Can Amazon spider a Wordpress 404 error page for Omakase?

Discussion in 'Amazon' started by Chadrew, Sep 16, 2010.

  1. #1
    Hello,
    I had an idea about putting Amazon Omakase module in my custom Wordpress 404 error page. That page should have enough content for any spider to understand what the topic of the blog is (video games).

    Now the only question is... Can Amazon spider 404 pages? The server sends a "HTTP/1.1 404 Not Found" header when that page is accessed, just like it should. Will Amazon actually manage to spider it?

    Furthermore, Wordpress custom error pages just display the dynamic 404 page on any URL that is not found. Erm, I think an example would be best. Let's say I open my site and make up any random URL that doesn't exist:

    mysite.com/blablasomerandomletters

    Wordpress will display a 404 error at this address instead of redirecting you to another url (like mysite.com/404.html). This might be another issue for spiders, but I honestly don't know.

    What do you think?

    On a similar note, I've heard about people putting AdSense on their custom 404 pages - does AdSense spider manage to reach those then?
     
    Chadrew, Sep 16, 2010 IP