What is wildcard SEO

Discussion in 'Search Engine Optimization' started by seoblore, Nov 9, 2008.

  1. #1
    What is wildcard SEO and how is working in seo factor
     
    seoblore, Nov 9, 2008 IP
  2. carfinance

    carfinance Peon

    Messages:
    156
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Google's URL removal page contains a little bit of handy information that's not found on their webmaster info pages where it should be.

    Google supports the use of 'wildcards' in robots.txt files. This isn't part of the original 1994 robots.txt protocol, and as far as I know, is not supported by other search engines. To make it work, you need to add a separate section for Googlebot in your robots.txt file. An example:

    User-agent: Googlebot
    Disallow: /*sort=

    This would stop Googlebot from reading any URL that included the string &sort= no matter where that string occurs in the URL.
     
    carfinance, Nov 9, 2008 IP
  3. ajaylulia

    ajaylulia Peon

    Messages:
    56
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    The best resource to learn more about robots.txt is http://www.robotstxt.org/
     
    ajaylulia, Nov 9, 2008 IP