How to Disallow Dynamic URL?

Discussion in 'Search Engine Optimization' started by infograb, Jun 11, 2008.

0
  1. #1
    Hi,

    From my domain some of dynamic URLs crawled in Google.
    Some example URLs given here.

    http://www.domainname.com/index.html?agent_camp=16643001&agent_bann=213 87001
    http://www.domainname.com/index.html?agent_camp=16593001&agent_bann=20423001
    http://www.domainname.com/pagename....utm_medium=CPC&ovmtc=content&ovadid=548417531
    http://www.domainname.com/?utm_source=tumblrblog&utm_medium=tlink

    I want to stop crawler to crawl this type of URL.
    Anyone suggest how to stop crawler to crawl these URLs.
     
    infograb, Jun 11, 2008 IP
  2. webcosmo

    webcosmo Notable Member

    Messages:
    5,840
    Likes Received:
    153
    Best Answers:
    2
    Trophy Points:
    255
    #2
    What you can do is on your pages detect the user agent; if its a bot and page have querystring like you mentioned do a 301 permanent redirect to the main page without query string.
     
    webcosmo, Jun 11, 2008 IP