How to allow crawling a URL with a certain parameter

Discussion in 'robots.txt' started by Devtard, Apr 16, 2013.

0
  1. #1
    I have a dynamically generated calendar. There are only a few events so I don't want Google to crawl infinite number of pages where is actually nothing. The page with an event has a certain parameter, in this case it is "e".

    example.com/forum/calendar.php?do=getinfo&day=2013-2-27&e=857&c=2

    How to block calendar.php but allow URLs with the "e" parameter?
     
    Devtard, Apr 16, 2013 IP
  2. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #2
    Solved.

    Disallow: /forum/calendar.php
Allow: /forum/calendar.php?do=getinfo&day=*&e=*&c=*
    Code (markup):
     
    Devtard, Apr 17, 2013 IP