1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to allow crawling a URL with a certain parameter

Discussion in 'robots.txt' started by Devtard, Apr 16, 2013.

  1. #1
    I have a dynamically generated calendar. There are only a few events so I don't want Google to crawl infinite number of pages where is actually nothing. The page with an event has a certain parameter, in this case it is "e".

    example.com/forum/calendar.php?do=getinfo&day=2013-2-27&e=857&c=2

    How to block calendar.php but allow URLs with the "e" parameter?
     
    Devtard, Apr 16, 2013 IP
  2. Devtard

    Devtard Notable Member

    Messages:
    850
    Likes Received:
    133
    Best Answers:
    4
    Trophy Points:
    220
    #2
    Solved.

    Disallow: /forum/calendar.php
    Allow: /forum/calendar.php?do=getinfo&day=*&e=*&c=*
    Code (markup):
     
    Devtard, Apr 17, 2013 IP