How to create a robots file for PHP webpage to crawl

Discussion in 'robots.txt' started by Prasseo, Jan 12, 2015.

0
  1. #1
    Hi Friends,

    http://www.ksmwebmedia.com
    content is cached by search engine
    what to do now still it is displaying the old content in the search results even updating with the new description.

    Thanks
     
    Prasseo, Jan 12, 2015 IP
  2. meethi jain

    meethi jain Active Member

    Messages:
    169
    Likes Received:
    0
    Best Answers:
    1
    Trophy Points:
    56
    #2
    google don't use cache, may be in your system have a cache, you are unable to see the updation, clear the system cache
     
    meethi jain, Jun 3, 2015 IP
  3. O-D-T

    O-D-T Member

    Messages:
    180
    Likes Received:
    10
    Best Answers:
    3
    Trophy Points:
    43
    #3
    If the search engine is Google then use Google Webmasters (newly Search Console) feature called "Fetch as Google". This allows you to tell Google that a new content is there and it will crawl the site.

    If the search engine is Bing then they have similar service called Bing Webmaster Tools
     
    O-D-T, Jun 4, 2015 IP
  4. abinjoy

    abinjoy Member

    Messages:
    110
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #4
    Please clear all the browsing data and do the search. Or you can use incognito window. Use the keyboard shortcut Ctrl+Shift+N to open an incognito window and do the search
     
    abinjoy, Jul 14, 2015 IP