i think my robots is not OK for wordpress

Discussion in 'robots.txt' started by Vebtools, Sep 12, 2009.

  1. #1
    here is my robots site

    i want google index all pages mention in my site map is it ok?

    actually this robot automatically created
     
    Vebtools, Sep 12, 2009 IP
  2. Vebtools

    Vebtools Well-Known Member

    Messages:
    2,619
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    145
    #2
    any one please reply to me
     
    Vebtools, Sep 14, 2009 IP
  3. renlok

    renlok Well-Known Member

    Messages:
    457
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    110
    #3
    renlok, Sep 14, 2009 IP
  4. Vebtools

    Vebtools Well-Known Member

    Messages:
    2,619
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    145
    #4
    i try my best remove robots file but it is not deleting :-s actually the sitemap generated plugin atomatically creat my virtual robot :(
     
    Vebtools, Sep 14, 2009 IP
  5. Vebtools

    Vebtools Well-Known Member

    Messages:
    2,619
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    145
    #5
    i dont know how to delete :-s actually i searched every where but not found.. it is a virtual robots file made by site map plugin (Wordpress)
     
    Vebtools, Sep 29, 2009 IP
  6. AKSIN

    AKSIN Peon

    Messages:
    159
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    No its not. Use like follows:

    User-Agent: *
    Allow: /

    file name should be sitemap.xml
     
    AKSIN, Sep 29, 2009 IP
  7. dren

    dren Active Member

    Messages:
    86
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #7
    This is correct and Ask.com, Google, Bing and Yahoo! all support this file.
     
    dren, Sep 29, 2009 IP
  8. shanmugasundaram

    shanmugasundaram Active Member

    Messages:
    230
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    70
    #8
    User-agent: *
    Disallow:

    Sitemap: http://www.mywebsite.com/sitemap.xml.gz

    i have like this and all my files are indexed and this is created by the plugin as you said

    you cannot find the file inside WWW if you want to change it just create a robots.txt file and upload in www folder
     
    shanmugasundaram, Sep 30, 2009 IP