1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Need Help!! with Robots.txt

Discussion in 'Search Engine Optimization' started by ikishan, Apr 28, 2014.

  1. #1
    Hi guys,
    my website is been coded to disallow the search engines to crawl
    www.auravedic.com/robots.txt

    i just cannot locate the robots.txt file in my Cpanal directory i searched every folder including the hidden files
    but just couldn't locate the file

    is there any other way to find the file or any other way so that google can crawl my website?
    Please help
     
    ikishan, Apr 28, 2014 IP
  2. unna

    unna Well-Known Member

    Messages:
    3,274
    Likes Received:
    43
    Best Answers:
    0
    Trophy Points:
    140
    #2
    Your file contained following texts.

    User-agent: *
    Disallow: /

    I will suggest you to create new file and upload to the directory.
     
    unna, Apr 28, 2014 IP
  3. iwebsocial

    iwebsocial Well-Known Member

    Messages:
    1,715
    Likes Received:
    69
    Best Answers:
    4
    Trophy Points:
    170
    #3
    Your robots.txt is located on the root folder of your site like "public_html" if you are using c Panel.
     
    iwebsocial, Apr 28, 2014 IP
  4. ikishan

    ikishan Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #4
    iwebsocial thank your reply. but no its not there . i even used search option but couldn't find it.
     
    ikishan, Apr 28, 2014 IP
  5. homer7

    homer7 Well-Known Member

    Messages:
    268
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    125
    #5
    since you are running nginx, the root folder should be on:
    /var/www/auravedic.com
    or
    /var/www
     
    homer7, Apr 28, 2014 IP
  6. ikishan

    ikishan Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #6
    Thanks but will that work? how long it might take to work? is there any instant tool that i can check that google can now crawl the website.
     
    ikishan, Apr 28, 2014 IP
  7. ikishan

    ikishan Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #7
    there wasn't any folder as var in the file manager.
    cpanal.jpg these are all the directories. which have
     
    ikishan, Apr 28, 2014 IP
  8. Kamaldeep Singh SEO

    Kamaldeep Singh SEO Well-Known Member

    Messages:
    210
    Likes Received:
    14
    Best Answers:
    1
    Trophy Points:
    155
    #8
    Yes Of course You can Create new file and update it again.

    User-agent: *
    Allow: /
    Disallow: /public_html/_movedcontent
    Disallow: /public_html/old/images
    and Create sitemap submit it.
     
    Kamaldeep Singh SEO, Apr 29, 2014 IP
  9. homer7

    homer7 Well-Known Member

    Messages:
    268
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    125
    #9
    because you don't have root access. the root folder is the parent of the home folder.
     
    homer7, Apr 29, 2014 IP
  10. debajyotibanerji

    debajyotibanerji Member

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #10
    go to the public_html directory and you can see robots.txt there. download it via filezilla and then change it to :
    User-agent: *
    Disallow:
     
    debajyotibanerji, Apr 29, 2014 IP
  11. ikishan

    ikishan Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #11
    Thank you. It worked
     
    ikishan, May 4, 2014 IP
  12. meethi jain

    meethi jain Active Member

    Messages:
    169
    Likes Received:
    0
    Best Answers:
    1
    Trophy Points:
    56
    #12
    The programs. txt can be located on the underlying folder of this site just like "public_html" if you use d Solar panel.
     
    meethi jain, May 8, 2014 IP
  13. Pooja Gupta

    Pooja Gupta Member

    Messages:
    193
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #13
    You can create the new robot.txt file and upload in c panel.
     
    Pooja Gupta, May 9, 2014 IP
  14. IAMHeisenberg

    IAMHeisenberg Greenhorn

    Messages:
    11
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    21
    #14
    Put a Folder in your Directory if you cant Find it
     
    IAMHeisenberg, May 10, 2014 IP
    MarielaSchmidt likes this.
  15. MarielaSchmidt

    MarielaSchmidt Member

    Messages:
    15
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    30
    #15
    Exactly i think one needs to manually insert that file
     
    MarielaSchmidt, May 17, 2014 IP
  16. PraveenaM

    PraveenaM Banned

    Messages:
    18
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #16
    Create robot.txt file in " C" panel
     
    PraveenaM, May 17, 2014 IP