robots.txt

Find help with setting up your robots.txt file on your web site.

Page 12 of 19
Sort by:
Title Start Date
Replies Views
Last Message ↑
  1. chaukar

    index.html as default intead of index.php

    chaukar, Apr 2, 2010
    Replies:
    4
    Views:
    1,448
    nimonogi
    Apr 10, 2010
  2. sakshamtalwar

    Robots.txt for phpBB

    sakshamtalwar, Apr 9, 2010
    Replies:
    2
    Views:
    2,500
    sakshamtalwar
    Apr 10, 2010
  3. whiteeaglet

    Best Robot.txt designed for Pligg

    whiteeaglet, Oct 27, 2009
    Replies:
    1
    Views:
    2,773
    whiteeaglet
    Apr 17, 2010
  4. teohcl

    How to protect our robots.txt?

    teohcl, Mar 28, 2010
    Replies:
    6
    Views:
    4,064
    chauhanmanish
    Apr 21, 2010
  5. adinfinite

    What is meant by "upload robots.txt file to Top Level Domain?

    adinfinite, Apr 4, 2010
    Replies:
    8
    Views:
    2,289
    smartware
    Apr 26, 2010
  6. ghias

    Set Google Robots Problem?

    ghias, Apr 7, 2010
    Replies:
    7
    Views:
    1,483
    Allthebest
    Apr 28, 2010
  7. carol123in

    robots.txt

    carol123in, Apr 26, 2010
    Replies:
    2
    Views:
    1,058
    carol123in
    May 3, 2010
  8. Soraya Marques

    Robots.txt content

    Soraya Marques, May 1, 2010
    Replies:
    3
    Views:
    1,313
    iloveindia
    May 3, 2010
  9. smartware

    What is User Agent?

    smartware, Apr 25, 2010
    Replies:
    2
    Views:
    1,077
    iloveindia
    May 3, 2010
  10. intellg

    How to stop my all external link crawling?

    intellg, May 5, 2010
    Replies:
    1
    Views:
    953
    onlinesujeet
    May 18, 2010
  11. agklein

    Can robots.txt block or allow search engines from specific countries?

    agklein, May 20, 2010
    Replies:
    2
    Views:
    1,461
    agklein
    May 23, 2010
  12. weathor

    Too many googlebot hits

    weathor, Apr 6, 2010 ... 2
    Replies:
    25
    Views:
    6,785
    kevoh99
    May 25, 2010
  13. jack_sparrow

    Help needed - robts.txt and sitemap

    jack_sparrow, Aug 3, 2007 ... 3 4 5
    Replies:
    89
    Views:
    23,704
    kevoh99
    May 25, 2010
  14. mithu.singh
    Locked

    What is robot.txt files.

    mithu.singh, May 22, 2010
    Replies:
    13
    Views:
    1,356
    goldenminds
    May 25, 2010
  15. internet money making

    Robot tag

    internet money making, Apr 29, 2010
    Replies:
    4
    Views:
    1,123
    lonew
    May 29, 2010
  16. Imozeb

    Is this robots.txt file correct?

    Imozeb, May 5, 2010
    Replies:
    10
    Views:
    1,665
    luckzz1000
    May 30, 2010
  17. internet money making

    robot.txt is necessary ?

    internet money making, Apr 26, 2010
    Replies:
    10
    Views:
    1,613
    aeroz1
    Jun 7, 2010
  18. ysribharath

    am i correct ?

    ysribharath, Jun 10, 2010
    Replies:
    1
    Views:
    950
    manish.chauhan
    Jun 10, 2010
  19. 1rapid

    help make a robots.txt

    1rapid, Jun 6, 2010
    Replies:
    3
    Views:
    1,103
    manish.chauhan
    Jun 11, 2010
  20. No_name

    URL restriction tips

    No_name, Jun 2, 2010
    Replies:
    1
    Views:
    1,215
    manish.chauhan
    Jun 11, 2010
  21. thosecars82

    robots.txt how prevent pages under website's root folder from being listed by Google

    thosecars82, Jun 3, 2010
    Replies:
    1
    Views:
    1,162
    manish.chauhan
    Jun 11, 2010
  22. Ralarash

    Robots txt file permission

    Ralarash, Apr 30, 2010
    Replies:
    9
    Views:
    22,500
    manish.chauhan
    Jun 11, 2010
  23. cahyoaja

    robot.txt for blogspot

    cahyoaja, May 8, 2010
    Replies:
    1
    Views:
    1,094
    manish.chauhan
    Jun 11, 2010
  24. SearchBliss

    Google's Robots.txt Tip

    SearchBliss, May 30, 2010
    Replies:
    5
    Views:
    1,549
    manish.chauhan
    Jun 13, 2010
  25. zinghana

    Robots.txt advice needed

    zinghana, Jun 18, 2010
    Replies:
    1
    Views:
    1,001
    manish.chauhan
    Jun 20, 2010
  26. Tanha Karim

    Is robots.txt file decrease our Adsense Revenue ?

    Tanha Karim, Jun 3, 2010
    Replies:
    4
    Views:
    1,490
    manish.chauhan
    Jun 22, 2010
  27. Charlee22

    Pattern Matching in Robots.txt !

    Charlee22, Jun 22, 2010
    Replies:
    1
    Views:
    1,326
    manish.chauhan
    Jun 23, 2010
  28. Rakhi Chowdhary

    My Site Shows many pages which I don't want search engine to crawl

    Rakhi Chowdhary, Jun 22, 2010
    Replies:
    3
    Views:
    1,331
    manish.chauhan
    Jun 24, 2010
  29. Groovystar

    Need help on robots.txt

    Groovystar, Jun 24, 2010
    Replies:
    2
    Views:
    1,121
    Groovystar
    Jun 25, 2010
  30. milan.mysterio

    what is robot.txt and how is it important for SEO

    milan.mysterio, Jun 8, 2010
    Replies:
    8
    Views:
    1,717
    edpatton
    Jun 29, 2010
  31. arcademan

    block root directory and all subdirectories?

    arcademan, Jun 29, 2010
    Replies:
    1
    Views:
    1,053
    manish.chauhan
    Jun 30, 2010
  32. durgesh871

    How to analyze robots.txt for errors ?

    durgesh871, Jun 30, 2010
    Replies:
    3
    Views:
    1,340
    alexeyd
    Jul 2, 2010
  33. arcademan

    block root directory and all subdirectories?

    arcademan, Jun 29, 2010
    Replies:
    2
    Views:
    1,561
    manish.chauhan
    Jul 7, 2010
  34. wan.ariffuddin

    How do i remove my history from INTERNET ARCHIVE WAYBACK MACHINE

    wan.ariffuddin, Jul 8, 2010
    Replies:
    1
    Views:
    7,793
    manish.chauhan
    Jul 8, 2010
  35. Chalkywhite

    Blog logs and robots.txt

    Chalkywhite, Jul 8, 2010
    Replies:
    3
    Views:
    1,140
    manish.chauhan
    Jul 9, 2010
  36. fadetoblack22

    Robots.txt not working for wordpress.

    fadetoblack22, Jul 8, 2010
    Replies:
    6
    Views:
    2,364
    fadetoblack22
    Jul 9, 2010
  37. jnelson563

    Help with blocking affiliate URLs

    jnelson563, Jun 17, 2010 ... 2
    Replies:
    23
    Views:
    3,842
    manish.chauhan
    Jul 12, 2010
  38. cDc

    Blocking certain querystring parameters

    cDc, Jul 13, 2010
    Replies:
    3
    Views:
    1,217
    manish.chauhan
    Jul 15, 2010
  39. Coldfaun

    Problem with robots.txt

    Coldfaun, Jul 12, 2010
    Replies:
    14
    Views:
    1,749
    Groovystar
    Jul 17, 2010
  40. mobixone

    Please Guid me

    mobixone, Apr 16, 2009
    Replies:
    9
    Views:
    2,901
    newlogo
    Jul 20, 2010
  41. internet money making

    is it necessay robots.txt

    internet money making, Apr 27, 2010
    Replies:
    3
    Views:
    1,315
    travelguides
    Jul 25, 2010
  42. Neil UK

    Robots.txt and Google crawl error

    Neil UK, Jul 10, 2010
    Replies:
    6
    Views:
    2,200
    mattstevens40
    Jul 27, 2010
  43. life31

    Please help me in listing the useful bots or user agents.

    life31, Jun 15, 2009
    Replies:
    3
    Views:
    2,068
    zero_124
    Jul 27, 2010
  44. Talker

    Robots.txt for Vbulletin

    Talker, Oct 13, 2006
    Replies:
    11
    Views:
    6,903
    zinghana
    Jul 31, 2010
  45. catilucky

    robots.txt

    catilucky, Aug 2, 2010
    Replies:
    1
    Views:
    1,077
    zacharooni
    Aug 3, 2010
  46. PuneetJvw

    How bad is it to NOT have a robots.txt file

    PuneetJvw, Jan 16, 2010 ... 2
    Replies:
    22
    Views:
    5,962
    smartamit04
    Aug 4, 2010
  47. astrohope

    What to Allow and Disallow on robots.txt

    astrohope, Jul 5, 2010
    Replies:
    6
    Views:
    2,252
    joseph pop
    Aug 5, 2010
  48. khemraj

    Robot.txt help

    khemraj, Jul 30, 2010
    Replies:
    3
    Views:
    1,220
    bieberfc.com
    Aug 9, 2010
  49. smartamit04

    Can we use robot for content of page?????

    smartamit04, Aug 4, 2010
    Replies:
    2
    Views:
    1,205
    Mikesloug
    Aug 10, 2010
  50. jitendraag

    Last.fm's robots.txt

    jitendraag, Jul 28, 2010
    Replies:
    3
    Views:
    2,360
    jitendraag
    Aug 17, 2010
Showing threads 551 to 600 of 911

Thread Display Options

Loading...
Page 12 of 19