1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

how i can force search engine crawler to crawl my site ?

Discussion in 'robots.txt' started by solution9, Aug 15, 2010.

  1. #1
    hi i can keep them for long time and for crawl all the pages ??
     
    solution9, Aug 15, 2010 IP
  2. cyberlight

    cyberlight Peon

    Messages:
    343
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Make sure you

    1. Have a sitemap. If you have a wp blog you can
    install a plugin to do this for you.

    2.Ping it also.... Again if you have a WP Blog you can install a
    plugin for this also.

    3. Submit your RSS Feed

    4. Social Book marking will also bring the spiders

    Hope this helps.
     
    cyberlight, Aug 15, 2010 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    There is no dead sure way you can force crawlers to crawl your website. However, if your website has some great content and some potential backlinks, crawlers will automatically starting following your website.
     
    manish.chauhan, Aug 16, 2010 IP
  4. ThatThing

    ThatThing Well-Known Member

    Messages:
    104
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    110
    #4
    It's really easy to ping sites using http://pingler.com/
     
    ThatThing, Aug 18, 2010 IP
  5. maninwhite

    maninwhite Peon

    Messages:
    32
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    sitemap
    robots
    great content
    ping
     
    maninwhite, Aug 18, 2010 IP
  6. infogle

    infogle Prominent Member

    Messages:
    2,732
    Likes Received:
    128
    Best Answers:
    1
    Trophy Points:
    300
    #6
    The one and foremost way to have your site crawled is submit your sitemap to search engine and they will quickly crawl your site.

    Hope this helps...
     
    infogle, Aug 18, 2010 IP
  7. ruth.mendez

    ruth.mendez Greenhorn

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    11
    #7
    Don't mind manipulating or controlling robots of different SE's. Just keep your content fresh and linking pattern consistent. That's your target anyway...
     
    ruth.mendez, Aug 18, 2010 IP
  8. SteveDakine

    SteveDakine Peon

    Messages:
    14
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Site crawlability is vital. Sitemaps are actually very good for this. Try to use an XML sitemap that is updatable. For very large sites you may only realistically be able to update down to the sub-category level. With regards robots.txt files, ensure they have zero mistakes, may sound obvious but it is very easy to misplace a character or number and end up with swathes of your site not being seen by the search engines.
     
    SteveDakine, Aug 22, 2010 IP
  9. seo.lover

    seo.lover Peon

    Messages:
    132
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    i think frequent updation can do this for your site
     
    seo.lover, Aug 29, 2010 IP