1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Crawl

Discussion in 'All Other Search Engines' started by sajjad037, Jun 30, 2011.

0
  1. #1
    what is the meaning Crawl in term of Search Engine ?
     
    sajjad037, Jun 30, 2011 IP
  2. Alan Smith

    Alan Smith Active Member

    Messages:
    1,263
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #2
    Crawling is process which is used by search bot or crawler or spider(software/application) to index pages of website.
     
    Alan Smith, Jun 30, 2011 IP
  3. sajjad037

    sajjad037 Peon

    Messages:
    15
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Can you define more how to use Crawler
     
    sajjad037, Jul 1, 2011 IP
  4. seosemguy

    seosemguy Member

    Messages:
    165
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    48
    #4
    A Web crawler is a computer program that browses the World Wide Web in a methodical, automated manner. Other terms for Web crawlers are ants, automatic indexers, bots, and worms or Web spider, Web robot, or—especially in the FOAF community—Web scutter.

    This process is called Web crawling or spidering. Many sites, in particular search engines, use spidering as a means of providing up-to-date data. Web crawlers are mainly used to create a copy of all the visited pages for later processing by a search engine that will index the downloaded pages to provide fast searches. Crawlers can also be used for automating maintenance tasks on a Web site, such as checking links or validating HTML code. Also, crawlers can be used to gather specific types of information from Web pages, such as harvesting e-mail addresses (usually for spam).

    A Web crawler is one type of bot, or software agent. In general, it starts with a list of URLs to visit, called the seeds. As the crawler visits these URLs, it identifies all the hyperlinks in the page and adds them to the list of URLs to visit, called the crawl frontier. URLs from the frontier are recursively visited according to a set of policies.
     
    seosemguy, Jul 1, 2011 IP
  5. Jenny4u

    Jenny4u Member

    Messages:
    271
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    28
    #5
    Crawling is nothing but checking the pages.
     
    Jenny4u, Jul 2, 2011 IP
  6. uday nikam

    uday nikam Peon

    Messages:
    318
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Web crawling means spidering in particular search engine, use spidering as a means of providing up-to-date data.
     
    uday nikam, Jul 4, 2011 IP
  7. veedabiometrics

    veedabiometrics Peon

    Messages:
    64
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Hello friend,

    crawlers are constantly search on web for new or updated information or pages.
     
    veedabiometrics, Jul 4, 2011 IP
  8. markhamilton

    markhamilton Member

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #8
    Crawl mean web pages are crawled (Indexed) by spider and bot of Search Engine.
     
    markhamilton, Jul 4, 2011 IP
  9. unknownpray

    unknownpray Active Member

    Messages:
    3,831
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    70
    #9
    Crawl means when a Search Engine Spider (also known as crawler) "crawls" along your page and reads the text and urls and stores them in it's huge index of already crawled pages. From here the results are displayed when someone then searches for that page.
     
    unknownpray, Aug 20, 2011 IP
  10. amherstsowell

    amherstsowell Peon

    Messages:
    261
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Crawl means an software of a search engine when visits on any web-page then it said that crawler is crawling a page, and this technique is known by name crawl.
     
    amherstsowell, Aug 24, 2011 IP
  11. rising_sun

    rising_sun Peon

    Messages:
    908
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #11
    That must be required to get PR.
     
    rising_sun, Aug 27, 2011 IP
  12. ralf45

    ralf45 Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    search engine spider known as crawlers it crawl your web pages and give them rank so its very important from the pr view.
     
    ralf45, Aug 29, 2011 IP