Build Search Engine with same database as Google!!!

Discussion in 'Google' started by napsterkosova, Mar 10, 2011.

  1. #1
    Hi,

    I'm just surfing the forum for couple of hours and I see so many people trying to be first competitor of Facebook, Google and similar site.

    Therefore I'm about to tell you how to become first competitor of Google! :)

    1. You have to invest about 1200$
    2. buy a dedicated server
    3. design the simple site
    4. Use the info's below :)

    Google Robots :)
    User-agent: *
    Disallow: /search
    Disallow: /groups
    Disallow: /images
    Disallow: /catalogs
    Disallow: /catalogues
    Disallow: /news
    Allow: /news/directory
    Disallow: /nwshp
    Disallow: /setnewsprefs?
    Disallow: /index.html?
    Disallow: /?
    Disallow: /addurl/image?
    Disallow: /pagead/
    Disallow: /relpage/
    Disallow: /relcontent
    Disallow: /imgres
    Disallow: /imglanding
    Disallow: /keyword/
    Disallow: /u/
    Disallow: /univ/
    Disallow: /cobrand
    Disallow: /custom
    Disallow: /advanced_group_search
    Disallow: /googlesite
    Disallow: /preferences
    Disallow: /setprefs
    Disallow: /swr
    Disallow: /url
    Disallow: /default
    Disallow: /m?
    Disallow: /m/?
    Disallow: /m/blogs?
    Disallow: /m/directions?
    Disallow: /m/ig
    Disallow: /m/images?
    Disallow: /m/imgres?
    Disallow: /m/local?
    Disallow: /m/movies?
    Disallow: /m/news?
    Disallow: /m/news/i?
    Disallow: /m/place?
    Disallow: /m/products?
    Disallow: /m/products/
    Disallow: /m/setnewsprefs?
    Disallow: /m/search?
    Disallow: /m/swmloptin?
    Disallow: /m/trends
    Disallow: /m/video?
    Disallow: /wml?
    Disallow: /wml/?
    Disallow: /wml/search?
    Disallow: /xhtml?
    Disallow: /xhtml/?
    Disallow: /xhtml/search?
    Disallow: /xml?
    Disallow: /imode?
    Disallow: /imode/?
    Disallow: /imode/search?
    Disallow: /jsky?
    Disallow: /jsky/?
    Disallow: /jsky/search?
    Disallow: /pda?
    Disallow: /pda/?
    Disallow: /pda/search?
    Disallow: /sprint_xhtml
    Disallow: /sprint_wml
    Disallow: /pqa
    Disallow: /palm
    Disallow: /gwt/
    Disallow: /purchases
    Disallow: /hws
    Disallow: /bsd?
    Disallow: /linux?
    Disallow: /mac?
    Disallow: /microsoft?
    Disallow: /unclesam?
    Disallow: /answers/search?q=
    Disallow: /local?
    Disallow: /local_url
    Disallow: /froogle?
    Disallow: /products?
    Disallow: /products/
    Disallow: /froogle_
    Disallow: /product_
    Disallow: /products_
    Disallow: /products;
    Disallow: /print
    Disallow: /books
    Disallow: /bkshp?q=
    Allow: /booksrightsholders
    Disallow: /patents?
    Disallow: /patents/
    Allow: /patents/about
    Disallow: /scholar
    Disallow: /complete
    Disallow: /s?
    Disallow: /sponsoredlinks
    Disallow: /videosearch?
    Disallow: /videopreview?
    Disallow: /videoprograminfo?
    Disallow: /maps?
    Disallow: /mapstt?
    Disallow: /mapslt?
    Disallow: /maps/stk/
    Disallow: /maps/br?
    Disallow: /mapabcpoi?
    Disallow: /maphp?
    Disallow: /mapprint?
    Disallow: /maps/api/js/StaticMapService.GetMapImage?
    Disallow: /maps/api/staticmap?
    Disallow: /mld?
    Disallow: /staticmap?
    Disallow: /places/
    Allow: /places/$
    Disallow: /maps/place
    Disallow: /help/maps/streetview/partners/welcome/
    Disallow: /lochp?
    Disallow: /center
    Disallow: /ie?
    Disallow: /sms/demo?
    Disallow: /katrina?
    Disallow: /blogsearch?
    Disallow: /blogsearch/
    Disallow: /blogsearch_feeds
    Disallow: /advanced_blog_search
    Disallow: /reader/
    Allow: /reader/play
    Disallow: /uds/
    Disallow: /chart?
    Disallow: /transit?
    Disallow: /mbd?
    Disallow: /extern_js/
    Disallow: /calendar/feeds/
    Disallow: /calendar/ical/
    Disallow: /cl2/feeds/
    Disallow: /cl2/ical/
    Disallow: /coop/directory
    Disallow: /coop/manage
    Disallow: /trends?
    Disallow: /trends/music?
    Disallow: /trends/hottrends?
    Disallow: /trends/viz?
    Disallow: /notebook/search?
    Disallow: /musica
    Disallow: /musicad
    Disallow: /musicas
    Disallow: /musicl
    Disallow: /musics
    Disallow: /musicsearch
    Disallow: /musicsp
    Disallow: /musiclp
    Disallow: /browsersync
    Disallow: /call
    Disallow: /archivesearch?
    Disallow: /archivesearch/url
    Disallow: /archivesearch/advanced_search
    Disallow: /base/reportbadoffer
    Disallow: /urchin_test/
    Disallow: /movies?
    Disallow: /codesearch?
    Disallow: /codesearch/feeds/search?
    Disallow: /wapsearch?
    Disallow: /safebrowsing
    Allow: /safebrowsing/diagnostic
    Allow: /safebrowsing/report_error/
    Allow: /safebrowsing/report_phish/
    Disallow: /reviews/search?
    Disallow: /orkut/albums
    Allow: /jsapi
    Disallow: /views?
    Disallow: /c/
    Disallow: /cbk
    Disallow: /recharge/dashboard/car
    Disallow: /recharge/dashboard/static/
    Disallow: /translate_a/
    Disallow: /translate_c
    Disallow: /translate_f
    Disallow: /translate_static/
    Disallow: /translate_suggestion
    Disallow: /profiles/me
    Allow: /profiles
    Disallow: /s2/profiles/me
    Allow: /s2/profiles
    Allow: /s2/photos
    Allow: /s2/static
    Disallow: /s2
    Disallow: /transconsole/portal/
    Disallow: /gcc/
    Disallow: /aclk
    Disallow: /cse?
    Disallow: /cse/home
    Disallow: /cse/panel
    Disallow: /cse/manage
    Disallow: /tbproxy/
    Disallow: /imesync/
    Disallow: /shenghuo/search?
    Disallow: /support/forum/search?
    Disallow: /reviews/polls/
    Disallow: /hosted/images/
    Disallow: /ppob/?
    Disallow: /ppob?
    Disallow: /ig/add?
    Disallow: /adwordsresellers
    Disallow: /accounts/o8
    Allow: /accounts/o8/id
    Disallow: /topicsearch?q=
    Disallow: /xfx7/
    Disallow: /squared/api
    Disallow: /squared/search
    Disallow: /squared/table
    Disallow: /toolkit/
    Allow: /toolkit/*.html
    Disallow: /globalmarketfinder/
    Allow: /globalmarketfinder/*.html
    Disallow: /qnasearch?
    Disallow: /app/updates
    Disallow: /sidewiki/entry/
    Disallow: /quality_form?
    Disallow: /labs/popgadget/search
    Disallow: /buzz/post
    Disallow: /compressiontest/
    Disallow: /analytics/reporting/
    Disallow: /analytics/admin/
    Disallow: /analytics/web/
    Disallow: /analytics/feeds/
    Disallow: /analytics/settings/
    Disallow: /alerts/
    Disallow: /ads/preferences/
    Allow: /ads/preferences/html/
    Allow: /ads/preferences/plugin
    Disallow: /phone/compare/?
    Allow: /alerts/manage
    Sitemap: http://www.gstatic.com/s2/sitemaps/profiles-sitemap.xml
    Sitemap: http://www.google.com/hostednews/sitemap_index.xml
    Sitemap: http://www.google.com/ventures/sitemap_ventures.xml
    Sitemap: http://www.google.com/sitemaps_webmasters.xml
    Sitemap: http://www.gstatic.com/trends/websites/sitemaps/sitemapindex.xml
    Sitemap: http://www.gstatic.com/dictionary/static/sitemaps/sitemap_index.xml
    Code (markup):
    This is just for fun:)

    Thanks
     
    napsterkosova, Mar 10, 2011 IP
  2. rakesh.tcy

    rakesh.tcy Peon

    Messages:
    370
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    WOW ! buddy its not easy. where you will get huge database of Google.
     
    rakesh.tcy, Mar 10, 2011 IP
  3. napsterkosova

    napsterkosova Peon

    Messages:
    35
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Take Google's Sitemap :) Add to your new Search Engine :p
     
    napsterkosova, Mar 10, 2011 IP
  4. fr@nc!z

    fr@nc!z Active Member

    Messages:
    1,545
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    80
    #4
    So... What is point of such site like that?
     
    fr@nc!z, Mar 10, 2011 IP
  5. saqib889

    saqib889 Peon

    Messages:
    1,291
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Put the Google search engine it self. and no need to do anything. :)
     
    saqib889, Mar 10, 2011 IP
  6. napsterkosova

    napsterkosova Peon

    Messages:
    35
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Guys guys :) Read above :) This post is just for fun from my side :) that's the point of site like that :)

    Buy maybe someone will find it useful who know

    Thanks
     
    napsterkosova, Mar 10, 2011 IP
  7. DoDo Me

    DoDo Me Peon

    Messages:
    2,257
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Google sitemap is just some static content, not them database
     
    DoDo Me, Mar 11, 2011 IP
  8. RumpledElf

    RumpledElf Well-Known Member

    Messages:
    1,054
    Likes Received:
    13
    Best Answers:
    0
    Trophy Points:
    100
    #8
    I have this vague notion of going up against google (not the whole company, just one part of one product) and it is going to cost a LOT more than $1200 to kick it off ...
     
    RumpledElf, Mar 11, 2011 IP
  9. ForgottenCreature

    ForgottenCreature Notable Member

    Messages:
    7,473
    Likes Received:
    173
    Best Answers:
    0
    Trophy Points:
    260
    #9
    lol, Google drives traffic, why go against it? Can't beat them
     
    ForgottenCreature, Mar 11, 2011 IP