Hi, I recently launched a new site and its indexed by Google just fine, but Yahoo and Bing just are not seeing it, even if I type the full URL into the browser. I have submitted the site to both engines and added site maps and upp'ed the crawl rate - but its just not happening and I submitted well over 10 days ago I'm at a loss and really could do with some advice... help! The URL is www.icroak.com
It's best to provide you with a source rather than feed you a line of garbage that you may not understand. Also just a kindly reminder "Google is your friend" do a search for Yahoo indexing FAQ and Bing indexing FAQ, the first 3 results if not the top 2 will be your answer. help.yahoo.com/l/us/yahoo/search/indexing/ bing.com/community/webmaster/f/12252/t/646805.aspx
Not meaning to be blunt, but this is an invalid source of support. The object of it's meaning is to input the tagged information he/she needs rather than placing content in this thread that he/she would not understand what you're saying to them.
Hi I have no reference to blocking the engines in my robots, bascially all I have in there is reference to my site map@JD - I checked those links and it appears to me I have done all the references they point toAny other suggestions please?ThanksPaul
Hey icroak, I checked your page source and found no errors. Can you paste your robots.txt for me so I can see where you may be going wrong at? Also, what system are you using to run your site? I.E Drupal etc.
HiContents of rbots.txt is below# Optional sitemap URL:Sitemap: http://icroak.com/sitemap.xmlSitemap: https://online.webceo.com/submission/smaps/e41937d4.xml.gz# End robots.txt fileSite is in .phpthanksPaul
Ok so this is your robots.txt? If so then this is where your issues is at. Use this link I am providing for you and be sure to put your robots.txt in your root folder of your sites FTP. mcanerin.com/en/search-engine/robots-txt.asp
HiOk, this is the content now - hopefully this will work# robots.txt generated at http://www.mcanerin.comUser-agent: *Disallow: Disallow: /cgi-bin/Sitemap: http://www.icroak.com/sitemap.gzSitemap: https://online.webceo.com/submission/smaps/e41937d4.xml.gz
HiOk, this is the content now - hopefully this will work - the live has the http, it won't let me post the actual URLS# robots.txt generated at www.mcanerin.comUser-agent: *Disallow: Disallow: /cgi-bin/Sitemap: www.icroak.com/sitemap.gzSitemap: online.webceo.com/submission/smaps/e41937d4.xml.gz
Here is an example of my robots.txt User-agent: * Crawl-delay: 10 # Directories Disallow: /includes/ Disallow: /misc/ Disallow: /modules/ Disallow: /profiles/ Disallow: /scripts/ Disallow: /themes/ Disallow: /comment/reply Disallow: /node/add Disallow: /archive/ Disallow: /tracker/ Disallow: /user/ Disallow: /*?* Disallow: /*feed You want to block as much as possible from the indexing, in other words just give the spiders access to the content only. In this case it is my other sub-folders and as well with login pages and admin as well. Copy this if you like, this is only half of my robots.txt file but it's a great example of what you want yours to look like.
Bing (which also powers Yahoo) is sloooow at indexing new sites, especially when they're small - I submitted my site and was checking it every day for two weeks - finally I just gave up . After about a month, it was finally on Bing and Yahoo, but I saw no traffic (even to this day, Google is the sole provider). It's not really worth bothering in some niches, but if you do SEO for Google, it will work just as well or even better for Bing.
Are Bing and Yahoo now just two brandings for the same SE or do they still maintain separate databases. I noticed my Firefox Rank Checker plugin now just treats them as one SE.