I have problem regarding the indexing and crawling of my website. My website is meant to serve only Indian users and hence i have blocked the IPs of all other regions from entering my site. Currently, since most Google IPs are from US, I cant get them to crawl my site. Also, I have placed a temporary redirect for all non Indian IPs to be redirected to the global website. Now I dont know when Google IPs from India will crawl my site. Currently my site is not indexed and Crawled in Google India. I want other solutions to solve the matter as to how can I get Google to crawl the site and keep my website visible only to Indian Audiences. Please help me with this. P.S:- I found this thread to be escalated under this category. Apologize if it doesn't fit to the category. Do share your feedback, as our website is in critical stage.
Hi, first you want to register your web into Google Webmasters - http://www.google.com/webmasters/ - for lots of interesting information about your web and ability to manually ask Google robot to check your web and actually see its result. Then you want to read this article - https://support.google.com/webmasters/answer/1061943?hl=en - to find out which user agents Google robots use. Then you want to configure your web in order to allow access for requests made with these user agents - for example with a help of this article - http://stackoverflow.com/questions/11864727/htaccess-allow-all-from-specific-user-agent