I have added this link: disallow: *wap in my robots.txt file but google is still indexing my website url as wap links and most of them are wap links only... Pls help me how To avoid this? Thank you.
I dont want google to include the wap version of my post.. What is the meaning of this disallow: /yourfile.php I want to block all the url ... My site is : forum.wedost.com
Almost 60% of url indexed in google from my website is wap version.. Will google will delete it after some time? If not why google is storing the wap version not original version.. I have already restricted wap in my robot file..
oh, i see your point. put this on your robots.txt and fill the directory or file that you dont want to google index in disallow:/ or put robots.txt in your root directory of your wap version
I have done for my wap listing.. But still google is indexing the new posts as wap version , not as original version..
what i use in smf is User-agent: Googlebot Disallow: /index.php?*;wap Disallow: /index.php?*;wap2 Disallow: /index.php?*;imode works for me but will take time for them to become de-indexed. Once the robots txt is in place you could also use the remove url in google webmaster tools if you are careful.
you can removing your indexed url from google webmaster if you need it to remove the url that you dont want google to index.
It can take some time to dis-allow Google from indexing it as well as if you want to remove some listing from Google then you need to request them manually.
Although you have changed your Robots.txt file, usually, it will need some time to remove the indexed wap webpages for Google spiders. So, don't worry about that, just wait for the change gradually.