Hi all, My site started to get index in google. 1) My www.example.com\wp-admin page of wordpress is also showing up in the indexed page. 2) and my i have made sitemap file in my html directory and the gz extension (zip file ) url is also indexed in the google search. i want to exclude these two (1) (2). Please help me out. Please advice with the content to include in the file. All types help are appreciated. Regards, Init2
Just add following in your robots.txt file: User-agent: * Disallow: /wp-admin Disallow: /any_filename_which_you_want_to_block