How to remove this dynamic url using robots.txt from SE's

[sarathy]

Hi guyz, how do i remove this url:

mydomain.com/viewquestionsanswers.php?START=1&END=10 thorugh robots .txt

all the urls in this page is generated like:
mydomain.com/viewquestionsanswers.php?START=1&END=10
mydomain.com/viewquestionsanswers.php?START=11&END=20

Is there any way to remove all the dynamically generated urls through Robots .txt from the search engines?.

Regards.,
sarathy.s :)

[nohaber]

If you disallow viewquestionsanswers.php file, it should disallow all the dynamic URLs involving the file.

[AzAkers]

If you want to keep the main page indexed you could do a user agent detect and supply Google, MSN, and Yahoo each a unique variable, then they would be reassigned that same variable each time they entered the dynamic page so they would never find and index multiple URLs for a single page.

[alexo]

Hello
question
i know, that it's possible via robots.txt to disallow indexation of all dinamic files, but unfortunately i don't remember command.

anybody ,can remind it

thank you

[alexo]

i find this one:
User-Agent: *
Disallow: /*?

is it right command?

thank you

[idolw]

I have one directory divided into 2 categories. One shall be indexed, the other not. The URL for the main directory page (where the user chooses from two main categories) is:
http://www.mydomain.com/mydirectory.asp
The category I do not want to be indexed and cached is:
http://www.mydomain.com/mydirectoryy.asp?cat=TheOneNotToBeCached

so will:

User-Agent: *
Disallow: /mydirectoryy.asp?cat=TheOneNotToBeCached

work for me? if not, what will?

[flyguy]

So for sure would:
User-Agent: *
Disallow: somepage.php

exclude all of these?
somepage.php?id=1234
somepage.php?id=12345
somepage.php?id=12345&id2=12345
etc.

[Alfahane]

If you disallow viewquestionsanswers.php file, it should disallow all the dynamic URLs involving the file.

Are you sure? (I'm not saying that you are wrong :) )

[UmbrellaTechnologies]

I have the same problem with some pages I dont want listed in google, do I use the same method above to accomplish this?

[internetmarketing]

Hey guys if you solve that problem then please pm me ...... I also faced the same problems. :)

[netprophet]

me too........... :)

[adacprogramming]

So for sure would:
User-Agent: *
Disallow: somepage.php

exclude all of these?
somepage.php?id=1234
somepage.php?id=12345
somepage.php?id=12345&id2=12345
etc.

This does not work, it will disallow somepage.php but allow all the variable versions. I'm trying to figure out the same thing.

I just found something else I am going to try

Disallow somepage.php*

the * is suppose to equal any characters of any number. Seems like that should work
If I can't get a better way, I'll have to move the file into a folder and disallow the folder. What a pain!! :(

[sarathy]

Thatz good idea, But even that would not help in removing a single dynamic url :(

[adacprogramming]

Thatz good idea, But even that would not help in removing a single dynamic url :(

Looks like this can help you be dynamic
mydomain.com/viewquestionsanswers.php?START=1&END=*
Should fix your problem

If you only want the one page ignored you can state the exact page
disallow: mydomain.com/viewquestionsanswers.php?START=1&END=10

[manish.chauhan]

Hi guyz, how do i remove this url:

mydomain.com/viewquestionsanswers.php?START=1&END=10 thorugh robots .txt

all the urls in this page is generated like:
mydomain.com/viewquestionsanswers.php?START=1&END=10
mydomain.com/viewquestionsanswers.php?START=11&END=20

Is there any way to remove all the dynamically generated urls through Robots .txt from the search engines?.

Regards.,
sarathy.s :)
This code will help you...
User-Agent: *
Disallow: /*?

[C. Berntsen]

This code will help you...
User-Agent: *
Disallow: /*?

I'm not sure if you noticed, but last post was posted almost 2 years ago.