how i can do it http://www.carinfoz.com/ajax_product.php?parentid= http://www.carinfoz.com/ajax_city.php?parentid= Currently my robot.txt is User-agent: ia_archiver Disallow: / User-agent: * Disallow: /admin/ Disallow: /dealers_mail_new.php Disallow: /showroom_mail_new.php Disallow: /service_mail_new.php Disallow: /auto.php Disallow: /auto_feature.php Disallow: /auto_review.php Disallow: /auto_specifc.php So tell me please that what should add in this robot.txt for disallowing the above given urls.
Yes it is helpful, but SPYGuyz one more question suppose i have 100 or more urls like http://www.carinfoz.com/ajax_product.php?parentid= http://www.carinfoz.com/ajax_city.php?parentid= which started from http://www.carinfoz.com/ajax_ then how many times i write Disallow: http://www.carinfoz.com/ajax_ Is there not a way which can work in single line for blocking to crawl the urls which is starting by http://www.carinfoz.com/ajax_ Thanks in adwance