this is simple code if robot.txt user agent:*--(google bot-slurp-msn bot) allow:/ disallow:/a.txt/b.jpeg allow:/a.txt/c.jpeg
Disallow dynamic URLs using this method: http://stackoverflow.com/questions/1495363/how-to-disallow-all-dynamic-urls-robots-txt