HI, As each one of you know some of the video websites like metacafe, youtube has mature content and ask the user through javascript or html to confirm they are above 18 to view the video. My question is how does google index those videos? I mean can google crawlers pass through those age verification mode All your views are highly appreciated
you might be surprised what google spiders will index... there might be a different link for Useragent "google-bot" in the robots.txt...