I want to create a urllist.txt for my site. Do I have to list all the files or can it be the folders that they are in? e.g. www.site.com www.site.com/folder1 www.site.com/folder2 www.site.com/folder3 I have a wordpress install on my site in a subdirectory so the urls from that are dynamic.
You could look at the WordPress Sitemap Add-on. That will generate an XML sitemap for you and keep it up to date automatically as you post. Not sure if it does plain text ones...
The reason I was asking is because when I type site:www.mysite.com and site:mysite.com/wordpress there are more pages listed in the second one. For some reason they don't show up when I search just mysite.com