Suppose my competetor is running a site www.abcdef..com i want to extract all his webpage is this possible ?
So that i can make a much better site than his ,to be frank i just want the list of all the urls of his site .
Yeah, you can do it, but you kind of have to know PHP or some other kind of programming language. Basically what you need to do is make a script that reads in a page, finds all the links on that page, and then goes after those. This can be made easier if there is a set way to go after it - for example, if he has SE friendly links, like: mysite/a/ You can go after the index page for each letter, read those links, but stop there - it's harder if the site all links together and you have to keep track of where you've been. I'd look into PHP, or hiring a PHP programmer - it's a web language but you can run it from command line on windows without even having a server setup if you know what your doing.