I am looking to build a site similar to semrush.com, does anyone know what all I would need to build it? So far I know I will need a spider but what would I have to use to get the keywords and page rank information for every site? If someone thinks they are able to make a clone please send me a PM as well, I'm looking for a partner.
Honeastly the back end is any ones guess We can tell its using PHP cause files end in .php Javascript and HTML are oviouse because they are on the lcient As for the rest.. its any one's guess Mysql (usualy accompanies php but not always) are there additional applications runnin in the background? maybe java? maybe not? e-mail them and ask :-P