Duplicate Content deletion [Is there something like this]

Hello guys,

Alright, I got 2 different files (both text and excel), one contains around 2000 domains and another contains around 360 domains. Now some of these domains repeat in both of these files, I want the duplicate content to be deleted and the originals to be retained. I need to import this list somewhere!

Is there some application that does that ? Or some excel feature or whatever ?

Any help appreciated!

Abhishek

 

would copyscape work?
www.copyscape.com

 

errr... dude! I think you didn't really get what I am wanting ?

 

Send me the files, I will weed out the duplicates.

Catch me on IM if files contains some sensitive data.

 

You can use MS Excel.

Select the entire domain name column.
Use Data>Filter>Advanced Filter>
Select "Copy To Another Location" and Check "Unique Records Only"
Specify a new column and press "OK".

 

Past that 360 domain list (excel) below the 2000 domain list. Go to Data > Filter > Advance Filter > Unique records only (Excel 2007)

Thats it

Edit: I was bit slow

 

Yes that will work. Other option is to use duplicate remover from ablebits.com

 

Thanks for the help guys, but this is not exactly what I was looking for!

Let me give you an example,

We have two Datasets Provided, Dataset A is the supplied task, whereas Dataset B is the completed task. Now what I want is Dataset A minus Dataset B. So that the pending task is retained, whereas duplicated task is deleted.

Just wanting to know if something like this exists! Saving myselves the trouble to write a script for this!

Abhishek

Edit - I think Ablebit will do what am looking for!