How would I remove duplicate entries?

I recently purchased a DB from a DP member that contains a large amount of duplicate entries… I’m looking for a program that’s able to loop through the DB and removed dup content based on entire titles.

 

What platform?

If you're not concerned which titles you're deleting, why not just create a new table using distinct?

eg. create table new_table (select distinct(title) title,[...rest of field list you want to keep...])

 

The platform is important but as well as the way mentioned above, if there is chance of the title being the same but the content having minor difference on some platforms you could create a table with a unique index on the title and it would exclude the duplicates.

 

mysql Database

 

use distinct in your sql query to eliminate duplicate and show only unique ones.

SELECT DISTINCT title
FROM <table>

 

just join on a itself (making a tmp table), only selecting the ID and a Count of the IDs. Then order this by Count DESC. This way you will get a list of the dupes and you can sort out what you want to do with each