Duplicate Data

I combined two data sources and now have duplicate data how can I remove  duplicate data?


  • This discussion probably belongs in the subforum for data sources.  Nevertheless, is there any way that the data sources can be de-duplicated at the data source level?  I am assuming here that the duplicates are the same in every field, right?

    "When I have money, I buy books. When I have no money, I buy food." - Erasmus of Rotterdam
  • The data from the source is not duplicated however the result of combining data sources have created the duplicate data.

  • Moved to Data Sources for better exposure ?

  • Can anybody provide further assistance for @vcsmedia?

  • Why not use Magic ETL (AKA Dataflow) to remove duplicates? It's one of the ETL tools.