Questions tagged [deduplication]

De-duplication is the process of removing duplicated or redundant data from a database.

139 questions
-1
votes
1 answer

De duplicate multidimensional array

I have a fairly simple multidimensional array that I need to dedupe. I also need to remove any key that has a value, so in the below code I would need to keep the second target/value of city/Paris (Array 3) and also remove the 6th Array. Array ( …
soulston
  • 147
  • 1
  • 4
-2
votes
2 answers

T-SQL - Deduplicate large table

Sorry if this has already been asked. I see a lot of similar questions but none exactly like this one.I am trying to de-dup a large set (about 500 M) records: Sample data: CUST_ID PROD_TYPE VALUE DATE ------------------------------------ 1 …
SQLGal
  • 3
  • 1
-3
votes
1 answer

Sequential Byte-By-Byte Comparison

How would I use xor bitwise operations to perform byte by byte comparison in c? When comparing two files #include int main() { FILE *fp1, *fp2; int ch1, ch2; char fname1[40], fname2[40] ; printf("Enter name of first file…
humblebeast
  • 303
  • 3
  • 16
-3
votes
1 answer

Java program for de-duplicating an array

Could someone help with writing an efficient java function for the below please? Without using internal sorting or deduplication function, take an array which contains duplicate entries and return a new array without duplicates. eg…
1 2 3
9
10