Questions tagged [duplicate-data]
354 questions
3
votes
2 answers
How do I delete contacts repeated in the listview?
Following the tutorial
get android contact phone number list
I pulled the phone numbers and names of contacts, how do I get a listview clean, no duplicate contacts and possibly sorted by name?

Elohim
- 41
- 2
3
votes
1 answer
How to detect duplicate text with some fuzzyness
Some thing ago, I write small script using Text::DeDupe to remove duplicates of blog posts before I have to lay my eyes on them.
After reading Syntactic Clustering of the Web paper on which implementation is based, I would love to have ability to…

dpavlin
- 1,372
- 2
- 9
- 18
3
votes
2 answers
duplicate mongo record in same collection
In mongo I have a collections with records. These record are very complex. Now I would like to duplicate one of them.
I can easily select the one
mongo> var row = db.barfoo.find({"name":"bar"});
Now I actually don't know what to do. I don't know…

Jeanluca Scaljeri
- 26,343
- 56
- 205
- 333
3
votes
8 answers
What algorithm should be used when doing filechecksums to find dupes?
Is taking a MD5 sum still suitable for checking for file dupes? I know that it isn't secure, but does that really matter in the case of trying to find file dupes?
Should I be using something in the SHA family instead?
What is best practice in this…

Firesteel
- 689
- 1
- 6
- 3
3
votes
1 answer
To find duplicate files on a hard disk by technique other than calculating hash on each file
There is a hard disk with lots of file, how will you find duplicate files among them.
First thing we could do is separate files on the basis of FILE_SIZE.
Then we could find hash value of each file using some algorithm like MD5, one with the same…

user2328404
- 423
- 1
- 4
- 9
3
votes
2 answers
How can I choose one record over the other?
I have a list that has some duplicates.
Row# Lineid ItemDescItemId RoadTax VehicleId Amount
1 122317 None -1 26.63 -78603 300
2 122317 None -2 17.75 -78603 200
3 122317 None -1 22.19 -78602 250
4 122317 Deli …

abhi
- 3,082
- 6
- 47
- 73
3
votes
1 answer
MYSQL Table with 2 columns.Col1 Duplicate ,Col2 unique values
I am using mysql , Table with 2 Columns
Col1 | Col1
------+-------+
a@a | ab |
a@a | cd |
b@b | ab |
b@b | cd |
I want result like this
Col1 | Col1
------+--------+
a@a | abcd |
b@b | abcd |
How can i achieve this…

Hansa
- 149
- 1
- 1
- 8
3
votes
2 answers
SQL Server : find duplicates in a table based on values in a single column
I have a SQL Server table with the following fields and sample data:
ID employeename
1 Jane
2 Peter
3 David
4 Jane
5 Peter
6 Jane
The ID column has unique values for each row.
The employeename column has duplicates.
I want to be…

slayernoah
- 4,382
- 11
- 42
- 73
3
votes
2 answers
SharePoint: How to have a unique constraint in a list?
In SQL its possible to have fields that cannot contain duplicate data.
How is this possible in SharePoint?
Lets say you have a list containing values like
ORANGES
APPLES
PEARS
How do you ensure that the user cannot enter
ORANGES
APPLES…

JL.
- 78,954
- 126
- 311
- 459
3
votes
1 answer
removing duplicate entries-- variant in matlab
I have A matrix part of which looks like this :
4080530 92 -- rid of this
4085908 92 -- keep this
4086589 93 -- rid
4091453 93 -- rid
4104393 93 -- rid
4112841 93 -- rid
4122958 93 -- rid
4130815 93 -- rid
4142617 93 -- rid
4152386 93 -- keep…

bhavs
- 2,091
- 8
- 36
- 66
3
votes
5 answers
Remove dupes/sort from a Array of Associative Arrays in PHP
I have a array of associative arrays
aa[] = ('Tires'=>100, 'Oil'=>10, 'Spark Plugs'=>4 );
aa[] = ('Tires'=>454, 'Oil'=>43, 'Spark Plugs'=>3 );
aa[] = ('Tires'=>34, 'Oil'=>55, 'Spark Plugs'=>44 );
aa[] = ('Tires'=>454, 'Oil'=>43, 'Spark Plugs'=>45…

The Unknown
- 19,224
- 29
- 77
- 93
3
votes
7 answers
Is there a standard way to duplicate a row in a database table?
I want to duplicate a row, not the keys of course, without explicity using the field names.
Is there a SQL way or do I have to enumerate the field names through code?
I don't want to explicity use field names because I want to minimize code and db…

Nick Dandoulakis
- 42,588
- 16
- 104
- 136
2
votes
2 answers
How to avoid duplicate data when doing SQL INSERT from CSV
How can i avoid duplicate data when inserting from CSV file into my SQL server 2008 ?
#region Put to SQL
string line = null;
bool IsFirst = true;
string SqlSyntax = "INSERT INTO ORDRE ";
…

user609511
- 4,091
- 12
- 54
- 86
2
votes
1 answer
Retrieve single from pairs
This is a SQL query question.
If you have a table like this:
ID1 ID2
1709 1689
1689 1709
1934 1501
1501 1934
And you want to retrieve like this:
ID1 ID2
1709 1689
1934 1501
How would you do that? Please note that…

Vondool
- 25
- 4
2
votes
3 answers
SQL Unique Values
I have this query that joins 3 table. It appears to be working but I am getting duplicates. How can I remove the duplicates?
SELECT FIRST 100 e.email_id, e.location_id, e.email, l.location_type, p.salutation,
p.fname, p.lname
FROM email e,…

Antarr Byrd
- 24,863
- 33
- 100
- 188