Questions tagged [duplicate-data]

354 questions
3
votes
2 answers

How do I delete contacts repeated in the listview?

Following the tutorial get android contact phone number list I pulled the phone numbers and names of contacts, how do I get a listview clean, no duplicate contacts and possibly sorted by name?
3
votes
1 answer

How to detect duplicate text with some fuzzyness

Some thing ago, I write small script using Text::DeDupe to remove duplicates of blog posts before I have to lay my eyes on them. After reading Syntactic Clustering of the Web paper on which implementation is based, I would love to have ability to…
dpavlin
  • 1,372
  • 2
  • 9
  • 18
3
votes
2 answers

duplicate mongo record in same collection

In mongo I have a collections with records. These record are very complex. Now I would like to duplicate one of them. I can easily select the one mongo> var row = db.barfoo.find({"name":"bar"}); Now I actually don't know what to do. I don't know…
Jeanluca Scaljeri
  • 26,343
  • 56
  • 205
  • 333
3
votes
8 answers

What algorithm should be used when doing filechecksums to find dupes?

Is taking a MD5 sum still suitable for checking for file dupes? I know that it isn't secure, but does that really matter in the case of trying to find file dupes? Should I be using something in the SHA family instead? What is best practice in this…
Firesteel
  • 689
  • 1
  • 6
  • 3
3
votes
1 answer

To find duplicate files on a hard disk by technique other than calculating hash on each file

There is a hard disk with lots of file, how will you find duplicate files among them. First thing we could do is separate files on the basis of FILE_SIZE. Then we could find hash value of each file using some algorithm like MD5, one with the same…
user2328404
  • 423
  • 1
  • 4
  • 9
3
votes
2 answers

How can I choose one record over the other?

I have a list that has some duplicates. Row# Lineid ItemDescItemId RoadTax VehicleId Amount 1 122317 None -1 26.63 -78603 300 2 122317 None -2 17.75 -78603 200 3 122317 None -1 22.19 -78602 250 4 122317 Deli …
abhi
  • 3,082
  • 6
  • 47
  • 73
3
votes
1 answer

MYSQL Table with 2 columns.Col1 Duplicate ,Col2 unique values

I am using mysql , Table with 2 Columns Col1 | Col1 ------+-------+ a@a | ab | a@a | cd | b@b | ab | b@b | cd | I want result like this Col1 | Col1 ------+--------+ a@a | abcd | b@b | abcd | How can i achieve this…
Hansa
  • 149
  • 1
  • 1
  • 8
3
votes
2 answers

SQL Server : find duplicates in a table based on values in a single column

I have a SQL Server table with the following fields and sample data: ID employeename 1 Jane 2 Peter 3 David 4 Jane 5 Peter 6 Jane The ID column has unique values for each row. The employeename column has duplicates. I want to be…
slayernoah
  • 4,382
  • 11
  • 42
  • 73
3
votes
2 answers

SharePoint: How to have a unique constraint in a list?

In SQL its possible to have fields that cannot contain duplicate data. How is this possible in SharePoint? Lets say you have a list containing values like ORANGES APPLES PEARS How do you ensure that the user cannot enter ORANGES APPLES…
JL.
  • 78,954
  • 126
  • 311
  • 459
3
votes
1 answer

removing duplicate entries-- variant in matlab

I have A matrix part of which looks like this : 4080530 92 -- rid of this 4085908 92 -- keep this 4086589 93 -- rid 4091453 93 -- rid 4104393 93 -- rid 4112841 93 -- rid 4122958 93 -- rid 4130815 93 -- rid 4142617 93 -- rid 4152386 93 -- keep…
bhavs
  • 2,091
  • 8
  • 36
  • 66
3
votes
5 answers

Remove dupes/sort from a Array of Associative Arrays in PHP

I have a array of associative arrays aa[] = ('Tires'=>100, 'Oil'=>10, 'Spark Plugs'=>4 ); aa[] = ('Tires'=>454, 'Oil'=>43, 'Spark Plugs'=>3 ); aa[] = ('Tires'=>34, 'Oil'=>55, 'Spark Plugs'=>44 ); aa[] = ('Tires'=>454, 'Oil'=>43, 'Spark Plugs'=>45…
The Unknown
  • 19,224
  • 29
  • 77
  • 93
3
votes
7 answers

Is there a standard way to duplicate a row in a database table?

I want to duplicate a row, not the keys of course, without explicity using the field names. Is there a SQL way or do I have to enumerate the field names through code? I don't want to explicity use field names because I want to minimize code and db…
Nick Dandoulakis
  • 42,588
  • 16
  • 104
  • 136
2
votes
2 answers

How to avoid duplicate data when doing SQL INSERT from CSV

How can i avoid duplicate data when inserting from CSV file into my SQL server 2008 ? #region Put to SQL string line = null; bool IsFirst = true; string SqlSyntax = "INSERT INTO ORDRE "; …
user609511
  • 4,091
  • 12
  • 54
  • 86
2
votes
1 answer

Retrieve single from pairs

This is a SQL query question. If you have a table like this: ID1 ID2 1709 1689 1689 1709 1934 1501 1501 1934 And you want to retrieve like this: ID1 ID2 1709 1689 1934 1501 How would you do that? Please note that…
Vondool
  • 25
  • 4
2
votes
3 answers

SQL Unique Values

I have this query that joins 3 table. It appears to be working but I am getting duplicates. How can I remove the duplicates? SELECT FIRST 100 e.email_id, e.location_id, e.email, l.location_type, p.salutation, p.fname, p.lname FROM email e,…
Antarr Byrd
  • 24,863
  • 33
  • 100
  • 188