Questions tagged [duplicate-data]

354 questions
4
votes
4 answers

Finding duplicate files by content across multiple directories

I have downloaded some files from the internet related to a particular topic. Now I wish to check if the files have any duplicates. The issue is that the names of the files would be different, but the content may match. Is there any way to implement…
gagneet
  • 35,729
  • 29
  • 78
  • 113
4
votes
3 answers

R, find duplicated rows , regardless of order

I've been thinking this problem for a whole night: here is my matrix: 'a' '#' 3 '#' 'a' 3 0 'I am' 2 'I am' 0 2 ..... I want to treat the rows like the first two rows are the same, because it's just different order of 'a' and '#'. In my case, I…
Jiang Du
  • 189
  • 2
  • 14
4
votes
3 answers

mysql duplicate data deletion

This shows me all the first names and last names that have exactly two entries that are identical SELECT `firstname`,`lastname`,COUNT(*) AS Count FROM `people` GROUP BY `firstname`,`lastname` HAVING Count = 2 How do I turn this into a DELETE…
Dasa
  • 297
  • 1
  • 7
  • 23
4
votes
1 answer

Infinite scroll (Waypoints) with jQuery Mobile, Back button and remote script called twice

I'm building a jQuery Mobile site for future use with PhoneGap, so all my content is loaded via AJAX pulling data from remote PHP/MySQL stuff In the home page I initially load only first 10 news; then, with a "More..." button, I load next 10, and so…
Ivan
  • 2,463
  • 6
  • 39
  • 51
4
votes
0 answers

Restkit 0.20 pre4 core data issue

{"status":"ok", "count":5, "count_total":165, "pages":33, "posts":[{ "id":2971, "status":"publish", "title":"title1", "content":"", "date":"date", "categories":[{"id":5, …
user1669026
  • 51
  • 1
  • 3
3
votes
4 answers

Prevent duplicate email address in PHP sign up form

I've looked around the boards but there are no complete answers that I could find. I'm using PHP and MySQL to create and manage a volunteer sign up form. I need to make sure that there are no duplicate email addresses (email key is UNIQUE) Here is…
AAAndreAAA
  • 137
  • 1
  • 1
  • 13
3
votes
3 answers

SQL queries - try to avoid dulicate data in result set?

This is a question I have been wondering about for quite some time now. I'll try to explain by means of an example, but it's a general question. Say you have two tables: users, which holds the first name, last name, ... of a user posts, which holds…
3
votes
2 answers

How to remove duplicates from an Oracle result set based on multiple tables

I have 2 tables: a main APPLICATION table that holds the core data, and a STATUSTRACKING table that reflects the status changes of the core data in the APPLICATION table. There is a 1:N relationship between the APPLICATION table and the…
user1058946
  • 243
  • 2
  • 3
  • 14
3
votes
3 answers

Is there a way to quickly duplicate record in T-SQL?

I need to duplicate selected rows with all the fields exactly same except ID ident int which is added automatically by SQL. What is the best way to duplicate/clone record or records (up to 50)? Is there any T-SQL functionality in MS SQL 2008 or do I…
feronovak
  • 2,687
  • 6
  • 35
  • 54
3
votes
1 answer

Partial and duplicate records while sqoop import

Sqoop import is resulting in duplicate/partial records when we are using the following setting --query - Custom Query --split-by - Non-integer column (char) --num-mappers - More than 2 Verified the source data count say 1000 records Verified the…
maxmithun
  • 1,089
  • 9
  • 18
3
votes
2 answers

Delete duplicates based on Group By - SQL

EDIT: I think I now have the solution but need to do some more sense checking... DELETE TBLFIRE_TEMP3 FROM TBLFIRE_TEMP3 LEFT OUTER JOIN ( SELECT MIN(FireNo) as FireNo, ActionRef, FRADate, FIREUPRN FROM TBLFIRE_TEMP3 GROUP BY ActionRef,…
indofraiser
  • 1,014
  • 3
  • 18
  • 50
3
votes
2 answers

Remove duplicates based on a specific key

Got a multidimensional array like this one: $A = array( [0]=> array( ["rel"]=> 4 ["name"]=> "Bar" ... ) [1]=> array( ["rel"]=> 2 ["name"]=> "Bar" ... ) [2]=> array( ["rel"]=> 1 ["name"]=> "Foo" …
Oriol
  • 11,660
  • 5
  • 35
  • 37
3
votes
3 answers

What is the SQL statement that removes duplicates but keep additional column's data?

I'd like to know what should be the SQL statement (for ORACLE DBMS) that would get back unique (by CUSTOMER_ID, VEHICLE_ID, DEALER_ID and EVENT_TYPE_ID) rows BUT it will return the latest date (EVENT_INITIATED_DATE) for that row too. I've tried…
Roman Kagan
  • 10,440
  • 26
  • 86
  • 126
3
votes
0 answers

Gridview fixed header cloneNode duplicates value

I have a gridview with textboxes and checkboxes inside each row. Textboxes have bound watermarks in it.(Bound it with hidden fields from client side on first page load) When i want to fix the gridview header with javascript code where i find from…
34Era34
  • 31
  • 2
3
votes
3 answers

duplicate one element from php array

how i can duplicate one element from array: for example, i have this array: Array ( [LRDEPN] => 0008.jpg [OABCFT] => 0030.jpg [SIFCFJ] => 0011.jpg [KEMOMD] => 0022.jpg [DHORLN] => 0026.jpg [AHFUFB] => 0029.jpg ) if i want to…
robertdd
  • 325
  • 1
  • 8
  • 22