Questions tagged [duplicate-data]
354 questions
2
votes
4 answers
SQL Unique Record not column?
Is there a way to insert into an SQL database where the whole record is unique? I know you can make primary keys and unique columns, but that is not what I want.
What is the best way of doing this without overloading the database? I have seen a sort…

user84786
- 631
- 7
- 19
- 33
2
votes
2 answers
Assigning values based on the number of character duplicates
Sorry for the burst of question after question. Trying my best to search, but I have the arduous task of coming up with a very, very large program and I am still very new to R so I appreciate all the quick help I have got thus far.
Fake example to…

Tim
- 367
- 1
- 6
- 19
2
votes
2 answers
Rails: Duplicate a record and its multi-level associations?
I'm building a survey app and trying to build a duplication feature so users can duplicate surveys.
What I need to do is duplicate the survey, that survey's questions and each questions answers (multiple choice options, for instance).
Here are my…

Shpigford
- 24,748
- 58
- 163
- 252
2
votes
4 answers
Remove duplicate data in a file
I have a problem coming up with an algorithm. Will you, guys, help me out here?
I have a file which is huge and thus can not be loaded at once. There exists duplicate data (generic data, might be strings). I need to remove duplicates.

Anton K.
- 933
- 3
- 9
- 22
2
votes
1 answer
Check duplicate content without doing a GET
One of the main purposes of URL normalization is to avoid GET requests on distinct URLs that produce the exact same result.
Now, I know that you can check for the canonical tag and even compare two URL's HTML to see if they're the same, however you…

Ben
- 16,275
- 9
- 45
- 63
2
votes
1 answer
ways to detect data redundancy between tables with different structures
I'm working on a problem that involves multiple database instances, each with different table structures. The problem is, between these tables, there are lots and lots of duplicates, and i need a way to efficiently find them, report them, and…

c-ram
- 154
- 9
2
votes
2 answers
SELECT * (apart from Identity) FROM
I have a table with about 20 columns, and I wish to duplicate a record. I could just do:
INSERT INTO [Table] (ColumnA, ColumnB, ColumnC, .... ColumnZ)
SELECT TOP 1 ColumnA, ColumnB, ColumnC, .... ColumnZ
FROM [Table]
WHERE ID=@ID
However, this will…

Curtis
- 101,612
- 66
- 270
- 352
2
votes
1 answer
MySQL remove duplicated row data on SELECT
I have a table that i want to filter out duplicated data when using SELECT operation, the table itself contain data like this:
|=======|
| SPEED |
|=======|
| 100 |
| 100 |
| 90 |
| 80 |
| 80 |
| 100 |
| 80 |
|=======|
What i want…

Dels
- 2,375
- 9
- 39
- 59
2
votes
5 answers
how to delete duplicate rows from ms access database (C#)
I have been going through various sites and codes, but nothing seems to end my misery. Either they help to find and remove duplicates for a specific column or they remove only from the datatable, not the underlying database itself. I want to delete…

nawfal
- 70,104
- 56
- 326
- 368
2
votes
2 answers
Finding "duplicate" rows that differ in one column
I have a table like the following in MySQL 5.1:
+--------------+----------------+------+-----+---------+----------------+
| Field | Type | Null | Key | Default | Extra …

GarlicFries
- 8,095
- 5
- 36
- 53
2
votes
2 answers
Duplicate records created in has_many :through associations
I have three models: Booking, ExtraNight and BookedExtraNight. Running Rails 2.3.11
Booking:
has_many :extra_nights, :through => :booked_extra_nights
has_many :booked_extra_nights, :dependent => :destroy
ExtraNight:
has_many :booked_extra_nights,…

amunds
- 702
- 8
- 22
2
votes
2 answers
PHP runs two requests per request when using rewrite rule
I noticed that PHP has been inserting the same data twice, even with a simple query, below is my index file:

peterjwest
- 4,294
- 2
- 33
- 46
2
votes
4 answers
How do I find duplicate data in xml document using XQuery?
I have a bunch of documents in a MarkLogic xml database. One document has:
red
red
Having multiple colors is not a problem. Having multiple colors that are both red is a problem. How do I find…

Sixty4Bit
- 12,852
- 13
- 48
- 62
2
votes
2 answers
Perl MySQL - How do I skip updating or inserting a row if a particular field matches?
I am pretty new to this so sorry for my lack of knowledge.
I set up a few tables which I have successfully written to and and accessed via a Perl script using CGI and DBI modules thanks to advice here.
This is a member list for a local band…

DulcimerDude
- 47
- 2
- 7
2
votes
1 answer
Does JSON syntax allow duplicate values?
Is this valid JSON?
{
"a" : [
"x",
"x"
]
}
http://jsonlint.com/ says yes.
http://www.json.org/ doesn't say anything about it being forbidden, but does say:
JSON is built on two structures:
A collection of name/value pairs. In…

Hugo
- 27,885
- 8
- 82
- 98