Questions tagged [duplicate-data]

354 questions
2
votes
4 answers

SQL Unique Record not column?

Is there a way to insert into an SQL database where the whole record is unique? I know you can make primary keys and unique columns, but that is not what I want. What is the best way of doing this without overloading the database? I have seen a sort…
user84786
  • 631
  • 7
  • 19
  • 33
2
votes
2 answers

Assigning values based on the number of character duplicates

Sorry for the burst of question after question. Trying my best to search, but I have the arduous task of coming up with a very, very large program and I am still very new to R so I appreciate all the quick help I have got thus far. Fake example to…
Tim
  • 367
  • 1
  • 6
  • 19
2
votes
2 answers

Rails: Duplicate a record and its multi-level associations?

I'm building a survey app and trying to build a duplication feature so users can duplicate surveys. What I need to do is duplicate the survey, that survey's questions and each questions answers (multiple choice options, for instance). Here are my…
Shpigford
  • 24,748
  • 58
  • 163
  • 252
2
votes
4 answers

Remove duplicate data in a file

I have a problem coming up with an algorithm. Will you, guys, help me out here? I have a file which is huge and thus can not be loaded at once. There exists duplicate data (generic data, might be strings). I need to remove duplicates.
Anton K.
  • 933
  • 3
  • 9
  • 22
2
votes
1 answer

Check duplicate content without doing a GET

One of the main purposes of URL normalization is to avoid GET requests on distinct URLs that produce the exact same result. Now, I know that you can check for the canonical tag and even compare two URL's HTML to see if they're the same, however you…
Ben
  • 16,275
  • 9
  • 45
  • 63
2
votes
1 answer

ways to detect data redundancy between tables with different structures

I'm working on a problem that involves multiple database instances, each with different table structures. The problem is, between these tables, there are lots and lots of duplicates, and i need a way to efficiently find them, report them, and…
c-ram
  • 154
  • 9
2
votes
2 answers

SELECT * (apart from Identity) FROM

I have a table with about 20 columns, and I wish to duplicate a record. I could just do: INSERT INTO [Table] (ColumnA, ColumnB, ColumnC, .... ColumnZ) SELECT TOP 1 ColumnA, ColumnB, ColumnC, .... ColumnZ FROM [Table] WHERE ID=@ID However, this will…
Curtis
  • 101,612
  • 66
  • 270
  • 352
2
votes
1 answer

MySQL remove duplicated row data on SELECT

I have a table that i want to filter out duplicated data when using SELECT operation, the table itself contain data like this: |=======| | SPEED | |=======| | 100 | | 100 | | 90 | | 80 | | 80 | | 100 | | 80 | |=======| What i want…
Dels
  • 2,375
  • 9
  • 39
  • 59
2
votes
5 answers

how to delete duplicate rows from ms access database (C#)

I have been going through various sites and codes, but nothing seems to end my misery. Either they help to find and remove duplicates for a specific column or they remove only from the datatable, not the underlying database itself. I want to delete…
nawfal
  • 70,104
  • 56
  • 326
  • 368
2
votes
2 answers

Finding "duplicate" rows that differ in one column

I have a table like the following in MySQL 5.1: +--------------+----------------+------+-----+---------+----------------+ | Field | Type | Null | Key | Default | Extra …
GarlicFries
  • 8,095
  • 5
  • 36
  • 53
2
votes
2 answers

Duplicate records created in has_many :through associations

I have three models: Booking, ExtraNight and BookedExtraNight. Running Rails 2.3.11 Booking: has_many :extra_nights, :through => :booked_extra_nights has_many :booked_extra_nights, :dependent => :destroy ExtraNight: has_many :booked_extra_nights,…
2
votes
2 answers

PHP runs two requests per request when using rewrite rule

I noticed that PHP has been inserting the same data twice, even with a simple query, below is my index file:
peterjwest
  • 4,294
  • 2
  • 33
  • 46
2
votes
4 answers

How do I find duplicate data in xml document using XQuery?

I have a bunch of documents in a MarkLogic xml database. One document has: red red Having multiple colors is not a problem. Having multiple colors that are both red is a problem. How do I find…
Sixty4Bit
  • 12,852
  • 13
  • 48
  • 62
2
votes
2 answers

Perl MySQL - How do I skip updating or inserting a row if a particular field matches?

I am pretty new to this so sorry for my lack of knowledge. I set up a few tables which I have successfully written to and and accessed via a Perl script using CGI and DBI modules thanks to advice here. This is a member list for a local band…
DulcimerDude
  • 47
  • 2
  • 7
2
votes
1 answer

Does JSON syntax allow duplicate values?

Is this valid JSON? { "a" : [ "x", "x" ] } http://jsonlint.com/ says yes. http://www.json.org/ doesn't say anything about it being forbidden, but does say: JSON is built on two structures: A collection of name/value pairs. In…
Hugo
  • 27,885
  • 8
  • 82
  • 98