Questions tagged [duplicate-data]

354 questions
1
vote
2 answers

Sql Alchemy Duplicated Commit

I'm currently facing a problem in my Cherrypy application. Im my own custom session module, when performing session.add(), the exact same object gets updated twice. cherrypy.request.SessionManager.user_data = user try: …
PythonWolf
  • 1,205
  • 1
  • 9
  • 17
1
vote
1 answer

Forms submitting twice in Struts 2, Hibernate application behing a network proxy

I have a struts2, Hibernate and Spring application. It works properly at our local end. When we deploy the application on the development server sometimes some forms are submitted twice on form submission. This is causing duplicate data to be…
ajm
  • 12,863
  • 58
  • 163
  • 234
1
vote
2 answers

MySql Duplicate-data an entry on another table

I have table1,table2 => all fields are identical except that table2 two has an extra field which is a FK of table1 **table1** *ID*,content,status **table2** *ID*,content,status,tid so tid = table1 id. I need to copy a row from table1 one to table2…
Val
  • 17,336
  • 23
  • 95
  • 144
1
vote
2 answers

How to identify duplicate items gathered from multiple feeds and link to them in a Database

I have a Database storing details of products which are taken from many sites, and gathered through the individual sites API's. When I call the feed, the details are stored in a database table. The problem I'm having is that because the exact same…
Max
  • 43
  • 2
  • 9
1
vote
2 answers

SQL Insertion without duplication

Is there a specific command for SQL Server in order to INSERT a lot of rows with the condition : if a row already exists in database doesn't duplicate it during insertion ? Edited In a sqlbulkcopy, I'd like to avoid exception because a row is…
Patrice Pezillier
  • 4,476
  • 9
  • 40
  • 50
1
vote
1 answer

space optimize a large array with many duplicates

I have an array where the index doubles as 'identifier for a collection of items' and the content of the array is a group-number. The group numbers fall into a finite range from 0..N, where N << length_of_the_array. Hence every is entry will be…
broun
  • 2,483
  • 5
  • 40
  • 55
1
vote
0 answers

Duplicate oracle database from remote server on local machine

Plz someone help me. I have an oracle 11g running on a remote server, and I need make a copy on my machine to work out of the networking. I have access on remote sever with sys as sysdba. With that user I make an export with SQLDeveloper. The I…
brbrbr
  • 157
  • 4
  • 17
1
vote
1 answer

How to find rows in a file with same values for specific columns using unix commands?

I have a file with a large number of rows. Each row contains 5 columns delimited by tabs. I want to find all rows that have the same value for the first 4 columns but have different values for the 5th column. name age address phone …
tourniquet_grab
  • 792
  • 9
  • 14
1
vote
0 answers

how make the opentsdb store duplicate data

I have three duplicate records with the same timestamp, the same metric, the same tags etc. Because of concurrence. When I had stored them in opentsdb, only the last one record had been stored, others had been covered. But I want all the records can…
anmei
  • 11
  • 1
1
vote
1 answer

ELKI's LOF implementation for heavily duplicated data

Does ELKI fail for data which has many duplicate values in it? I have files with more than 2 million observations(1D), but it contains only a few hundred unique values. The rest are duplicates. When I run this file in ELKI, for LOF or LoOP…
Ira
  • 107
  • 8
1
vote
2 answers

Mysql - On Duplicate Key Update not working for 2 keys

Hello I have a table with two unique keys profile_id and date. I don't know where is the problem but my query is not working. Table: CREATE TABLE `profile_views` (\n `id` int(11) NOT NULL AUTO_INCREMENT, \n `profile_id` varchar(45)…
Yas
  • 120
  • 6
1
vote
1 answer

SQL Server Update with check of duplicates

In SQL Server 2008 I have a table tblProfile with employee numbers (EmID) and profileID (ProID). EmID+ProID are a combined primary key. I found "duplicates" on the EmID, which come from the employee table. Each employee can have multiple ProID, but…
mak
  • 359
  • 3
  • 14
1
vote
3 answers

Duplicate Data Stop in MySQL

I have a table below : +-----+-------+------+------------+ | ID | RefID | Type | EventTime | +-----+-------+------+------------+ | 101 | 228 | 1 | 1437195633 | | 102 | 228 | 5 | 1437195633 | | 103 | 228 | 1 | 1437195633 | | 104 | …
Satender K
  • 571
  • 3
  • 13
1
vote
0 answers

SQL Server Duplicate Records + add time to each new row

Below is a CTE I am currently using to count how many times it took to send a transmission over a given period of time. The CTE works by sharing the time to send in seconds (HT.ElapsedTime) by 60. This then produces a value such as 4, 6, 10 etc.…
A Marsh
  • 33
  • 3
1
vote
5 answers

sql: keep only the minimum value if two rows have duplicate id

Below is my sample data. Row 3 and 4 have the same st_case (the primary key), but their dist_min are different. I want to keep the row with the minimum dist_min value. And please notice that there could be more than 2 duplicate rows associate with…
daydayup
  • 2,049
  • 5
  • 22
  • 47