Questions tagged [duplicate-data]

354 questions
2
votes
2 answers

Is it better to make a method for returning a string from an Enum? or to have an extra string variable to hold the string value?

Right now I have public enum EnumSize { Miniscule, Tiny, Small, Medium, Large, Huge, Giant } and I want the string value returned so I made a switch statement to return the string value public string getSize() { string temp =…
2
votes
1 answer

query that would count and increment the number of duplicate instances of that record

Using Access 2010. So if I had a table COL1 A B A C A and the run the query I would get the output in COL2 where 'A' is duplicated three times and its COL2 value is in turn incremented. COL1 | COL2 A | 1 B | 1 A | 2 C…
megaSteve4
  • 1,760
  • 1
  • 17
  • 24
2
votes
2 answers

SQL for duplicating parent and children records

I'm trying to figure out the best way to create a SQL statement (in SQL Server) to duplicate a parent record and all the children records. I have the below as an example; -- duplicate the order insert into Orders (CustomerID, EmployeeID, OrderDate,…
2
votes
2 answers

C# Directory Services Double Addition to List

I have a directory services method to gather machines from Active Directory and return them as a List<> . The code is: public static List PCsAndAttributes(string PCName, string AttributeToRead) { List toReturn = new…
Austin T French
  • 5,022
  • 1
  • 22
  • 40
2
votes
11 answers

SQL Duplicate Delete Query over Millions of Rows for Performance

This has been an adventure. I started with the looping duplicate query located in my previous question, but each loop would go over all 17 million records, meaning it would take weeks (just running *select count * from MyTable* takes my server 4:30…
RyanKeeter
  • 5,939
  • 7
  • 32
  • 40
2
votes
1 answer

Is ARP source hardware address redundant?

I'm working on a network security project and I noticed something that I can't explain: Why do we need a source hardware address field in arp? Isn't it already contained in the ethernet header?
Laurent
  • 21
  • 1
2
votes
3 answers

How to delete partial duplicate lines with AWK?

I have files with these kind of duplicate lines, where only the last field is…
zedascouves
  • 35
  • 1
  • 7
2
votes
2 answers

Best method to deduplicate people records in Rails

I am writing a rails app with a Person model that looks something like this: create_table "people", :force => true do |t| t.string "first_name" t.string "last_name" t.string "email" t.datetime "created_at", :null => false …
DougB
  • 674
  • 7
  • 14
2
votes
6 answers

Remove Duplicates with Caveats

I have a table with rowID, longitude, latitude, businessName, url, caption. This might look like: rowID | long | lat | businessName | url | caption 1 20 -20 Pizza Hut yum.com null How do I delete all of the duplicates, but only…
RyanKeeter
  • 5,939
  • 7
  • 32
  • 40
2
votes
3 answers

Duplicate Removal in a list of list

[ [0.074, 0.073, 0.072, 0.03, 0.029, 0.024, 0.021, 0.02], [0.02, 0.02, 0.015], [0.026, 0.026, 0.02, 0.02, 0.02, 0.015], [0.021, 0.021, 0.02, 0.017], [0.077, 0.076, 0.074, 0.055, 0.045, 0.021], [0.053, 0.052, 0.051, 0.023, 0.022], [0.016,…
Ting Ping
  • 1,145
  • 7
  • 18
  • 34
2
votes
3 answers

Pull to refresh and list pagging duplicating records on listing page

I am new for sencha touch. I have a Listing page which using Ext.plugin.PullRefresh and Ext.plugin.ListPaging plugin to refresh my page, but I'm having an issue with duplicate items appearing after I pull to refresh. Here is my…
user998405
  • 1,329
  • 5
  • 41
  • 84
2
votes
1 answer

Duplicates in a QIF File?

Does anyone have a good way of deleting duplicate transactions (same date, amount, biller, etc) in a QIF file? I looked at PERL's Finance:QIF, but it appear to have delete a record function. Alternatively, does someone have a good QIF --> CSV…
NoahD
  • 8,092
  • 4
  • 27
  • 28
2
votes
2 answers

Tips for deduping a list based on priority column

I have a set of rows that contain duplicate entries because the data originates from multiples sources. I also have a separate reference table that indicates the priority of those data sources. Does anyone have good tips for the most effective…
jkelley
  • 2,570
  • 3
  • 21
  • 24
2
votes
2 answers

Eliminating duplicate same-level elements in XSLT

I'm looking to display a list of same-level node names, without duplicates. Let's say I have I'd want c,d,e,f to be…
Jamie Carmichael
2
votes
2 answers

Generate connection table from table with duplicates

I have a SQL Server database table (DuplicateIds) that contains the ID's of duplicate words from another table (Words). Here's and example of the data in the table DuplicateIds: word_id | word ---------------------------------- 244…
tkahn
  • 1,407
  • 2
  • 21
  • 37