Questions tagged [merging-data]
173 questions
3
votes
2 answers
Algorithm for combining n files into one concurrently
I am trying to find a horizontally scaling solution to the problem described in the title.
A more detailed explanation of the problem would be: from a message queue web service, read a message containing a URL to a file uploaded somewhere, download…
JRL
- 76,767
- 18
- 98
- 146
3
votes
1 answer
Ruby, merging lazy sequences
Let i have lazy sequences: s1, s2, s3, ..., sN, with non-descending numbers, for example:
s1 = [1, 1, 2, 3, 3, 3, 4, .....]
s2 = [1, 2, 2, 2, 2, 2, 3, 3, 4, ....]
s3 = [1, 2, 3, 3, 3, 3, 4, 4, 4, ....]
what I'd like to do - is to merge it, grouping…
Alex
- 1,210
- 8
- 15
2
votes
2 answers
Core Data, iCloud, and stock objects
I'm updating a local Core Data-driven app to support iCloud. One challenge I anticipate is around what I'm calling "stock objects" -- seed data the app provides at first launch that 99% of users will customize.
Stock Objects
Item A
Item…
ed94133
- 1,477
- 2
- 19
- 40
2
votes
5 answers
Add data from second 2d array to first 2d array based on related id columns
I have two arrays $a and $b
$a = [
'0' => [
'name'=>'Apple',
'id' => 1
],
'1' => [
'name'=>'Banana',
'id' => 2
],
'2' => [
'name' => 'orange',
'id' => 3
]
];
AND
$b = [
'0'…
Rezaul Zablu
- 23
- 3
2
votes
0 answers
How to group rows of data into subarrays based on another column?
What is the best way to group data in my multi-dimensional array by one column and crate a subarray of from another column in each group?
$array = [
['idAnswer' => 209, 'idQuestion' => 141],
['idAnswer' => 1668, 'idQuestion' => 141],
…
MarinaGB
- 21
- 5
2
votes
1 answer
R: finding mismatched column names before merging
I have a large number of data frames to merge. Each has several hundred columns. I want to identify all mismatching column names before doing this. So far I can generate a list of mismatches, but format is terrible and I can't quite figure out how…
marcel
- 389
- 1
- 8
- 21
2
votes
1 answer
How do I merge data sets with some of the same columns without matching the elements but rather adding them to the vector?
I have been attempting to merge cross sectional data sets which were acquired at different years from different people.
For data collection, most of the same questions were asked per year but some questions where added or deleted. Hence, there is…
JFC_Mx
- 23
- 5
2
votes
1 answer
How do I merge 2 data frames on R based on 2 columns?
I am looking to merge 2 data frames based on 2 columns in R. The two data frames are called popr and dropped column, and they share the same 2 variables: USUBJID and TRTAG2N, which are the variables that I want to combine the 2 data frames by.
The…
statsprogramming
- 23
- 3
2
votes
1 answer
Merge Irregular Time Based Data Series
I would like to merge 2 Google sheets (INPUT #1 & INPUT #2) into 1 sheet (OUTPUT). These 3 sheets are enclosed in the same Google Spreadsheet.
On a daily basis, Sheets INPUT #1 & INPUT #2 are updated by the end of the data series.
OUTPUT should…
Henri
- 1,571
- 5
- 23
- 38
2
votes
1 answer
Rank or merge sequential rows
I have a log file I need to either rank (but treating sequential and equal rows as ties), or merge sequential equal rows (based on specific column). My table looks like below, The Start and Stop are all being sequential (within the same ID…
Pär Adeen
- 23
- 4
2
votes
1 answer
Merging iqy files with python
currently I extracted data from sharepoint and have .iqy files that I can open with excel. There are about 30 files and I am trying to merge all the information into one .iqy file or excel file with python.
import os, glob
import pandas as pd
files…
jordan23
- 73
- 1
- 12
2
votes
1 answer
Merging two data frames with origins
Suppose I have the two following data frames df_1 and df_2 and want to merge them with an additional column which states if the row is present in df_1,df_2 or both. Is there any way I could do this directly while using merge?
df_1
df_2
The data…
hegdep
- 596
- 1
- 6
- 16
2
votes
1 answer
FFT in Python 2.7 merging two codes
I have two codes for an FFT but I need to merge them, because they seems to be working well in some parts. Let me explain.
First code:
fft1 = (Bx[51:-14])
fft2 = (By[1:-14])
# NS antena FFT - red
FFTdata = np.sqrt(fft1*fft1)**1
samples =…
Hiddenguy
- 547
- 13
- 33
2
votes
1 answer
Merge two losely related datasets in BigQuery
I am new to BigQuery, and would appreciate your help. I am trying to keep my case generic so that it can be useful to others. I'm sure it's pretty basic and I am missing something...
I have 2 datasets, "Master" and "New". Master contains several…
user2887805
- 21
- 2
2
votes
2 answers
Updating data.frame from another data.frame with different columns in R
Given two data frames
old.df = data.frame(SampleNo=c('A1', 'B4', 'C5', 'D4'), Result=c(rep("Successful",4)), NoUnit = c(rep(4,4)))
new.df = data.frame(SampleNo=c('A1', 'C5', 'D4', 'E4'), Result=c(rep("Successful",2),rep(…
geodex
- 1,219
- 3
- 13
- 22