Questions tagged [data-management]
312 questions
0
votes
2 answers
R: delete columns from data.frame if condition fulfilled
I have got a data.frame with approx. 20,000 columns. From this data.frame I want to remove columns for which the follow vector has a value of 1.
u.snp <- apply(an[25:19505], 2, mean)
I am sure there must be a straight forward way to accomplish…
user102546
- 17
- 1
- 6
0
votes
0 answers
Python Data Storage Method
I am trying to create a database of variable in python from a large csv file. Any given row in the csv file can be uniquely identified from 4 columns.
To give an idea of the data structure:
Supplier A
Tariff RateA
Region 1
…
Rob Robinson
- 50
- 6
0
votes
2 answers
EDITED: How to insert NAs between specific character values in R
I have a list of values with a dummy character, "break", coded in to signal the line breaks:
[11] "break" "-9.737715" "0.000091" "-0.000340" "-0.001318"
[16] "-38.103233" "-10.327046" "break" "27.469583" "break"
I need to: 1)…
Lindsay Veazey
- 135
- 10
0
votes
1 answer
Sum Values in Column based on indexes of other columns and then assigning that value to each row
I am currently dealing with a data set that has shots taken on a basketball court. I currently have the shot count for each individual, but I would get the shot count per team. Rather than having to do all of the code I did for each individual, I…
klassic123
- 29
- 2
0
votes
2 answers
Resorting columns to initial ordering after deletion of columns
Clumsy title, but let me explain what's in it:
My initial matrix looks like that:
kitty <- matrix(
c(1, 2, 4, 0, 0, 0, 0, 0, 0, 3, 1, 2),
nrow=3,
ncol=4)
returning:
X1 X2 X3 X4
1 0 0 3
2 0 0 1
4 0 0 2
I delete all columns of…
Luks
- 133
- 11
0
votes
1 answer
Best way to store stats of multiple people weekly
I am using the Clash Of Clans api to show all the members of the clan on a web page. But now I want to save all the donations, cups and received donations on a weekly base. So i can see in a very clear overview who are the most active members. But…
Luke Hol
- 140
- 8
0
votes
0 answers
Space management when using geom_polygon R
I am trying to make a heat map of the US with a very large data set and I am getting this error.
Error: cannot allocate vector of size 140.7 Mb
I know my data set might be to big, I am looking for options to keep the integrity of my data and still…
Clinton Woods
- 249
- 1
- 2
- 11
0
votes
1 answer
Resetting generation numbers on permanent data
Goo day,
I'm having following permanent file series beginning from generation 10 +:
file#010
file#011
file#012
....
file#062
file /*the latest one*/
This is due to some cleanup work, where generations 1-9 were deemed to have wrong data and were…
pinegulf
- 1,334
- 13
- 32
0
votes
1 answer
Flexible order of columns in CSV with hard coded display of items in an app
In short
I have a CSV for which the order and the name of the columns can change frequently. I am building an app that should load this csv into a sqlite3 db, retrieve a specific row and display it in the corresponding widgets: Label_Name,…
MagTun
- 5,619
- 5
- 63
- 104
0
votes
2 answers
generate q1/q3 as variables by group in R
I have a two level data (hospital level and region level), each hospital has an unique o:e:
hospid zipid o:e
1 1 0.8
2 1 0.5
3 1 0.4
4 2 0.9
5 2 1.2
6 2 1.5
I want to generate the 25%…
mandy
- 483
- 9
- 20
0
votes
2 answers
Accessing text in PowerShell object. Why doesn't it seem to be stored in an array?
I have taken state plane coordinates from a SQL Server table and populated an object with 100 concatenated strings that will serve as my input into a java application.
$key = Invoke-Sqlcmd -Query "SELECT DISTINCT…
TravisLong
- 69
- 5
0
votes
2 answers
Store variable in user's phone
I am working on telegram bot where i want to store some variable in user's phone memory similar to shared preferences in android. I am using nodejs language to create telegram bot. Kindly help me how to implement that.
Thanks
Abhishek Dixit
- 19
- 4
0
votes
1 answer
'can only join iterable' when fetching data using tia.bbg.datamgr (Python 2.7)
I'm writing a script that fetches data from Bloomberg using the TIA toolkit. I'm trying to place the PX_VALUE from the start date for each equity in stocks in a dictionary called dict1 so that i can manipulate those values later.
Here is my script…
0
votes
0 answers
GoDaddy and Databases
im currently creating a website hosted at GoDaddy. I will have large amount of Data (700 GB per year) stored in a mysql database. Now, GoDaddy has a limitation of 1 GB per database, so im wondering how i should manage the data. I need the database…
Daniel Thoma
- 13
- 3
0
votes
0 answers
Pandas- conditional information retrieval with on a date range
I'm still fairly new to pandas and the script i wrote to accomplish a seemily easy task seems needlessly complicated. If you guys know of an easier way to accomplish this I would be extremely grateful.
task:
I hate two spreadsheets (df1&df2), each…
Garrett Eickelberg
- 65
- 6