Stack Overflow
Stack Overflow

Questions tagged [data-handling]

60 questions
1
vote
3 answers

How can I create a data frame when I only have the values for each cell (possibly more than one string per cell) and their column and row index?

I have a dataframe including the values for each cell (possibly more than one value) and the row and the column index. df = data.frame(values = c(1,"Sven", 20,"Mueller","sept",2,30,"John","Mar","Hynes","Marc"), colI =…
Michael Altorfer
  • 21
  • 5
1
vote
2 answers

Which Timeseries Database would be more suitable for Sensor Datas - InfluxDb or Prometheus

I have searched for it in many blogs, but it seems all the blogs present a biased view. I myself am having a little bias towards Prometheus now, However, i did not find any good article which explains a use case of Prometheus for sensor data. In my…
Daga Arihant
  • 464
  • 4
  • 19
1
vote
2 answers

Remove columns with factors that has less than 5 observations per level

I have a dataset composed of more than 100 columns and all columns are of type factor. Ex: animal fruit vehicle color cat orange car blue …
Israel Motta
  • 35
  • 5
1
vote
1 answer

How to groupby two columns while assigning 'aggregated' columns to new columns?

I'm using Python, and I need to "aggregate" on the columns "R" then "J", so that for each R, each row is a unique "J". I don't want to lose the data in C, so I need to create new columns named C1 for T=1, C2 for T=2, and C2 for T=3, that writes in…
nielsen
  • 383
  • 1
  • 6
1
vote
1 answer

Make a vector of coordinates to filter data within a certain area

Rookie R user here and I would greatly appreciate any help you someone could give me. My project requires me to create a vector boundary box around a city of my choice and then filter a lot of data so I only have the data relative to the area.…
T.Omalley
  • 325
  • 1
  • 2
  • 9
1
vote
1 answer

react: always fetch data or save data frontend

So i am working on a IoT SaaS project in React. The user selects a sensor and a time range and receives data visualized in charts with a resolution about 5 minutes. My question is regarding best practices when handling fetching and saving of this…
Håkon Halldal
  • 71
  • 2
  • 2
  • 5
1
vote
1 answer

Efficient Output Format for Huge Data Sets?

I have written a program that writes output to a file. The output is in 6-column, n-row format, and all values are double-precision float. It is very common in my code for n to become extremely large (1e20 or so) and, hence, the output data file…
noobprogrammer
  • 71
  • 7
1
vote
1 answer

Alternatives of OR and IN operators for indexing a table

The mysql query I am working on is as follow: select line_item_product_code, line_item_usage_start_date, sum(line_item_unblended_cost) as sum from test_indexing force index(date) where line_item_product_code in('AmazonEC2', 'AmazonRDS') and…
poindexter
  • 21
  • 3
1
vote
1 answer

Write Inf (numeric) into excel and read it back into R. Inf is char, rather than numeric

After writing Inf (as numeric) into excel, I read it back again and get Inf as Char. For NaN, it becomes NA. For NA, it remains NA as numeric, which is supposed to be. I used both readxl and writexl. I tried to install tibble and…
ESG
  • 11
  • 3
1
vote
1 answer

Passing data between components with @Input and using router-outlet?

What is the easiest way to pass data around components? I get that for Parent-> child you should use @Input however it's not really seems usefull if you are using router-outlet, since you need to access the child's template(and i don't get it how…
Exitl0l
  • 459
  • 2
  • 11
  • 27
1
vote
1 answer

Assigning variable names with a 'for' loop in Python, when number of variables is unknown

I am new to Python and Stacks Overflow. I am trying to assign variabel names to 1 dimensional arrays of columns in a np. matrix dataset. The amount of total data columns is unknown, so I cannot name the columns manually. I do however know that the…
J.Doe
  • 143
  • 7
1
vote
1 answer

WordPress: PHP Fatal Error... Allowed memory size exhauted

Fatal error: Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes) in /var/www/web24689573/html/wp-includes/meta.php on line 841 Fatal error: Allowed memory size of 536870912 bytes exhausted (tried to allocate 20480 bytes)…
Erik
  • 45
  • 7
0
votes
1 answer

Merging data from two datasets based on closet lower value between two different columns

I am trying to do a full join on two datasets where the merge by columns differ in their values and I am trying to merge data based on the closest lower value. Example dataset 1 Example dataset 2 What I want it to look like I have tried to use…
Rana
  • 25
  • 5
0
votes
2 answers

Rearranging data according to rater and subject, simultaneously creating new row names

I have a dataset where multiple raters rate multiple subjects. I'd like to rearrange the data that looks like this: data <- data.frame(rater=c("A", "B", "C", "A", "B", "C"), subject=c(1, 1, 1, 2, 2, 2), …
Linus
  • 41
  • 5
0
votes
0 answers

how to retrieve data from world bank excel master sheet and create a new data frame

I'm working on retrieving the data from world bank master excel sheet. I want to extract the country names and different indicators from the world bank master sheet and create a new data frame. here is the link for the data…
sadiqcodex
  • 1
  • 1
1
2
3 4