Questions tagged [data-processing]

Data Processing concerns the converting of raw data to machine-readable form and its subsequent processing (as storing, updating, rearranging, or printing out) by a computer.

Data Processing concerns the converting of raw data to machine-readable form and its subsequent processing (as storing, updating, rearranging, or printing out) by a computer.

More Info

909 questions
-1
votes
1 answer

The code returns 0 GPU when there is a built in GPU

was getting started with tensor flow. I dont have any external gpu expect the built in intel 5000. so when I ran this I got 0 . Should that be the desired output? Should I not get 1? If that's the case, should I limit CPU space to ensure it doesn't…
-1
votes
1 answer

which one to use to process data for sagemaker batch inferencing pipeline - SKlearnEstimator or SKlearnProcessor

I'm building a Sagemaker batch inferencing pipeline and get confused about the options to process features (before inferencing) between using sagemaker.sklearn.processing.SKLearnProcessor and sagemaker.sklearn.estimator.SKLearn My understanding of…
-1
votes
1 answer

Find the occurences of different keys in a file has multiple columns in C++

I have a file in the format as belows. I've done parsing it. I have the code to find the occurences of each key by switch-case or if(). But I want to find a better way to do it. Here's the message I need to parse then find occurence of keys. We can…
user00biet
  • 11
  • 1
  • 3
-1
votes
1 answer

I have written a code to find zscore but it's output is greater than 1 , also it's standard deviation is not 1, what is the error here

i have written a code to standardize data from scratch but the problem is, it's output is sometimes greater than 1, i have no clue what's the issue. if i've did something stupid, please point out my errors, here's the code import numpy as np import…
hell fx
  • 1
  • 1
-1
votes
2 answers

Generate vectors of dataset based on a feature list, in Python

I need to generate a vector for each sample in a dataset, based on total amount of features of the dataset. # Assume the dataset has 6 features features = ['a', 'b', 'c', 'd', 'e', 'f'] # Examples: s1 = ['a', 'b', 'c'] # For s1, I want to generate…
Jack Qiao
  • 13
  • 3
-1
votes
2 answers

How do I apply a function to rows in columns with names containing a partilcular stringin R

I have a dataframe with column names: X, time, "indoors_c" and "outdoors_c". Where time is >= 13, I want to replace the value of the rows in columns with names containing the string "_c" with 0. How do I do this without referring to the entire…
nc97
  • 1
  • 1
-1
votes
1 answer

Theoretically, are DATE and TIME two different variables?

I’m curious to find out if, in terms of tidy data principles, a column containing “date and time” ( 1/1/21 11:31) would be considered as a single variable or tow separate ones?
Jose
  • 1
-1
votes
5 answers

Print whole lines, when find duplicate

This is fragment of my input: DGD3 SOL10 DGD53 SOL15 DGD100 SOL15 DGD92 SOL20 DGD41 SOL22 DGD62 SOL35 DGD13 SOL40 DGD13 SOL40 My expected output DGD53 SOL15 DGD100 SOL15 DGD13 SOL40 DGD13 SOL40 In my data I have sometimes SOL duplicates (not more…
Jakub
  • 679
  • 5
  • 16
-1
votes
2 answers

Compare 2 dataframe columns and delete rows

I have 2 dataframes with different lengths. I would like to compare and delete unavailable values(rows) from df1. Here is an example: df1 = pd.DataFrame({'Filename':['image1','image1','image2','image3'], …
Praveen
  • 267
  • 1
  • 5
  • 19
-1
votes
1 answer

Which programming language to use for data processing on a server?

I am planning to start a project where a client uses a form to enter data which is forwarded to a MySQL database. From this database the data should be read by a script which is processing the data (comparision with other values stored in another…
Tim B.
  • 88
  • 2
  • 11
-1
votes
1 answer

Contain in Apache free marker

I have below object returned by a particular function {"count":3, "items":[ { "organizationCode": "FP1", "organizationName": "FTE Process Org" }, { "organizationCode": "T11", …
Shruti sharma
  • 199
  • 6
  • 21
  • 67
-1
votes
1 answer

How to compare two string in apache free marker

I have below scenario in apache free marker. str1= Shruti str2 it can be( "Shruti" ,"shruti", shruti,'Shruti' or SHRUTI) if string 2 is either with double quote or single quote or plain, we need to return it true. also it should be case…
Shruti sharma
  • 199
  • 6
  • 21
  • 67
-1
votes
2 answers

Developing a simple cloud data processing system

What would be the most simple way to take a public data API, for example, and schedule a daily job to calculate a set of statistics and land the computed statistics in a cloud database?
-1
votes
2 answers

How to divide numbers stored as text into many parts in awk or maybe sed or other?

I need to divide my text file. In my text file, I have numbers. This is a small fragment of my input file. In my text file, I have numbers from 29026 to 58050. 29026 29027 29028 29029 29030 29031 29032 29033 29034 29035 29036 29037 29038 29039…
Jakub
  • 679
  • 5
  • 16
-1
votes
1 answer

How to update values with the column names with condition in R?

I have a data frame like below. Note: This is the sample data of my data. data: id user time1 time2 time3 1 user1 07:52 08:34 08:43 2 user2 08:14 10:09 10:22 3 user3 07:43 09:29 09:44 4 user4 09:36 10:34 …
Navya
  • 307
  • 3
  • 15