Stack Overflow
Stack Overflow

Questions tagged [data-processing]

Data Processing concerns the converting of raw data to machine-readable form and its subsequent processing (as storing, updating, rearranging, or printing out) by a computer.

Data Processing concerns the converting of raw data to machine-readable form and its subsequent processing (as storing, updating, rearranging, or printing out) by a computer.

More Info

909 questions
0
votes
2 answers

Python: read text file into array - unequal row distrubution

I need to process a large text file containing information on scientific publications, exported from the ScienceDirect search page. I want to store the data in an array of arrays, so that each paper is an array, and all papers are stored in a larger…
Michael van Elk
  • 13
  • 4
0
votes
0 answers

Combine boxplot axies with polyfit lines axies in Matlab

I am drawing a plot for a set of data, including a boxplot and a polyfit plot, but when I drew it, they had two different axies so that I could not compare them. How could I combine these two plots and make them into the same axies? (For example,…
kimdai
  • 1
  • 2
0
votes
2 answers

How to create php associative array from messy data

Supposing you have a html form with a small amount of backend php. The form has only one field, which returns either 1 or 0. For instance... And the php script records this in a MySQL database along with the information about the user's OS. So you…
Stumbler
  • 2,056
  • 7
  • 35
  • 61
0
votes
1 answer

R scripting in SPSS Modeler 16: change default "rowCount=1000" for modelerData

When applying R transform Field operation node in SPSS Modeler, for every script, the system will automatically add the following code on the top of my own script to interface with the R Add-on: while(ibmspsscfdata.HasMoreData()){ …
KeepMoving
  • 3
  • 3
0
votes
1 answer

SAS-Generating Mean of a Variable For Each Date in Data Set

Hello I have a data set, icecreamData that is of the form: Date Firm ConesSold 19900101 A 5 19900101 B 6 19900101 C 7 19900102 A 3 19900102 B …
Claude
  • 1
0
votes
0 answers

How can you read a file as binary, hexadecimal or integer data for immediate data processing in PHP

I have stumbled across a really odd issue in PHP that I thought would have been solved a very long time ago but doesn't seem to be. I am reading a file of a proprietary format, byte by byte using $handle = fopen("myfile.bin", "rb"); while…
Supernovah
  • 1,946
  • 12
  • 34
  • 50
0
votes
1 answer

Deleting Observations That Are Not Part of a List in SAS

My first SAS data set, ds1 contains dates, firms and share prices. My second data set, ds2 contains a subset of the firms in ds1. I'd like to create ds3 which contains all of the observations in ds1 provided a firm in ds1 is also in ds2. I try…
Carolyn
  • 1
0
votes
1 answer

Mapping financial data from multiple vendors to match internal formats and naming convention

I have a concern which I believe might be a good subject for the archives, as I imagine many people may encounter a similar problem at some point in their careers. I'm looking for any/all suggestions, ideas, comments in regards to mapping data…
user3610077
  • 3
  • 2
0
votes
3 answers

Low level file processing in ruby/python

So I hope this question already hasn't been answered, but I can't seem to figure out the right search term. First some background: I have text data files that are tabular and can easily climb into the 10s of GBs. The computer processing them is…
lswim
  • 3,064
  • 2
  • 15
  • 13
0
votes
1 answer

data processing pipeline python

I am working on the following problem. Lets say I have data (say image values RGB as integers) in a file per line. I want to read 10000 of these lines and make a frame object (image frame containing 10000 RGB Values) and send it to downstream…
kaaliakahn
  • 3
  • 1
  • 2
0
votes
1 answer

Is it possible to export data directly from R to ODF?

I know there is odfWeave. But as far as I know, odfWeave expects you to have your code in the OpenOffice file and R will then process that file. Is there a way to export directly from R to an ODF file? The idea is to generate an ODF file from R that…
R-obert
  • 999
  • 3
  • 10
  • 17
0
votes
1 answer

How to write awk command to group line data and dump to file

One data file consists of multiple line data. A quick look of data file is like: ./gc_string/datadata.distr 10 1273377106 2 ./gc_string/datadata.distr 10 -540812264 2 ./gc_string/datadata.distr 10 318171673 2 ./app_fib/datadata.distr 4 …
shijie xu
  • 1,975
  • 21
  • 52
0
votes
2 answers

Data normalization for new inputs into a trained neural network

I have a backpropagation neural network that I have created and coded it in Q with a Kdb+ database. I am pre-processing data into the network with normalization into the form of [0,1], the network is trained on and predicts future moving averages on…
teabigs
  • 1
  • 1
0
votes
1 answer

Can Datomic simplify querying data contained in dynamically accessed HTML documents?

I need to write an API which would provide access to data being served as HTML documents from a web server. I need for my users to be able to perform queries over the data. Say on a web site there is a page which lists items and their owners. Then…
user7610
  • 25,267
  • 15
  • 124
  • 150
0
votes
2 answers

How to check is there any error in DhtmlxGrid using Dataprocessor?

I want to send data from DhtmlxGrid in my MVC project. I have set some basic validation on grid cells which are working fine. But before submitting i want to check if is there any error in the grid. Right the data are being submitted to controller…
Anupam Roy
  • 1,654
  • 2
  • 18
  • 25
1 2 3
…
60 61