Questions tagged [csv-parser]

44 questions
1
vote
1 answer

How to load values from a local csv and pass them in a webform using Playwright

So I am trying to automate the process of filling out a webform on https://www.business.att.com/disconnects/. I am using the Playwright test tool to automate this process using JavaScript I have the steps outlined in Playwright: const { test, expect…
FTM.ELR
  • 11
  • 2
1
vote
1 answer

csv-parser cannot read or open such .csv file

csv file is and in my index.js here is my code : const fs = require('fs'); const csv = require('csv-parser'); const inputFile = "./data.csv" let results = [] fs.createReadStream(inputFile) .pipe(csv()) .on('data', (data) =>…
deagleshot32
  • 81
  • 1
  • 8
1
vote
1 answer

What is causing Error TypeError: text is not iterable? - Web scraper Puppeteer NodeJs

I am learning nodejs/puppeteer and having issues getting Puppeteer to fill UPC numbers from a CSV file onto the search bar of a book website. I managed to get a the web scraper to scrape the website if I use a single UPC number. But I am getting the…
Ben
  • 77
  • 9
0
votes
2 answers

Reading .csv data with inconsistent pattern

I have a very huge CSV file. I want to read it through Pyspark but I am not able to read it properly. Sample csv as "keyvalue","rto","state","maker_model","veh_type","veh_class" "hnjsnjncjssssmj", "OD", "ODISHA", "BAJAJ AUTO", "Private Vehicle",…
Sumanta
  • 29
  • 5
0
votes
0 answers

readStream.pause() is resuming while using pipe with csv-parser

I want to read a csv file rows one by one and perform a third party call on them. but when i pause the stream it is getting resume before my response. const csv = require('csv-parser'); const readStream = fs.createReadStream('data.csv'); readStream …
DevError404
  • 129
  • 2
  • 14
0
votes
0 answers

Parse CSV using database and fieldFilter parameters

I created a method using an ArrayList that is building a list from a CSV File. I am having trouble adding the String value of the field to the list. When I tried to use field.add() it gives me an error "The method add(String) is undefined for the…
0
votes
0 answers

How to read a huge CSV file efficiently and convert CSV values into objects based on a user-defined class in Java

I have to read a large CSV file with about 700,000 records and compare the CSV data to an API response. I was able to use OpenCSV and make the code work. However, the deserialization process is extremely slow. It takes about an hour just to…
ychaulagain
  • 73
  • 1
  • 8
0
votes
0 answers

How to parse =,"" csv files using csv-parse

I am using csv-parse/sync library and trying to parse a .csv file that has this structure. ="212600300516","1122133",="****5401",="000272", I am using this configurations const { parse } = require("csv-parse/sync"); const records = parse(text,…
Missak Boyajian
  • 1,965
  • 7
  • 32
  • 59
0
votes
0 answers

javax.xml.parsers.DocumentBuilderFactory parsing double quotes from text editor("") but not from Libre Office writer (“”) in Linux

A CSV file with empty double quotes "" is parsed using javax.xml.parser where DocumentBuilder and DocumentBuilderFactory is used. when double quotes are added to the file using Linux text editor("") it is parsed correctly. when double quotes are…
CSD
  • 1
0
votes
0 answers

VPA- insert diff picture

I want to know what formla should I use through VPA when I want to enter a different picture every month I make a file in my work I need to enter a picture of the balance every month I would like to know which formla who through VPA will help me…
0
votes
1 answer

csv-parser, delimiter usage

There is a csv file separated by semicolons. The problem is solved when I replace all semicolons in the file with commas. but I want it to parse the csv file with semicolon. const csv = require('csv-parser') const fs = require('fs') const results =…
FarukA.
  • 3
  • 2
0
votes
1 answer

Parsing CSV file with non normalized data and overloaded delimiter in NodeJS

My aim is to parse a CSV-dataset with non normalized data in some rows which is enclosed in "". I cannot split it by ";" because this char is also used inside of the data. I ask myself, if there is an easy way to solve this!? Some rows contain non…
A.T.
  • 127
  • 9
0
votes
0 answers

Java OpenCSV CSVParser delimiter inside quoted string

I have an issue to parse a CSV file with the following separator ';' and quote char '"'. The problem is that I have to deal with quotes and semicolons inside the quoted string. I cannot change the source file / separators etc. I am using the library…
AndrewP
  • 1
  • 1
0
votes
1 answer

csv-parser .on('end') nodeJS

I have this function bd() that should return an arrays of all the data read in the file groupes.csv which will be later processed : function bd() { const birthdays = []; fs.createReadStream('./data/groupes.csv') .pipe(csv({})) …
0
votes
1 answer

create json object from csv file data coming as buffer in request in node js

I'm processing csv file data coming from request to create json object using multer,csv-parser. but can't process from long time. please help and thanks.following is example of csv file processing. const multer = require('multer'); const fs =…
omkar p
  • 43
  • 1
  • 8