Questions tagged [choetl]

Cinchoo ETL is a popular high-performance ETL framework for .NET.

Cinchoo ETL is an ETL framework for .NET. Simple, intuitive Extract, transform and load (ETL) library for .NET. It is a code-based ETL framework for extracting data from multiple sources, transforming, and loading into your very own data warehouse in .NET environment. Extremely fast, flexible, and easy to use.

Sample shows how to load below CSV (emp.csv) file

Id,Name
1,Tom
2,Carl
3,Mark

Load using iterator

foreach (dynamic e in new ChoCSVReader("Emp.csv").WithFirstLineHeader())
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

Load using loop

var reader = new ChoCSVReader("Emp.csv").WithFirstLineHeader();
dynamic rec;

while ((rec = reader.Read()) != null)
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

Load using POCO object

public class Employee
{
    public int Id { get; set; }
    public string Name { get; set; }
}
foreach (var e in new ChoCSVReader<Employee>("Emp.csv").WithFirstLineHeader())
    Console.WriteLine("Id: " + e.Id + " Name: " + e.Name);

References

57 questions
1
vote
1 answer

Cinchoo ETL json to csv

I am trying to format a json to csv file. here is the the data struct public class Location { [JsonProperty("latitude")] public double Latitude { get; set; } [JsonProperty("longitude")] public double Longitude { get; set;…
Dude
  • 887
  • 6
  • 15
1
vote
2 answers

Getting more then just the first item in JSON array using CHOETL converting JSON to CSV

Been struggling with the following: I have a JSON response of orders from our Ecommerce website (Shopify). I need to create a CSV from the response. Everything is fine for me until I get to the line item details. I only get the first item in the…
Matthew Brown
  • 142
  • 1
  • 17
1
vote
1 answer

How to Map ChoETL Json to CSV Complex Types

I have the following Class structure public class ResultData { [JsonProperty(PropertyName = "Id")] public string Id { get; set; } [JsonProperty(PropertyName = "Results")] public IEnumerable Results{ get; set; } } public…
MicroMan
  • 1,988
  • 4
  • 32
  • 58
1
vote
1 answer

Creating a file as a stream and uploading to Azure

I am using the ChoETL and ChoETL.Parquet library to create a parquet file based on some other data. I can create the file just fine locally. using (ChoParquetWriter parser = new…
crystyxn
  • 1,411
  • 4
  • 27
  • 59
1
vote
1 answer

Replace or dont append if record/row already exists in csv

I have the following code that loops through json files in a directory and creates a csv file with following records: results.csv File Name Page Practice Name fileXYZ.json 1 XYZ & Co fileAB2.json 1 ABC & Co file1.json 1 Associates…
Cataster
  • 3,081
  • 5
  • 32
  • 79
1
vote
1 answer

How to aggregate confidence levels in csv?

My program currently loops through a directory of pdf/image files and generates json files using the Azure computer vision REST API. Using the JsonToCsv() below, I export specific json elements from those files into csv file, so the the output looks…
Cataster
  • 3,081
  • 5
  • 32
  • 79
1
vote
1 answer

How to extract only certain elements from JSON file and append to csv?

My program currently loops through a directory of pdf/image files and generates json files using the Azure computer vision REST API. Besides generating the JSON files, I'd like to extract certain elements from the JSON generated, such as text and…
Cataster
  • 3,081
  • 5
  • 32
  • 79
1
vote
2 answers

Convert dynamic JSON format to CSV using ChoETL

I would receive JSON in various formats and hierarchies, Need to know the possibility to be able to convert any JSON format into CSV by forming columns dynamically.As an example,i have provided the required details,below is an multi level JSON and…
user2586782
  • 75
  • 3
  • 12
1
vote
1 answer

Converting a Microsoft Graph JSON to CSV using Cinchoo ETL

I am trying to convert a JSON file ( a Microsoft.Graph.Event ) to a CSV file. I'm using Cinchoo ETL to do this. Here is the URL I'm referring to: https://www.codeproject.com/Articles/1193650/Cinchoo-ETL-Quick-Start-Converting-JSON-to-CSV-Fil Here…
beadaman
  • 83
  • 1
  • 2
  • 10
1
vote
1 answer

ChoCSVReader is not considering some configurations

I'm using ChoETL in an MVC project in order to read a csv file and load data into a DataTable. I configured the reader to ignore the duplicates and empty lines but this is not applied DataTable csvFileAsDataTable; using (var reader = new…
1
vote
1 answer

ChoJSONWriter in append mode

How do you open and write data into a file using ChoJSONWriter without overwriting existing data in the file? This is what I've tried: using (var parser = new ChoJSONWriter(fileName)) { parser.Write(data); }
Ahamad
  • 11
  • 1
1
vote
0 answers

Read NACHA Formatted File using ChoETL DLL Not Working in SSIS package

I have Used ChoETL.dll and ChoETL.NACHA.dll to read NACHA Formatted file VS2015 C# console and it is working fine. Created an exe for this console application. Called the EXE in SSIS package using "Execute Process Task". But it is throwing the…
Suresh K
  • 131
  • 1
  • 6
1
vote
1 answer

how to give exception handling for json string if an array found instead of object usinc C#

I am having a json text file as : [ { "productId":"17213812", "returnPolicies": { "user":"Regular Guest" } }, { "productId":"17813832", "returnPolicies":[] } ] and I am getting…
0
votes
3 answers

How do I map from a string to a custom type when importing a csv using ChoETL?

I'm importing a csv of sales orders into CsvSalesOrder objects. The CsvSalesOrder has an Address property, and its properties are of a custom type called CustomString. How can I convert the strings into the CustomString types when importing them? My…
0
votes
0 answers

ChoETL.NACHA FileHeader is not including the File Creation Date

I have upgraded my windows service to use ChoETL.Dll version 1.2.1.55 and ChoETL.NACHA version 1.0.2.3. The NACHA file generated does not include the FileCreation date, which throws the file off as it should have a constant record length. I have…
ERukes
  • 51
  • 6