Stack Overflow
Stack Overflow

Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
2
votes
1 answer

SSIS Flat file connection

I am getting a flat file as given below. I have been using ssis to load this data. It has 9 dynamic column name and only first three columns has the row data and rest don't have any data. In the flat file connection manager. I have selected: row…
MSM
  • 327
  • 2
  • 6
  • 12
2
votes
1 answer

How to use set row and column delimiter in flat file connection manager editor

I am trying to set row and column delimiters for flat file connection manager here the data i have The data is in .txt file "Det.ID","Cus.ID","SHIP.ID","PRODUCT"----columns "BO861"00184490"0000"09530-2"TARASCON " ---- rows For rows how to set…
user1757483
  • 87
  • 7
2
votes
1 answer

How can I concatenate yyyyMMdd at the end of my txt file in ssis?

I am using SSIS to transform my data. My file_name is test_heathcare.csv. How can I bring it to my flat file destination as new derived column being filename as test_healthcare20190712.txt? If anyone know please help me .
Kate
  • 445
  • 3
  • 9
  • 22
2
votes
1 answer

Can SSIS support loading of files with varying column lengths in each row?

Currently I receive a daily file of around 750k rows and each row has a 3 character identifier at the start. For each identifier, the number of columns can change but are specific to the identifier (e.g. SRH will always have 6 columns, AAA will…
JbP
  • 45
  • 3
2
votes
2 answers

How to import Flat-file with no column header using SSIS?

I want to import the flat file using SSIS. My flat file has 50 columns but no column header. So it shows like Column 0, Column 1, and so on. I don't want to manually assign column name using the advanced editor. Is there a way to dynamically assign…
Nilesh
  • 21
  • 2
2
votes
0 answers

Text qualifier appears in data when using flat file

I have a flat file connection manager that reads data from a file that I have constructed with a Powershell script. The fields in the file are delimited with a vertical bar (|) and each field is qualified with the ¬ character (mainly because some…
johnmcp
  • 891
  • 1
  • 10
  • 17
2
votes
1 answer

Import csv file via SSMS where text fields contain extra quotes

I'm trying to import a customer csv file via SSMS Import Wizard, file contains 1 million rows and I'm having trouble importing where the field has extra quotes e.g. the file has ben populated freehand so could contain anything. Name,…
Roger Clerkwell
  • 406
  • 4
  • 19
2
votes
1 answer

SSIS flat file with values containing text qualifier

I received a flat file that cannot be generated in other way. The delimited is a comma and the text qualifier is a double quote. The problem is that sometimes a have a double quote in the value. In example: "0","12345", "Centre d"edu et de…
Bradford1138
  • 65
  • 1
  • 1
  • 7
2
votes
2 answers

SSIS Flat File Connection - How does it determine string column DataType?

I am creating a new Flat File Connection Manager SSIS component which is based on a CSV file. I am keen to have the columns (all 547 of them) to be of type Unicode string [DT_WSTR] rather than string [DT_STR]. I am not sure how to trigger this…
Allan F
  • 2,110
  • 1
  • 24
  • 29
2
votes
1 answer

token expression in flat file connection

I have loaded the variables in the format for example: where produkt = 'Muj zivot2 R' and uraz = 'Uraz' and I need the output in the file name to be: Muj zivot2 R_Uraz token worked for me, but it doesn't work in this case " + TOKEN("…
Patrik Novotný
  • 79
  • 7
2
votes
1 answer

remove special characters " and ' from a column using SSIS

I have a csv which has a column called "Value" and in it there are a combination of strings & special characters. Eg: Value abc xyz " pqr ' I want to replace the " and ' special characters with empty string "" in the output file.I used the derived…
AtuD
  • 83
  • 2
  • 11
2
votes
1 answer

'C# script task to remove quadruple quotes before loading .CSV file"

I have a fairly basic SSIS package that will load a .csv file into a SQL table. However, when the package is attempting to read the .csv source in the data flow task I receive the error message: "The column delimiter for column 'X' was not found. …
ManMadeNova
  • 57
  • 2
  • 14
2
votes
1 answer

Change the file encoding of the file which is created using SSIS Log provider for Text Files

I am new to SSIS, I have already designed a package and configured SSIS Log provider for Text Files. This works fine and log files are generated successfully. We have a monitoring team, they use this log file for monitoring. They are unable to read…
StackUser
  • 5,370
  • 2
  • 24
  • 44
2
votes
2 answers

SSIS reading flatfile header column

Can you guys help me (point me in the right direction) on how I can achieve the following in SSIS. So, I have a flatfile that looks like this ColumnA ColumnB ColumnC ColumnD ColumnN 1 x APPLE Random1 MoreRandomData1 …
fo2bug
  • 85
  • 1
  • 8
2
votes
1 answer

SSIS Package Date format

I have a data factory in Azure that has a pipeline to execute an SSIS package. An extract script is included in this package that will convert a date value from 2019-01-13 00:00:00 to 2019-01-13. After this, a logic app picks up the extract.txt file…
Watsyyy
  • 125
  • 10
1 2 3
…
55 56