Stack Overflow
Stack Overflow

Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
3
votes
1 answer

SSIS strips periods off column names in Flat File Connection Manager

This question is related to my previous question but is different in focus, so I'm creating a new question. I have a CSV file that has only column names in it, no data. I've created a Flat File Connection Manager in SSIS using Visual Studio 2012.…
Melanie
  • 3,021
  • 6
  • 38
  • 56
3
votes
1 answer

writing .dat file into .txt file after encoding using ssis

I have .dat FIle. I need to do some encoding on this file and need o save into a .txt file I am using script component in SSIS. I have used SSIS Script component to impement this . //have declared 2 read write variable FIleLoc and FileWrite string…
user3035090
  • 57
  • 10
3
votes
2 answers

How to change the flatfile connection manager "file name" value in SSIS package?

I have an ssis package...which read data from fixed-column-width text file into DB table. And I am modifying an existing ssis package. I have a flat file source...and flat file cnnection. When I try to edit the flat file connection...using "flat…
Relativity
  • 6,690
  • 22
  • 78
  • 128
3
votes
1 answer

SSIS Convert Blank Datetime column to NULL and Parse Input

I have the following simple SSIS Package to process a comma delimited file: I'm having problems with date columns - specifically MoveInDate which the input column has data in the format '20090731000000'. It goes into a database column MoveInDt…
rigoo44
  • 95
  • 1
  • 8
3
votes
1 answer

How to replace uni code character in ssis package

I am trying to load DAT file to sql server table .A particular column of DAT file having � in a particular column of the file .I am trying to replace this character using a expression in derived column transformation . Following is the expression…
Velugoti
  • 59
  • 1
  • 6
3
votes
2 answers

Flat file destination columns data types validation

A source database field of type INT is read through an OLE DB Source. It is eventually written to a Flat File Destination. The destination Flat File Connection Manager > Advanced page reports it as a four-byte signed integer [DT_I4]. This data type…
lit
  • 14,456
  • 10
  • 65
  • 119
3
votes
2 answers

How to deal with pipe as data in pipe delimited file

I am trying to solve a problem where my csv data looks like below: A|B|C "Jon"|"PR | RP"|"MN" "Pam | Map"|"Ecom"|"unity" "What"|"is"this" happening"|"?" That is, it is pipe delimited and has quotes as text qualifier but it also has pipe and…
Yogita
  • 31
  • 1
  • 4
3
votes
2 answers

Iterate through search results by column

Is there a way in Vim (or a plugin) to search for a term and iterate through the search results (as per n in Vim), by column, rather than row? So if my file was this: foo1 bar bar baz baz foo3 baz baz foo4 foo2 bar bar If I search…
Brian Carper
  • 71,150
  • 28
  • 166
  • 168
3
votes
1 answer

Importing a flat file with row and column delimiters

I am importing a flat .txt file with both row and column delimiters. The problem is that the row delimiter is used to reduce file size and so often the rest of the columns are skipped. Another problem is that the length of the longest character is…
78282219
  • 593
  • 5
  • 21
3
votes
1 answer

SSIS - Vertical bar vs comma delimited

I have a small issue with my SSIS package. I am importing a flat file. One of the fields is incoming with a decimal value, i.e. 32.76. It is being mapped to an int data type column. What is strange is that if the input flat file is comma…
Scott
  • 165
  • 1
  • 3
  • 15
3
votes
3 answers

Import Flat file to SQL - No error thrown after adding a character

I am working on a package that loads data from a text file onto a table on SQL server. The text file has data in the below format I am including the flat file connection manager here - I have created a test table executed the package and moved…
Tara
  • 73
  • 2
  • 9
3
votes
2 answers

How to traverse multiple folders & multiple files & dump data to SQL tables with same filename? SSIS

This will be a bit of an update from the question I asked here before. I need to traverse folders & dump txt files to SQL tables with the same name (barring the .txt extension) My folder/file structure is setup as shown below Now the FileA,B,C are…
thestralFeather7
  • 529
  • 2
  • 10
  • 28
3
votes
5 answers

Can't Separate Text File By Delimiter |

I am using C#. I am trying to pull in a text file to an object. I am using an ODBC connection and it looks like this Driver={Microsoft Text Driver (*.txt; *.csv)};Dbq=C:\Users\Owner\Desktop\IR\IR_Files\Absolute;Extensions=asc,csv,tab,txt; I am able…
jumbojs
  • 4,768
  • 9
  • 38
  • 50
3
votes
1 answer

Column delimiter not found for the column

I have a flat source file with following settings. Test Qualifier = " Header row delimiter = | I have a Column A which has value = This is the example of "value in the source file" The error that i am seeing is the column delimiter for the column A…
Dee
  • 111
  • 2
  • 9
3
votes
1 answer

SSIS ragged file not recognized CRLF

In SSIS, I try to load data from a flat file. The flat file have fixed width columns, but some column are not present in a row (a column can have a CRLF, which must be a new line) like this a b c the first rowok iu …
Cascador84
  • 141
  • 2
  • 12
1 2 3
…
55 56