Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
7
votes
2 answers

Not Creating the File when source has 0 rows

I have the below within the Data-flow area. The problem I'm experiencing is that even if the result is 0, it is still creating the file. Can anyone see what I'm doing wrong here?
Philip
  • 2,460
  • 4
  • 27
  • 52
7
votes
2 answers

Is there a WHERE Clause feature in SSIS for a Flat File Source?

I don't know too much about SSIS and I've googled as much as I could on this. I'd really appreciate any help I could get. I'm building an SSIS package and I only want to insert a specific set of data from a Flat File Source. Is there a way to use a…
iamtheratio
  • 569
  • 4
  • 9
  • 16
7
votes
5 answers

SSIS reading LF as terminator when its set as CRLF

using SSIS 2012. My flat file connection manager I have a delimited file where the row delimiter is set to CRLF, but when it processes the file, I have a text column that has an LF in it. This is causing it to read that as a row terminator causing…
vin
  • 195
  • 3
  • 13
7
votes
9 answers

Why use MySQL over flatfiles?

A friend and I were debating about whether he should use MySQL or a flatfile database for his website's backend. I told him to go with MySQL because it was structured, held records well, and was consistent. He on the other hand said that he would…
John M.
  • 2,234
  • 4
  • 24
  • 36
7
votes
8 answers

Flat File Database Example

I would like to see some examples of simple flat file databases and how they are accessed through a data layer. I've written to and read from a flat file before, but I have not ever created a data layer that accessed the data for an application…
John Fischer
  • 1,115
  • 3
  • 13
  • 24
7
votes
8 answers

Java: Save objects in a textfile? Are there readymade solutions?

I want to save the objects I generated in a program. After restart the App should load automaticly all Objects in an Array. I want to write them in a file and parse them after restart. Are the other smarter possibilities than do it by hand? Thank…
wellenreiter
  • 95
  • 2
  • 8
7
votes
7 answers

How to prevent SSIS from truncating the last field of the last data row in a flat file?

I have an SSIS package thats unzips and loads a text file. It has been working great from the debugger, and from the various servers its been uploaded to on its way to our production environment. My problem right now is this: A file was being…
misterManager
  • 1,174
  • 4
  • 12
  • 33
7
votes
8 answers

What is faster, flat files or a MySQL RAM database?

I need a simple way for multiple running PHP scripts to share data. Should I create a MySQL DB with a RAM storage engine, and share data via that (can multiple scripts connect to the same DB simultaneously?) Or would flat files with one piece of…
Robin Rodricks
  • 110,798
  • 141
  • 398
  • 607
7
votes
6 answers

Converting Flat File to Java Objects

Does anybody know of any good libraries to convert a flat file to Java objects? I found flatworm but I am looking for alternatives.
mkoryak
  • 57,086
  • 61
  • 201
  • 257
6
votes
4 answers

C# Text File Input Multi-File Output

I have a file that looks something like this: |29923C|SomeGuy,NameHere1 |00039252|042311|Some Address Info Here | |47422K|SomeGuy,NameHere2 |00039252|042311|Some Address Info Here | |98753D|SomeGuy,NameHere3 |00039252|042311|Some Address…
ErocM
  • 4,505
  • 24
  • 94
  • 161
6
votes
7 answers

How to Convince Programming Team to Let Go of Old Ways?

This is more of a business-oriented programming question that I can't seem to figure out how to resolve. I work with a team of programmers who have been working with BASIC for over 20 years. I was brought in to help write the same software in…
Austin
  • 834
  • 1
  • 10
  • 21
6
votes
5 answers

Preferred way to parse a custom binary flat file?

I have a flat file generated by a C program. Each record in the file consists of a fixed length header followed by data. The header contains a field indicating the size of the following data. My ultimate goal is to write a C#/.NET program to…
Trevor Balcom
  • 3,766
  • 2
  • 32
  • 51
6
votes
2 answers

Vim - how to join lines using matching pattern

I have a txt file that contains contact info for businesses. Currently, each line contains a different piece of data for the business. I'm attempting to construct a pipe-delimited file with all the info for each business on a single line. The catch…
javaman717
  • 67
  • 1
  • 5
6
votes
3 answers

BizTalk Flat File Schema - how to accept a LF or CRLF as the line delimiter

Our client sends us a flat file as input, which we then take and convert to an XML file before sending to the destination system. The flat file consists of multiple lines, each line is delimited by LF or CRLF. How do I create a Flat File Schema so…
FullOfQuestions
  • 412
  • 6
  • 14
6
votes
2 answers

SSIS Flat file could not deal with NUL (\x00) value?

I am trying to load data from text files to database. My source files contain null character NUL somehow (Picture1). I just make all the fields as one column (delimited with {CR}{LF}). Then I do the preview of the data. The data is just what we…
morgan117
  • 338
  • 1
  • 5
  • 16
1 2
3
55 56