Stack Overflow
Stack Overflow

Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
4
votes
1 answer

Should I use a flat file or database for storing quotes for a random quotations app on Android?

I am developing an app on Android that will randomly pick and display an inspirational quotation (or verse) from a large collection of quotations. On Android I can choose between a flat file and an SQLite database. The app should satisfy the…
Pankaj Godbole
  • 177
  • 1
  • 8
4
votes
3 answers

Flat file normalization with a dynamic number of columns

I have a flat file with an unfortunately dynamic column structure. There is a value that is in a hierarchy of values, and each tier in the hierarchy gets its own column. For example, my flat file might resemble…
Jeremy Holovacs
  • 22,480
  • 33
  • 117
  • 254
4
votes
1 answer

Subset a ffdf object (subset vs ffwhich)

I am performing a subset of a large ffdf objects and I noticed that when I use subset.ff it is generating a large number of NAs. I tried an alternative way by using ffwhich and the result is much faster and no NAs are generated. Here it is my…
ddg
  • 2,493
  • 2
  • 20
  • 23
4
votes
5 answers

Using PHP to replace a line in a flat-file database

There are quite a few different threads about this similar topic, yet I have not been able to fully comprehend a solution to my problem. What I'd like to do is quite simple, I have a flat-file db, with data stored like this -…
user1707616
  • 117
  • 2
  • 9
4
votes
3 answers

Unicode string to flat file from vba

I want to store a unicode string in a flat file on a windows box from an excel/vba macro. The macro converts normal string to unicode representation, need to store it in a file and retrieve later.
Amit
  • 61
  • 2
  • 5
3
votes
2 answers

Spring Batch: How to process multi-line log files

I am trying to import the contents of a log file into a database using Spring Batch. I am currently using a FlatFileItemReader, but there are unfortunately many log entries that doesn't catch. The two main problems are: Lines that contain…
Sean Patrick Floyd
  • 292,901
  • 67
  • 465
  • 588
3
votes
3 answers

Record manipulation in flat files in Java

This is my first post here in StackOverflow. I am not a newbie to Java but I am not an expert or a professional programmer either. It has been quite some time I have had some ideas in my head and I do not know how to implement them in a proper…
Jazz
  • 639
  • 1
  • 11
  • 28
3
votes
1 answer

SSIS FlatFile Access via Jet

Is there a way to access FlatFiles with the Microsoft.Jet.OLEDB.4.0 driver in SSIS ? The acces via the FlatFile Source is much better, it´s just about if there exists a way to do it with the Jet driver.
kamahl
  • 931
  • 1
  • 8
  • 20
3
votes
1 answer

SSIS Derived Column Expression to skip null/blank value and take the next digits of string value

I am very new to SSIS and I am performing a task where I have to take the flat-file text document and then derive the columns with specific digit lengths. For eg, lines in the text document are: 101001A00000000000000309493020111139 …
sarcastic reality
  • 41
  • 1
3
votes
4 answers

How do I do a full-text search search of flat files with Perl?

We have a Perl-based web application whose data originates from a vast repository of flat text files. Those flat files are placed into a directory on our system, we extensively parse them inserting bits of information into a MySQL database, and…
Patrick
  • 95
  • 5
3
votes
3 answers

The row delimiter cannot be the same as the column delimiter

When I try to add a column and set the ColumnDelimiter in the Flat File Connection Manager Editor, I get the error: The row delimiter cannot be the same as the column delimiter. How can I specify the delimiter?
live-love
  • 48,840
  • 22
  • 240
  • 204
3
votes
2 answers

"Import Flat File" wizard unable to detect the column headers

I am using "Import Flat File" wizard in the SQL Server 2017 to import a .txt file into the database. Below screenshot shows the steps: Once I select the file location, I see the data preview. In data preview, I don't see the column names. Wizard…
Rashmi Shivanna
  • 85
  • 2
  • 14
3
votes
1 answer

SSIS Oracle Source outputs only 1 character

I'm a trying to make a SSIS package that extracts data from a view in and Oracle database and saves this in a flat file. No coversions, no nothing. My problem is that when I preview the data in the source component it looks correct and returns ex.…
Specialet
  • 31
  • 1
3
votes
1 answer

How do I solve (use) ETL when columns and rows are unmatched from flat file

I have 2 large files, an Excel spreadsheet and a csv file, which are messed up, but still need to be uploaded into a table. I'm in progress learning how to use SSIS. Assume the columns and rows look something like this.. 1st Excel spreadsheet (file…
rs001
  • 57
  • 7
3
votes
2 answers

Derived column Transformation Editor - I need add number at the end of order number in increment order

I have a csv file having many lines with different order number I need to change them via SSIS Derived column Transformation Editor so I can have transformed output. I need to write Expression that adds number at the end of order but I need…
David
  • 67
  • 1
  • 6
1 2 3
…
55 56