Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
2
votes
1 answer

Viewstate in flat files vs viewstate in SQLserver

I wrote my own PageStatePersister class based on SessionPageStatePersister which writes the most recent 10 Viewstates for a session to a shared disk. I figure this will scale better than  keeping Viewstate in session since all web servers have…
Tuviah
  • 723
  • 2
  • 10
  • 20
2
votes
1 answer

Reading tab and newline delimited (multi-dimensional) flat-file database

Apologies if this may be a simple question, I haven't worked with flat file databases before and finding this pretty non-intuitive. I have a flat file, tab \t and \n new line delimited database as such: Sebastian Ingrosso Kidsos (Wippenberg Mix)…
wnajar
  • 747
  • 1
  • 7
  • 27
2
votes
2 answers

How to view the ConnectionString value of Flat File Connection while debugging?

There seem to be 2 ways to set up the connection string in FlatFile connection properties: Using ConnectionString property Using ConnectionString expression Which one will be used? Is there any way to see this value during the debug, or to print…
Yulia V
  • 3,507
  • 10
  • 31
  • 64
2
votes
3 answers

Reading text file

We have a a supplier that each Monday sends a list of new Devices/Parts these are then manually entered into a database. I'd like to use PHP to read this file and update the appropriate datebase records. The database I can do, but how do I read the…
MacMan
  • 925
  • 1
  • 14
  • 32
2
votes
3 answers

How do I retrieve only the top x rows from a flatfile in SSIS

I have a flatfile connection and I'm only interested in the first 10 rows of data. How can I just import the first 10 rows? Row sampling is random so I can't use that. Is there some way I can have some sort of derived column which is an automatic…
neiled
  • 169
  • 1
  • 9
2
votes
4 answers

Remove first line from a text file using XSLT

I'm working with a system (Maximo) that generates a text file. I need to remove just the first line of the file. The way to do that should be using XSLT. Any idea?
NitroxDM
  • 5,039
  • 10
  • 44
  • 56
2
votes
3 answers

Best practices for storing the schema of delimited text files

I am writing a program that parses several delimited flat files from which it needs several of the columns. I am not sure of the best way to make my code easy to maintain/update in the event of future changes to the format of input flat…
Rob Donnelly
  • 2,256
  • 2
  • 20
  • 29
2
votes
1 answer

Replace NAs in a ffdf object

I`m working with a ffdf object which has NAs in some of the columns. The NAs are the result of a left outer merge using merge.ffdf.I would like to replace the NAs with 0s but not managing to do it. Here is the code I am running: library(ffbase) …
ddg
  • 2,493
  • 2
  • 20
  • 23
2
votes
1 answer

Automating Excel Work - flat files into excel spreadsheet

I have a master Excel spreadsheet and I am updating this every day with 10 flat files for 10 different tabs. So, every morning I am opening my excel spreadsheet, deleting yesterday's tabs and putting the most recent txt files. Txt files follow same…
NickFallin
  • 21
  • 2
2
votes
1 answer

Import Text File with irregular header lines through SSIS

I have a file like as seen below; please help how to import it through SSIS.The problem comes how to skip the starting lines as the rest of the file has all columns tab separated.Also i need some information from the header lines like Name of BSC to…
user1820133
  • 41
  • 1
  • 4
2
votes
1 answer

Better solution for High Performance ETL Flat File Extraction?

I have a data set that is structured as follows: [TIMESTAMP] FIXED POSITION DATA STRING [TIMESTAMP] FIXED POSITION DATA STRING [TIMESTAMP] tag1=9324, tag2=19, tag3=55, etc [TIMESTAMP] FIXED POSITION DATA STRING These two types of…
Oeste
  • 1,041
  • 2
  • 7
  • 13
2
votes
5 answers

Storing SAS data (including table structure) in a single flat file

I need to convert SAS data tables into flat files (or "ASCII files" as they were called once, as opposed to binary files). And only one flat file for each original SAS table. The challenging thing is that I want the flat file to contain some…
Martin Bøgelund
  • 1,681
  • 1
  • 17
  • 26
2
votes
4 answers

iOS Implementation Theory

We (IT Department at work) are looking to build an iPad app, that will take numeric IDs and provide a simple lookup in a table. It is essentially a primary key search on a single table, and displaying a field after minor processing. The…
Paystey
  • 3,287
  • 2
  • 18
  • 32
2
votes
4 answers

Suggestion for fastest PHP web page caching for many thousands of pages?

I'm looking for the best solution for caching thousands of web pages. Right now I am using flat files, which works great until there's many thousands of flat files, then the entire file system slows down (a lot) when accessing the cache of files…
Kris B.
  • 95
  • 1
  • 8
1
vote
1 answer

Flat file database vs SQLite for fulltext search PHP

I want to develop a PHP application. And I don't want to use MySQL for my application. And I will need full-text search feature for my application. I want to know that which database is best for my needs, Flat file or SQLite database for full-text…
Seek Php
  • 163
  • 2
  • 3
  • 12