Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
0
votes
5 answers

Attempting to import a csv into SQL Server that is lead by a random number of 0

Basically, I want to skip the random number of zeroes. The solution, I think, would be to create a dummy column, in the format file, that ends on the first nonzero value. However, after scouring the net, I have no idea how to do that. edit: To…
Jerome
  • 267
  • 4
  • 15
0
votes
2 answers

SSIS file with no deliminator, how(is it possible) to read using files source?

I have got a feed (for Employee details) whose one record is like this. 101EnggAnal brief given to me is 1st 3 characters will be employee ID, next 4 will be department and last 4 will be Designation. Can I read this using Flat file source? If yes…
Pritesh
  • 1,938
  • 7
  • 32
  • 46
0
votes
0 answers

SSIS 2008 parsing flat file

I'm trying to import the following txt file with SSIS 2008. :BEGIN "2011-12-19 10:30:56" "Alignement pos.10-74" -0.0010 "Côté Rouage" "X_pos.réf.10" -8.8340 -8.8340 0.0020 0.0020 -0.0000 "Y_pos.réf.10" 1.0330 1.0330 0.0020 0.0020 -0.0000…
largo68
  • 609
  • 2
  • 16
  • 29
0
votes
4 answers

Format to use to transmit bulk-data?

I am planning to request the users of the my web application to submit bulk data in the following format. BatchID:1 TotalRecords:200 Cust:CustID~FirstName~LastName~Age~Dob~City~State~Country 1~John~Abraham~35~10/10/1974~New…
acadia
  • 2,619
  • 18
  • 55
  • 72
0
votes
1 answer

Flat File Schema Wizard

I have an example of a tab delimited flat file like this: Expense Report Id Name Geography StartDate EndDate TotalExpense 123456789 JJ Thompson Atlanta 6/12/2011 6/18/2011 454.10 ExpenseDate Guests (Separated by comma)…
auwall12688
  • 389
  • 3
  • 11
  • 23
0
votes
1 answer

Is it really helpful to store content in flat-file than a database for better google/yahoo/bing searches?

I just came across few articles, while selecting a wiki for my personal site. I am confused, as i am setting a personal wiki for my personal projects, i think a flat file system is good, even to maintain revisions of the design documents, design…
Vivek Sharma
  • 3,794
  • 7
  • 38
  • 48
0
votes
2 answers

Dumping blob rows to files from MySQL

I have a table with a few thousand rows in it that has a few integer columns and a blob column. I want to dump each row out as its own file with the blob being the content and the integers being used to form the file name. This is a one time op so…
BCS
  • 75,627
  • 68
  • 187
  • 294
0
votes
1 answer

What is the fastest way to bulk insert fixed width flat-file data into Oracle 11g r2?

I am tasked with inserting ~1 million rows from a fixed width format flat-file on a daily basis. I do not have the privilege of direct access to the database file system. The file system also cannot be accessed by any external mounts or samba…
NickSuperb
  • 1,174
  • 1
  • 8
  • 28
0
votes
2 answers

Finding the maximum occurring string within a text file

So I've seen questions asked before that are along the lines of finding the maximum occurence of a string within a file but all of those rely on knowing what to look for. I have what you might almost call a flat file database that grabs a bunch of…
Michael Zaporozhets
  • 23,588
  • 3
  • 30
  • 47
0
votes
1 answer

BizTalk - Generating schema for carriage return delimited flat file

I am trying to generate schema for a flat file the content of which are separated by carriage returns. Please see a sample of the data from the import file below: 12042012 TDF XYZ Industries Limited X9090-78900 - 3.4 - NA - - - - - All…
Shivvu
  • 1
  • 2
0
votes
1 answer

SSIS Flat File Destination prevent text quoting in fields with no data

I'm creating an exported CSV file in SSIS (2008) in which text fields need to be surrounded in quotes. Easy enough. But my requirments say that if there is no data in a text field, there should be no quotes either. But SSIS will put two double…
BeachBum
  • 571
  • 1
  • 6
  • 17
-1
votes
1 answer

how to select a column range when importing data from flat file into sql, if the data in file didn't separated with any tags like comma and semicolon

If data like "700133 70013303102021SC 25 210604580000000440" "700133 70013303102021SC 26 210604600000010000" need roll number like "80000000440" and "600000010000" how will separate the data and to load in table which are already created
-1
votes
1 answer

How to create a fixed length flat file in Java?

I'm currently having a JSON file which needs to be converted into a text file with fixed length for each field. For example, for a JSON { "employee": { "name": "ABC", [length = 10] "salary": 1000 [length = 5] …
swathi
  • 11
  • 2
-1
votes
2 answers

unix command to extract lines with blank values in particular position in a fixed width file

I have a fixed width file with no delimiter. I would like to extract lines in the fixed width file which has blank values from position 550-552
ush rani
  • 15
  • 2
  • 4
-1
votes
2 answers

Custom flat-file database - how do I design them?

Normally I would just use SQL/SQLite/Mongo for anything database-y but I thought it would be interesting to try and create my own flat file database structure (it's just a learning project). The application itself is a music streamer with a…
Cheetah
  • 13,785
  • 31
  • 106
  • 190