Stack Overflow
Stack Overflow

Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
1
vote
1 answer

How to convert table to flat file with each field on new row

I have a pipe delimited file with user and address information in the following format: userid|name|street|city|state|zip 123456|fred|123 apple st|Navada|MO|64772 I to output the information another flat file in the following format: *** DOCUMENT…
Ruben E Noguera
  • 43
  • 3
1
vote
1 answer

SSISDB package errs out, says variable does not exist

I have an SSIS package that writes csv files from a database, copies them to a couple locations, and then emails a success message. The process is: Retrieve public file location from database into a variable, @[User::varSQLCSVOutputFolder] Loop…
Quicksilver
  • 295
  • 4
  • 16
1
vote
2 answers

SSIS Flat File add trailing spaces to columns

I am developing a SSIS package which concatenates 3 columns and then outputs the result to a flat file. 1st column is a emp_number consists of length 10. The values which I get is "12345" or "123456" or "1234567". In the output I want is "12345 …
user1526892
  • 61
  • 8
1
vote
0 answers

Importing Flat file with repeating rows into SQL server

I have a very large Fixed length patient eligibility file that I would like to use SSIS to import into SQL. The problem is it's not a standard file, the first 15 columns made up of patient information (Name, Address etc). The next section (20…
Bobby Cruthirds
  • 13
  • 3
1
vote
2 answers

SSIS-- Archive Flat File Task Creating Duplicate Files

I have an SSIS package that first looks at a table in the database for flat files that have been ingested. If they have a status of 1, they are ready to be first archived, and then imported into a database table. I am using a For Each Loop to…
Netta G
  • 53
  • 1
  • 5
1
vote
2 answers

can we send a flat file to IBM MQ or we have to create a string representation of the flat file so that it can be send as a message

I do not have a Flat file which could be converted to string directly. Instead I have a Java object which I need to send as a Flat File to MQ.
user466
  • 47
  • 1
  • 1
  • 5
1
vote
1 answer

Remove duplicates based on substring in Python

i have the following code for detecting duplicates in a file and outputing them in 3 separate files, one for non-duplicates, one for duplicates (x2) and one for duplicates (> x2). The first file, holds only lines that had no duplicates in the…
onlyf
  • 767
  • 3
  • 19
  • 39
1
vote
1 answer

Potential Loss of Data reading from CSV with decimal

I have read a large number of questions and answers on this and I still can't get it to work. I have a csv like the following: Field1;Field2;Field3 CCC;DDD;0.03464 EEE;FFF;0.08432 ... When I attach a Flat File Source, in SSIS, it gives me the…
Diogo Santos
  • 780
  • 4
  • 17
1
vote
1 answer

XSD optional element with tag name

Am building an XSD for a flat file, the XSD have two elements delimited by new line: FirstElement_AAA: Repeating but optional with tag name (AAA,). SecondElement_BBB: Single and Mandatory with tag name (BBB,). So the XSD should support a flat file…
Sufyan Jabr
  • 791
  • 4
  • 20
1
vote
0 answers

flat pack java for multiline records or multi line fixed width files

I am using net.sf.flatpack and new to fixed length file parsing. Does flatpack support mutlilined files or files with different fixed length records? for example: myfile AAA000 SOMETHING 0001 - record1 AAAA SOMETHINGELSE 0001 AAAA - sub-record of…
Maxwell Wang
  • 41
  • 1
  • 3
1
vote
1 answer

How to configure beanio to ignore certain chars in a flat file

I am currently working on a legacy application that gets its data via flat files. To read and write flat files beanio is used and the records are defined via annotations. My Problem is that the specification of one of the flat files demands that…
Tobias Nolte
  • 103
  • 2
  • 12
1
vote
2 answers

Importing flat file into SSIS gives problems because non-consistent deliminater

I am facing a problem importing a flat file into SSIS. The file is seperated by "|" and has deliminater as ";;". However the deliminator is inconsistent. Sometimes, at the and of the rows, there is only ";" or nothing "". When importing to SSIS I…
sss
  • 21
  • 2
1
vote
1 answer

SSIS Flat File Source Not Splitting Column by Comma

I have a flat file connector in SSIS but for some reason it is not splitting the commas into columns. I have the column delimiter set to comma and you can see in "Column 0" there is commas "," however it just doesn't want to split them. Has anyone…
user2407147
  • 1,508
  • 2
  • 22
  • 40
1
vote
3 answers

Dealing with hosts with no mysql

I am dealing with a good web host but the problem is that they limit mysql to 1 database of 25MB The problem is that I need more but can't afford to pay more for the moment. Is there any solution like a .dat file or any type of flat file database…
med
  • 227
  • 2
  • 3
  • 5
1
vote
2 answers

SSIS and JSON Flat Files

Whats the best way to get JSON flat files into SQL Server using SSIS? Currently I've tried parsing the data in a script component, but with amount of JSON files I'm parsing (around 120 at a time) it takes upward of 15 minutes to get the data in. I…
AlanPear
  • 737
  • 1
  • 11
  • 32
1 2 3
…
55 56