Stack Overflow
Stack Overflow

Questions tagged [flat-file]

A flat-file database model is any system using a single file for storage with one record per line, usually plain-text or text mixed with binary data.

A "flat file" is a plain text or mixed text and binary file which usually contains one record per line or 'physical' record (example on disc or tape). Within such a record, the single fields can be separated by delimiters, e.g. commas, or have a fixed length. In the latter case, padding may be needed to achieve this length. Extra formatting may be needed to avoid delimiter collision. There are no structural relationships between the records.

Typical examples of flat files are /etc/passwd and /etc/group on Unix-like operating systems. Another example of a flat file is a name-and-address list with the fields Name, Address, and Phone Number.

Source: Wikipedia (Flat file database)

830 questions
1
vote
3 answers

Parse flat-file (positional text-file) to read the wavelength

I have the next txt with data: FI R 83.0000m 34.960 1.1262 Fe 2 1.32055m 33.626 0.0522 N 2 5754.61A 33.290 0.0241 TI R 1800.00m 33.092 0.0153 Fe 2 1.24854m 32.645 0.0054 N 2…
Joan Lopez
  • 47
  • 6
1
vote
2 answers

Spring Batch custom partitioner for input file

I'm trying to partition a flat input file containing ; separated items. the first item on a line indicates a category and I would like to partition on this category so that for each category a partition is created that will be handled by a dedicated…
nkr1pt
  • 4,691
  • 5
  • 35
  • 55
1
vote
1 answer

Informatica Flat File source name

I am working on a project were we need to load flat file eg : (Gemstone_20220325.csv) I have given the source name as (Gemstone_*.csv) in script to search for the file in the path. But it is failing with error , No such file . Is that anything I am…
abirami ramachandran
  • 37
  • 6
1
vote
1 answer

Flat file formatting issue in SSIS

We receive a flat file that is delimited from our third-party client. Row Delimiter = LF; Column Delimiter = Tab The file has 8 columns. The delimited formatting in the file is correct for the most part except for three records where the 6th…
maljee
  • 21
  • 4
1
vote
1 answer

SSIS import CSV file to existing table, using data type and sizes

I have an existing table in SQL Server to which a CSV file must be loaded. Using a Flat File Source comes up with the correct line endings and delimiter character. However, every column is configured as DataType = DT_STR and OutputColumnWidth =…
lit
  • 14,456
  • 10
  • 65
  • 119
1
vote
5 answers

Import multiple flat files in the same folder to SQL Server using flat file name as table name

I have been searching for an efficient way of uploading 100's of text files in the same folder to an SQL Server with one click of a button. I perform this every month, manually mapping the tables. It takes some time to manually choose each flat file…
pandasman
  • 90
  • 18
1
vote
1 answer

multiline regex with lookahead

I`m currently trying to read a log file with regex. My logs begin with a timestamp followed by a random multiline message which can include multiple new lines, returns and all types of character. The regex should capture everything starting with the…
MSDUV
  • 13
  • 2
1
vote
1 answer

Create flat file that 'flattens' multiple rtansaction rows into one line in SQL*PLus

As the title says, I need a method of flattening multiple rows into a one luine output per account. For example table looks like this: Account Transaction 12345678 ABC 12345678 DEF 12346578 GHI 67891011 ABC 67891011 JKL I need the…
derek b
1
vote
2 answers

How to add FileSytemObject to my VBA for creating text flat files in Unicode?

I've managed to piece together this VBA which takes data from excel and turns it into .txt flat file. It works exactly as I need, but I would like to alter it so that the end result is saved as Unicode as opposed to ANSI. I've done some reading and…
Jim
  • 23
  • 4
1
vote
1 answer

azure data factory v2 ingest files from data lake with different filenames and structure

I've been tasked to ingest flat files from data lake storage. They are multiple files and will be stored in the same logical folder. The contents and structure of these files are different. each times a new file is added with the same structure of a…
Geezer
  • 513
  • 5
  • 17
1
vote
1 answer

Explode Flat File Result

I am using flat file db, not mysql so I can't use $limit Function getbyfieldsw() /*! * @function getbyfieldsw * @abstract retrieves records in the database whose field matches the * given regular expression. * @param fieldname the field which to…
cchap
  • 11
  • 1
1
vote
0 answers

Using a VBA script to make flat files - Remove blank rows and handle more volumes?

Completely new to VBA, and here for that matter. I'm trying to write a script for converting data in an Excel spreadsheet to a flat file (.txt) for loading into an ERP. I've got as far as piecing together the below script, but have two problems that…
Jim
  • 23
  • 4
1
vote
3 answers

import flat file to SQL Server - Is there some kind of size / cell limit?

Can someone please confirm / deny if there is a cell limit (or any other kind of size restriction) when importing flat files into SQL Server? I have been having an exasperating time recently, importing csv files which continually return the error…
smallnorthumbrianvillage
  • 49
  • 9
1
vote
0 answers

Flat File Python SQL Automatize process ETL script

I need to create the process ETL in the next file: LIST OF TRANSACTIONS COD. SE ,COMERCIAL NAME ,TYPE ,DATE OP ,TIME OP ,DATE TX ,ID UNIQUE , 1010101 ,CARL…
Darth_Kenobi
  • 11
  • 2
1
vote
0 answers

How to Parse a Text File using SSIS Flat File Connection Manager having Pipe Delimited Columns, Tilde Delimited Segments and Line Feeds?

I need some guidance in parsing a file that uses pipe delimiters for each field, has segments and line feeds at end of the row. A sample is pasted below: I've tried writing a Script Component that separates the column by pipe delimiter. However,…
SidC
  • 3,175
  • 14
  • 70
  • 132
1 2 3
…
55 56