record(line) terminator in BufferedReader of Java

Question

I am reading from a file from hadoop. The file is delimited by CTRL+B character. I must load these files to vertica database.

I am reading hadoop files line by line and inserts the records using prepared statements. Some of the records in the files contains new line(SOH control character) in their values(eg; address, comments). I am using readLine() on the BufferedReader object to hadoop file. So, it rejects some of the records containing newlines in their columns. It reads these records as two records missing some column values. This causes database to reject them.

The File is delimited by STX(CTRL+B). The columns values containing new lines are having SOH(CTRL+A) inside them. My question is how to read these lines as such. Any help?

Yes, the vertical hadopp connector is not working properly with vertical 7 — Santhosh, Apr 25 '15 at 01:34
What isn't working? What version of Vertica are you running? What flavor of Hadoop are you running? — Kermit, Apr 25 '15 at 02:43
I am using CDH5 and vertica 7. Right now I am using prepared statement s — Santhosh, Apr 25 '15 at 03:04

score 1 · Answer 1 · answered Apr 24 '15 at 23:36

1

These aren't lines as such in terms of BufferedReader.readLine(), and the bytes concerned are not characters in its terms either. You will have to use an InputStream and look for the terminators yoursef

answered Apr 24 '15 at 23:36

user207421

305,947
44
307
483

score 0 · Answer 2 · answered Apr 25 '15 at 00:02

0

Use the Scanner class. You can set the delimiter with useDelimiter(String) .

answered Apr 25 '15 at 00:02

mrres1

1,147
6
10

record(line) terminator in BufferedReader of Java

2 Answers2