cascading : How to read or write multicharactor word?

Question

If 'Each' read GBK String from file and Write GBK String to file, how can i do? How to define it?

Fields namesFields = new Fields("zid", "vid", "title", "number");
sourcePipe = new Each(sourcePipe, new Fields("line"), new Parse(namesFields), Fields.ALL);

score 0 · Answer 1 · answered Mar 01 '13 at 07:30

0

On Feb 27, 2013, at 11:24pm, chen dong wrote:

If i want to read String (format: GBK) and Write String(format: GBK). How can i do?

http://docs.cascading.org/cascading/2.1/javadoc/cascading/scheme/hadoop/TextLine.html

Use the constructor with charsetName parameter.

answered Mar 01 '13 at 07:30

cdhit

1,384
1
15
38

I also ask this question in Google groups, and at there someone answer my question. – cdhit Mar 01 '13 at 07:30

score 0 · Answer 2 · answered Mar 01 '13 at 07:34

Each is used to perform a function or filter on input data.

if you have data in columns like "zid", "vid", "title", "number",

you can perform filter on one of those columns .like you can filter data if column title is not having jdk string.

so that tuple with jdk string will be printed as output .

for that you have to write a user defined filter by implementing filter interface and extending baseoperation class.

cascading : How to read or write multicharactor word?

2 Answers2