How SCDF stream diagram reflect multiple source channel?

Question

If a have a source app(named A-Source) which has multiple channels to emit messages, eg. channelA.destination=b-topic, channelB.destination=c-topic. The receiver for b-topic is B-Sink, for c-topic is C-Sink. How can i construct my stream, describe them like: A|B and A|C? And if so, i think just part of my A-Source code is useful in every stream.

So my question is: how SCDF stream DSL deal with multiple tap for single source app.

score 0 · Answer 1 · answered Jun 08 '17 at 06:12

0

You can use named channel destinations in the Stream DSL.

For example:

dataflow:>stream create tap1 --definition ":b-topic > B-SInk" dataflow:>stream create tap2 --definition ":c-topic > C-SInk"

answered Jun 08 '17 at 06:12

Ilayaperumal Gopinathan

4,099
1
13
12

And how about the DSL for A-Source ? `A-Source > :b-topic` `A-Source > :c-topic` if so, then just part of my A-Source code is useful in the above two stream. – zjunothing Jun 08 '17 at 07:21
Yes, the named destinations can be either source channel or sink channel destinations. – Ilayaperumal Gopinathan Jun 08 '17 at 10:18
So it mean the scdf just cannot orchestrate stream like A->B and A->C – zjunothing Jun 09 '17 at 03:52
Not sure what do you mean by that. Can you specify the stream definition and specify which do you think SCDF cannot orchestrate? – Ilayaperumal Gopinathan Jun 09 '17 at 08:57
eg. A-Source app have three channels to B-Sink. How to write the Stream DSL for it. – zjunothing Jun 14 '17 at 02:56

How SCDF stream diagram reflect multiple source channel?

1 Answers1