StreamSets get MongoDB fields

Question

I would like to ask if anyone knows if StreamSets can also get a field which does not exist in every MongoDB records.

Thanks in advance.

Answer 1

StreamSets Data Collector follows a 'schema on read' model - it will read records from a MongoDB collection whether they have the same fields or different.

Answer 2

If you read some document from mongodb which doesn't contain some field you want it to contain then you can add some SDC component like expression evaluator or groovy script to add this field programmaticaly after reading from mongodb.