-1

We are planning to use of fast aggregator or hzc jet. We have a requirement to aggregate based on an infinite streqm of messgaes. So lets say if i recieve same type of message will it cache the previously aggregated data or it will calculate based on all previous messages of that type for eg lets say we have to aggregate marks of student and key being student id we have kafka topic where continous meseages are coming contaning student id and marks and some other detail. Now lets say we recieve 4 message of student 1,

1, 90 - output 90 2,80 - 170 3, 70 - 240 4 100- 370

In this case every time we recive message will hazelcast jet caches the last aggregate result or it will aggregate all the messages every time

Abhishek
  • 519
  • 1
  • 6
  • 24

1 Answers1

1

@Abhishek, you can do both ways. There are aggregate operations that you can run on a subset of data continuously, windowing, or you can use Rolling Aggregate operations that will do the aggregation for each item & carry the previous results.

Please see examples here:

Gokhan Oner
  • 3,237
  • 19
  • 25