Questions tagged [storm-topology]
5 questions
2
votes
1 answer
Apache Strom upgrade from 1.0.3 to 2.2.0 and not all workers are used
I am upgrading from Apache Storm 1.0.3 to 2.2.0 and facing a peculiar issue where the topology tasks are not running on all the workers and is only running on the same worker as the Spout.
I am using shuffleGrouping and have configured 6 workers and…
Robin Blue
- 21
- 2
1
vote
0 answers
Apache storm spout is not emitting tuples to all executors of the bolt
storm v1.2.2
I have an environment with 6 node cluster each 16 cores. I have deployed a sample topology which reads messages from a kafka topic which has 12 partitions.
Configurations
Max spout pending is 15.
Topology message timeout is 300…
Soman
- 21
- 2
1
vote
1 answer
When is the 'ack' method in the spout called in Apache Storm?
I have a topology for processing documents with two bolts. I need to be able to make modifications a data structure stored in the spout after a document is fully processed/has made its way through the whole topology. Before learning more about…
dacmacho
- 45
- 5
1
vote
1 answer
Apache Storm 2.1.0 memory related configurations
We are in the process of migrating to 2.1.0 from 1.1.x.
In our current setup we have following memory configurations in storm.yaml
nimbus.childopts: -Xmx2048m
supervisor.childopts: -Xmx2048m
worker.childopts: -Xmx16384m
I see many other memory…
Pavithra Gunasekara
- 3,902
- 8
- 36
- 46
0
votes
0 answers
Apache Storm tuple timed out after 10 minutes but topology.message.timeout.secs is configured as 5 minutes
We have a topology with topology.message.timeout.secs = 300 secs.
Recently, we ran into an issue where the first bolt after the spout reached a capacity of ~2.
The bolt started processing tuples very slowly (it started processing tuples 5 mins after…
Ankita Saha
- 137
- 3
- 10