Questions tagged [apache-storm-configs]

10 questions
1
vote
1 answer

Topology does not execute on local cluster

I was trying to study apache storm and setup the storm on my ubuntu installed in vmware. storm version is 2.4.0 and it is running on localhost currently. When I submit the topology. Topology is submitted successfully and distributed according to…
1
vote
1 answer

Apache Storm 2.1.0 memory related configurations

We are in the process of migrating to 2.1.0 from 1.1.x. In our current setup we have following memory configurations in storm.yaml nimbus.childopts: -Xmx2048m supervisor.childopts: -Xmx2048m worker.childopts: -Xmx16384m I see many other memory…
0
votes
0 answers

Apache Storm UI visualisation window not working

I get this error trying to open the visualisation window in apache storm UI and it shows an empty page "org.apache.storm.thrift.transport.TTransportException: Frame size (35307746) larger than max length (1048576)" apache storm version: 2.4.0
0
votes
0 answers

Apache storm 2.4.0 working slow compared to apache storm 0.9.6

I am migrating to apache storm 2.4.0 from apache storm 0.9.6 But the performance in apache storm 2.4.0 is slower. I read that wait strategy plays role in performance Exiting application on apache storm 0.9.6 has following wait strategy…
0
votes
0 answers

Storm 2.4.0 - Worker Heapsize Issue

Although we have given the following parameters in Storm.yaml, it calculates the assigned total memory by multiplying the number of executors in the topology by onheap(128mb). `topology.component.resources.onheap.memory.mb:…
0
votes
0 answers

Apache storm metrics reporter not working as expected

I'm using apache storm 2.4.0 version and we want all our metrics need to be exposed. So, we created an service that accepts all the metrics in time being and will expose the metrics on /metrics end point. storm uses drop-wizard metrics and I'm…
0
votes
1 answer

can we setup single storm ui for all nimbus?

my question is, can we use only one storm ui for multiple nimbus?. because if nimbus is fail on the machine, the ui also getting error on the browser. even not a leader nimbus is changed as a leader (which is running on another machine ) instead of…
0
votes
0 answers

Apache Storm tuple timed out after 10 minutes but topology.message.timeout.secs is configured as 5 minutes

We have a topology with topology.message.timeout.secs = 300 secs. Recently, we ran into an issue where the first bolt after the spout reached a capacity of ~2. The bolt started processing tuples very slowly (it started processing tuples 5 mins after…
0
votes
1 answer

About the effect of parallelism in StormCrawler

I am currently working on a Storm Crawler based project. We have a fixed and limited amount of bandwidth for fetching page from the web. We have 8 worker with a large value for parallelism hint for different Bolt in the topology (i.e. 50). So lots…
aeranginkaman
  • 279
  • 1
  • 3
  • 11
-1
votes
1 answer

Apache storm tumbling window producing duplicate tuples in case of message timeout reached

I have used BaseWindowBolt of apache storm. However in case of message timeout reached i am seeing duplicate packets. For example below is my test configuration. I am using kafka spout to read data from a topic. I have my bolt with tumbling window…