Stack Overflow
Stack Overflow

Questions tagged [apache-storm-topology]

80 questions
4
votes
0 answers

This user's topologies are in danger of being unscheduled due to the owner's over-use of cluster resources

We are in the process of upgrading Storm version from 1.x.x to 2.1.0, and were able to bring up the Storm cluster, and it's running fine so far, with just one topology. We see a new owner section in the Storm UI, with the following message in red…
Pavithra Gunasekara
  • 3,902
  • 8
  • 36
  • 46
4
votes
0 answers

Netty-client connection errors between Apache Storm's worker nodes

I am running Apache Storm with Nimbus set up on one node and two supervisors set up on two other nodes. After I launch the topology (with workers=2), it does not run correctly. In the worker logs of one of the supervisor nodes, I see the following…
TGR
  • 41
  • 5
4
votes
0 answers

Apache storm stream parse in Windows

I'm a newbie in apache storm. I'm trying to run apache storm + stream parse in windows 10. so I just tried to do in following. (http://streamparse.readthedocs.io/en/master/quickstart.html) First, Install Python 3.5 and JDK 1.8.0_131. Secod,…
flymaxelib
  • 101
  • 1
  • 10
3
votes
1 answer

Understanding Storm Topology Visualization

I am trying to use Apache Storm 1.0.2 to process a stream of data that is originating from a Kafka Spout. I was trying to use the storm topology visualization that is part of the Storm UI to understand the performance of the pipeline. Based on the…
user3854499
  • 48
  • 4
2
votes
1 answer

Apache Strom upgrade from 1.0.3 to 2.2.0 and not all workers are used

I am upgrading from Apache Storm 1.0.3 to 2.2.0 and facing a peculiar issue where the topology tasks are not running on all the workers and is only running on the same worker as the Spout. I am using shuffleGrouping and have configured 6 workers and…
Robin Blue
  • 21
  • 2
2
votes
0 answers

Dependency Injection in Apache Storm topology

Little background: I am working on a topology using Apache Storm, I thought why not use dependency injection in it, but I was not sure how it will behave on cluster environment when topology deployed to cluster. I started looking for answers on if…
Sandeep Kumar
  • 13,799
  • 21
  • 74
  • 110
2
votes
1 answer

Getting "No available slots for topology" error for storm nimbus

I am new to the apache-storm. I am trying to set up a local storm cluster. I have setup zookeeper using the following link and when I start zookeeper it's running fine.But when I start nimbus using start nimbus command I am seeing an error No slot…
Anshita Singh
  • 1,583
  • 1
  • 17
  • 40
2
votes
0 answers

Setting logstash-compatible logging patterns in Apache Storm Workers

I have some difficulties getting Storm worker/topology logs into an ELK-compatible format (JSON) with Storm 2.1.0. These are my current worker logging configs: cluster.xml
filpa
  • 3,651
  • 8
  • 52
  • 91
2
votes
1 answer

[Storm]What happens to other tuples anchored to the same message id if one of them fails?

If one of the tuples anchored to a message id fails, will the other tuples process completely or they're stopped by storm?
KaliCharan
  • 1,215
  • 2
  • 8
  • 12
2
votes
1 answer

Apache Storm Kafka Spout Lag Issue

I am building a Java Spring application using Storm 1.1.2 and Kafka 0.11 to be launched in a Docker container. Everything in my topology works as planned but under a high load from Kafka, the Kafka lag increases more and more over time. My…
NaptownCSC
  • 71
  • 8
2
votes
0 answers

Cannot start storm application. Error on initialization of server mk-worker

I am having error continuously for storm application on cluster. I have two same application with exactly same configuration except for the name, specific variables. One is working and one not. Here is the log: I am running storm app on ubuntu vms,…
Darpan27
  • 239
  • 1
  • 4
  • 9
2
votes
0 answers

New KafkaSpout Issue in Apache Storm

I have a basic topology includes kafka spout and and kafka bolts When submit my topology ı gets this error in Storm UI Unable to get offset lags for kafka. Reason: org.apache.kafka.shaded.common.errors.InvalidTopicException: Topic '[enrich-topic]'…
cekeriya
  • 297
  • 2
  • 13
1
vote
1 answer

Topology does not execute on local cluster

I was trying to study apache storm and setup the storm on my ubuntu installed in vmware. storm version is 2.4.0 and it is running on localhost currently. When I submit the topology. Topology is submitted successfully and distributed according to…
Amjad Arshad
  • 11
  • 2
1
vote
0 answers

Apache Storm Starter 2.2.0 in Eclipse in Windows - Exception while trying to get leader nimbus info from localhost NimbusLeaderNotFound

I have downloaded the zip file for Apache Storm 2.2.0. I imported the storm-starter maven project into eclipse in Windows 10. Did a Maven--> Update Project My project did not have any errors. I did not do any updates to pom.xml. I executed the…
HappyCoder
  • 11
  • 2
1
vote
1 answer

When is the 'ack' method in the spout called in Apache Storm?

I have a topology for processing documents with two bolts. I need to be able to make modifications a data structure stored in the spout after a document is fully processed/has made its way through the whole topology. Before learning more about…
dacmacho
  • 45
  • 5
1
2 3 4 5 6