Stack Overflow
Stack Overflow

Questions tagged [apache-storm-flux]

Apache Storm is an open source computation system that allows processing data streams in real time, in a reliable and distributed way.

13 questions
3
votes
2 answers

Multiple invokable constructors in Storm Flux

I'm using Storm Flux (0.10.0) DSL to deploy the following topology (simplified to keep only the relevant parts of it): --- name: "my-topology" components: - id: "esConfig" className: "java.util.HashMap" configMethods: - name: "put" …
Guido
  • 46,642
  • 28
  • 120
  • 174
2
votes
1 answer

Clojure Storm Flux

I started to work with Apache Storm recently. I use Storm with Clojure Storm DSL and Leiningen. There is a very cool tool for storm topology management: Storm Flux. My question is: How can I use flux when I am coding in storm with clojure?
Raphael Boukara
  • 398
  • 3
  • 11
1
vote
1 answer

Apache Storm Flux Kafka Spout Record Translator Exception

I am using storm flux 1.2.2 to deploy topology. I am passing record translator to KafkaSpoutConfig (referred from -> https://github.com/apache/storm/blob/master/flux/flux-examples/src/main/resources/kafka_spout.yaml), but getting following…
pratik
  • 15
  • 3
1
vote
0 answers

Using flux YAML, how to mention number of task for bolts in a Storm topology?

See this snippet of storm-flux YAML: ## spout definitions spouts: #spouts- Start - id: "perform-spout" className: "org.apache.storm.kafka.KafkaSpout" parallelism: 2 constructorArgs: - ref: "PerformSpoutConfig" #spouts-…
Mayank Raghav
  • 640
  • 1
  • 7
  • 17
1
vote
1 answer

Storm UI topology not working

We are executing a Storm topology in LocalCluster. Storm topology is executing fine and able to connect Storm UI (8090). But Storm UI is not displaying the running topology information. LocalCluster cluster = new LocalCluster(); and submitting…
new
  • 11
  • 3
1
vote
1 answer

Apache Storm Topology using Flux YAML file

I am designing an Apache Storm topology using a Flux YAML topology definition file. The trouble is I don't see how to :- Create a stream that sends to multiple bolts (the syntax seems to only include one 'to:' line). Emit multiple named streams…
JohnB
  • 11
  • 1
0
votes
0 answers

Apache Storm tuple timed out after 10 minutes but topology.message.timeout.secs is configured as 5 minutes

We have a topology with topology.message.timeout.secs = 300 secs. Recently, we ran into an issue where the first bolt after the spout reached a capacity of ~2. The bolt started processing tuples very slowly (it started processing tuples 5 mins after…
Ankita Saha
  • 137
  • 3
  • 10
0
votes
0 answers

Stormcrawler Topology class is not working as we run with es-injector.flux

I have few urls need to scrape using stormcrawler.As per [link]https://medium.com/analytics-vidhya/web-scraping-and-indexing-with-stormcrawler-and-elasticsearch-a105cb9c02ca[/link]I followed all steps and got scraped and loaded content in my…
operation_java
  • 1
  • 1
0
votes
0 answers

Deployment Exception of an Apache Storm application

When I try to deploy the Apache Storm jar,that I have developed using Flux, I get the following error enter link description here My Flux file is here enter link description here
cekeriya
  • 297
  • 2
  • 13
0
votes
1 answer

How to configure generic parameters in Storm Flux

I am a new guy on Storm Flux, and now confused by how to configure generic parameters in Storm Flux. For example, the org.apache.storm.kafka.spourt.KafkaSpout is defined as below: public class KafkaSpout extends BaseRichSpout { .... …
Soloman
  • 91
  • 4
0
votes
1 answer

Inject external properties for Apache Storm Flux

I am using Flux 1.0.0 and I have rewritten my topology into a YAML file. But I have some properties that used to be part of the configuration that I used the Storm driver to run with. storm.Driver --config myConfig/config.conf Now with Storm Flux,…
PhoonOne
  • 2,678
  • 12
  • 48
  • 76
0
votes
2 answers

How to submit multiple spouts in single topology in apache storm?

I am trying to use parallelism concept in apache-Storm.I want to know how to submit multiple spouts by single topology. Here is my code for single topology submission TwitterTopologyCreator topology = new…
user5898161
  • 1
  • 1
  • 2
0
votes
1 answer

Apache Storm Flux change topology

Is it possible to change the topology layout while it is running? I would like to change the stream groupings and bolts while it is active. Submitting the yaml file with the new topology layout says it cannot deploy since it is already running.…
user3499430
  • 17
  • 1
  • 1
  • 6