Stack Overflow
Stack Overflow

Questions tagged [trident]

Abstraction on top of Apache Storm for doing realtime computation.

Trident is a high-level abstraction for doing realtime computing on top of Apache Storm. It allows you to seamlessly intermix high throughput (millions of messages per second), stateful stream processing with low latency distributed querying. If you're familiar with high level batch processing tools like Pig or Cascading, the concepts of Trident will be very familiar – Trident has joins, aggregations, grouping, functions, and filters. In addition to these, Trident adds primitives for doing stateful, incremental processing on top of any database or persistence store. Trident has consistent, exactly-once semantics, so it is easy to reason about Trident topologies. (source)

122 questions
0
votes
1 answer

How to build Storm Trident topology which will persist tuples in HBase

I want to build a trident topology which will get tuples from Kafka, group them by one field and persist entire grouped tuples in HBase. Reason for grouping is that HBase put operations are faster with multiple put objects compared to putting single…
Shekhar
  • 11,438
  • 36
  • 130
  • 186
0
votes
1 answer

Apache Storm pluggable scheduler in Trident

Core Storm allows to specify on what node a specific bolt should be executed by a means of pluggable scheduler. We are considering redesigning Storm topologies to Trident, but do not see how we can get the same behavior of configuring on what nodes…
ValeryC
  • 477
  • 3
  • 17
0
votes
1 answer

Multiple Streams in Trident Topology

I have multiple OpaqueTridentKafkaSpout reading from different Kafka topics. I want data from all these streams to go through same set of Functions. What is the best way to achieve that. Do I need to create separate streams and pass each Tuple to…
Ashu
  • 1,703
  • 4
  • 16
  • 23
0
votes
0 answers

How to write transactional spout for storm trident

I have written a demo about trident. In the demo, I want to generate a series batches of data in a transaction spout and then do persistentAggregate operation for them. The normal processing like this: step1: txid=1, {"aaa 3", "bbb 2"}==>persist to…
iceguo
  • 103
  • 1
  • 12
0
votes
1 answer

Client serialization issue: read from Couchbase in Trident function

Basically, I want to read some additional attributes from Couchbase with attributes from the tuple, for example, the tuple has input fields "{a, b, c}", I want to emit a tuple "{a, b, c, d, e}" where "d" and "e" are read from Couchbase with "a" as…
Leo Li
  • 19
  • 3
0
votes
1 answer

Database lookup : How to use CachedMap in Trident

How do we use CachedMap in Trident. My use case is such that, I will be doing some database and want to store that information in cache or trident state. Next time when I get any tuple, I want to query the trident state or cache before querying…
Alok
  • 1,374
  • 3
  • 18
  • 44
0
votes
2 answers

Force Qihoo 360 Browser to use Chrome Layout Engine

How do you force the Chinese "Qihoo 360 Browser" to use the Chrome Layout Engine instead of the trident layout engine for your website. Specifically I want all users that use Qihoo 360 Browser that visit my website to use the Chrome38 engine…
Tony J Watson
  • 629
  • 2
  • 9
  • 20
0
votes
1 answer

Using Trident to read from RDBMS

I am new to Storm and Trident. I wrote a spout (used Storm core) to read from RDBMS. I override the open() method of BaseRichSpout public void open(Map map, TopologyContext topologyContext, SpoutOutputCollector spoutOutputCollector) { …
Alok
  • 1,374
  • 3
  • 18
  • 44
0
votes
2 answers

Trident Topology throws out of memory exception

I am shifting from Storm's traditional topology to Trident topology, which maintain batches of tuples before pushing them to database. We are processing XMLs as single tuple. In the traditional topology, which processes one xml at a time, this…
Kshitij Dixit
  • 71
  • 1
  • 6
0
votes
1 answer

What happens if kafka spout is restarted by storm trident?

Say the kafka spout fetched some messages and at that time the spout task is restarted. Will the fetched messages be lost? I'm a starter on trident and my question is for the trident kafka transactional/opaque spout. Thanks in advance!
Adrian Liu
  • 385
  • 3
  • 13
0
votes
1 answer

How to write a trident topology without aggregations?

I would like to process tuples in batches for which I am in a thought of using Trident API. However, there are no operations that I perform in batches here. Every tuple is processed individually. All that I need here is exactly-once semantics so…
JavaTechnical
  • 8,846
  • 8
  • 61
  • 97
0
votes
2 answers

Gridgain exception java.lang.IncompatibleClassChangeError: Implementing class

I am using Trident storm and trying to start a grid instance within a function prepare method. The same config file works well with local cluster.. When i submit it in remore cluster i get the error. Code: public class MemoryGrid extends…
user3072054
  • 339
  • 2
  • 6
  • 17
0
votes
1 answer

Writing from trident storm to memory grid(Apache Ignite)

Can someone shed some light on how to write/read data from trident storm to Memory grid (Apache ignite). i googled and don't find any information/document on how to connect from trident storm to memory grid.
user3072054
  • 339
  • 2
  • 6
  • 17
0
votes
1 answer

Batch size in Storm Trident

I would like to know how to set BATCH SIZE (example I want a batch to have 10000 records) in TRIDENT. I have the below configuration in my code and this fetches approximately 250 records per batch from Kafka. Can I increase this to 10000*1024? or…
user3072054
  • 339
  • 2
  • 6
  • 17
0
votes
1 answer

Debugging JavaScript in Trident-based app

Is there a way to debug JavaScript in an app using the Trident (IE11) object? We have an (C++/MFC) app that embeds a Trident instance. It works fine and right-clicking on the object brings up the usual IE11 context menu. But it is not obvious how…
rkwright
  • 447
  • 6
  • 21
1 2 3
…
8 9