Stack Overflow
Stack Overflow

Questions tagged [hazelcast-jet]

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

188 questions
0
votes
1 answer

Remove JetInstance job

Is there a way, how I can remove not RUNNING jobs from my hazelcastInstance? I have stream from jetInstance.getJobs() and I need to return Map, where key is the name of job. But it is not possible, since I already stopped and re-run…
Daniel Perník
  • 5,464
  • 2
  • 38
  • 46
0
votes
1 answer

Restart Hazelcast Jet (v0.4) when there is an exception

We are using Hazelcast Jet 0.4 version to read messages from Kafka Source, process the messages and write to Kafka. Since Kafka is managed by an external team, we could not control various exceptions thrown in Kafka. For example, we receive the…
ek_cool
  • 11
  • 4
0
votes
0 answers

Hazelcast Jet - Pattern matching

Does hazelcast jet support pattern matching use cases like few of the even stream processors support. If not, will this be included in the future release. Here is an use ase for pattern matching Find the trader who sold 'AAA' stock followed by…
Harshad Murtekar
  • 57
  • 3
0
votes
0 answers

How to implement mapUsingContext() / filterUsingContext() - hazelcast-jet

I have the following scenario for understanding my problem. There is one external node (Node A), one client App (App1) and one Hazelcast-Jet Job App (Node B, App2). App1 collects data from FlatBuffers and wraps it in an Object HzData. HzData is…
Krishna Nadiminti
  • 1
  • 2
0
votes
1 answer

Hazelcast Jet 0.6.1 - Compilation error with Pipeline customTransform API

I am getting following compilation error with Pipeline customTransform API. Here is sample code for building pipeline: private Pipeline buildPipeline2() { Pipeline p = Pipeline.create(); p.drawFrom(Sources.
Harshad Murtekar
  • 57
  • 3
0
votes
1 answer

Hazelcast Jet 0.6.1 + Pipeline API + Custom Processor

I am trying to attach custom processor to the Hazelcast Jet Pipeline definition. Here is sample code. private Pipeline buildPipeline() { Pipeline p = Pipeline.create(); p.drawFrom(Sources.remoteMapJournal("record", …
Harshad Murtekar
  • 57
  • 3
0
votes
0 answers

How to perform Jet jobs by joining another node?

Hi I have an issue with Hazelcast jet. I have an app that initiates two nodes in 127.0.0.1:5701, 127.0.0.1:5702 . When I run the application it creates DAG and am getting the required output. If I am trying to connect another instance of hazelcast…
Krishna Nadiminti
  • 1
  • 2
0
votes
1 answer

Hazelcast Jet Query

I have following query regarding Hazelcast Jet The use-case as follows There is one application (Application 'A', deployed in cluster) uses Hazelcast IMDG and puts millions of records / transactions in hazelcast IMap. The Event Journal has been…
Harshad Murtekar
  • 57
  • 3
0
votes
1 answer

Hazelcast Jet - Support for multiple clients

Can Hazelcast Jet be used for processing of millions of records using multiple clients accessing an event journal and each client would process a portion of the records? Furthermore, is it possible to accumulate the results processed by different…
Harshad Murtekar
  • 57
  • 3
0
votes
0 answers

Hazelcast Jet 0.5.1 Server / Client issue

I am trying to run Server - Client example using Hazelcast Jet 0.5.1. This example is extended from the hazelcast jet following code…
Harshad Murtekar
  • 57
  • 3
0
votes
1 answer

Jet Kafka Load Balancing

With Jet 0.4, there was an option to load balance Jet instances reading from a Kafka Topic by using a common group id. With current Jet 0.5, this group.id value is ignored, how do we prevent Jet instances from getting duplicate copy of the…
data_engineer
  • 19
  • 2
0
votes
1 answer

Custom log wrapper

I'm trying to create a custom wrapper to log the execution time spent to process each message performed by each vertex processor. Using the DiagnosticProcessors.peekInputP/peekOutputP and processor.PeekWrappedP as inspiration, I ended up with the…
Kleyson Rios
  • 2,597
  • 5
  • 40
  • 65
0
votes
1 answer

Jet RoutingPolicy.ISOLATED not working as supposed

I'm trying to use RoutingPolicy.ISOLATED to create dedicated connections between the upstream and downstream, according to this thread Creating a new Jet custom Partitioner Also, trying to use DiagnosticProcessors.peekOutputP to validate that…
Kleyson Rios
  • 2,597
  • 5
  • 40
  • 65
0
votes
1 answer

Creating a new Jet custom Partitioner

My use case requires to read messages from a Kafka topics and process the messages in the natural order as they were published into the Kafka. The Kafka producer is responsible to publish each group of messages sorted in a single kafka…
Kleyson Rios
  • 2,597
  • 5
  • 40
  • 65
0
votes
1 answer

How to create a new DistributedFunction

This new paradigm of programming is very new to me. I would like to replace the anonymous function in .map() by a defined DistributedFunction in a given class. But I'm not sure how to create the new function. I have the following…
Kleyson Rios
  • 2,597
  • 5
  • 40
  • 65
1 2 3
…
12
13