Stack Overflow
Stack Overflow

Questions tagged [hazelcast-jet]

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

188 questions
0
votes
0 answers

Hazelcast avg get latency is > 2 ms for 18k/s throughput

Background: We are working on evaluating hazelcast which can act as an alternative of Redis. Setup : 3 members in a cluster under a single subnet (production boxes). Each member has ~1.4GB of data. Near caching is off. Each member has 1…
plug
  • 13
  • 1
  • 3
0
votes
1 answer

Hazelcast map max-size configuration without eviction policy

In hazelcast Map configuration,if we set eviction-policy to None and Used max-idle-seconds,time-to-live-seconds like below , 0 360…
sandy
  • 97
  • 2
  • 14
0
votes
2 answers

Expose entire IMap over REST/WebFlux without excessive Heap utilisation

I have a distributed Hazelcast map (IMap) which is potentially very large. I am tasked with returning the ENTIRE map values() collection as response to an HTTP GET request. To minimise heap utilisation I plan to use Spring WebFlux and return an…
Robin Roos
  • 100
  • 8
0
votes
2 answers

Hazelcast IMDG vs Hazelcast Jet

I'm using Hazelcast IMDG in my application. I heard that Hazelcast Jet provides fast data processing than Hazelcast IMDG. If Yes. Is Hazelcast Jet is open source? Hazelcast Jet provides all the functionality which is available Hazelcast IMDG?
manu
  • 161
  • 7
0
votes
1 answer

Hazelcast Jet - how to use a non-static method in a Jet pipeline

I have a basic pipeline below. In one of the steps I want to transform an object by calling a method from a service as below. But Jet throws an error saying that this mapFn is not serializable. What to do here? It works perfectly fine for static…
Rajesh
  • 153
  • 6
0
votes
1 answer

Convert a single node to distributed java application with Hazelcast

We have a current java application built with Vert.x using simple local HashMaps. In order to distribute our application on several nodes, we would like to replace local HashMaps by a single Hazelcast IMap. Basically we have our 2 HashMaps…
rico
  • 1,843
  • 2
  • 24
  • 41
0
votes
1 answer

Custom processor to map inputs in batches

I'm developing a Hazelcast Jet batch job using the core API (not the pipeline API). One of the intermediate vertices of my DAG must do a map operation, but would benefit from mapping a batch of items at a time, rather than one by one. My mapping…
Mirko Luchi
  • 321
  • 3
  • 4
0
votes
1 answer

Not able to form embedded Hazelcast jet cluster in docker

I am trying to form a jet cluster(not in client-server deployment strategy, but embedded one). Tried both Multicast and TCP discovery, but still not successful. when i try to scale multiple container using docker-compose file, both container comes…
mahendra yadav
  • 35
  • 8
0
votes
1 answer

HazelcastJet kafka throttling

I couldn't find any possibilities to create pipeline in hazelcast-jet-kafka that will limit the throughput to a specific number of elements per time unit, anybody could suggest me possible solutions? I know that alpaka…
Aliksz
  • 29
  • 5
0
votes
1 answer

How to write Hazelcast Jet job to process Http request and emit result as response

I have an http endpoint where client make request with their data to which a computed response is returned. The computation has few stages - data lookup, calculations & few transformations. The final result is written as response to the request. Can…
vvra
  • 2,832
  • 5
  • 38
  • 82
0
votes
0 answers

Heap memory full in Hazelcast jet

I have a client and server application, where the client is receiving data from the server using WebSockets. Client application is built using Hazelcast Jet to process data provided by server. ClientApplication stores data inside Queue and polls it…
Milan
  • 147
  • 1
  • 4
  • 16
0
votes
1 answer

Distributed processing - Apache Spark, Flink, Samza, Siddhi, Hazelcast Jet

Imagine a processing system that receives data from other internal systems, or from internet exposed REST endpoints. Once received, set of (background) tasks (compute a response from input based on db or other webservices) work on the data in…
vvra
  • 2,832
  • 5
  • 38
  • 82
0
votes
1 answer

Hazelcast Jet MultiMap source support?

I couldn't find any possibilities to construct Source from MultiMap, why such Source is not provided in standard API? https://docs.hazelcast.org/docs/jet/3.2/manual/#overview-of-sources-and-sinks
Aliksz
  • 29
  • 5
0
votes
1 answer

how stable is Hazelcast-Jet with Kafka source and sink pipelines?

I'm running 3 node embedded cluster of Hazelcast-Jet and the following error is frequently seen in the console. What could be the possible reason? [jet] [3.0] Execution of job '15ba-4fbe-1b73-9ed1', execution 61d7-46eb-5875-8799 failed after 60,112…
srikanth
  • 958
  • 16
  • 37
0
votes
1 answer

Hazelcast Jet stuck on starting Job

I've encountered strange behaviour in Hazelcast Jet. I'm starting many jobs at once (~30, some are triggered slightly before other). However, when my Hazelcast Jet job count hits 26 (magic number?), all processing got stuck. In the threadumps I see…
T. Gawęda
  • 15,706
  • 4
  • 46
  • 61
1 2 3
…
12 13