Stack Overflow
Stack Overflow

Questions tagged [hazelcast-jet]

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

188 questions
2
votes
1 answer

Cooperative and non-cooperative `Processor`s in single vertex

Can Processors be both cooperative and non-cooperative in single vertex? Because cooperativity is a property of Processor, and the ProcessorSupplier is not required to return Processors of the same type. Or is it? The use case of this is weird and…
Oliv
  • 10,221
  • 3
  • 55
  • 76
1
vote
1 answer

Hazelcast Predicate SQL into map

I'm trying to build a method that deletes entries with attributes that are not null, but I keep failing in predicates and I don't know how to implement properly the predicate because hazelcast doesn't take "NOT NULL" or "IS NULL" as a where clause…
killopolo
  • 41
  • 5
1
vote
0 answers

How to handle multiple requests to huge csv files?

I am working on on Java web application and in our application user can upload his csv files and than we allow them to create charts, table etc in our dashboard. But when user uploads huge csv files above 500mb and uses it with multiple elements…
user3458271
  • 638
  • 12
  • 31
1
vote
0 answers

How to change exception from ERROR to WARRNING in Hazelcast

How to change exception level from ERROR to WARNING in hazelcast. How to customise the hazelcast global exception handler? 2022-04-07 15:07:06,094 [ERROR] [hz.laughing_bhabha.partition-operation.thread-0] [c.h.m.i.o.EntryOperation]:…
Imtiaz Ali
  • 302
  • 1
  • 3
  • 8
1
vote
1 answer

How Hazecast BatchStage work with memory?

I am new to Hazelcast jet and I am trying to join to datas but I want to know how it will occupy memory and how much and what it best practice to do it? Here is my code: BatchStage> batch1=…
user3458271
  • 638
  • 12
  • 31
1
vote
1 answer

How to query embedded object field with sql from hazelcast?

I'm trying to get complex java object from hazelcast using sql approach. My data object contains embedded object like Person{ ... HumanName name; ... } HumanName { String firstName; } And I'm trying to get this firstName field using…
Александр Селютин
  • 147
  • 2
  • 8
1
vote
1 answer

How to Sink output to the json file in Hazelcast Jet?

I am new to Hazelcast Jet and in my application I am using jdbc source, this source returning List of Map which I have to Sink in one of json file but when I use Sinks.json it create json directory how can I sink it to particular json file? For…
user3458271
  • 638
  • 12
  • 31
1
vote
1 answer

Java parallelStream java.util.concurrent.RejectedExecutionException: Thread limit exceeded replacing blocked worker

I'm using Hazelcast Jet to do calculations over a large number of elements (~ 480 million). I'm starting using an IMap Sink containing the starting data. I'm filling the map using …
Nova Shadowflame
  • 184
  • 11
1
vote
2 answers

How to use Connection Pooling with Hazelcast jet JDBC?

I am trying to use connection pooling with hazelcast jet jdbc but it is not allowing me to do it. I have Datasource bean from which I am fetching connection but it is not working. Here is my code: Connection conn =…
user3458271
  • 638
  • 12
  • 31
1
vote
1 answer

Hazelcast Jet "mapFn" must be Serializable Error

Good day, i'm having a problem implementing some code source from github to my project so... i'm trying to build a pipeline, and then create StreamStage to read the sources and build a queuesink with the methods inside the project and i'm always…
killopolo
  • 41
  • 5
1
vote
0 answers

Hazelcast jet Python Exception: PythonService initialization failed

While executing python function but it's not working: Here is my code : BatchStage bd1 = AggregateData.aggregate(data, Object); bd1 = bd1.filter(k -> { // some filters }); Here I am using…
user3458271
  • 638
  • 12
  • 31
1
vote
1 answer

Why is Hazelcast IMap journal not producing all expected events?

The minimal working example below fast produces events which then update an IMap. The IMap in turn produces update events from its journal. public class FastIMapExample { private static final int NUMBER_OF_GROUPS = 10; private static final…
user3078523
  • 1,520
  • 18
  • 27
1
vote
0 answers

Does Hazelcast Jet mapWithUpdating preserve Data Locality

The minimal working example below presents some (simplified) processing where: each event is processed individually (no windowing), each event belongs to a certain group, each event updates a group state, which then is used to generate some output…
user3078523
  • 1,520
  • 18
  • 27
1
vote
1 answer

JSON processing using Hazelcast Jet

I'm using PostgreSQL as database. ------------------------- id | name | value | ------------------------- 1 | john | {"id":"0001"} ------------------------- Above is simple JSON but in the application level JSON is very big. So once we…
manu
  • 19
  • 4
1
vote
1 answer

hazelcast topic as a hazelcast-jet source

I'm trying to get more up to speed with Hazelcast Jet as a processing pipeline and began digging into the Sources documentation a bit more https://jet-start.sh/docs/api/sources-sinks#sources I was very surprised to see that Hazelcast Topics and…
Erick J
  • 53
  • 6
1 2
3
…
12 13