Questions tagged [hazelcast-jet]

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

Hazelcast Jet is a distributed computing platform for low-latency stream and batch processing. It benefits from integration with Hazelcast IMDG providing fast, scalable Big Data processing that’s lightweight and embeddable.

188 questions
0
votes
1 answer

Hazelcast jet data loading

I'm trying to load database data into hazelcast jet map instance public void sourceStage(JetInstance jet, Pipeline pipeLine){ SimpleDriverDataSource dataSource = new SimpleDriverDataSource(); dataSource.setDriver(new org.postgresql.Driver()); …
vivek
  • 115
  • 2
  • 9
0
votes
1 answer

Problem Deserializing Hazelcast Aggregator Response

I have this custom Aggregator written, which aggregation response is a HashMap. I have a problem on client side deserializer fails in the error given below. Any clue what could be wrong? public class CountFixtureBySportAggregator extends…
aquawhale
  • 11
  • 3
0
votes
1 answer

Hazelcast adding address to blacklist and client not connecting

I am new to Hazelcast and in my application when I am starting Hazelcast member it is showing two addresses been blacklisted don't know why, what is the best configuration for Hazelcast clustering? Here is the log that I am getting: 2021-07-22…
user3458271
  • 638
  • 12
  • 31
0
votes
1 answer

Convert BatchStage> to BatchStage in Hazelcast
In my hazelcast jet application I am performing grouping joins after that I am getting result in BatchStage format but I want to convert it to BatchStage, I have tried flatMap but it overwrites some keys that I don't want I want all Object to…
user3458271
  • 638
  • 12
  • 31
0
votes
1 answer

Hazelcast jet flatMap says: These transforms have nothing attached to them: [flat-map]

I am trying to filter BatchStage but it is not working it is giving me below error: java.lang.IllegalArgumentException: "filterFn" must be serializable at com.hazelcast.jet.impl.util.Util.checkSerializable(Util.java:203) at…
user3458271
  • 638
  • 12
  • 31
0
votes
1 answer

How to control number of processors during Hazelcast Imap filter

I am new to Hazelcast. When Imap filter with predicate is triggered on a HazelCast Jet pipeline, in a VDI I see the porcessors count is only 2 and on my machine I see 12 porcessors. When there is only 2 processor, filter job is completing very fast.…
Parthi
  • 123
  • 1
  • 7
0
votes
1 answer

How to read CSV in Hazelcast jet in List or JsonArray format?

As I am new to hazelcast am I trying few thing but not getting result as I accepted, please help me out. Here is my below code which I am trying but not getting success. BatchSource companyListBatchSource = FileSources.files("directory") …
user3458271
  • 638
  • 12
  • 31
0
votes
2 answers

Hazelcast Jet with Named Jdbc Query or ResultSet?

I am new to Hazelcast Jet and I am using Spring JdbcTemplate to execute my query, which uses named parameters in the query, but I am not sure how to use it with Hazelcast Jet. E.g. Hazelcast works in following way: Pipeline p =…
user3458271
  • 638
  • 12
  • 31
0
votes
0 answers

Junit Mockito test cases using Jupiter for Hazelcast Jet Pipiline

I am trying to write the Junit test cases for the below hazelcast Jet Pipeline. My component: @Component public class UserJetJob extends AbstarctJetJob { private static final String TABLE_NAME = "User"; @Autowired private ClientConfig…
Pandit Biradar
  • 1,777
  • 3
  • 20
  • 35
0
votes
1 answer

failed to map segment from shared object hazelcast mancenter

I have Hazelcast 4.2 runs in a linux server in a standalone mode by running the following files in background: hazelcast management center : management-center/bin/start.sh but hazelcast management center is not starting properly. error while start…
0
votes
1 answer

Hazelcast Jet vs Java 8 streams

I'm trying sort List> object based on max date using Hazelcast Jet. Here is my java 8 code that works: public static List> extractDate1(List> data) { return data.stream().map(value ->…
vivek
  • 115
  • 2
  • 9
0
votes
1 answer

Serialization in the Hazelcast IMap

I'm trying to load data into IMap inside jet pipeLine stage I'm getting the error Here is my code public static Pipeline pipeLineStage(JetInstance jet) { Pipeline pipeLine = Pipeline.create(); BatchStage dbValue =…
vivek
  • 115
  • 2
  • 9
0
votes
1 answer

Serialization in the hazelcast jet

I'm getting the following error when I tried to processing the data from hazelcast jet. Caused by: java.lang.IllegalArgumentException: Invalid lambda deserialization at com.example.LearnJet.joins.LeftJoins.$deserializeLambda$(LeftJoins.java:1) …
manu
  • 19
  • 4
0
votes
1 answer

Left join in the hazelcast jet

I'm using the Hazelcast Jet in My application. // value1 BatchStageWithKey, Object> indianCustomerJson = value .filter(model -> model.nationName().equals("india")) .map(model ->…
manu
  • 19
  • 4
0
votes
0 answers

Does Hazelcast Jet allow to query accumulator values from rollingAggregate?

The minimal working example below presents some (simplified) processing where: each event is processed individually (no windowing), each event belongs to a certain group, each event updates a group state, which then is used to generate some output…
user3078523
  • 1,520
  • 18
  • 27