Questions tagged [chronicle-map]

Chronicle Map is an efficient, low latency in-memory Key Value Store for the JVM with optional persistence to disk.

Chronicle Map is a high performance, off-heap, key-value, in memory, persisted data store. It works like a standard Java map, yet it automatically distributes data between processes. These processes can be both on the same server or across your network. In other words, it's a low-latency, huge data key value store, which can store terabytes of data locally to your process.

118 questions
0
votes
1 answer

Use Chronicle Map as a means of data sharing among micro services

In one of my project, we elected to use Chronicle Map as the underlying data structure for storing and sharing data among different microservices across different hosting servers. Our idea is we use createOrPersist(File file) method to create a…
sotondolphin
  • 223
  • 1
  • 10
0
votes
1 answer

Does Chronicle Map have any concept of expiration

Does Chronicle Map have any concept (or pluggable ability) to provide automatic entry expiration?
user2591854
  • 182
  • 3
  • 15
0
votes
1 answer

Chronicle-Map recovery

I'm reading this https://github.com/OpenHFT/Chronicle-Map/blob/master/docs/CM_Tutorial.adoc And it says it could be in corrupted state if a process is killed while "accessing" it. I would imagine it means while it's "writing" to it? If I only have…
Theboy
  • 353
  • 1
  • 2
  • 8
0
votes
1 answer

Runtime error "cannot find symbol ByteValue$$Native" when using ChronicleMap

The project I'm working on is made of several components - several independent libraries that are compiled to JARs, and a main project that references them. All are written in Scala. I'm using ChronicleMap internally in one of those libraries, using…
0
votes
0 answers

Using ChronicleMap in Apache Spark

We want to use ChronicleMap in Apache Spark on the workers to store a shared cache within a VM. Currently, we are using Hazelcast to share the cache but obviously, being able to use off-heap memory for free and also avoiding tcp-ip (even over…
noobNeverything
  • 212
  • 4
  • 14
0
votes
1 answer

Very slow iteration on Chronicle Map

I'm seeing very slow times iterating over a Chronicle Map - in the below example 93ms per iteration over 1M entries on my 2013 MacbookPro. I'm wondering if there's a better way to iterate or something I'm doing wrong or if this is expected? I know…
jlw
  • 1
0
votes
1 answer

How to use chronicle-map instead of redis as a data cache

I intend to use chronicle-map instead of redis, the application scenario is the memoryData module starts every day from the database to load hundreds of millions of records to chronicle-map, and dozens of jvm continue to read chronicle-map records.…
afone
  • 1
  • 2
0
votes
1 answer

How to avoid creating new instance of byteable data when using ChronicleMap.put

I am learning how to use ChronicleMap 3.12 by using Byteable key and value classes. When I run my code with a loop of ChronicleMap.put operations based on the call stack it seems to create a value object everytime ChronicleMap.put is called. I would…
Thomas Lo
  • 3
  • 2
0
votes
1 answer

Why ChronicleMap doesn't use hashCode or equals to lookup keys?

import net.openhft.chronicle.map.ChronicleMap; import java.io.File; import java.io.Serializable; import java.util.Map; import java.util.concurrent.ConcurrentHashMap; public class App { public static void main(String[] args) throws Exception …
0
votes
1 answer

IllegalArgumentException when populating a ChronicleMap with high variability in value size

A while back, I asked this question about a ChronicleMap being used as a Map>. Basically, we have a collection where the average Set might be 400, but the max length is 20,000. With ChronicleMap 2, this was causing a…
Depressio
  • 1,329
  • 2
  • 20
  • 39
0
votes
1 answer

Kryo serialisation in Chronicle Map - slow byte reading

I'm using Chronicle Map extensively in Scala and recently decided to experiment with Kryo serialisation. I added custom marshallers (code below) and while it reduced the size of my stores by 14G (roughly 62%), and everything still works, the speed…
Anton
  • 3,006
  • 3
  • 26
  • 37
0
votes
0 answers

Iterating over ChronicleMap results in Exception

I am using v3.10.1 of Chronicle Map. In my map, I have approximately 77K entries. I am trying to iterate through this map using entrySet() method. It doesn't iterate successfully and in between throws Chronicle specific exception. Here are the logs…
chauhraj
  • 469
  • 4
  • 19
0
votes
1 answer

How long will it take to persist the latest key-value after I put the entry?

I created a chronicle map with createOrRecoverPersistedTo method. But after restarting the jvm process some entries disappeared. How long will it take to persist the latest key-value after I put the entry? Is there anyway forcing the latest data to…
Hui Li
  • 51
  • 2
0
votes
1 answer

Exception while reading from the Chronicle Map file

I am using version 3.8.0 and I am getting following exception. I am using the ChronicleMap without much customization. I am currently prototyping to exhibit ChronicleMap as a viable option to share data between different JVM processes on the same…
chauhraj
  • 469
  • 4
  • 19
0
votes
1 answer

Java: Does Chronicle Map support different value classes?

I usually create a new Chronicle Map using a ChronicleMapBuilder like so: ChronicleMapBuilder builder = ChronicleMapBuilder.of(SomeKey.class, MyImplClass.class); ChronicleMap map =…
Martin Andersson
  • 18,072
  • 9
  • 87
  • 115