Stack Overflow
Stack Overflow

Questions tagged [chronicle-map]

Chronicle Map is an efficient, low latency in-memory Key Value Store for the JVM with optional persistence to disk.

Chronicle Map is a high performance, off-heap, key-value, in memory, persisted data store. It works like a standard Java map, yet it automatically distributes data between processes. These processes can be both on the same server or across your network. In other words, it's a low-latency, huge data key value store, which can store terabytes of data locally to your process.

118 questions
1
vote
1 answer

Can Chronicle Map use a network file share for read only data?

I would like to use Chronicle Map to read a serialized map from a network file share and then process it locally. We would have 100+ machines reading prepared data from a map - lots of iteration but never writing. Can I just have one process…
optisoft
  • 21
  • 2
1
vote
1 answer

Chronicle Map slows down significantly with more than 200m entries

I am using Chronicle Map to temporarily store / lookup a very large number of KV pairs (several billion in fact). I don't need durability or replication, and I'm using memory mapped files, rather than pure off-heap memory. Average key length is 8…
Vince
  • 2,181
  • 13
  • 16
1
vote
1 answer

OpenHFT/Chronicle map failed

I am using a VanillaChroncile to temporary store and retrieve entries, and it all works perfectly fine, except when there is huge load. I get the map failed exception. Although I have recovery logic that handles this exception, I would like to know…
Naveen Reddy
  • 11
  • 1
1
vote
1 answer

Are there any advantages of using Chronicle Map for java.util.String over .`intern` method for the purpose of lowering heap usage?

Intention is to reduce old gen size in order to lower gc pauses. In my understanding Chronicle Map will store objects in native space and (starting from java 8) String#intern will do the same because interned string are in metaspace. I was curious…
Petro Semeniuk
  • 6,970
  • 10
  • 42
  • 65
1
vote
2 answers

Chronicle map and docker containers?

Want to ask linux gurus if Chronicle can share state (be used) between docker containers on one host machine. Just an assumption: since chronicle uses memory mapped files and we can share (probably?) the same host's filesystem between containers we…
Konstantin Kulagin
  • 684
  • 6
  • 16
1
vote
2 answers

ChronicleMap (and more general off-heap data structures) implementation?

ChronicleMap on OpenHFT's repository on Github states in their documentation: Chronicle Map implements the java.util.concurrent.ConcurrentMap, that stores its data off the java heap. I've built a compiler and contributed to a few off-shoot…
Devarsh Desai
  • 5,984
  • 3
  • 19
  • 21
0
votes
0 answers

ChronicleMap is causing high heap usage / OOM error

My understanding of ChronicleMaps is that they store data off heap, and if specified, using the disk with off-heap memory used to map to where on the disk the data is stored. Is this correct? I have an application running with a ChronicleMap that's…
Nick Fusaro
  • 42
  • 8
0
votes
0 answers

OOM will appear when deployed in k8s when I use Chronicle-Map

Deploying on a dedicated host is normal, but deploying on k8s will appear oomkilled, it requires a lot of memory, does anyone know how to solve this problem. version:3.16.0
Jeffrey Huang
  • 1
0
votes
0 answers

Handling size estimates for ChronicleMap

When using ChronicleMap, you have to give an average value size and an entries estimate. With a growing (albeit slowly) data set, how do people automate this? Is there a different way of using ChronicleMap without having to give size hints?…
rrva
  • 190
  • 1
  • 8
0
votes
1 answer

Chronicle Values: getter that returns Array instead of individual items

So, I have a Value Interface with these array field getter and setter methods, which works interface Instrument: Marshallable { ... fun setBidAt(index: Int, entry: OrderBookEntry) @Array(length = 10) fun getBidAt(index: Int):…
David Teh
  • 61
  • 5
0
votes
1 answer

AssertionError while putting value in chronicle map

I'm trying to use chronicle map as off heap map for my project. When I try to put a value in the chronicle map, I'm getting the below error. This error comes when searchStatePresent() is true. I don't know what is this and there is not much…
Ritu Bhandari
  • 291
  • 2
  • 4
  • 8
0
votes
0 answers

Multiple chronicle maps in same application causing long GC pauses

I'm creating multiple chronicle maps just to avoid contention between threads. I have 10 threads that need something from the cache. With a single cache I observed continuously increasing putAll() [putting 2016 double[3][2] arrays) with each putAll]…
P K
  • 69
  • 7
0
votes
1 answer

Chronicle maps and queues is part of application JVM heap or not

In case anyone is using Chronicle Map, can you tell if Chronicle maps and queues sizes are part of application JVM heap or not. I have an application which listens on Chronicle Queue and then has multiple Chronicle maps. I have allocated 16GB as max…
The Roy
  • 2,178
  • 1
  • 17
  • 33
0
votes
0 answers

Off Heap storage of downloaded large files

I have multiple huge files (around 10-12 files, 1-2Gb each) that need to be downloaded every hour. I store them as a Hashmap, where the key is the file version, and the value is the file contents in list of strings. The problem we face is that every…
Sarthak Agarwal
  • 404
  • 1
  • 3
  • 13
0
votes
1 answer

Chroniclemap - fetch subset of keys

According to this answer ChronicleMap's entrySet().iterator() will dump all objects in memory. I do not want to load all objects in memory and filter the entire map in memory - that defeats the purpose of chroniclemap. So now, Given a chronicle map…
NRJ
  • 1,064
  • 3
  • 15
  • 32
1 2 3 4
5
6 7 8