Questions tagged [chronicle]

Chronicle is a low latency data fabric for logging, IPC, sharing and processing data.

Chronicle uses memory mapped files and access to direct memory to give sub micro second persistence and IPC. This is available as a Queue or Map. It is a high performance solution which is designed for low level Java programmers in mind. This means you will have to worry about many things Java developers generally can ignore, but if you need maximum performance, Chronicle can log or send messages between processes at rates in the tens of millions per second.

The latency between processes can be sub-micro-second including serialization and deserialization, making it an ultra low latency solution. It can also be used in a lockless and GC-free manner.

For more details http://chronicle.software


Chronicle product runs on Java 8 on these platforms

  • 64-bit JVMs on Windows 8 & 10.
  • Linux 2.6 or later
  • Max OSX

It will also run on 32-bit JVMs on Windows, but this has two resource limitations

A 32-bit process has a small virtual address space which can cause performance issues. To accommodate the lack of address space the format of a chronicle on 32-bit bit JVMs is different to a 64-bit system meaning you can get errors trying to swap one for the other.

Note: running a 32-bit JVM on 64-bits Windows will still have these issues as it is the Win XP emulator which emulates the limitations.

238 questions
0
votes
2 answers

Vanilla Queue Creation

This used to work with the chronicle queue v3. It does not create a queue in v4. What am I doing wrong? Thanks. Chronicle chronicleSignal = ChronicleQueueBuilder.vanilla("somePath").build(); ExcerptAppender appender =…
aezn
  • 1
  • 1
0
votes
2 answers

Chronicle 'file not found' for file in the future

I am using Chronicle Queue v4.5.15. I have created a method to tell me the number of elements that are in the queue: public long getQueueSize() { long index = getQueueIndex(); // I store the index in a persistent map so this method simply…
sam
  • 2,469
  • 8
  • 37
  • 57
0
votes
1 answer

IllegalArgumentException when populating a ChronicleMap with high variability in value size

A while back, I asked this question about a ChronicleMap being used as a Map>. Basically, we have a collection where the average Set might be 400, but the max length is 20,000. With ChronicleMap 2, this was causing a…
Depressio
  • 1,329
  • 2
  • 20
  • 39
0
votes
1 answer

How long will it take to persist the latest key-value after I put the entry?

I created a chronicle map with createOrRecoverPersistedTo method. But after restarting the jvm process some entries disappeared. How long will it take to persist the latest key-value after I put the entry? Is there anyway forcing the latest data to…
Hui Li
  • 51
  • 2
0
votes
2 answers

Reading message from chronicle queue does not move the current index to the next cycle automatically

Reading message from chronicle queue does not move the current index to the next cycle automatically. I get the following logs messages: 697917 [SCHEDULER#4] INFO net.openhft.chronicle.queue.impl.single.SingleChronicleQueueExcerpts - Rolled 2 times…
Hui Li
  • 51
  • 2
0
votes
1 answer

Selectable chronicle index and data file

We are trying Chronicle HFT as a proof of concept for low latency messaging b/w components. We are using chronicle-1.7.2.jar We have a reader and writer, writer keeps writing excerpts to chronicle and reader keeps reading it in a busy while loop.…
Srujan Kumar Gulla
  • 5,721
  • 9
  • 48
  • 78
0
votes
1 answer

ChronicleMap causes JVM to crash when values are highly variable in size

We've had success so far using ChronicleMap for most things we wanted to use it for, and most data sets have worked just fine. One use case we have is using it as a multimap, covering most of the concerns with doing so. We're using it as a…
Depressio
  • 1,329
  • 2
  • 20
  • 39
0
votes
1 answer

Using Map3 and Engine in the same project?

Correct me if I'm wrong, but looks like I will have troubles if I try to use Map3 and Engine in the same project due the same package names? Is there any way it can be done? PS Side note - looks like Engine master branch (at least 'demo' module)…
0
votes
1 answer

Writing into a chronicle queue with multiple threads -> java.nio.BufferOverflowException

I am writing an adapter to use chronicle queue in Apache Aries Remote Service Admin. It works fine when I only use a single thread. With more than one thread I get exceptions like below. Any idea what i do wrong? For reference this is my…
Christian Schneider
  • 19,420
  • 2
  • 39
  • 64
0
votes
1 answer

Wha happens if consumer fails on Chronicle

Hi looking at Chronicle v3 what happens if the consumer reads a record of the queue then tries to do something with that record downstream but fails. Can that record be picked up from the queue again? Does everything need to be replayed? Thinking of…
user432024
  • 4,392
  • 8
  • 49
  • 85
0
votes
1 answer

Can killing a process corrupt offheap stored data?

Basically subj. In a case of ChronicleMap: if process was killed or failed with OOM error or something else, is there a probability that actual stored data was corrupted and map became not usable any more?
0
votes
2 answers

Does it make sense to store byte values in Map or it will still use 4 bytes?

In Java in-memory there is no difference between byte or int - both will be represented as 4 bytes. Does for Chronicle Map the difference exist, i.e. does Chronicle Map store byte values as 8 bits or still use 32? Same question if byte is an object…
0
votes
2 answers

Fast passing image data between two JVM

I have two Java applications running on the same machine. As there was a requirement for remote connection we implemented the inter-jvm communication via http. We are passing about 10MByte imagedata 100 times a second from one vm to the other. With…
blaster
  • 845
  • 1
  • 10
  • 25
0
votes
1 answer

How to achieve transaction behaviour with file persisted Chronicle Map

all, I am trying to store time series in Chronicle Map. The series are split into chunks, and every chunk is a separate map entry. I am wondering if anybody knows what is going to happen if JVM exits while an entry is currently being written to the…
user3455810
  • 99
  • 1
  • 7
0
votes
1 answer

Problems building OpenHFT / Chronicle Queue

I've been trying to build the latest release of chronicle queue (3.4.4), but keep running into dependency resolution failures. Some of the dependencies SNAPSHOT versions are missing from the oss sonatype repository, etc. Is there an "all" jar…
1 2 3
15
16