Questions tagged [chronicle]

Chronicle is a low latency data fabric for logging, IPC, sharing and processing data.

Chronicle uses memory mapped files and access to direct memory to give sub micro second persistence and IPC. This is available as a Queue or Map. It is a high performance solution which is designed for low level Java programmers in mind. This means you will have to worry about many things Java developers generally can ignore, but if you need maximum performance, Chronicle can log or send messages between processes at rates in the tens of millions per second.

The latency between processes can be sub-micro-second including serialization and deserialization, making it an ultra low latency solution. It can also be used in a lockless and GC-free manner.

For more details http://chronicle.software


Chronicle product runs on Java 8 on these platforms

  • 64-bit JVMs on Windows 8 & 10.
  • Linux 2.6 or later
  • Max OSX

It will also run on 32-bit JVMs on Windows, but this has two resource limitations

A 32-bit process has a small virtual address space which can cause performance issues. To accommodate the lack of address space the format of a chronicle on 32-bit bit JVMs is different to a 64-bit system meaning you can get errors trying to swap one for the other.

Note: running a 32-bit JVM on 64-bits Windows will still have these issues as it is the Win XP emulator which emulates the limitations.

238 questions
2
votes
1 answer

String array - needless synchronization?

I'm studying ChronicleHFT libraries. I found a class StringInterner posted below public class StringInterner { @NotNull protected final String[] interner; protected final int mask; protected final int shift; protected boolean…
minizibi
  • 363
  • 2
  • 14
2
votes
1 answer

How to update a record in chronicle queue?

I want to update a record at specific index. My code did not work. Thank you all appender.writeBytes(Bytes.wrapForRead("1234".getBytes())); long index = tailer.index(); DocumentContext dc = tailer.readingDocument(); Wire wire…
dragun
  • 21
  • 2
2
votes
1 answer

Using Chronicle Map producing garbage while using Streams API

Today I was experimenting with Chronicle Map. Here is a code sample: package experimental; import net.openhft.chronicle.core.values.IntValue; import net.openhft.chronicle.map.ChronicleMap; import net.openhft.chronicle.values.Values; public class…
2
votes
1 answer

chronicle vs chronicle-queue package

I'm just getting started with chronicle queue - however I'm a bit confused on which API to use for reading/writing to the queue. Specifically chronicle-queue-5 vs chronicle-3.5.* I've gone through this link which basically uses chronicle-queue API…
Plaiska
  • 166
  • 2
  • 11
2
votes
1 answer

Chronicle Queue tailer stops when appender is restarted

In the below code, restarting the tailer process is ok. However, restarting the appender process results in the tailer failing to receive any more messages. Is there a way to restart the appender and keep the channel open? Edited: Below is a full…
Chris Mack
  • 21
  • 2
2
votes
1 answer

chronicle-bytes shared DirectBytesStores

I've created a MappedBytes instance to a file that I'm using as shared cache between different Java processes. I would like to be able to split out additional MappedByte instances (or ByteBuffer or any other instance) from the original that provide…
2
votes
1 answer

Reading messages in Chronicle Queue Tailer (v5.16.11) does not auto-move the index to next roll cycle

I use CQ v5.16.11 (with openjdk 11) to save data with daily roll cycles. The process runs non-stop from Sun to Fri so I have 5 cq4 files per week. I ran the process for 1.5 weeks and have 8 files (3 for 1st and 5 for 2nd week). So the files that I…
Sam
  • 61
  • 6
2
votes
1 answer

SAN based storage with chronicle queue

I started using chronicle-queue a few days back, and i was going through its documentation. Chronicle Queue does not support operating off any network file system, be it NFS, AFS, SAN-based storage or anything else. The reason for this is…
Joshnee
  • 241
  • 4
  • 8
2
votes
2 answers

Is there guaranteed order of subscribers in chronicle queue?

I'm looking at Chronicle and I don't understand one thing. An example - I have a queue with one writer - market data provider writes tick data as they appear. Let's say queue has 10 readers - each reader is a different trading strategy that reads…
Mark Fric
  • 21
  • 2
2
votes
1 answer

Using ChronicleMap as a key-value database

I would like to use a ChronicleMap as a memory-mapped key-value database (String to byte[]). It should be able to hold up to the order of 100 million entries. Reads/gets will happen much more frequently than writes/puts, with an expected write rate…
xpages-noob
  • 1,569
  • 1
  • 10
  • 37
2
votes
2 answers

Chronicle Queue - Read from last read position and delete files if read by all consumers

I am using Chronicle 4.5.27 for writing and reading market data. I have got a single writer but multiple readers. Development OS is Windows followed by Linux for Prod deployment. How to implement following uses cases? How to start reading queues…
AmbGup
  • 731
  • 1
  • 9
  • 23
2
votes
1 answer

Chronicle Map atomicity semantics

I am wondering about the Atomicity semantics in Chronicle Map. If I have a chronicle map shared across 2 nodes (servers) and I try to insert the same key into this map simultaneously on both nodes, what are the transactional semantics? Will the…
cliff
  • 43
  • 1
  • 3
2
votes
1 answer

Copy data from one Chronicle to another

For the concept of taking back up , i need to copy data from one chronicle queue to another . Would it be safe to do a directly copy the whole Bytes object from wire of one queue into another ? something like…
user3887600
  • 138
  • 1
  • 8
2
votes
1 answer

Chronicle Queue StoreTailer.next() creating huge amount of garbage

I'm bench-marking Chronicle queue for one of our use cases and noticed that readDocument() API of the ExcerptTailer creates too much garbage! JFR shows that the process spends around 66% of the time in the stack below. What version of Chronicle…
KodeWarrior
  • 3,538
  • 3
  • 26
  • 40
2
votes
1 answer

NavigableMap support in Chronicle-Map ?

Thanks in advance for your support. Is there any way to create java NavigableMap in Chronicle-Map ?
1 2
3
15 16