Stack Overflow
Stack Overflow

Questions tagged [chronicle-queue]

Chronicle Queue is a persisted low-latency messaging framework for high performance and critical applications.

Resources

  1. SourceCode
  2. Stackoverflow Questions and Answers
  3. Getting started
  4. Java Docs
172 questions
1
vote
1 answer

Chronicle Queue: What is the recommended way to multiplex producers to write into a single queue?

Let there be 5 producer threads, and 1 queue. It seems like I have 2 options: create an appender for each producer thread, append concurrently and let chronicle queue deal with synchronization (enable double-buffereing?) synchronize the 5 producer…
ccnlui
  • 91
  • 5
1
vote
1 answer

Chronicle Queue JSON

I'm currently trying to marshal a certain POJO as JSON and write it to an output queue. This is the run down of what I'm trying to do: object OrderExecutor { const val OUT_PATH = "${PATH}/order-executor/out" @JvmStatic fun main(args:…
David Teh
  • 61
  • 5
1
vote
1 answer

Non-time-based RollCycles?

Chronicle Queue has the notion of RollCycles which determine when an appender will switch to a new file. Would it be possible to have RollCycles based on other criteria, for instance of current file size? It would switch to a new file if the current…
vasquez
  • 583
  • 5
  • 18
1
vote
1 answer

What is the correct way of doing Java IPC through /dev/shm (with the lowest possible latency)

I'm trying to code an IPC solution through /dev/shm. @SK-logic gave me some pointers in the comments here: Chronicle: How to optimize memory-mapped files for low-latency? My doubt is: Should I use a MappedByteBuffer or just a plain FileChannel? With…
Roger Kasinsky
  • 73
  • 5
1
vote
1 answer

Chronicle: How to optimize memory-mapped files for low-latency?

I'm using Chronicle to transfer vast amounts of data from one JVM to another. Problem is that I notice a lot of jitter on my benchmarks. My knowledge of memory-mapped files is somewhat limited, but I do know that the OS swaps pages back and forth…
Roger Kasinsky
  • 73
  • 5
1
vote
1 answer

How to copy one tailer's read index to apply into another tailer using Chronicle Queue

I create a tailerA and use tailerA read to the 100th message. And I create another tailerB ChronicleQueue queue = SingleChronicleQueueBuilder.single("/home/data").rollCycle(rollCycles).build() ExcerptTailer tailerA =…
Asuka_Truth
  • 15
  • 5
1
vote
1 answer

Chronicle Queue despite rolling cycle minutely deleting chronicle file after processing keeps file in open list lsof and not releasing memory

I am using chronicle queue version 5.20.123 and open JDK 11 with Linux Ubuntu 20.04, when we recycle current cycle on minute rolling I am listening on StoreFileListener onReleased I am deleting file then also file remains open without releasing…
chaitas shah
  • 13
  • 4
1
vote
1 answer

Save consumer/tailer read offset for ChronicleQueue

I am exploring ChronicleQueue to save events generated in one of my application.I would like to publish the saved events to a different system in its original order of occurrence after some processing.I have multiple instances of my application and…
Sam
  • 295
  • 2
  • 9
  • 24
1
vote
1 answer

StreamCorruptedException on chronicle queue making the queue unusable

We had a StreamCorruptedException from chroniclequeue(chronicle-queue-5.20.106, Red Hat Linux release 6.10) and we have pasted the stacktrace below. During that time, there was a very high IO/disk operation by completely different process which we…
Venkat
  • 23
  • 4
1
vote
1 answer

Can Chronicle Queue method writer be shared between threads?

And a second question that follows if method writer (MW) can be shared: Is it advised from performance reasons ? (or it is better to have a single MW per thread ?)
digital_infinity
  • 534
  • 6
  • 20
1
vote
1 answer

Chronicle write introducing 1-2 sec latency at file roll over time

We have a single threaded java process that is writing messages into chronicle queue. The queue (SingleChronicleQueue) is configured with RollCycle HOURLY. At the hourly mark, when the file roll happens, chronicle write takes more than a second…
rj_89
  • 11
  • 5
1
vote
1 answer

Chronicle Queue performance when using ByteBuffer

I'm using Chronicle Queue as a DataStore which will be written to once but read many many times. I'm trying to get the best performance (time to read x number of records). My data set (for my test) is about 3 million records , where each record…
Plaiska
  • 166
  • 2
  • 11
1
vote
1 answer

Adding Chronicle Queue to project using Maven conflicts with Lombok

I was using Chronicle Queue in a project that does not have Lombok. Everything was okey. Then I tried to use same Maven dependency in a project that have Lombok dependency. But it crashed this time. I see the below error in my all Lombok Getter and…
Tugrul Bayrak
  • 111
  • 1
  • 15
1
vote
1 answer

file corruption or truncation on hard reset

When using ExcerptAppender over Chronicle Queue (append only log) is it guaranteed that only the end of file may be truncated in case of power loss i.e. all intermediate records are not corrupted? If so what implementation/filesystem/OS behaviour…
hawk
  • 1,827
  • 2
  • 14
  • 28
1
vote
1 answer

Chronicle Queue memory mapping file to reduce avoid garbage collection?

I have a question about how the Chronicle queue avoids garbage collection: I understand that the Chronicle queue uses a memory mapping file so that it can save an object into main memory or dist rather than into JVM. However, when a processor…
Guifan Li
  • 1,543
  • 5
  • 14
  • 28
1 2 3
…
11 12