Questions tagged [rocksdb-java]
45 questions
1
vote
1 answer
To close or to not close RocksDB Cache and WriteBufferManager in kafka streams app
I am currently playing around with a custom RocksDB configuration in my streams app by extending RocksDBConfigSetter interface. I see conflicting documentation around closing cache & writeBufferManager instances.
Right now, I see that the javadoc &…

Wizard
- 1,154
- 2
- 14
- 41
1
vote
1 answer
Sorting by value in rocksdb
Rocksdb allows to sort the records by keys but I want to sort them by value. Is it possible to do that?

Shagor Hasan
- 21
- 2
1
vote
1 answer
Suggestion on RocksDB Configuration
I am looking for suggestions on my RocksDB configuration. Our use case is to load 100GB of key-value pairs into rocksdb and at run time only serve the key-value pairs in the db. Key is 32 bytes and value is 1.6 KB in size.
What we have right now is…

codegenx
- 23
- 1
- 8
1
vote
1 answer
RocksDB iterator seek until last matching prefix
How do I tell a RocksDB iterator to seek until the last matching prefix?
In Clojure using the RocksDB Java API:
(import '(org.rocksdb RocksDB Options ReadOptions RocksIterator Slice))
(let [opts (-> (ReadOptions.)
…

Petrus Theron
- 27,855
- 36
- 153
- 287
1
vote
1 answer
Is rocksdb WriteBatch thread safe?
For example, one class has a private db, and a public method-put .
We got several threads to run the put, is this ok ? (ps: we don't consider the order of the k/v )
void put(List values) {
WriteOptions writeOpt = new…

jcyan
- 51
- 7
1
vote
0 answers
RocksDB JNI Slow Read Performance
I am using RocksDB JNI and I found that reads are getting exponentially slow for this program
Initially, it's in an acceptable range. But when the program runs so that the total records reach 1 million then the read time logger prints are showing…

RSSAH
- 123
- 14
1
vote
1 answer
Kafka stream window aggregation almost working
I need to aggregate some sensor data and I'm experimenting with windowed aggregation for a PoC/study project.
After researching here and there and a lot of attempts, I came up with the following code, which seems to be working.
I get in fact the…

Pinco Pallino
- 916
- 1
- 6
- 18
1
vote
1 answer
Does rocksdbjava api library contain the rocksdb database itself
I am very new to rockdb and will be using the rocksdb in my application as a lookup service. Does the rockDBjava library api provided contain the database itself, I mean is it not necessary to install rocksDB database separately.
I tried running the…

Tom Thorpe
- 11
- 1
0
votes
0 answers
How to configure RocksDB matrics using kafka streams 3.2.0 in java?
I need to use metrics mentioned in https://cwiki.apache.org/confluence/display/KAFKA/KIP-471%3A+Expose+RocksDB+Metrics+in+Kafka+Stream in java.
Is there any sample document available for printing the default values using java code ?
In case any…

shalaka
- 1
- 2
0
votes
1 answer
RocksDB Metrics
I'm using RocksDB in my project with the SpringBoot Microservices. For monitoring & troubleshooting purposes, I want to export RocksDB metrics daily. I have exposed some metrics like Column Family, Estimated Counts, RocksDB Properties, etc. Now I…

Luffy
- 186
- 2
- 14
0
votes
0 answers
Memory is not reclaimed when close the rocksdb instance
our project use rocksdb with rocksdbjni that is nice and easy to use.
but, some problems give me a headaches. when i close the rocksdb the momery in used doesn't properly reclaimed. It seems to depending on OS.
so i did some test with this code in…

kospi
- 355
- 5
- 14
0
votes
0 answers
Calling java native method from Kotlin
I am trying to create an instance of a rocksDB cache from Kotlin.
val cache = org.rocksdb.LRUCache(500L * 1024L * 1024L)
But I am getting an exception
Exception in thread "main" java.lang.UnsatisfiedLinkError: 'long…

AmsterdamLuis
- 341
- 3
- 21
0
votes
1 answer
Kafka Streams state store count
I have the following topology in Kafka Streams 7.2.2-ccs:
Or in code:
val groupedStream = StreamsBuilder().stream("quotes").groupByKey()
for (windowSize in windows()) {
groupedStream
…

AmsterdamLuis
- 341
- 3
- 21
0
votes
0 answers
Strategy error when try to update the RocksDB default column family options
I am trying to update the Ttl option (in scala) for the default column family in RocksDB.
Following the code snippet i am using:
db = RocksDB.open(options, dir)
val optionsBuilder =…
0
votes
0 answers
Rocksdb deleted records are visible in iterator
Below is my pseudocode.
1. Begin transaction
2. Create iterator
3. Delete first record from iterator and move next on iterator
4. commit transaction
5. If there's end of iterator then create new iterator and repeat from step #1
Note: Iterator range…

amitwdh
- 661
- 2
- 9
- 19