Questions tagged [rocksdb-java]

45 questions
1
vote
1 answer

To close or to not close RocksDB Cache and WriteBufferManager in kafka streams app

I am currently playing around with a custom RocksDB configuration in my streams app by extending RocksDBConfigSetter interface. I see conflicting documentation around closing cache & writeBufferManager instances. Right now, I see that the javadoc &…
Wizard
  • 1,154
  • 2
  • 14
  • 41
1
vote
1 answer

Sorting by value in rocksdb

Rocksdb allows to sort the records by keys but I want to sort them by value. Is it possible to do that?
1
vote
1 answer

Suggestion on RocksDB Configuration

I am looking for suggestions on my RocksDB configuration. Our use case is to load 100GB of key-value pairs into rocksdb and at run time only serve the key-value pairs in the db. Key is 32 bytes and value is 1.6 KB in size. What we have right now is…
codegenx
  • 23
  • 1
  • 8
1
vote
1 answer

RocksDB iterator seek until last matching prefix

How do I tell a RocksDB iterator to seek until the last matching prefix? In Clojure using the RocksDB Java API: (import '(org.rocksdb RocksDB Options ReadOptions RocksIterator Slice)) (let [opts (-> (ReadOptions.) …
Petrus Theron
  • 27,855
  • 36
  • 153
  • 287
1
vote
1 answer

Is rocksdb WriteBatch thread safe?

For example, one class has a private db, and a public method-put . We got several threads to run the put, is this ok ? (ps: we don't consider the order of the k/v ) void put(List values) { WriteOptions writeOpt = new…
1
vote
0 answers

RocksDB JNI Slow Read Performance

I am using RocksDB JNI and I found that reads are getting exponentially slow for this program Initially, it's in an acceptable range. But when the program runs so that the total records reach 1 million then the read time logger prints are showing…
RSSAH
  • 123
  • 14
1
vote
1 answer

Kafka stream window aggregation almost working

I need to aggregate some sensor data and I'm experimenting with windowed aggregation for a PoC/study project. After researching here and there and a lot of attempts, I came up with the following code, which seems to be working. I get in fact the…
1
vote
1 answer

Does rocksdbjava api library contain the rocksdb database itself

I am very new to rockdb and will be using the rocksdb in my application as a lookup service. Does the rockDBjava library api provided contain the database itself, I mean is it not necessary to install rocksDB database separately. I tried running the…
Tom Thorpe
  • 11
  • 1
0
votes
0 answers

How to configure RocksDB matrics using kafka streams 3.2.0 in java?

I need to use metrics mentioned in https://cwiki.apache.org/confluence/display/KAFKA/KIP-471%3A+Expose+RocksDB+Metrics+in+Kafka+Stream in java. Is there any sample document available for printing the default values using java code ? In case any…
0
votes
1 answer

RocksDB Metrics

I'm using RocksDB in my project with the SpringBoot Microservices. For monitoring & troubleshooting purposes, I want to export RocksDB metrics daily. I have exposed some metrics like Column Family, Estimated Counts, RocksDB Properties, etc. Now I…
Luffy
  • 186
  • 2
  • 14
0
votes
0 answers

Memory is not reclaimed when close the rocksdb instance

our project use rocksdb with rocksdbjni that is nice and easy to use. but, some problems give me a headaches. when i close the rocksdb the momery in used doesn't properly reclaimed. It seems to depending on OS. so i did some test with this code in…
kospi
  • 355
  • 5
  • 14
0
votes
0 answers

Calling java native method from Kotlin

I am trying to create an instance of a rocksDB cache from Kotlin. val cache = org.rocksdb.LRUCache(500L * 1024L * 1024L) But I am getting an exception Exception in thread "main" java.lang.UnsatisfiedLinkError: 'long…
0
votes
1 answer

Kafka Streams state store count

I have the following topology in Kafka Streams 7.2.2-ccs: Or in code: val groupedStream = StreamsBuilder().stream("quotes").groupByKey() for (windowSize in windows()) { groupedStream …
0
votes
0 answers

Strategy error when try to update the RocksDB default column family options

I am trying to update the Ttl option (in scala) for the default column family in RocksDB. Following the code snippet i am using: db = RocksDB.open(options, dir) val optionsBuilder =…
0
votes
0 answers

Rocksdb deleted records are visible in iterator

Below is my pseudocode. 1. Begin transaction 2. Create iterator 3. Delete first record from iterator and move next on iterator 4. commit transaction 5. If there's end of iterator then create new iterator and repeat from step #1 Note: Iterator range…
amitwdh
  • 661
  • 2
  • 9
  • 19