Stack Overflow
Stack Overflow

Questions tagged [rocksdb]

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

About

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

RocksDB builds on LevelDB to be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO-bound, in-memory and write-once workloads, and to be flexible to allow for innovation.

Links

474 questions
3
votes
3 answers

RocksDB: Too many SST files of very small size

I am using RocksDBJava after running the service for sometime I can see the "Too many open files" exception. Digging through the previous issue mentioned on the portal I found out that it is because of system limitation of opening a maximum number…
AmanSinghal
  • 2,404
  • 21
  • 22
3
votes
0 answers

Partial range query using Kafka Streams, RocksDB and Avro schema

I have an avro schema named CompositeKey with fields of . Another avro schema named SimpleValue. Using Kafka Streams, I put them into a KeyValueStore using Avro…
yolgun
  • 196
  • 3
  • 14
3
votes
1 answer

Can I sync/backup RocksDB over the network?

I have several machines processing large amounts of text data (100s of GB) that is indexed in RocksDB. The machines are for load balancing and are operating on the same data. When I add new machines, I want to copy the database over the network from…
cidermole
  • 5,662
  • 1
  • 15
  • 21
3
votes
3 answers

Does Java API of Rocks DB support prefix scan?

I have huge data set(key-value) in Rocks DB and I have to search for key based on prefix of key in hand. I do not want to scan whole data set to filter out key based on key-prefix. is there any way to do that?
user2463894
  • 33
  • 1
  • 7
3
votes
2 answers

An Unusual use of RocksDB

The way I want to use RocksDB I think is unusual. I want to use it to lower the memory pressure of an application that has a very large number of strings in memory. The reason is because the application will eventually scale to the point that…
Daisha Lynn
  • 459
  • 1
  • 4
  • 16
3
votes
2 answers

Percona Server for MongoDB fails to start when engine is set to rocksdb (MongoRocks)

My understanding is that Percona Server for MongoDB (latest version) is already compiled with the rocksdb engine. Yet, when I set the flag to use it, the service fails to start. It exits with code 100 (uncaught exception), and there is no journal…
Lee3
  • 2,882
  • 1
  • 11
  • 19
3
votes
1 answer

Unable to install pyrocksdb against RocksDB master

I followed the instructions from here: http://pyrocksdb.readthedocs.org/en/latest/installation.html When I try pip install git+git://github.com/stephan-hof/pyrocksdb.git I get the following output with error: running install running build running…
Iulian
  • 1,496
  • 2
  • 15
  • 35
3
votes
2 answers

Does the Java API for Rocks DB support the API GetUpdatesSince?

Does the Java API support the concept of getting all records after a certain point in time? The RocksDB documents read: "Incremental Backups and Replication need to be able to find and tail all the recent changes to the database. The API…
RickHigh
  • 1,808
  • 20
  • 16
3
votes
3 answers

RocksDB make install

From the (slightly) outdated documentation on pyrocksdb, it says: "If you do not want to call make install export the following enviroment variables:" $ export CPLUS_INCLUDE_PATH=${CPLUS_INCLUDE_PATH}:`pwd`/include $ export…
therealrootuser
  • 10,215
  • 7
  • 31
  • 46
2
votes
1 answer

Determining the number of files in each level in RocksDB

By default, RocksDB sets target_file_size_base to 64 MB and target_file_size_multiplier to 1. The comments in the code mention that: Target file size for level L can be calculated by target_file_size_base * (target_file_size_multiplier ^ (L-1)). By…
jeffreyveon
  • 13,400
  • 18
  • 79
  • 129
2
votes
1 answer

Failed to lock the state directory for task 0_13

I am facing a very weird issue with Kafka streams, under heavy load when a rebalancing happens my kafka streams application keep getting stuck with the following error showing up in logs repeatedly: org.apache.kafka.streams.errors.LockException:…
birinder tiwana
  • 21
  • 3
2
votes
1 answer

RocksDB: range query on numbers

Is it possible to use RocksDB efficiently for range queries on numbers? For example if I have billions of tuples (price, product_id) can I use RocksDB to retrieve all products that have 10 <= price <= 100? Or it can't be used for that? I am confused…
collimarco
  • 34,231
  • 36
  • 108
  • 142
2
votes
1 answer

Get values from keys matching pattern in rocks db

Is it possible to read all values matching key pattern from rocks db. e.g: key1 -> value1 key12 -> value12 key123 -> value123 I want to ready all keys matching pattern => "key1*" or "key*2" Is there a way to perform this kind of search operation in…
vineet pant
  • 77
  • 1
  • 9
2
votes
0 answers

Kafka Streams RocksDB Config - Static cache understanding

I'm using Kafka Streams 3.0.0, Spring Cloud Stream and Micrometer to surface the metrics to /actuator/prometheus. The metric I'm referring to is kafka_stream_state_block_cache_capacity, which I believe is equivalent to the block-cache-capacity…
n2my
  • 53
  • 6
2
votes
1 answer

Could not create class Caused by: com.esotericsoftware.kryo.KryoException: java.io.EOFException: No more bytes left

I'm finding issues running a job in a specific small cluster and in my local machine. The job runs smoothly on larger machines. I'm using: com.twitter "chill-protobuf" 0.7.6 .excluding com.esotericsoftware.kryo "kryo" com.google.protobuf…
Juancki
  • 1,793
  • 1
  • 14
  • 21
1 2 3
…
31 32