Stack Overflow
Stack Overflow

Questions tagged [rocksdb]

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

About

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

RocksDB builds on LevelDB to be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO-bound, in-memory and write-once workloads, and to be flexible to allow for innovation.

Links

474 questions
2
votes
1 answer

KafkaAvroSerializer with multiple avro registry urls

we have a KafkaAvroSerde configured with multiple avroregistry url. At some point, the serde got a timeout while trying to register a schema on 1 url, but since it threw an IO exception up to the stream app, the stream thread closed. From a kafka…
Frederic Tardif
  • 126
  • 1
  • 11
2
votes
1 answer

Getting "Failed to create lock" exception when performing parallel writes using RocksDB in Java

I am using below dependency for RocksDb. rocksdbjni » 3.5.1 Below code I am calling from Multiple Threads. public static void test(){ try { RocksDB.loadLibrary(); RocksDB rocksDB = RocksDB.open("C:\\Users\\Downloads\\db"); …
cody123
  • 2,040
  • 24
  • 29
2
votes
1 answer

How can I shutdown Rocksdb completely?

I'm using Rocksdb in an application and after closing down all of the db instances, I still see threads with this running rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long) () So when I shutdown the application I receive a libc++abi.dylib:…
user4221
  • 89
  • 8
2
votes
1 answer

How to set up prefix_same_as_start in read_options in RocksDbSharp

I'm using RocksDbSharp library, which is implementation of RocksDb from facebook in C#. I would like to filter my records by part of a key, but unfortunately, I don't see an option how to do that. Here is sample code: static void Main(string[]…
Peska
  • 3,980
  • 3
  • 23
  • 40
2
votes
1 answer

How to control location of Rocksdb shared object in KafkaStreams

I have a Kafka Streams application. I had no problems with rocksdb or Kafka Streams until we deployed the code to our QA servers. The applications streams state was set to error and this was the error message: ERROR…
whomer
  • 575
  • 9
  • 21
2
votes
1 answer

Flink consuming more memory than expected

I am using Flink 1.4.1 to process transactional events and HDFS to store the checkpoint information for fault tolerance. A job was created to aggregate information about clients, day of week and hour of day, thus creating a profile as shown in the…
Gabriel Pelielo
  • 21
  • 2
2
votes
2 answers

RocksDb does not create SST files for smaller tables

A RocksDB newbie here. I am trying to load data into newly created RocksDB databases. I am using the RocksDB Sharp .NET wrapper around the native Windows RocksDB lib. Everything seems to be working, but when I peek inside the directories it…
Vadim Berman
  • 1,932
  • 1
  • 20
  • 39
2
votes
0 answers

Rollback arangodb database to a specific point in time

I have (on purpose) truncated a collection in ArangoDB because I had to import a new data set into it. Unfortunately the data I truncated was of use. Is there a way to bring the database back to a specific point in time using journal files or…
Serigne Saalihou Mbacké Ndiaye
  • 21
  • 1
  • 2
2
votes
1 answer

Kafka Streams building StateStoreSupplier: API clarifications

I am using Kafka Streams of version 0.11.0.2. In order to leverate transform API I create my own StateStoreSupplier using Stores.create builder method. The problem is that javadoc for some field/methods to me is not clear enough. val storeSupplier =…
Nikolay Kuznetsov
  • 9,467
  • 12
  • 55
  • 101
2
votes
1 answer

RocksDB Disk Usage

When I start my Kafka Streams application many directories and files are created under a temp rocksdb directory. Can I reduce the amount of disk space consumed by RocksDB? The total usage seems to be greater than the space needed by the…
AdamS
  • 21
  • 2
2
votes
1 answer

Encryption at rest for RocksDB

I am exploring options to implement encryption at rest for RocksDB data which I am using in one application (that is, I don't have to store the key in the data, I can calculate it in runtime). Ideally, it should be DES. Are there easy plugins or…
Vadim Berman
  • 1,932
  • 1
  • 20
  • 39
2
votes
2 answers

How to facilitate dict record filtering by dict key value?

I want to interface with rocksdb in my python application and store arbitrary dicts in it. I gather that for that I can use something like pickle to for serialisation. But I need to be able to filter the records based on values of their keys. What's…
Worse_Username
  • 318
  • 1
  • 11
2
votes
1 answer

Kafka Streams - Low-Level Processor API - RocksDB TimeToLive(TTL)

I'm kind of experimenting with the low level processor API. I'm doing data aggregation on incoming records using the processor API and writing the aggregated records to RocksDB. However, I want to retain the records added in the rocksdb to be…
Barro
  • 335
  • 3
  • 16
2
votes
1 answer

Replacing RocksDB with In-memory state store in Kafka Streams

I'm using Kafka Streams 0.10.1.1 release. the RocksDB implementation for state store can't handle our 50k/msg rate so I want to change the state store to be the in-memory one. This should be possible according to the docs:…
user278530
  • 83
  • 2
  • 11
2
votes
0 answers

Rocksdb background threads are working after deleting db instance

My start up method: vector columnFamilies = ... DBOptions dbOptions(options); std::vector ttls = ... DBWithTTL* _db; std::vector _handles; Status status = DBWithTTL::Open(dbOptions,…
Mugen
  • 8,301
  • 10
  • 62
  • 140
1 2 3
…
31 32