Stack Overflow
Stack Overflow

Questions tagged [rocksdb]

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

About

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB can also be the foundation for a client-server database but our current focus is on embedded workloads.

RocksDB builds on LevelDB to be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO-bound, in-memory and write-once workloads, and to be flexible to allow for innovation.

Links

474 questions
4
votes
0 answers

Kafka Streams memory allocation issues with RocksDB

I am trying to make a simple Kafka Stream application (v2.3.1 initially it was 2.3.0) which gathers statistics on specified time intervals (e.g. per minute namely tumbling windows). Therefore I follow a textbook implementation like the one below…
ypanag
  • 287
  • 5
  • 22
4
votes
1 answer

RocksDBStateBackend in Flink: how does it works exactly?

I have read the official Flink's documentation about the State Backends, here. In particular, I was interested in the RocksDBStateBackend. I don't understand, if I enable this kind of backend, RocksDB will be accessible from TaskManagers through…
Maurizio Cimino
  • 105
  • 1
  • 9
4
votes
3 answers

Installation of Python-Rocksdb

I'm trying to install Python-RocksDB package. I tried using sudo pip3 install python-rocksdb sudo pip install python-rocksdb However, I get this message Requirement already satisfied: python-rocksdb in /usr/local/lib/python3.6/dist-packages I…
Vivek
  • 165
  • 3
  • 9
4
votes
1 answer

Streaming application with state stores takes up to 1 hour to restart

We are using spring cloud stream with Kafka 2.0.1 and utilizing the InteractiveQueryService to fetch data from the stores. There are 4 stores that persist data on disk after aggregating data. The code for the topology looks like…
mmelsen
  • 636
  • 1
  • 8
  • 24
4
votes
1 answer

When to use RocksDB and when to use MMFiles storage engine in ArangoDB?

We use ArangoDB to store telco data. The main goal of our application is to let users build a certain types of reports very quickly. The reports are mostly based on the data we get from ArangoDB when we traverse different graphs. The business logic…
Peter Liapin
  • 1,196
  • 9
  • 20
4
votes
1 answer

Am I properly forcing RocksDB to use fsync? Neither fsync() nor msync() shows in strace

I'm using RocksDB via the C API. I have a test program that opens a database, does 1,000 writes (gathering timing data between initiation of write and callback), does 1,000 reads, and shuts down. This works. Average time to do a write is about…
TJIC
  • 190
  • 5
4
votes
2 answers

What is the best practice of SQL Database table analogy in RocksDB

In a SQL database, we generally have related information stored in different tables in a database. From what I read from RocksDB document, there's really no clear or 'right' way to represent this kind of structure. So I'm wondering what is the…
Joe Lin
  • 450
  • 7
  • 20
4
votes
0 answers

How to disable RocksDB database debug logging?

RocksDB writes detailed database debug logs: Database Debug Logs RocksDB writes detailed logs to a file named LOG*. These are mostly used for debugging and analyzing a running system. This LOG may be configured to roll at a specified…
q9f
  • 11,293
  • 8
  • 57
  • 96
4
votes
1 answer

Gui viewer for RocksDb sst files

I'm working with Kafka that save the data into rocksdb. Now I want to have a look at the db keys and values that created by Kafka. I downloaded FastNoSQL and tried but failed. The folder contains: .sst files .log files CURRENT file IDENTITY…
DonSaada
  • 767
  • 2
  • 8
  • 18
4
votes
1 answer

Getting started with rocksdb on MacOS

I followed the guide and did: brew install rocksdb and I stuck here. What should I do to use rocksdb? I copied the content of this example file and tried to compile it, both with gcc-5 (brew) and gcc (clang) on Mac OS, but both of them return…
mommomonthewind
  • 4,390
  • 11
  • 46
  • 74
4
votes
1 answer

Using Rocksdb to store custom data types?

I want to write a C++ program using Rocksdb to store key, value pairs which are not in std::string type. For instance, I want use int data-type as the key and values in following data type as the value. typedef struct custom_type { int…
kjee
  • 359
  • 5
  • 19
4
votes
2 answers

Storing arbitrary bytes in RocksDB

RocksDB states that it can store arbitrary data but the API only supports std::string types. I want to store std::vector values and it appears if I want to do this then I must convert it into a std::string. Is there a less brittle way to storing…
jimjampez
  • 1,766
  • 4
  • 18
  • 29
4
votes
1 answer

multiple instances of rocksdb

On a multi-core server (or cluster) want to deploy a rocksdb db on each core that is independent of each other ie. not looking for a distributed db. Is this possible? For each in-memory db, does it need to communicate with storage during runtime…
Henry Thornton
  • 4,381
  • 9
  • 36
  • 43
3
votes
1 answer

Rocksdb compaction is very slow

I am doing rocksdb compaction using compactfiles api. I checked the compaction stats, the read and write is very slow.. I am seeing the read write and write rate to be around 10MBps. which is very low.. Because my flushes are happening at rate…
suresh
  • 4,084
  • 10
  • 44
  • 59
3
votes
1 answer

rocksdb merge operarator performance is very slow for large number of keys

I'm trying to figure out why using the merge operator for a large number of keys with rocksdb is very slow. My program uses a simple associative merge operator (based on upstream StringAppendOperator) that concatenates values using a delimiter for a…
bharat nc
  • 129
  • 2
  • 7
1 2
3
…
31 32