Stack Overflow
Stack Overflow

Questions tagged [kyotocabinet]

Kyoto Cabinet is a key-value based database, based on the DBM (Unix DataBase Manager) standard, similar the modern database system Tokyo Cabinet.

From: http://fallabs.com/kyotocabinet/

Kyoto Cabinet is a library of routines for managing a database. The database is a simple data file containing records, each is a pair of a key and a value. Every key and value is serial bytes with variable length. Both binary data and character string can be used as a key and a value. Each key must be unique within a database. There is neither concept of data tables nor data types. Records are organized in hash table or B+ tree.

Kyoto Cabinet runs very fast. For example, elapsed time to store one million records is 0.9 seconds for hash database, and 1.1 seconds for B+ tree database. Moreover, the size of database is very small. For example, overhead for a record is 16 bytes for hash database, and 4 bytes for B+ tree database. Furthermore, scalability of Kyoto Cabinet is great. The database size can be up to 8EB (9.22e18 bytes).

Kyoto Cabinet is written in the C++ language, and provided as API of C++, C, Java, Python, Ruby, Perl, and Lua. Kyoto Cabinet is available on platforms which have API conforming to C++03 with the TR1 library extensions. Kyoto Cabinet is a free software licensed under the GNU General Public License. On the other hand, a commercial license is also provided. If you use Kyoto Cabinet within a proprietary software, the commercial license is required.

45 questions
2
votes
1 answer

Kyoto Tycoon remove expired recorde from memory

We have small setup of Kyoto Tycoon [Kyoto Tycoon 0.9.55 (2.18) on Linux (Kyoto Cabinet 1.2.75)] which is Fully In-Memory DB & shared in 3 with Master slave architecture for each shared. Presently we have issue with expired records which stays in…
roy
  • 6,344
  • 24
  • 92
  • 174
2
votes
1 answer

Are Kyoto Cabinet and Tokyo Cabinet dead?

These projects sound interesting, but I don't see any active development, and the code base depends on obsolete sowftware (GLIBC_2.14...) Or am I looking in the wrong places?
MasterScrat
  • 7,090
  • 14
  • 48
  • 80
2
votes
2 answers

Can RocksDB handle multiple read-only clients?

I need a key-value database, like redis or memcached, but not in memory and rather on disk. After filling the database (which we do regularly and from scratch), I'd actually only need the get operation, but from many different processes (so Kyoto…
Valentin Golev
  • 9,965
  • 10
  • 60
  • 84
2
votes
2 answers

Kyoto Cabinet HashDB inserts are not O(1)

I am experimenting with Kyoto Cabinet HashDB. My database will grow up to the size of 110 TB. The keys are 20 Bytes and values are 128 KB. I am trying to insert about 500 million records. Here is the best performance I have gotten so far: Time is in…
Tarandeep Gill
  • 1,506
  • 18
  • 34
2
votes
0 answers

How to improve kyotocabinet Hash Database time effective

In the homepage of kyotocabinet, I see it cost 0.9 secods to store data with hash database, but in my test , store one million data cost about 13 seconds. I find some Parameter can improve effective in…
yancey
  • 23
  • 3
2
votes
1 answer

Kyoto cabinet TreeDB: memory usage grows uncontrollably until database is closed

I've been trying to use kyotocabinet TreeDB (MSVC10 build) and stumbled upon a strange memory issue: basically, on each database write, memory usage grows and it doesn't drop until database is closed. The test code looks like this: size_t BLOCK_SIZE…
Chriso
  • 112
  • 7
2
votes
2 answers

Does Tokyo Cabinet support in-memory B+ Tree implementation?

Does Tokyo Cabinet support in-memory B+ trees? If so, how do I use them? Because in some web articles (for example here and here), such usage is reported but I can't find any document describing how to do it. Thanks.
Arpssss
  • 3,850
  • 6
  • 36
  • 80
2
votes
4 answers

Installing Issue in the Debian-Linux Server

I am trying to install Kyoto Cabinet in the Debian-Linux Server by using this commands. However, when I execute ./configure Command, it gives error -bash: ./configure: /bin/sh^M: bad interpreter: No such file or directory Can anybody help me…
Arpssss
  • 3,850
  • 6
  • 36
  • 80
1
vote
2 answers

Storing multiple values for keys in KyotoDB

Could you please let me know if one can store multiple values for same key/s in Kyoto Cabinet(KB). I need to implement a quick indexing mechanism for a large chunk of data which could have multiple values for same keys and I am trying to test KB for…
Abhi
  • 6,075
  • 10
  • 41
  • 55
1
vote
2 answers

How to use kyotocabinet(JNI) in playframework?

I'm tackling to use kyotocabinet in Playframework. and following error occurred. I'm using Eclipse and playframework-1.2.3. and kyotocabinet is native library so I'm using its Java-Binding. the reproduce code is simple. in controller: public static…
DyK
  • 249
  • 3
  • 12
1
vote
1 answer

How to read a csv and process rows using dask?

I want to read a 28Gb csv file and print the contents. However, my code: import json import sys from datetime import datetime from hashlib import md5 import dask.dataframe as dd import dask.multiprocessing import pandas as pd from kyotocabinet…
aviral sanjay
  • 953
  • 2
  • 14
  • 31
1
vote
1 answer

Unable to install kyotocabinet command 'gcc' failed with exit status 1

Trying to install kyotocabinet using pip install kyoto cabinet but it always throw this error, I already have already installed all the packages like sudo yum install python-devel sudo yum install libevent-devel sudo yum -y install gcc gcc-c++…
Waqar
  • 817
  • 2
  • 8
  • 18
1
vote
0 answers

Does kyotocabinet hashdb contain array bucket in RAM?

I use kyotocabinet hashdb for search by hashes. I have been put 10 millions fields to hashdb and searched 1000 random hashes for 78 milliseconds. After some time i tried again and it took around 40 seconds. I thought that kyotodb load array bucket…
Artem Vichurin
  • 11
  • 3
1
vote
1 answer

How to dump a tokyocabinet in-memory hashtable database in a file?

Is there a simply way to dump a tokyocabinet in-memory database to a file? I didn't find anything about it in the tokyo documentation. Does anyone know another nosql database that provide with this kind of thing? I'm looking for a very efficient in…
gregosb
  • 21
  • 1
1
vote
2 answers

What database is really fast on write to disk?

i'm working on a biology software that generates some millions of strings (formed by nucleotide bases, A-G-C-T) of length usually bigger than 30 chars. It was written C. I need a database to store this data on disk fast enough to don't create a…
Pedro Alves
  • 1,667
  • 4
  • 17
  • 37
1
2
3