Stack Overflow
Stack Overflow

Questions tagged [kyotocabinet]

Kyoto Cabinet is a key-value based database, based on the DBM (Unix DataBase Manager) standard, similar the modern database system Tokyo Cabinet.

From: http://fallabs.com/kyotocabinet/

Kyoto Cabinet is a library of routines for managing a database. The database is a simple data file containing records, each is a pair of a key and a value. Every key and value is serial bytes with variable length. Both binary data and character string can be used as a key and a value. Each key must be unique within a database. There is neither concept of data tables nor data types. Records are organized in hash table or B+ tree.

Kyoto Cabinet runs very fast. For example, elapsed time to store one million records is 0.9 seconds for hash database, and 1.1 seconds for B+ tree database. Moreover, the size of database is very small. For example, overhead for a record is 16 bytes for hash database, and 4 bytes for B+ tree database. Furthermore, scalability of Kyoto Cabinet is great. The database size can be up to 8EB (9.22e18 bytes).

Kyoto Cabinet is written in the C++ language, and provided as API of C++, C, Java, Python, Ruby, Perl, and Lua. Kyoto Cabinet is available on platforms which have API conforming to C++03 with the TR1 library extensions. Kyoto Cabinet is a free software licensed under the GNU General Public License. On the other hand, a commercial license is also provided. If you use Kyoto Cabinet within a proprietary software, the commercial license is required.

45 questions
1
vote
3 answers

Kyoto TreeDB insertion slows down after 100 million records

I am inserting records in Kyoto TreeDB. The key is simply a counter which I increment and the value is fixed. After 100 million records, insertion gradually keeps slowing down. Has anyone tried to insert more records in Kyoto Cabinet?
bazzinga
  • 219
  • 1
  • 8
0
votes
1 answer

Kyoto Cabinet Installation Issue

I have installed Kyoto Cabinet by using instruction from this. However, this says you have to add kyotocabinet.jar in your class path to compile a java file. But, I have not find anywhere the kyotocabinet.jar file. I try to add kyotocabinet.jar by…
Arpssss
  • 3,850
  • 6
  • 36
  • 80
0
votes
5 answers

> 60K inserts per second key value store to be used from Java

Am working on custom solution where I need to store huge data to file/db at the speed of 60K records per second. This data is result of incoming continuous stream. leveldb - it can NOT be accessed simultaneously from multiple java…
Ketan Khairnar
  • 1,620
  • 3
  • 12
  • 21
0
votes
4 answers

does kyoto cabinet support key range search?

Does Kyoto Cabinet support searching for a range of keys? If so, what types of keys do support range search? Can I do range search on a long (64bit) key? Thanks RG
nightwatch
  • 1,276
  • 2
  • 18
  • 27
0
votes
2 answers

Trouble installing Kyoto Tycoon - Java. Maven failing

I've downloaded Kyoto Tycoon via: hxxps://bitbucket.org/EP/kyototycoon-java When running mvn install I get plenty of warnings telling me it couldn't find several files: http://pastebin.com/znpJ3d5n When I first started running the install I was…
shifty_28
  • 1
  • 2
0
votes
1 answer

How to have parallelization in Key-Value Databases?

My intent is to version large csv files and hence, I am using key-value databases where key will be the column(s) from a complete row and value will be the row itself. For eg: Name, Age, Roll.No Aviral, 22, 1 Apoorv, 19, 2 If I put Roll no as the…
aviral sanjay
  • 953
  • 2
  • 14
  • 31
0
votes
2 answers

which is the efficient db for autosuggest for some million datas

i need to know which will be the best db for an autosugest db with some 80 million records... 1)Redis 2)tokyoCabinet 3)Kyoto Cabinet
mumt
  • 49
  • 2
  • 6
0
votes
0 answers

What is the output format for Kyoto Cabinet `kchashmgr get` command?

Hello fellow Stackoverflowians. I'm looking to extract information from a cache key from a Kyoto Tycoon cabinet file, specifically from the output from the Kyoto Cabinet utility kchashmgr (see: http://fallabs.com/kyotocabinet/util.html#kchashmgr ) I…
Yzmir Ramirez
  • 1,281
  • 7
  • 11
0
votes
2 answers

Serious performance degradation with KyotoCabinet (TreeDB)

I have selected TreeDB as Kyoto Cabinet backend in hope that it will scale to huge values. Unfortunately, there's a problem: # ./kyotobench Generated string length: 1024 1000 records, type t 74.008887ms throughput: 13511 /sec 2000 records, type t…
LetMeSOThat4U
  • 6,470
  • 10
  • 53
  • 93
0
votes
2 answers

Kyotocabinet and Scala(Java): Limit of DB files open?

I write scala application that use a lot of Kyotocabinet Db files (i need to open 500-3k little kyotocabinet files at one time). But after 512 opened (created) db files i have a error "Error:success: no error", and new db file does not…
Vov Pov
  • 101
  • 5
0
votes
1 answer

Snapshot of KyotoCabinet database concurrent to writes

Is it possible in Kyoto Cabinet database to make safely a database snapshot and concurrently write to database in the same time ? The KyotoCabinet database class kyotocabinet.DB (for JAVA among other languages) provides the following methods: …
digital_infinity
  • 534
  • 6
  • 20
0
votes
2 answers

Straightforward way to create and access databases for: (List and HashMap) in java

I am not familiar with databases and I usually benefit from memory and data structures such as Maps. However right now my data is huge and by reading it into memory it quickly overflows and then the system entirely freezes (linux 12.04 LTS). So I…
MAZDAK
  • 573
  • 1
  • 4
  • 16
0
votes
2 answers

kyotocabinet java binding installation error

I am trying to install kyotocabinet's java binding. I used mac port to install kyotocabinet (1.2.76). Then I downloaded and unzipped kyoto java binding 1.24. Next I set the current directory to where kyoto java binding is unzipped. Now the problem…
MAZDAK
  • 573
  • 1
  • 4
  • 16
0
votes
1 answer

PostgreSQL Junction Table to a key-value store (like Kyoto Cabinet)

I am not sure what type of question this is. What import format(s) does Kyoto Cabinet support? For example, I have a junction table t, many-to-many relationship, in a PostgreSQL database. The size of t is about 285 million. t = X, Y ----- 1, a 1,…
Martin Velez
  • 1,379
  • 11
  • 24
0
votes
1 answer

Should a database connection be opened only once in a django app or once for every user within views.py?

I'm working on my first Django project. I need to connect to a pre-existing key value store (in this case it is Kyoto Tycoon) for a one off task. i.e. I am not talking about the main database used by django. Currently, I have something that works,…
Pete W
  • 1,817
  • 3
  • 18
  • 20
1 2
3