Questions tagged [tokyo-cabinet]

Tokyo Cabinet is a modern key-value based (NoSQL) database system.

From: http://fallabs.com/tokyocabinet/

Tokyo Cabinet is a library of routines for managing a database. The database is a simple data file containing records, each is a pair of a key and a value. Every key and value is serial bytes with variable length. Both binary data and character string can be used as a key and a value. There is neither concept of data tables nor data types. Records are organized in hash table, B+ tree, or fixed-length array.

Tokyo Cabinet is developed as the successor of GDBM and QDBM on the following purposes. They are achieved and Tokyo Cabinet replaces conventional DBM products.

improves space efficiency : smaller size of database file. improves time efficiency : faster processing speed. improves parallelism : higher performance in multi-thread environment. improves usability : simplified API. improves robustness : database file is not corrupted even under catastrophic situation. supports 64-bit architecture : enormous memory space and database file are available. Tokyo Cabinet is written in the C language, and provided as API of C, Perl, Ruby, Java, and Lua. Tokyo Cabinet is available on platforms which have API conforming to C99 and POSIX. Tokyo Cabinet is a free software licensed under the GNU Lesser General Public License.

78 questions
2
votes
2 answers

Issue with Hash Map Space

In my Java code, I am using Guava's Multimap (com.google.common.collect.Multimap) by using this: Multimap Index = HashMultimap.create() Here, Multimap key is some portion of a URL and value is another portion of the URL…
Arpssss
  • 3,850
  • 6
  • 36
  • 80
2
votes
1 answer

Why can't I create a fixed length tokyo cabinet database larger than 1.8GB?

When I attempt to create a database using tcfdbtune with a parameter limsiz of 1900000000 (1.9GB) and then try to run a tcfdbopen, it fails with a "memory error", and I have no idea why. When I create a 1.8 GB database, the process takes a lot of…
Ron Reiter
  • 3,852
  • 3
  • 30
  • 34
2
votes
0 answers

Why tchdb file size keep going bigger after tchdbout some items?

I use tchdb in a server to store some data. And use another program to clean some old and useless data. But after executing this cleaner the file size didn't change and keep going bigger while the server still running. Did I do things wrong? Should…
amazingjxq
  • 4,487
  • 7
  • 33
  • 35
2
votes
0 answers

Tokyo tyrant database size limit

I have a database with 65GB and it looks like it is not accepting new entries. Is there any limit for tokyo tyrant database size?
Daniel Cukier
  • 11,502
  • 15
  • 68
  • 123
2
votes
1 answer

Are Kyoto Cabinet and Tokyo Cabinet dead?

These projects sound interesting, but I don't see any active development, and the code base depends on obsolete sowftware (GLIBC_2.14...) Or am I looking in the wrong places?
MasterScrat
  • 7,090
  • 14
  • 48
  • 80
2
votes
1 answer

What is the best way to determine the count of records that will be returned by a query with rufus-tokyo?

I would like to determine the number of records that a query on a Tokyo Cabinet Table will return before I run the query. I am using the rufus-tokyo Ruby gem as my interface. What is the best way to do this?
Jamal Hansen
  • 954
  • 7
  • 16
2
votes
1 answer

SimpleDB vs Tokyo Cabinet

Has anybody compared SimpleDB and Tokyo Cabinet for performance and scalability? I'm coding my project against SimpleDB at the moment and considering benchmarking TC, be nice if somebody had already done it and could tell me whether it's worth…
Mark Rendle
  • 9,274
  • 1
  • 32
  • 58
2
votes
1 answer

What conditions cause Tokyo Cabinet to block

I'm using Tokyo Cabinet with the tc module in python. I store my data in the TDB format. I expected the table to block only for the duration of a write. Unfortunately, I see that when the file is open with in the "writer mode", other processes…
viraptor
  • 33,322
  • 10
  • 107
  • 191
2
votes
2 answers

How to start Tokyo tyrant server using ttservctl file

i successfully tokyo tyrant and tokyo cabinet now i have to start the tokyo tyrant server when i run the command ./ttservctl start instead of starting the server it is giving me error and the output is ritesh@ritesh-desktop:~/tokyotyrant-1.1.33$…
mathlearner
  • 7,509
  • 31
  • 126
  • 189
2
votes
2 answers

Kyoto Cabinet HashDB inserts are not O(1)

I am experimenting with Kyoto Cabinet HashDB. My database will grow up to the size of 110 TB. The keys are 20 Bytes and values are 128 KB. I am trying to insert about 500 million records. Here is the best performance I have gotten so far: Time is in…
Tarandeep Gill
  • 1,506
  • 18
  • 34
2
votes
1 answer

What are some techniques to push changes from tokyo cabinet in a multi-service setup?

Let's say I have N > 1 TCP-based, connection-oriented (read: not a website) services handling connections from end users in some load-balanced/sharing configuration. These users do things that cause updates to one or more keys in the centralized…
z8000
  • 3,715
  • 3
  • 29
  • 37
2
votes
1 answer

memory leaks in the lists tokyocabinet

Do I to use the function free() after the use: TCLIST *list = tcbdbrange(); or using enough : tclistdel(list); Do I to free(p) for: p = (lk_key*) tclistval(list,...) or tclistdel(list) delete all elemenst of list ?
Alexandre Kalendarev
  • 681
  • 2
  • 10
  • 24
2
votes
5 answers

Tokyo Cabinet and variable size C++ objects

I'm building a system, with C++, that uses Tokyo Cabinet (original API in C). The problem is I want to store a class such as: class Entity { public: string entityName; short type; vector x; …
Felipe Hummel
  • 4,674
  • 5
  • 32
  • 35
2
votes
2 answers

how to build one to many rows in tokyo cabinet?

i quote from the tokyo cabinet docs... As for database of hash table, each key must be unique within a database, so it is impossible to store two or more records with a key overlaps. or does tokyocabinet allow tuple based keys ? what would be…
bosky101
  • 2,244
  • 1
  • 18
  • 10
2
votes
2 answers

Does Tokyo Cabinet support in-memory B+ Tree implementation?

Does Tokyo Cabinet support in-memory B+ trees? If so, how do I use them? Because in some web articles (for example here and here), such usage is reported but I can't find any document describing how to do it. Thanks.
Arpssss
  • 3,850
  • 6
  • 36
  • 80