size limit on Jena/TDB archives

Asked Jun 18 '13 at 14:15

Active Jun 18 '13 at 17:17

Viewed 192 times

We are working in a big project (with a lot of metadata) using Jena TDB. About a month ago a problem regarding memory appeared suddenly—the program has been working properly for months and no changes were done—and we are not able to upload any more data.

We’ve been working in this issue for several weeks, and we think that the problem is caused because of the size of some of our .dat files are larger than 16Gb. We’ve read that the index system used for TDB employs 64 bits for each index: 8 bits for the type + 44 bits for disk allocation + 12 bits for vnode. With 44 bits we can manage 16GB, and we think here is where the memory problem appears.

Could you please tell us if we are correct? If so, can you please tell us about the best solution?

edited Jun 18 '13 at 17:17

RobV

28,022
11
77
119

asked Jun 18 '13 at 14:15

Paco

Could you provide some details about the machine you are using? OS, architecture (32 or 64 bit), file system etc. – user205512 Jun 18 '13 at 14:47
Which version of the software? – AndyS Jun 18 '13 at 15:32
The index id (for the released version) is 56 bits address range per file. – AndyS Jun 18 '13 at 15:40
Duplicated at http://answers.semanticweb.com/questions/23413/is-there-a-limit-of-size-for-jenatdb-archives – RobV Jun 18 '13 at 17:31
I use Debian with 64bit architecture, the file system is ext4. The tdb version is 0.8.8. – Paco Jun 26 '13 at 10:26

size limit on Jena/TDB archives

0 Answers0