I have already held the 80G Berkeley DB file. I measure the average insert speed is 8ms for one record(32 byte key/100 byte value) without transaction.
Compare to insert to empty database with same interface, the average speed is 3~6 us.
Asked
Active
Viewed 423 times
0
-
Was there a question in there? – Blazemonger Nov 08 '12 at 03:27
-
I things it is too slow for key_value database. Is this performance normal value? I was wondering if there's something I missed that can improve my speeds? – xiaoningyb Nov 08 '12 at 07:58
1 Answers
0
If you insert data when your buffers are empty it can perform every well, once the buffers of your system are full, they cannot continue until some buffer space has been clearer. e.g. the time to write data to a HDD is typically 8 ms.
I would test busts of say one million records, after the system is quiet to see what the latency is like when the buffers are not full.
Peter Lawrey
- 525,659
- 79
- 751
- 1,130
-
Thanks Peter, I am sure the buffers is empty because i have test the speed at the beginning of starting. – xiaoningyb Nov 13 '12 at 10:10
-
In thank case, I suggest is parititoning the data. You shouldn't need to IMHO but it may be your only option. – Peter Lawrey Nov 13 '12 at 10:14