Stack Overflow
Stack Overflow

Questions tagged [lmdb]

It is the mmap’d database for OpenLDAP aka Lightning MDB (LMDB).

It is the mmap’d database for OpenLDAP aka Lightning MDB (LMDB).

254 questions
0
votes
0 answers

How to re-open LMDB after some iteration?

I have dataset contain 71,000 images with 500MB size, and I'm trying to put it in LMDB for Caffe framework. I've used this code : with lmdb.open(train_lmdb, map_size=int(1e12)) as env: with env.begin(write=True) as in_txn: for in_idx,…
malloc
  • 604
  • 10
  • 18
0
votes
0 answers

Oppening LMDB data FCN32 Semantic Segmentation

I'm new with Caffe and all the ML stuff but I've been working with LeNet using LMDB files without any problem. Now, making a small test over my new Net (FCN32 semantic segmentation) it seems that always get stuck forever trying to open the file. I…
byaeggy
  • 1
0
votes
1 answer

convert imageset.bin is missing

I build caffe on windows.it ended succesfuly. Now in my caffe/build/tools there is no convert imagetset.bin. Where can I find or build(I already build caffe on windows with opencv installed and etc.) convert imageset.bin? This is my…
adel jafary
  • 1
  • 1
0
votes
1 answer

Can one store different size records in LMDB or do they need to be in the exact same size?

I like to record my images in different sizes in LMDB dataset. Is it viable to store these images without resizing into certain size? If it is, then do I lose any space by the gap of the largest possible record in LMDB? So for instance, if the…
erogol
  • 13,156
  • 33
  • 101
  • 155
0
votes
1 answer

How to compress numpy arrays before inserting into LMDB dataset?

I have size of [82,3,780,1024] tensors - merge of 82 different image frames - in uint8 format. LMDB goes wild in terms of size, once i start to insert these. Is there any way to compress these tensors before inserting? For inserting I follow the…
erogol
  • 13,156
  • 33
  • 101
  • 155
0
votes
2 answers

What is the best way to compress my data in lmdb

I have a large dataset which makes my lmdb huge. For 16.000 samples my database is already 20 GB. But in total I have 800.000 images which would end up in a huge amount of data. Is there any way to compress an lmdb? Or is it better to use HDF5…
user4911648
0
votes
1 answer

How to generate coorectlly lmdb files from own dataset using caffe ?

I'm trying to to generate lmdbs to train my CNN using Caffe. I've used as data set Stanford Dogs Dataset.After downloading the data set , I prepared the training data set et test data set.I have saved the configuration into the files train.txt and…
user7417788
  • 35
  • 1
  • 6
0
votes
1 answer

AttributeError: 'module' object has no attribute 'Environment'

I am trying convert jpeg files to 'lmdb' format. But I got this error: >>> import lmdb Traceback (most recent call last): File "", line 1, in File "lmdb.py", line 25, in write_images_to_lmdb('/home/anaca/ferjpg' ,…
user1234
  • 145
  • 5
  • 20
0
votes
0 answers

Caffe, shuffle train.txt before creating LMDB

Unfortunately, I can't use --shuffle while creating LMDB. So, I was advised to shuffle train.txt before creating LMDB. After shuffling train.txt looks like this n07747607/n07747607_28410.JPEG 950 n02111277/n02111277_55668.JPEG…
Aleksander Monk
  • 2,787
  • 2
  • 18
  • 31
0
votes
1 answer

caffe convert_imageset pending

When I convert ImageNet dataset to lmdb, convert_imageset will suspend and no longer process image data.Can you tell me how to solve this problem? I have tried it many time.I checked the log. Every time the number of images that was processed is…
Tyan
  • 1
0
votes
0 answers

Caffe Stucking in infinite loop of blocking queue while using LMDB in windows cpp?

I am trying to train and test the simple network for segmentation. I have created the LMDB file using windows cpp. But while doing training in windows cpp it get stuck in boost::shared_ptr >…
AnkitSahu
  • 421
  • 4
  • 12
0
votes
1 answer

LMDB using extra space when overwriting entries

In LMDB, if you overwrite a previous entry in the same transaction, it seems that the previous entry's space is not released until the data is committed. In my application, I encountered a case where LMDB ran out of space because a particular entry…
user1428945
  • 339
  • 1
  • 13
0
votes
2 answers

lmdb: Can I access different named databases in the same transaction?

I want to write a lot of data to a lmdb data base with several named (sub) data bases. I run into the following problem: To write to one named data base, I need to open a transaction for this named data base. This implies: To write to another…
Yaakov Belch
  • 4,692
  • 33
  • 39
0
votes
1 answer

Do I have to transpose my gray scale image while creating LMDB database?

I am converting a set of images and a set of ground truth images to LMDB database. The purpose is pixel-wise prediction. Most of the codes for creating LMDB from RGB images has a line indicating transpose in CxHxW order, as follows: im =…
S.EB
  • 1,966
  • 4
  • 29
  • 54
0
votes
1 answer

NVIDIA DIGITS - Multiple Input layers

i have a question regarding NVIDIA DIGITS Framework. So i have been using caffe without DIGITS and have used HDF5 Layers so far. There i could use multiple "top" (data_0, data_1, data_2) inputs (see code below). So i could feed the net with more…
Biba
  • 1,595
  • 1
  • 12
  • 17
1 2 3
…
16 17