how to load reference .caffemodel for training

Question

I'm using alexnet to train my own dataset. The example code in caffe comes with

bvlc_reference_caffenet.caffemodel
solver.prototxt
train_val.prototxt
deploy.prototxt

When I train with the following command:

./build/tools/caffe train --solver=models/bvlc_reference_caffenet/solver.prototxt

I'd like to start with weights given in bvlc_reference.caffenet.caffemodel.

My questions are

How do I do that?
Is it a good idea to start from the those weights? Would this converge faster? Would this be bad if my data are vastly different from the Imagenet dataset?

score 1 · Accepted Answer · edited May 23 '17 at 12:34

1

1.
In order to use existing .caffemodel weights for fine-tuning, you need to use --weights command line argument:

./build/tools/caffe train --solver=models/bvlc_reference_caffenet/solver.prototxt --weights=models/bvlc_reference_caffenet/bvlc_reference_caffenet.caffemodel

2.
In most cases fine-tuning a net is quite a recommended practice, even when the input images are quite different than "imagenet" photos.
However, you should note that when training for the original weights you are about to use, some (very reasonable) assumptions were made. You should decide whether these assumptions are still true for your task.
For instance, most nets were trained with simple data augmentation using an image and its horizontal flip. However, if your task is to distinguish between images that are flipped you will find it very difficult to fine tune.

edited May 23 '17 at 12:34

Community

1
1

answered May 03 '17 at 05:27

Shai

111,146
38
238
371

Thank you. I do have one more question: the last fully connected layer of my network outputs 50 instead of 1000. Is there any way I can copy the rest and not the final layer? – MoneyBall May 03 '17 at 05:34
1

if you give your last layer a different `name` than caffe will not copy its weights. – Shai May 03 '17 at 05:48
Awesome! Thank you so much! – MoneyBall May 03 '17 at 05:49
by the way, when you said images that are flipped, do you mean flipped vertically? – MoneyBall May 03 '17 at 05:50
@MoneyBall flipped = mirrored along the y-axis. – Shai May 03 '17 at 05:58

how to load reference .caffemodel for training

1 Answers1

Linked