0

What is the difference between Base Learning rate in Nvidia Digits UI during training and Learning rate param(lr_pm) for each layer defined in the caffe .prototxt file. Finally which learning rate is used?

chandan v
  • 11
  • 2
  • 2
    it's the product of the two – Shai Mar 20 '18 at 07:21
  • you mean `lr_multi` or `lrn_param` or both ? – Milind Deore Mar 20 '18 at 07:49
  • [`lrn_param`](https://github.com/BVLC/caffe/blob/master/src/caffe/proto/caffe.proto#L401) has nothing to do with learning rate: it stores paramters for [`"LRN"`](http://caffe.help/manual/layers/lrn.html) layer. – Shai Mar 20 '18 at 11:23

1 Answers1

0

The learning rate for a particular layer is the global learning rate multiplied with the lr_mult of that specific layer.

shubhamgoel27
  • 1,391
  • 10
  • 17