Reading dangerously large protocol message Caffe warning

Question

I am trying to fine tune the fully convolutional nets for my problem. I am getting the following warning. Why I am getting this warning?

     [libprotobuf WARNING google/protobuf/io/coded_stream.cc:505] Reading dangerously 
     large protocol message.  If the message turns out to be larger than 2147483647 bytes, 
     parsing will be halted for security reasons.  To increase the limit (or to disable 
     these warnings), see CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h.

I think you need not worry too much about it. You are getting that warning because your model proto might be close to `2147483647` bytes. — Autonomous, Jul 26 '16 at 23:10
ya, I get this all the time...never affects my nets. If it bothers you, change the source code before compiling. Although I'm sure the warning is there for some reason! — user1269942, Jul 29 '16 at 21:49

score 3 · Accepted Answer · answered Jul 27 '16 at 13:18

3

2147483647 is the max value that you can store in an integer data type in C++.

Caffe reads the .prototxt file into a buffer and then reads the parameters from the buffer. This buffer is defined internally to be of a maximum size of 2147483647 bytes. So if the .prototxt file is too large, it may not fit into this buffer. So Caffe gives this warning to increase the limit.

answered Jul 27 '16 at 13:18

malreddysid

1,342
1
9
12

Will it automatically resize after the warning? – user570593 Jul 27 '16 at 14:00
No. You have to do it. See CodedInputStream::SetTotalBytesLimit() in google/protobuf/io/coded_stream.h. – malreddysid Jul 27 '16 at 17:33

Reading dangerously large protocol message Caffe warning

1 Answers1