I am using EfficientNetB0 for custom training . I get the following output
In order to debug I tried the same data for train and test and get the following error
This is not happening with other networks like Xception and Inception. What can be the reason ? PS I have displayed only 4 epoch cases but have actually tried out up to 30 and the same problem. I am pasting a picture of the predictions also. They are the same in each row