I have an image binary classification problem, with only 15% of the data from class 1, and 85% of it is from class 0.
I decided to work with focal loss to deal with the unbalanced dataset and noticed something. When I use a fairly simple cnn, I see the focal loss working, managing to classify more than just one class (with accuracy more than 85%).
The thing is, when I switch the cnn to be a 50 layer resnet, it doesn't work. It classifies every photo with class 0, keeping the accuracy locked at 85% with AUC of 0.5. Why is this happening? The images are 180x180x3.
Thanks.