I am using the VGG16 model on spectrograms without any pre-training. I am currently doing KFold validation but while in one the accuracy reaches 99%, in another one it stays at 53%.
Can anyone help me with it? Why and how to solve it?
On the fold where the validation accuracy remains at 53%, training accuracy and training loss stays the same too throughout the process.