At first, i want to binary classify "Fire" event in 5000 images. Secondly, if fire is available in images, then classify further either its urban area(buildings) or rural (As forest). I am using Transfer learning with different models including VGG16 and fine-tune few of its last layers.
I have already tried by training and testing both classification steps separately, but it creates lot of penalty, if i identify that image has fire in rural area but image does not include fire.
I want transfer learning model to binary classify and produce results of both steps as:
img1 fire rural/urban 1 No-fire No-rural/no-urban 2 Fire urban 3 Fire rural
so can i retrain vgg16 in a way to it provides both level of classification i-e step one (fire/no-fire) and step two (rural/urban)