Questions tagged [semantic-segmentation]

Semantic segmentation is the task of classifying every pixel in the image to a category or class label.

Semantic segmentation is the task of classifying every pixel in the image to a category. It refers to the process of linking each pixel in an image to a class label. Some of its primary applications are in autonomous vehicles, human-computer interaction & robotics.

532 questions
4
votes
1 answer

Medical Image Segmentation if the entire ground truth is black

I am new to deep learning. I am working on a CT-scan medical images. I want to use UNet architecture to predict the image segmentation. I have successfully implemented the UNet, however, my prediction is completely black. I think it is because there…
4
votes
1 answer

Which F1-score is used for the semantic segmentation tasks?

I read some papers about state-of-the-art semantic segmentation models and in all of them, authors use for comparison F1-score metric, but they did not write whether they use the "micro" or "macro" version of it. Does anyone know which F1-score is…
Panicum
  • 794
  • 1
  • 9
  • 32
4
votes
2 answers

Not able to read Sagemaker Semantic Segmentation Model Batch Transformation Output file

Currently I have deployed a Semantic Segmentation model and an endpoint with which I am able to invoke and get inferences. Now, I am getting inferences for each image at a time. Now I want to try batch of images at a time using Batch Transform job.…
min2bro
  • 4,509
  • 5
  • 29
  • 55
4
votes
3 answers

Constructing Unet with pretrained Resnet34 encoder with Keras

I am a beginner in image segmentation. I was trying to create an Unet model with pretrained Resnet34 (imagenet) as encoder. And as for comparison, I have used the segmentation models API to get the same model. However, my model is not doing as good…
4
votes
1 answer

How calculate the dice coefficient for multi-class segmentation task using Python?

I am wondering how can I calculate the dice coefficient for multi-class segmentation. Here is the script that would calculate the dice coefficient for the binary segmentation task. How can I loop over each class and calculate the dice for each…
AI_NA
  • 336
  • 2
  • 5
  • 20
4
votes
3 answers

Highlight areas with different colour image with the area that surround them

I've just started with Computer Vision and also with OpenCV. I'm working with MRI brain images and I wondering if there is a filter or something that let me segment the areas that I have marked with red on this image: This is the original…
VansFannel
  • 45,055
  • 107
  • 359
  • 626
4
votes
0 answers

What is the difference between using backbone architecture and transfer learning?

hi im super new to this field(deep learning, computer vision) so this question may sound dumb. In this link (https://github.com/GeorgeSeif/Semantic-Segmentation-Suite), there are pre-trained models (eg, ResNet101) called front end models. And they…
4
votes
1 answer

How should image preprocessing and data augmentation be for semantic segmentation?

I have an imbalanced and small dataset which contains 4116 224x224x3 (RGB) aerial images. It's very likely that I will encounter the overfitting problem since the dataset is not big enough. Image preprocessing and data augmentation help to tackle…
saki
  • 117
  • 3
  • 8
4
votes
0 answers

Is there a way to make keras ignore a label when computing binary_crossentropy loss?

I'm writing a custom loss function for a (sort of) semantic segmentation task where I compute binary crossentropy (using keras backend) for the target (2-d array) and predictions. The overall loss is a sum of 4 different loss functions. In two of…
4
votes
1 answer

How to resize segmentation mask obtained from Deeplab v3?

Deeplab v3 returns a reduced/resized image and its corresponding mask. How can I resize the image as well its corresponding mask to better fit to my specification.
4
votes
2 answers

Channel wise CrossEntropyLoss for image segmentation in pytorch

I am doing an image segmentation task. There are 7 classes in total so the final outout is a tensor like [batch, 7, height, width] which is a softmax output. Now intuitively I wanted to use CrossEntropy loss but the pytorch implementation doesn't…
3
votes
1 answer

How to overlay segmentation result with another image?

This is my input image I have this code to overlay the segmentation from input image with color # sample execution (requires torchvision) from PIL import Image from torchvision import transforms input_image = Image.open("samping.JPG") input_image =…
3
votes
0 answers

Unexpected result of `train_function` (Empty logs). Please use `Model.compile(..., run_eagerly=True)

when i run model.fit i get the following error : Unexpected result of train_function (Empty logs). Please use Model.compile(..., run_eagerly=True), or tf.config.run_functions_eagerly(True) for more information of where went wrong, or file a…
3
votes
1 answer

Is it right to do inference different patch size than training patch size with segmentation?

I'm training a satellite model with high-resolution images(Higher than 8GB). I generate smaller patches to handle the huge images. Is it right to do inference with a different patch size than training patch size? exp: Training patch size is…
3
votes
2 answers

Pytorch semantic segmentation loss function

I’m new to segmentation model. I would like to use the deeplabv3_resnet50 model. My image has shape (256, 256, 3) and my label has shape (256, 256). Each pixel in my label has a class value(0-4). And the batch size set in the DataLoader is…
1 2
3
35 36