3

I have been trying to figure out how to compute the object similarity (OKS) in Detectron2, In my custom dataset I have 4 keypoints per image, I'd like during training to improve the Object Keypoint Similarity's score properly, therefore I need to initial the simgas values (cfg.TEST.KEYPOINT_OKS_SIGMAS ) with a list of values (Each simga for each keypoint). I have read thoroughly the Object Keypoint Similarity, BUT unfortunately it's still unclear for me how to find those values:

For each keypoint type i we measured the per-keypoint standard deviation σi with respect to object scale s. That is we compute σi^2=E[di^2/s^2].

  • s we define as the square root of the object segment area
  • di are the Euclidean distances between each corresponding ground truth and detected keypoint

How can we calculate a head of time the Sigmas (Standard deviation) values if the Expected value depends on the Euclidean distances between each corresponding ground truth and detected keypoint, which has not been calculated yet?

Can someone PLEASE give a simple example so it will be a more clear, Thank you.

JammingThebBits
  • 732
  • 11
  • 31

1 Answers1

0

refer this https://github.com/facebookresearch/detectron2/issues/3192

"From what I know, to make OKS, we need to make our own keypoints on the same image multiple times (make redundant annotations). Pick one as your base, then calculate the euclidean distance and its deviation. This then would be used as sigmas." - darwinharianto

Abhay Karade
  • 1
  • 1