Questions tagged [pose-estimation]

The specific task of determining the position and orientation of an object in an image relative to the camera coordinates is called Pose Estimation.

The pose of a camera is also known as the camera Extrinsic Parameters. It is a 3x4 matrix where the first 3 columns are the rotation (orientation) and the las column is the translation (position).

Camera Pose matrix. Rotation and Translation

291 questions
6
votes
1 answer

How to make mediapipe pose estimation faster (python)

I'm making a pose estimation script for my game. However, it's working at 20-30 fps and not using the whole CPU even if there is no fps limit. It's not using whole GPU too. Can someone help me? Here is resource usage while playing a dance video:…
6
votes
0 answers

Mismatch between OpenCV projected points and Unity camera view

We are working on an AR application in which we need to overlay a 3D model of an object on a video stream of the object. A Unity scene contains the 3D model and a camera is filming the 3D object. The camera pose is initially unknown. ▶ What we have…
6
votes
1 answer

OpenCV rotation (Rodrigues) and translation vectors for positioning 3D object in Unity3D

I'm using "OpenCV for Unity3d" asset (it's the same OpenCV package for Java but translated to C# for Unity3d) in order to create an Augmented Reality application for my MSc Thesis (Computer Science). So far, I'm able to detect an object from video…
6
votes
2 answers

Reverse of OpenCV projectPoints

I have a camera facing the equivalent of a chessboard. I know the world 3d location of the points as well as the 2d location of the corresponding projected points on the camera image. All the world points belong to the same plane. I use…
gregoiregentil
  • 1,793
  • 1
  • 26
  • 56
6
votes
1 answer

solvePnP returns wrong result

I'm using the function solvePnP to estimate the pose of my robot by visual markers. Some times I get wrong results in two consecutives frames. In the file problem.cpp you can see one of these results. The points sets correspond to the same marker in…
5
votes
1 answer

How to prepare a custom keypoints dataset for WongKinYiu/Yolov7 Pose Estimation?

How do I prepare a custom keypoints dataset for WongKinYiu/yolov7?
C.Tale
  • 263
  • 2
  • 13
5
votes
1 answer

Calculating the distance and yaw between ArUco marker and camera?

I am trying to calculate the exact( 3 cm error rate is acceptable ) distance between aruco marker and camera. I use python, opencv and aruco. I can detect them ( marker side is 0.023 meters which is 2.3 cm ) but I can't interpret the distance…
aliyasineser
  • 186
  • 3
  • 15
5
votes
4 answers

Epipolar geometry pose estimation: Epipolar lines look good but wrong pose

I am trying to use OpenCV to estimate one pose of a camera relative to another, using SIFT feature tracking, FLANN matching and subsequent calculations of the fundamental and essential matrix. After decomposing the essential matrix, I check for…
4
votes
2 answers

How to improve Aruco Marker Pose Estimation?

I'm having a hard time estimating the positions of the Aruco markers with the camera. In my tests with the DICT_6X6_250 dictionary and the board with 4 markers of 20x20 cm on it, I measured at 6 meters with an error of 20-30 cm. I need more precise…
bariskplgz
  • 43
  • 1
  • 5
4
votes
1 answer

How to calculate object keypoint similarity

I am trying to compute Object Keypoint similarity to evaluate the keypoint detection of an algorithm. below is code I've written based on what I've found and understood from here def oks(gt, preds, threshold, v, gt_area): ious =…
4
votes
1 answer

How to deal with different image size

I am working on image to find outer body points but when I save them they have different size and which is creating problem. My original image is of a person. (1.8Mb) I create a mask of the person to detect the outer body parts from the original…
008karan
  • 411
  • 1
  • 3
  • 8
4
votes
1 answer

Uncertainty on pose estimate when minimizing measurement errors

Let's say I want to estimate the camera pose for a given image I and I have a set of measurements (e.g. 2D points ui and their associated 3D coordinates Pi) for which I want to minimize the error (e.g. the sum of squared reprojection errors). My…
BConic
  • 8,750
  • 2
  • 29
  • 55
4
votes
2 answers

Camera pose estimation

I am trying to write a program from scratch that can estimate the pose of a camera. I am open to any programming language and using inbuilt functions/methods for feature detection... I have been exploring different ways of estimating pose like SLAM,…
Rohit H.S.
  • 65
  • 1
  • 6
4
votes
2 answers

Confusion about methods of pose estimation

I'm trying to do pose estimation (actually [Edit: 3DOF] rotation is all I need) from a planar marker with 4 corners = 4 coplanar points. Up until today I was under the impression from everything I read that you will always compute a homography (e.g.…
Garp
  • 89
  • 6
3
votes
1 answer

How to remove face mesh from holistic mediapipe to get better performance

I'm working on holistic mediapipe model (javascript API), it utilizes the pose, face and hand landmark models in MediaPipe Pose, MediaPipe Face Mesh and MediaPipe Hands respectively to generate a total of 543 landmarks (33 pose landmarks, 468 face…
Ayoub Benayache
  • 1,046
  • 12
  • 28
1
2
3
19 20