Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 3D Coordinate Information to Object Tracker When Depth Is Enabled #213

Closed
Luxonis-Brandon opened this issue Oct 2, 2020 · 3 comments
Assignees
Labels
enhancement New feature or request

Comments

@Luxonis-Brandon
Copy link
Contributor

Start with the why:

Our object tracker now currently returns the 2D bounding box of the tracked object. The metadata of the neural network returns the 2D bounding box, and also the 3D position (in x,y,z, in meters). So it is possible to get the 3D position of a tracked object, but it requires some additional (and mostly unnecessary) intersection-over-union (IOU) work on the host to do the association.

Move to the how:

Calculate the depth of the tracked object on DepthAI return the 3D position of the tracked object when depth is enabled (i.e. when -dd is not given), just like we do now for detected objects (by the neural network).

Move to the what:

Provided 3D XYZ position (in meters) of tracked objects when the object tracker stream is enabled and when depth is enabled (i.e. when -dd is not used).

@Luxonis-Brandon
Copy link
Contributor Author

Since Gen2 does not have an object localization capability yet (i.e. object detection with 3D XYZ information), and does not yet have an object tracker, we will need to implement this node/capability first, and then pair with object tracker.

@Luxonis-Brandon
Copy link
Contributor Author

This is now initially implemented:
C++: luxonis/depthai-core#92
Python: luxonis/depthai-python#173

@Luxonis-Brandon
Copy link
Contributor Author

jdavidberger pushed a commit to constructiverealities/depthai that referenced this issue May 26, 2022
Add option to pick spatial calculation algorithm : average,min,max of…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants