Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Capability to Align Color Frame with Depth Frame. #217

Closed
Luxonis-Brandon opened this issue Oct 2, 2020 · 2 comments
Closed

Capability to Align Color Frame with Depth Frame. #217

Luxonis-Brandon opened this issue Oct 2, 2020 · 2 comments
Labels
enhancement New feature or request

Comments

@Luxonis-Brandon
Copy link
Contributor

Start with the why:

In cases where absolute alignment (or as close to it as possible) is required between the neural inference results and the depth results and the neural inference must be run on the color camera, it is desirable to be able to align the color frame and the depth frame (which is aligned with the RIGHT grayscale cameras) through the color and grayscale camera intrinsics.

Move to the how:

This capability will require the calibration of the color camera intrinsics and extrinsics to the grayscale (right camera), either at the factory, or by the user interested in the feature and the implementation of the distortion and translation using the WARP blocks and additional logic in DepthaI.

Move to the what:

Allow registration of the color and depth frames.

@Luxonis-Brandon
Copy link
Contributor Author

Luxonis-Brandon commented Dec 2, 2020

We have the initial version of this calibration working:
image (11)
image (10)

Note that Deeplabv3+ was run so the pixel-matching could be checked in multiple locations.

@Luxonis-Brandon
Copy link
Contributor Author

Accidentally had mad this a duplicate issue. Will close this and move to: #284

jdavidberger pushed a commit to constructiverealities/depthai that referenced this issue May 26, 2022
Fix still image output in RGB postprocessing
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant