Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Napari plugin reader for videos #49

Open
Tracked by #50
niksirbi opened this issue Sep 20, 2023 · 3 comments
Open
Tracked by #50

Napari plugin reader for videos #49

niksirbi opened this issue Sep 20, 2023 · 3 comments
Assignees
Labels
enhancement New optional feature GUI Graphical User Interface

Comments

@niksirbi
Copy link
Member

niksirbi commented Sep 20, 2023

We would like to have the ability to load single frames from a video (minimally just loading an image) into napari as an Image layer.
The development of this feature will be facilitated by #38 and it will in turn facilitate #50.

@niksirbi niksirbi added GUI Graphical User Interface enhancement New optional feature labels Sep 20, 2023
@niksirbi niksirbi self-assigned this Sep 20, 2023
@niksirbi niksirbi added this to the v0.1 - alpha release milestone Oct 16, 2023
@niksirbi
Copy link
Member Author

Simple image frames can be just drag-and-dropped into napari and they will automatically open as images. What we want instead is a way to load videos. This is possible via the napari-video plugin, which is essentially a reader plugin for videos.

That said, it would be useful to add a visible place on the movement widget to load the video together with the predicted poses.

@sfmig sfmig removed this from the v0.1 - alpha release milestone Aug 27, 2024
@sfmig sfmig changed the title Napari plugin reader for video frames Napari plugin reader for videos Aug 27, 2024
@sfmig
Copy link
Contributor

sfmig commented Aug 27, 2024

When implementing this, check resources linked in #105

@niksirbi
Copy link
Member Author

niksirbi commented Oct 10, 2024

While working on #253, I ran into issues with napari-video /videoreader, see postpop/videoreader#6

OpenCV also seems to lead to inaccurate seeking (which will be important for labelling), see janclemenslab/napari-video#3

Given the above, might be worth checking out the newer napari-pyav plugin, which uses av as a backend, instead of opencv.

Another alternative would be relying on sleap-io to handle the video-loading, which currently uses an ffmpeg backend (via imageio-ffmpeg. The advantange is that we already depened on sleap-io so no new dependencies need be added. But in that case we would have to write our own napari plugin reader for videos - sth similar to napari-video and napari-pyav but using sleap-io.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New optional feature GUI Graphical User Interface
Projects
Status: 🤔 Triage
Development

No branches or pull requests

2 participants