Video Frame Interpolation Summary 2024
Summary2023
2024-01-11：新增结合ffmpeg的视频推理代码basic_infer
如有其他想测试模型或视频，可以在issue中联系
2024-01-11：新增结合推理演示视频(1080P) https://space.bilibili.com/350913028
1.https://paperswithcode.com/sota/video-frame-interpolation-on-ucf101-1
2.https://paperswithcode.com/sota/video-frame-interpolation-on-vimeo90k
3.https://paperswithcode.com/sota/video-frame-interpolation-on-x4k1000fps
4.https://github.com/AIVFI/Video-Frame-Interpolation-Rankings-and-Video-Deblurring-Rankings
5.https://sniklaus.com/vfibench(Benchmarking Video Frame Interpolation)
数据集：Vimeo90K:
| index | method | paper | code | PSNR | SSIM | Algorithm | Traindata | Arbitrary |
|---|---|---|---|---|---|---|---|---|
| 1 | MA-VFI(Arxiv 2402) | paper | code | 35.96 | 0.980 | Motion-Aware | Vimeo90K | True |
| 2 | VIDIM (Arxiv 2404) | paper | code | - | - | generate video | mixture: WebVid + . | True |
| 3 | LADDER(Arxiv 2404) | paper | code | 36.65 | 0.981 | 光流,更高效 | Vimeo90K | False/结构可改 |
| 4 | SGM-VFI(Arxiv 2404) | paper | code | - | - | large motion | Vimeo90K/X4K1000FPS | False/结构可改 |
| 5 | MADIFF(Arxiv 2404) | paper | code | - | - | a novel diffusion framework | Vimeo90K | - |
| 6 | PerVFI(Arxiv 2404) | paper | code | - | - | 降低模糊和伪影 | Vimeo90K | - |
| 7 | ConsecutiveBrownianBridge(Arxiv 2405) | paper | code | - | - | Brownian Bridge | Vimeo90K | True |
| 8 | ToonCrafter(Arxiv 2405) | paper | code | - | - | 动漫插帧 | - | True |
| 9 | ZeroSmooth(Arxiv 2406) | paper | code | - | - | Training-free Diffuser | - | True |
| 10 | Swin-VFI(Arxiv 2406) | paper | code | 38.04 | 0.981 | Swin-Transverter的多阶段多尺度网络 | Vimeo90K | False |
| 11 | LAVIB(Arxiv 2406) | paper | code | - | - | 提出一个新的数据集 | - | - |
| 12 | MoMo(Arxiv 2406) | paper | code | - | - | 解脱运动建模MoMo一种基于扩散的VFI方法 | Vimeo90K | - |
| 13 | VFI-SwinT(Arxiv 2406) | paper | code | - | - | 基于Swin-Transformer | Vimeo90K | - |
| 14 | VFIMamba(Arxiv 2407) | paper | code | 36.64 | 0.9819 | 基于Mamba | Vimeo90K | - |
| 15 | GIMM-VFI(Arxiv 2407) | paper | code | - | - | 可泛化隐式运动建模（GIMM） | Vimeo90K | True |
| 16 | 360VFI(Arxiv 2407) | paper | code | - | - | 全景图插帧 | 新数据集360VFI | - |
| 17 | ViBiDSampler(Arxiv 2410) | paper | code | - | - | 首尾帧扩散插帧 | Pexels dataset | - |
| 18 | HIFI(Arxiv 2410) | paper | code | - | - | 高分辨(8K)率,扩散，插帧 | 30 M videos with 40 frames dataset | - |
| 17 | Framer(Arxiv 2410) | paper | code | - | - | 交互式帧插值 | OpenVidHD-0.4M datas | - |
UCF101: Download UCF101 dataset
Vimeo90K: Download Vimeo90K dataset
MiddleBury: Download MiddleBury OTHER dataset
HD: Download HD dataset
感谢各位大佬的开源，希望大佬们论文多多，工作顺利。如有侵犯权益，可联系我进行修改和删除。