Skip to content

This is a collective repository for all 3DGS related progresses in research and industry world

License

Notifications You must be signed in to change notification settings

yangjiheng/3DGS_and_Beyond_Docs

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

46 Commits
 
 
 
 
 
 

Repository files navigation

3DGS and Beyond Docs

This is a collection of documents and topics NeRF/3DGS & Beyond channel accumulated, as well as papers in literaure. Since there are lots of papers out there, so we split them into two seperate repositories: NeRF and Beyond Docs and 3DGS and Beyond Docs. Please choose accordingly recarding to your preference.

Some papers we discussed in the group, will be added to the back of the paper with a Notes link. You can follow the link to check whether there is topic you are interested in. If not, welcome to join us and ask the question to the crowd. The mighty community might have your answers.

We are actively maintaining this page trying to stay up-to-date and gather important works in a daily basis. We would also like to put as many notes as possible to some works, trying to make it easier to catch up.

Please feel free to join us on WeChat group or start a discussion topic here.

NeRF/3DGS Book

I have recently published a book with PHEI(Publishing House of Electronics Industry) on NeRF/3DGS. This would not have been possible without the help of the whole 3D vision community. It is now available on jd.com (Checkout here) and it should be suitable as a reference handbook for NeRF/3DGS beginners or engineers in related areas. I sincerely hope the book can be helpful in any perspective.

For those of you who have already purchased the book, all references can be downloaded HERE. If you experience any issue reading the book or have any suggestions to improve it, please contact me through my email address: jiheng.yang@gmail.com, or directly concact me on WeChat: jiheng_yang. I'm looking forward to talk to anyone reaching out to me, thanks in advance.

How to join us

For now, you can join us in the following ways

  • Bilibili Channel where we post near daily updates (primarily) on NeRF.
  • WeChat group, due to the limitation of WeChat group, you can add my personal account: jiheng_yang, and I will add you to the chat groups.
  • If you want to view this from a timeline perspective, please refer to this ProcessOn Diagram
  • If you think something is not correct or you think we could do better in some way, please write to us through all possible channels or drop an issue. All suggestions are appreciated!
  • For other discussed techniques that's related to 3D reconstruction and NeRF, please refer to link, we are constantly trying to add more resource to this document.

NeRF Progresses

For NeRF related progress, you can refer to NeRF and Beyond Docs

Table of Content

3DGS Original Paper

3D Gaussian Splatting for Real-Time Radiance Field Rendering
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis
ACM ToG 2023, 8 August, 2023
[arXiv] [Project] [Github]

3DGS Surveys

A Survey on 3D Gaussian Splatting
Guikun Chen, Wenguan Wang
arXiv preprint, 8 Jan 2024
[arXiv]

3D Gaussian as a New Vision Era: A Survey
Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He
arXiv preprint, 11 Feb 2024
[arXiv]

🔥Recent Advances in 3D Gaussian Splatting
Tong Wu, Yu-Jie Yuan, Ling-Xiao Zhang, Jie Yang, Yan-Pei Cao, Ling-Qi Yan, Lin Gao
arXiv preprint, 17 Mar 2024
[arXiv]

Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review
Anurag Dalal, Daniel Hagen, Kjell G. Robbersmyr, Kristian Muri Knausgård
arXiv preprint, 6 May 2024
[arXiv]

Survey on Fundamental Deep Learning 3D Reconstruction Techniques
Yonge Bai, LikHang Wong, TszYin Twan
arXiv preprint, 11 Jul 2024
[arXiv]

3D Gaussian Splatting: Survey, Technologies, Challenges, and Opportunities
Yanqi Bao, Tianyu Ding, Jing Huo, Yaoli Liu, Yuxin Li, Wenbin Li, Yang Gao, Jiebo Luo
arXiv preprint, 24 Jul 2024
[arXiv]

3D Representation Methods: A Survey
Zhengren Wang
arXiv preprint, 9 Oct 2024
[arXiv]

3DGS Frameworks

🔥GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond
Chongjie Ye, Yinyu Nie, Jiahao Chang, Yuantao Chen, Yihao Zhi, Xiaoguang Han
arXiv preprint, 28 Mar 2024
[arXiv] [Code]

gsplat: An Open-Source Library for Gaussian Splatting
Vickie Ye, Ruilong Li, Justin Kerr, Matias Turkulainen, Brent Yi, Zhuoyang Pan, Otto Seiskari, Jianbo Ye, Jeffrey Hu, Matthew Tancik, Angjoo Kanazawa
arXiv preprint, 10 Sep 2024
[arXiv]

SuperSplat - 3D Gaussian Splat Editor
PlayCanvas
[Code]

3DGS Profiling

NerfBaselines: Consistent and Reproducible Evaluation of Novel View Synthesis Methods
Jonas Kulhanek, Torsten Sattler
arXiv preprint, 25 Jun 2024
[arXiv] [Project]

3DGS Distributed Training

On Scaling Up 3D Gaussian Splatting Training Hexu Zhao, Haoyang Weng, Daohan Lu, Ang Li, Jinyang Li, Aurojit Panda, Saining Xie
arXiv preprint, 26 Jun 2024
[arXiv] [Project] [Code]

3DGS Quality Enhancement

🔥Mip-Splatting: Alias-free 3D Gaussian Splatting
Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering
Zhiwen Yan, Weng Fei Low, Yu Chen, Gim Hee Lee
arXiv preprint, 28 Nov 2023
[arXiv] [Project] [Code] [Video]

🔥Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering
Tao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli, Limin Wang, Dahua Lin, Bo Dai
arXiv preprint, 30 Nov 2023
[arXiv] [Project]

Gaussian Splitting Algorithm with Color and Opacity Depended on Viewing Direction
Dawid Malarz, Weronika Smolak, Jacek Tabor, Sławomir Tadeja, Przemysław Spurek
arXiv preprint, 21 Dec 2023
[arXiv]

TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering
Linus Franke, Darius Rückert, Laura Fink, Marc Stamminger
Eurographics 2024, 11 Jan 2024
[arXiv] [Project] [Code] [Video]

Optimal Projection for 3D Gaussian Splatting
Letian Huang, Jiayang Bai, Jie Guo, Yanwen Guo
arXiv preprint, 1 Feb 2024
[arXiv]

FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization
Jiahui Zhang, Fangneng Zhan, Muyu Xu, Shijian Lu, Eric Xing
CVPR 2024, 11 Mar 2024
[arXiv] [Project]

🔥Analytic-Splatting: Anti-Aliased 3D Gaussian Splatting via Analytic Integration
Zhihao Liang, Qi Zhang, Wenbo Hu, Ying Feng, Lei Zhu, Kui Jia
arXiv preprint, 16 Mar 2024
[arXiv] [Project] [Code]

Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splatting
Zheng Zhang, Wenbo Hu, Yixing Lao, Tong He, Hengshuang Zhao
arXiv preprint, 22 Mar 2024
[arXiv]

🔥SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasing
Xiaowei Song, Jv Zheng, Shiran Yuan, Huan-ang Gao, Jingwei Zhao, Xiang He, Weihao Gu, Hao Zhao
arXiv preprint, 28 Mar 2024
[arXiv] [Project] [Code]

Robust Gaussian Splatting
François Darmon, Lorenzo Porzi, Samuel Rota-Bulò, Peter Kontschieder
arXiv preprint, 5 Apr 2024
[arXiv]

Revising Densification in Gaussian Splatting
Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder
arXiv preprint, 9 Apr 2024
[arXiv]

EGGS: Edge Guided Gaussian Splatting for Radiance Fields
Yuanhao Gong
arXiv preprint, 14 Apr 2024
[arXiv]

3D Gaussian Splatting as Markov Chain Monte Carlo
Shakiba Kheradmand, Daniel Rebain, Gopal Sharma, Weiwei Sun, Jeff Tseng, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
arXiv preprint, 15 Apr 2024
[arXiv]

LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion Field
Jiyang Li, Lechao Cheng, Zhangye Wang, Tingting Mu, Jingxuan He
arXiv preprint, 13 Apr 2024
[arXiv]

AbsGS: Recovering Fine Details for 3D Gaussian Splatting
Zongxin Ye, Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou
arXiv preprint, 16 Apr 2024
[arXiv] [Project] [Code]

Gaussian Splatting Decoder for 3D-aware Generative Adversarial Networks
Florian Barthel, Arian Beckmann, Wieland Morgenstern, Anna Hilsmann, Peter Eisert
CVPRW 2024, 16 Apr 2024
[arXiv]

Does Gaussian Splatting need SFM Initialization?
Yalda Foroutan, Daniel Rebain, Kwang Moo Yi, Andrea Tagliasacchi
arXiv preprint, 18 Apr 2024
[arXiv] [Project]

FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent
Cameron Smith, David Charatan, Ayush Tewari, Vincent Sitzmann
arXiv preprint, 23 Apr 2024
[arXiv]

🔥Spectrally Pruned Gaussian Fields with Neural Compensation
Runyi Yang, Zhenxin Zhu, Zhou Jiang, Baijun Ye, Xiaoxue Chen, Yifei Zhang, Yuantao Chen, Jian Zhao, Hao Zhao
arXiv preprint, 1 May 2024
[arXiv] [Project] [Code]

Bootstrap 3D Reconstructed Scenes from 3D Gaussian Splatting
Yifei Gao, Jie Ou, Lei Wang, Jun Cheng
arXiv preprint, 29 Apr 2024
[arXiv]

I3DGS: Improve 3D Gaussian Splatting from Multiple Dimensions
Jinwei Lin
arXiv preprint, 10 May 2024
[arXiv]

Gaussian Time Machine: A Real-Time Rendering Methodology for Time-Variant Appearances
Licheng Shen, Ho Ngai Chow, Lingyun Wang, Tong Zhang, Mengqiu Wang, Yuxing Han
arXiv preprint, 22 May 2024
[arXiv]

AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field
Rong Liu, Rui Xu, Yue Hu, Meida Chen, Andrew Feng
arXiv preprint, 20 May 2024
[arXiv] [Project] [Code] [Video]

Feature Splatting for Better Novel View Synthesis with Low Overlap
T. Berriel Martins, Javier Civera
arXiv preprint, 24 May 2024
[arXiv] [Code]

NegGS: Negative Gaussian Splatting
Artur Kasymov, Bartosz Czekaj, Marcin Mazur, Przemysław Spurek
arXiv preprint, 28 May 2024
[arXiv]

3D-HGS: 3D Half-Gaussian Splatting
Haolin Li, Jinyang Liu, Mario Sznaier, Octavia Camps
arXiv preprint, 4 Jun 2024
[arXiv]

Gaussian Splatting with Localized Points Management
Haosen Yang, Chenhao Zhang, Wenqing Wang, Marco Volino, Adrian Hilton, Li Zhang, Xiatian Zhu
arXiv preprint, 6 Jun 2024
[arXiv] [Code]

RetinaGS: Scalable Training for Dense Scene Rendering with Billion-Scale 3D Gaussians
Bingling Li, Shengyi Chen, Luchao Wang, Kaimin He, Sijie Yan, Yuanjun Xiong
arXiv preprint, 17 Jun 2024
[arXiv]

Effective Rank Analysis and Regularization for Enhanced 3D Gaussian Splatting
Junha Hyung, Susung Hong, Sungwon Hwang, Jaeseong Lee, Jaegul Choo, Jin-Hwa Kim
arXiv preprint, 17 Jun 2024
[arXiv] [Project]

PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splatting
Alex Hanson, Allen Tu, Vasu Singla, Mayuka Jayawardhana, Matthias Zwicker, Tom Goldstein
arXiv preprint, 14 Jun 2024
[arXiv]

Taming 3DGS: High-Quality Radiance Fields with Limited Resources
Saswat Subhajyoti Mallick, Rahul Goel, Bernhard Kerbl, Francisco Vicente Carrasco, Markus Steinberger, Fernando De La Torre
arXiv preprint, 21 Jun 2024
[arXiv]

SpotlessSplats: Ignoring Distractors in 3D Gaussian Splatting
Sara Sabour, Lily Goli, George Kopanas, Mark Matthews, Dmitry Lagun, Leonidas Guibas, Alec Jacobson, David J. Fleet, Andrea Tagliasacchi
arXiv preprint, 28 Jun 2024
[arXiv]

GS-Octree: Octree-based 3D Gaussian Splatting for Robust Object-level 3D Reconstruction Under Strong Lighting
Jiaze Li, Zhengyu Wen, Luo Zhang, Jiangbei Hu, Fei Hou, Zhebin Zhang, Ying He
arXiv preprint, 26 Jun 2024
[arXiv]

Textured-GS: Gaussian Splatting with Spatially Defined Color and Opacity
Zhentao Huang, Minglun Gong
arXiv preprint, 13 Jul 2024
[arXiv]

Splatfacto-W: A Nerfstudio Implementation of Gaussian Splatting for Unconstrained Photo Collections
Congrong Xu, Justin Kerr, Angjoo Kanazawa
arXiv preprint, 17 Jul 2024
[arXiv] [Code]

MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densification
Zhuoxiao Li, Shanliang Yao, Yijie Chu, Angel F. Garcia-Fernandez, Yong Yue, Eng Gee Lim, Xiaohui Zhu
arXiv preprint, 16 Jul 2024
[arXiv] [Project]

3iGS: Factorised Tensorial Illumination for 3D Gaussian Splatting
Zhe Jun Tang, Tat-Jen Cham
ECCV 2024, 7 Aug 2024
[arXiv]

Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Rendering
Jiameng Li, Yue Shi, Jiezhang Cao, Bingbing Ni, Wenjun Zhang, Kai Zhang, Luc Van Gool
arXiv preprint, 12 Aug 2024
[arXiv]

FLoD: Integrating Flexible Level of Detail into 3D Gaussian Splatting for Customizable Rendering
Yunji Seo, Young Sun Choi, Hyun Seung Son, Youngjung Uh
arXiv preprint, 23 Aug 2024
[arXiv] [Project] [Code]

Robust 3D Gaussian Splatting for Novel View Synthesis in Presence of Distractors
Paul Ungermann, Armin Ettenhofer, Matthias Nießner, Barbara Roessle
GCPR 2024, 21 Aug 2024
[arXiv] [Project] [Video] [Code]

Implicit Gaussian Splatting with Efficient Multi-Level Tri-Plane Representation
Minye Wu, Tinne Tuytelaars
arXiv preprint, 19 Aug 2024
[arXiv]

Correspondence-Guided SfM-Free 3D Gaussian Splatting for NVS
Wei Sun, Xiaosong Zhang, Fang Wan, Yanzhao Zhou, Yuan Li, Qixiang Ye, Jianbin Jiao
arXiv preprint, 16 Aug 2024
[arXiv]

Sources of Uncertainty in 3D Scene Reconstruction
Marcus Klasson, Riccardo Mereu, Juho Kannala, Arno Solin
ECCV 2024, 10 Sep 2024
[arXiv] [Project]

3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-Marquardt
Lukas Höllein, Aljaž Božič, Michael Zollhöfer, Matthias Nießner
arXiv preprint, 19 Sep 2024
[arXiv] [Project] [Video] [Code]

Spectral-GS: Taming 3D Gaussian Splatting with Spectral Entropy
Letian Huang, Jie Guo, Jialin Dan, Ruoyu Fu, Shujie Wang, Yuanqi Li, Yanwen Guo
arXiv preprint, 19 Sep 2024
[arXiv]

GStex: Per-Primitive Texturing of 2D Gaussian Splatting for Decoupled Appearance and Geometry Modeling
Victor Rong, Jingxiang Chen, Sherwin Bahmani, Kiriakos N. Kutulakos, David B. Lindell
arXiv preprint, 19 Sep 2024
[arXiv] [Project]

Frequency-based View Selection in Gaussian Splatting Reconstruction
Monica M.Q. Li, Pierre-Yves Lajoie, Giovanni Beltrame
arXiv preprint, 24 Sep 2024
[arXiv]

MVGS: Multi-view-regulated Gaussian Splatting for Novel View Synthesis
Xiaobiao Du, Yida Wang, Xin Yu
arXiv preprint, 2 Oct 2024
[arXiv] [Project] [Code]

6DGS: Enhanced Direction-Aware Gaussian Splatting for Volumetric Rendering
Zhongpai Gao, Benjamin Planche, Meng Zheng, Anwesa Choudhuri, Terrence Chen, Ziyan Wu
arXiv preprint, 7 Oct 2024
[arXiv] [Project]

Efficient Perspective-Correct 3D Gaussian Splatting Using Hybrid Transparency
Florian Hahlbohm, Fabian Friederichs, Tim Weyrich, Linus Franke, Moritz Kappel, Susana Castillo, Marc Stamminger, Martin Eisemann, Marcus Magnor
arXiv preprint, 10 Oct 2024
[arXiv] [Project]

PH-Dropout: Prctical Epistemic Uncertainty Quantification for View Synthesis
Chuanhao Sun, Thanos Triantafyllou, Anthos Makris, Maja Drmač, Kai Xu, Luo Mai, Mahesh K. Marina
arXiv preprint, 7 Oct 2024
[arXiv]

PhotoReg: Photometrically Registering 3D Gaussian Splatting Models
Ziwen Yuan, Tianyi Zhang, Matthew Johnson-Roberson, Weiming Zhi
arXiv preprint, 7 Oct 2024
[arXiv] [Project] [Video] [Code]

Variational Bayes Gaussian Splatting
Toon Van de Maele, Ozan Catal, Alexander Tschantz, Christopher L. Buckley, Tim Verbelen
arXiv preprint, 4 Oct 2024
[arXiv]

VR-Splatting: Foveated Radiance Field Rendering via 3D Gaussian Splatting and Neural Points
Linus Franke, Laura Fink, Marc Stamminger
arXiv preprint, 23 Oct 2024
[arXiv] [Project]

ODGS: 3D Scene Reconstruction from Omnidirectional Images with 3D Gaussian Splattings
Suyoung Lee, Jaeyoung Chung, Jaeyoo Huh, Kyoung Mu Lee
arXiv preprint, 28 Oct 2024
[arXiv] [Code]

3DGS with Ray Tracing

Don't Splat your Gaussians: Volumetric Ray-Traced Primitives for Modeling and Rendering Scattering and Emissive Media
Jorge Condor, Sebastien Speierer, Lukas Bode, Aljaz Bozic, Simon Green, Piotr Didyk, Adrian Jarabo
arXiv preprint, 24 May 2024
[arXiv]

Unified Gaussian Primitives for Scene Representation and Rendering
Yang Zhou, Songyin Wu, Ling-Qi Yan
arXiv preprint, 14 Jun 2024
[arXiv]

3D Gaussian Ray Tracing: Fast Tracing of Particle Scenes
Nicolas Moenne-Loccoz, Ashkan Mirzaei, Or Perel, Riccardo de Lutio, Janick Martinez Esturo, Gavriel State, Sanja Fidler, Nicholas Sharp, Zan Gojcic
arXiv preprint, 9 Jul 2024
[arXiv]

RayGauss: Volumetric Gaussian-Based Ray Casting for Photorealistic Novel View Synthesis
Hugo Blanc, Jean-Emmanuel Deschaud, Alexis Paljic
arXiv preprint, 6 Aug 2024
[arXiv] [Project]

EVER: Exact Volumetric Ellipsoid Rendering for Real-time View Synthesis
Alexander Mai, Peter Hedman, George Kopanas, Dor Verbin, David Futschik, Qiangeng Xu, Falko Kuester, Jon Barron, Yinda Zhang
arXiv preprint, 2 Oct 2024
[arXiv] [Project] [Video]

3DGS Acceleration

EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS
Sharath Girish, Kamal Gupta, Abhinav Shrivastava
arXiv preprint, 7 Dec, 2023
[arXiv] [Project] [Code]

StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Rendering
Lukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch, Bernhard Kerbl, Markus Steinberger
SIGGRAPH 2024, 1 Feb 2024
[arXiv] [Project] [Code] [Video]

GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering
Abdullah Hamdi, Luke Melas-Kyriazi, Guocheng Qian, Jinjie Mai, Ruoshi Liu, Carl Vondrick, Bernard Ghanem, Andrea Vedaldi
CVPR 2024, 15 Feb 2024
[arXiv] [Project] [Code] [Video]

OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images
Longwei Li, Huajian Huang, Sai-Kit Yeung, Hui Cheng
arXiv preprint, 4 Apr 2024
[arXiv]

Hash3D: Training-free Acceleration for 3D Generation
Xingyi Yang, Xinchao Wang
arXiv preprint, 9 Apr 2024
[arXiv] [Project] [Code]

RTGS: Enabling Real-TimeGaussianSplatting on Mobile Devices Using Efficiency-Guided Pruning and Foveated Rendering
Weikai Lin, Yu Feng, Yuhao Zhu
arXiv preprint, 29 Jun 2024
[arXiv] [Code]

Low Latency Point Cloud Rendering with Learned Splatting
Yueyu Hu, Ran Gong, Qi Sun, Yao Wang
CVPR 2024 Workshop on AIS, 24 Sep 2024
[arXiv] [Code]

Sort-free Gaussian Splatting via Weighted Sum Rendering
Qiqi Hou, Randall Rauwendaal, Zifeng Li, Hoang Le, Farzad Farhadzadeh, Fatih Porikli, Alexei Bourd, Amir Said
arXiv preprint, 24 Oct 2024
[arXiv]

3DGS Geometry Reconstruction

SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
Antoine Guédon, Vincent Lepetit
arXiv preprint, 21 Nov 2023
[arXiv] [Project]

NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance
Hanlin Chen, Chen Li, Gim Hee Lee
arXiv preprint, 1 Dec, 2023
[arXiv]

🔥2D Gaussian Splatting for Geometrically Accurate Radiance Fields
Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao
SIGGRAPH 2024, 26 Mar 2024
[arXiv] [Project] [Code] [Video]

GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction
Mulin Yu, Tao Lu, Linning Xu, Lihan Jiang, Yuanbo Xiangli, Bo Dai
arXiv preprint, 25 Mar 2024
[arXiv] [Project] [Code]

Modeling uncertainty for Gaussian Splatting
Luca Savant, Diego Valsesia, Enrico Magli
arXiv preprint, 27 Mar 2024
[arXiv]

Surface Reconstruction from Gaussian Splatting via Novel Stereo Views
Yaniv Wolf, Amit Bracha, Ron Kimmel
arXiv preprint, 2 Apr 2024
[arXiv] [Project]

Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes
Zehao Yu, Torsten Sattler, Andreas Geiger
arXiv preprint, 16 Apr 2024
[arXiv] [Project] [Code]

Dynamic Gaussians Mesh: Consistent Mesh Reconstruction from Monocular Videos
Isabella Liu, Hao Su, Xiaolong Wang
arXiv preprint, 18 Apr 2024
[arXiv] [Project]

Direct Learning of Mesh and Appearance via 3D Gaussian Splatting
Ancheng Lin, Jun Li
arXiv preprint, 11 May 2024
[arXiv]

TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes
Minghao Guo, Bohan Wang, Kaiming He, Wojciech Matusik
arXiv preprint, 30 May 2024
[arXiv]

Tetrahedron Splatting for 3D Generation
Chun Gu, Zeyu Yang, Zijie Pan, Xiatian Zhu, Li Zhang
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

RaDe-GS: Rasterizing Depth in Gaussian Splatting
Baowen Zhang, Chuan Fang, Rakesh Shrestha, Yixun Liang, Xiaoxiao Long, Ping Tan
arXiv preprint, 3 Jun 2024
[arXiv]

Trim 3D Gaussian Splatting for Accurate Geometry Representation
Lue Fan, Yuxue Yang, Minxing Li, Hongsheng Li, Zhaoxiang Zhang
arXiv preprint, 11 Jun 2024
[arXiv] [Project] [Code]

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction
Danpeng Chen, Hai Li, Weicai Ye, Yifan Wang, Weijian Xie, Shangjin Zhai, Nan Wang, Haomin Liu, Hujun Bao, Guofeng Zhang
arXiv prepreint, 10 Jun 2024
[arXiv] [Project] [Code]

VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction
Hanlin Chen, Fangyin Wei, Chen Li, Tianxin Huang, Yunsong Wang, Gim Hee Lee
arXiv preprint, 9 Jun 2024
[arXiv]

Projecting Radiance Fields to Mesh Surfaces
Adrian Xuan Wei Lim, Lynnette Hui Xian Ng, Nicholas Kyger, Tomo Michigami, Faraz Baghernezhad
SIGGRAPH Poster 2024, 17 Jun 2024
[arXiv]

2DGH: 2D Gaussian-Hermite Splatting for High-quality Rendering and Better Geometry Reconstruction
Ruihan Yu, Tianyu Huang, Jingwang Ling, Feng Xu
arXiv preprint, 30 Aug 2024
[arXiv]

Spurfies: Sparse Surface Reconstruction using Local Geometry Priors
Kevin Raj, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen
arXiv preprint, 29 Aug 2024
[arXiv] [Project]

Spiking GS: Towards High-Accuracy and Low-Cost Surface Reconstruction via Spiking Neuron-based Gaussian Splatting
Weixing Zhang, Zongrui Li, De Ma, Huajin Tang, Xudong Jiang, Qian Zheng, Gang Pan
arXiv preprint, 9 Oct 2024
[arXiv] [Code]

Normal-GS: 3D Gaussian Splatting with Normal-Involved Rendering
Meng Wei, Qianyi Wu, Jianmin Zheng, Hamid Rezatofighi, Jianfei Cai
NeurIPS 2024, 27 Oct 2024
[arXiv]

GVKF: Gaussian Voxel Kernel Functions for Highly Efficient Surface Reconstruction in Open Scenes
Gaochao Song, Chong Cheng, Hao Wang
NeurIPS 2024, 4 Nov 2024
[arXiv]

3DGS+Mesh For Reconstruction

Integrating Meshes and 3D Gaussians for Indoor Scene Reconstruction with SAM Mask Guidance
Jiyeop Kim, Jongwoo Lim
arXiv preprint, 23 Jul 2024
[arXiv]

Enhancement of 3D Gaussian Splatting using Raw Mesh for Photorealistic Recreation of Architectures
Ruizhe Wang, Chunliang Hua, Tomakayev Shingys, Mengyuan Niu, Qingxin Yang, Lizhong Gao, Yi Zheng, Junyan Yang, Qiao Wang
arXiv preprint, 22 Jul 2024
[arXiv]

3DGS Based Dynamic Scene

Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
Jonathon Luiten, Georgios Kopanas, Bastian Leibe, Deva Ramanan
arXiv preprint, 18 Aug 2023
[arXiv] [Project] [Github]

🔥Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction
Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, Xiaogang Jin
arXiv preprint, 22 Sep 2023
[arXiv]

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, Xinggang Wang
arXiv preprint, 12 Oct 2023
[arXiv] [Project] [Github]

Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
Zeyu Yang, Hongye Yang, Zijie Pan, Xiatian Zhu, Li Zhang
arXiv preprint, 16 Oct 2023
[arXiv]

Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstruction
Devikalyan Das, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen
arXiv preprint, 2 Dec 2023
[arXiv]

Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle
Youtian Lin, Zuozhuo Dai, Siyu Zhu, Yao Yao
arXiv preprint, 6 Dec 2023
[arXiv]

CoGS: Controllable Gaussian Splatting
Heng Yu, Joel Julin, Zoltán Á. Milacski, Koichiro Niinuma, László A. Jeni
CVPR 2024, 9 Dec 2023
[arXiv]

GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis
Yiqing Liang, Numair Khan, Zhengqin Li, Thu Nguyen-Phuoc, Douglas Lanman, James Tompkin, Lei Xiao
arXiv preprint, 18 Dec 2023
[arXiv] [Project]

🔥SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes
Yi-Hua Huang, Yang-Tian Sun, Ziyi Yang, Xiaoyang Lyu, Yan-Pei Cao, Xiaojuan Qi
CVPR 2024, 4 Dec 2023
[arXiv] [Project] [Code] [Video]

Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis
Zhan Li, Zhang Chen, Zhong Li, Yi Xu
CVPR 2024, 28 Dec 2023
[arXiv] [Project] [Code] [Video]

4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes
Yuanxing Duan, Fangyin Wei, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen
arXiv preprint, 5 Feb 2024
[arXiv] [Code]

Mesh-based Gaussian Splatting for Real-time Large-scale Deformation
Lin Gao, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai
arXiv preprint, 7 Feb 2024
[arXiv]

GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
Quankai Gao, Qiangeng Xu, Zhe Cao, Ben Mildenhall, Wenchao Ma, Le Chen, Danhang Tang, Ulrich Neumann
arXiv preprint, 19 Mar 2024
[arXiv] [Project] [Code] [Video]

Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting
Jeongmin Bae, Seoha Kim, Youngsik Yun, Hahyun Lee, Gun Bang, Youngjung Uh
arXiv preprint, 4 Apr 2024
[arXiv] [Project] [Code]

3D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesis
Zhicheng Lu, Xiang Guo, Le Hui, Tianrui Chen, Min Yang, Xiao Tang, Feng Zhu, Yuchao Dai
CVPR 2024, 9 Apr 2024
[arXiv] [Project]

MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds
Jiahui Lei, Yijia Weng, Adam Harley, Leonidas Guibas, Kostas Daniilidis
arXiv preprint, 27 May 2024
[arXiv] [Project] [Video]

GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting
Jiajun Huang, Hongchuan Yu
arXiv preprint, 24 May 2024
[arXiv] [Project] [Video]

GFlow: Recovering 4D World from Monocular Video
Shizun Wang, Xingyi Yang, Qiuhong Shen, Zhenxiang Jiang, Xinchao Wang
arXiv preprint, 28 May 2024
[arXiv] [Project]

A Refined 3D Gaussian Representation for High-Quality Dynamic Scene Reconstruction
Bin Zhang, Bi Zeng, Zexin Peng
arXiv preprint, 28 May 2024
[arXiv]

Object-centric Reconstruction and Tracking of Dynamic Unknown Objects using 3D Gaussian Splatting
Kuldeep R Barad, Antoine Richard, Jan Dentler, Miguel Olivares-Mendez, Carol Martinez
IEEE Space Robotics 2024, 30 May 2024
[arXiv]

GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesis
Boming Zhao, Yuan Li, Ziyu Sun, Lin Zeng, Yujun Shen, Rui Ma, Yinda Zhang, Hujun Bao, Zhaopeng Cui
SIGGRAPH 2024, 30 May 2024
[arXiv] [Project]

Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splatting
Shaojie Ma, Yawei Luo, Yi Yang
arXiv preprint, 3 Jun 2024
[arXiv] [Project] [Code]

Self-Calibrating 4D Novel View Synthesis from Monocular Videos Using Gaussian Splatting
Fang Li, Hao Zhang, Narendra Ahuja
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstruction
Diwen Wan, Ruijie Lu, Gang Zeng
ICML 2024, 6 Jun 2024
[arXiv] [Project] [Code]

MoDGS: Dynamic Gaussian Splatting from Causually-captured Monocular Videos
Qingming Liu, Yuan Liu, Jiepeng Wang, Xianqiang Lv, Peng Wang, Wenping Wang, Junhui Hou
arXiv preprint, 1 Jun 2024
[arXiv]

DGD: Dynamic 3D Gaussians Distillation
Isaac Labe, Noam Issachar, Itai Lang, Sagie Benaim
arXiv preprint, 29 May 2024
[arXiv] [Project] [Code]

Modeling Ambient Scene Dynamics for Free-view Synthesis
Meng-Li Shih, Jia-Bin Huang, Changil Kim, Rajvi Shah, Johannes Kopf, Chen Gao
SIGGRAPH 2024, 13 Jun 2024
[arXiv] [Project]

Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videos
Colton Stearns, Adam Harley, Mikaela Uy, Florian Dubost, Federico Tombari, Gordon Wetzstein, Leonidas Guibas
arXiv preprint, 26 Jun 2024
[arXiv]

Gaussian Splatting LK
Liuyue Xie, Joel Julin, Koichiro Niinuma, Laszlo A. Jeni
arXiv preprint, 16 Jul 2024
[arXiv]

S4D: Streaming 4D Real-World Reconstruction with Gaussians and 3D Control Points
Bing He, Yunuo Chen, Guo Lu, Li Song, Wenjun Zhang
arXiv preprint, 23 Aug 2024
[arXiv]

SplatFields: Neural Gaussian Splats for Sparse 3D and 4D Reconstruction
Marko Mihajlovic, Sergey Prokudin, Siyu Tang, Robert Maier, Federica Bogo, Tony Tung, Edmond Boyer
ECCV 2024, 17 Sep 2024
[arXiv]

MotionGS: Exploring Explicit Motion Guidance for Deformable 3D Gaussian Splatting
Ruijie Zhu, Yanzhe Liang, Hanzhi Chang, Jiacheng Deng, Jiahao Lu, Wenfei Yang, Tianzhu Zhang, Yongdong Zhang
NeurIPS 2024, 10 Oct 2024
[arXiv] [Project]

DN-4DGS: Denoised Deformable Network with Temporal-Spatial Aggregation for Dynamic Scene Rendering
Jiahao Lu, Jiacheng Deng, Ruijie Zhu, Yanzhe Liang, Wenfei Yang, Tianzhu Zhang, Xu Zhou
NeurIPS 2024, 17 Oct 2024
[arXiv]

MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenes
Xinjie Zhang, Zhening Liu, Yifan Zhang, Xingtong Ge, Dailan He, Tongda Xu, Yan Wang, Zehong Lin, Shuicheng Yan, Jun Zhang
arXiv preprint, 17 Oct 2024
[arXiv]

Fully Explicit Dynamic Gaussian Splatting
Junoh Lee, Chang-Yeon Won, Hyunjun Jung, Inhwan Bae, Hae-Gon Jeon
NeurIPS 2024, 21 Oct 2024
[arXiv]

FreeGaussian: Guidance-free Controllable 3D Gaussian Splats with Flow Derivatives
Qizhi Chen, Delin Qu, Yiwen Tang, Haoming Song, Yiting Zhang, Dong Wang, Bin Zhao, Xuelong Li
arXiv preprint, 29 Oct 2024
[arXiv] [Project] [Code]

Grid4D: 4D Decomposed Hash Encoding for High-fidelity Dynamic Gaussian Splatting
Jiawei Xu, Zexin Fan, Jian Yang, Jin Xie
NeurIPS 2024, 28 Oct 2024
[arXiv]

3DGS + Depth

DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization
Jiahe Li, Jiawei Zhang, Xiao Bai, Jin Zheng, Xin Ning, Jun Zhou, Lin Gu
CVPR 2024, 11 Mar 2024
[arXiv] [Project] [Code] [Video]

🔥DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing
Matias Turkulainen, Xuqian Ren, Iaroslav Melekhov, Otto Seiskari, Esa Rahtu, Juho Kannala
arXiv preprint, 26 Mar 2024
[arXiv]

HoloGS: Instant Depth-based 3D Gaussian Splatting with Microsoft HoloLens 2
Miriam Jäger, Theodor Kapler, Michael Feßenbecker, Felix Birkelbach, Markus Hillemann, Boris Jutzi
arXiv preprint, 3 May 2024
[arXiv]

Self-Evolving Depth-Supervised 3D Gaussian Splatting from Rendered Stereo Pairs
Sadra Safadoust, Fabio Tosi, Fatma Güney, Matteo Poggi
BMVC 2024, 11 Sep 2024
[arXiv] [Project] [[]]

3DGS Based Depth Estimation

Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus
Jinchang Zhang, Ningning Xu, Hao Zhang, Guoyu Lu
arXiv preprint, 18 Sep 2024
[arXiv]

3DGS Few-shot Reconstruction

Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images
Jaeyoung Chung, Jeongtaek Oh, Kyoung Mu Lee
arXiv preprint, 22 Nov 2023
[arXiv]

FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting
Zehao Zhu, Zhiwen Fan, Yifan Jiang, Zhangyang Wang
arXiv preprint, 1 Dec 2023
[arXiv] [Project]

Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers
Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao, Song-Hai Zhang
arXiv preprint, 14 Dec 2023
[arXiv] [Project] [Code]

pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction
David Charatan, Sizhe Li, Andrea Tagliasacchi, Vincent Sitzmann
arXiv preprint, 19 Dec 2023
[arXiv] [Project] [Code]

AGG: Amortized Generative 3D Gaussians for Single Image to 3D
Dejia Xu, Ye Yuan, Morteza Mardani, Sifei Liu, Jiaming Song, Zhangyang Wang, Arash Vahdat
arXiv preprint, 8 Jan 2024
[arXiv] [Project]

GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting
Chen Yang, Sikuang Li, Jiemin Fang, Ruofan Liang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian
arXiv preprint, 15 Feb 2024
[arXiv] [Project]

FDGaussian: Fast Gaussian Splatting from Single Image via Geometric-aware Diffusion Model
Qijun Feng, Zhen Xing, Zuxuan Wu, Yu-Gang Jiang
arXiv preprint, 15 Mar 2024
[arXiv] [Project]

Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
Qiuhong Shen, Xuanyu Yi, Zike Wu, Pan Zhou, Hanwang Zhang, Shuicheng Yan, Xinchao Wang
arXiv preprint, 27 Mar 2024
[arXiv] [Project]

🔥InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds
Zhiwen Fan, Wenyan Cong, Kairun Wen, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang
arXiv preprint, 29 Mar 2024
[arXiv] [Project] [Video]

CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians
Avinash Paliwal, Wei Ye, Jinhui Xiong, Dmytro Kotovenko, Rakesh Ranjan, Vikas Chandra, Nima Khademi Kalantari
arXiv preprint, 28 Mar 2024
[arXiv] [Project]

Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses
Inhee Lee, Byungjun Kim, Hanbyul Joo
arXiv preprint, 22 Apr 2024
[arXiv] [Project]

GDGS: Gradient Domain Gaussian Splatting for Sparse Representation of Radiance Fields
Yuanhao Gong
arXiv preprint, 8 May 2024
[arXiv]

CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularization
Jiawei Zhang, Jiahe Li, Xiaohan Yu, Lei Huang, Lin Gu, Jin Zheng, Xiao Bai
arXiv preprint, 20 May 2024
[arXiv] [Project] [Video]

Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors
Soumava Paul, Christopher Wewer, Bernt Schiele, Jan Eric Lenssen
arXiv preprint, 26 May 2024
[arXiv]

A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction
Jianghao Shen, Tianfu Wu
arXiv preprint, 30 May 2024
[arXiv]

Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image
Stanislaw Szymanowicz, Eldar Insafutdinov, Chuanxia Zheng, Dylan Campbell, João F. Henriques, Christian Rupprecht, Andrea Vedaldi
arXiv preprint, 6 Jun 2024
[arXiv] [Project]

GSD: View-Guided Gaussian Splatting Diffusion for 3D Reconstruction
Yuxuan Mu, Xinxin Zuo, Chuan Guo, Yilin Wang, Juwei Lu, Xiaofeng Wu, Songcen Xu, Peng Dai, Youliang Yan, Li Cheng
ECCV 2024, 5 Jul 2024
[arXiv]

Self-augmented Gaussian Splatting with Structure-aware Masks for Sparse-view 3D Reconstruction
Lingbei Meng, Bi'an Du, Wei Hu
arXiv preprint, 9 Aug 2024
[arXiv]

🔥ReconX: Reconstruct Any Scene from Sparse Views with Video Diffusion Model
Fangfu Liu, Wenqiang Sun, Hanyang Wang, Yikai Wang, Haowen Sun, Junliang Ye, Jun Zhang, Yueqi Duan
arXiv preprint, 29 Aug 2024
[arXiv] [Project] [Video] [Code]

🔥ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis
Wangbo Yu, Jinbo Xing, Li Yuan, Wenbo Hu, Xiaoyu Li, Zhipeng Huang, Xiangjun Gao, Tien-Tsin Wong, Ying Shan, Yonghong Tian
arXiv preprint, 3 Sep 2024
[arXiv] [Project] [Video] [Code]

LM-Gaussian: Boost Sparse-view 3D Gaussian Splatting with Large Model Priors
Hanyang Yu, Xiaoxiao Long, Ping Tan
arXiv preprint, 5 Sep 2024
[arXiv] [Project] [Video] [Code]

Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction
Shen Chen, Jiale Zhou, Lei Li
arXiv preprint, 5 Sep 2024
[arXiv]

Object Gaussian for Monocular 6D Pose Estimation from Sparse Views
Luqing Luo, Shichu Sun, Jiangang Yang, Linfang Zheng, Jinwei Du, Jian Liu
arXiv preprint, 4 Sep 2024
[arXiv]

Single-View 3D Reconstruction via SO(2)-Equivariant Gaussian Sculpting Networks
Ruihan Xu, Anthony Opipari, Joshua Mah, Stanley Lewis, Haoran Zhang, Hanzhe Guo, Odest Chadwicke Jenkins
RSS 2024, 11 Sep 2024
[arXiv]

Vista3D: Unravel the 3D Darkside of a Single Image
Qiuhong Shen, Xingyi Yang, Michael Bi Mi, Xinchao Wang
ECCV 2024, 18 Sep 2024
[arXiv] [Code]

MVPGS: Excavating Multi-view Priors for Gaussian Splatting from Sparse Input Views
Wangze Xu, Huachen Gao, Shihe Shen, Rui Peng, Jianbo Jiao, Ronggang Wang
ECCV 2024, 22 Sep 2024
[arXiv] [Project] [Code]

HiSplat: Hierarchical 3D Gaussian Splatting for Generalizable Sparse-View Reconstruction
Shengji Tang, Weicai Ye, Peng Ye, Weihao Lin, Yang Zhou, Tao Chen, Wanli Ouyang
arXiv preprint, 8 Oct 2024
[arXiv] [Project] [Code]

MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields
Yuru Xiao, Deming Zhai, Wenbo Zhao, Kui Jiang, Junjun Jiang, Xianming Liu
arXiv preprint, 15 Oct 2024
[arXiv]

Few-shot Novel View Synthesis using Depth Aware 3D Gaussian Splatting
Raja Kumar, Vanshika Vats
ECCV 2024 Workshop S3DSGR, 14 Oct 2024
[arXiv] [Code]

3DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
Xi Liu, Chaoyi Zhou, Siyu Huang
NeurIPS 2024, 21 Oct 2024
[arXiv] [Project]

Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesis
Liang Han, Junsheng Zhou, Yu-Shen Liu, Zhizhong Han
NeurIPS 2024, 24 Oct 2024
[arXiv] [Project] [Code]

MVSplat360: Feed-Forward 360 Scene Synthesis from Sparse Views
Yuedong Chen, Chuanxia Zheng, Haofei Xu, Bohan Zhuang, Andrea Vedaldi, Tat-Jen Cham, Jianfei Cai
NeurIPS 2024, 7 Nov 2024
[arXiv] [Project] [Code]

Structure Consistent Gaussian Splatting with Matching Prior for Few-shot Novel View Synthesis
Rui Peng, Wangze Xu, Luyang Tang, Liwei Liao, Jianbo Jiao, Ronggang Wang
NeurIPS 2024, 6 Nov 2024
[arXiv] [Code]

FewViewGS: Gaussian Splatting with Few View Matching and Multi-stage Training
Ruihong Yin, Vladimir Yugay, Yue Li, Sezer Karaoglu, Theo Gevers
NeurIPS 2024, 4 Nov 2024
[arXiv]

3DGS Weak Camera Pose

COLMAP-Free 3D Gaussian Splatting
Yang Fu, Sifei Liu, Amey Kulkarni, Jan Kautz, Alexei A. Efros, Xiaolong Wang
CVPR 2024, 12 Dec 2023
[arXiv] [Project] [Video]

iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching
Yuan Sun, Xuan Wang, Yunfan Zhang, Jie Zhang, Caigui Jiang, Yu Guo, Fei Wang
arXiv preprint, 14 Dec 2023
[arXiv]

A Construct-Optimize Approach to Sparse View Synthesis without Camera Pose
Kaiwen Jiang, Yang Fu, Mukund Varma T, Yash Belhe, Xiaolong Wang, Hao Su, Ravi Ramamoorthi
arXiv preprint, 6 May 2024
[arXiv]

6DGS: 6D Pose Estimation from a Single Image and a 3D Gaussian Splatting Model
Matteo Bortolon, Theodore Tsesmelis, Stuart James, Fabio Poiesi, Alessio Del Bue
ECCV 2024, 22 Jul 2024
[arXiv] [Project] [Code] [Video]

GSLoc: Efficient Camera Pose Refinement via 3D Gaussian Splatting
Changkun Liu, Shuai Chen, Yash Bhalgat, Siyan Hu, Zirui Wang, Ming Cheng, Victor Adrian Prisacariu, Tristan Braud
arXiv preprint, 20 Aug 2024
[arXiv]

Splatt3R: Zero-shot Gaussian Splatting from Uncalibrated Image Pairs
Brandon Smart, Chuanxia Zheng, Iro Laina, Victor Adrian Prisacariu
arXiv preprint, 25 Aug 2024
[arXiv] [Project] [Code]

HGSLoc: 3DGS-based Heuristic Camera Pose Refinement
Zhongyan Niu, Zhen Tan
arXiv preprint, 17 Sep 2024
[arXiv]

GSplatLoc: Grounding Keypoint Descriptors into 3D Gaussian Splatting for Improved Visual Localization
Gennady Sidorov, Malik Mohrat, Ksenia Lebedeva, Ruslan Rakhimov, Sergey Kolyubin
arXiv preprint, 24 Sep 2024
[arXiv] [Project] [Video] [Code]

SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality
Hongjia Zhai, Xiyu Zhang, Boming Zhao, Hai Li, Yijia He, Zhaopeng Cui, Hujun Bao, Guofeng Zhang
arXiv preprint, 21 Sep 2024
[arXiv] [Project] [Code]

PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting
Sunghwan Hong, Jaewoo Jung, Heeseong Shin, Jisang Han, Jiaolong Yang, Chong Luo, Seungryong Kim
arXiv preprint, 29 Oct 2024
[arXiv] [Project] [Code]

3DGS Object Pose Estimation

Object Pose Estimation Using Implicit Representation For Transparent Objects
Varun Burde, Artem Moroz, Vit Zeman, Pavel Burget
arXiv preprint, 17 Oct 2024
[arXiv]

GS2Pose: Tow-stage 6D Object Pose Estimation Guided by Gaussian Splatting
Jilan Mei, Junbo Li, Cai Meng
arXiv preprint, 6 Nov 2024
[arXiv]

3DGS-NeRF Transfer

NeRFs to Gaussian Splats, and Back
Siming He, Zach Osman, Pratik Chaudhari
arXiv preprint, 15 May 2024
[arXiv] [Code]

3DGS Generalization

GGRt: Towards Generalizable 3D Gaussians without Pose Priors in Real-Time
Hao Li, Yuanyuan Gao, Dingwen Zhang, Chenming Wu, Yalun Dai, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, Junwei Han
arXiv preprint, 15 Mar 2024
[arXiv] [Project]

latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction
Christopher Wewer, Kevin Raj, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen
arXiv preprint, 24 Mar 2024
[arXiv] [Project]

Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo
Tianqi Liu, Guangcong Wang, Shoukang Hu, Liao Shen, Xinyi Ye, Yuhang Zang, Zhiguo Cao, Wei Li, Ziwei Liu
arXiv preprint, 20 May 2024
[arXiv] [Project] [Code] [Video]

GS-Net: Generalizable Plug-and-Play 3D Gaussian Splatting Module
Yichen Zhang, Zihan Wang, Jiali Han, Peilin Li, Jiaxun Zhang, Jianqiang Wang, Lei He, Keqiang Li
arXiv preprint, 17 Sep 2024
[arXiv]

DepthSplat: Connecting Gaussian Splatting and Depth
Haofei Xu, Songyou Peng, Fangjinhua Wang, Hermann Blum, Daniel Barath, Andreas Geiger, Marc Pollefeys
arXiv preprint, 17 Oct 2024
[arXiv] [Project] [Code]

🔥No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Images
Botao Ye, Sifei Liu, Haofei Xu, Xueting Li, Marc Pollefeys, Ming-Hsuan Yang, Songyou Peng
arXiv preprint, 31 Oct 2024
[arXiv] [Project] [Code]

Epipolar-Free 3D Gaussian Splatting for Generalizable Novel View Synthesis
Zhiyuan Min, Yawei Luo, Jianwen Sun, Yi Yang
NeurIPS 2024, 30 Oct 2024
[arXiv] [Project]

3DGS Indoor Scene Reconstruction

360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming
Jiayang Bai, Letian Huang, Jie Guo, Wen Gong, Yuanqi Li, Yanwen Guo
arXiv preprint, 1 Feb 2024
[arXiv]

MonoSelfRecon: Purely Self-Supervised Explicit Generalizable 3D Reconstruction of Indoor Scenes from Monocular RGB Views
Runfa Li, Upal Mahbub, Vasudev Bhaskaran, Truong Nguyen
arXiv preprint, 10 Apr 2024
[arXiv]

FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes
Yunsong Wang, Tianxin Huang, Hanlin Chen, Gim Hee Lee
arXiv preprint, 28 May 2024
[arXiv]

Scalable Indoor Novel-View Synthesis using Drone-Captured 360 Imagery with 3D Gaussian Splatting
Yuanbo Chen, Chengyu Zhang, Jason Wang, Xuefan Gao, Avideh Zakhor
ECCV 2024 Workshop S3DSGR, 15 Oct 2024
[arXiv]

3DGS Based Wild Scene Reconstruction

SWAG: Splatting in the Wild images with Appearance-conditioned Gaussians
Hiba Dahmani, Moussab Bennehar, Nathan Piasco, Luis Roldao, Dzmitry Tsishkou
arXiv preprint, 15 Mar 2024
[arXiv]

Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections
Dongbin Zhang, Chuming Wang, Weitao Wang, Peihao Li, Minghan Qin, Haoqian Wang
arXiv preprint, 23 Mar 2024
[arXiv]

WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collections
Yuze Wang, Junyi Wang, Yue Qi
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

Wild-GS: Real-Time Novel View Synthesis from Unconstrained Photo Collections
Jiacong Xu, Yiqun Mei, Vishal M. Patel
arXiv preprint, 14 Jun 2024
[arXiv]

WildGaussians: 3D Gaussian Splatting in the Wild
Jonas Kulhanek, Songyou Peng, Zuzana Kukelova, Marc Pollefeys, Torsten Sattler
arXiv preprint, 11 Jul 2024
[arXiv] [Project] [Code]

3DGS Based Large Scene Reconstruction

Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering
Yurui Chen, Chun Gu, Junzhe Jiang, Xiatian Zhu, Li Zhang
arXiv preprint, 30 Nov 2023
[arXiv] [Project]

GauU-Scene: A Scene Reconstruction Benchmark on Large Scale 3D Reconstruction Dataset Using Gaussian Splatting
Butian Xiong, Zhuo Li, Zhen Li
arXiv preprint, 25 Jan 2024
[arXiv]

GaussianPro: 3D Gaussian Splatting with Progressive Propagation
Kai Cheng, Xiaoxiao Long, Kaizhi Yang, Yao Yao, Wei Yin, Yuexin Ma, Wenping Wang, Xuejin Chen
arXiv preprint, 22 Feb 2024
[arXiv] [Project] [Code]

🔥VastGaussian: Vast 3D Gaussians for Large Scene
Jiaqi Lin, Zhihao Li, Xiao Tang, Jianzhuang Liu, Shiyong Liu, Jiayue Liu, Yangdi Lu, Xiaofei Wu, Songcen Xu, Youliang Yan, Wenming Yang
CVPR 2024, 27 Feb, 2024
[arXiv] [Project]

🔥Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians
Kerui Ren, Lihan Jiang, Tao Lu, Mulin Yu, Linning Xu, Zhangkai Ni, Bo Dai
arXiv preprint, 26 Mar 2024
[arXiv] [Project] [Code]

SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
Zhongrui Yu, Haoran Wang, Jinze Yang, Hanzhang Wang, Zeke Xie, Yunfeng Cai, Jiale Cao, Zhong Ji, Mingming Sun
arXiv preprint, 29 Mar 2024
[arXiv]

HO-Gaussian: Hybrid Optimization of 3D Gaussian Splatting for Urban Scenes
Zhuopeng Li, Yilin Zhang, Chenming Wu, Jianke Zhu, Liangjun Zhang
arXiv preprint, 29 Mar 2024
[arXiv]

CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians
Yang Liu, He Guan, Chuanchen Luo, Lue Fan, Junran Peng, Zhaoxiang Zhang
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Code]

LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives
Jiadi Cui, Junming Cao, Yuhui Zhong, Liao Wang, Fuqiang Zhao, Penghao Wang, Yifan Chen, Zhipeng He, Lan Xu, Yujiao Shi, Yingliang Zhang, Jingyi Yu
arXiv preprint, 15 Apr 2024
[arXiv] [Project]

GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting
Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, Zexiang Xu
arXiv preprint, 30 Apr 2024
[arXiv] [Project]

DoGaussian: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus
Yu Chen, Gim Hee Lee
arXiv preprint, 22 May 2024
[arXiv] [Project] [Code]

PyGS: Large-scale Scene Representation with Pyramidal 3D Gaussian Splatting
Zipeng Wang, Dan Xu
arXiv preprint, 27 May 2024
[arXiv]

GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Prediction
Yuanhui Huang, Wenzhao Zheng, Yunpeng Zhang, Jie Zhou, Jiwen Lu
arXiv preprint, 27 May 2024
[arXiv] [Code]

3D StreetUnveiler with Semantic-Aware 2DGS
Jingwei Xu, Yikai Wang, Yiqun Zhao, Yanwei Fu, Shenghua Gao
arXiv preprint, 28 May 2024
[arXiv] [Project] [Code]

A Hierarchical 3D Gaussian Representation for Real-Time Rendering of Very Large Datasets
Bernhard Kerbl, Andréas Meuleman, Georgios Kopanas, Michael Wimmer, Alexandre Lanvin, George Drettakis
arXiv preprint, 17 Jun 2024
[arXiv] [Project]

VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priors
Sungwon Hwang, Min-Jung Kim, Taewoong Kang, Jayeon Kang, Jaegul Choo
arXiv preprint, 3 Jul 2024
[arXiv] [Project]

FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Rendering
Guofeng Feng, Siyan Chen, Rong Fu, Zimu Liao, Yi Wang, Tao Liu, Zhilin Pei, Hengjie Li, Xingcheng Zhang, Bo Dai
arXiv preprint, 15 Aug 2024
[arXiv]

GigaGS: Scaling up Planar-Based 3D Gaussians for Large Scene Surface Reconstruction
Junyi Chen, Weicai Ye, Yifan Wang, Danpeng Chen, Di Huang, Wanli Ouyang, Guofeng Zhang, Yu Qiao, Tong He
arXiv preprint, 10 Sep 2024
[arXiv]

LI-GS: Gaussian Splatting with LiDAR Incorporated for Accurate Large-Scale Reconstruction
Changjian Jiang, Ruilan Gao, Kele Shao, Yue Wang, Rong Xiong, Yu Zhang
arXiv preprint, 19 Sep 2024
[arXiv]

GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction
Hanyue Zhang, Zhiliu Yang, Xinhe Zuo, Yuxin Tong, Ying Long, Chen Liu
arXiv preprint, 19 Sep 2024
[arXiv]

DENSER: 3D Gaussians Splatting for Scene Reconstruction of Dynamic Urban Environments
Mahmud A. Mohamad, Gamal Elghazaly, Arthur Hubert, Raphael Frank
arXiv preprint, 16 Sep 2024
[arXiv] [Code]

StreetSurfGS: Scalable Urban Street Surface Reconstruction with Planar-based Gaussian Splatting
Xiao Cui, Weicai Ye, Yifan Wang, Guofeng Zhang, Wengang Zhou, Tong He, Houqiang Li
arXiv preprint, 6 Oct 2024
[arXiv]

Long-LRM: Long-sequence Large Reconstruction Model for Wide-coverage Gaussian Splats
Chen Ziwen, Hao Tan, Kai Zhang, Sai Bi, Fujun Luan, Yicong Hong, Li Fuxin, Zexiang Xu
arXiv preprint, 16 Oct 2024
[arXiv] [Project]

🔥SCube: Instant Large-Scale Scene Reconstruction using VoxSplats Xuanchi Ren, Yifan Lu, Hanxue Liang, Zhangjie Wu, Huan Ling, Mike Chen, Sanja Fidler, Francis Williams, Jiahui Huang
NeurIPS 2024, 26 Oct 2024
[arXiv] [Project] [Code] [Video]

3DGS Autonomous Driving

DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes
Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang
CVPR 2024, 13 Dec 2023
[arXiv] [Code]

Street Gaussians for Modeling Dynamic Urban Scenes
Yunzhi Yan, Haotong Lin, Chenxu Zhou, Weijie Wang, Haiyang Sun, Kun Zhan, Xianpeng Lang, Xiaowei Zhou, Sida Peng
arXiv preprint, 2 Jan 2024
[arXiv] [Project] [Code]

TCLC-GS: Tightly Coupled LiDAR-Camera Gaussian Splatting for Surrounding Autonomous Driving Scenes
Cheng Zhao, Su Sun, Ruoyu Wang, Yuliang Guo, Jun-Jun Wan, Zhou Huang, Xinyu Huang, Yingjie Victor Chen, Liu Ren
arXiv preprint, 3 Apr, 2024
[arXiv]

S^3 Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
Nan Huang, Xiaobao Wei, Wenzhao Zheng, Pengju An, Ming Lu, Wei Zhan, Masayoshi Tomizuka, Kurt Keutzer, Shanghang Zhang
arXiv preprint, 30 May 2024
[arXiv] [Code]

VDG: Vision-Only Dynamic Gaussian for Driving Simulation
Hao Li, Jingfeng Li, Dingwen Zhang, Chenming Wu, Jieqi Shi, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, Junwei Han
arXiv preprint, 26 Jun 2024
[arXiv] [Project]

AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstruction
Mustafa Khan, Hamidreza Fazlali, Dhruv Sharma, Tongtong Cao, Dongfeng Bai, Yuan Ren, Bingbing Liu
arXiv preprint, 2 Jul 2024
[arXiv] [Project]

DHGS: Decoupled Hybrid Gaussian Splatting for Driving Scene
Xi Shi, Lingli Chen, Peng Wei, Xi Wu, Tian Jiang, Yonggang Luo, Lecheng Xie
arXiv preprint, 23 Jul 2024
[arXiv] [Project]

GaussianBeV: 3D Gaussian Representation meets Perception Models for BeV Segmentation
Florian Chabot, Nicolas Granger, Guillaume Lapouge
arXiv preprint, 19 Jul 2024
[arXiv]

🔥OmniRe: Omni Urban Scene Reconstruction
Ziyu Chen, Jiawei Yang, Jiahui Huang, Riccardo de Lutio, Janick Martinez Esturo, Boris Ivanovic, Or Litany, Zan Gojcic, Sanja Fidler, Marco Pavone, Li Song, Yue Wang
arXiv preprint, 29 Aug 2024
[arXiv] [Project]

Drone-assisted Road Gaussian Splatting with Cross-view Uncertainty
Saining Zhang, Baijun Ye, Xiaoxue Chen, Yuantao Chen, Zongzheng Zhang, Cheng Peng, Yongliang Shi, Hao Zhao
BMVC 2024, 27 Aug 2024
[arXiv] [Project] [Code]

GGS: Generalizable Gaussian Splatting for Lane Switching in Autonomous Driving
Huasong Han, Kaixuan Zhou, Xiaoxiao Long, Yusen Wang, Chunxia Xiao
arXiv preprint, 4 Sep 2024
[arXiv]

DrivingForward: Feed-forward 3D Gaussian Splatting for Driving Scene Reconstruction from Flexible Surround-view Input
Qijian Tian, Xin Tan, Yuan Xie, Lizhuang Ma
arXiv preprint, 19 Sep 2024
[arXiv] [Project] [Code]

RenderWorld: World Model with Self-Supervised 3D Label
Ziyang Yan, Wenzhen Dong, Yihua Shao, Yuhang Lu, Liu Haiyang, Jingwen Liu, Haozhe Wang, Zhe Wang, Yan Wang, Fabio Remondino, Yuexin Ma
arXiv preprint, 17 Sep 2024
[arXiv]

UniBEVFusion: Unified Radar-Vision BEVFusion for 3D Object Detection
Haocheng Zhao, Runwei Guan, Taoyu Wu, Ka Lok Man, Limin Yu, Yutao Yue
arXiv preprint, 23 Sep 2024
[arXiv]

GSPR: Multimodal Place Recognition Using 3D Gaussian Splatting for Autonomous Driving
Zhangshuo Qi, Junyi Ma, Jingyi Xu, Zijie Zhou, Luqi Cheng, Guangming Xiong
arXiv preprint, 1 Oct 2024
[arXiv]

LiDAR-GS:Real-time LiDAR Re-Simulation using Gaussian Splatting
Qifeng Chen, Sheng Yang, Sicong Du, Tao Tang, Peng Chen, Yuchi Huo
arXiv preprint, 7 Oct 2024
[arXiv]

DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation
Guosheng Zhao, Chaojun Ni, Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Boyuan Wang, Youyi Zhang, Wenjun Mei, Xingang Wang
arXiv preprint, 17 Oct 2024
[arXiv] [Project] [Code]

3DGS Based Occupancy Prediction

GaussianOcc: Fully Self-supervised and Efficient 3D Occupancy Estimation with Gaussian Splatting
Wanshui Gan, Fang Liu, Hongbin Xu, Ningkai Mo, Naoto Yokoya
arXiv preprint, 21 Aug 2024
[arXiv] [Code]

3DGS Based on Diffusion

L3DG: Latent 3D Gaussian Diffusion
Barbara Roessle, Norman Müller, Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder, Angela Dai, Matthias Nießner
SIGGRAPH Asis 2024, 17 Oct 2024
[arXiv] [Project] [Video]

3DGS Based AIGC

GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise
Xinhai Li, Huaibin Wang, Kuo-Kun Tseng
arXiv preprint, 19 Nov 2023
[arXiv]

LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching
Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, Yingcong Chen
arXiv preprint, 19 Nov 2023
[arXiv] [Github]

LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
Jaeyoung Chung, Suyoung Lee, Hyeongjin Nam, Jaerin Lee, Kyoung Mu Lee
arXiv preprint, 22 Nov 2023
[arXiv] [Project]

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation
Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, Gang Zeng
arXiv preprint, 28 Sep 2023
[arXiv] [Project] [Github]

Text-to-3D using Gaussian Splatting
Zilong Chen, Feng Wang, Huaping Liu
arXiv preprint, 29 Sep 2023
[arXiv] [Project] [Github]

GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors
Taoran Yi, Jiemin Fang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, Xinggang Wang
arXiv preprint, 12 Oct 2023
[arXiv] [Project] [Github]

CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting
Alexander Vilesov, Pradyumna Chari, Achuta Kadambi
arXiv preprint, 29 Nov 2023
[arXiv]

Text2Immersion: Generative Immersive Scene with 3D Gaussians
Hao Ouyang, Kathryn Heal, Stephen Lombardi, Tiancheng Sun
arXiv preprint, 14 Dec 2023
[arXiv] [Project]

Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models
Huan Ling, Seung Wook Kim, Antonio Torralba, Sanja Fidler, Karsten Kreis
CVPR 2024, 21 Dec 2023
[arXiv] [Project]

🔥LangSplat: 3D Language Gaussian Splatting
Minghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang, Hanspeter Pfister
CVPR 2024, 26 Dec 2023
[arXiv] [Project] [Code] [Video]

4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency
Yuyang Yin, Dejia Xu, Zhangyang Wang, Yao Zhao, Yunchao Wei
arXiv preprint, 28 Dec 2023
[arXiv] [Project] [Code]

DreamGaussian4D: Generative 4D Gaussian Splatting
Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, Ziwei Liu
arXiv preprint, 28 Dec 2023
[arXiv] [Project] [Code]

IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generation
Luke Melas-Kyriazi, Iro Laina, Christian Rupprecht, Natalia Neverova, Andrea Vedaldi, Oran Gafni, Filippos Kokkinos
arXiv preprint, 13 Feb 2024
[arXiv]

GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting
Xiaoyu Zhou, Xingjian Ran, Yajiao Xiong, Jinlin He, Zhiwei Lin, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang
arXiv preprint, 11 Feb 2024
[arXiv]

GVGEN: Text-to-3D Generation with Volumetric Representation
Xianglong He, Junyi Chen, Sida Peng, Di Huang, Yangguang Li, Xiaoshui Huang, Chun Yuan, Wanli Ouyang, Tong He
arXiv preprint, 19 Mar 2024
[arXiv] [Project]

BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis
Lutao Jiang, Lin Wang
arXiv preprint, 17 Mar 2024
[arXiv] [Project] [Code]

DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion
Yuanze Lin, Ronald Clark, Philip Torr
arXiv preprint, 25 Mar 2024
[arXiv] [Project] [Code]

GaussianCube: Structuring Gaussian Splatting using Optimal Transport for 3D Generative Modeling
Bowen Zhang, Yiji Cheng, Jiaolong Yang, Chunyu Wang, Feng Zhao, Yansong Tang, Dong Chen, Baining Guo
arXiv preprint, 28 Mar 2024
[arXiv] [Prject] [Code]

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion
Jaidev Shriram, Alex Trevithick, Lingjie Liu, Ravi Ramamoorthi
arXiv preprint, 10 Apr 2024
[arXiv] [Project]

DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
Shijie Zhou, Zhiwen Fan, Dejia Xu, Haoran Chang, Pradyumna Chari, Tejas Bharadwaj, Suya You, Zhangyang Wang, Achuta Kadambi
arXiv preprint, 10 Apr 2024
[arXiv] [Project]

DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling
Xuening Yuan, Hongyu Yang, Yueming Zhao, Di Huang
arXiv preprint, 14 Apr 2024
[arXiv]

DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling
Haoran Li, Haolin Shi, Wenli Zhang, Wenjun Wu, Yong Liao, Lin Wang, Lik-hang Lee, Pengyuan Zhou
arXiv preprint, 4 Apr 2024
[arXiv]

Interactive3D: Create What You Want by Interactive 3D Generation
Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, Tianfan Xue, Dan Xu
arXiv prepring, 25 Apr 2024 [arXiv] [Project] [Code]

FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splatting
Yikun Ma, Dandan Zhan, Zhi Jin
IJCAI 2024, 9 May 2024
[arXiv]

MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes
Ruiyuan Gao, Kai Chen, Zhihao Li, Lanqing Hong, Zhenguo Li, Qiang Xu
arXiv preprint, 23 May 2024
[arXiv]

Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching
Xingyu Miao, Haoran Duan, Varun Ojha, Jun Song, Tejal Shah, Yang Long, Rajiv Ranjan
arXiv preprint, 18 May 2024
[arXiv] [Code]

EG4D: Explicit Generation of 4D Object without Score Distillation
Qi Sun, Zhiyang Guo, Ziyu Wan, Jing Nathan Yan, Shengming Yin, Wengang Zhou, Jing Liao, Houqiang Li
arXiv preprint, 28 May 2024
[arXiv] [Code]

PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting
Qiaowei Miao, Yawei Luo, Yi Yang
arXiv preprint, 30 May 2024
[arXiv] [Project]

Adversarial Generation of Hierarchical Gaussians for 3D Generative Model
Sangeek Hyun, Jae-Pil Heo
arXiv preprint, 5 Jun 2024
[arXiv] [Project]

Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion
Fangfu Liu, Hanyang Wang, Shunyu Yao, Shengjun Zhang, Jie Zhou, Yueqi Duan
arXiv preprint, 6 Jun 2024
[arXiv] [Project]

GaussianCity: Generative Gaussian Splatting for Unbounded 3D City Generation
Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, Ziwei Liu
arXiv preprint, 10 Jun 2024
[arXiv]

MVGamba: Unify 3D Content Generation as State Space Sequence Modeling
Xuanyu Yi, Zike Wu, Qiuhong Shen, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, Shuicheng Yan, Xinchao Wang, Hanwang Zhang
arXiv preprint, 10 Jun 2024
[arXiv]

L4GM: Large 4D Gaussian Reconstruction Model
Jiawei Ren, Kevin Xie, Ashkan Mirzaei, Hanxue Liang, Xiaohui Zeng, Karsten Kreis, Ziwei Liu, Antonio Torralba, Sanja Fidler, Seung Wook Kim, Huan Ling
arXiv preprint, 14 Jun 2024
[arXiv] [Project]

GradeADreamer: Enhanced Text-to-3D Generation Using Gaussian Splatting and Multi-View Diffusion
Trapoom Ukarapol, Kevin Pruvost
arXiv preprint, 14 Jun 2024
[arXiv] [Code]

ClotheDreamer: Text-Guided Garment Generation with 3D Gaussians
Yufei Liu, Junshu Tang, Chu Zheng, Shijie Zhang, Jinkun Hao, Junwei Zhu, Dongjin Huang
arXiv preprint, 24 Jun 2024
[arXiv] [Project]

GaussianDreamerPro: Text to Manipulable 3D Gaussians with Highly Enhanced Quality
Taoran Yi, Jiemin Fang, Zanwei Zhou, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Xinggang Wang, Qi Tian
arXiv preprint, 26 Jun 2024
[arXiv] [Project] [Code]

TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulation
Chaofan Luo, Donglin Di, Yongjia Ma, Zhou Xue, Chen Wei, Xun Yang, Yebin Liu
arXiv preprint, 2 Jul 2024
[arXiv]

HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptions
Haiyang Zhou, Xinhua Cheng, Wangbo Yu, Yonghong Tian, Li Yuan
arXiv preprint, 21 Jul 2024
[arXiv] [Project]

Connecting Consistency Distillation to Score Distillation for Text-to-3D Generation
Zongrui Li, Minghui Hu, Qian Zheng, Xudong Jiang
ECCV 2024, 18 Jul 2024
[arXiv] [Code]

SV4D: Dynamic 3D Content Generation with Multi-Frame and Multi-View Consistency
Yiming Xie, Chun-Han Yao, Vikram Voleti, Huaizu Jiang, Varun Jampani
arXiv preprint, 24 Jul 2024
[arXiv] [Project] [Code]

DreamCouple: Exploring High Quality Text-to-3D Generation Via Rectified Flow
Hangyu Li, Xiangxiang Chu, Dingyuan Shi
arXiv preprint, 9 Aug 2024
[arXiv]

Hi3D: Pursuing High-Resolution Image-to-3D Generation with Video Diffusion Models
Haibo Yang, Yang Chen, Yingwei Pan, Ting Yao, Zhineng Chen, Chong-Wah Ngo, Tao Mei
ACMMM 2024, 11 Sep 2024
[arXiv] [Code]

DreamMapping: High-Fidelity Text-to-3D Generation via Variational Distribution Mapping
Zeyu Cai, Duotun Wang, Yixun Liang, Zhijing Shao, Ying-Cong Chen, Xiaohang Zhan, Zeyu Wang
arXiv preprint, 8 Sep 2024
[arXiv]

DreamHOI: Subject-Driven Generation of 3D Human-Object Interactions with Diffusion Priors
Thomas Hanwen Zhu, Ruining Li, Tomas Jakab
arXiv preprint, 12 Sep 2024
[arXiv]

DreamMesh: Jointly Manipulating and Texturing Triangle Meshes for Text-to-3D Generation
Haibo Yang, Yang Chen, Yingwei Pan, Ting Yao, Zhineng Chen, Zuxuan Wu, Yu-Gang Jiang, Tao Mei
ECCV 2024, 11 Sep 2024
[arXiv] [Project]

DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representation
Zhiqi Li, Yiming Chen, Peidong Liu
NeurIPS 2024, 9 Oct 2024
[arXiv]

RGM: Reconstructing High-fidelity 3D Car Assets with Relightable 3D-GS Generative Model from a Single Image
Xiaoxue Chen, Jv Zheng, Hao Huang, Haoran Xu, Weihao Gu, Kangliang Chen, He xiang, Huan-ang Gao, Hao Zhao, Guyue Zhou, Yaqin Zhang
arXiv preprint, 10 Oct 2024
[arXiv]

DreamSat: Towards a General 3D Model for Novel View Synthesis of Space Objects
Nidhi Mathihalli, Audrey Wei, Giovanni Lavezzi, Peng Mun Siew, Victor Rodriguez-Fernandez, Hodei Urrutxua, Richard Linares
arXiv preprint, 7 Oct 2024
[arXiv] [Code]

Enhancing Single Image to 3D Generation using Gaussian Splatting and Hybrid Diffusion Priors
Hritam Basak, Hadi Tabatabaee, Shreekant Gayaka, Ming-Feng Li, Xin Yang, Cheng-Hao Kuo, Arnie Sen, Min Sun, Zhaozheng Yin
arXiv preprint, 12 Oct 2024
[arXiv]

3D-Adapter: Geometry-Consistent Multi-View Diffusion for High-Quality 3D Generation
Hansheng Chen, Bokui Shen, Yulin Liu, Ruoxi Shi, Linqi Zhou, Connor Z. Lin, Jiayuan Gu, Hao Su, Gordon Wetzstein, Leonidas Guibas
arXiv preprint, 24 Oct 2024
[arXiv] [Project] [Code]

CompGS: Unleashing 2D Compositionality for Compositional Text-to-3D via Dynamically Optimizing 3D Gaussians
Chongjian Ge, Chenfeng Xu, Yuanfeng Ji, Chensheng Peng, Masayoshi Tomizuka, Ping Luo, Mingyu Ding, Varun Jampani, Wei Zhan
arXiv preprint, 28 Oct 2024
[arXiv] [Project]]

DiffGS: Functional Gaussian Splatting Diffusion
Junsheng Zhou, Weiqi Zhang, Yu-Shen Liu
NeurIPS 2024, 25 Oct 2024
[arXiv] [Project] [Code]

3DGS Model Compactness Optimization

3DGS Model Compression Surveys

3DGS.zip: A survey on 3D Gaussian Splatting Compression Methods
Milena T. Bagdasarian, Paul Knoll, Florian Barthel, Anna Hilsmann, Peter Eisert, Wieland Morgenstern
arXiv preprint, 17 Jun 2024
[arXiv] [Project]

3DGS Model Compression Progresses

LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Zhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu, Dejia Xu, Zhangyang Wang
arXiv preprint, 28 Nov 2023
[arXiv] [Project] [Video]

Identifying Unnecessary 3D Gaussians using Clustering for Fast Rendering of 3D Gaussian Splatting
Joongho Jo, Hyeongwon Kim, Jongsun Park
arXiv preprint, 21 Feb 2024
[arXiv]

HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression
Yihang Chen, Qianyi Wu, Weiyao Lin, Mehrtash Harandi, Jianfei Cai
ECCV 2024, 21 Mar 2024
[arXiv] [Project] [Code]

CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting
Xiangrui Liu, Xinju Wu, Pingping Zhang, Shiqi Wang, Zhu Li, Sam Kwong
arXiv preprint, 15 Apr 2024
[arXiv]

F-3DGS: Factorized Coordinates and Representations for 3D Gaussian Splatting
Xiangyu Sun, Joo Chan Lee, Daniel Rho, Jong Hwan Ko, Usman Ali, Eunbyung Park
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

LP-3DGS: Learning to Prune 3D Gaussian Splatting
Zhaoliang Zhang, Tianchen Song, Yongjae Lee, Li Yang, Cheng Peng, Rama Chellappa, Deliang Fan
arXiv preprint, 29 May 2024
[arXiv]

ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Model
Yufei Wang, Zhihao Li, Lanqing Guo, Wenhan Yang, Alex C. Kot, Bihan Wen
arXiv preprint, 31 May 2024
[arXiv]

Gaussian-Forest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling
Fengyi Zhang, Tianjun Zhang, Lin Zhang, Helen Huang, Yadan Luo
arXiv preprint, 13 Jun 2024
[arXiv]

🔥Reducing the Memory Footprint of 3D Gaussian Splatting
Panagiotis Papantonakis, Georgios Kopanas, Bernhard Kerbl, Alexandre Lanvin, George Drettakis
arXiv preprint, 24 Jun 2024
[arXiv] [Project]

Lightweight Predictive 3D Gaussian Splats
Junli Cao, Vidit Goel, Chaoyang Wang, Anil Kag, Ju Hu, Sergei Korolev, Chenfanfu Jiang, Sergey Tulyakov, Jian Ren
arXiv preprint, 27 Jun 2024
[arXiv] [Project]

Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruning
Muhammad Salman Ali, Maryam Qamar, Sung-Ho Bae, Enzo Tartaglione
arXiv preprint, 26 Jun 2024
[arXiv]

A Benchmark for Gaussian Splatting Compression and Quality Assessment Study
Qi Yang, Kaifa Yang, Yuke Xing, Yiling Xu, Zhu Li
arXiv preprint, 19 Jul 2024
[arXiv] [Code]

Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fields
Joo Chan Lee, Daniel Rho, Xiangyu Sun, Jong Hwan Ko, Eunbyung Park
arXiv preprint, 7 Aug 2024
[arXiv]

MesonGS: Post-training Compression of 3D Gaussians via Efficient Attribute Transformation
Shuzhao Xie, Weixiang Zhang, Chen Tang, Yunpeng Bai, Rongwei Lu, Shijia Ge, Zhi Wang
ECCV 2024, 15 Sep 2024
[arXiv]

Fast Feedforward 3D Gaussian Splatting Compression
Yihang Chen, Qianyi Wu, Mengyao Li, Weiyao Lin, Mehrtash Harandi, Jianfei Cai
arXiv preprint, 10 Oct 2024
[arXiv] [Project] [Code]

ELMGS: Enhancing memory and computation scaLability through coMpression for 3D Gaussian Splatting
Muhammad Salman Ali, Sung-Ho Bae, Enzo Tartaglione
arXiv preprint, 30 Oct 2024
[arXiv]

3DGS Streaming

3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos
Jiakai Sun, Han Jiao, Guangyuan Li, Zhanjie Zhang, Lei Zhao, Wei Xing
CVPR 2024, 3 Mar 2024
[arXiv] [Project] [Code]

HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression
Yihang Chen, Qianyi Wu, Jianfei Cai, Mehrtash Harandi, Weiyao Lin
arXiv preprint, 12 Mar 2024
[arXiv] [Project] [Code]

LapisGS: Layered Progressive 3D Gaussian Splatting for Adaptive Streaming
Yuang Shi, Simone Gasparini, Géraldine Morin, Wei Tsang Ooi
arXiv preprint, 27 Aug 2024
[arXiv]

PRoGS: Progressive Rendering of Gaussian Splats
Brent Zoomers, Maarten Wijnants, Ivan Molenaers, Joni Vanherck, Jeroen Put, Lode Jorissen, Nick Michiels
arXiv preprint, 3 Sep 2024
[arXiv]

SwinGS: Sliding Window Gaussian Splatting for Volumetric Video Streaming with Arbitrary Length
Bangya Liu, Suman Banerjee
[arXiv]

3DGS Based Relighting

Subsurface Scattering for 3D Gaussian Splatting
Jan-Niklas Dihlmann, Arjun Majumdar, Andreas Engelhardt, Raphael Braun, Hendrik P.A. Lensch
arXiv preprint, 22 Aug 2024
[arXiv] [Project] [Code]

3DGS Robotics

3DGS Robotics Surveys

3D Gaussian Splatting in Robotics: A Survey
Siting Zhu, Guangming Wang, Dezhi Kong, Hesheng Wang
arXiv preprint, 16 Oct 2024
[arXiv]

Neural Fields in Robotics: A Survey
Muhammad Zubair Irshad, Mauro Comi, Yen-Chen Lin, Nick Heppert, Abhinav Valada, Rares Ambrus, Zsolt Kira, Jonathan Tremblay
arXiv preprint, 26 Oct 2024
[arXiv] [Project]

3DGS Robotics Progresses

Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps
Timothy Chen, Ola Shorinwa, Weijia Zeng, Joseph Bruno, Philip Dames, Mac Schwager
arXiv preprint, 5 Mar 2023
[arXiv]

ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation
Guanxing Lu, Shiyi Zhang, Ziwei Wang, Changliu Liu, Jiwen Lu, Yansong Tang
arXiv preprint, 13 Mar 2024
[arXiv]

Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splatting
Ola Shorinwa, Johnathan Tucker, Aliyah Smith, Aiden Swann, Timothy Chen, Roya Firoozi, Monroe Kennedy III, Mac Schwager
arXiv preprint, 7 Mar 2024
[arXiv]

Query-based Semantic Gaussian Field for Scene Representation in Reinforcement Learning
Jiaxu Wang, Ziyi Zhang, Qiang Zhang, Jia Li, Jingkai Sun, Mingyuan Sun, Junhao He, Renjing Xu
arXiv preprint, 4 Jun 2024
[arXiv]

Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks
Alex Quach, Makram Chahine, Alexander Amini, Ramin Hasani, Daniela Rus
arXiv preprint, 21 Jun 2024
[arXiv]

Robo-GS: A Physics Consistent Spatial-Temporal Model for Robotic Arm with Hybrid Representation
Haozhe Lou, Yurong Liu, Yike Pan, Yiran Geng, Jianteng Chen, Wenlong Ma, Chenglong Li, Lin Wang, Hengzhen Feng, Lu Shi, Liyi Luo, Yongliang Shi
arXiv preprint, 27 Aug 2024
[arXiv] [Project] [Video]

GaussianPU: A Hybrid 2D-3D Upsampling Framework for Enhancing Color Point Clouds via 3D Gaussian Splatting
Zixuan Guo, Yifan Xie, Weijing Xie, Peng Huang, Fei Ma, Fei Richard Yu
arXiv preprint, 3 Sep 2024
[arXiv]

GraspSplats: Efficient Manipulation with 3D Feature Splatting
Mazeyu Ji, Ri-Zhao Qiu, Xueyan Zou, Xiaolong Wang
arXiv preprint, 3 Sep 2024
[arXiv] [Project] [Video] [Code]

SplatSim: Zero-Shot Sim2Real Transfer of RGB Manipulation Policies Using Gaussian Splatting
Mohammad Nomaan Qureshi, Sparsh Garg, Francisco Yandun, David Held, George Kantor, Abhishesh Silwal
arXiv preprint, 16 Sep 2024
[arXiv]

BEINGS: Bayesian Embodied Image-goal Navigation with Gaussian Splatting
Wugang Meng, Tianfu Wu, Huan Yin, Fumin Zhang
arXiv preprint, 16 Sep 2024
[arXiv]

SAFER-Splat: A Control Barrier Function for Safe Navigation with Online Gaussian Splatting Maps
Timothy Chen, Aiden Swann, Javier Yu, Ola Shorinwa, Riku Murai, Monroe Kennedy III, Mac Schwager
arXiv preprint, 15 Sep 2024
[arXiv] [Project]

RT-GuIDE: Real-Time Gaussian splatting for Information-Driven Exploration
Yuezhan Tao, Dexter Ong, Varun Murali, Igor Spasojevic, Pratik Chaudhari, Vijay Kumar
arXiv preprint, 26 Sep 2024
[arXiv] [Project] [Video]

Language-Embedded Gaussian Splats (LEGS): Incrementally Building Room-Scale Representations with a Mobile Robot
Justin Yu, Kush Hari, Kishore Srinivas, Karim El-Refai, Adam Rashid, Chung Min Kim, Justin Kerr, Richard Cheng, Muhammad Zubair Irshad, Ashwin Balakrishna, Thomas Kollar, Ken Goldberg
arXiv preprint, 26 Sep 2024
[arXiv]

HGS-Planner: Hierarchical Planning Framework for Active Scene Reconstruction Using 3D Gaussian Splatting
Zijun Xu, Rui Jin, Ke Wu, Yi Zhao, Zhiwei Zhang, Jieru Zhao, Zhongxue Gan, Wenchao Ding
arXiv preprint, 26 Sep 2024
[arXiv]

Let's Make a Splan: Risk-Aware Trajectory Optimization in a Normalized Gaussian Splat
Jonathan Michaux, Seth Isaacson, Challen Enninful Adu, Adam Li, Rahul Kashyap Swayampakula, Parker Ewen, Sean Rice, Katherine A. Skinner, Ram Vasudevan
arXiv preprint, 26 Sep 2024
[arXiv]

RL-GSBridge: 3D Gaussian Splatting Based Real2Sim2Real Method for Robotic Manipulation Learning
Yuxuan Wu, Lei Pan, Wenhua Wu, Guangming Wang, Yanzi Miao, Hesheng Wang
arXiv preprint, 30 Sep 2024
[arXiv]

SplaTraj: Camera Trajectory Generation with Semantic Gaussian Splatting
Xinyi Liu, Tianyi Zhang, Matthew Johnson-Roberson, Weiming Zhi
arXiv preprint, 8 Oct 2024
[arXiv]

Next Best Sense: Guiding Vision and Touch with FisherRF for 3D Gaussian Splatting
Matthew Strong, Boshu Lei, Aiden Swann, Wen Jiang, Kostas Daniilidis, Monroe Kennedy III
arXiv preprint, 7 Oct 2024
[arXiv] [Project] [Video] [Code]

Mode-GS: Monocular Depth Guided Anchored 3D Gaussian Splatting for Robust Ground-View Scene Rendering
Yonghan Lee, Jaehoon Choi, Dongki Jung, Jaeseong Yun, Soohyun Ryu, Dinesh Manocha, Suyong Yeon
arXiv preprint, 6 Oct 2024
[arXiv]

L-VITeX: Light-weight Visual Intuition for Terrain Exploration
Antar Mazumder, Zarin Anjum Madhiha
arXiv preprint, 10 Oct 2024
[arXiv]

Gaussian Splatting Visual MPC for Granular Media Manipulation
Wei-Cheng Tseng, Ellina Zhang, Krishna Murthy Jatavallabhula, Florian Shkurti
arXiv preprint, 13 Oct 2024
[arXiv] [Project]

Differentiable Robot Rendering
Ruoshi Liu, Alper Canberk, Shuran Song, Carl Vondrick
arXiv preprint, 17 Oct 2024
[arXiv] [Project] [Video] [Code]

MSGField: A Unified Scene Representation Integrating Motion, Semantics, and Geometry for Robotic Manipulation
Yu Sheng, Runfeng Lin, Lidian Wang, Quecheng Qiu, YanYong Zhang, Yu Zhang, Bei Hua, Jianmin Ji
arXiv preprint, 21 Oct 2024
[arXiv] [Project] [Code]

Dynamic 3D Gaussian Tracking for Graph-Based Neural Dynamics Modeling
Mingtong Zhang, Kaifeng Zhang, Yunzhu Li
arXiv preprint, 24 Oct 2024
[arXiv] [Project] [Code]

E-3DGS: Gaussian Splatting with Exposure and Motion Events
Xiaoting Yin, Hao Shi, Yuhan Bao, Zhenshan Bing, Yiyi Liao, Kailun Yang, Kaiwei Wang
arXiv preprint, 22 Oct 2024
[arXiv] [Code]

ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splatting
Yuetao Li, Zijia Kuang, Ting Li, Guyue Zhou, Shaohui Zhang, Zike Yan
arXiv preprint, 29 Oct 2024
[arXiv] [Project] [Video]

Get a Grip: Multi-Finger Grasp Evaluation at Scale Enables Robust Sim-to-Real Transfer
Tyler Ga Wei Lum, Albert H. Li, Preston Culbertson, Krishnan Srinivasan, Aaron D. Ames, Mac Schwager, Jeannette Bohg
arXiv preprint, 31 Oct 2024
[arXiv] [Project] [Video]

3DGS-CD: 3D Gaussian Splatting-based Change Detection for Physical Object Rearrangement
Ziqi Lu, Jianbo Ye, John Leonard
arXiv preprint, 6 Nov 2024
[arXiv] [Code]

Object and Contact Point Tracking in Demonstrations Using 3D Gaussian Splatting
Michael Büttner, Jonathan Francis, Helge Rhodin, Andrew Melnik
CoRL 2024, 5 Nov 2024
[arXiv]

Modeling Uncertainty in 3D Gaussian Splatting through Continuous Semantic Splatting
Joey Wilson, Marcelino Almeida, Min Sun, Sachit Mahajan, Maani Ghaffari, Parker Ewen, Omid Ghasemalizadeh, Cheng-Hao Kuo, Arnie Sen
arXiv preprint, 4 Nov 2024
[arXiv]

3DGS Avatar Generation

3DGS Avatar Generation Survey

A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation
Ruihe Wang, Yukang Cao, Kai Han, Kwan-Yee K. Wong
arXiv preprint, 6 Jun 2024
[arXiv]

3DGS Avatar Generation Progresses

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars
Yang Liu, Xiang Huang, Minghan Qin, Qinwei Lin, Haoqian Wang
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting
Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu
arXiv preprint, 28 Nov 2023
[arXiv] [Project]

HUGS: Human Gaussian Splats
Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel, Anurag Ranjan
arXiv preprint, 29 Nov 2023
[arXiv]

Gaussian Shell Maps for Efficient 3D Human Generation
Rameen Abdal, Wang Yifan, Zifan Shi, Yinghao Xu, Ryan Po, Zhengfei Kuang, Qifeng Chen, Dit-Yan Yeung, Gordon Wetzstein
arXiv preprint, 29 Nov 2023
[arXiv]

GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis
Shunyuan Zheng, Boyao Zhou, Ruizhi Shao, Boning Liu, Shengping Zhang, Liqiang Nie, Yebin Liu
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians
Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Shengping Zhang, Liqiang Nie
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Shenhan Qian, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Simon Giebenhain, Matthias Nießner
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianHead: Impressive 3D Gaussian-based Head Avatars with Dynamic Hybrid Neural Field
Jie Wang, Xianyan Li, Jiucheng Xie, Feng Xu, Hao Gao
arXiv preprint, 4 Dec 2023
[arXiv]

GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
Shoukang Hu, Ziwei Liu
CVPR 2024, 5 Dec, 2023
[arXiv] [Project] [Code]

HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
Helisa Dhamo, Yinyu Nie, Arthur Moreau, Jifei Song, Richard Shaw, Yiren Zhou, Eduardo Pérez-Pellitero
arXiv preprint, 5 Dec, 2023
[arXiv]

Relightable Gaussian Codec Avatars
Shunsuke Saito, Gabriel Schwartz, Tomas Simon, Junxuan Li, Giljoo Nam
CVPR 2024, 5 Dec 2023
[arXiv] [Project]

HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting
Yuheng Jiang, Zhehao Shen, Penghao Wang, Zhuo Su, Yu Hong, Yingliang Zhang, Jingyi Yu, Lan Xu
arXiv preprint, 6 Dec, 2023
[arXiv]

MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar
Yufan Chen, Lizhen Wang, Qijing Li, Hongjiang Xiao, Shengping Zhang, Hongxun Yao, Yebin Liu
SIGGRAPH 2024, 7 Dec, 2023
[arXiv] [Project] [Code] [Video]

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Haokai Pang, Heming Zhu, Adam Kortylewski, Christian Theobalt, Marc Habermann
arXiv preprint, 10 Dec 2023
[arXiv] [Project] [Code]

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting
Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang
CVPR 2024, 14 Dec 2023
[arXiv] [Project] [Code]

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
Ye Yuan, Xueting Li, Yangyi Huang, Shalini De Mello, Koki Nagano, Jan Kautz, Umar Iqbal
CVPR 2024, 18 Dec 2023
[arXiv] [Project] [Video]

3D Points Splatting for Real-Time Dynamic Hand Reconstruction
Zheheng Jiang, Hossein Rahmani, Sue Black, Bryan M. Williams
arXiv preprint, 21 Dec 2023
[arXiv]

Human101: Training 100+FPS Human Gaussians in 100s from 1 View
Mingwei Li, Jiachen Tao, Zongxin Yang, Yi Yang
arXiv preprint, 23 Dec 2023
[arXiv] [Code]

Gaussian Shadow Casting for Neural Characters
Luis Bolanos, Shih-Yang Su, Helge Rhodin
arXiv preprint, 11 Jan 2024
[arXiv]

GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Xuangeng Chu, Yu Li, Ailing Zeng, Tianyu Yang, Lijian Lin, Yunfei Liu, Tatsuya Harada
ICLR 2024, 18 Jan 2024
[arXiv] [Code]

PSAvatar: A Point-based Morphable Shape Model for Real-Time Head Avatar Creation with 3D Gaussian Splatting
Zhongyuan Zhao, Zhenyu Bao, Qing Li, Guoping Qiu, Kanglin Liu
arXiv preprint, 23 Jan 2024
[arXiv]

ImplicitDeepfake: Plausible Face-Swapping through Implicit Deepfake Generation using NeRF and Gaussian Splatting
Georgii Stanishevskii, Jakub Steczkiewicz, Tomasz Szczepanik, Sławomir Tadeja, Jacek Tabor, Przemysław Spurek
arXiv preprint, 9 Feb 2024
[arXiv]

GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians
Haimin Luo, Min Ouyang, Zijun Zhao, Suyi Jiang, Longwen Zhang, Qixuan Zhang, Wei Yang, Lan Xu, Jingyi Yu
arXiv preprint, 16 Feb 2024
[arXiv]

HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
Zhenglin Zhou, Fan Ma, Hehe Fan, Yi Yang
arXiv preprint, 9 Feb 2024
[arXiv]

Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos
Alfredo Rivero, ShahRukh Athar, Zhixin Shu, Dimitris Samaras
arXiv preprint, 6 Feb 2024
[arXiv] [Project]

SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface
Jiahao Luo, Jing Liu, James Davis
arXiv preprint, 27 Mar 2024
[arXiv]

HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior
David Svitov, Pietro Morerio, Lourdes Agapito, Alessio Del Bue
arXiv preprint, 1 Apr 2024
[arXiv]

GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing, Shenlong Wang
CVPR 2024, 11 Apr 2024
[arXiv] [Project] [Code]

OccGaussian: 3D Gaussian Splatting for Occluded Human Rendering
Jingrui Ye, Zongkai Zhang, Yujiao Jiang, Qingmin Liao, Wenming Yang, Zongqing Lu
arXiv preprint, 12 Apr 2024
[arXiv]

GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting
Hongyun Yu, Zhan Qu, Qihang Yu, Jianchuan Chen, Zhonghua Jiang, Zhiwen Chen, Shengyu Zhang, Jimin Xu, Fei Wu, Chengfei Lv, Gang Yu
arXiv preprint, 22 Apr 2024
[arXiv] [Project] [Video]

3D Gaussian Blendshapes for Head Avatar Animation
Shengjie Ma, Yanlin Weng, Tianjia Shao, Kun Zhou
SIGGRAPH 2024, 30 Apr 2024
[arXiv]

GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting
Kyusun Cho, Joungbin Lee, Heeji Yoon, Yeobin Hong, Jaehoon Ko, Sangjun Ahn, Seungryong Kim
arXiv preprint, 24 Apr 2024
[arXiv] [Code]

GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting
Bo Chen, Shoukang Hu, Qi Chen, Chenpeng Du, Ran Yi, Yanmin Qian, Xie Chen
arXiv preprint, 29 Apr 2024
[arXiv]

MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing
Cong Wang, Di Kang, He-Yi Sun, Shen-Han Qian, Zi-Xuan Wang, Linchao Bao, Song-Hai Zhang
arXiv preprint, 29 Apr 2024
[arXiv] [Project]

Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras
*Hanzhang Tu, Ruizhi Shao, Xue Dong, Shunyuan Zheng, Hao Zhang, Lili Chen, Meili Wang, Wenyu Li, Siyan Ma, Shengping Zhang, Boyao Zhou, Yebin Liu
SIGGRAPH 2024, 23 May 2024
[arXiv] [Project] [Video]

LAGA: Layered 3D Avatar Generation and Customization via Gaussian Splatting
Jia Gong, Shenyu Ji, Lin Geng Foo, Kang Chen, Hossein Rahmani, Jun Liu
arXiv preprint, 21 May 2024
[arXiv]

Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery
Hongsheng Wang, Weiyue Zhang, Sihao Liu, Xinrui Zhou, Shengyu Zhang, Fei Wu, Feng Lin
arXiv preprint, 21 May 2024
[arXiv] [Project] [Code]

Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping
Tianhao Wu, Jing Yang, Zhilin Guo, Jingyi Wan, Fangcheng Zhong, Cengiz Oztireli
arXiv preprint, 20 May 2024
[arXiv] [Project]

FAGhead: Fully Animate Gaussian Head from Monocular Videos
Yixin Xuan, Xinyang Li, Gongxin Yao, Shiwei Zhou, Donghui Sun, Xiaoxin Chen, Yu Pan
arXiv preprint, 27 Jun 2024
[arXiv]

Expressive Gaussian Human Avatars from Monocular RGB Video
Hezhen Hu, Zhiwen Fan, Tianhao Wu, Yihan Xi, Seoyoung Lee, Georgios Pavlakos, Zhangyang Wang
arXiv preprint, 3 Jul 2024
[arXiv] [Project]

MeshAvatar: Learning High-quality Triangular Human Avatars from Multi-view Videos
Yushuo Chen, Zerong Zheng, Zhe Li, Chao Xu, Yebin Liu
arXiv preprint, 11 Jul 2024
[arXiv] [Project] [Code]

Interactive Rendering of Relightable and Animatable Gaussian Avatars
Youyi Zhan, Tianjia Shao, He Wang, Yin Yang, Kun Zhou
arXiv preprint, 15 Jul 2024
[arXiv]

Generalizable Human Gaussians for Sparse View Synthesis
Youngjoong Kwon, Baole Fang, Yixing Lu, Haoye Dong, Cheng Zhang, Francisco Vicente Carrasco, Albert Mosella-Montoro, Jianjin Xu, Shingo Takagi, Daeil Kim, Aayush Prakash, Fernando De la Torre
arXiv preprint, 17 Jul 2024
[arXiv]

iHuman: Instant Animatable Digital Humans From Monocular Videos
Pramish Paudel, Anubhav Khanal, Ajad Chhatkuli, Danda Pani Paudel, Jyoti Tandukar
ECCV 2024, 15 Jul 2024
[arXiv]

HeadGAP: Few-shot 3D Head Avatar via Generalizable Gaussian Priors
Xiaozheng Zheng, Chao Wen, Zhaohu Li, Weiyi Zhang, Zhuo Su, Xu Chang, Yang Zhao, Zheng Lv, Xiaoyuan Zhang, Yongjie Zhang, Guidong Wang, Lan Xu
arXiv preprint, 12 Aug 2024
[arXiv] [Project]

DEGAS: Detailed Expressions on Full-Body Gaussian Avatars
Zhijing Shao, Duotun Wang, Qing-Yao Tian, Yao-Dong Yang, Hengyu Meng, Zeyu Cai, Bo Dong, Yu Zhang, Kang Zhang, Zeyu Wang
arXiv preprint, 20 Aug 2024
[arXiv]

SG-GS: Photo-realistic Animatable Human Avatars with Semantically-Guided Gaussian Splatting
Haoyu Zhao, Chen Yang, Hao Wang, Xingyue Zhao, Wei Shen
arXiv preprint, 19 Aug 2024
[arXiv]

CHASE: 3D-Consistent Human Avatars with Sparse Inputs via Gaussian Splatting and Contrastive Learning
Haoyu Zhao, Hao Wang, Chen Yang, Wei Shen
arXiv preprint, 19 Aug 2024
[arXiv]

Human-VDM: Learning Single-Image 3D Human Gaussian Splatting from Video Diffusion Models
Zhibin Liu, Haoye Dong, Aviral Chharia, Hefeng Wu
arXiv preprint, 4 Sep 2024
[arXiv] [Project] [Code]

Instant Facial Gaussians Translator for Relightable and Interactable Facial Rendering
Dafei Qin, Hongyang Lin, Qixuan Zhang, Kaichun Qiao, Longwen Zhang, Zijun Zhao, Jun Saito, Jingyi Yu, Lan Xu, Taku Komura
arXiv preprint, 11 Sep 2024
[arXiv] [Project] [Video]

GST: Precise 3D Human Body from a Single Image with Gaussian Splatting Transformers
Lorenza Prospero, Abdullah Hamdi, Joao F. Henriques, Christian Rupprecht
arXiv preprint, 6 Sep 2024
[arXiv] [Project] [Video] [Code]

JEAN: Joint Expression and Audio-guided NeRF-based Talking Face Generation
Sai Tanmay Reddy Chakkera, Aggelina Chatziagapi, Dimitris Samaras
BMVC 2024, 18 Sep 2024
[arXiv] [Project] [Video]

Disco4D: Disentangled 4D Human Generation and Animation from a Single Image
Hui En Pang, Shuai Liu, Zhongang Cai, Lei Yang, Tianwei Zhang, Ziwei Liu
arXiv preprint, 25 Sep 2024
[arXiv] [Project]

Gaussian Deja-vu: Creating Controllable 3D Gaussian Head-Avatars with Enhanced Generalization and Personalization Abilities
Peizhi Yan, Rabab Ward, Qiang Tang, Shan Du
WACV 2024, 23 Sep 2024
[arXiv]

Human Hair Reconstruction with Strand-Aligned 3D Gaussians
Egor Zakharov, Vanessa Sklyarova, Michael Black, Giljoo Nam, Justus Thies, Otmar Hilliges
arXiv preprint, 23 Sep 2024
[arXiv]

EVA-Gaussian: 3D Gaussian-based Real-time Human Novel View Synthesis under Diverse Camera Settings
Yingdong Hu, Zhening Liu, Jiawei Shao, Zehong Lin, Jun Zhang
arXiv preprint, 2 Oct 2024
[arXiv] [Project]

DifFRelight: Diffusion-Based Facial Performance Relighting
Mingming He, Pascal Clausen, Ahmet Levent Taşel, Li Ma, Oliver Pilarski, Wenqi Xian, Laszlo Rikker, Xueming Yu, Ryan Burgert, Ning Yu, Paul Debevec
SIGGRAPH Asia 2024, 10 Oct 2024
[arXiv] [Project]

GS-VTON: Controllable 3D Virtual Try-on with Gaussian Splatting
Yukang Cao, Masoud Hadi, Liang Pan, Ziwei Liu
arXiv preprint, 7 Oct 2024
[arXiv]

LoDAvatar: Hierarchical Embedding and Adaptive Levels of Detail with Gaussian Splatting for Enhanced Human Avatars
Xiaonuo Dongye, Hanzhi Guo, Le Luo, Haiyan Jiang, Yihua Bao, Zeyu Tian, Dongdong Weng
arXiv preprint, 28 Oct 2024
[arXiv]

HFGaussian: Learning Generalizable Gaussian Human with Integrated Human Features
Arnab Dey, Cheng-You Lu, Andrew I. Comport, Srinath Sridhar, Chin-Teng Lin, Jean Martinet
arXiv preprint, 5 Nov 2024
[arXiv]

3DGS Clothes/Garment

GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting
Haodong Chen, Yongle Huang, Haojian Huang, Xiangsheng Ge, Dian Shao
arXiv preprint, 13 May 2024
[arXiv]

MOSS: Motion-based 3D Clothed Human Synthesis from Monocular Video
Hongsheng Wang, Xiang Cai, Xi Sun, Jinhong Yue, Shengyu Zhang, Feng Lin, Fei Wu
arXiv preprint, 21 May 2024
[arXiv] [Project] [Code]

GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
Boqian Li, Xuan Li, Ying Jiang, Tianyi Xie, Feng Gao, Huamin Wang, Yin Yang, Chenfanfu Jiang
arXiv preprint, 20 May 2024
[arXiv] [Project]

NPGA: Neural Parametric Gaussian Avatars
Simon Giebenhain, Tobias Kirschstein, Martin Rünz, Lourdes Agapito, Matthias Nießner
arXiv preprint, 29 May 2024
[arXiv] [Project] [Video]

GGHead: Fast and Generalizable 3D Gaussian Heads
Tobias Kirschstein, Simon Giebenhain, Jiapeng Tang, Markos Georgopoulos, Matthias Nießner
arXiv preprint, 13 Jun 2024
[arXiv] [Projectt] [Video]

Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
Yuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-Moll
arXiv preprint, 12 Jun 2024
[arXiv] [Project] [Code]

HumanSplat: Generalizable Single-Image HumanGaussianSplattingwith Structure Priors
Panwang Pan, Zhuo Su, Chenguo Lin, Zhen Fan, Yongjie Zhang, Zeming Li, Tingting Shen, Yadong Mu, Yebin Liu
arXiv preprint, 18 Jun 2024
[arXiv] [Project]

PICA: Physics-Integrated Clothed Avatar
Bo Peng, Yunfan Tao, Haoyu Zhan, Yudong Guo, Juyong Zhang
arXiv preprint, 7 Jul 2024
[arXiv] [Project]

Gaussian Eigen Models for Human Heads
Wojciech Zielonka, Timo Bolkart, Thabo Beeler, Justus Thies
arXiv preprint, 5 Jul 2024
[arXiv] [Project]

3DGS Scene Editing and Animation

Animatable 3D Gaussians for High-fidelity Synthesis of Human Motions
Keyang Ye, Tianjia Shao, Kun Zhou
arXiv preprint, 22 Nov 2023
[arXiv]

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin
arXiv preprint, 24 Nov 2023
[arXiv] [Project]

Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing
Jian Gao, Chun Gu, Youtian Lin, Hao Zhu, Xun Cao, Li Zhang, Yao Yao
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

GART: Gaussian Articulated Template Models
Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, Kostas Daniilidis
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling
Zhe Li, Zerong Zheng, Lizhen Wang, Yebin Liu
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
Jiajun Huang, Hongchuan Yu
arXiv preprint, 28 Nov, 2023
[arXiv]

TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts
Jingyu Zhuang, Di Kang, Yan-Pei Cao, Guanbin Li, Liang Lin, Ying Shan
SIGGRAPH 2024, 26 Jan 2024
[arXiv]

GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting
Joanna Waczyńska, Piotr Borycki, Sławomir Tadeja, Jacek Tabor, Przemysław Spurek
arXiv preprint, 2 Feb 2024
[arXiv]

GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
Jing Wu, Jia-Wang Bian, Xinghui Li, Guangrun Wang, Ian Reid, Philip Torr, Victor Adrian Prisacariu
arXiv preprint, 13 Mar 2024
[arXiv] [Project]

Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing
Tian-Xing Xu, Wenbo Hu, Yu-Kun Lai, Ying Shan, Song-Hai Zhang
arXiv preprint, 15 Mar 2024
[arXiv]

View-Consistent 3D Editing with Gaussian Splatting
Yuxuan Wang, Xuanyu Yi, Zike Wu, Na Zhao, Long Chen, Hanwang Zhang
arXiv preprint, 18 Mar 2024
[arXiv] [Project]

Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing
Ri-Zhao Qiu, Ge Yang, Weijia Zeng, Xiaolong Wang
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Code]

GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal
Yuxin Wang, Qianyi Wu, Guofeng Zhang, Dan Xu
arXiv preprint, 21 Apr 2024
[arXiv] [Project]

DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing
Minghao Chen, Iro Laina, Andrea Vedaldi
arXiv preprint, 29 Apr 2024
[arXiv] [Project] [Code]

TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing
Teng Xu, Jiamin Chen, Peng Chen, Youjia Zhang, Junqing Yu, Wei Yang
arXiv preprint, 23 May 2024
[arXiv]

D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soup
Joanna Waczyńska, Piotr Borycki, Joanna Kaleta, Sławomir Tadeja, Przemysław Spurek
arXiv preprint, 23 May 2024
[arXiv]

ICE-G: Image Conditional Editing of 3D Gaussian Splats
Vishnu Jaganathan, Hannah Hanyun Huang, Muhammad Zubair Irshad, Varun Jampani, Amit Raj, Zsolt Kira
CVPR AI4CC Workshop 2024, 12 Jun 2024
[arXiv] [Project]

3DEgo: 3D Editing on the Go!
Umar Khalid, Hasan Iqbal, Azib Farooq, Jing Hua, Chen Chen
ECCV 2024, 14 Jul 2024
[arXiv] [Project]

3D Gaussian Editing with A Single Image
Guan Luo, Tian-Xing Xu, Ying-Tian Liu, Xiao-Xiong Fan, Fang-Lue Zhang, Song-Hai Zhang
arXiv preprint, 14 Aug 2024
[arXiv]

LumiGauss: High-Fidelity Outdoor Relighting with 2D Gaussian Splatting
Joanna Kaleta, Kacper Kania, Tomasz Trzcinski, Marek Kowalski
arXiv preprint, 6 Aug 2024
[arXiv]

Generative Object Insertion in Gaussian Splatting with a Multi-View Diffusion Model
Hongliang Zhong, Can Wang, Jingbo Zhang, Jing Liao
arXiv preprint, 25 Sep 2024
[arXiv] [Code]

GaussianBlock: Building Part-Aware Compositional and Editable 3D Scene by Primitives and Gaussians
Shuyi Jiang, Qihao Zhao, Hossein Rahmani, De Wen Soh, Jun Liu, Na Zhao
arXiv preprint, 2 Oct 2024
[arXiv]

MiraGe: Editable 2D Images using Gaussian Splatting
Joanna Waczyńska, Tomasz Szczepanik, Piotr Borycki, Sławomir Tadeja, Thomas Bohné, Przemysław Spurek
arXiv preprint, 2 Oct 2024
[arXiv]

RNG: Relightable Neural Gaussians
Jiahui Fan, Fujun Luan, Jian Yang, Miloš Hašan, Beibei Wang
arXiv preprint, 29 Sep 2024
[arXiv]

ProEdit: Simple Progression is All You Need for High-Quality 3D Scene Editing
Jun-Kun Chen, Yu-Xiong Wang
NeurIPS 2024, 7 Nov 2024
[arXiv] [Project]

3DGS Stylization

Gaussian Splatting in Style
Abhishek Saroha, Mariia Gladkova, Cecilia Curreli, Tarun Yenamandra, Daniel Cremers
arXiv preprint, 13 Mar 2024
[arXiv]

StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting
Kunhao Liu, Fangneng Zhan, Muyu Xu, Christian Theobalt, Ling Shao, Shijian Lu
arXiv preprint, 12 Mar 2024
[arXiv] [Project] [Code]

StylizedGS: Controllable Stylization for 3D Gaussian Splatting
Dingxi Zhang, Zhuoxun Chen, Yu-Jie Yuan, Fang-Lue Zhang, Zhenliang He, Shiguang Shan, Lin Gao
arXiv preprint, 8 Apr 2024
[arXiv]

InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior
Zhiheng Liu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng, Jie Xiao, Kai Zhu, Nan Xue, Yu Liu, Yujun Shen, Yang Cao
arXiv preprint, 17 Apr 2024
[arXiv] [Project] [Code]

3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
Qihang Zhang, Yinghao Xu, Chaoyang Wang, Hsin-Ying Lee, Gordon Wetzstein, Bolei Zhou, Ceyuan Yang
arXiv preprint, 28 May 2024
[arXiv] [Project] [Code]

Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
Inkyu Shin, Qihang Yu, Xiaohui Shen, In So Kweon, Kuk-Jin Yoon, Liang-Chieh Chen
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

StyleSplat: 3D Object Style Transfer with Gaussian Splatting
Sahil Jain, Avik Kuthiala, Prabhdeep Singh Sethi, Prakanshul Saxena
arXiv preprint, 12 Jul 2024
[arXiv] [Project]

InstantStyleGaussian: Efficient Art Style Transfer with 3D Gaussian Splatting
Xin-Yi Yu, Jun-Xin Yu, Li-Bo Zhou, Yan Wei, Lin-Lin Ou
arXiv preprint, 8 Aug 2024
[arXiv]

PRTGS: Precomputed Radiance Transfer of Gaussian Splats for Real-Time High-Quality Relighting
Yijia Guo, Yuanxi Bai, Liwen Hu, Ziyi Guo, Mianzhi Liu, Yu Cai, Tiejun Huang, Lei Ma
arXiv preprint, 7 Aug 2024
[arXiv]

Towards Realistic Example-based Modeling via 3D Gaussian Stitching
Xinyu Gao, Ziyi Yang, Bingchen Gong, Xiaoguang Han, Sipeng Yang, Xiaogang Jin
arXiv preprint, 28 Aug 2024
[arXiv] [Project]

G-Style: Stylized Gaussian Splatting
Áron Samuel Kovács, Pedro Hermosilla, Renata G. Raidou
arXiv preprint, 28 Aug 2024
[arXiv]

WaSt-3D: Wasserstein-2 Distance for Scene-to-Scene Stylization on 3D Gaussians
Dmytro Kotovenko, Olga Grebenkova, Nikolaos Sarafianos, Avinash Paliwal, Pingchuan Ma, Omid Poursaeed, Sreyas Mohan, Yuchen Fan, Yilei Li, Rakesh Ranjan, Björn Ommer
arXiv preprint, 26 Sep 2024
[arXiv] [Project] [Code]

4DStyleGaussian: Zero-shot 4D Style Transfer with Gaussian Splatting
Wanlin Liang, Hongbin Xu, Weitao Chen, Feng Xiao, Wenxiong Kang
arXiv preprint, 14 Oct 2024
[arXiv]

3DGS for Computer Graphics

PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Tianyi Xie, Zeshun Zong, Yuxing Qiu, Xuan Li, Yutao Feng, Yin Yang, Chenfanfu Jiang
CVPR 2024, 20 Nov 2023
[arXiv] [Project]

Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting
Yutao Feng, Xiang Feng, Yintong Shang, Ying Jiang, Chang Yu, Zeshun Zong, Tianjia Shao, Hongzhi Wu, Kun Zhou, Chenfanfu Jiang, Yin Yang
arXiv preprint, 27 Jan 2024
[arXiv] [Project] [Video]

VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality
Ying Jiang, Chang Yu, Tianyi Xie, Xuan Li, Yutao Feng, Huamin Wang, Minchen Li, Henry Lau, Feng Gao, Yin Yang, Chenfanfu Jiang
arXiv preprint, 30 Jan 2024
[arXiv] [Project]

A Grid-Free Fluid Solver based on Gaussian Spatial Representation
Jingrui Xing, Bin Wang, Mengyu Chu, Baoquan Chen
arXiv preprint, 28 May 2024
[arXiv]

GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis
Yumeng He, Yunbo Wang, Xiaokang Yang
arXiv preprint, 31 May 2024
[arXiv]

DreamPhysics: Learning Physical Properties of Dynamic 3DGaussianswith Video Diffusion Priors
Tianyu Huang, Yihan Zeng, Hui Li, Wangmeng Zuo, Rynson W. H. Lau
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

GASP: Gaussian Splatting for Physic-Based Simulations
Piotr Borycki, Weronika Smolak, Joanna Waczyńska, Marcin Mazur, Sławomir Tadeja, Przemysław Spurek
arXiv preprint, 9 Sep 2024
[arXiv]

3DGS Based Scene Understanding

Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding
Jin-Chuan Shi, Miao Wang, Hao-Bin Duan, Shao-Hua Guan
arXiv preprint, 30 Nov 2023
[arXiv]

Semantic Anything in 3D Gaussians
Xu Hu, Yuxi Wang, Lue Fan, Junsong Fan, Junran Peng, Zhen Lei, Qing Li, Zhaoxiang Zhang
arXiv preprint, 31 Jan 2024
[arXiv]

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting
Jun Guo, Xiaojian Ma, Yue Fan, Huaping Liu, Qing Li
arXiv preprint, 22 Mar 2024
[arXiv] [Project] [Code]

CLIP-GS: CLIP-Informed Gaussian Splatting for Real-time and View-consistent 3D Semantic Understanding
Guibiao Liao, Jiankun Li, Zhenyu Bao, Xiaoqing Ye, Jingdong Wang, Qing Li, Kanglin Liu
arXiv preprint, 22 Apr 2024
[arXiv] [Code]

🔥HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splatting
Hongyu Zhou, Jiahao Shao, Lu Xu, Dongfeng Bai, Weichao Qiu, Bingbing Liu, Yue Wang, Andreas Geiger, Yiyi Liao
CVPR 2024, 19 Mar 2024
[arXiv] [Project]

Memorize What Matters: Emergent Scene Decomposition from Multitraverse
Yiming Li, Zehong Wang, Yue Wang, Zhiding Yu, Zan Gojcic, Marco Pavone, Chen Feng, Jose M. Alvarez
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

FastLGS: Speeding up Language Embedded Gaussians with Feature Grid Mapping
Yuzhou Ji, He Zhu, Junshu Tang, Wuyi Liu, Zhizhong Zhang, Yuan Xie, Lizhuang Ma, Xin Tan
arXiv preprint, 4 Jun 2024
[arXiv]

OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understanding
Yanmin Wu, Jiarui Meng, Haijie Li, Chenming Wu, Yahao Shi, Xinhua Cheng, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, Jian Zhang
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splatting
Daiwei Zhang, Gengyan Li, Jiajie Li, Mickaël Bressieux, Otmar Hilliges, Marc Pollefeys, Luc Van Gool, Xi Wang
arXiv preprint, 28 Jun 2024
[arXiv]

Scaling 3D Reasoning with LMMs to Large Robot Mission Environments Using Datagraphs
W. J. Meijer, A.C. Kemmeren, E.H.J. Riemens, J.E. Fransman, M. van Bekkum, G.J. Burghouts, J.D. van Mil
RSS Workshop on Semantics for Robotics 2024, 15 Jul 2024
[arXiv]

SpectralGaussians: Semantic, spectral 3D Gaussian splatting for multi-spectral scene representation, visualization and analysis
Saptarshi Neil Sinha, Holger Graf, Michael Weinmann
arXiv preprint, 13 Aug 2024
[arXiv]

🔥ShapeSplat: A Large-scale Dataset of Gaussian Splats and Their Self-Supervised Pretraining
Qi Ma, Yue Li, Bin Ren, Nicu Sebe, Ender Konukoglu, Theo Gevers, Luc Van Gool, Danda Pani Paudel
arXiv preprint, 20 Aug 2024
[arXiv]

GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning
Keyi Liu, Yeqi Luo, Weidong Yang, Jingyi Xu, Zhijun Li, Wen-Ming Chen, Ben Fei
arXiv preprint, 8 Sep 2024
[arXiv]

Gradient-Driven 3D Segmentation and Affordance Transfer in Gaussian Splatting Using 2D Masks
Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar
arXiv preprint, 18 Sep 2024
[arXiv] [Project] [Code]

EdgeGaussians -- 3D Edge Mapping via Gaussian Splatting
Kunal Chelani, Assia Benbihi, Torsten Sattler, Fredrik Kahl
arXiv preprint, 19 Sep 2024
[arXiv] [Code]

SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimation
Mingze Sun, Chen Guo, Puhua Jiang, Shiwei Mao, Yurun Chen, Ruqi Huang
arXiv preprint, 18 Sep 2024
[arXiv]

Semantics-Controlled Gaussian Splatting for Outdoor Scene Reconstruction and Rendering in Virtual Reality
Hannah Schieber, Jacob Young, Tobias Langlotz, Stefanie Zollmann, Daniel Roth
arXiv preprint, 24 Sep 2024
[arXiv]

3DGS-DET: Empower 3D Gaussian Splatting with Boundary Guidance and Box-Focused Sampling for 3D Object Detection
Yang Cao, Yuanliang Jv, Dan Xu
arXiv preprint, 2 Oct 2024
[arXiv] [Code]

Gaussian-Det: Learning Closed-Surface Gaussians for 3D Object Detection
Hongru Yan, Yu Zheng, Yueqi Duan
arXiv preprint, 2 Oct 2024
[arXiv]

3D Vision-Language Gaussian Splatting
Qucheng Peng, Benjamin Planche, Zhongpai Gao, Meng Zheng, Anwesa Choudhuri, Terrence Chen, Chen Chen, Ziyan Wu
arXiv preprint, 10 Oct 2024
[arXiv]

4-LEGS: 4D Language Embedded Gaussian Splatting
Gal Fiebelman, Tamir Cohen, Ayellet Morgenstern, Peter Hedman, Hadar Averbuch-Elor
arXiv preprint, 14 Oct 2024
[arXiv] [Project]

3DArticCyclists: Generating Simulated Dynamic 3D Cyclists for Human-Object Interaction (HOI) and Autonomous Driving Applications
Eduardo R. Corral-Soto, Yang Liu, Tongtong Cao, Yuan Ren, Liu Bingbing
arXiv preprint, 14 Oct 2024
[arXiv]

MVSDet: Multi-View Indoor 3D Object Detection via Efficient Plane Sweeps
Yating Xu, Chen Li, Gim Hee Lee
NeurIPS 2024, 28 Oct 2024
[arXiv] [Code]

3DGS based Segmentation

2D-Guided 3D Gaussian Segmentation
Kun Lan, Haoran Li, Haolin Shi, Wenjun Wu, Yong Liao, Lin Wang, Pengyuan Zhou
arXiv preprint, 26 Dec 2023
[arXiv]

CoSSegGaussians: Compact and Swift Scene Segmenting 3D Gaussians
Bin Dou, Tianyu Zhang, Yongjia Ma, Zhaohui Wang, Zejian Yuan
arXiv preprint, 11 Jan 2024
[arXiv] [Project]

OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation
Lizhi Wang, Feng Zhou, Jianqin Yin arXiv preprint, 24 Apr 2024
[arXiv] [Code]

RT-GS2: Real-Time Generalizable Semantic Segmentation for 3D Gaussian Representations of Radiance Fields
Mihnea-Bogdan Jurca, Remco Royen, Ion Giosan, Adrian Munteanu
arXiv preprint, 28 May 2024
[arXiv]

Fast and Efficient: Mask Neural Fields for 3D Scene Segmentation
Zihan Gao, Lingling Li, Licheng Jiao, Fang Liu, Xu Liu, Wenping Ma, Yuwei Guo, Shuyuan Yang
arXiv preprintm, 1 Jul 2024
[arXiv]

Segment Any 4D Gaussians
Shengxiang Ji, Guanjun Wu, Jiemin Fang, Jiazhong Cen, Taoran Yi, Wenyu Liu, Qi Tian, Xinggang Wang
arXiv preprint, 5 Jul 2024
[arXiv] [Project]

Click-Gaussian: Interactive Segmentation to Any 3D Gaussians
Seokhun Choi, Hyeonseop Song, Jaechul Kim, Taehyeong Kim, Hoseok Do
ECCV 2024, 16 Jul 2024
[arXiv] [Project]

🔥FlashSplat: 2D to 3D Gaussian Splatting Segmentation Solved Optimally
Qiuhong Shen, Xingyi Yang, Xinchao Wang
ECCV 2024, 12 Sep 2024
[arXiv] [Code]

PLGS: Robust Panoptic Lifting with 3D Gaussian Splatting
Yu Wang, Xiaobao Wei, Ming Lu, Guoliang Kang
arXiv preprint, 23 Oct 2024
[arXiv]

3DGS + Specular

Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting
Ziyi Yang, Xinyu Gao, Yangtian Sun, Yihua Huang, Xiaoyang Lyu, Wen Zhou, Shaohui Jiao, Xiaojuan Qi, Xiaogang Jin
arXiv preprint, 24 Feb 2024
[arXiv]

3DGS Based SLAM

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Nikhil Keetha, Jay Karhade, Krishna Murthy Jatavallabhula, Gengshan Yang, Sebastian Scherer, Deva Ramanan, Jonathon Luiten
arXiv preprint, 4 Dec 2023
[arXiv]

LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering
Sheng Hong, Junjie He, Xinhu Zheng, Hesheng Wang, Hao Fang, Kangcheng Liu, Chunran Zheng, Shaojie Shen
arXiv preprint, 26 Jan 2024
[arXiv]

SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM
Mingrui Li, Shuhong Liu, Heng Zhou
arXiv preprint, 5 Feb 2024
[arXiv]

MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstruction
Heng Zhou, Zhetao Guo, Shuhong Liu, Lechen Zhang, Qihao Wang, Yuxiang Ren, Mingrui Li
arXiv preprint, 6 Feb 2024
[arXiv]

SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM
Siting Zhu, Renjie Qin, Guangming Wang, Jiuming Liu, Hesheng Wang
arXiv preprint, 13 Mar 2024
[arXiv]

RGBD GS-ICP SLAM
Seongbo Ha, Jiung Yeon, Hyeonwoo Yu
arXiv preprint, 19 Mar 2024
[arXiv]

NEDS-SLAM: A Novel Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting
Yiming Ji, Yang Liu, Guanghu Xie, Boyu Ma, Zongwu Xie
arXiv preprint, 18 Mar 2024
[arXiv]

CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field
Jiarui Hu, Xianhao Chen, Boyin Feng, Guanglin Li, Liangjing Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui
arXiv preprint, 24 Mar 2024
[arXiv] [Project] [Code]

RGBD GS-ICP SLAM
Seongbo Ha, Jiung Yeon, Hyeonwoo Yu
arXiv preprint, 19 Mar 2024
[arXiv]

HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes
Ke Wu, Kaizhao Zhang, Zhiwei Zhang, Shanshuai Yuan, Muer Tie, Julong Wei, Zijun Xu, Jieru Zhao, Zhongxue Gan, Wenchao Ding
arXiv preprint, 29 Mar 2024
[arXiv]

MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements
Lisong C. Sun, Neel P. Bhatt, Jonathan C. Liu, Zhiwen Fan, Zhangyang Wang, Todd E. Humphreys, Ufuk Topcu
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Video]

Gaussian-LIC: Photo-realistic LiDAR-Inertial-Camera SLAM with 3D Gaussian Splatting
Xiaolei Lang, Laijian Li, Hang Zhang, Feng Xiong, Mu Xu, Yong Liu, Xingxing Zuo, Jiajun Lv
IROS 2024, 10 Apr 2024
[arXiv]

RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting
Zhexi Peng, Tianjia Shao, Yong Liu, Jingke Zhou, Yin Yang, Jingdong Wang, Kun Zhou
arXiv preprint, 30 Apr 2024
[arXiv]

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization
Pengcheng Zhu, Yaoming Zhuang, Baoquan Chen, Li Li, Chengdong Wu, Zhanlin Liu
arXiv preprint, 10 May 2024
[arXiv]

NGM-SLAM: Gaussian Splatting SLAM with Radiance Field Submap
Mingrui Li, Jingwei Huang, Lei Sun, Aaron Xuxiang Tian, Tianchen Deng, Hongyu Wang
arXiv preprint, 9 May 2024
[arXiv]

GS-Planner: A Gaussian-Splatting-based Planning Framework for Active High-Fidelity Reconstruction
Rui Jin, Yuman Gao, Haojian Lu, Fei Gao
arXiv preprint, 16 May 2024
[arXiv]

GaussNav: Gaussian Splatting for Visual Navigation
Xiaohan Lei, Min Wang, Wengang Zhou, Houqiang Li
arXiv preprint, 18 Mar 2024
[arXiv]

Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians
Erik Sandström, Keisuke Tateno, Michael Oechsle, Michael Niemeyer, Luc Van Gool, Martin R. Oswald, Federico Tombari
arXiv preprint, 26 May 2024
[arXiv] [Code]

Structure Gaussian SLAM with Manhattan World Hypothesis
Shuhong Liu, Heng Zhou, Liuzhuozheng Li, Yun Liu, Tianchen Deng, Yiming Zhou, Mingrui Li
arXiv preprint, 30 May 2024
[arXiv]

From Perfect to Noisy World Simulation: Customizable Embodied Multi-modal Perturbations for SLAM Robustness Benchmarking
Xiaohao Xu, Tianyi Zhang, Sibo Wang, Xiang Li, Yongqi Chen, Ye Li, Bhiksha Raj, Matthew Johnson-Roberson, Xiaonan Huang
arXiv preprint, 24 Jun 2024
[arXiv]

I^2-SLAM: Inverting Imaging Process for Robust Photorealistic Dense SLAM
Gwangtak Bae, Changwoon Choi, Hyeongjun Heo, Sang Min Kim, Young Min Kim
ECCV 2024, 16 Jul 2024
[arXiv]

Evaluating Modern Approaches in 3D Scene Reconstruction: NeRF vs Gaussian-Based Methods
Yiming Zhou, Zixuan Zeng, Andi Chen, Xiaofan Zhou, Haowei Ni, Shiyao Zhang, Panfeng Li, Liangxi Liu, Mengyao Zheng, Xupeng Chen
2024 6th International Conference on Data-driven Optimization of Complex Systems, 8 Aug 2024
[arXiv]

Visual SLAM with 3D Gaussian Primitives and Depth Priors Enabling Novel View Synthesis
Zhongche Qu, Zhi Zhang, Cong Liu, Jianhua Yin
arXiv preprint, 10 Aug 2024
[arXiv]

Towards Real-Time Gaussian Splatting: Accelerating 3DGS through Photometric SLAM
Yan Song Hu, Dayou Mao, Yuhao Chen, John Zelek
arXiv preprint, 7 Aug 2024
[arXiv]

IG-SLAM: Instant Gaussian SLAM
F. Aykut Sarikamis, A. Aydin Alatan
arXiv preprint, 2 Aug 2024
[arXiv]

MotionGS : Compact Gaussian Splatting SLAM by Motion Filter
Xinli Guo, Peng Han, Weidong Zhang, Hongtian Chen
arXiv preprint, 18 May 2024
[arXiv]

GSFusion: Online RGB-D Mapping Where Gaussian Splatting Meets TSDF Fusion
Jiaxin Wei, Stefan Leutenegger
arXiv preprint, 22 Aug 2024
[arXiv] [Code]

LoopSplat: Loop Closure by Registering 3D Gaussian Splats
Liyuan Zhu, Yue Li, Erik Sandström, Shengyu Huang, Konrad Schindler, Iro Armeni
arXiv preprint, 19 Aug 2024
[arXiv] [Project] [Code]

OG-Mapping: Octree-based Structured 3DGaussians for Online Dense Mapping
Meng Wang, Junyi Wang, Changqun Xia, Chen Wang, Yue Qi
arXiv preprint, 30 Aug 2024
[arXiv]

FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometry
Chunran Zheng, Wei Xu, Zuhao Zou, Tong Hua, Chongjian Yuan, Dongjiao He, Bingyang Zhou, Zheng Liu, Jiarong Lin, Fangcheng Zhu, Yunfan Ren, Rong Wang, Fanle Meng, Fu Zhang
arXiv preprint, 26 Aug 2024
[arXiv]

Hi-SLAM: Scaling-up Semantics in SLAM with a Hierarchically Categorical Gaussian Splatting
Boying Li, Zhixi Cai, Yuan-Fang Li, Ian Reid, Hamid Rezatofighi
arXiv preprint, 19 Sep 2024
[arXiv]

GLC-SLAM: Gaussian Splatting SLAM with Efficient Loop Closure
Ziheng Xu, Qingfeng Li, Chen Chen, Xuefeng Liu, Jianwei Niu
arXiv preprint, 17 Sep 2024
[arXiv]

Go-SLAM: Grounded Object Segmentation and Localization with Gaussian Splatting SLAM
Phu Pham, Dipam Patel, Damon Conover, Aniket Bera
arXiv preprint, 26 Sep 2024
[arXiv]

CaRtGS: Computational Alignment for Real-Time Gaussian Splatting SLAM
Dapeng Feng, Zhiqiang Chen, Yizhen Yin, Shipeng Zhong, Yuhua Qi, Hongbo Chen
arXiv preprint, 1 Oct 2024
[arXiv]

Robust Gaussian Splatting SLAM by Leveraging Loop Closure
Zunjie Zhu, Youxu Fang, Xin Li, Chengang Yan, Feng Xu, Chau Yuen, Yanyan Li
arXiv preprint, 30 Sep 2024
[arXiv]

ES-Gaussian: Gaussian Splatting Mapping via Error Space-Based Gaussian Completion
Lu Chen, Yingfu Zeng, Haoang Li, Zhitao Deng, Jiafu Yan, Zhenjun Zhao
arXiv preprint, 9 Oct 2024
[arXiv] [Project]

GSLoc: Visual Localization with 3D Gaussian Splatting
Kazii Botashev, Vladislav Pyatov, Gonzalo Ferrer, Stamatios Lefkimmiatis
arXiv preprint, 8 Oct 2024
[arXiv]

LoGS: Visual Localization via Gaussian Splatting with Fewer Training Images
Yuzhou Cheng, Jianhao Jiao, Yue Wang, Dimitrios Kanoulas
arXiv preprint, 15 Oct 2024
[arXiv]

GSORB-SLAM: Gaussian Splatting SLAM benefits from ORB features and Transmittance information
Wancai Zheng, Xinyi Yu, Jintao Rong, Linlin Ou, Yan Wei, Libo Zhou
arXiv preprint, 15 Oct 2024
[arXiv]

AG-SLAM: Active Gaussian Splatting SLAM
Wen Jiang, Boshu Lei, Katrina Ashton, Kostas Daniilidis
arXiv preprint, 22 Oct 2024
[arXiv]

XRDSLAM: A Flexible and Modular Framework for Deep Learning based SLAM
Xiaomeng Wang, Nan Wang, Guofeng Zhang
arXiv preprint, 31 Oct 2024
[arXiv]

LVI-GS: Tightly-coupled LiDAR-Visual-Inertial SLAM using 3D Gaussian Splatting
Huibin Zhao, Weipeng Guan, Peng Lu
arXiv preprint, 5 Nov 2024
[arXiv]

3DGS Based 3D Point Tracking

DynOMo: Online Point Tracking by Dynamic Online Monocular Gaussian Reconstruction
Jenny Seidenschwarz, Qunjie Zhou, Bardienus Duisterhof, Deva Ramanan, Laura Leal-Taixé
arXiv preprint, 3 Sep 2024
[arXiv]

3DGS Based Inverse Rendering

GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorization
Yahao Shi, Yanmin Wu, Chenming Wu, Xing Liu, Chen Zhao, Haocheng Feng, Jingtuo Liu, Liangjun Zhang, Jian Zhang, Bin Zhou, Errui Ding, Jingdong Wang
arXiv preprint, 8 Dec, 2023
[arXiv] [Project]

DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading
Tong Wu, Jia-Mu Sun, Yu-Kun Lai, Yuewen Ma, Leif Kobbelt, Lin Gao
arXiv preprint, 15 Apr 2024
[arXiv]

Progressive Radiance Distillation for Inverse Rendering with Gaussian Splatting
Keyang Ye, Qiming Hou, Kun Zhou
arXiv preprint, 14 Aug 2024
[arXiv]

GS-ID: Illumination Decomposition on Gaussian Splatting via Diffusion Prior and Parametric Light Source Optimization
Kang Du, Zhihao Liang, Zeyu Wang
arXiv preprint, 16 Aug 2024
[arXiv]

Phys3DGS: Physically-based 3D Gaussian Splatting for Inverse Rendering
Euntae Choi, Sungjoo Yoo
arXiv preprint, 16 Sep 2024
[arXiv]

Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats
Mingyang Xie, Haoming Cai, Sachin Shah, Yiran Xu, Brandon Y. Feng, Jia-Bin Huang, Christopher A. Metzler
arXiv preprint, 3 Oct 2024
[arXiv] [Project]

GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Rendering
Hongze Chen, Zehong Lin, Jun Zhang
arXiv preprint, 3 Oct 2024
[arXiv]

RelitLRM: Generative Relightable Radiance for Large Reconstruction Models
Tianyuan Zhang, Zhengfei Kuang, Haian Jin, Zexiang Xu, Sai Bi, Hao Tan, He Zhang, Yiwei Hu, Milos Hasan, William T. Freeman, Kai Zhang, Fujun Luan
arXiv preprint, 8 Oct 2024
[arXiv] [Project]

GS^3: Efficient Relighting with Triple Gaussian Splatting
Zoubin Bi, Yixin Zeng, Chong Zeng, Fan Pei, Xiang Feng, Kun Zhou, Hongzhi Wu
SIGGRAPH Asia 2024, 15 Oct 2024
[arXiv] [Project] [Code]

Triplet: Triangle Patchlet for Mesh-Based Inverse Rendering and Scene Parameters Approximation
Jiajie Yang
arXiv preprint, 16 Oct 2024
[arXiv]

GlossyGS: Inverse Rendering of Glossy Objects with 3D Gaussian Splatting
Shuichang Lai, Letian Huang, Jie Guo, Kai Cheng, Bowen Pan, Xiaoxiao Long, Jiangjing Lyu, Chengfei Lv, Yanwen Guo
arXiv preprint, 17 Oct 2024
[arXiv]

SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes
Cheng-De Fan, Chen-Wei Chang, Yi-Ruei Liu, Jie-Ying Lee, Jiun-Long Huang, Yu-Chee Tseng, Yu-Lun Liu
arXiv preprint, 22 Oct 2024
[arXiv] [Project]

GeoSplatting: Towards Geometry Guided Gaussian Splatting for Physically-based Inverse Rendering
Kai Ye, Chong Gao, Guanbin Li, Wenzheng Chen, Baoquan Chen
arXiv preprint, 31 Oct 2024
[arXiv] [Project]

Scaled Inverse Graphics: Efficiently Learning Large Sets of 3D Scenes
Karim Kassab, Antoine Schnepf, Jean-Yves Franceschi, Laurent Caraffa, Flavian Vasile, Jeremie Mary, Andrew Comport, Valérie Gouet-Brunet
arXiv preprint, 31 Oct 2024
[arXiv] [Project]

3DGS Imaging Tasks

Deblurring 3D Gaussian Splatting
Byeonghyeon Lee, Howoong Lee, Xiangyu Sun, Usman Ali, Eunbyung Park
arXiv preprint, 1 Jan 2024
[arXiv] [Project] [Code]

BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splatting
Lingzhe Zhao, Peng Wang, Peidong Liu
arXiv preprint, 18 Mar 2024
[arXiv] [Project] [Code]

Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion
Otto Seiskari, Jerry Ylilammi, Valtteri Kaatrasalo, Pekka Rantalankila, Matias Turkulainen, Juho Kannala, Esa Rahtu, Arno Solin
arXiv preprint, 20 Mar 2024
[arXiv] [Code]

BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modeling
Cheng Peng, Yutao Tang, Yifan Zhou, Nengyu Wang, Xijun Liu, Deming Li, Rama Chellappa
arXiv preprint, 7 Mar 2024
[arXiv]

From Chaos to Clarity: 3DGS in the Dark
Zhihao Li, Yufei Wang, Alex Kot, Bihan Wen
arXiv preprint, 12 Jun 2024
[arXiv]

Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field
Chao Wang, Krzysztof Wolski, Bernhard Kerbl, Ana Serrano, Mojtaba Bemana, Hans-Peter Seidel, Karol Myszkowski, Thomas Leimkühler
arXiv preprint, 11 Jun 2024
[arXiv]

Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesis
Xin Jin, Pengyi Jiao, Zheng-Peng Duan, Xingchao Yang, Chun-Le Guo, Bo Ren, Chongyi Li
arXiv preprint, 10 Jun 2024
[arXiv] [Code]

CRiM-GS: Continuous Rigid Motion-Aware Gaussian Splatting from Motion Blur Images
Junghe Lee, Donghyeong Kim, Dogyoon Lee, Suhwan Cho, Sangyoun Lee
arXiv preprint, 4 Jul 2024
[arXiv] [Project]

HDRSplat: Gaussian Splatting for High Dynamic Range 3D Scene Reconstruction from Raw Images
Shreyas Singh, Aryan Garg, Kaushik Mitra
arXiv preprint, 23 Jul 2024
[arXiv]

EaDeblur-GS: Event assisted 3D Deblur Reconstruction with Gaussian Splatting
Yuchen Weng, Zhengwen Shen, Ruofan Chen, Qi Wang, Jun Wang
arXiv preprint, 18 Jul 2024
[arXiv]

HDRGS: High Dynamic Range Gaussian Splatting
Jiahao Wu, Lu Xiao, Chao Wang, Rui Peng, Kaiqiang Xiong, Ronggang Wang
arXiv preprint, 13 Aug 2024
[arXiv]

DeRainGS: Gaussian Splatting for Enhanced Scene Reconstruction in Rainy Environments
Shuhong Liu, Xiang Chen, Hongming Chen, Quanfeng Xu, Mingrui Li
arXiv preprint, 21 Aug 2024
[arXiv]

Gaussian in the Dark: Real-Time View Synthesis From Inconsistent Dark Images Using Gaussian Splatting
Sheng Ye, Zhen-Hui Dong, Yubin Hu, Yu-Hui Wen, Yong-Jin Liu
PG 2024, 17 Aug 2024
[arXiv]

GS-Blur: A 3D Scene-Based Dataset for Realistic Image Deblurring
Dongwoo Lee, Joonkyu Park, Kyoung Mu Lee
NeurIPS 2024, 31 Oct 2024
[arXiv]

3DGS for Reflective and Transparent Objects

Snap-it, Tap-it, Splat-it: Tactile-Informed 3D Gaussian Splatting for Reconstructing Challenging Surfaces
Mauro Comi, Alessio Tonioni, Max Yang, Jonathan Tremblay, Valts Blukis, Yijiong Lin, Nathan F. Lepora, Laurence Aitchison
arXiv preprint, 29 Mar 2024
[arXiv]

Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting
Jiarui Meng, Haijie Li, Yanmin Wu, Qiankun Gao, Shuzhou Yang, Jian Zhang, Siwei Ma
arXiv preprint, 1 Apr 2024
[arXiv]

RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Rendering
Xianqiang Lyu, Hui Liu, Junhui Hou
arXiv preprint, 17 Apr 2024
[arXiv]

DeblurGS: Gaussian Splatting for Camera Motion Blur
Jeongtaek Oh, Jaeyoung Chung, Dongwoo Lee, Kyoung Mu Lee
arXiv preprint, 17 Apr 2024
[arXiv]

3D Gaussian Splatting with Deferred Reflection
Keyang Ye, Qiming Hou, Kun Zhou
arXiv preprint, 29 Apr 2024
[arXiv]

MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections
Jiayue Liu, Xiao Tang, Freeman Cheng, Roy Yang, Zhihao Li, Jianzhuang Liu, Yi Huang, Jiaqi Lin, Shiyong Liu, Xiaofei Wu, Songcen Xu, Chun Yuan
arXiv preprint, 20 May 2024
[arXiv] [Project]

DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videos
Linhan Wang, Kai Cheng, Shuo Lei, Shengkun Wang, Wei Yin, Chenyang Lei, Xiaoxiao Long, Chang-Tien Lu
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

RefGaussian: Disentangling Reflections from 3D Gaussian Splatting for Realistic Rendering
Rui Zhang, Tianyue Luo, Weidong Yang, Ben Fei, Jingyi Xu, Qingyuan Zhou, Keyi Liu, Ying He
arXiv preprint, 9 Jun 2024
[arXiv]

Gaussian Splatting in Mirrors: Reflection-Aware Rendering via Virtual Camera Optimization
Zihan Wang, Shuzhe Wang, Matias Turkulainen, Junyuan Fang, Juho Kannala
arXiv preprint, 2 Oct 2024
[arXiv]

3DGS Superresolution

SRGS: Super-Resolution 3D Gaussian Splatting
Xiang Feng, Yongbo He, Yubo Wang, Yan Yang, Zhenzhong Kuang, Yu Jun, Jianping Fan, Jiajun ding
ACM MM 2024, 16 Apr 2024
[arXiv]

GaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion Priors
Xiqian Yu, Hanxin Zhu, Tianyu He, Zhibo Chen
arXiv preprint, 14 Jun 2024
[arXiv] [Project]

GaussianSR: High Fidelity 2D Gaussian Splatting for Arbitrary-Scale Image Super-Resolution
Jintong Hu, Bin Xia, Bin Chen, Wenming Yang, Lei Zhang
arXiv preprint, 25 Jul 2024
[arXiv]

SuperGS: Super-Resolution 3D Gaussian Splatting via Latent Feature Field and Gradient-guided Splitting
Shiyun Xie, Zhiru Wang, Yinghao Zhu, Chengwei Pan
arXiv preprint, 3 Oct 2024
[arXiv]

3DGS for Point Cloud

Zero-shot Point Cloud Completion Via 2D Priors
Tianxin Huang, Zhiwen Yan, Yuyang Zhao, Gim Hee Lee
arXiv preprint, 10 Apr 2024
[arXiv]

Photorealistic 3D Urban Scene Reconstruction and Point Cloud Extraction using Google Earth Imagery and Gaussian Splatting
Kyle Gao, Dening Lu, Hongjie He, Linlin Xu, Jonathan Li
arXiv preprint, 17 May 2024
[arXiv]

PFGS: High Fidelity Point Cloud Rendering via Feature Splatting
Jiaxu Wang, Ziyi Zhang, Junhao He, Renjing Xu
arXiv preprint, 4 Jul 2024
[arXiv]

3DGS for CV Tasks

3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration
Quentin Herau, Moussab Bennehar, Arthur Moreau, Nathan Piasco, Luis Roldao, Dzmitry Tsishkou, Cyrille Migniot, Pascal Vasseur, Cédric Demonceaux
arXiv preprint, 18 Mar 2024
[arXiv]

GaussReg: Fast 3D Registration with Gaussian Splatting
Jiahao Chang, Yinglin Xu, Yihao Li, Yuantao Chen, Xiaoguang Han
ECCV 2024, 7 Jul 2024
[arXiv]

3DGS with Hardware

Dual-Camera Smooth Zoom on Mobile Phones
Renlong Wu, Zhilu Zhang, Yu Yang, Wangmeng Zuo
arXiv preprint, 7 Apr 2024
[arXiv]

Event3DGS: Event-based 3D Gaussian Splatting for Fast Egomotion
Tianyi Xiong, Jiayi Wu, Botao He, Cornelia Fermuller, Yiannis Aloimonos, Heng Huang, Christopher A. Metzler
arXiv preprint, 5 Jun 2024
[arXiv]

E2GS: Event Enhanced Gaussian Splatting
Hiroyuki Deguchi, Mana Masuda, Takuya Nakabayashi, Hideo Saito
arXiv preprint, 21 Jun 2024
[arXiv]

SpikeGS: Reconstruct 3D scene via fast-moving bio-inspired sensors
Yijia Guo, Liwen Hu, Lei Ma, Tiejun Huang
arXiv preprint, 4 Jul 2024
[arXiv]

SpikeGS: 3D Gaussian Splatting from Spike Streams with High-Speed Camera Motion
Jiyuan Zhang, Kang Chen, Shiyan Chen, Yajing Zheng, Tiejun Huang, Zhaofei Yu
arXiv preprint, 14 Jul 2024
[arXiv]

Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Rendering
Jingqian Wu, Shuo Zhu, Chutian Wang, Edmund Y. Lam
arXiv preprint, 16 Jul 2024
[arXiv]

IncEventGS: Pose-Free Gaussian Splatting from a Single Event Camera
Jian Huang, Chengrui Dong, Peidong Liu
arXiv preprint, 10 Oct 2024
[arXiv] [Code]

EF-3DGS: Event-Aided Free-Trajectory 3D Gaussian Splatting
Bohao Liao, Wei Zhai, Zengyu Wan, Tianzhu Zhang, Yang Cao, Zheng-Jun Zha
arXiv preprint, 20 Oct 2024
[arXiv] [Project]

3DGS Applications

3DGS Application in Animal Reconstruction

Exploring the Feasibility of Generating Realistic 3D Models of Endangered Species Using DreamGaussian: An Analysis of Elevation Angle's Impact on Model Generation
Selcuk Anil Karatopak, Deniz Sen
arXiv preprint, 15 Dec 2023
[arXiv]

3DGS Application in Medical Imaging

EndoGaussian: Gaussian Splatting for Deformable Surgical Scene Reconstruction
Yifan Liu, Chenxin Li, Chen Yang, Yixuan Yuan
arXiv preprint, 23 Jan 2024
[arXiv] [Project] [Code]

Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting
Lingting Zhu, Zhao Wang, Zhenchao Jin, Guying Lin, Lequan Yu
arXiv preprint, 21 Jan 2024
[arXiv] [Code]

Endo-4DGS: Distilling Depth Ranking for Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting
Yiming Huang, Beilei Cui, Long Bai, Ziqi Guo, Mengya Xu, Hongliang Ren
arXiv preprint, 29 Jan 2024
[arXiv]

Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
Yuanhao Cai, Yixun Liang, Jiahao Wang, Angtian Wang, Yulun Zhang, Xiaokang Yang, Zongwei Zhou, Alan Yuille
arXiv preprint, 7 Mar 2024
[arXiv] [Video]

TOGS: Gaussian Splatting with Temporal Opacity Offset for Real-Time 4D DSA Rendering
Shuai Zhang, Huangxuan Zhao, Zhenghong Zhou, Guanjun Wu, Chuansheng Zheng, Xinggang Wang, Wenyu Liu
arXiv preprint, 28 Mar 2024
[arXiv]

Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction
Sierra Bonilla, Shuai Zhang, Dimitrios Psychogyios, Danail Stoyanov, Francisco Vasconcelos, Sophia Bano
arXiv preprint, 9 Apr 2024
[arXiv]

Novel View Synthesis for Cinematic Anatomy on Mobile and Immersive Displays
Simon Niedermayr, Christoph Neuhauser, Kaloian Petkov, Klaus Engel, Rüdiger Westermann
arXiv preprint, 17 Apr 2024
[arXiv]

HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstruction
Haoyu Zhao, Xingyue Zhao, Lingting Zhu, Weixi Zheng, Yongchao Xu
arXiv preprint, 28 May 2024
[arXiv]

Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splatting
Shuojue Yang, Qian Li, Daiyun Shen, Bingchen Gong, Qi Dou, Yueming Jin
arXiv preprint, 28 May 2024
[arXiv] [Code]

R^2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction
Ruyi Zha, Tao Jun Lin, Yuanhao Cai, Jiwen Cao, Yanhao Zhang, Hongdong Li
arXiv preprint, 31 May 2024
[arXiv]

DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering
Zhongpai Gao, Benjamin Planche, Meng Zheng, Xiao Chen, Terrence Chen, Ziyan Wu
arXiv preprint, 4 Jun 2024
[arXiv]

Gaussian Representation for Deformable Image Registration
Jihe Li, Fabian Zhang, Xia Li, Tianhao Zhang, Ye Zhang, Joachim Buhmann
arXiv preprint, 5 Jun 2024
[arXiv]

LGS: A Light-weight 4D Gaussian Splatting for Efficient Surgical Scene Reconstruction
Hengyu Liu, Yifan Liu, Chenxin Li, Wuyang Li, Yixuan Yuan
MICCAI 2024, 23 Jun 2024
[arXiv] [Project] [Code]

Free-SurGS: SfM-Free 3D Gaussian Splatting for Surgical Scene Reconstruction
Jiaxin Guo, Jiangliu Wang, Di Kang, Wenzhen Dong, Wenting Wang, Yun-hui Liu
MICCAI 2024, 3 Jul 2024
[arXiv] [Code]

EndoSparse: Real-Time Sparse View Synthesis of Endoscopic Scenes using Gaussian Splatting
Chenxin Li, Brandon Y. Feng, Yifan Liu, Hengyu Liu, Cheng Wang, Weihao Yu, Yixuan Yuan
MICCAI 2024, 1 Jul 2024
[arXiv] [Project]

SurgicalGaussian: Deformable 3D Gaussians for High-Fidelity Surgical Scene Reconstruction
Weixing Xie, Junfeng Yao, Xianpeng Cao, Qiqin Lin, Zerui Tang, Xiao Dong, Xiaohu Guo
arXiv preprint, 6 Jul 2024
[arXiv] [Project] [Video] [Code]

Realistic Surgical Image Dataset Generation Based On 3D Gaussian Splatting
Tianle Zeng, Gerardo Loza Galindo, Junlei Hu, Pietro Valdastri, Dominic Jones
MICCAI 2024, 20 Jul 2024
[arXiv]

A Review of 3D Reconstruction Techniques for Deformable Tissues in Robotic Surgery
Mengya Xu, Ziqi Guo, An Wang, Long Bai, Hongliang Ren
MICCAI 2024, 8 Aug 2024
[arXiv] [Code]

Free-DyGS: Camera-Pose-Free Scene Reconstruction based on Gaussian Splatting for Dynamic Surgical Videos
Qian Li, Shuojue Yang, Daiyun Shen, Yueming Jin
arXiv preprint, 2 Sep 2024
[arXiv]

Online 3D reconstruction and dense tracking in endoscopic videos
Michel Hayoz, Christopher Hahne, Thomas Kurmann, Max Allan, Guido Beldi, Daniel Candinas, ablo Márquez-Neila, Raphael Sznitman
arXiv preprint, 9 Sep 2024
[arXiv]

Seamless Augmented Reality Integration in Arthroscopy: A Pipeline for Articular Reconstruction and Guidance
Hongchao Shu, Mingxu Liu, Lalithkumar Seenivasan, Suxi Gu, Ping-Cheng Ku, Jonathan Knopf, Russell Taylor, Mathias Unberath
AE-CAI 2024, 1 Oct 2024
[arXiv]

Multi-Layer Gaussian Splatting for Immersive Anatomy Visualization
Constantin Kleinbeck, Hannah Schieber, Klaus Engel, Ralf Gutjahr, Daniel Roth
arXiv preprint, 22 Oct 2024
[arXiv]

3DGS Application in Underwater Scenario

RecGS: Removing Water Caustic with Recurrent Gaussian Splatting
Tianyi Zhang, Weiming Zhi, Kaining Huang, Joshua Mangelson, Corina Barbalata, Matthew Johnson-Roberson
arXiv preprint, 14 Jul 2024
[arXiv]

WaterSplatting: Fast Underwater 3D Scene Reconstruction Using Gaussian Splatting
Huapeng Li, Wenxuan Song, Tianao Xu, Alexandre Elsig, Jonas Kulhanek
arXiv preprint, 15 Aug 2024
[arXiv] [Project] [Code]

SeaSplat: Representing Underwater Scenes with 3D Gaussian Splatting and a Physically Grounded Image Formation Model
Daniel Yang, John J. Leonard, Yogesh Girdhar
arXiv preprint, 25 Sep 2024
[arXiv] [Project] [Video]

UW-GS: Distractor-Aware 3D Gaussian Splatting for Enhanced Underwater Scene Reconstruction
Haoran Wang, Nantheera Anantrasirichai, Fan Zhang, David Bull
arXiv preprint, 2 Oct 2024
[arXiv]

3DGS Application in Agriculture/Forestry Scenario

Comparative Analysis of Novel View Synthesis and Photogrammetry for 3D Forest Stand Reconstruction and extraction of individual tree parameters
Guoji Tian, Chongcheng Chen, Hongyu Huang
arXiv preprint, 8 Oct 2024
[arXiv]

3DGS Artifact Detection

SplatPose & Detect: Pose-Agnostic 3D Anomaly Detection
Mathis Kruse, Marco Rudolph, Dominik Woiwode, Bodo Rosenhahn
CVPR 2024, 10 Apr 2024
[arXiv]

SplatPose+: Real-time Image-Based Pose-Agnostic 3D Anomaly Detection
Yizhe Liu, Yan Song Hu, Yuhao Chen, John Zelek
arXiv preprint, 15 Oct 2024
[arXiv]

SplatOverflow: Asynchronous Hardware Troubleshooting
Amritansh Kwatra, Tobias Wienberg, Ilan Mandel, Ritik Batra, Peter He, Francois Guimbretiere, Thijs Roumen
arXiv preprint, 4 Nov 2024
[arXiv] [Video]

3DGS Copyright/Safety

GaussianStego: A Generalizable Stenography Pipeline for Generative 3D Gaussians Splatting
Chenxin Li, Hengyu Liu, Zhiwen Fan, Wuyang Li, Yifan Liu, Panwang Pan, Yixuan Yuan
arXiv preprint, 1 Jul 2024
[arXiv] [Project]

Poison-splat: Computation Cost Attack on 3D Gaussian Splatting
Jiahao Lu, Yifan Zhang, Qiuhong Shen, Xinchao Wang, Shuicheng Yan
arXiv preprint, 10 Oct 2024
[arXiv] [Code]

GaussianMarker: Uncertainty-Aware Copyright Protection of 3D Gaussian Splatting
Xiufeng Huang, Ruiqi Li, Yiu-ming Cheung, Ka Chun Cheung, Simon See, Renjie Wan
arXiv preprint, 31 Oct 2024
[arXiv]

Geometry Cloak: Preventing TGS-based 3D Reconstruction from Copyrighted Images
Qi Song, Ziyuan Luo, Ka Chun Cheung, Simon See, Renjie Wan
NeurIPS 2024, 30 Oct 2024
[arXiv]

3DGS Applications in UAV/MAV

DRAGON: Drone and Ground Gaussian Splatting for 3D Building Reconstruction
Yujin Ham, Mateusz Michalkiewicz, Guha Balakrishnan
ICCP 2024, 1 Jul 2024
[arXiv]

Developing Smart MAVs for Autonomous Inspection in GPS-denied Constructions
Paoqiang Pan, Kewei Hu, Xiao Huang, Wei Ying, Xiaoxuan Xie, Yue Ma, Naizhong Zhang, Hanwen Kang
arXiv preprint, 12 Aug 2024
[arXiv]

3DGS Applications in Satellite Images

Reconstructing Satellites in 3D from Amateur Telescope Images
Zhiming Chang, Boyang Liu, Yifei Xia, Youming Guo, Boxin Shi, He Sun
arXiv preprint, 29 Apr 2024
[arXiv]

SatSplatYOLO: 3D Gaussian Splatting-based Virtual Object Detection Ensembles for Satellite Feature Recognition
Van Minh Nguyen, Emma Sandidge, Trupti Mahendrakar, Ryan T. White
arXiv preprint, 4 Jun 2024
[arXiv]

3DGS Network Applications

Embracing Radiance Field Rendering in 6G: Over-the-Air Training and Inference with 3D Contents
Guanlin Wu, Zhonghao Lyu, Juyong Zhang, Jie Xu
arXiv preprint, 20 May 2024
[arXiv]

3DGS for Acoustic

AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
Swapnil Bhosale, Haosen Yang, Diptesh Kanojia, Jiankang Deng, Xiatian Zhu
arXiv preprint, 13 Jun 2024
[arXiv]

3DGS with Panorama

LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation
Shuai Yang, Jing Tan, Mengchen Zhang, Tong Wu, Yixuan Li, Gordon Wetzstein, Ziwei Liu, Dahua Lin
arXiv preprint, 23 Aug 2024
[arXiv] [Project]

Pano2Room: Novel View Synthesis from a Single Indoor Panorama
Guo Pu, Yiming Zhao, Zhouhui Lian
Siggraph Asia 2024, 21 Aug 2024
[arXiv] [Code]

3DGS with Thermal

🔥 Thermal3D-GS: Physics-induced 3D Gaussians for Thermal Infrared Novel-view Synthesis
Qian Chen, Shihao Shu, Xiangzhi Bai
ECCV 2024, 12 Sep 2024
[arXiv] [Code]

ThermalGaussian: Thermal 3D Gaussian Splatting
Rongfeng Lu, Hangyu Chen, Zunjie Zhu, Yuhang Qin, Ming Lu, Le Zhang, Chenggang Yan, Anke Xue
arXiv preprint, 11 Sep 2024
[arXiv]

3DGS with Fisheye Camera

Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Cameras
Zimu Liao, Siyan Chen, Rong Fu, Yi Wang, Zhongling Su, Hao Luo, Li Ma, Linning Xu, Bo Dai, Hengjie Li, Zhilin Pei, Xingcheng Zhang
arXiv preprint, 7 Sep 2024
[arXiv]

Other NVS Methods

LVSM: A Large View Synthesis Model with Minimal 3D Inductive Bias
Haian Jin, Hanwen Jiang, Hao Tan, Kai Zhang, Sai Bi, Tianyuan Zhang, Fujun Luan, Noah Snavely, Zexiang Xu
arXiv preprint, 22 Oct 2024
[arXiv] [Project]

Other Surveys

Learning-based Multi-View Stereo: A Survey
Fangjinhua Wang, Qingtian Zhu, Di Chang, Quankai Gao, Junlin Han, Tong Zhang, Richard Hartley, Marc Pollefeys
arXiv preprint, 27 Aug 2024
[arXiv]

Contributors

Thanks to the community and hoping more and more people are joining us and submit commits and PRs!

Made with contributors-img.

License

CC-0

About

This is a collective repository for all 3DGS related progresses in research and industry world

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published