4D reconstruction
In computer vision and computer graphics, 4D reconstruction is the process of capturing the shape and appearance of real objects along a temporal dimension.[1][2][3][4] This process can be accomplished by methods such as depth camera imaging,[1] photometric stereo, or structure from motion,[5] and is also referred to as spatio-temporal reconstruction.[4]
4D Gaussian splatting
Extending the concept of 3D Gaussian Splatting, the 4D Gaussian Splatting incorporates a time component, allowing for dynamic scene rendering. It represents and renders dynamic scenes, with a focus on modeling complex motions while maintaining efficiency.[6] The method uses a HexPlane to connect different adjacent Gaussians, providing an accurate representation of position and shape deformations. By utilizing only a single set of canonical 3D Gaussians, and predictive analytics, the 4D Gaussian splatting method models how they move over different timestamps.[7]
Achievements of this technique include real-time rendering on dynamic scenes with high resolutions, while maintaining quality. It showcases potential applications for future developments in film and other media, although there are current limitations regarding the length of motion captured.[7]See also
- 3D reconstruction
- Free viewpoint television
- Structure from motion
- Volumetric video
References
- ^ a b Dou, Mingsong, et al. "Fusion4d: Real-time performance capture of challenging scenes." ACM Transactions on Graphics (TOG) 35.4 (2016): 1-13.
- ^ Mustafa, Armin, et al. "Temporally coherent 4d reconstruction of complex dynamic scenes." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2016.
- ^ Oswald, Martin Ralf, Jan Stühmer, and Daniel Cremers. "Generalized connectivity constraints for spatio-temporal 3d reconstruction." European Conference on Computer Vision. Springer, Cham, 2014.
- ^ a b Dong, Jing, et al. "4D crop monitoring: Spatio-temporal reconstruction for agriculture." 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 2017.
- ^ Kyriakaki, Georgia, et al. "4D reconstruction of tangible cultural heritage objects from web-retrieved images." International Journal of Heritage in the Digital Era 3.2 (2014): 431-451.
- ^ Guanjun Wu; Taoran Yi; Jiemin Fang; Lingxi Xie; Xiaopeng Zhang; Wei Wei; Wenyu Liu; Qi Tian; Xinggang Wang (12 Oct 2023). "4D Gaussian Splatting for Real-Time Dynamic Scene Rendering". arXiv:2310.08528 [cs.CV].
- ^ a b Franzen, Carl. "Actors' worst fears come true? New 4D Gaussian splatting method captures human motion". venturebeat.com. VentureBeat. Retrieved October 18, 2023.
External links
- c-Space: 4D Reconstruction from pictures and videos
- v
- t
- e
- Datasets
- Digital geometry
- Commercial systems
- Feature detection
- Geometry
- Image sensor technology
- Learning
- Morphology
- Motion analysis
- Noise reduction techniques
- Recognition and categorization
- Research infrastructure
- Researchers
- Segmentation
- Software
- Computer stereo vision
- Motion capture
- Object recognition
- 3D object recognition
3D reconstruction |
---|
- 3D pose estimation
- Activity recognition
- Audio-visual speech recognition
- Automatic image annotation
- Automatic number-plate recognition
- Automated species identification
- Augmented reality
- Bioimage informatics
- Blob detection
- Computer-aided diagnosis
- Content-based image retrieval
- Eye tracking
- Face recognition
- Foreground detection
- Gesture recognition
- Image denoising
- Image restoration
- Landmark detection
- Medical image computing
- Object detection
- Optical character recognition
- Pose tracking
- Remote sensing
- Robotic mapping
- Autonomous vehicles
- Video content analysis
- Video motion analysis
- Video surveillance
- Video tracking
This computer graphics–related article is a stub. You can help Wikipedia by expanding it. |
- v
- t
- e