3D damage mapping and segmentation using neural radiance fields and advanced deep learning techniques

Loading...
Thumbnail Image
Date
2024-07-08
Authors
Kim, Geontae
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This thesis introduces a novel approach to Structural Health Monitoring (SHM) by integrating deep learning with advanced 3D reconstruction techniques, focusing on the efficient analysis of bridge structures for achieving digital twin in SHM. Traditional photogrammetry faces challenges in accurately reconstructing flat surfaces and rapidly assessing structural health. Addressing these issues, this research adopts the Nerfacto model from the Neural Radiance Fields (NeRF) within the Nerfstudio framework to enhance 3D reconstruction fidelity and utilizes strategically placed markers to improve camera pose accuracy. Additionally, the integration of the STRNet and Test Time Agumentation (TTA) significantly enhances crack detection capabilities. This approach allows for precise mapping of segmented cracks onto a 3D model of a bridge, offering a detailed and quantifiable assessment of structural damage. By combining these innovative technologies, the research provides a scalable, cost-effective solution for comprehensive structural assessments, paving the way for proactive maintenance strategies that ensure the longevity and safety of critical infrastructure. The integration of digital twin technology and detailed damage mapping in 3D also sets a new standard in the field, demonstrating substantial potential for future SHM applications.
Description
Keywords
SHM, Damage detection, Deep learning, Crack segmentation, 3D reconstruction, Neural radiance fields, NeRF, Digital twin
Citation