Infrared-visible image registration for augmented reality-based thermographic building diagnostics
2015 (English)In: Visualization in Engineering, ISSN 2213-7459, Vol. 3, 16Article in journal (Refereed) Published
Background: In virtue of their capability to measure temperature, thermal infrared cameras have been widely used in building diagnostics for detecting heat loss, air leakage, water damage etc. However, the lack of visual details in thermal infrared images makes the complement of visible images a necessity. Therefore, it is often useful to register images of these two modalities for further inspection of architectures. Augmented reality (AR) technology, which supplements the real world with virtual objects, offers an ideal tool for presenting the combined results of thermal infrared and visible images. This paper addresses the problem of registering thermal infrared and visible façade images, which is essential towards developing an AR-based building diagnostics application. Methods: A novel quadrilateral feature is devised for this task, which models the shapes of commonly present façade elements, such as windows. The features result from grouping edge line segments with the help of image perspective information, namely, vanishing points. Our method adopts a forward selection algorithm to determine feature correspondences needed for estimating the transformation model. During the formation of the feature correspondence set, the correctness of selected feature correspondences at each step is verified by the quality of the resulting registration, which is based on the ratio of areas between the transformed features and the reference features. Results and conclusions: Quantitative evaluation of our method shows that registration errors are lower than errors reported in similar studies and registration performance is usable for most tasks in thermographic inspection of building façades.
Place, publisher, year, edition, pages
2015. Vol. 3, 16
Multimodality image registration, Augmented reality, Thermal infrared imaging, Façade
Computer Vision and Robotics (Autonomous Systems) Human Computer Interaction Other Computer and Information Science
IdentifiersURN: urn:nbn:se:hig:diva-20587DOI: 10.1186/s40327-015-0028-0OAI: oai:DiVA.org:hig-20587DiVA: diva2:869184