Automatic model-based 3-D reconstruction of the teeth from five photographs with predefined viewing directions

Andreas Wirtz; Florian Jung; Matthias Noll; Anqi Wang; Stefan Wesarg

doi:10.1117/12.2582253

15 February 2021 Automatic model-based 3-D reconstruction of the teeth from five photographs with predefined viewing directions

Andreas Wirtz, Florian Jung, Matthias Noll, Anqi Wang, Stefan Wesarg

Author Affiliations +

Proceedings Volume 11596, Medical Imaging 2021: Image Processing; 115960S (2021) https://doi.org/10.1117/12.2582253
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

Misalignment of teeth or jaws can impact the ability to chew or speak, increase the risk of gum disease or tooth decay, and potentially influence a person’s (psychological) well-being. Orthodontic treatments of misaligned teeth are complex procedures that employ dental braces to apply forces in order to move the teeth or jaws to their correct position. Photographs are typically used to document the treatment. An automatic analysis of those photographs could support the decision making and monitoring process. In this paper, we propose an automatic model-based end-to-end 3-D reconstruction approach of the teeth from five photographs with predefined viewing directions (i.e. the photographs used in orthodontic treatment documentation). It uses photo- or view-specific 2-D coupled shape models to extract the teeth contours from the images. The shape reconstruction is then carried out by a deformation-based reconstruction approach that utilizes 3-D coupled shape models and minimizes a silhouette-based loss. The optimal model parameters are determined by an optimization which maximizes the overlaps between the projected 2-D outlines of individual teeth of the 3-D model and the contours extracted from the corresponding photograph. After that the point displacements between the projected outline and segmented contour are used to iteratively deform the 3-D shape model of each tooth for all five views. Back-projection into shape space ensures that the 3-D coupled shape model consists of (statistically) valid teeth. Evaluation on 22 data sets shows promising results with an average symmetric surface distance of 0.848mm and an average DICE coefficient of 0.659.

Conference Presentation

Citation Download Citation

Andreas Wirtz, Florian Jung, Matthias Noll, Anqi Wang, and Stefan Wesarg "Automatic model-based 3-D reconstruction of the teeth from five photographs with predefined viewing directions", Proc. SPIE 11596, Medical Imaging 2021: Image Processing, 115960S (15 February 2021); https://doi.org/10.1117/12.2582253

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available