Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Fully Automatic, Omnidirectional Acquisition of Geometry and Appearance in the Context of Cultural Heritage Preservation

Published: 25 February 2015 Publication History

Abstract

Effective documentation and display of ancient objects is an essential task in the field of cultural heritage conservation. Digitization plays an important role in the process of creating, preserving, and accessing objects in digital space. Up to the present day, industrial scanners are used for this task, which focus mainly on the detailed reconstruction of the object’s geometry only. However, particularly important for a faithful digital presentation of the object is the appearance information—that is, a description of the used materials and how they interact with incident light. Using the world’s first full-spherical scanner, we propose a user-friendly reconstruction process that is specifically tailored to the needs of digitizing and representing cultural heritage artifacts. More precisely, our hardware specifically addresses the problem that invaluable or fragile artifacts may not be turned over during acquisition. Nevertheless, we can digitize the object completely, including its bottom. Further, by integrating appearance information into our digitization, we achieve a far more faithful digital replica with a quality comparable to a real picture of the object. But in contrast to a static picture, our representation allows one to interactively change the viewing and lighting directions freely. In addition, the results are very memory efficient, consuming only several megabytes per scanned object. In cooperation with museums and a private collector, we digitized several cultural heritage artifacts to demonstrate the feasibility of the proposed process.

References

[1]
Amit Agrawal, Srikumar Ramalingam, Yuichi Taguchi, and Visesh Chari. 2012. A theory of multi-layer flat refractive geometry. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR’12). IEEE, Los Alamitos, CA, 3346--3353. Available at http://dblp.uni-trier.de/db/conf/cvpr/cvpr2012.html#AgrawalRTC12.
[2]
Oleg Alexander, Mike Rogers, William Lambeth, Jen-Yuan Chiang, Wan-Chun Ma, Chuan-Chang Wang, and Paul Debevec. 2010. The Digital Emily project: Achieving a photorealistic digital actor. IEEE Computer Graphics and Applications 30, 20--31.
[3]
Sylvain Bougnoux. 1998. From projective to Euclidean space under any practical situation, a criticism of self-calibration. In Proceedings of the IEEE International Conference on Computer Vision. 790.
[4]
Nicola D’Apuzzo. 2006. Overview of 3D surface digitization technologies in Europe. In Three-Dimensional Image Capture and Applications VII. SPIE Proceedings, Vol. 6056. International Society for Optics and Photonics, 42--54.
[5]
Paul E. Debevec and Jitendra Malik. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’97). ACM, New York, NY, 369--378.
[6]
Mark D. Fairchild. 2013. Color Appearance Models. John Wiley & Sons.
[7]
Martin A. Fischler and Robert C. Bolles. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 6, 381--395.
[8]
Ryo Furukawa, Hiroshi Kawasaki, Katsushi Ikeuchi, and Masao Sakauchi. 2002. Appearance based object modeling using texture database: acquisition, compression and rendering. In Proceedings of the 13th Eurographics Workshop on Rendering (EGRW’02). Eurographics Association, Aire-la-Ville, Switzerland, 257--266.
[9]
Riccardo Gherardi and Andrea Fusiello. 2010. Practical autocalibration. In Computer Vision—ECCV 2010. Lecture Notes in Computer Science, Vol. 6311. Springer, 790--801. Available at http://dblp.uni-trier.de/db/conf/eccv/eccv2010-1.html#GherardiF10.
[10]
Steven J. Gortler, Radek Grzeszczuk, Richard Szeliski, and Michael F. Cohen. 1996. The lumigraph. In Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’96). ACM, New York, NY, 43--54.
[11]
Md. Zahurul Haq. 2012. Applied Measurement Systems. INTECH Open Access Publisher. Available at http://www.intechopen.com/books/applied-measurement-systems.
[12]
Richard Hartley and Andrew Zisserman. 2003. Multiple View Geometry in Computer Vision (2nd ed.). Cambridge University Press, New York, NY.
[13]
Michael Holroyd, Jason Lawrence, and Todd Zickler. 2010. A coaxial optical scanner for synchronous acquisition of 3D geometry and surface reflectance. ACM Transactions on Graphics 29, 4, Article No. 99.
[14]
Jan J. Koenderink and Andrea J. Van Doorn. 1998. Phenomenological description of bidirectional surface reflection. Journal of the Optical Society of America 15, 11, 2903--2912.
[15]
Johannes Köhler, Tobias Nöll, Gerd Reis, and Didier Stricker. 2012. Robust outlier removal from point clouds acquired with structured light. In Eurographics (Short Papers), Carlos Andjar and Enrico Puppo (Eds.). Eurographics Association, 21--24. Available at http://dblp.uni-trier.de/db/conf/eurographics/eg-short2012.html#KohlerNRS 12.
[16]
Johannes Köhler, Tobias Nöll, Gerd Reis, and Didier Stricker. 2013. A full-spherical device for simultaneous geometry and reflectance acquisition. In Proceedings of the 2013 IEEE Workshop on Applications of Computer Vision (WACV’13). 355--362.
[17]
Hendrik P. A. Lensch, Jan Kautz, Michael Goesele, Wolfgang Heidrich, and Hans-Peter Seidel. 2003. Image-based reconstruction of spatial appearance and geometric detail. ACM Transactions on Graphics 22, 2, 234--257.
[18]
Vincent Lepetit, Francesc Moreno-Noguer, and Pascal Fua. 2009. EPnP: An accurate o(n) solution to the PnP problem. International Journal of Computer Vision 81, 2, 155--166.
[19]
Kenneth Levenberg. 1944. A method for the solution of certain non-linear problems in least squares. Quarterly Journal of Applied Mathmatics II, 2, 164--168.
[20]
Manolis I. A. Lourakis and Antonis A. Argyros. 2009. SBA: A software package for generic sparse bundle adjustment. ACM Transactions on Mathematical Software 36, 1, 1--30.
[21]
David G. Lowe. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91--110.
[22]
Gero Müller, Gerhard H. Bendels, and Reinhard Klein. 2005. Rapid synchronous acquisition of geometry and BTF for cultural heritage artefacts. In Proceedings of the 6th International Symposium on Virtual Reality, Archaeology, and Cultural Heritage (VAST’05). Eurographics Association, 13--20.
[23]
G. N. Newsam, D. Q. Huynh, M. J. Brooks, and H. P. Pan. 1996. Recovering unknown focal lengths in self-calibration: An essentially linear algorithm and degenerate configurations. In International Archives of Photogrammetry and Remote Sensing. 575--580.
[24]
Fred E. Nicodemus. 1965. Directional reflectance and emissivity of an opaque surface. Applied Optics 4, 7, 767--775.
[25]
Tobias Nöll, Johannes Köhler, Gerd Reis, and Didier Stricker. 2012. High quality and memory efficient representation for image based 3D reconstructions. In Proceedings of the 2012 International Conference on Digital Image Computing Techniques and Applications (DICTA’12). 1--8.
[26]
Tobias Nöll, Johannes Köhler, Gerd Reis, and Didier Stricker. 2013. Faithful, compact and complete digitization of cultural heritage using a full-spherical scanner. In Proceedings of the 2013 Digital Heritage International Congress. IEEE, Los Alamitos, CA, 15--22.
[27]
Gianpaolo Palma, Marco Callieri, Matteo Dellepiane, and Roberto Scopigno. 2012. A statistical method for SVBRDF approximation from video sequences in general lighting conditions. Computer Graphics Forum (Issue of Eurographics Symposium on Rendering 2012) 31, 4, 1491--1500. Available at http://vcg.isti.cnr.it/Publications/2012/PCDS12.
[28]
Gianpaolo Palma, Nicola Desogus, Paolo Cignoni, and Roberto Scopigno. 2013. Surface light field from video acquired in uncontrolled settings. In Proceedings of the Digital Heritage 2013 International Conference, Vol. 1. IEEE, Los Alamitos, CA, 31--38. Available at http://vcg.isti.cnr.it/Publications/2013/PDCS13.
[29]
Charles A. Poynton. 1993. Gamma and its disguises: The nonlinear mappings of intensity in perception, CRTs, film, and video. SMPTE Motion Imaging Journal 102, 12, 1099--1108.
[30]
Christopher Schwartz and Reinhard Klein. 2012. Acquisition and presentation of virtual surrogates for cultural heritage artefacts. In Proceedings of EVA 2012 Berlin. Gesellschaft zur Förderung angewandter Informatik e.V., 50--57.
[31]
Christopher Schwartz, Michael Weinmann, Roland Ruiters, and Reinhard Klein. 2011. Integrated high-quality acquisition of geometry and appearance for cultural heritage. In Proceedings of the International Symposium on Virtual Reality, Archeology, and Cultural Heritage (VAST'11). Eurographics Association, 25--32.
[32]
Tali Treibitz, Yoav Schechner, Clayton Kunz, and Hanumant Singh. 2012. Flat refractive geometry. IEEE Transactions on Pattern Analysis and Machine Intelligence 34, 1, 51--65.
[33]
Zhaoyang Wang and Bongtae Han. 2004. Advanced iterative algorithm for phase extraction of randomly phase-shifted interferograms. Optics Letters 29, 14, 1671--1673.
[34]
Zhaoyang Wang, Dung A. Nguyen, and John C. Barnes. 2010. Some practical considerations in fringe projection profilometry. Optics and Lasers in Engineering 48, 2, 218--225.
[35]
Gregory J. Ward. 1992. Measuring and modeling anisotropic reflection. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH’92). ACM, New York, NY, 265--272.

Cited By

View all
  • (2023)An empirical study to design interactions with historical buildings used for everyday activitiesProceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality10.1145/3623462.3624635(1-12)Online publication date: 28-Sep-2023
  • (2022)Design Recommendations for Historical Cemeteries Using Speculative DesignProceedings of the 25th International Academic Mindtrek Conference10.1145/3569219.3569378(147-157)Online publication date: 16-Nov-2022
  • (2021)Towards Tangible Cultural Heritage Experiences—Enriching VR-based Object Inspection with Haptic FeedbackJournal on Computing and Cultural Heritage 10.1145/347047015:1(1-17)Online publication date: 14-Dec-2021
  • Show More Cited By

Index Terms

  1. Fully Automatic, Omnidirectional Acquisition of Geometry and Appearance in the Context of Cultural Heritage Preservation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Journal on Computing and Cultural Heritage
    Journal on Computing and Cultural Heritage   Volume 8, Issue 1
    Special Issue on Best Papers from Digital Heritage 2013
    February 2015
    129 pages
    ISSN:1556-4673
    EISSN:1556-4711
    DOI:10.1145/2740008
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 25 February 2015
    Accepted: 01 April 2014
    Revised: 01 March 2014
    Received: 01 January 2014
    Published in JOCCH Volume 8, Issue 1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Appearance
    2. BRDF
    3. cultural heritage
    4. digital replica
    5. virtual museum

    Qualifiers

    • Research-article
    • Research
    • Refereed

    Funding Sources

    • DENSITY (01IW12001)
    • Google Research Award received by Didier Stricker, Kaiserslautern University

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 08 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)An empirical study to design interactions with historical buildings used for everyday activitiesProceedings of the 20th International Conference on Culture and Computer Science: Code and Materiality10.1145/3623462.3624635(1-12)Online publication date: 28-Sep-2023
    • (2022)Design Recommendations for Historical Cemeteries Using Speculative DesignProceedings of the 25th International Academic Mindtrek Conference10.1145/3569219.3569378(147-157)Online publication date: 16-Nov-2022
    • (2021)Towards Tangible Cultural Heritage Experiences—Enriching VR-based Object Inspection with Haptic FeedbackJournal on Computing and Cultural Heritage 10.1145/347047015:1(1-17)Online publication date: 14-Dec-2021
    • (2020)In search of the lost polychromy of English medieval alabaster panels in the Southwest of FranceColor Research & Application10.1002/col.2248245:3(427-449)Online publication date: 5-Feb-2020
    • (2019)A New Projection-based Exhibition System for a MuseumJournal on Computing and Cultural Heritage 10.1145/327552212:2(1-17)Online publication date: 7-May-2019
    • (2019)Spatially-Varying Diffuse Reflectance Capture Using Irradiance Map Rendering for Image-Based Modeling Applications2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR.2019.00-27(46-54)Online publication date: Oct-2019
    • (2019)Virtual Reality in Media and TechnologyDigital Transformation10.1007/978-3-662-58134-6_3(19-41)Online publication date: 2019
    • (2018)Virtuelle Realität in Medien und TechnikDigitalisierung10.1007/978-3-662-55890-4_3(19-42)Online publication date: 2018
    • (2017)Scene reassembly after multimodal digitization and pipeline evaluation using photorealistic renderingApplied Optics10.1364/AO.56.00767956:27(7679)Online publication date: 19-Sep-2017
    • (2017)Assisted color acquisition for 3D modelsComputers and Graphics10.1016/j.cag.2017.08.01168:C(119-128)Online publication date: 1-Nov-2017
    • Show More Cited By

    View Options

    Login options

    Full Access

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media