Investigating the time and spatial constraints under which visual and auditory stimuli are perceived as a unique percept or as spatially coincident has been a topic of numerous researches. However, these findings have been derived up to... more
Investigating the time and spatial constraints under which visual and auditory stimuli are perceived as a unique percept or as spatially coincident has been a topic of numerous researches. However, these findings have been derived up to now in extremely simplified stimulation context consisting in the combination of elementary auditory and visual stimuli usually displayed in dark and anechoic conditions.
The advent of low cost scanning devices and the improvement of multi-view stereo techniques have made the acquisition of 3D geometry ubiquitous. Data gathered from different devices, however, result in large variations in detail, scale,... more
The advent of low cost scanning devices and the improvement of multi-view stereo techniques have made the acquisition of 3D geometry ubiquitous. Data gathered from different devices, however, result in large variations in detail, scale, and coverage. Registration of such data is essential before visualizing, comparing and archiving them. However, state-of-the-art methods for geometry registration cannot be directly applied due to intrinsic differences between the models, e.g. sampling, scale, noise. In this paper we present a method for the automatic registration of multi-modal geometric data, i.e. acquired by devices with different properties (e.g. resolution, noise, data scaling). The method uses a descriptor based on Growing Least Squares, and is robust to noise, variation in sampling density, details, and enables scale-invariant matching. It allows not only the measurement of the similarity between the geometry surrounding two points, but also the estimation of their relative scale. As it is computed locally, it can be used to analyze large point clouds composed of millions of points. We implemented our approach in two registration procedures (assisted and automatic) and applied them successfully on a number of synthetic and real cases. We show that using our method, multi-modal models can be automatically registered, regardless of their differences in noise, detail, scale, and unknown relative coverage.
ABSTRACT An archeological excavation is usually a rapidly evolving environment: several factors (weather, costs, permissions) force the work to be concentrated in a few weeks. Moreover, excavating is essentially a mono-directional... more
ABSTRACT An archeological excavation is usually a rapidly evolving environment: several factors (weather, costs, permissions) force the work to be concentrated in a few weeks. Moreover, excavating is essentially a mono-directional operation, which constantly modifies the state of the site. Since most of the interpretation is performed in a second stage, it is necessary to collect a massive amount of documentation (images, sketches, notes, measurements). In this paper we present an experiment of monitoring of an excavation in Uppåkra, South Sweden, using dense stereo matching techniques. The archeologists were trained to collect a set of images every day; the set was used to produce a 3D model depicting the state of the excavation. In this way, it was possible to obtain a reliable geometric representation of the evolution of the excavation. The obtained model were also used by the archeologists, by the means of an open-source tool, to perform a site study and interpretation stage directly on the geometric data. The results of the experimentation show that dense stereo matching can be easily integrated with the daily work of archeologists in the context of an excavation, and it can provide a valuable source of data for interpretation, archival and integration of acquired material.
Research Interests:
Research Interests:
Research Interests:
Wepresentasimple,fastandrobusttechniqueforsemi-automatic2D-3Dregistrationcapabletoalignalargeset of unordered images to a massive point cloud with minimal human effort. Our method converts the hard to solve... more
Wepresentasimple,fastandrobusttechniqueforsemi-automatic2D-3Dregistrationcapabletoalignalargeset of unordered images to a massive point cloud with minimal human effort. Our method converts the hard to solve image-to-geometryregistrationprobleminaStructure-from-Motion(SfM)plusa3D-3Dregistrationproblem.We exploit a SfM framework that, starting just from the unordered image collection, computes an estimate of camera parametersandasparse3Dgeometryderivingfrommatchedimagefeatures.Wethencoarselyregisterthismodel tothegiven3Dgeometrybyestimatingaglobalscaleandabsoluteorientationusingminimalmanualintervention. A specialized sparse bundle adjustment (SBA) step, exploiting the correspondence between the model deriving from image features and the fine input 3D geometry, is then used to refine intrinsic and extrinsic parameters of each camera. Output data is suitable for photo blending frameworks to produce seamless colored models. The effectiveness ofthemethod isdemonstrated onaseries ofreal-w...
This paper shows how to improve the results of a 3D scan-ning system to allow to better fit the requirements of the Multi-Media and Cultural Heritage domains. A real-time in-hand scanning system is enhanced by further processing its... more
This paper shows how to improve the results of a 3D scan-ning system to allow to better fit the requirements of the Multi-Media and Cultural Heritage domains. A real-time in-hand scanning system is enhanced by further processing its intermediate data, with the goal of producing a digital 3D model with a high quality color texture and an improved representation of the high-frequency shape detail. The pro-posed solution starts from the usual output of the scanner, a 3D model and a video sequence gathered by the scanner sensor, for which the rigid motion is known at each frame. The produced color texture is deprived of the typical artifacts that generally appear while creating textures from several pictures: ghosting, shadows and specular highlights. In the case of objects made of diffuse materials, the system is also able to compute a normal map, thus improving the geometry acquired by the scanner. Re-sults demonstrate that our texturing procedure is quite fast (a few min-utes to proc...
The remote visualization and navigation of 3D data directly inside the web browser is becoming a viable option, due to the recent efforts in standardizing the components for 3D rendering on the web platform. Nevertheless, handling complex... more
The remote visualization and navigation of 3D data directly inside the web browser is becoming a viable option, due to the recent efforts in standardizing the components for 3D rendering on the web platform. Nevertheless, handling complex models may be a challenge, especially when a more generic solution is needed to handle different cases. In particular, archeological and architectural models are usually hard to handle, since their navigation can be managed in several ways, and a completely free navigation may be misleading and not realistic. In this paper we present a solution for the remote navigation of these dataset in a WebGL component. The navigation has two possible modes: the ”bird’s eye” mode, where the user is able to see the model from above, and the ”first person” mode, where the user can move inside the structure. The two modalities are linked by a point of interest, that helps the user to control the navigation in an intuitive fashion. Since the terrain may not be fla...
Research Interests:
ABSTRACT The management, processing and visualization of color information is a critical subject in the context of the acquisition and visualization of real objects. Especially in the context of Cultural Heritage, artifacts are so complex... more
ABSTRACT The management, processing and visualization of color information is a critical subject in the context of the acquisition and visualization of real objects. Especially in the context of Cultural Heritage, artifacts are so complex or hard-to-handle that the appearance information has to be extracted from a set of images. The images usually have to be registered to the 3D model of the objects, in order to transfer the needed information. Hence, the problem of image-to-geometry registration has been thoroughly studied by the Computer Graphics and Computer Vision community. Several methods have been proposed, but a fully automatic and generic solution is still missing. Moreover, small misalignments often lead to visible artifacts in the final colored 3D models. In this paper, we propose a method to refine the alignment of a group of images which has been already registered to a 3D model. Taking advantage of the overlapping among the images, and applying a statistical global method based on Mutual Information, the registration error is distributed among all the elements of the dataset. Hence, the quality of color projection is improved, especially when dealing with small details. The method was tested on a number of heterogeneous Cultural Heritage objects, bringing to a visible improvement in the rendering quality. The method is fully automatic, and it does not need powerful hardware or long processing time. Hence, it represents a valid solution for a wide application on CH artifacts.
Research Interests:
Abstract This poster presents a practical system for enhancing the quality of Low Dynamic Range (LDR) videos using High Dynamic Range (HDR) background images. Our technique relies on the assumption that the HDR information is static in... more
Abstract This poster presents a practical system for enhancing the quality of Low Dynamic Range (LDR) videos using High Dynamic Range (HDR) background images. Our technique relies on the assumption that the HDR information is static in the video footage. This assumption can be valid in many scenarios where moving subjects are the main focus of the footage and do not have to interact with moving light sources or highly reflective objects. Another valid scenario is teleconferencing via webcams, where the background is ...
Research Interests:
ABSTRACT The integrated presentation of a 3D model and a descriptive text which is strongly connected to the geometry (and, more in general, of multiple interconnected datasets of different nature) is still problematic. This is often... more
ABSTRACT The integrated presentation of a 3D model and a descriptive text which is strongly connected to the geometry (and, more in general, of multiple interconnected datasets of different nature) is still problematic. This is often solved by using plugins and/or resulting in poorly connected exploration tree (where one media is used as a "primary content", and the rest of the data are just used to enrich it). In this paper, we present a framework for the presentation, on the web platform, of multiple heterogeneous datasets. Thanks to a modular design, and a simple mechanism to index data structures and messages, it is possible to design interconnected viewers, and build a flexible system for this purpose. By explicitly annotating the datasets with locators, which are present in all datasets, it is possible to build a strongly connected graph, and let the user explore it, obtaining a real multi-media exploration, inside and across the various datasets. The entire system is implemented using HTML5 and JavaScript, making it a portable solution, able to run natively inside browsers, without additional components. We tested the system on two practical, complex examples, both composed of an intricate high-resolution geometry, and rich textual information.
Research Interests:
ABSTRACT Multiview stereo reconstruction methods can provide impressive results in a number of applications. Nevertheless, when trying to apply the state-of-the-art methods in the case of a more structured 3D acquisition, the lack of... more
ABSTRACT Multiview stereo reconstruction methods can provide impressive results in a number of applications. Nevertheless, when trying to apply the state-of-the-art methods in the case of a more structured 3D acquisition, the lack of feedback on the quality of the reconstruction during the photo shooting can be problematic. In this paper we present a framework for the assisted reconstruction from images of real objects. The framework is able to provide, in quasi-real time, a sparse reconstruction of the scene, so that the user is able to spot the missing or problematic parts. Moreover, the framework is able to separate the object of interest from the background and suggests missing points of view to the user, without any previous knowledge of the shape of the scene and the acquisition path. This is obtained by analyzing the sparse reconstruction and the connection between the reconstructed points and the input images. The framework has been tested on a variety of practical cases, and it has proved to be effective not only to obtain more complete reconstructions, but also to reduce the number of images needed and the processing time for dense reconstruction.
Research Interests:
@Book{IWPT:2011, editor = {Harry Bunt and Joakim Nivre and Özlem Çetinoğlu}, title = {Proceedings of the 12th International Conference on Parsing Technologies}, month = {October}, year = {2011}, address = {Dublin, Ireland}, publisher =... more
@Book{IWPT:2011, editor = {Harry Bunt and Joakim Nivre and Özlem Çetinoğlu}, title = {Proceedings of the 12th International Conference on Parsing Technologies}, month = {October}, year = {2011}, address = {Dublin, Ireland}, publisher = {Association for Computational Linguistics}, url = {http://www.aclweb.org/anthology/W11-29} } @InProceedings{steedman:2011:IWPT, author = {Steedman, Mark}, title = {Computing Scope in a CCG Parser}, booktitle = {Proceedings of the 12th International Conference on Parsing Technologies}, month = {October ...
Research Interests:
Research Interests:
Abstract This paper describes how some innovative methodologies have been designed and employed to support the restoration of the Madonna of Pietranico, a terracotta statue severely damaged in the 2009 earthquake. The statue, fragmented... more
Abstract This paper describes how some innovative methodologies have been designed and employed to support the restoration of the Madonna of Pietranico, a terracotta statue severely damaged in the 2009 earthquake. The statue, fragmented in many pieces, has undergone a complex restoration performed by a multidisciplinary working group. The contribution of digital technologies was planned from the very beginning, since the complexity of this restoration originated the design of innovative procedures for managing ...
Research Interests:
Research Interests:
Abstract The support of advanced information technology (IT) to preservation, restoration and documentation of Cultural Heritage (CH) is becoming a very important goal for the research community.... more
Abstract The support of advanced information technology (IT) to preservation, restoration and documentation of Cultural Heritage (CH) is becoming a very important goal for the research community. Michelangelo's David was one of the first applications of 3D scanning technology on a highly popular work of art. The subsequent restoration campaign, started in 2002 and concluded in 2004, was also a milestone for the adoption of modern scientific analysis procedures and IT tools in the framework of a restoration process. One of the ...
Abstract This work concerns a novel study in the field of image-to-geometry registration. Our approach takes inspiration from medical imaging, in particular from multi-modal image registration. Most of the algorithms developed in this... more
Abstract This work concerns a novel study in the field of image-to-geometry registration. Our approach takes inspiration from medical imaging, in particular from multi-modal image registration. Most of the algorithms developed in this domain, where the images to register come from different sensors (CT, X-ray, PET), are based on Mutual Information, a statistical measure of non-linear correlation between two data sources. The main idea is to use mutual information as a similarity measure between the image to be registered and renderings of ...
Research Interests:
Abstract The dichotomy between full detail representation and the efficient management of data digitization is still a big issue in the context of the acquisition and visualization of 3D objects, especially in the field of the cultural... more
Abstract The dichotomy between full detail representation and the efficient management of data digitization is still a big issue in the context of the acquisition and visualization of 3D objects, especially in the field of the cultural heritage. Modern scanning devices enable very detailed geometry to be acquired, but it is usually quite hard to apply these technologies to large artifacts. In this article we present a project aimed at virtually reconstructing the impressive (7× 11 m.) portal of the Ripoll Monastery, Spain. The monument was acquired ...
Research Interests:
Research Interests:
Camera calibration is an important operation for a number of applications in the field of Computer Graphics and Computer Vision. In particular, if the intrinsic parameters of the camera are known in advance, the accuracy of results is... more
Camera calibration is an important operation for a number of applications in the field of Computer Graphics and Computer Vision. In particular, if the intrinsic parameters of the camera are known in advance, the accuracy of results is extremely improved. For this reason, several easy procedures to calibrate a camera have been proposed. The accuracy and ease-of-use of these procedures is strongly related to the needed calibration target, which is usually a single 2D printed pattern (ie a checkerboard). In this paper we propose ...
Abstract: The result of an outdoors 3D scanning acquisition campaign is usually an accurate 3D model of the site, but in most of the cases the quality of the color acquired by the scanner is not satisfying. Alternative solutions, like the... more
Abstract: The result of an outdoors 3D scanning acquisition campaign is usually an accurate 3D model of the site, but in most of the cases the quality of the color acquired by the scanner is not satisfying. Alternative solutions, like the projection of a photographic dataset acquired in a different stage, are still dependent on the quality of the initial images. The short time for the acquisition campaigns and the weather conditions often force the shooting of images taken under a strong direct sun illumination. This generates colored models of poor quality ...
Research Interests:
In this paper, we present a practical system for enhancing the quality of Low Dynamic Range (LDR) videos using High Dynamic Range (HDR) background images. Our technique relies on the assumption that the HDR information is static in the... more
In this paper, we present a practical system for enhancing the quality of Low Dynamic Range (LDR) videos using High Dynamic Range (HDR) background images. Our technique relies on the assumption that the HDR information is static in the video footage. This assumption can be valid in many scenarios where moving subjects are the main focus of the footage and do not have to interact with moving light sources or highly reflective objects. Another valid scenario is teleconferencing via webcams, where the background is ...
Research Interests:
The introduction of new technologies in the context of cultural heritage (CH) and Archeology has often been a difficult issue. This is probably related to the lack in confidence in replacing consolidated approaches with experimental... more
The introduction of new technologies in the context of cultural heritage (CH) and Archeology has often been a difficult issue. This is probably related to the lack in confidence in replacing consolidated approaches with experimental methods heavily based on innovative hardware or software systems. This already happened for a number of revolutionary technologies: for example, the advent of photography, color images and digital cameras took some time before changing the reference methods for archival and studies in the context of ...
Abstract: In this paper we propose an extension for the algorithms of image-to-geometry registration by Mutual Information (MI) to improve the performance and the quality of the alignment. Proposed for the registration of multi modal... more
Abstract: In this paper we propose an extension for the algorithms of image-to-geometry registration by Mutual Information (MI) to improve the performance and the quality of the alignment. Proposed for the registration of multi modal medical images, in the last years MI has been adapted to align a 3D model to a given image by using different renderings of the model and a gray-scale version of the input image. A key aspect is the choice of the rendering process to correlate the 3D model to the image without taking into account the ...
Research Interests:
Abstract: We present a new method for the accurate registration of video sequences of a real object over its dense triangular mesh. The goal is to obtain an accurate video-to-geometry registration to allow the bidirectional data transfer... more
Abstract: We present a new method for the accurate registration of video sequences of a real object over its dense triangular mesh. The goal is to obtain an accurate video-to-geometry registration to allow the bidirectional data transfer between the 3D model and the video using the perspective projection defined by the camera model. Our solution uses two different approaches: feature-based registration by KLT video tracking, and statistic-based registration by maximizing the Mutual Information (MI) between the gradient of the frame ...
Abstract: The heritage site of Luni is a very interesting location, which tells the story of an ancient roman colony, and of an area where different cultures left their heritage. In particular, the remains of the pediments of an ancient... more
Abstract: The heritage site of Luni is a very interesting location, which tells the story of an ancient roman colony, and of an area where different cultures left their heritage. In particular, the remains of the pediments of an ancient temple represent a very interesting case and an open field of study for art historians. The scanning of a group of statue belonging to the pediments showed that the produced 3D models could be used in several ways, not only for archival and presentation purposes but also to provide interactive support for the work of ...
Research Interests:
Lighting artifacts are one of the main issues in digital photography: complex light setups are needed to attenuate or remove them. Flash light is a very easy way to illuminate an object or an environment, but it is rarely considered in... more
Lighting artifacts are one of the main issues in digital photography: complex light setups are needed to attenuate or remove them. Flash light is a very easy way to illuminate an object or an environment, but it is rarely considered in most of the Computer Graphics and Computer Vision applications. This is due to the big amount of artifacts introduced by this lighting, and to the difficulty in modeling its behavior. In this paper we present a simple method to use flash light in the context of color acquisition and mapping on 3D models. ...
Abstract: In this paper we present how technologies developed in the context of 3D graphics (3D scanning and image-to-3D-model mapping) have been used to evaluate in a metrically objective way the plausibility of an attribution hypothesis... more
Abstract: In this paper we present how technologies developed in the context of 3D graphics (3D scanning and image-to-3D-model mapping) have been used to evaluate in a metrically objective way the plausibility of an attribution hypothesis of a Renaissance artifact. The artifact considered is a small bronze horse (Archeological Museum, Florence, Italy), which was discovered to be very similar to a silverpoint drawing by Leonardo (Leonardo drawing# 358, Windsor Royal Library, UK), thus originating an attribution hypothesis. A highly ...
Research Interests:
abstract={In this paper the project Archeomatica of Catania University dedicated to Minoan civilization and Cretan culture is presented. The project carried out by experts of information technology and archaeological research provides the... more
abstract={In this paper the project Archeomatica of Catania University dedicated to Minoan civilization and Cretan culture is presented. The project carried out by experts of information technology and archaeological research provides the creation of realistic 3D models based on the data recorded during excavations that are digital upgradeable archives to add to the traditional graphic and photographic documentations. In particular two case-studies of 3D reconstructions of monuments of prehistoric and proto-historic archaeology, realized by a" ...
Research Interests:
Abstract: The paper presents MeshLab, an open source, extensible, mesh processing system that has been developed at the Visual Computing Lab of the ISTI-CNR with the helps of tens of students. We will describe the MeshLab architecture,... more
Abstract: The paper presents MeshLab, an open source, extensible, mesh processing system that has been developed at the Visual Computing Lab of the ISTI-CNR with the helps of tens of students. We will describe the MeshLab architecture, its main features and design objectives discussing what strategies have been used to support its development. Various examples of the practical uses of MeshLab in research and professional frameworks are reported to show the various capabilities of the presented system.
Research Interests:
ABSTRACT In this paper, we present EnvyDepth, an interface for recovering local illumination from a single HDR environment map. In EnvyDepth, the user quickly indicates strokes to mark regions of the environment map that should be grouped... more
ABSTRACT In this paper, we present EnvyDepth, an interface for recovering local illumination from a single HDR environment map. In EnvyDepth, the user quickly indicates strokes to mark regions of the environment map that should be grouped together in a single geometric primitive. From these annotated strokes, EnvyDepth uses edit propagation to create a detailed collection of virtual point lights that reproduce both the local and the distant lighting effects in the original scene. When compared to the sole use of the distant illumination, the added spatial information better reproduces a variety of local effects such as shadows, highlights and caustics. Without the effort needed to create precise scene reconstructions, EnvyDepth annotations take only tens of seconds to produce a plausible lighting without visible artifacts. This is easy to obtain even in the case of complex scenes, both indoors and outdoors. The generated lighting environments work well in a production pipeline since they are efficient to use and able to produce accurate renderings.