-
GPU-based data processing for speeding-up correlation plenoptic imaging
Authors:
Francesca Santoro,
Isabella Petrelli,
Gianlorenzo Massaro,
George Filios,
Francesco V. Pepe,
Leonardo Amoruso,
Maria Ieronimaki,
Samuel Burri,
Edoardo Charbon,
Paul Mos,
Arin Ulku,
Michael Wayne,
Cristoforo Abbattista,
Claudio Bruschini,
Milena D'Angelo
Abstract:
Correlation Plenoptic Imaging (CPI) is a novel technological imaging modality enabling to overcome drawbacks of standard plenoptic devices, while preserving their advantages. However, a major challenge in view of real-time application of CPI is related with the relevant amount of required frames and the consequent computational-intensive processing algorithm. In this work, we describe the design a…
▽ More
Correlation Plenoptic Imaging (CPI) is a novel technological imaging modality enabling to overcome drawbacks of standard plenoptic devices, while preserving their advantages. However, a major challenge in view of real-time application of CPI is related with the relevant amount of required frames and the consequent computational-intensive processing algorithm. In this work, we describe the design and implementation of an optimized processing algorithm that is portable to an efficient computational environment and exploits the highly parallel algorithm offered by GPUs. Improvements by a factor ranging from 20x, for correlation measurement, to 500x, for refocusing, are demonstrated. Exploration of the relation between the improvement in performance achieved and actual GPU capabilities, also indicates the feasibility of near-real time processing capability, opening up to the potential use of CPI for practical real-time application.
△ Less
Submitted 30 July, 2024;
originally announced July 2024.
-
Correlation Hyperspectral Imaging
Authors:
Gianlorenzo Massaro,
Francesco V. Pepe,
Milena D'Angelo
Abstract:
Hyperspectral imaging aims at providing information on both the spatial and the spectral distribution of light, with high resolution. However, state-of-the-art protocols are characterized by an intrinsic trade-off imposing to sacrifice either resolution or image acquisition speed. We address this limitation by exploiting light intensity correlations, which are shown to enable overcoming the typica…
▽ More
Hyperspectral imaging aims at providing information on both the spatial and the spectral distribution of light, with high resolution. However, state-of-the-art protocols are characterized by an intrinsic trade-off imposing to sacrifice either resolution or image acquisition speed. We address this limitation by exploiting light intensity correlations, which are shown to enable overcoming the typical downsides of traditional hyperspectral imaging techniques, both scanning and snapshot. The proposed approach also opens possibilities that are not otherwise achievable, such as sharper imaging and natural filtering of broadband spectral components that would otherwise hide the spectrum of interest. The enabled combination of high spatial and spectral resolution, high speed, and insensitivity to undesired spectral features shall lead to a paradigm change in hyperspectral imaging devices and open-up new application scenarios.
△ Less
Submitted 18 July, 2024;
originally announced July 2024.
-
Assessing the 3D resolution of refocused correlation plenoptic images using a general-purpose image quality estimator
Authors:
Gianlorenzo Massaro
Abstract:
Correlation plenoptic imaging (CPI) is emerging as a promising approach to light-field imaging (LFI), a technique enabling simultaneous measurement of light intensity distribution and propagation direction from a scene. LFI allows single-shot 3D sampling, offering fast 3D reconstruction for a wide range of applications. However, the array of micro-lenses typically used in LFI to obtain 3D informat…
▽ More
Correlation plenoptic imaging (CPI) is emerging as a promising approach to light-field imaging (LFI), a technique enabling simultaneous measurement of light intensity distribution and propagation direction from a scene. LFI allows single-shot 3D sampling, offering fast 3D reconstruction for a wide range of applications. However, the array of micro-lenses typically used in LFI to obtain 3D information limits image resolution, which rapidly declines with enhanced volumetric reconstruction capabilities. CPI addresses this limitation by decoupling light-field information measurement using two photodetectors with spatial resolution, eliminating the need for micro-lenses. 3D information is encoded in a four-dimensional correlation function, which is decoded in post-processing to reconstruct images without the resolution loss seen in conventional LFI. This paper evaluates the tomographic performance of CPI, demonstrating that the refocusing reconstruction method provides axial sectioning capabilities comparable to conventional imaging systems. A general-purpose analytical approach based on image fidelity is proposed to quantitatively study axial and lateral resolution. This analysis fully characterizes the volumetric resolution of any CPI architecture, offering a comprehensive evaluation of its imaging performance.
△ Less
Submitted 19 June, 2024;
originally announced June 2024.
-
Light-field imaging from position-momentum correlations
Authors:
Davide Giannella,
Gianlorenzo Massaro,
Bohumil Stoklasa,
Milena D'Angelo,
Francesco V. Pepe
Abstract:
Correlation plenoptic imaging (CPI) is a light-field imaging technique employing intensity correlation measurements to simultaneously detect the spatial distribution and the propagation direction of light. Compared to standard methods, in which light-field images are directly encoded in intensity, CPI provides a significant enhancement of the volumetric reconstruction performance in terms of both…
▽ More
Correlation plenoptic imaging (CPI) is a light-field imaging technique employing intensity correlation measurements to simultaneously detect the spatial distribution and the propagation direction of light. Compared to standard methods, in which light-field images are directly encoded in intensity, CPI provides a significant enhancement of the volumetric reconstruction performance in terms of both achievable depth of field and 3D resolution. In this article, we present a novel CPI configuration where light-field information is encoded in correlations between position and momentum measurements, namely, points on a given object plane and points of the Fourier plane of the imaging lens. Besides the fundamental interest in retrieving the properties of position-momentum correlation, the proposed scheme overcomes practical limitations of previously proposed setups, providing higher axial homogeneity and robustness with respect to the identification of reference planes.
△ Less
Submitted 29 January, 2024;
originally announced January 2024.
-
Direct 3D imaging through spatial coherence of light
Authors:
Gianlorenzo Massaro,
Barbara Barile,
Giuliano Scarcelli,
Francesco V. Pepe,
Grazia Paola Nicchia,
Milena D'Angelo
Abstract:
Wide-field imaging is widely adopted due to its fast acquisition, cost-effectiveness and ease of use. Its extension to direct volumetric applications, however, is burdened by the trade-off between resolution and depth of field (DOF), dictated by the numerical aperture of the system. We demonstrate that such trade-off is not intrinsic to wide-field imaging, but stems from the spatial incoherence of…
▽ More
Wide-field imaging is widely adopted due to its fast acquisition, cost-effectiveness and ease of use. Its extension to direct volumetric applications, however, is burdened by the trade-off between resolution and depth of field (DOF), dictated by the numerical aperture of the system. We demonstrate that such trade-off is not intrinsic to wide-field imaging, but stems from the spatial incoherence of light: images obtained through spatially coherent illumination are shown to have resolution and DOF independent of the numerical aperture. This fundamental discovery enabled us to demonstrate an optimal combination of coherent resolution-DOF enhancement and incoherent tomographic sectioning for scanning-free, wide-field 3D microscopy on a multicolor histological section.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
Light Field Ghost Imaging
Authors:
Alberto Paniate,
Gianlorenzo Massaro,
Alessio Avella,
Alice Meda,
Francesco V. Pepe,
Marco Genovese,
Milena D'Angelo,
Ivano Ruo Berchera
Abstract:
Techniques based on classical and quantum correlations in light beams, such as ghost imaging, allow us to overcome many limitations of conventional imaging and sensing protocols. Despite their advantages, applications of such techniques are often limited in practical scenarios where the position and the longitudinal extension of the target object are unknown. In this work, we propose and experimen…
▽ More
Techniques based on classical and quantum correlations in light beams, such as ghost imaging, allow us to overcome many limitations of conventional imaging and sensing protocols. Despite their advantages, applications of such techniques are often limited in practical scenarios where the position and the longitudinal extension of the target object are unknown. In this work, we propose and experimentally demonstrate a novel imaging technique, named Light Field Ghost Imaging, that exploits light correlations and light field imaging principles to enable going beyond the limitations of ghost imaging in a wide range of applications. Notably, our technique removes the requirement to have prior knowledge of the object distance allowing the possibility of refocusing in post-processing, as well as performing 3D imaging while retaining all the benefits of ghost imaging protocols.
△ Less
Submitted 26 September, 2023;
originally announced September 2023.
-
Periodic patterns for resolution limit characterization of correlation plenoptic imaging
Authors:
Francesco Scattarella,
Gianlorenzo Massaro,
Bohumil Stoklasa,
Milena D'Angelo,
Francesco V. Pepe
Abstract:
The measurement of the spatio-temporal correlations of light provides an interesting tool to overcome the traditional limitations of standard imaging, such as the strong trade-off between spatial resolution and depth of field. In particular, using correlation plenoptic imaging, one can detect both the spatial distribution and the direction of light in a scene, pushing both resolution and depth of…
▽ More
The measurement of the spatio-temporal correlations of light provides an interesting tool to overcome the traditional limitations of standard imaging, such as the strong trade-off between spatial resolution and depth of field. In particular, using correlation plenoptic imaging, one can detect both the spatial distribution and the direction of light in a scene, pushing both resolution and depth of field to the fundamental limit imposed by wave-optics. This allows one to perform refocusing of different axial planes and three-dimensional reconstruction without any spatial scanning. In the present work, we investigate the resolution limit in a particular correlation plenoptic imaging scheme, by considering periodic test patterns, which provide, through analytical results, a deeper insight in the resolution properties of this second-order imaging technique, also in comparison with standard imaging.
△ Less
Submitted 1 September, 2023;
originally announced September 2023.
-
Correlated-photon imaging at 10 volumetric images per second
Authors:
Gianlorenzo Massaro,
Paul Mos,
Sergii Vasiukov,
Francesco Di Lena,
Francesco Scattarella,
Francesco V. Pepe,
Arin Ulku,
Davide Giannella,
Edoardo Charbon,
Claudio Bruschini,
Milena D'Angelo
Abstract:
The correlation properties of light provide an outstanding tool to overcome the limitations of traditional imaging techniques. A relevant case is represented by correlation plenoptic imaging (CPI), a quantum-inspired volumetric imaging protocol employing spatio-temporally correlated photons from either entangled or chaotic sources to address the main limitations of conventional light-field imaging…
▽ More
The correlation properties of light provide an outstanding tool to overcome the limitations of traditional imaging techniques. A relevant case is represented by correlation plenoptic imaging (CPI), a quantum-inspired volumetric imaging protocol employing spatio-temporally correlated photons from either entangled or chaotic sources to address the main limitations of conventional light-field imaging, namely, the poor spatial resolution and the reduced change of perspective for 3D imaging. However, the application potential of high-resolution imaging modalities relying on photon correlations is limited, in practice, by the need to collect a large number of frames. This creates a gap, unacceptable for many relevant tasks, between the time performance of correlated-light imaging and that of traditional imaging methods. In this article, we address this issue by exploiting the photon number correlations intrinsic in chaotic light, combined with a cutting-edge ultrafast sensor made of a large array of single-photon avalanche diodes (SPADs). This combination of source and sensor is embedded within a novel single-lens CPI scheme enabling to acquire 10 volumetric images per second. Our results place correlated-photon imaging at a competitive edge and prove its potential in practical applications.
△ Less
Submitted 7 August, 2023; v1 submitted 5 December, 2022;
originally announced December 2022.
-
Comparative analysis of signal-to-noise ratio in correlation plenoptic imaging architectures
Authors:
Gianlorenzo Massaro,
Giovanni Scala,
Milena D'Angelo,
Francesco V. Pepe
Abstract:
Correlation plenoptic imaging (CPI) is a scanning-free diffraction-limited 3D optical imaging technique exploiting the peculiar properties of correlated light sources. CPI has been further extended to samples of interest to microscopy, such as fluorescent or scattering objects, in a modified architecture named correlation light-field microscopy (CLM). Interestingly, experiments have shown that the…
▽ More
Correlation plenoptic imaging (CPI) is a scanning-free diffraction-limited 3D optical imaging technique exploiting the peculiar properties of correlated light sources. CPI has been further extended to samples of interest to microscopy, such as fluorescent or scattering objects, in a modified architecture named correlation light-field microscopy (CLM). Interestingly, experiments have shown that the noise performances of CLM are significantly improved over the original CPI scheme, leading to better images and faster acquisition. In this work, we provide a theoretical foundation to such advantage by investigating the properties of both the signal-to-noise and the signal-to-background ratios of CLM and the original CPI setup.
△ Less
Submitted 27 June, 2022;
originally announced June 2022.
-
Light-field microscopy with correlated beams for extended volumetric imaging at the diffraction limit
Authors:
Gianlorenzo Massaro,
Davide Giannella,
Alessio Scagliola,
Francesco Di Lena,
Giuliano Scarcelli,
Augusto Garuccio,
Francesco V. Pepe,
Milena D'Angelo
Abstract:
Light-field microscopy represents a promising solution for microscopic volumetric imaging, thanks to its capability to encode information on multiple planes in a single acquisition. This is achieved through its peculiar simultaneous capture of information on light spatial distribution and propagation direction. However, state-of-the-art light-field microscopes suffer from a detrimental loss of spa…
▽ More
Light-field microscopy represents a promising solution for microscopic volumetric imaging, thanks to its capability to encode information on multiple planes in a single acquisition. This is achieved through its peculiar simultaneous capture of information on light spatial distribution and propagation direction. However, state-of-the-art light-field microscopes suffer from a detrimental loss of spatial resolution compared to standard microscopes. We propose and experimentally demonstrate a light-field microscopy architecture based on light intensity correlation, in which resolution is limited only by diffraction. We demonstrate the effectiveness of our technique in refocusing three-dimensional test targets and biological samples out of the focused plane. We improve the depth of field by a factor 6 with respect to conventional microscopy, at the same resolution, and obtain, from one acquired correlation image, about $130,000$ images, all seen from different perspectives; such multi-perspective images are employed to reconstruct over $40$ planes within a $1 \,\mathrm{mm}^3$ sample with a diffraction-limited resolution voxel of $20 \times 20 \times 30\ μ\mathrm{m}^3$.
△ Less
Submitted 2 October, 2021;
originally announced October 2021.
-
Towards quantum 3D imaging devices: the Qu3D project
Authors:
Cristoforo Abbattista,
Leonardo Amoruso,
Samuel Burri,
Edoardo Charbon,
Francesco Di Lena,
Augusto Garuccio,
Davide Giannella,
Zdenek Hradil,
Michele Iacobellis,
Gianlorenzo Massaro,
Paul Mos,
Libor Motka,
Martin Paur,
Francesco V. Pepe,
Michal Peterek,
Isabella Petrelli,
Jaroslav Rehacek,
Francesca Santoro,
Francesco Scattarella,
Arin Ulku,
Sergii Vasiukov,
Michael Wayne,
Milena D'Angelo,
Claudio Bruschini,
Maria Ieronymaki
, et al. (1 additional authors not shown)
Abstract:
We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum-position entanglement and photon-number correlations to provide the typical refocusing and ultra-fast, scanning-free, 3D imaging capability of plenoptic devices, along with dramatically enhanced performances, unattainable in stan…
▽ More
We review the advancement of the research toward the design and implementation of quantum plenoptic cameras, radically novel 3D imaging devices that exploit both momentum-position entanglement and photon-number correlations to provide the typical refocusing and ultra-fast, scanning-free, 3D imaging capability of plenoptic devices, along with dramatically enhanced performances, unattainable in standard plenoptic cameras: diffraction-limited resolution, large depth of focus, and ultra-low noise. To further increase the volumetric resolution beyond the Rayleigh diffraction limit, and achieve the quantum limit, we are also developing dedicated protocols based on quantum Fisher information. However, for the quantum advantages of the proposed devices to be effective and appealing to end-users, two main challenges need to be tackled. First, due to the large number of frames required for correlation measurements to provide an acceptable SNR, quantum plenoptic imaging would require, if implemented with commercially available high-resolution cameras, acquisition times ranging from tens of seconds to a few minutes. Second, the elaboration of this large amount of data, in order to retrieve 3D images or refocusing 2D images, requires high-performance and time-consuming computation. To address these challenges, we are developing high-resolution SPAD arrays and high-performance low-level programming of ultra-fast electronics, combined with compressive sensing and quantum tomography algorithms, with the aim to reduce both the acquisition and the elaboration time by two orders of magnitude. Routes toward exploitation of the QPI devices will also be discussed.
△ Less
Submitted 14 June, 2021;
originally announced June 2021.
-
Correlation Plenoptic Imaging between Arbitrary Planes
Authors:
Francesco Di Lena,
Gianlorenzo Massaro,
Alessandro Lupo,
Augusto Garuccio,
Francesco V. Pepe,
Milena D'Angelo
Abstract:
We propose a novel method to perform plenoptic imaging at the diffraction limit by measuring second-order correlations of light between two reference planes, arbitrarily chosen, within the tridimensional scene of interest. We show that for both chaotic light and entangled-photon illumination, the protocol enables to change the focused planes, in post-processing, and to achieve an unprecedented com…
▽ More
We propose a novel method to perform plenoptic imaging at the diffraction limit by measuring second-order correlations of light between two reference planes, arbitrarily chosen, within the tridimensional scene of interest. We show that for both chaotic light and entangled-photon illumination, the protocol enables to change the focused planes, in post-processing, and to achieve an unprecedented combination of image resolution and depth of field. In particular, the depth of field results larger by a factor 3 with respect to previous correlation plenoptic imaging protocols, and by an order of magnitude with respect to standard imaging, while the resolution is kept at the diffraction limit. The results lead the way towards the development of compact designs for correlation plenoptic imaging devices based on chaotic light, as well as high-SNR plenoptic imaging devices based on entangled photon illumination, thus contributing to make correlation plenoptic imaging effectively competitive with commercial plenoptic devices.
△ Less
Submitted 4 August, 2020; v1 submitted 23 July, 2020;
originally announced July 2020.