Abstract
Coherent light detection and ranging (LiDAR), particularly the frequency-modulated continuous-wave LiDAR, is a robust optical imaging technology for measuring long-range distance and velocity in three dimensions (3D). We propose a spatio-spectral coherent LiDAR based on a unique wavelength-swept laser to enable both axial coherent ranging and lateral spatio-spectral beam scanning simultaneously. Instead of the conventional unidirectional wavelength-swept laser, a flutter-wavelength-swept laser (FWSL) successfully decoupled bidirectional wavelength modulation and continuous wavelength sweep, which overcame the measurable distance limited by the sampling process. The decoupled operation in FWSL enabled sequential sampling of flutter-wavelength modulation across its wide spectral bandwidth of 160ânm and, thus, allowed simultaneous distance and velocity measurement over an extended measurable distance. Herein, complete four-dimensional (4D) imaging, combining real-time 3D distance and velocity measurements, was implemented by solid-state beam scanning. An acousto-optic scanner was synchronized to facilitate the other lateral beam scanning, resulting in an optimized solid-state coherent LiDAR system. The proposed spatio-spectral coherent LiDAR system achieved high-resolution coherent ranging over long distances and real-time 4D imaging with a frame rate of 10âHz, even in challenging environments.
Similar content being viewed by others
Introduction
Optical imaging techniques based on optical coherence are used as powerful tools in various applications, ranging from optical coherence tomography1 for imaging on the order of several millimeters2,3 to coherent light detection and ranging (LiDAR) for imaging on the order of several tens of meters4,5,6. Coherent LiDAR technology is gaining interest, particularly because of the increasing demand for high-quality three-dimensional (3D) imaging for remote sensing in various fields, such as autonomous driving7,8, defense9, security, and robotics. Coherent LiDAR, also known as frequency-modulated continuous-wave (FMCW) LiDAR10, has recently received significant attention owing to its unique advantages compared to the conventional time-of-flight11,12,13 and amplitude-modulated continuous-wave LiDAR. Based on the coherent detection principle, coherent LiDAR is robust against external environmental disturbances14 and ambient light interference. It simultaneously provides accurate distance and velocity information at a high axial resolution and signal-to-noise ratio (SNR) over long distances.
In addition to its strengths of coherent measurement, there are ongoing initiatives to develop high-performance coherent LiDAR systems that excel in terms of accuracy, speed, resolution, range, stability, and efficiency. Various approaches have been reported to achieve higher performance, especially in solid-state systems15. Flash LiDAR4,16,17 exhibit powerful performance for 3D distance and velocity detection over a long range with a compact on-chip architecture. However, it has the drawback of a limited number of pixels. The resulting narrow field of view (FOV) and consequent requirements for free-space optics indicate that the technology requires further maturation. Similarly, LiDAR systems based on optical-phased arrays (OPA)18,19,20 deliver robust performance with a silicon chip architecture and offer a wider FOV without relying on a lens. However, the fabrication of an OPA involves a challenging trade-off among the FOV, SNR, and beam efficiency. Additionally, a full four-dimensional (4D) image of 3D distance and velocity using this technology has not been reported yet. Coherent LiDAR using spectral dispersion4,21,22,23,24 is a strong alternative, especially when compared to existing silicon chip-based LiDAR systems, including flash and OPA-based LiDAR. Spatio-spectral mapping simplifies it straightforwardly to create a direct correspondence of the lateral position of the beam according to wavelength sweep, all driven by a single light source.
Given the specific features of the light source required for coherent LiDAR, in which the wavelength must be swept, it is an efficient strategy to use the broad wavelength bandwidth of the light source to achieve coherent axial ranging and lateral beam-scanning simultaneously. Okano et al.21 first proposed a swept-source LiDAR using a combination of a wideband wavelength-swept source and diffraction grating. A high sweep rate of 10âkHz with a sweep bandwidth of 40ânm at a center wavelength of 1060ânm was achieved using a commercially available tunable vertical-cavity surface-emitting laser. During the unidirectional wavelength sweep of the source, light is spatially mapped in one lateral direction by passing through the diffraction grating. The interference signal across the entire bandwidth was measured and subsequently processed after windowing at arbitrary sampling point intervals to separate the axial coherent ranging and lateral spatial scanning. A 3D distance image of 30âÃâ100 pixels was obtained at an approximate single-point acquisition rate of 13.5âkHz with an axial resolution of 0.042âcm. Another 3D distance image of 45âÃâ200 pixels was obtained, utilizing a galvanometric scanner for the remaining lateral axis. The second image was acquired at an acquisition rate of 300âHz with an axial resolution of 0.14âcm. This was the first demonstration of a spatio-spectral coherent LiDAR system based on a broadband wavelength-swept laser and diffractive optics, demonstrating effective and efficient operation with a simple system configuration.
Qian et al.22 proposed a time-frequency multiplexed 3D coherent ranging system that extended the previous approach by Okano et al. They utilized a commercial akinetic all-semiconductor wavelength-swept laser with a sweep rate of 15.94âkHz and a wavelength bandwidth of 65.85ânm, centered at 1316ânm. Similarly, the interference signals throughout the wavelength bandwidth were sampled at once and then post-processed to derive both the axial distance and lateral position information. A densely sampled high-resolution spatio-spectral coherent LiDAR system was demonstrated using a compressed sampling method during the post-processing stage. It showed a 3D distance image of 475âÃâ400 pixels at an acquisition rate of 7.6âMHz with an axial resolution of 0.28âcm. High-resolution imaging at a fast acquisition rate, enabled by optimization at sampling point intervals, ensured powerful spatio-spectral coherent LiDAR (the specifications of the laser source and LiDAR system are listed in Supplementary Table 1).
However, there are two significant drawbacks that still need to be addressed: (1) The system cannot measure the Doppler frequency for velocity owing to the unidirectional wavelength sweep across the entire bandwidth; consequently, it can only be utilized for distance ranging. (2) The system has a short measurable distance owing to the constraints of the sampling process. In addition to the laser coherence length, the maximum measurable distance is calculated as \({d}_{\max }={f}_{s}{cT}/4B\), where \({f}_{s}\), \(c\), \(T\), and \(B\) denote the sampling rate of the digitizer, the speed of light, the sweep period, and the sweep bandwidth21, respectively. Moreover, it is assumed that the beat frequency of the entire wavelength bandwidth does not exceed the response bandwidth of the avalanched balanced photodetector (BPD). Because the complete distance data were simultaneously collected and sampled along a single lateral axis, the measurable distance was significantly limited by the finite electrical bandwidth compared to the provided wavelength bandwidth. In other words, there is a significant trade-off among the measurable distance, the sweep rate, and the wavelength bandwidth. Okano et al. extended the measurable distance from 0.25 to 12âm by reducing the sweep rate and bandwidth to 300âHz and 19ânm, respectively. However, this approach is less desirable because it results in the loss of advantages associated with spatio-spectral mapping and real-time ranging. To develop a high-performance LiDAR system suitable for real-world applications8, the fundamental requirement of a coherent LiDAR system is the capability of 4D ranging over long distances. The subsequent requirements include high-resolution real-time imaging, precise measurements, and stable operation within a straightforward and efficient system configuration. In pursuit of these goals, it is clear that the light source plays a crucial role in the development of a spatio-spectral coherent LiDAR system. Specifically, a suitable wavelength-swept laser must have a coherence length adequate for long-distance ranging25 as a primary requirement. In addition, the laser must offer bidirectional modulation throughout the continuous and linear wavelength sweep26. This capability is vital for measuring distance and velocity during spatio-spectral scanning. In this context, data-efficient sampling27,28 of the interference signal across the entire wavelength bandwidth is essential for extending the measurable distance. Importantly, all these requirements must be fulfilled without compromising the wavelength bandwidth and sweep rate.
In this study, we introduce an innovative laser source, a flutter-wavelength-swept laser (FWSL), and a solid-state spatio-spectral coherent LiDAR system that utilizes the FWSL in combination with an acousto-optic deflector (AOD). The proposed FWSL simultaneously offers bidirectional wavelength modulation at the pm-level and wavelength sweep at the hundred nm-level each enabling axial coherent ranging and spatio-spectral mapping, respectively. We achieved independent mechanisms for the wavelength modulation in a fluttering shape (bidirectional modulation), and the wavelength sweep across the entire wavelength bandwidth. This decoupling, which occurred at the laser source level, separated axial ranging and spatio-spectral scanning functionalities in the resulting LiDAR system. The advancement allows for concurrent coherent 4D measurements throughout spatio-spectral mapping without any conflicts by instantly and sequentially sampling the flutter-wavelength modulation segment during the continuous wavelength sweep. This approach effectively resolved the measurable distance limitations of previous sampling methods. The proposed FWSL offers a long coherence length of 1.2âkm, a wide bandwidth of 160ânm centered at 1535ânm, and a rapid sweep rate of 100âkHz per single acquisition. To complement the spatio-spectral scanning along the horizontal axis achieved with diffraction grating, an AOD29 was used as a non-mechanical scanner for the vertical axis. This study showcases the potential of a flawless solid-state coherent LiDAR system, an achievement not realized in prior studies utilizing synchronized triple-driving configurations.
We simultaneously obtained 3D distance and velocity images using coherent ranging and solid-state beam scanning. A theoretical maximum measurable distance of 264âm was achieved through the sequential sampling of the flutter-wavelength modulation segment, and successful results of coherent ranging were shown in order of several tens of meters. In conclusion, we successfully acquired high-resolution 4D images of miniaturized targets in real-world settings, even in a challenging environment, achieving a real-time frame rate in dimensions of 200âÃâ45 pixels with the robust and efficient solid-state spatio-spectral coherent LiDAR system.
Results
FWSL-based solid-state coherent LiDAR system
The architecture of the proposed solid-state coherent LiDAR system based on the FWSL is shown in Fig. 1. The system comprised an FWSL, an external cavity-based wavelength-swept laser, an interferometer, and an optical system that included a solid-state scanner. The entire system was designed in a synchronized triple all-electrical driving configuration of an electro-optic phase modulator (EOPM), AOD, and wavelength selector (WS) to obtain the axial, vertical, and horizontal information, respectively. As shown on the left side of Fig. 1a, the FWSL contained an EOPM within a cavity comprised of a semiconductor optical amplifier in the 1550ânm band to the WS. The WS determined the wavelength of the light to be lased, and the EOPM modulated the selected wavelength. The EOPM was controlled by an electric signal from an arbitrary function generator (AFG) that enabled bidirectional modulation with a freely adjustable modulation signal. In addition, the WS was controlled by an electrical signal from the AFG, allowing the continuous and linear wavelength sweep over the entire bandwidth. The EOPM and WS were triggered by each other to ensure robust flutter-wavelength modulation for each fixed wavelength across the entire wavelength bandwidth. Wavelength modulation via EOPM and wavelength sweep via WS were operated simultaneously yet independently, which decoupled the axial coherent ranging and lateral spatio-spectral mapping.
Light from the FWSL was mapped in free space using a solid-state beam scanner: AOD for acousto-optical scanning along the vertical axis and transmission grating (TG) for spatio-spectral scanning along the horizontal axis. The light passed through the AOD, a device that deflects light according to the acoustic frequency of an applied electrical signal, was then dispersed by passing through the TG. In this study, a two-dimensional (2D) raster scan was performed with the acousto-optical and spatio-spectral axes as the fast and slow axes, respectively. An overall 4D ranging principle using 2D solid-state scanning for simultaneous distance and velocity measurement based on coherent detection is summarized in Fig. 1b. First, the wavelength was modulated by the EOPM according to a triangular waveform with period T1 for the coherent detection of a single axial point. Next, the same flutter-wavelength modulation was performed for the number of vertical pixels by scanning the beam in the vertical direction through the AOD. The vertical axis was scanned along the signal with period T2 of the ramp waveform applied to the AOD. Finally, the same process was performed for the number of horizontal pixels according to a step waveform with period T3, scanning the beam along the horizontal axis, where the wavelength was continuously swept through the WS. As a result, a 4D coherent image of nâÃâm pixels (HâÃâV) was obtained by splitting the entire wavelength bandwidth into n and repeating the flutter-wavelength modulation at each wavelength m times along the acousto-optical axis.
The FWSL and optical system, which included a solid-state scanner, were interconnected with a fiber-based MachâZehnder interferometer for coherent detection. The light emitted from the FWSL passed through an optical coupler and was split into reference and sample arms. The light propagating through the sample arm was mapped into a 2D space by passing through the solid-state scanner. The reflected light returned to the reverse order and was coupled back through the circulator to interfere with the light of the reference arm at the other optical coupler. The interference signal was detected using a BPD and processed using a digitizer. Detailed data acquisition and processing procedures are described in the Methods section.
Coherent ranging and velocity measuring principle
The EOPM, AOD, and WS function for coherent ranging in the axial direction and beam scanning in the vertical and horizontal directions, respectively. They were triggered by each other via AFG for electrically synchronized operations. The EOPM was modulated with a triangular waveform of a fixed period, T1, of 10 \(\mu s\) for the flutter-wavelength modulation. The wavelength modulation bandwidth was measured as 0.71âGHz (5.5âpm at the center wavelength of 1535ânm) with respect to the applied modulation signal (Fig. 2b). The Methods and Supplementary Note 7 present the detailed measurement process and analysis. The R-squared values for each linear variable period for the up-chirp and down-chirp were 0.99997 and 0.99987, respectively. The high linearity enables accurate coherent ranging without an additional assistance of a k-linear process6. In coherent ranging, the distance (\(d\)), and velocity (\(v\)) are calculated using the following equations23,30:
where \(B\) is the wavelength modulation bandwidth, \(c\) is the speed of light, \(T\) is the linear wavelength modulation period, and \(\lambda\) is the center wavelength. fb, fb,up, fb,down, and fD represent the actual beat frequency for distance, the detected beat frequency during the up-chirp and down-chirp, and the Doppler frequency for velocity, respectively. The theoretical axial resolutions for distance and velocity23,30 determined by the FWSL were 0.21âm and 0.15âm/s, respectively, according to \(\Delta d=c/2B\) and \(\Delta v=\lambda /2T\).
The AOD was operated using an electric signal with a ramp waveform of period T2. The AOD exhibited a frequency bandwidth of 18âMHz with respect to a center acoustic frequency of 52âMHz at a working wavelength of 1550ânm. The scan angle corresponding to the frequency bandwidth was ~3.5°, which was the vertical FOV of the system. However, the acoustic frequency applied to the AOD affects not only the deflection angle of the incoming light but also its wavelength (i.e., optical frequency). The optical frequency of the light passing through the AOD shifts in the positive direction by the amount of that acoustic frequency31,32, depending on the acoustic frequency applied to the AOD. This acoustic frequency shift affected the beat frequency, which is the optical frequency difference between the sample and reference arms. The acoustic frequency shift depending on the chirp shape differs by the following equations: \({{f{{\hbox{'}}}}}_{b,{up}}={2f}_{a}-{f}_{b}\) and \({{f{{\hbox{'}}}}}_{b,{down}}={2f}_{a}+{f}_{b}\), where \({{f{{\hbox{'}}}}}_{b,{up}}\) and \({{f{{\hbox{'}}}}}_{b,{down}}\) represent the beat frequency during the up-chirp and down-chirp, respectively. Two times the acoustic frequency of \({f}_{a}\) in the equations is caused by the round trip of light. The acoustic frequency shift in the beat frequency is shown in Fig. 2c, with the fast Fourier transform (FFT) result of the interference signal from a coherent range against a target at 20âm. The detected beat frequencies during up-chirp and down-chirp, the two different peaks in red and blue, respectively, are distributed in opposite directions with respect to the center of 104âMHz (the black dotted line), which corresponds to \({2f}_{a}\), following the relationships above. According to this acoustic frequency shift, the actual beat and Doppler frequencies are related to the measured beat frequencies in our LiDAR system, as follows:
The compensation process for the acoustic frequency required to decompose the actual velocity information, is described in the Methods section.
The WS was operated according to the control signal of a step waveform with period T3. A wavelength bandwidth of 160ânm with a center wavelength of 1535ânm was achieved by WS, as shown in Fig. 2e (a detailed characterization procedure is provided in the Methods section). The horizontal FOV determined by the TG for the entire wavelength bandwidth was ~14.5°. The linewidth at the center wavelength of 1535ânm was measured at 81âkHz, which corresponds to a theoretical coherence length of 1.2âkm (Supplementary Fig. 9). As mentioned previously, each signal was operated while being triggered in accordance with the scanning process. Coherent measurements were performed by appropriately setting the variable conditions of AOD and WS (spatial scanning conditions) depending on the targeted scenes, while the axial scanning condition by EOPM was kept fixed.
Characterization of coherent LiDAR system
Coherent measurements were performed on a rotating disk with a retroreflective tape applied to its surface to characterize the proposed FWSL-based LiDAR system. The experimental setup is shown in Fig. 2a. A disk with a radius of 0.125âm was positioned 1âm behind the TG, rotating at a speed of 770ârpm. A 3D velocity image of 100âÃâ20 pixels (HâÃâV) was obtained for the central area of the disk, where the velocity changed from positive to negative owing to the receding and approaching parts against the beam propagation, respectively. The center of the disk was aligned perpendicular to the incident beam when the AOD and WS were set to the center acoustic frequency and center wavelength, respectively. The region of interest (ROI) was measured 100 times to verify the accuracy and precision of the proposed LiDAR system.
As a result, we successfully obtained a clear 3D velocity image, as shown in Fig. 2f. To provide more in-depth verification, we analyzed the velocity distribution along a single spatio-spectral axis of the 3D velocity image. In Fig. 3a, the linear velocity changed from positive to negative, as expected from the alignment of the rotating disk. This velocity distribution closely followed the theoretical velocity indicated by the black dashed-dotted line (Fig. 3a), which was calculated relative to the propagating beam direction within the horizontal FOV30. For comprehensive calculations, please refer to the Supplementary Note 10.
In Fig. 3b, we present error values, all within magnitudes not exceeding 0.08âm/s across the spatio-spectral axis. These errors may have originated from unintended vibrations of the disk and its inherent ellipticity. Nevertheless, it is evident that the measured velocities remained reliable within a reasonable error rate of ~5%, except in the zero-velocity region.
To further demonstrate the velocity measurement precision of our system across the spatio-spectral axis, we provided the standard deviation (SD) of 100 measured values at each lateral point, as shown in Fig. 3c. Notably, the SD was recorded consistently within the 0.1âm/s range throughout the spectral scanning from 1549ânm to 1564ânm. A few spatio-spectral points exhibited relatively high SDs but did not exceed 0.2âm/s. Considering the native velocity resolution determined by the FWSL, the obtained velocity results were within a reasonably accurate range.
We selected three representative points for each of the positive-, zero-, and negative-velocity parts among the different spatio-spectral points for further investigation of precision. The histograms of the measured velocity during 100 measurements at three selected wavelengths of 1544.7ânm, 1554.0ânm, and 1563.8ânm are provided in the inset of Fig. 3c. A clear tendency of a normal distribution was observed at all points. The mean error values of the estimated normal distribution at each point were recorded as 0.02âm/s, 0.03âm/s, and 0.003âm/s, respectively, indicating the accuracy of our experimental velocity measurement. The corresponding SDs were 0.063âm/s, 0.052âm/s, and 0.062âm/s, respectively, indicating that the actual velocity measurement was more precise than the theoretical velocity resolution. The proposed system successfully performed precise velocity measurements during spatio-spectral scanning, demonstrating the unique strength of the proposed FWSL. This achievement is notable among the other spatio-spectral coherent LiDARs based on a wavelength-swept laser reported to date.
In addition to the investigation of velocity measurement accuracy and precision described previously, we have also conducted an evaluation of distance measurement accuracy and precision. Employing the same experimental setup illustrated in Fig. 2a, we executed one-dimensional (1D) axial coherent distance measurements on a static target. The distance of a retroreflective tape positioned at distances ranging from 1 to 25âm relative to the TG is measured 1000 times. As illustrated in Supplementary Fig. 14, axial coherent ranging effectively exhibits distance measurements up to 25 meters, showing a linear increase of average measured distance. Remarkably, the SDs at all distances are recorded within a range of 0.04âm, which indicates that the actual distance measurements were more precise than the axial resolution determined by FWSL.
4D coherent ranging results
We conducted comprehensive 4D coherent measurements using the proposed LiDAR system under various scenarios. These scenarios, denoted as Scenes A, B, and C in Fig. 4a, were designed to demonstrate short-range (<7âm) and long-range (>20âm) 3D distance imaging and real-time 4D distance and velocity imaging, respectively. Photographs of the actual scenarios are provided in Supplementary Fig. 17.
Scene A was designed for high-resolution imaging within a room-scale distance range. We placed the objectsâa model bus, a police car, and a tunneled bridgeâat distances of 4.8, 5.4, and 6âm, respectively, against a background screen at 7.3âm. The 3D distance image was obtained using an FOV of 11.5°âÃâ3.5° (HâÃâV) and a fast axis scan rate of 0.5âkHz with dimensions of 600âÃâ190 pixels. Various miniatures in real-world settings were successfully imaged, as shown in Fig. 4b. Objects with distance differences of several tens of centimeters were obviously distinguished within a relatively short distance range of 7âm or less. Even small objects, such as toy trees and traffic lights, were clearly imaged in their detailed shapes, demonstrating the excellent imaging resolution of the proposed system. We have provided a detailed post-processing procedure for the obtained images in the Methods section.
Scene B, which spanned over 20âm, was designed to demonstrate the capability of the proposed system for long-distance imaging. We set up a wall at 22.5âm as the background and positioned retroreflective boxes at 2-m intervals. A model airplane was positioned on the second box from the back at 18.5âm. A long-range 3D distance image consisting of 600âÃâ190 pixels was obtained with an FOV of 7.7°âÃâ3.5° (HâÃâV) and a fast axis scan rate of 0.5âkHz. As shown in Fig. 4c, it is confirmed that the coherent measurement over a substantial distance was successfully performed. Objects over a few tens of meters were measured, in addition to the model airplane, which was clearly distinct in its complex shape in the image. The obtained 3D distance images indicate that the proposed LiDAR system is capable of both short- and long-distance imaging while maintaining a high-resolution for desirable imaging quality in each scenario. Scenes A and B were designed differently to demonstrate high-resolution and long-distance imaging, respectively. However, our system is capable of simultaneously imaging from short to long distances.
Scene C, which contained both stationary and moving objects, was designed to demonstrate real-time 4D imaging using the proposed coherent LiDAR system. With respect to the same target configuration in Scene A, we measured a train moving at a constant speed on a rail with a size of 0.47âÃâ0.69âm (WâÃâL) on a tunneled bridge. Two trees were positioned alongside the railâone at the start and the other in the middleâand a traffic light was positioned at the end. The 4D distance and velocity images of the ROI sized at 200âÃâ45 pixels were obtained continuously with an FOV of 7.7°âÃâ1.24° (HâÃâV) and a fast axis scan rate of 2âkHz. We achieved a frame rate of 10âHz by increasing the fast axis scan rate to 2âkHz and adjusting the pixel size to suit the reduced ROI. A full-time video of 11.6âs for the obtained real-time 4D images synchronized with the actual picture in Scene C during measurement is provided in Supplementary Video 1. We captured images from the video, as shown in Fig. 4d, to confirm that the 3D distances and velocities of both the stationary and moving objects were clearly measured simultaneously. As shown in both the video and figure, it is obvious that distinct 4D imaging of the objects was performed without any interruption, indicating that the proposed LiDAR system provided sufficient distance measurement resolution and lateral resolution.
Discussion
In this study, we introduce an FWSL designed for spatio-spectral coherent LiDAR and a solid-state LiDAR system, showcasing comprehensive solid-state 4D coherent measurements. The FWSL is a laser source that enables independent bidirectional wavelength modulation of 5â6âpm throughout the continuous wavelength sweep for its wide bandwidth of 160ânm, centered at 1535ânm. The proposed system successfully performed simultaneous distance and velocity measurements using decoupled axial coherent ranging and lateral spatio-spectral scanning. In addition to the spectral scanning facilitated by the FWSL, we achieved solid-state 2D scanning using another non-mechanical scanner, AOD. This combination enabled effective real-time (10âHz) 4D imaging relative to the long-distance 3D imaging of miniatures. The results demonstrate the robustness and efficiency of our LiDAR system, indicating its potential for a wide range of remote sensing applications.
Our system exhibits unique characteristics compared to previously reported spatio-spectral coherent LiDAR systems, which we outline as follows:
1) Flutter-wavelength modulation is a standout feature of our system that remains independent throughout the spectral bandwidth, thereby enabling 4D coherent ranging over extensive distances. Although the promise of spatio-spectral coherent LiDAR is evident owing to its inherent strengths, previously reported systems have limitations in velocity measurements along with relatively short measurable distances. We marked a significant advancement with the FWSL, which addressed both limitations by instantly and sequentially sampling the interference signals of flutter-wavelength modulation. In previous studies21,24, only unidirectional wavelength sweeps were achieved, limiting the system to distance measurements. In addition, the interference signal across the entire wavelength bandwidth was measured simultaneously, placing a considerable burden on the electrical bandwidth, such as the response bandwidth of the photodetector, and sampling rate of the digitizer, considering the Nyquist theory. Consequently, this imposed a strong limit on the maximum measurable distance. In contrast, the FWSL supports independent wavelength modulation, particularly exhibiting a fluttering shape, during continuous wavelength sweeps within the spectral bandwidth, which enables velocity measurement. Instant and sequential sampling of the interference signal of the flutter-wavelength modulation substantially extended the theoretical maximum measurable distance to 264âm. We experimentally demonstrated velocity measurements during spatio-spectral scanning and coherent measurements over 20âm using a BPD of 400âMHz and a digitizer of 500 MS/s. A detailed comparison between our method and conventional approaches is provided in Supplementary Fig. 1 and Supplementary Table 1.
2) Flexible operation of the spectral bandwidth is another strength of the proposed system, which was achieved by decoupled axial coherent ranging and lateral spatio-spectral scanning. In previous studies, deliberate windowing upon the spectral bandwidth was required to arrange the axial distance and lateral position information from the interference signal across the entire spectral bandwidth. In contrast, our system provides the entire bandwidth for spatio-spectral mapping, regardless of complex signal post-processing accompanied by a direct trade-off between axial and lateral resolutions. The spectral bandwidth for a wavelength sweep can be adjusted according to the spatial ROI, which indicates that the bandwidth can be used as required for a wide FOV regardless of the measurable distance. Thus, spectral scanning conditions can be flexibly set by considering the desired imaging resolution and frame rate.
3) A flawless solid-state coherent LiDAR was achieved by introducing another solid-state beam-scanning mechanism in addition to spatio-spectral mapping. This shows a meaningful approach not only for our system but also for other coherent LiDAR systems in terms of solid-state beam scanning. Active scanning in the vertical direction was performed using a high-speed, high-resolution non-mechanical beam scanner AOD. It was able to ignore the effect of internal interference caused by interferometer mating parts or surface reflections in the optical system owing to the acoustic frequency shift. We successfully achieved real-time, high-resolution 4D imaging at a frame rate of 10âHz with a fast axis scan rate of 2âkHz, enabled by the AOD. However, there is still room for improvement to attain a higher frame rate using AOD, which offers high-speed scanning up to several MHz, as long as a higher acquisition rate is assured. In addition, the AOD is controlled electrically in the triggered state with the EOPM and WS, which are also controlled electrically. The electric-based synchronized system, which especially operates in a solid-state, ensures robust data acquisition regardless of external turbulence or optical jitter.
Despite its unique advantages, there remain several challenges to be addressed in our system. The primary limitation was the native axial resolution determined by the FWSL. The theoretical axial resolution of 0.21âm, which is reasonable for long-range measurements, should be improved considering the specifications desired for real-world applications. Since the present axial resolution is determined by the flutter-wavelength modulation bandwidth, we suggest that the axial resolution can be improved by increasing the modulation bandwidth through careful optimization of the FWSL architecture. The FWSL, which is based on an external cavity structure with a Littrow configuration33, exhibits a decrease in the modulation bandwidth as the cavity length increases34,35, assuming the same EOPM operation. We have provided a more detailed explanation of the architecture and principles of the FWSL in the Supplementary Note 2â5. Therefore, optimization of the cavity length of the FWSL can enable a wider modulation bandwidth. In addition, the modulation bandwidth can be increased by applying a higher amplitude modulation signal to the EOPM. Throughout the experiments, the modulation signal for the EOPM remained fixed at optimal conditions, as determined based on the flutter-wavelength characteristics illustrated in Supplementary Fig. 2 and 3. Currently, it is observed that the response of the used voltage amplifier (VA) appears insufficient under high amplitude or high-frequency conditions. By employing a high-performance VA, the modulation bandwidth can be expanded directly by applying a higher voltage to the EOPM. Based on these strategies, we suggest that the axial resolution is due to the currently fabricated FWSL and does not arise from a fundamental flaw in the FWSL architecture. However, the axial resolution does not necessarily define the distance measurement resolution of our LiDAR system. Regarding LiDAR is a technology for topography over the meter scale, the practical distance and velocity resolutions for the measurements should be considered as the precision of the overall system. As demonstrated above, our system supports distance resolution under 0.04âm and velocity resolution around 0.06âm/s. Supplementary Video 1, which shows a distinct 4D image of the objects without any interruption, experimentally proves that the actual measurements were more precise than the axial resolution. In addition, we expect that there is also room for improvement in the distance and velocity resolutions of measurements through the increase in the number of samples using common zero-padding24.
Another limitation is the FOV along the acousto-optic axis. The scan angle of the AOD, which corresponds to the vertical FOV, was not sufficiently wide compared with the desirable vertical FOV. At present, most non-mechanical scanners, including acousto-optic devices, lack the wide FOV necessary to replace traditional mechanical scanners. Therefore, ongoing investigations are pursued to implement wider FOVs. However, this limitation can be practically mitigated by incorporating relay optics into the optical system36 or introducing an additional scan lens. Furthermore, considering the unique operation of the FWSL due to its wide spectral bandwidth, the implementation of other solid-state scanners37, such as 2D dispersers22, can be an accessible alternative. Additionally, in consideration of the future development of coherent LiDAR, we expect that the proposed FWSL can branch into various future studies. As faster and more compact light sources and LiDAR systems are preferred, an approach to parallel LiDAR based on simultaneous multi-wavelength generation5,23, or miniaturization of the FWSL through integration into PIC-based lasers38, will be meaningful for further studies.
In conclusion, we proposed a unique wavelength-swept laser, FWSL, and a comprehensive 4D solid-state coherent LiDAR system based on the FWSL. Simultaneous coherent measurements of distance and velocity, according to horizontal spatio-spectral mapping, were achieved using independent flutter-wavelength modulation during the wavelength sweep by the FWSL. Furthermore, we incorporated vertical solid-state scanning via AOD to enable high-resolution 2D solid-state beam scanning. As 4D coherent measurements in various scenarios were successfully performed, high-resolution 3D distance images were obtained from room-scale (within 7âm) to long-range (over 20âm), and 4D distance and velocity images were obtained in real time. Furthermore, we demonstrated the robustness of the proposed coherent LiDAR system even under challenging conditions by implementing real-time 4D imaging in a simulated fog environment (Supplementary Video 2). The proposed system stands as a robust, efficient, and straightforward spatio-spectral coherent LiDAR system with promising implications for the future of LiDAR technology. This advancement represents a significant step towards the realization of advanced coherent LiDAR applications.
Methods
Electrical system operation
Electrical control of the overall system was based on an AFG (Tektronix, Beaverton, OR, USA) and a data acquisition (DAQ) board synchronized with the LabVIEW program. First, the AFG generated a triangular waveform with a 10âVpp amplitude and a 100âkHz rate. The generated signal was applied to an EOPM (Thorlabs, Newton, NJ, USA) after the voltage was amplified 20 times through a VA (Thorlabs, Newton, NJ, USA). Subsequently, the control signal of the AOD (Photon Lines, Banbury, UK) programmed in LabVIEW was applied to a variable-frequency driver (Photon Lines, Banbury, UK) through the DAQ board. An acoustic frequency corresponding to the voltage from the DAQ board was applied to the AOD. Here, the AOD was driven by a ramp waveform, and its amplitude (vertical FOV) and speed (fast axis scan rate) were adjusted according to the target scenarios. Finally, a WS (Thorlabs, Newton, NJ, USA) was driven by a step waveform generated by the LabVIEW program and applied directly through the DAQ board. Similarly, the amplitude (horizontal FOV) and speed (frame rate) were set depending on the target scenarios. The AOD was triggered to EOPM synchronously with the transistor-transistor logic (TTL) signal of the AFG, and WS was triggered to AOD by the TTL signal generated by the LabVIEW program.
Characterization of FWSL
The relative optical frequency during wavelength modulation by the EOPM was measured to characterize the FWSL. A 4âÃâ4 MachâZehnder interferometer was used for the measurements, with the selected wavelength at the center. The phase variation during the single-wavelength modulation was extracted and converted into an optical frequency39,40 (Fig. 2b). The detailed procedure is given in Supplementary Note 7. The spectral bandwidth of the FWSL was verified by measuring the change in wavelength by WS using an optical spectrum analyzer (OSA; Anritsu, Atsugi, JP) with a 0.03ânm resolution. Different voltages were applied to the WS at certain intervals, which selected the wavelength discretely. The output of the FWSL was directly measured using the OSA, and the results of 191 measurements are shown in Fig. 2d. The optical power of the FWSL at 1535ânm was measured as 20âmW. During the overall operation of the FWSL, a constant typical operating current and temperature, which may primarily affect optical power, were provided to the SOA.
Design of optical system
A fiber collimator (Thorlabs, Newton, NJ, USA) was first placed in a free-space optical system. The collimated beam was passed through an achromatic lens pair (Thorlabs, Newton, NJ, USA) with focal lengths of 30âmm and 50âmm. The spacing between the two lenses was adjusted to focus the beam at the desired distance for each experiment. The AOD was placed after the lens pair in line and aligned for vertical beam deflection. A TG (Edmund Optics, Barrington, NJ, USA) was located after the AOD to cover the diffracted light within the TG area for horizontal beam deflection. The TG with a groove density of 1000 grooves/mm was aligned at a 50° angle with the propagating light to satisfy the Littrow angle condition. The FOV in the vertical and horizontal directions under these conditions were observed as 3.5° and 14.5°, respectively. The final output power at the end of the TG was ~5âmW. The focused beam at 1âm was measured ~2âmm of beam spatial profile.
Data acquisition and processing
The optical interference signal was measured using a BPD (Thorlabs, Newton, NJ, USA) with a 400âMHz bandwidth. The measured signal was collected on channel 1 of the digitizer (Alazartech, Quebec, CA) at a sampling rate of 500âMS/s, and a reference signal from the variable-frequency driver was collected simultaneously on channel 2. Here, the reference signal had the same frequency as the acoustic frequency applied to the AOD, but a power of 0âdBm. The data for a single-wavelength modulation from channel 1 and the corresponding data from channel 2 were digitized in 4960 samples. The signal acquired for each channel was divided into up- and down-chirps, and zero-padding was performed for up to 4992 samples in each chirp. After applying the FFT to each chirp, the detected beat frequency from channel 1 and the acoustic frequency from channel 2 was obtained by extracting the peak frequency at each chirp (Fig. 2c). The true beat and Doppler frequencies were obtained by compensating the shifted acoustic frequency for the measured beat frequency according to Eqs. 3 and 4. For image processing, a 2D median filter was applied to the 3D distance images obtained through a previous data-processing procedure. Subsequently, the built-in statistical outlier removal filter of the CloudCompare program was applied and rasterized by interpolation. The final 3D point-cloud data were plotted using MATLAB.
Target configuration for 4D coherent ranging
The design of Scene A for room-scale 3D distance imaging is illustrated in Supplementary Fig. 4a. The first bus, police car, tunneled bridge, and last white screen were located at 4.8âm, 5.4âm, 6âm, and 7.3âm from the TG, respectively. A reflective spray (ALBEDO 100, Sweden) was applied to the surface to enhance the reflectivity of the targets. The design of Scene B for long-range 3D distance imaging is depicted in Supplementary Fig. 4b. The first box is on the far right; the second, third, and fourth boxes; and the last wall was located at 13.5âm, 16âm, 18.5âm, 21âm, and 22.5âm from the TG, respectively. A reflective tape (3âM, Saint Paul, MN, USA) was applied to the boxes to enhance reflectivity, and a reflective spray was sprayed onto the surfaces of the model airplane and wall. The design of Scene C for simultaneous 4D distance and velocity imaging is shown in Supplementary Fig. 4c. The upper part of the tunneled bridge in Scene A was set as the ROI, and the stationary models (two model trees and a traffic light) were located at intervals of 0.3âm from 6âm, in the order mentioned. Similarly, a reflective spray was applied.
Data availability
The data that support the findings of this study are available from the corresponding author upon request.
Code availability
The codes used throughout this study are available from the corresponding author upon request.
References
Huang, D. et al. Optical coherence tomography. Science 254, 1178â1181 (1991).
Lee, H. D. et al. Akinetic swept-source optical coherence tomography based on a pulse-modulated active mode locking fiber laser for human retinal imaging. Sci. Rep. 8, 17660 (2018).
Huber, R., Wojtkowski, M. & Fujimoto, J. G. Fourier Domain Mode Locking (FDML): a new laser operating regime and applications for optical coherence tomography. Opt. Express 14, 3225 (2006).
Rogers, C. et al. A universal 3D imaging sensor on a silicon photonics platform. Nature 590, 256â261 (2021).
Riemensberger, J. et al. Massively parallel coherent laser ranging using a soliton microcomb. Nature 581, 164â170 (2020).
Jang, H. et al. Simultaneous distance and vibration mapping of FMCW-LiDAR with akinetic external cavity diode laser. Opt. Lasers Eng. 160, 107283 (2023).
Roriz, R., Cabral, J. & Gomes, T. Automotive LiDAR technology: a survey. IEEE Trans. Intell. Transport. Syst. 23, 6282â6297 (2022).
Holzhüter, H., Bödewadt, J., Bayesteh, S., Aschinger, A. & Blume, H. Technical concepts of automotive LiDAR sensors: a review. Opt. Eng. 62, 031213 (2023).
Schwarz, B. Mapping the world in 3D. Nat. Photonics 4, 429â430 (2010).
Uttam, D. & Culshaw, B. Precision time domain reflectometry in optical fiber systems using a frequency modulated continuous wave ranging technique. J. Light. Technol. 3, 971â977 (1985).
Jiang, Y., Karpf, S. & Jalali, B. Time-stretch LiDAR as a spectrally scanned time-of-flight ranging camera. Nat. Photonics 14, 14â18 (2020).
Rehain, P. et al. Noise-tolerant single photon sensitive three-dimensional imager. Nat. Commun. 11, 921 (2020).
Boger-Lombard, J. & Katz, O. Passive optical time-of-flight for non line-of-sight localization. Nat. Commun. 10, 3343 (2019).
Mitchell, E. W. et al. Coherent laser ranging for precision imaging through flames. Optica 5, 988 (2018).
Li, N. et al. A progress review on solidâstate LiDAR and nanophotonicsâbased LiDAR sensors. Laser Photon. Rev. 16, 2100511 (2022).
Martin, A. et al. Photonic integrated circuit-based FMCW coherent LiDAR. J. Light. Technol. 36, 4640â4645 (2018).
Baba, T. et al. Silicon photonics FMCW LiDAR chip with a slow-light grating beam scanner. IEEE J. Select. Top. Quantum Electronics 28, 5 (2022).
Poulton, C. V. et al. Coherent solid-state LIDAR with silicon photonic optical phased arrays. Opt. Lett. 42, 4091 (2017).
Poulton, C. V. et al. Long-range LiDAR and free-space data communication with high-performance optical phased arrays. IEEE J. Sel. Top. Quantum Electron. 25, 1â8 (2019).
Bhargava, P. et al. Fully Integrated Coherent LiDAR in 3D-Integrated Silicon Photonics/65nm CMOS. In: 2019 Symposium on VLSI Circuits C262âC263 (IEEE, 2019). https://doi.org/10.23919/VLSIC.2019.8778154.
Okano, M. & Chong, C. Swept Source Lidar: simultaneous FMCW ranging and nonmechanical beam steering with a wideband swept source. Opt. Express 28, 23898 (2020).
Li, Z., Zang, Z., Han, Y., Wu, L. & Fu, H. Y. Solid-state FMCW LiDAR with two-dimensional spectral scanning using a virtually imaged phased array. Opt. Express 29, 16547 (2021).
Lukashchuk, A., Riemensberger, J., Karpov, M., Liu, J. & Kippenberg, T. J. Dual chirped microcomb based parallel ranging at megapixel-line rates. Nat. Commun. 13, 3280 (2022).
Qian, R. et al. Video-rate high-precision time-frequency multiplexed 3D coherent ranging. Nat. Commun. 13, 1476 (2022).
Harris, M., Pearson, G. N., Vaughan, J. M., Letalick, D. & Karlsson, C. The role of laser coherence length in continuous-wave coherent laser radar. J. Mod. Opt. 45, 1567â1581 (1998).
Qiao, L., Sun, D., Zhang, X. & Zhao, Y. Linearity requirement for a linear frequency modulation lidar. Opt. Rev. 6, 160â162 (1999).
Bak, S. et al. Programmable optical vernierâsampled coherent ranging. Laser Photon. Rev. 17, 2200739 (2023).
Kim, N., Jung, M. U., Jang, H. & Kim, C.-S. Distance recovery via swept frequency mixing for data-efficient FMCW LiDAR. Opt. Lett. 48, 3657 (2023).
Goda, K. et al. Hybrid dispersion laser scanner. Sci. Rep. 2, 445 (2012).
Suyama, S., Ito, H., Kurahashi, R., Abe, H. & Baba, T. Doppler velocimeter and vibrometer FMCW LiDAR with Si photonic crystal beam scanner. Opt. Express 29, 30727 (2021).
Savage, N. Acousto-optic devices. Nat. Photonics 4, 728â729 (2010).
Li, B., Lin, Q. & Li, M. Frequencyâangular resolving LiDAR using chip-scale acousto-optic beam steering. Nature 620, 316â322 (2023).
Haiping, G., Chenhao, W., Fei, W., Lijing, Z. & Chengwen, X. Study on the dynamic mode stability of grating-feedback external cavity diode lasers. Laser Phys. 26, 045002 (2016).
Gong, H., Liu, Z., Zhou, Y. & Zhang, W. Extending the mode-hop-free tuning range of an external-cavity diode laser by synchronous tuning with mode matching. Appl Opt. 53, 7878 (2014).
Levin, L. Mode-hop-free electro-optically tuned diode laser. Opt. Lett. 27, 237 (2002).
Zhang, J. et al. Real-time wide-field spectral-scanning FMCW coherent 3D imaging and velocimetry. Opt. Lett. 47, 4064 (2022).
Juliano Martins, R. et al. Metasurface-enhanced light detection and ranging technology. Nat. Commun. 13, 5724 (2022).
Porter, C., Zeng, S., Zhao, X. & Zhu, L. Hybrid integrated chip-scale laser systems. APL Photonics 8, 080902 (2023).
Park, S., Rim, S., Kim, Y. & Lee, B. H. Noncontact photoacoustic imaging based on optical quadrature detection with a multiport interferometer. Opt. Lett. 44, 2590 (2019).
Choma, M. A., Yang, C. & Izatt, J. A. Instantaneous quadrature low-coherence interferometry with 3Ã3 fiber-optic couplers. Opt. Lett. 28, 2162 (2003).
Acknowledgements
The authors thank Professor Hwidon Lee for the discussion and valuable suggestions. This research was supported by the National Research Foundation of Korea (NRF), funded by the Ministry of Science and ICT, Korea (Grant no. NRF-2021R1A5A1032937), the Korea Evaluation Institute of Industrial Technology (KEIT) and Technology Innovation Program funded by the Ministry of Trade, Industry & Energy, Korea (Grant no. 1415181752, 20026554), and Hyundai Motor Company.
Author information
Authors and Affiliations
Contributions
D.J., H.J., and C.-S.K. contributed to the design of the system and experiments; D.J. and H.J. constructed the experimental setup; M.U.J. developed software programming for data acquisition; T.J., H.K., S.Y., and J.L. assisted in the preparation of the experimental setup; D.J., H.J., and M.U.J. obtained, analyzed, and processed the data. D.J. wrote the manuscript with input from all authors, and C.-S.K. reviewed it. C.-S.K. supervised the work.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Peer review
Peer review information
Nature Communications thanks Liheng Bian, Johann Riemensberger, and the other, anonymous, reviewers for their contribution to the peer review of this work. A peer review file is available.
Additional information
Publisherâs note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the articleâs Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the articleâs Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Jeong, D., Jang, H., Jung, M.U. et al. Spatio-spectral 4D coherent ranging using a flutter-wavelength-swept laser. Nat Commun 15, 1110 (2024). https://doi.org/10.1038/s41467-024-45297-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41467-024-45297-w