Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Expand this Topic clickable element to expand a topic
Skip to content
Optica Publishing Group

Large-curvature specular surface phase measuring deflectometry with a curved screen

Open Access Open Access

Abstract

Deflectometry has been widely used in topography measurement of the specular surface due to the merits of full-field data acquisition, automatic data processing, high accuracy, and large dynamic range. Existing deflectometry-based methods, such as model phase measuring deflectometry, direct phase measuring deflectometry, and stereo deflectometry, employ a plane screen, so they have a small field view. The characteristics of curved screens can effectively expand the range of the gradient and height field of the measured specular surface. This paper presents a novel deflectometric technique by using a curved screen to measure large-curvature specular surface. In order to obtain a model of the curved screen, a stereo vision method has been proposed to capture fringes displayed on the curved screen. After phase correction along epipolar lines and homologous points matching, the point cloud containing location and phase is obtained. A virtual plane fixed on the screen is assumed to gain posture and position of the screen. The model of the curved screen is transferred to the deflectometric system through the virtual plane. After calibrating the deflectometric system, height of specular objects can be obtained. Simulated and actual experiments on measuring specular objects have been carried out and the results show high accuracy and large field view for large-curvature specular surface of the proposed technique.

© 2021 Optica Publishing Group under the terms of the Optica Open Access Publishing Agreement

1. Introduction

Components with specular surface are widely used in aerospace, automobile, optics system and artificial intelligence. Phase measuring deflectometry (PMD) have been widely used to measure gradient and height of specular surface under test (SuT) because of its advantages of full-field data acquisition, non-contact operation, automatic data processing, high accurate data, and large dynamic range [1].

A PMD system usually contains a display screen, an imaging device (normally a camera) and a computer. Straight fringe patterns are generated in software and displayed on the screen. The camera captures the distorted fringe patterns modulated by the measured specular surface. Phase information is demodulated from the captured fringe patterns to reconstruct three-dimensional (3D) shape, as illustrated in Fig. 1.

 figure: Fig. 1.

Fig. 1. Deflectometry system.

Download Full Size | PDF

One challenging problem in PMD is the ambiguity of height and gradient, which means the same captured phase matches different height-gradient conditions [2]. In order to solve the ambiguity of height and gradient, many methods have been studied, such as stereo PMD [3,4], model PMD (MPMD) [57], different grating planes as phase displayers [8], a moving diffusive structured light source combined with light tracking technique [9,10], reconstruction from single distorted image combined with mathematic analysis [11,12].

In traditional PMD-based methods, the relationship between phase and slope of the measured surface is built, so that slope integration procedure is employed to compute height of the specular surface [13]. However, these methods are difficult to measure discontinues or isolated specular surfaces because of the limitation of integration procedure. A direct PMD (DPMD) [14,15] method has been presented to measure discontinues or isolated specular surface. DPMD directly formulates height and variation of phase, instead of gradient of surface with integration.

A plane liquid crystal display (LCD) screen or plane gratings are employed to generate sinusoidal structured light in all existing deflectometry systems. Due to the size and shape of the used plane LCD screen, some part of the measured surface will reflect scenes outside of screen, resulting in incomplete reconstruction of the specular surface. Thus, specular surface with large curvature can’t be obtained in a single measurement. Therefore, it is necessary to study a new method to measure 3D shape of specular surface with large curvature. The characteristics of curved screens can effectively expand the range of the gradient and height field of the measured specular surface, as illustrated in Fig. 2. Therefore, in this paper, a novel deflectometric technique has been presented to measure large-curvature specular surface by using a curved screen.

 figure: Fig. 2.

Fig. 2. Comparison of measuring field view and virtual image by using plane screen and curved screen.

Download Full Size | PDF

In the following, Section 2 explains the advantages, measurement principle, calibration method, and model reconstruction of the curved screen. In Section 3, simulated and actual experiments have been performed to verify the proposed deflectometric technique. Section 4 gives conclusion and future directions.

2. Principle

This section firstly presents the principle in PMD system with a curved screen. Then, the relationship between phase and height, and calibration are demonstrated. In order to get a model of the curved screen, a stereo vision method will be studied. Finally, usage of the model is explained.

2.1 Curved screen in deflectometry

In fact, a curved screen can effectively expand the range of gradient and height field of SuT, as illustrated in Fig. 2. When a large-curvature specular surface is measured, the small-size curved screen can satisfy with the measuring field view, instead of a large-size plane screen.

2.2 Deflectometry using a curved screen

A diagram of the proposed deflectometric technique is shown in Fig. 3. It contains a CCD camera and a curved screen with known radius. Ideally, the curved screen is a part of cylinder and radius is an important parameter with a constant value. The CCD camera is mounted on the top of the curved screen. The screen displays horizontal and vertical sinusoidal fringes with fringe numbers N2, N2-1, N2-N selected by the optimum fringe frequency method [16,17]. The displayed fringes are reflected by the reference plane mirror or SuT, and then be captured by the camera. In order to orient light direction corresponding to every camera pixel, the screen is fixed on a precise translating stage to locate two positions. The camera captures the fringes reflected by SuT and the reference plane mirror at the two screen positions.

 figure: Fig. 3.

Fig. 3. Diagram of the deflectometric technique.

Download Full Size | PDF

In order to simplify the geometric relationship, top view and left view of the deflectometric technique in Fig. 3 are illustrated in Fig. 4 when the curved screen is located in two positions. I1 and I2 are the middle point of the curved screen. For a certain pixel in CCD, A1, A2 are the corresponding pixels in the screen reflected by the reference plane, and the same for B1, B2 reflected by SuT. System parameters of the camera’s optical center F(xF, yF, zF), radius of the curved screen Rscreen, I1O and I2O can be predetermined. The relationship between height and systematic parameters can be easily derived in the following.

 figure: Fig. 4.

Fig. 4. Computation schematic diagram. (a) in top view, (b) in left view.

Download Full Size | PDF

Every pixel in the camera corresponds to four positions on the curved screen, A1, A2, reflected by the reference plane and B1, B2 reflected by SuT. These four points’ coordinates can be calculated by

$$z\textrm{ = }{R_{Screen}} \cdot \textrm{cos(}\frac{{\frac{{{\varphi _v} - {\varphi _\textrm{I}}}}{{totalphas{e_v}}} \cdot {l_w}}}{{{R_{Screen}}}}) - ({R_{Screen}} - {\textrm{I}_\textrm{1}}\textrm{O})$$
$$y = \frac{{{\varphi _h} - {\varphi _\textrm{I}}}}{{totalphas{e_h}}} \cdot {l_h}$$
where totalphasev and totalphaseh denotes the difference between maximum and minimum absolute phase along vertical and horizontal direction, respectively; lw, lh are width and height of the screen, respectively; ${\varphi _\textrm{I}}$ is the phase of the middle point of the screen; ${\varphi _h}$ and ${\varphi _v}$ are the demodulated absolute phase value by the camera’s pixel along horizontal and vertical direction, respectively; I1O is distance between I1 and the reference mirror.

${k_{\textrm{A1A2}}}$ and ${k_{\textrm{B1B2}}}$ represent direction of the light A1A2, B1B2 in the left view, as illustrated in Fig. 4(b). ${k_{\textrm{A1A2}}}$, ${k_{\textrm{B1B2}}}$ can be calculated by

$${k_{\textrm{A}1\textrm{A}2}} = \frac{{{y_{\textrm{A}1}} - {y_{\textrm{A}2}}}}{{{z_{\textrm{A}1}} - {z_{\textrm{A}2}}}}$$
$${k_{\textrm{B}1\textrm{B}2}} = \frac{{{y_{\textrm{B}1}} - {y_{\textrm{B}2}}}}{{{z_{\textrm{B}1}} - {z_{\textrm{B}2}}}}$$

In y direction, the distance between optical center F and B1 is expressed by

$$({z_\textrm{F}} - h){k_{\textrm{A1A2}}} + ({z_{\textrm{B1}}} - h){k_{\textrm{B1B2}}} = {y_{\textrm{B1}}} - {y_\textrm{F}}$$
where h denotes height of the reflected point D’ on SuT and can be expressed by
$$h = \frac{{{z_\textrm{F}} \cdot {k_{\textrm{A1A2}}} + {z_{\textrm{B1}}} \cdot {k_{\textrm{B1B2}}} - {y_{\textrm{B1}}} + {y_\textrm{F}}}}{{{k_{\textrm{A1A2}}} + {k_{\textrm{B1B2}}}}}$$

2.3 Model reconstruction of a curved screen

The derivations in section 2.2 are based on the assumption of the curved screen having a constant radius of curvature. However, the actual commercial curved screen is designed for human viewing and the radius of curvature has a changeable value.

In order to reconstruct a model of the actual screen at two locations, a stereo vision method is studied [1820]. The screen displays horizontal and vertical sinusoidal fringes selected by the optimum fringe number method and a multiple-step phase-shifting algorithm [16,17], distinguishing screen pixels’ coordinates along the screen and benefiting searching of the homologous points. Every kind of fringe shifts n times with a step of $\mathrm{2\ast }\pi /n$. Two cameras are fixed in front of the screen. After rectifying and analyzing the character of image pair, phase values along the epipolar line are fitted and corrected by a high-degree polynomial.

After demodulating the captured fringe patterns, horizontal and vertical absolute phase maps corresponding to every point location at two screen positions are obtained. The curved screen displaying the sinusoidal fringe patterns is a continuous curved surface, and the intersection line between the epipolar plane and the screen is a continuous curve, as shown in Fig. 5. The phase value on this curve is also continuous, without step phenomenon. After rectification, a camera pinhole model projects the curve to the same row of stereo image plane. Therefore, the function having different horizontal pixel coordinates with the same vertical coordinates as arguments and corresponding phase values as dependent are also continuous. The phase values captured by the two cameras are related to external parameters ${R_{CS}}$, ${T_{CS}}$ between the camera and the screen, and internal parameters ${P_{intrinsic}}$ of the camera. As above three parameters shown, shape of the screen determines the captured phase values. In other words, due to different shape of the screen, the same pixel of the camera will capture different phase values. Denoting hi as position of the screen point corresponding to a pixel of the camera, i as the horizontal camera pixels coordinate, f as the function of above parameters, the captured phase value phasei can be expressed as

$$phas{e_i} = f({R_{cs}},\textrm{ }{T_{cs}},\textrm{ }{P_{intrinsic}},\textrm{ }{h_i})$$

 figure: Fig. 5.

Fig. 5. Diagram of the stereo system for screen model.

Download Full Size | PDF

Through the N-order polynomial fitting of discrete points, a distribution function of phase values on the camera epipolar line can be determined by

$$phas{e_i}\textrm{ = }\sum\limits_{k = 0}^N {{a_k} \cdot {i^k}}$$

Due to the influence of electronic devices’ noise, the fringe pattern has non-negligible noise in the actual measurement. It’s effective to resist noise by fitting phase along the epipolar line in the image pair. Based on the fitting function, the matching points’ horizontal coordinates corresponding to the base points’ phase values can be computed, and the difference of horizontal coordinates of base and matching points is the disparity value. Depth of screen can be computed by using the obtained disparity value.

2.4 Calibration of the deflectometric system

In the proposed deflectometric technique based on the curved screen, xoy plane of the right-hand system coordinate is fixed on the reference mirror. Optical center F and coordinates of the screen model need to be calculated in system coordinate according to Eqs. (5) and (6).

Optical center F can be determined by capturing the markers with known separation on the reference mirror. Meanwhile, rotation matrix ${R_{mirror}}$ and translation vector ${T_{mirror}}$ between the camera and the reference mirror, normal direction of the reference mirror ${n_{mirror}}$ in camera coordinate system, distance ${d_{camera}}$ between F and the reference mirror can be calculated by a PnP algorithm [21,22].

A virtual plane is defined to represent the curved screen’s position and posture according to symmetric points displayed on the curved screen. The stereo system in section 2.3 measures its height h and width w. In the stereo system and the deflectometric system, the same virtual plane is chosen to represent the screen’s position and posture.

In the stereo system, ${R_{vp\_stereo}}$ and ${T_{vp\_stereo}}$ denote rotation matrix and translation vector, respectively, between the left camera in Fig. 5 and the virtual plane. In the deflectometry system, rotation matrix and translation vector between the camera in Fig. 3 and the virtual image of the virtual plane in the reference mirror are denoted as ${R_{vp\_virtual}}$ and ${T_{vp\_virtual}}$, respectively. Rotation matrix and translation vector between the camera in Fig. 3 and the virtual plane are denoted as ${R_{vp}}$ and ${T_{vp}}$, respectively. Model of screen at two locations obtained in section 2.3 is denoted as Pcs in the left camera coordinate, and Pmirror in the deflectometry system.

As illustrated in Fig. 6, the following equations transfer the model of the screen from the stereo system to the deflectometric system.

$${R_{vp\_virtual}} = (I - 2{n_{mirror}}{n^T}_{mirror}){R_{vp}}\left( {\begin{array}{lll} 1 &0 &0 \\ 0 &{ - 1} &0 \\ 0 &0 &1 \end{array}} \right)$$
$$\begin{aligned} &{T_{vp\_virtual}} = \\ &(I - 2{n_{mirror}}{n^T}_{mirror}){R_{vp}}\left( \begin{array}{l} 0 \\ w \\ 0 \end{array} \right) + (I - 2{n_{mirror}}{n^T}_{mirror}){T_{vp}} - 2{d_{camera}}{n_{mirror}} \end{aligned}$$
$${P_{mirror}} = {R^{ - 1}}_{mirror}({R_{vp}}{R^{ - 1}}_{vp\_stereo}({P_{cs}} - {T_{vp\_stereo}}) + {T_{vp}} - {T_{mirror}})$$

 figure: Fig. 6.

Fig. 6. Coordinate transfer diagram.

Download Full Size | PDF

As shown in Fig. 7, the spatial positions of the light source A1, A2, B1, B2 in the screen model corresponding to the pixel of the camera in Fig. 3 are searched by the normal absolute phase reflected by the reference mirror and the deformed absolute phase by SuT. Firstly, the area where the light source located is found by the fringe order constraints. Then, the coordinate of the light source in pixel level is found by monotonicity of the fringe’s absolute phase. Finally, the coordinate of the light source in subpixel level is searched by the bilinear interpolation of adjacent positions’ spatial coordinates and phase values.

 figure: Fig. 7.

Fig. 7. Methods searching for optical source.

Download Full Size | PDF

Based on the four coordinates corresponding to each pixel of the screen in Fig. 3, height of SuT can be calculated by Eqs. (3)–(6).

3. Experiments and results

In this section, some experiments have been carried out to test the proposed technique by using a curved screen. Firstly, simulated experiments were performed to verify the measurement accuracy. Then, hardware of the deflectometric system has been setup by using a curved screen. Some comparative experiments were performed by using a plane screen and a curved screen. Finally, a plane mirror, a specular step, and a large-curvature specular surface have been measured and reconstructed to test the proposed technique.

3.1 Simulated experiment

3.1.1 Depth of virtual image in the deflectometric system with a curved screen

In order to evaluate the proposed technique by using the curved screen quantitatively, a simulated experiment has been performed. With optical axis being perpendicular to the reference plane, the distance between the camera’s optical center F and the reference plane is d1=600 mm. The axis of a half cylinder, with radio r=300 mm, is perpendicular to zox plane and goes through point O. Point I is the middle of the screen, and the distance between I and the reference plane is IO=500 mm. The point E in the screen reflected by D’ is captured by the camera and its virtual image point E’ is symmetric to E about the tangent line of D’. Radio R of the ideal screen changes from 100 mm to 1500 mm, and R=109 mm represents the plane screen. With the different radios of the curved screen, the virtual image crossed the zox plane is computed. With R=367.521 mm, I’ and E’ are in the same depth, as E’ corresponds to E at the edge of the screen. The depth of virtual image d2 of different screen and its simulation diagram are illustrated in Fig. 8. For any points in screen with the same x, the projection of light to zox plane is also the same. The simulated experiments demonstrate that the curved screen with a proper radio can effectively decrease depth range of virtual image of the fringe patterns.

 figure: Fig. 8.

Fig. 8. Simulation with different screens. (a) simulation diagram, (b) depth of virtual image d2 of different screens.

Download Full Size | PDF

3.1.2 Measurement of specular surface in the deflectometric system with a curved screen

For testing the proposed deflectometric technique by using an ideal curved screen with a radius of 1000 mm, some simulation experiments have been carried out. A camera was employed to capture the reflected fringe patterns. The reference mirror after translating 20 mm and a specular cylinder with a radio of 60 mm was measured by the simulated system. The distance between screen and the reference mirror is 150 mm. Rotation matrix and translating vector between camera and the reference mirror is $\left( \begin{array}{lcl} 0.9848 &0 &0.1736 \\ 0.0594 &0.9397 &- 0.3368 \\ - 0.1632 &0.3420 &0.9254 \end{array} \right)$ and $\left( \begin{array}{ccc} 0 &0 &378.2081 \end{array} \right)$, respectively.

Noises with different levels were added into the generated fringe patterns by

$${I_{noisy}} = {I_{ideal}} \ast (1 + i \cdot 0.2/100 \cdot randn)$$
where Inoisy denotes the generated noisy fringe pattern, i is the noise level and i=1, …, 15, randn is a matrix whose element obeys standard normal distribution.

At different noise levels, the difference of RMS (Root Mean Square) between the measured height by Eqs. (1)–(6) and the real height is illustrated in Table 1 and Table 2.

Tables Icon

Table 1. Simulation results of reference mirror after translating

Tables Icon

Table 2. Simulation results of cylinder measurement

The simulated experimental results indicate that the proposed technique is of high noise resistance and high reconstruction accuracy.

3.2 Deflectometric system with a curved screen

3.2.1 Hardware of the deflectometric system

The deflectometric system consists of a curved screen, a CCD camera, and a translating stage, as depicted in Fig. 9(b). The camera (XIMEADE XIQ, MQ042CG-CM, Germany) has a resolution of 2048 × 2048 pixels, and uses a standard prime lens (AZURE-1620ML5M) of focal length 16 mm. The model of the curved screen is SAMSUNG C24T55* 1000R, with a resolution of 1920*1080, pixel size of 0.272 mm*0.272 mm. The translating stage (DHC, GCD-20Series, Beijing, China) has an accuracy of 1 μm.

 figure: Fig. 9.

Fig. 9. Hardware of the deflectometric systems. (a) with a plane screen, (b) with a curved screen.

Download Full Size | PDF

3.2.2 Qualitative comparisons

In order to explain the advantages of using the curved screen in measuring large-curvature specular surface, deflectometric systems with a plane and a curved screen were setup, as demonstrated in Fig. 9. A cylinder specular surface was tested. The area of displaying fringe patterns for the plane and curved screen was chosen as the same resolution of 1440*900. The pixel size of the plane screen and the curved screen is 0.283 mm and 0.272 mm, respectively, which means the size of the plane screen is larger than that of the curved screen. In the comparative experiments, the plane screen needs to be replaced with the curved screen. Both of two screens were fixed on a translating stage with accuracy of 1 micrometer to be accurately located in a certain position. In order to compare two screens, the specular surface was placed at a position where the camera can capture the largest area of clear patterns.

The camera captured the virtual image of the reflected fringe patterns and the corresponding absolute phase was calculated, as shown in Fig. 10.

 figure: Fig. 10.

Fig. 10. The fringe patterns and absolute phase maps. (a) and (b) with a plane screen, (c) and (d) with a curved screen.

Download Full Size | PDF

The edge of the virtual image of the fringe patterns displayed by the plane screen is blurred, so the corresponding absolute phase map is noisy on both sides due to out of the depth of field of the imaging lens. However, the virtual image of the fringe patterns displayed by the curved screen is clear because of the small range along depth, as illustrated in Fig. 2. The specular surface was reconstructed by the proposed method with the plane screen and the curved screen and was transferred to same coordinate, as illustrated in Fig. 11. It clearly shows although the physical size of the plane screen is larger than that of the curved screen, the shape data on both sides are missed when using the plane screen, while most parts of the specular surface can be reconstructed when using the curved screen. The qualitative comparison clearly shows that a curved screen can effectively expand the range of gradient and height field of SuT. When a large-curvature specular surface is measured, the small-size curved screen can satisfy with the measuring field view, instead of a large-size plane screen.

 figure: Fig. 11.

Fig. 11. The reconstruction of the specular surface in deflectometric system. (a) with a plane screen, (b) with a curved screen.

Download Full Size | PDF

3.2.3 System calibration

The radius of the curved screen is 1000 mm in the manual. However, the actual radius is gradually changing, instead of a constant value. In order to calibrate the deflectometric system, the curved screen needs to be reconstructed by using the proposed method in section 2.3. The curved screen displayed sinusoidal fringe patterns with N=10. Two cameras captured the patterns to model the curved screen, as shown in Fig. 12.

 figure: Fig. 12.

Fig. 12. Hardware diagram of stereo system.

Download Full Size | PDF

Absolute phase maps were demodulated from the captured fringe patterns as shown in Fig. 13. The reconstruction results were fitted by a polynomial surface, as shown in Fig. 14, where the color bar represented depth. Thus, this method was employed to reconstruct the screen at two positions, and the phase value was merged with the spatial point cloud. The result is shown in Fig. 15, where the color bar represents phase.

 figure: Fig. 13.

Fig. 13. Fringe patterns and phase maps. (a)-(d) fringe patterns captured by the left camera and phase map after rectification, (e)-(h) by the right camera.

Download Full Size | PDF

 figure: Fig. 14.

Fig. 14. Fitting surface and reconstruction curved screen.

Download Full Size | PDF

 figure: Fig. 15.

Fig. 15. Reconstruction depth merge with (a) vertical phase, (b) horizontal phase.

Download Full Size | PDF

After reconstructing the model of the curved screen, the deflectometric system was calibrated by using a reference mirror. There are evenly distributed rings, with a radio of 1.5 mm and separation of 6 mm, on the reference mirror. Because aperture value and depth of focus of camera’s lens affect depth of field [23,24], the parameters of the camera lens were adjusted to have depth of focus around 0.3 m and a smaller aperture value. Therefore, markers on the reference mirror and virtual image of the curved screen can be clearly captured. Camera in Fig. 3 recorded signs on the surface of the reference mirror as screen displayed pure white, then recorded virtual image of displayed checker pattern reflected by the reference mirror, as shown in Fig. 16, where + denoted extracted feature points, ○ reprojected feature points. Based on the PnP algorithm, ${R_{vp\_virtual}}$, ${T_{vp\_virtual}}$, ${R_{mirror}}$ and ${T_{mirror}}$ were determined.

 figure: Fig. 16.

Fig. 16. Deflectometric system calibration. (a) Calibration of reference plane, (b) calibration of virtual plane’s virtual image in reference mirror.

Download Full Size | PDF

Based on Eqs. (9)–(11) and above calibration results, the screen model was transferred to deflectometric system, as shown in Fig. 17, where color bar denoted height of screen to the reference mirror. The reprojection error is [0.1559 0.1044] pixel which computed by virtual plane’s featured points reprojected to the camera by the calibrated parameters in Fig. 17. The process of reprojection refers to literature [25]. The error mainly comes from reconstruction of the curved screen, extraction of markers in reference mirror and virtual plane, and distance of markers on virtual plane which need to be measured by stereo system. Meanwhile, electronic noise from screen and camera will also impact the reprojection error. Eventually, these noise will propagate to reconstruction of the specular surface.

 figure: Fig. 17.

Fig. 17. Models of screen in deflectometric system.

Download Full Size | PDF

3.2.4 Experiments on specular surface

In order to evaluate the proposed deflectometric system quantitatively, the system measured the plane reference mirror after rotated a random angle. The coordinates of a plane mirror were obtained, as shown in Fig. 18 with the width around 200 mm, the length around 50 mm. As point cloud fitted to a plane, RMS of the distance to the fitting plane is 0.0648 mm.

 figure: Fig. 18.

Fig. 18. Reconstruction of a plane mirror.

Download Full Size | PDF

To verify furtherly, a specular step with high accuracy was measured, as shown in Fig. 19. The actual distance between steps was measured by a three-coordinate measuring machine. Then, deflectometric measured coordinates of every step was fitted to a plane. Finally, the distance between the points of the adjacent step and the fitting plane was treated as measured distance. Table 3 shows the comparison between the actual distance and the measured distance.

 figure: Fig. 19.

Fig. 19. Specular step and deflectometric measurement result. (a) Specular step, (b) deflectometric measurement result.

Download Full Size | PDF

Tables Icon

Table 3. Actual distance, measurement distance of step and error

3.2.5 Quantitative comparisons

A large-curvature specular surface was measured by the proposed technique with a plane and a curved screen illustrated in Fig. 9. The reconstruction of the specular surface through plane and curved screen system were fitted into polynomial surface, as illustrated in Fig. 20.

 figure: Fig. 20.

Fig. 20. The reconstruction of the specular surface in deflectometric system. (a) with a plane screen, (b) with a curved screen.

Download Full Size | PDF

RMS of the difference between the fitting surface and the reconstruction of specular surface by the plane and the curved screen were 0.0568 mm and 0.0490 mm, respectively. Meanwhile, the range of measurement was expanded by the deflectometric system with the curved screen.

The experiment results show that the proposed deflectometric system can reconstruct specular surface with high accuracy and reliability.

4. Conclusion

In this paper, a novel deflectometric technique has been proposed by using a curved screen to measure large-curvature specular surface. The curved screen effectively expands the range of the gradient and height field of the measured large-curvature specular surface. Firstly, the principle and calibration of the curved screen deflectometric system are given. Stereo cameras are placed in the front of the curved screen to reconstruct the screen. The model of the curved screen is transferred to deflectometric system. Then, a specular cylinder is reconstructed by using a plane screen and a curved screen, and the range of measurement is efficiently expanded by using the curved screen. Finally, a plane mirror, a specular step and a large-curvature specular surface are reconstructed with high accuracy by the proposed deflectometric technique. The experiment results verify the high accuracy and large measured range for measuring large-curvature specular surface by using the proposed deflectometric technique. In the future, further experiments will be carried out to measure more components with large-curvature specular surface and more accurate calibration methods will be studied.

Funding

National Natural Science Foundation of China (51675160, 52075147).

Disclosures

The authors declare no conflicts of interest.

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

References

1. T. Bothe, W. S. Li, C. V. Kopylow, and W. Jüptner, “High-resolution 3D shape measurement on specular surfaces by fringe reflection,” Proc. SPIE 5457, 411–422 (2004). [CrossRef]  

2. L. Huang, M. Idir, C. Zuo, and A. Asundi, “Review of phase measuring deflectometry,” Opt. Laser Eng. 107, 247–257 (2018). [CrossRef]  

3. M. C. Knauer, J. Kaminski, and G. Hausler, “Phase measuring deflectometry: a new approach to measure specular free-form surfaces,” Proc. SPIE 5457, 366–376 (2004). [CrossRef]  

4. L. Svenja, J. Kaminski, M. C. Knauer, and G. Häusler, “Vision and modeling of specular surfaces,” Vision, Modeling and Visualization 2005, pp. 479–486 (2005).

5. L. Huang, J. P. Xue, B. Gao, C. Mcpherson, J. Beverage, and M. Idir, “Modal phase measuring deflectometry,” Opt. Express 24(21), 24649–24664 (2016). [CrossRef]  

6. L. Huang, J. P. Xue, B. Gao, and M. Idir, “Three-dimensional shape measurement with modal phase measuring deflectometry,” Proc. SPIE 10449, 1044909 (2017). [CrossRef]  

7. L. Huang, J. P. Xue, B. Gao, C. Mcpherson, J. Beverage, and M. Idir, “Model mismatch analysis and compensation for modal phase measuring deflectometry,” Opt. Express 25(2), 881–887 (2017). [CrossRef]  

8. M. Petz and R. Tutsch, “Measurement of optically effective surfaces by imaging of gratings,” Proc. SPIE 5144, 288–294 (2003). [CrossRef]  

9. H. W. Guo and T. Tao, “Specular surface measurement by using a moving diffusive structured light source,” Proc. SPIE 6834, 68343E (2007). [CrossRef]  

10. H. W. Guo, P. Feng, and T. Tao, “Specular surface measurement by using least squares light tracking technique,” Opt. Laser Eng. 48(2), 166–171 (2010). [CrossRef]  

11. M. M. Liu, R. Hartley, and M. Salzmann, “Mirror surface reconstruction from a single image,” CVPR, pp. 129–136 (2013).

12. M. M. Liu, R. Hartley, and M. Salzmann, “Mirror surface reconstruction from a single image,” PAMI 37(4), 760–773 (2015). [CrossRef]  

13. Z. H. Zhang, Y. M. Wang, S. J. Huang, Y. Liu, C. X. Chang, F. Gao, and X. Q. Jiang, “Three-Dimensional shape measurements of specular objects using phase-measuring deflectometry,” Sensors 17(12), 2835 (2017). [CrossRef]  

14. Y. Liu, S. J. Huang, Z. H. Zhang, N. Gao, F. Gao, and X. Q. Jiang, “Full-field 3D shape measurement of discontinuous specular objects by direct phase measuring deflectometry,” Sci. Rep. 7(1), 10293 (2017). [CrossRef]  

15. P. Zhao, N. Gao, Z. H. Zhang, F. Gao, and X. Q. Jiang, “Performance analysis and evaluation of direct phase measuring deflectometry,” Opt. Laser Eng. 103, 24–33 (2018). [CrossRef]  

16. Z. H. Zhang, C. E. Towers, and D. P. Towers, “Time efficient color fringe projection system for 3D shape and color using optimum 3-frequency selection,” Opt. Express 14(14), 6444–6455 (2006). [CrossRef]  

17. C. E. Towers, D. P. Towers, and J. D. C. Jones, “Generalized frequency selection in multifrequency interferometry,” Opt. Lett. 29(12), 1348–1350 (2004). [CrossRef]  

18. H. X. Liu, S. J. Huang, N. Gao, and Z. H. Zhang, “Binocular stereo vision system based on phase matching,” Proc. SPIE 10023, 100230S (2016). [CrossRef]  

19. Y. Li, Y. Ruichek, and C. Cappelle, “3D triangulation based extrinsic calibration between a stereo vision system and a LIDAR,” 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), pp. 797–802 (2011). [CrossRef]  

20. A. Fusiello, E. Trucco, and A. Verri, “A compact algorithm for rectification of stereo pairs,” Mach Vision Appl. 12(1), 16–22 (2000). [CrossRef]  

21. X. S. Gao, X. R. Hou, J. L. Tang, and H. F. Cheng, “Complete solution classification for the perspective-three-point problem,” PAMI 25(8), 930–943 (2003). [CrossRef]  

22. S. Q. Li, C. Xu, and M. Xie, “A robust O(n) solution to the perspective-n-point problem,” IEEE Trans. Pattern Anal. Mach. Intell. 34(7), 1444–1450 (2012). [CrossRef]  

23. H. Y. Wang, B. Q. Zhao, Y. Wang, L. Zheng, G. J. Wang, and D. Y. Wang, “Depths of view and focus of digital holographic imaging system,” Proc. SPIE 6622, 662213 (2007). [CrossRef]  

24. D. Y. Yu and H. Y. Tang, Engineering optics (China machine press, 2016), Chap. 4.

25. Y. L. Xiao, S. K. Li, Q. C. Zhang, J. X. Zhong, X. Y. Su, and Z. S. You, “Optical fringe-reflection deflectometry with bundle adjustment,” Opt. Laser Eng. 105, 132–140 (2018). [CrossRef]  

Data availability

Data underlying the results presented in this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Cited By

Optica participates in Crossref's Cited-By Linking service. Citing articles from Optica Publishing Group journals and other participating publishers are listed here.

Alert me when this article is cited.


Figures (20)

Fig. 1.
Fig. 1. Deflectometry system.
Fig. 2.
Fig. 2. Comparison of measuring field view and virtual image by using plane screen and curved screen.
Fig. 3.
Fig. 3. Diagram of the deflectometric technique.
Fig. 4.
Fig. 4. Computation schematic diagram. (a) in top view, (b) in left view.
Fig. 5.
Fig. 5. Diagram of the stereo system for screen model.
Fig. 6.
Fig. 6. Coordinate transfer diagram.
Fig. 7.
Fig. 7. Methods searching for optical source.
Fig. 8.
Fig. 8. Simulation with different screens. (a) simulation diagram, (b) depth of virtual image d2 of different screens.
Fig. 9.
Fig. 9. Hardware of the deflectometric systems. (a) with a plane screen, (b) with a curved screen.
Fig. 10.
Fig. 10. The fringe patterns and absolute phase maps. (a) and (b) with a plane screen, (c) and (d) with a curved screen.
Fig. 11.
Fig. 11. The reconstruction of the specular surface in deflectometric system. (a) with a plane screen, (b) with a curved screen.
Fig. 12.
Fig. 12. Hardware diagram of stereo system.
Fig. 13.
Fig. 13. Fringe patterns and phase maps. (a)-(d) fringe patterns captured by the left camera and phase map after rectification, (e)-(h) by the right camera.
Fig. 14.
Fig. 14. Fitting surface and reconstruction curved screen.
Fig. 15.
Fig. 15. Reconstruction depth merge with (a) vertical phase, (b) horizontal phase.
Fig. 16.
Fig. 16. Deflectometric system calibration. (a) Calibration of reference plane, (b) calibration of virtual plane’s virtual image in reference mirror.
Fig. 17.
Fig. 17. Models of screen in deflectometric system.
Fig. 18.
Fig. 18. Reconstruction of a plane mirror.
Fig. 19.
Fig. 19. Specular step and deflectometric measurement result. (a) Specular step, (b) deflectometric measurement result.
Fig. 20.
Fig. 20. The reconstruction of the specular surface in deflectometric system. (a) with a plane screen, (b) with a curved screen.

Tables (3)

Tables Icon

Table 1. Simulation results of reference mirror after translating

Tables Icon

Table 2. Simulation results of cylinder measurement

Tables Icon

Table 3. Actual distance, measurement distance of step and error

Equations (12)

Equations on this page are rendered with MathJax. Learn more.

z  =  R S c r e e n cos( φ v φ I t o t a l p h a s e v l w R S c r e e n ) ( R S c r e e n I 1 O )
y = φ h φ I t o t a l p h a s e h l h
k A 1 A 2 = y A 1 y A 2 z A 1 z A 2
k B 1 B 2 = y B 1 y B 2 z B 1 z B 2
( z F h ) k A1A2 + ( z B1 h ) k B1B2 = y B1 y F
h = z F k A1A2 + z B1 k B1B2 y B1 + y F k A1A2 + k B1B2
p h a s e i = f ( R c s ,   T c s ,   P i n t r i n s i c ,   h i )
p h a s e i  =  k = 0 N a k i k
R v p _ v i r t u a l = ( I 2 n m i r r o r n T m i r r o r ) R v p ( 1 0 0 0 1 0 0 0 1 )
T v p _ v i r t u a l = ( I 2 n m i r r o r n T m i r r o r ) R v p ( 0 w 0 ) + ( I 2 n m i r r o r n T m i r r o r ) T v p 2 d c a m e r a n m i r r o r
P m i r r o r = R 1 m i r r o r ( R v p R 1 v p _ s t e r e o ( P c s T v p _ s t e r e o ) + T v p T m i r r o r )
I n o i s y = I i d e a l ( 1 + i 0.2 / 100 r a n d n )
Select as filters


Select Topics Cancel
© Copyright 2024 | Optica Publishing Group. All rights reserved, including rights for text and data mining and training of artificial technologies or similar technologies.