Phase measuring deflectometry (PMD) has been widely used to measure three-dimensional (3D) shape of specular objects because of its advantages of non-contact, large dynamic range, high-precision and fast-acquisition. However, due to the limited depth of field (DOF) of a camera lens, a liquid crystal display (LCD) screen and a tested specular object cannot be clearly imaged together, which affects the measurement accuracy. To tackle this issue, this paper proposes a novel PMD method of auxiliary imaging LCD screen by using a concave mirror. The LCD screen and a reference are in the same plane via the center of the concave mirror, and are perpendicular to the optical axis of the mirror. Both the LCD screen and the reference are symmetric each other through the optical axis, so that the imaging of one is the location of the other. Based on the imaging principle of concave mirror, the LCD screen is reflected and an inverted real image of the equal size is formed at the reference, and then reflected into the camera by the reference mirror during calibration. During the measuring procedure, a tested specular object is placed at the position of the reference. The displayed fringe patterns on the LCD screen are modulated by the tested specular object and the deformed fringes are captured by the camera. After phase calculation from the captured fringe patterns, 3D shape of the tested specular object can be obtained. The proposed PMD method can avoid the limited DOF of the camera lens, because fringe patterns displayed on the LCD screen and the tested specular surface can be clearly imaged together at the same position. Some simulated experiments on measuring specular objects have been carried out and the results demonstrate that the proposed PMD method can effectively and accurately measure 3D shape of specular surfaces.
Deflectometry has been widely used in topography measurement of specular surface due to the merits of full-field data acquisition, automatic data processing, high accuracy, and large dynamic range. Existing deflectometry-based methods, such as model phase measuring deflectometry, direct phase measuring deflectometry, stereo deflectometry, employ a plane screen. Due to the size and shape of the used screen, reconstruction of specular surface with large curvature can’t be carried out in single measurement. The characteristics of curved screens effectively expand the ranges of the gradient and height field of mirror. Ideally, curved screens are a part of normal cylinders. However, initial experiment shows that the commercialized curved screen changes in radius, instead of a constant value. In order to obtain the model of the curved screen, two CCD cameras capture fringes displayed on the curved screen. Stereo technique is applied to compute screen’s point cloud containing curved screen’s location and phase. The stereo technique is rectifying pairs of fringe map based on epipolar constraint to the same rotating matrix. The epipolar line of fringe map pair lies in the same row. Then disparity is computed through block match in column coordinate and refined through curve fitting. Some experiments have been carried out and results show that rectifying fringe map helps get more accurate and stable point cloud of curved screen to be suitably employed in deflectometry by a curved screen.
Phase measuring deflectometry (PMD) is a superior technique to obtain three-dimensional (3D) shape information of specular surfaces because of its advantages of large dynamic range, noncontact operation, full-field measurement, fast acquisition, high precision, and automatic data processing. We review the recent advances on PMD. The basic principle of PMD is introduced following several PMD methods based on fringe reflection. First, a direct PMD (DPMD) method is reviewed for measuring 3D shape of specular objects having discontinuous surfaces. The DPMD method builds the direct relationship between phase and depth data, without gradient integration procedure. Second, an infrared PMD (IR-PMD) method is reviewed to measure specular objects. Because IR light is used as a light source, the IR-PMD method is insensitive to the effect of ambient light on the measured results and has high measurement accuracy. Third, a proposed method is reviewed to measure the 3D shape of partial reflective objects having discontinuous surfaces by combining fringe projection profilometry and DPMD. Then, the effects of error sources that mainly include phase error and geometric calibration error on the measurement results are analyzed, and the performance of the 3D shape measurement system is also evaluated. Finally, the future research directions of PMD are discussed.
Aiming at the problem that the center extraction accuracy of the circular coding target is easily affected by camera angle, a method to extract the center based on the radial line fitting of the coding ring is proposed in this paper. Firstly, the radial straight line edge of the circular coding target ring is obtained by edge extraction after image preprocessing, The extracted sub-pixel edge points set is mapped to the parameter space into curves, and the intersection points between all curves are found. Finally, the RANSAC (Random Sample Consensus) algorithm is used for fitting the line to the above points, and the actual center is obtained by mapping the fitted line to the original coordinate space. Compared with the ellipse fitting method, the reprojection error of the camera calibration by the extracted targets centers is reduced by 20%, and the calibration result is more accurate and reliable.
Phase measuring deflectometry (PMD) is a superior technique to obtain 3D shape information of specular surfaces because of its advantages of large dynamic range, non-contact operation, full-field measurement, fast acquisition, high precision and automatic data processing. This paper reviews the recent advance on PMD. First, the basic principle of PMD is introduced following several fringe reflection methods. Then, a direct PMD (DPMD) method is presented for measuring 3D shape of specular objects having discontinuous surfaces. The DPMD method builds the relationship between phase and depth data, without gradient integration procedure. Next, an infrared PMD (IR-PMD) method is reviewed to measure specular objects. Because IR light is used as a light source, the IR-PMD method is insensitive to the effect of ambient light and has high measurement accuracy. The following will analyze the effects of error sources, including nonlinear influence, lens distortion of imaging and projecting system, geometric calibration error, on the measurement results and evaluate the performance of the 3D shape measurement system. Finally, the future research directions of PMD will be discussed.
KEYWORDS: 3D metrology, Imaging systems, 3D acquisition, Infrared imaging, Light, Complex systems, Reflectivity, Deflectometry, Data processing, Data integration
Phase sensitivity plays a vital role in accurately retrieving three-dimensional (3D) shape of diffused objects in fringe projection profilometry (FPP). With regard to traditional means that simply project horizontal or vertical fringe patterns, the fringe frequency and direction are not the best choice to acquire optimal sensitivity to depth variations. This talk will present a novel method to obtain 3D shape with high accuracy by combining the optimal fringe frequency and the optimal fringe direction (OFF + OFD). The simulated and actual experiments have been carried out to demonstrate that the proposed optimization method is feasible and effective in increasing phase sensitivity and measurement accuracy.
Phase-measuring deflectometry (PMD)-based methods have been widely used in the measurement of the threedimensional (3D) shape of specular objects, and the existing PMD methods utilize visible light. However, specular surfaces are sensitive to ambient light. As a result, the reconstructed 3D shape results are mostly affected by the external environment in actual measurements. To overcome this problem, a novel infrared-PMD (IR-PMD) method is proposed to measure specular objects by directly establishing the relationship between the absolute phase and depth data. In addition, a new calibration method for the measurement system has been proposed by combining fringe projection and fringe reflection. The proposed IR-PMD method uses an IR projector to project sinusoidal fringe patterns onto a ground glass, which can be regarded as an IR digital screen. The IR fringe patterns are reflected by the measured specular surfaces and the deformed fringe patterns captured by an IR camera. The multiple-step phase-shifting algorithm and the optimum three-fringe number selection method are applied to the deformed fringe patterns to obtain the wrapped and unwrapped phase data, respectively. Then 3D shape data can be directly calculated by the unwrapped phase data on the screen located at two positions. The results have validated the effectiveness and accuracy of the proposed method. It can be used to measure specular components in the application fields of advanced manufacturing, automobile industry, and aerospace industry.
With the fast development of integrated circuits, photovoltaics, automobile industry, advanced manufacturing, and astronomy, it is particularly important to obtain the three-dimensional (3D) shape data of specular objects quickly and accurately. Owing to the advantages of large dynamic range, non-contact operation, full-field and fast acquisition, high accuracy, and automatic data processing, phase-measuring deflectometry (PMD, also called fringe reflection profilometry) has been widely studied and applied in many fields. Direct PMD (DPMD) can directly establish the relationship between phase and depth data without gradient integration process, so it can be used for 3D shape measurement of specular objects having discontinuous surfaces. However, compared with gradient data, depth data is more sensitive to measurement noise, so the measurement accuracy obtained by gradient field integration is higher. In order to make use of the anti-noise property of gradient measurement structure, some PMD techniques usually abandon the height data obtained from the intermediate process and use the gradient data to complete the surface reconstruction. Stereo deflectometry is a typical representative to retrieve 3D shape of the measured object according to the gradient integration. It calculates the gradient field based on the uniqueness of the normal vector of the object points by using two cameras. Although obtaining high-precision measurement results, this method cannot be used for the measurement of discontinuous objects. In this paper, a new stereo DPMD method is proposed to obtain 3D shape of specular objects having discontinuous surfaces. Some experimental results on measuring discontinuous specular objects verify the high precision of the proposed stereo DPMD method.
Phase measuring deflectometry (PMD) has been widely studied to obtain three-dimensional (3D) shape of specular surfaces. Due to the procedure of slope integration, complicated specular components having discontinuous surfaces cannot be measured by the existing PMD methods. This paper presents a novel Direct PMD (DPMD) method to solve this problem of measuring discontinuous specular objects. A mathematical model is established to directly relate the absolute phase and depth data. Then a hardware measuring system has been set up. The system parameters are calibrated by using a plane mirror and a translating stage. 3D shape of an artificial specular step, a monolithic multi-mirror array having multiple specular surfaces and a reflected diamond distribution surface has been measured. The experimental results verified that the proposed method based on DPMD successfully measured full-field 3D shape of specular objects having discontinuous surfaces accurately and effectively.
Pose calibration is widely used in the fields of 3D (three-dimensional) shape reconstruction, vision-based robot navigation, augmented reality, and so on. However, if two cameras have the non-overlapped FOV (Field Of View), existing methods cannot calibrate their relative position because the calibration target is invisible to one camera. This paper presents a novel calibration method for two cameras with non-overlapped FOV by using a calibration target and a flat mirror. For the camera invisible to the calibration target, the camera can capture the virtual image via the flat mirror. PNP (Perspective-N-Point) problem is solved via the captured virtual image, and then the relative orientation between the virtual calibration target and the camera is obtained. Based on the reflection theory, moving the mirror to several positions, the orthogonal constraint equations are established. This orthogonal constraint is satisfied by all mirror positions and the reference points on target. Therefore, one can obtain the external orientation between the calibration target and the camera. For the camera visible to the calibration target, the traditional calibration method is used to obtain the external orientation between the target and the camera. After obtaining the relative orientation of the two cameras to the calibration target, an ICP (Iterative Closest Point) algorithm is used to compensate binocular pose matrix. The calibration results are analyzed by using an error model. The experimental results show that the proposed calibration method can obtain the relative orientations between two cameras effectively and accurately.
Fringe projection profilometry is commonly used for three-dimensional (3-D) shape measurement. The gamma effect caused by nonlinear intensity response of projector-camera system makes ideal sinusoidal waveforms nonsinusoidal, leading to phase and 3-D shape errors. The existing phase-error compensation methods or gamma correction methods are complicated and time-consuming. An exponential fringe projection method is proposed based on principal component analysis to alleviate phase error without requiring any complicated prior and post data. The experimental results demonstrate that the proposed method decreases the phase error effectively with high quality in the measured surfaces and needs low computational cost by comparing with the existing state-of-the-art methods.
With the development of science and technology and the improvement of social information, fingerprint recognition technology has become a hot research direction and been widely applied in many actual fields because of its feasibility and reliability. The traditional two-dimensional (2D) fingerprint recognition method relies on matching feature points. This method is not only time-consuming, but also lost three-dimensional (3D) information of fingerprint, with the fingerprint rotation, scaling, damage and other issues, a serious decline in robustness. To solve these problems, 3D fingerprint has been used to recognize human being. Because it is a new research field, there are still lots of challenging problems in 3D fingerprint recognition.
This paper presents a new 3D fingerprint recognition method by using a convolution neural network (CNN). By combining 2D fingerprint and fingerprint depth map into CNN, and then through another CNN feature fusion, the characteristics of the fusion complete 3D fingerprint recognition after classification. This method not only can preserve 3D information of fingerprints, but also solves the problem of CNN input. Moreover, the recognition process is simpler than traditional feature point matching algorithm. 3D fingerprint recognition rate by using CNN is compared with other fingerprint recognition algorithms. The experimental results show that the proposed 3D fingerprint recognition method has good recognition rate and robustness.
KEYWORDS: 3D imaging metrology, Fringe analysis, 3D metrology, Phase measurement, Deflectometry, 3D displays, Calibration, 3D acquisition, Mathematical modeling, 3D modeling, Visual process modeling, Projection systems
This paper presents a novel Phase Measuring Deflectometry (PMD) method to measure specular objects having discontinuous surfaces. A mathematical model is established to directly relate the absolute phase and depth, instead of the phase and gradient. Based on the model, a hardware measuring system has been set up, which consists of a precise translating stage, a projector, a diffuser and a camera. The stage locates the projector and the diffuser together to a known position during measurement. By using the model-based and machine vision methods, system calibration is accomplished to provide the required parameters and conditions. The verification tests are given to evaluate the effectiveness of the developed system. 3D (Three-Dimensional) shapes of a concave mirror and a monolithic multi-mirror array having multiple specular surfaces have been measured. Experimental results show that the proposed method can obtain 3D shape of specular objects having discontinuous surfaces effectively
Based on an image pre-processing algorithm, a three-dimensional (3D) object measurement method is proposed by combining time domain and frequency domain analysis. Firstly, extreme points of sinusoidal fringes under the disturbance of noise are accurately extracted. Secondly, mean envelope of the fringe is obtained through appropriate interpolation method and then removed. Thirdly, phase information is extracted by using specific filtering in Fourier spectrum of the pre-processed fringe pattern. Finally, simulated and experimental results show a good property of the proposed method in accuracy and measurement range. The proposed method can achieve 3D shape of objects having large slopes and/or discontinuous surfaces from one-shot acquisition by using color fringe projection technique and will have wide applications in the fields of fast measurement.
This paper presents a new Phase Measuring Deflectometry (PMD) method to measure specular object having discontinuous surfaces. A mathematical model is established to directly relate absolute phase and depth, instead of phase and gradient. Based on the model, a hardware measuring system has been set up, which consists of a beam splitter to change the optical path, and two LCD screens to display the same sinusoidal fringe patterns. By using model-based and machine vision method, system calibration is accomplished to provide the required parameters and conditions. The verification tests are given to evaluate the effectiveness of the developed system. The 3D shape of an artificial step having multiple specular surfaces and a concave mirror has been measured. Initial experimental results show that the proposed measurement method can obtain 3D shape of specular objects with discontinuous surface effectively.
Binocular stereo vision is an efficient way for three dimensional (3D) profile measurement and has broad applications. Image acquisition, camera calibration, stereo matching, and 3D reconstruction are four main steps. Among them, stereo matching is the most important step that has a significant impact on the final result. In this paper, a new stereo matching technique is proposed to combine the absolute fringe order and the unwrapped phase of every pixel. Different from traditional phase matching method, sinusoidal fringe in two perpendicular directions are projected. It can be realized through the following three steps. Firstly, colored sinusoidal fringe in both horizontal (red fringe) and vertical (blue fringe) are projected on the object to be measured, and captured by two cameras synchronously. The absolute fringe order and the unwrapped phase of each pixel along the two directions are calculated based on the optimum three-fringe numbers selection method. Then, based on the absolute fringe order of the left and right phase maps, stereo matching method is presented. In this process, the same absolute fringe orders in both horizontal and vertical directions are searched to find the corresponding point. Based on this technique, as many as possible pairs of homologous points between two cameras are found to improve the precision of the measurement result. Finally, a 3D measuring system is set up and the 3D reconstruction results are shown. The experimental results show that the proposed method can meet the requirements of high precision for industrial measurements.
Person identification based on biometrics is drawing more and more attentions in identity and information safety. This paper presents a biometric system to identify person using 3D palmprint data, including a non-contact system capturing 3D palmprint quickly and a method identifying 3D palmprint fast. In order to reduce the effect of slight shaking of palm on the data accuracy, a DLP (Digital Light Processing) projector is utilized to trigger a CCD camera based on structured-light and triangulation measurement and 3D palmprint data could be gathered within 1 second. Using the obtained database and the PolyU 3D palmprint database, feature extraction and matching method is presented based on MCI (Mean Curvature Image), Gabor filter and binary code list. Experimental results show that the proposed method can identify a person within 240 ms in the case of 4000 samples. Compared with the traditional 3D palmprint recognition methods, the proposed method has high accuracy, low EER (Equal Error Rate), small storage space, and fast identification speed.
Infrared absorption spectroscopy has been widely used in the field of quantitative analysis. The overlapped spectral lines of different components makes the component recognition and concentration calculation of the mixture difficult to realize. In order to solve this problem, in this paper the analytic technology of infrared absorption spectrum has been researched to establish an effective, accurate and stable component identification method. The derivative spectrum of direct absorption spectral line is calculated to eliminate the influence of background and noise. The wavelet analysis method with appropriate wavelet basis and scale resolution is used to make the time-frequency analysis of the derivative spectrum to obtain the two dimensional time-frequency characteristics matrix. The correlation analysis in both time and frequency dimensions to the time-frequency characteristics matrix of different components and mixtures is researched to realize the component identification in combination with the morphological characteristics of the derivative spectral line. Experimental results show that the proposed method can effectively identify the target component from the mixture spectral line. The research provides a method and technical route for simultaneous detection and spectral analysis of multi-component.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.