Next Article in Journal
Prediction of Machine Inactivation Status Using Statistical Feature Extraction and Machine Learning
Next Article in Special Issue
Photonic Microwave Distance Interferometry Using a Mode-Locked Laser with Systematic Error Correction
Previous Article in Journal
EDM of D2 Steel: Performance Comparison of EDM Die Sinking Electrode Designs
Previous Article in Special Issue
An Off-Axis Differential Method for Improvement of a Femtosecond Laser Differential Chromatic Confocal Probe
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Fast Laser Adjustment-Based Laser Triangulation Displacement Sensor for Dynamic Measurement of a Dispensing Robot

Department of Instrument Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2020, 10(21), 7412; https://doi.org/10.3390/app10217412
Submission received: 23 September 2020 / Revised: 14 October 2020 / Accepted: 20 October 2020 / Published: 22 October 2020
(This article belongs to the Special Issue Manufacturing Metrology)

Abstract

:
Height measurement and location by a laser sensor is a key technology to ensure accurate and stable operation of a dispensing robot. In addition, alternation of dynamic and static working modes of a robot, as well as variation of surface and height of a workpiece put forward strict requirements for both repeatability and respond speed of the location system. On the basis of the principle of laser triangulation, a displacement sensor applied to a dispensing robot was developed, and a fast laser adjustment algorithm was proposed according to the characteristics of static and dynamic actual laser imaging waveforms on different objects. First, the relationship between the centroid position of static waveform and peak intensity for different measured objects was fitted by least square method, and the intersection point of each curve was solved to confirm the ideal peak intensity, and therefore reduce the interference of different measured objects. Secondly, according to the dynamic centroid difference threshold of two adjacent imaging waveforms, the static and dynamic working modes of the sensor were distinguished, and the peak intensity was adjusted to different intervals by linear iteration. Finally, a Z direction reciprocating test, color adaptability test, and step response test were carried out on the dispensing robot platform; the experiments showed that the repeatability accuracy of the sensor was 2.7 um and the dynamic step response delay was 0.5 ms.

1. Introduction

With the development of modern science and technology, miniaturization of intelligent equipment has become a trend, which puts forward more stringent requirements for the processing technology of the equipment. In order to ensure the reliability of equipment processing, protective measures need to be taken. Precision dispensing technology effectively solves this problem and is widely used in many fields such as bottom filling, precision coating, chip encapsulation, component fixation, and so on [1,2,3].
Traditional precision dispensing depends on manual work under a microscope [4], which has the disadvantages of low production efficiency, high work intensity, and inevitable human error. With the continuous development of automation and robot technology, a series of dispensing robots have been developed to improve dispensing efficiency. All the dispensing robots developed by the Nordson Corporation (USA), the Datron Corporation (Germany), and the Soonchunhyang University (Korea) [5,6] have realized automatic high-speed precision dispensing, but the price has been expensive and they have been costly to maintain. Therefore, development of a high-precision and low-cost dispensing robot has potential application prospects. The location technology of the dispensing robot is the key to ensure measurement accuracy. Generally, height information of the actuator relative to the workpiece is accurately fed back to a robot through the photoelectric detection system, in order to carry out the operation [7,8].
A laser triangulation displacement sensor (LTDS) is a kind of ranging sensor which combines high directivity and brightness of laser with the principle of triangular measurement. It has the advantages of wide application, large measuring range, high precision, and fast response [9,10,11,12], and can be applied for precisely measuring the height information of a dispensing robot. Considering the working environment of a dispensing robot, the technical difficulties to be overcome when using LTDS to detect dispensing height information are as follows:
  • The problem of the adaptability of different objects, i.e., the different textures and colors of an object on the dispensing substrate affect the measurement, and the sensor must have good adaptability to different objects;
  • The problem of dynamic response speed, i.e., dispensing is a high-speed dynamic process, because the height of the workpiece on the dispensing substrate is not uniform, the sensor should have fast dynamic response speed during the measurement process.
Concerning the adaptability of different measured objects, for several years, researchers have studied the accuracy optimization methods of LTDS and have obtained a number of achievements. Klemen [13] introduced a dynamic symmetric projection and hyperbolic fitting compensation algorithm to solve robust alignment problems for different material objects, but the installation and measurement steps of this method were relatively complex. In contrast, it was relatively convenient to control the intensity of the laser imaging spot using an algorithm. Jung [14] improved the adaptability of the sensor to different colors by controlling the beam intensity of the laser diode so that the power received on the photoelectric device was constant when the object color changed. Similarly, Keyence [15] proposed the ABLE algorithm to adapt to the problem of light intensity inconsistency caused by different object colors. Song [16] established a mathematical model for the relationship between the imaging point position and the surface characteristic parameters of the measured object and modified the imaging point position according to the surface parameters to adapt to different measured objects. In addition, Li Sansi [17] analyzed the measurement error caused by different surface colors based on the Phong reflector model and established a color error function library to compensate for the error caused by the color change of the measured object. Although the above researches effectively improved the measurement accuracy of the LTDS for different objects, they did not involve the study of the dynamic response performance of the LTDS.
For the dynamic response speed problem, Zhang [18] developed a new type of LTDS which could measure the surface of a train with a speed of 64 km/h, but the accuracy was low. Scichi [19] proposed a dual-view triangulation structure to reduce the measurement error caused by the change of laser speckle when the measured object moved laterally. However, the structure was too large to be integrated. Thus, the LK-G series LTDS developed by Keyence [20,21] could achieve high-speed and high-precision measurement synchronously (50 KHz sampling frequency and accuracy of 0.05% F.S) through a highly integrated design. However, the LK-G series sensor took 4096 times, on average, to improve the measurement repeatability, and it relied on the sampling speed of customized imaging devices, with the disadvantage of complex steps that resulted in higher production costs.
In addition, imaging characteristics influence the accuracy of an optical measurement system. With the development of computer pattern recognition, researchers have carried out recognition and feature extraction for various optical images. Jeong [22] realized the detection of a dynamic laser spot by auto-associative multilayer perceptron (AAMLP) but did not extract the detailed information of the spot. Huffman [23] adopted a supervised classification algorithm based on a t-test filter for spectral feature classification in a complex data environment. Wang [24] proposed a method combining deep learning with a physical model to recover the information of the measured object from a single diffraction intensity diagram, but the imaging time of this method was too long. Manzo [25] developed an object recognition framework based on a fast convolution neural network, which could further extract more detailed features of the image and improved the speed of the model. Although the above studies had forward-looking significance, they had high requirements for the performance of the hardware system, which was not conducive to integrated development and promotion of LTDS. Therefore, we need a simpler laser imaging recognition method that requires less hardware. Moreover, in the particular application of a dispensing robot, it is necessary to quickly distinguish the dynamic and static imaging and to adjust the imaging to ensure measurement accuracy.
In this paper, an LTDS was proposed for a dispensing robot. By using the adjustment algorithm of laser imaging waveform, a method of “replacing hardware with software” was adopted to save hardware cost, and high-precision measurements in a dynamic scene were realized to meet the application requirements of a dispensing robot. First, the principle of dispensing robot system and the laser spot location method of the LTDS were introduced. Secondly, from the static and dynamic point of view, we studied the characteristics of an actual laser imaging waveform, in which the measured objects were a white diffuse reflector and a black frosted reflector, respectively. The optimal peak intensity of the imaging waveform was determined by least square fitting. Then, considering the actual working scene of a dispensing robot, a fast waveform adjustment algorithm was proposed. According to the dynamic centroid position shift of the imaging waveform, the static and dynamic working modes of the sensor were distinguished, and the peak intensity of the waveform was adjusted to different intervals by linear iteration. Finally, based on the dispensing robot experimental platform, we verified the repeatability accuracy and the step dynamic response characteristics of the sensor.

2. Dispensing Robot System and Laser Spot Location Principle

2.1. Principe of the Dispensing Robot System

The location and height measurement system of the dispensing robot is shown in Figure 1. The LTDS was fixed on the end of the manipulator to measure the workpiece in real time. It was designed based on direct-injection laser triangulation imaging [26]. The laser light emitted by a laser diode (LD) was focused by a collimated lens and projected vertically onto the object to form reflected light. The reflected light propagated in space by way of diffuse reflection, and then the reflected light was focused by the receiver lens in the direction of the observation angle ε and formed a laser imaging spot on the photosensitive imaging device (CMOS). The position of the imaging spot on the CMOS was obtained by the spot location algorithm. When the object moves s, the position of the imaging spot moves Δx on the CMOS accordingly, and the displacement s can be calculated according to Equation (1), where l and fpo are the object distance and image distance of the receiver lens group, and β is the imaging angle:
s = Δ x l sin β f p o sin ε Δ x l sin ( α + β )
During the high-speed movement when the dispensing robot was working, the surface and height of the workpiece could suddenly change, which inevitably led to distortion of the laser imaging spot and reduced the measurement accuracy. The different surfaces and heights of the workpiece led to a change in the shape and position shift of the imaging waveform, respectively. According to the characteristics of an actual imaging waveform, considering the static and dynamic working mode of the robot, we proposed a fast laser intensity iterative adjustment method to obtain an ideal waveform for laser spot location, in order to satisfy measurement accuracy and response speed in both.

2.2. Laser Imaging Spot Location

The laser spot location algorithm is the most important key technology to improve measurement accuracy. The gray centroid method [27,28] and function fitting method [29,30,31,32] are the mainstream methods. Under ideal conditions, the laser spot energy presents a Gaussian distribution. The function fitting method fits the Gaussian distribution of the spot energy by a simplified mathematical function, which can effectively and quickly obtain the position of the imaging point on the CMOS. In practice, however, due to optical distortion and the structure of the optical path, the imaging waveform was tilted and stretched, which led to a skewed distribution. Therefore, the function method causes some calculation deviation. In contrast, the gray centroid method can calculate the centroid of distorted waveforms to achieve the spot subpixel location.
To reduce the influence of random noise and increase the weight value near the peak, in this paper, the square weighted gray centroid method is adopted to calculate position x of the laser spot on the CMOS, as shown in Equation (2), where xi is the position on the CMOS and yi is the waveform intensity. In addition, we convert the position x from the pixel coordinates to the world coordinates by the calibration method of linear piecewise interpolation, and finally obtain the measured value.
x = i N x i y i 2 i N y i 2

3. Characteristics of the Actual Laser Imaging Waveform

The quality of imaging waveform affects the result of the centroid calculation, thus the sensor developed, in this paper, adjusted the peak intensity of the imaging waveform by controlling the CMOS exposure time. In order to improve the efficiency of the adjustment algorithm and the adaptability to different objects, it was necessary to further analyze the characteristics of the imaging waveform.

3.1. Experiment Platform for Analyzing Imaging Waveform Characteristics

Although many practical factors, such as air flow, humidity, and temperature, have been considered in recent research on laser triangulation imaging [33,34], most of these researches have focused on simulation analysis and lacked complete analysis of the actual imaging waveform. In addition, there was a lack of research on the dynamic imaging waveform, so we comprehensively analyzed the actual laser imaging waveform from the static and dynamic perspectives.
An experimental platform for analysis of laser imaging waveform was established, as shown in Figure 2a. The LTDS developed, in this paper, was placed at a certain distance from the mobile platform. It was highly integrated with a field programmable gate array (FPGA) and STM32 microprocessor for signal processing. The key components in the sensor included a laser diode (Rohm Corporation, wavelength 650 nm, power 2 mw), a linear CMOS (Hamamatsu Corporation), and an optical lens, which were purchased without special customization, therefore, improving productivity and reducing costs. The measured object was fixed on the mobile platform (resolution 1 um and precision 2 um). When its movement was controlled by the motion controller, the imaging waveforms on the CMOS were collected synchronously by the host computer. The black frosted and white diffuse reflectors were selected as the measured objects to carry out the actual waveform analysis experiment, as shown in Figure 2b.

3.2. Characteristics of Static Laser Imaging Waveforms

By controlling the exposure time of the CMOS to obtain a gray-scale image, the characteristics of static imaging waveforms of two different measured object were studied. First, 10 groups of waveforms were obtained for two measured objects, and the change rule of waveform shape under different exposure times was analyzed. Then, the centroids of the waveforms were calculated, and the relationships among the centroid positions of the imaging waveform and the peak intensity were studied.
The imaging waveforms corresponding to different exposure times are shown in Figure 3. Although the imaging waveforms of the two different objects had obvious morphological differences (Figure 3a,b), the waveforms had a consistent trend when the peak intensity was in a certain range (350–800). The relationship between the exposure time and the peak intensity was further analyzed, as shown in Figure 3c. For different objects, the relationship between the peak intensity and the CMOS exposure time was different; the CMOS exposure time required to reach the target peak intensity could not be simply calculated from a function. Establishing multiple functions to calculate the CMOS exposure time for different measured objects was costly in terms of both software and hardware. Therefore, we intended to develop an iterative algorithm to automatically adjust the CMOS exposure time for different objects.
To confirm the ideal peak intensity, we considered the relationship between the peak intensity and the centroid position. As shown in Figure 4a, there was a certain difference in the centroid positions calculated from the waveforms with different peaks. To reduce this difference and to eliminate the interference caused by different colors, we fit the “centroid position-peak intensity” curve equation of black and white objects, respectively, as shown in Equation (3):
X ( p ) = a k p k + a k 1 p k 1 + a k 2 p k 2 + + a 1 p + a 0
where ak (k = 0, 1, 2, …) is the coefficient term, p is the peak intensity, and X (p) is the centroid position when the peak intensity was p.
The least square method is used to confirm the coefficient term, and the sum of squares of error I(a0, a1, …, ak) is constructed, where Ci is the actual centroid position:
I ( a 0 , a 1 , , a k ) = i = 1 n [ C i x ( p i ) ] 2 = i = 1 n ( y i a 0 a 1 p 1 a k p i k )
Solving the corresponding coefficient a0*, a1*, …, ak* such that:
I ( a 0 * , a 1 * , , a k * ) = min a 0 * , a 1 * , , a k * I ( a 0 , a 1 , , a k )
According to the least square approximation method described above, the centroid position-peak intensity equation can be written as:
X ( p ) = [ X w X b ] = [ 1.216 e 19 5.878 e 19 ] p 7 + [ 3.39 e 16 1.856 e 15 ] p 6 + [ 3.916 e 13 2.406 e 12 ] p 5 + [ 2.574 e 10 1.649 e 9 ] p 4 + [ 1.178 e 7 6.383 e 7 ] p 3 + [ 4.255 e 5 0.0001399 ] p 2 + [ 0.01124 0.01872 ] p + [ 568 567.3 ]
where Xw and Xb are the centroid positions when the measured object is white diffuse reflector and black frosted reflector, and the intersection point of the equation curves is the ideal peak intensity (520 in this paper), as shown in Figure 4b.

3.3. Characteristics of Dynamic Laser Imaging Waveform

In order to study the change law of imaging waveform when the measured object moved, the mobile platform was driven by the host computer to enable the object to move 0.1 mm horizontally at a speed of 20 mm/s, which was a tiny displacement to avoid the interference caused by the texture change of the object surface, and five groups real-time imaging waveforms were collected (similar to static experiments, two different objects were selected). On the basis of the result of the static waveform experiment, we controlled the peak intensity of the imaging waveform to be as close as possible to the ideal value (520) by giving a constant CMOS exposure time.
The dynamic waveform change is shown in Figure 5. Although we tried to obtain a stable waveform by giving a constant exposure time, the imaging waveform was still distorted in the dynamic measurement process. Moreover, when the measured object was a black frosted reflector, the distortion of the imaging waveform changed more obviously than that of a white diffuse reflector, and the peak intensity oscillated violently. We considered that it was inevitable that the laser energy distribution on the CMOS was not uniform because of the superposition of light and the motion vector in the process of laser transmission. Therefore, it was necessary to develop a dynamic waveform adjustment strategy for dynamic waveform distortion.
Before developing the dynamic waveform adjustment algorithm, we quantitatively compared the static and dynamic waveforms, as shown in Table 1. The peak intensity fluctuation of dynamic waveforms was two to seven times that of static waveforms, and the maximum centroid position shift was 24 times that of static waveforms. The peak intensity and centroid position drift of dynamic waveform were taken as the important indexes of dynamic waveform adjustment.
In summary, based on the analysis of actual imaging waveforms of laser on the CMOS, the characteristics of static and dynamic imaging waveforms were significantly different. Therefore, we needed to fully consider the difference between the two measurement scenarios to develop the control algorithm.

4. Fast Automatic Adjustment Algorithm of Imaging Waveform

On the basis of the characteristics of the static and dynamic actual imaging waveforms, and according to the centroid position shift of two adjacent frames of imaging waveforms, an automatic fast waveform adjustment algorithm was proposed. This method could satisfy the dynamic response of the dispensing robot during its high-speed motion, and could also ensure its static measurement accuracy. The algorithm flow is shown in Figure 6.
The proposed algorithm mainly included three main parts, i.e., waveform preprocessing, measurement mode judgment, and peak intensity adjustment which are described as follows: (1) The waveform preprocessing filtered out the noise interference and obtained the effective waveform information. (2) The measurement mode judgment determined whether the measurement mode was static or dynamic by setting the centroid difference threshold of two waveforms, and different peak intensity adjustment intervals were selected for these two measurement modes. (3) During the peak intensity adjustment part, a linear approximation prediction method was presented to quickly adjust the imaging waveform.

4.1. Imaging Waveform Preprocessing

Before entering the algorithm loop, we gave the initial CMOS exposure time T0 to obtain the first frame image, and based on it, each subsequent waveform image was preprocessed as follows:
Step 1
Read the raw data of CMOS imaging waveform, identify the peak (Pi), and record its position xp.
Step 2
To filter out the edge noise, select 15% of the peak intensity as the threshold, and the waveform whose energy is higher than the threshold is intercepted as the main peak.
Step 3
Apply a median smoothing filter to the main peak obtained by Step 2, taking into account both the filtering effect and speed.

4.2. Automatic Judgment of Measurement Mode

The actual working state of the dispensing robot alternated between dynamic and static. First, the dispensing robot moved to the target position at a high speed in the dynamic state, and then measured and dispensed in the static state.
Therefore, we set the dynamic centroid difference threshold between two adjacent frames of imaging waveform to distinguish the dynamic and static states and adopted different algorithm strategies. When it was the static working mode, the peak intensity was strictly controlled in an interval close to the ideal value (520), and therefore reduced the interference caused by different measured objects. Then, 64 times of smooth filter was applied to improve the measuring stability. In the dynamic mode, considering that the sharp fluctuation of the peak intensity of the dynamic waveform decreased the dynamic response speed of the sensor, we enlarged the peak intensity control interval. Different from the static mode, we did not filter the measured value in dynamic mode.
In the above algorithm, the dynamic centroid difference threshold and the peak intensity control interval of different working modes were identified as two important parameters.

4.2.1. Dynamic Centroid Difference Threshold

Table 1 shows the comparison of centroid shift of imaging waveforms between two adjacent frames, the centroid position shift caused by object motion is obvious, and the state of the measured object can be judged by the centroid difference. When the object moved, the centroid of the imaging waveform shifted at least 0.5312 pixel, therefore, we set the dynamic centroid difference threshold as 0.5 pixel. When the dynamic centroid difference was higher than 0.5 pixel, the sensor entered the dynamic mode. Otherwise, the sensor entered the static mode.

4.2.2. Peak Intensity Adjustment Interval

It was difficult to adjust the peak intensity to the ideal value at a time. Therefore, according to the static and dynamic working modes, different adjustment convergence intervals were determined to improve the peak intensity adjustment efficiency.
On the basis of the result of Equation (6), the “centroid position-peak intensity” fitting curve of different objects are subtracted to obtain the static centroid difference Xc(p) caused by the change of the peak intensity of different measured objects, as shown in Figure 7a, which was different from the dynamic centroid difference of two adjacent waveforms. We define the absolute deviation evaluation function ф(p), as shown in Equation (7), where φ is the deviation threshold. The peak intensity adjustment intervals under different working modes are determined according to φ:
Φ ( p ) = | X c ( p ) | = | X b ( p ) X w ( p ) | φ
When φ = 0.125 pixel, the corresponding dynamic peak intensity interval is [400,800], as shown in Figure 7b. When φ = 0.025 pixel, the corresponding static peak intensity interval is [500,550], as shown in Figure 7c. The pixel coordinates are converted to the world coordinates, the theoretical errors of dynamic and static measurement caused by φ are 2.7 um and 0.5 um respectively. Therefore, the selection of the above peak intervals satisfied the needs of high-precision measurement.

4.3. Peak Intensity Linear Iterative Adjustment

In order to further improve the convergence speed of peak intensity adjustment iteration, we proposed a linear iterative method, which simplified the exposure time and the peak intensity as a linear relationship, as shown in Figure 8. The relationship between the current waveform peak intensity and the ideal peak intensity was established, and the ideal peak intensity was approximated iteratively in the next frame.
First, we judge whether the waveform peak intensity Pi of the current frame is in the ideal interval. If it is in the ideal interval, no adjustment is needed, otherwise, the peak intensity adjustment is required. According to the coordinate point (Ti, Pi) consisting of the CMOS exposure time, Ti, and the peak intensity, Pi, a linear relationship is established, and the exposure time, Ti+1, required for the next frame is calculated from Equation (8) for waveform adjustment. This cycle is iterated until the peak intensity is adjusted to the ideal interval.
T i + 1 = P i + 1 P i T i
In order to approach the ideal peak intensity, Pi+1, Equation (8) is replaced by the ideal peak intensity, Pc, as shown in Equation (9):
T i + 1 = P c P i T i
where Pc is a constant, determined to be 520 by the analysis of the actual imaging waveform. On the basis of the above peak intensity linear iterative approximation method, the peak could be quickly adjusted to an ideal interval, and therefore improve the response performance of the sensor.

5. Dispensing Robot Experiment

5.1. Experimental Platform and Method

We verified the performance of the sensor developed in this paper on the dispensing robot platform by experiments. The DS-200C dispensing robot developed by the Mingseal Robot company (in China) was taken as the experimental platform, as shown in Figure 9a. The robot could move in three dimensions, i.e., X, Y, and Z. The maximum moving speeds in the X-Y direction and Z direction were 800 and 400 mm/s, respectively, and its repeat positioning accuracy was 10 um.
The sensor was fixed to the mechanical arm in the Z direction of the robot and different measured objects were placed on the X-Y platform (Figure 9b) for experiments, including the Z direction reciprocating test, color mutation adaptability test, and step response test. It should be noted that the robot stayed at each measured position for 30 ms to avoid interference caused by shaking of the manipulator. Considering the processing errors of the measured objects and the working table of the dispensing robot, the measurement performance of the sensor was evaluated for repeatability accuracy.

5.2. Z Direction Reciprocating Test Results and Analysis

To test the stability of the sensor in the Z direction of the dispensing robot, we fixed the sensor on the robot arm and moved back and forth at a speed of 400 mm/s along the Z direction, reaching five preset positions and staying for 30 ms, where the distance between each two-adjacent positions was 10 mm, as shown in Figure 10.
The displacement change curve of the sensor was recorded, as shown in Figure 11. When the sensor moved in the Z direction, its displacement curve was smooth and there was no obvious noise point, therefore, the sensor had good stability. Among them, the repeatability accuracy of five pause positions are shown in Table 2, with an average repeatability accuracy of 2 um.

5.3. Color Adaptability Test Results and Analysis

We placed a ceramic checkered calibration board (its total size was 50 × 50 mm, each square size was 5 × 5 mm, and surface flatness was 5 um) on the working platform of the dispensing robot. The black and white squares were used to simulate the scene of color mutation, and the adaptability of the sensor to the color of the measured object was tested.
As shown in Figure 12, we selected 11 alternate measured positions on the checkerboard for static and dynamic tests. First, the dispensing robot moved slowly to the measured positions. When the system was stable, the repeatability accuracy of each position was recorded, sequentially, in the static state. Then, the dynamic test was carried out, the dispensing robot moved at a speed of 800 mm/s, and it stopped for 30 ms at each measured position. The repeatability accuracy of each position during the short-time stay were also recorded, as shown in Table 3.
According to the results of Table 3, the dynamic measurement repeatability (1.58 um) of the sensor was very close to the static repeatability (1.42 um). This indicated that the sensor could quickly adjust to a stable working state within 30 ms under dynamic test conditions and verified that the sensor had good adaptability to the color dynamic change of the measured object.

5.4. Step Response Test Results and Analysis

Two different steps were constructed for the step response test as follows: (1) A metal gauge block (2 mm in height, 10 mm in width, and 75 mm in length) was placed on the working table of the dispensing robot to construct a step without color change. (2) Similarly, a step with color change was constructed by a white ceramic gauge block (the same size as the metal gauge block). As shown in Figure 13, based on the steps constructed, the reciprocating dynamic experiments were conducted five times. The X-Y worktable of the robot moved at a speed of 800 mm/s, and stayed for 30 ms at the starting position (Position 1) and the measured position (Position 2) on the gauge block. During this process, the sensor recorded the data at a sampling frequency of 2 KHz.
First, we investigated the step response characteristics of the sensor in the dynamic test. As shown in Figure 14, the dynamic displacement curve of the sensor could completely express the changes of the two different steps’ height information, during the five reciprocating tests. However, there were obvious noise points at the edge of the step, which resulted in a delay of 0.5 ms for the measurement, therefore, the dynamic step response delay of the sensor we developed was 0.5 ms. We considered that there were two main reasons for the delay, one was the random tremble of the dispensing robot, the other was the instantaneous distortion of the laser spot when it moved from the worktable to the gauge block.
Furthermore, we investigated the repeatability accuracy of the sensor when it reached the measured position at a quick speed and passed through the step, as shown in Table 4. The repeatability accuracies of the sensor for the metal gauge block and the ceramic gauge block were 2.7 um and 1.48 um, respectively, within 30 ms after the mechanical arm stopped, which met the needs of high-precision measurement.
To sum up, we verified the measurement repeatability and dynamic respond speed of the LTDS we proposed in various working scenarios of the dispensing robot through Z direction motion, color dynamic mutation. and step response experiments. The dynamic respond delay was 0.5 ms and the maximum repeatability error among the test scenarios was 2.7 um.

5.5. Comparison and Discussion

We added three different laser adjustment strategies for comparison, as shown in Figure 15. The laser adjustment method that only considered dynamic mode, the laser adjustment method that only considered static working mode, and the Proportional Integral Derivative (PID) control were selected, and these algorithms were implemented on a FPGA by program.
For the above different methods, we took the z direction stability, color adaptability, and step response tests, successively, under the same conditions (the measured object moved at the same speed). The measurement repeatability and dynamic response speed of each method were calculated. In addition, we defined the concept of positional noise density, σ, to comprehensively evaluate the accuracy and response speed of measurement, as shown in Equation (10).
σ = i = 1 n ( u i u ) 2 w
where u is the average measured displacement, ui is the ith measured displacement, n is the total measured data, and w is the dynamic response speed. The measurement results were compared with the method we proposed, as shown in Table 5.
First, we discuss the necessity of working mode judgement. It was obvious that high measurement repeatability and fast dynamic response speed could not be achieved at the same time in the previous method. The dynamic mode only lead to low measurement accuracy, and the dynamic response speed in high precision static mode was very slow. Our new method combined the advantages of both static and dynamic mode by auto mode judgment. Its measurement accuracy was similar to the static mode, and it had the same response speed as the dynamic mode.
In addition, compared with the relatively complex PID control algorithm, the linear adjustment method had better repeatability accuracy and faster response speed, which we considered to be caused by the operation consumption of PID algorithm on hardware.
Finally, we discuss the positional noise density, σ, for different methods. The method proposed in this paper had the lowest σ, which also indicated that it had much better performance in both accuracy and speed.
Therefore, the method proposed greatly improved the dynamic response speed while ensuring the measurement accuracy and it had good adaptability to the alternating static and dynamic working scenarios.

6. Conclusions

In this paper, a laser triangulation displacement sensor for a dispensing robot location system was developed based on the comprehensive characteristics of the actual image waveform of the laser. The “centroid position-peak intensity” relationship of static imaging waveforms of different objects was fitted by the least square method, and the optimal peak intensity was solved to eliminate the interference of different measured objects. On the basis of the centroid difference of two dynamic imaging waveforms, the static and dynamic working modes were distinguished, and the peak intensity was adjusted to the ideal interval by the linear iterative method. According to the dynamic test experiment of the dispensing robot, the step response speed of the sensor was 0.5 ms under the dynamic measurement scene, and the repeatability accuracy was 2.7 um for different measured objects. However, the repeatability of the sensor still had room for improvement. In future work, we would increase the sampling frequency to collect more data for an average filter, and research a method to quickly obtain more feature information on the imaging laser spot, in order to improve the repeatability accuracy. Moreover, the LTDS proposed in this paper can also be applied to other high-precision dynamic measurement scenarios, in addition to the dispensing robot.

Author Contributions

Conceptualization, Z.N. and W.T.; data curation, N.L.; methodology, Z.N.; software, H.Z.; writing—original draft, Z.N. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the National Natural Science Foundation of China under grant no. 51975374.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Deng, G.; Cui, W.; Zhou, C.; Li, J. A piezoelectric jetting dispenser with a pin joint. Optik 2018, 175, 163–171. [Google Scholar] [CrossRef]
  2. Tran, M.-S.; Hwang, S.-J. Design and Experiment of a Moving Magnet Actuator Based Jetting Dispenser. Appl. Sci. 2019, 9, 2911. [Google Scholar] [CrossRef] [Green Version]
  3. Lu, S.; Yao, Y.; Liu, Y.; Zhao, Y. Design and experiment of a needle-type piezostack-driven jetting dispenser based on lumped parameter method. J. Adhes. Sci. Technol. 2015, 29, 716–730. [Google Scholar] [CrossRef]
  4. Das, A.N.; Sin, J.; Popa, D.O.; Stephanou, H.E. On the precision alignment and hybrid assembly aspects in manufacturing of a microspectrometer. In Proceedings of the IEEE International Conference on Automation Science and Engineering, Arlington, VA, USA, 23–26 August 2008; pp. 959–966. [Google Scholar]
  5. Yanwei, L.; Guiling, D. The Influence of Fluid Viscosity of Fluid Jetting Dispensing. In Proceedings of the 2007 International Symposium on High Density packaging and Microsystem Integration, Shanghai, China, 26–28 June 2017; pp. 1–4. [Google Scholar]
  6. Kwon, K.S. Speed measurement of ink droplet by using edge detection techniques. Measurement 2009, 42, 44–50. [Google Scholar] [CrossRef]
  7. Wang, N.; Liu, J.; Wei, S.; Zhang, X. A Vision Location System Design of Glue Dispensing Robot. Lect. Notes Comput. Sci. 2015, 9246, 536–551. [Google Scholar]
  8. Ting, Y.; Chen, C.; Feng, H.; Chen, S. Apply Computer Vision and Neural Network to Glue Dispenser Route Inspection. In Proceedings of the 2007 International Conference on Mechatronics and Automation, Harbin, China, 5–8 August 2007; pp. 3882–3887. [Google Scholar]
  9. Donges, A.; Noll, R. Laser Triangulation. In Laser Measurement Technology: Fundamentals and Applications; Springer: Berlin/Heidelberg, Germany, 2015; pp. 247–278. [Google Scholar] [CrossRef]
  10. Wu, C.; Chen, B.; Ye, C. Detecting defects on corrugated plate surfaces using a differential laser triangulation method. Opt. Lasers Eng. 2020, 129, 106064. [Google Scholar] [CrossRef]
  11. Peng, T.; Zhang, Z.; Chen, F.; Zeng, D. Dimension Measurement and Key Point Detection of Boxes through Laser-Triangulation and Deep Learning-Based Techniques. Appl. Sci. 2020, 10, 26. [Google Scholar] [CrossRef] [Green Version]
  12. Xing-Qiang, L.; Zhong, W.; Lu-Hua, F. A Fast and in-Situ Measuring Method Using Laser Triangulation Sensors for the Parameters of the Connecting Rod. Sensors 2016, 16, 1679. [Google Scholar] [CrossRef] [Green Version]
  13. Žbontar, K.; Mihelj, M.; Podobnik, B.; Povše, F.; Munih, M. Dynamic symmetrical pattern projection based laser triangulation sensor for precise surface position measurement of various material types. Appl. Opt. 2013, 52, 2750–2760. [Google Scholar] [CrossRef] [Green Version]
  14. Jung, J.K.; Kang, S.G.; Nam, J.S.; Park, K.H. Intensity Control of Triangulation Based PSD Sensor Independent of Object Color Variation. IEEE Sens. J. 2011, 11, 3311–3315. [Google Scholar] [CrossRef]
  15. Amann, M.C.; Bosch, T.; Lescure, M.; Myllyla, R.; Rioux, M. Laser Ranging: A Critical Review of Unusual Techniques for Distance Measurement. Opt. Eng. 2001, 40, 10–19. [Google Scholar]
  16. Song, D.; Xia, D.; Wang, Z. Impact of Standard Deviation and Reflectance of the Measured Surface on Laser Diode-Position Sensitive Detector System. In MATEC Web of Conferences; EDP Sciences: Ulis, France, 2016; Volume 61, p. 06001. [Google Scholar] [CrossRef] [Green Version]
  17. Li, S.; Jia, X.; Chen, M.; Yang, Y. Error analysis and correction for color in laser triangulation measurement. Optik 2018, 168, 165–173. [Google Scholar] [CrossRef]
  18. Zhang, Z.; Feng, Q.; Gao, Z.; Kuang, C.; Fei, C.; Li, Z.; Ding, J. A new laser displacement sensor based on triangulation for gauge real-time measurement. Opt. Laser Technol. 2008, 40, 252–255. [Google Scholar] [CrossRef]
  19. Ibaraki, S.; Kitagawa, Y.; Kimura, Y.; Nishikawa, S. On the limitation of dual-view triangulation in reducing the measurement error induced by the speckle noise in scanning operations. Int. J. Adv. Manuf. Technol. 2017, 88, 731–737. [Google Scholar] [CrossRef]
  20. Da Silva Maciel, L.; Spelt, J.K. Influence of process parameters on average particle speeds in a vibratory finisher. Granul. Matter 2018, 20, 65. [Google Scholar] [CrossRef]
  21. Xu, Y.Y.; Jiang, D.H.; Ma, G.T.; Deng, Z.G.; Zheng, J.; Zhang, W.H. Dynamic Response Characteristics of a High-Temperature Superconducting Maglev Vehicle under Laterally Unbalanced Load Conditions. J. Supercond. Nov. Magn. 2014, 27, 35–39. [Google Scholar] [CrossRef]
  22. Jeong, S.; Jung, C.; Kim, C.S.; Shim, J.H.; Lee, M. Laser spot detection-based computer interface system using autoassociative multilayer perceptron with input-to-output mapping-sensitive error back propagation learning algorithm. Opt. Eng. 2011, 50, 084302. [Google Scholar] [CrossRef]
  23. Huffman, C.; Sobral, H.; Terán-Hinojosa, E. Laser-induced breakdown spectroscopy spectral feature selection to enhance classification capabilities: A t-test filter approach. Spectrochim. Acta Part B Spectrosc. 2019, 162, 105721. [Google Scholar] [CrossRef]
  24. Wang, F.; Bian, Y.; Wang, H.; Lyu, M.; Pedrini, G.; Osten, W.; Barbastathis, G.; Situ, G. Phase imaging with an untrained neural network. Light Sci. Appl. 2020, 9, 77. [Google Scholar] [CrossRef]
  25. Manzo, M.; Pellino, S. FastGCN+ARSRGemb: A novel framework for object recognition. arXiv 2020, arXiv:2002.08629. [Google Scholar]
  26. Nan, Z.; Feng, Y.; Zhao, H.; Tao, W. Research on laser source drift with temperature of laser triangular displacement sensor. In Proceedings of the Ninth International Symposium on Precision Mechanical Measurements, Chongqing, China, 18–21 October 2019; p. 1134326. [Google Scholar] [CrossRef]
  27. Assen, H.C.v.; Egmont-Petersen, M.; Reiber, J.H.C. Accurate object localization in gray level images using the center of gravity measure: Accuracy versus precision. IEEE Trans. Image Process. 2002, 11, 1379–1384. [Google Scholar] [CrossRef] [Green Version]
  28. Xian, W.; Qinwei, M.; Shaopeng, M.; Hongtao, W. A Marker Locating Method Based on Gray Centroid Algorithm and its Application to Displacement and Strain Measurement. In Proceedings of the 2011 Fourth International Conference on Intelligent Computation Technology and Automation, Shenzhen, China, 28–29 March 2011; pp. 932–935. [Google Scholar]
  29. Otepka, J.; Fraser, C. Accuracy Enhancement of Vision Metrology through Automatic Target Plane Determination. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2004, 35, 873–879. [Google Scholar]
  30. Xin, L.; Xu, L.; Cao, Z. Laser spot center location by using the gradient-based and least square algorithms. In Proceedings of the 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), Minneapolis, MN, USA, 6–9 May 2013; pp. 1242–1245. [Google Scholar]
  31. Wang, X.; Zhao, Q.; Ling, Q. Robust image processing method of laser spot center location in complex industrial environment. In Proceedings of the 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Xiamen, China, 6–9 November 2017; pp. 651–656. [Google Scholar] [CrossRef]
  32. Liu, X.; Lu, Z.; Wang, X.; Ba, D.; Zhu, C. Micrometer accuracy method for small-scale laser focal spot centroid measurement. Opt. Laser Technol. 2015, 66, 58–62. [Google Scholar] [CrossRef]
  33. Beermann, R.; Quentin, L.; Stein, G.; Reithmeier, E.; Kaestner, M. Full simulation model for laser triangulation measurement in an inhomogeneous refractive index field. Opt. Eng. 2018, 57, 114107. [Google Scholar] [CrossRef]
  34. Ciddor, P.E. Refractive index of air: 3. The roles of CO2, H2O, and refractivity virials: Erratum. Appl. Opt. 2002, 41, 7036. [Google Scholar] [CrossRef]
Figure 1. Dispensing robot location system and its measurement method.
Figure 1. Dispensing robot location system and its measurement method.
Applsci 10 07412 g001
Figure 2. Imaging waveform experiment platform. (a) Hardware platform; (b) Measured object.
Figure 2. Imaging waveform experiment platform. (a) Hardware platform; (b) Measured object.
Applsci 10 07412 g002
Figure 3. Imaging waveforms corresponding to different photosensitive imaging device (CMOS) exposure times. (a) Imaging waveforms of white diffuse reflector; (b) Imaging waveforms of black frosted reflector; (c) Relationship between peak intensity and exposure time of imaging waveform for different objects.
Figure 3. Imaging waveforms corresponding to different photosensitive imaging device (CMOS) exposure times. (a) Imaging waveforms of white diffuse reflector; (b) Imaging waveforms of black frosted reflector; (c) Relationship between peak intensity and exposure time of imaging waveform for different objects.
Applsci 10 07412 g003
Figure 4. Analysis of the relationship between peak intensity and centroid position of imaging waveform. (a) Relationship between centroid position and peak intensity of imaging waveform for different objects; (b) Fitting results of relationship between centroid position and peak Intensity.
Figure 4. Analysis of the relationship between peak intensity and centroid position of imaging waveform. (a) Relationship between centroid position and peak intensity of imaging waveform for different objects; (b) Fitting results of relationship between centroid position and peak Intensity.
Applsci 10 07412 g004
Figure 5. Dynamic imaging waveform. (a) Imaging waveform of white diffuse reflector; (b) Imaging waveform of black frosted reflector.
Figure 5. Dynamic imaging waveform. (a) Imaging waveform of white diffuse reflector; (b) Imaging waveform of black frosted reflector.
Applsci 10 07412 g005
Figure 6. Flow chart of fast waveform adjustment algorithm based on centroid difference.
Figure 6. Flow chart of fast waveform adjustment algorithm based on centroid difference.
Applsci 10 07412 g006
Figure 7. Analysis of centroid shift caused by different peak intensity. (a) Centroid difference curve; (b) Centroid difference in dynamic peak intervals; (c) Centroid difference in static peak intervals.
Figure 7. Analysis of centroid shift caused by different peak intensity. (a) Centroid difference curve; (b) Centroid difference in dynamic peak intervals; (c) Centroid difference in static peak intervals.
Applsci 10 07412 g007
Figure 8. Schematic diagram of peak intensity linear prediction.
Figure 8. Schematic diagram of peak intensity linear prediction.
Applsci 10 07412 g008
Figure 9. Experiment platform of dispensing robot. (a) Dispensing robot; (b) Different measured objects.
Figure 9. Experiment platform of dispensing robot. (a) Dispensing robot; (b) Different measured objects.
Applsci 10 07412 g009
Figure 10. Z direction reciprocating test.
Figure 10. Z direction reciprocating test.
Applsci 10 07412 g010
Figure 11. Displacement curve of the sensor when it moved in the Z direction.
Figure 11. Displacement curve of the sensor when it moved in the Z direction.
Applsci 10 07412 g011
Figure 12. Adaptability test when the color of the measured object changed suddenly.
Figure 12. Adaptability test when the color of the measured object changed suddenly.
Applsci 10 07412 g012
Figure 13. Step reciprocating dynamic test. (a) Metal gauge step dynamic test; (b) Ceramic gauge step dynamic test.
Figure 13. Step reciprocating dynamic test. (a) Metal gauge step dynamic test; (b) Ceramic gauge step dynamic test.
Applsci 10 07412 g013
Figure 14. Displacement curve of the step dynamic reciprocating test. (a) Metal block step displacement dynamic characteristic curve; (b) White ceramic block step displacement dynamic characteristic curve.
Figure 14. Displacement curve of the step dynamic reciprocating test. (a) Metal block step displacement dynamic characteristic curve; (b) White ceramic block step displacement dynamic characteristic curve.
Applsci 10 07412 g014
Figure 15. Different laser adjustment methods. (a) The method only considered dynamic mode; (b) The method only considered static mode; (c) PID laser adjustment method.
Figure 15. Different laser adjustment methods. (a) The method only considered dynamic mode; (b) The method only considered static mode; (c) PID laser adjustment method.
Applsci 10 07412 g015
Table 1. Change of centroid position and peak intensity of static and dynamic imaging waveforms.
Table 1. Change of centroid position and peak intensity of static and dynamic imaging waveforms.
Centroid Shift (Pixels)Intensity Difference (a.u.)
StaticDynamicStaticDynamic
White diffuse reflector0.02590.531249
Black frosted reflector0.03520.8641428
Table 2. Repeatability accuracy of pause positions in the Z direction reciprocating test.
Table 2. Repeatability accuracy of pause positions in the Z direction reciprocating test.
PositionMax Displacement (mm)Min Displacement (mm)Repeatability Accuracy (um)
161.026561.02511.4
252.273752.27191.8
342.004242.00340.8
452.276752.27462.1
561.026561.02491.6
Average//2.0
Table 3. Repeatability accuracy test results when measured object color changed.
Table 3. Repeatability accuracy test results when measured object color changed.
NO.1234567891011Average
Static (um)0.90.51.50.31.60.31.45.40.811.91.42
Dynamic (um)1.6111.51.52.61.21.22.72.60.51.58
Table 4. Repeatability of measured position on the gauge block in the step dynamic reciprocating test.
Table 4. Repeatability of measured position on the gauge block in the step dynamic reciprocating test.
No.Metal Gauge StepCeramic Gauge Step
Max (um)Min (um)R (um)Max (um)Min (um)R (um)
148.875348.87064.748.957948.95691
248.872748.8707248.957948.95651.4
348.872148.87061.548.957548.95591.6
448.872648.87032.348.957748.95581.9
548.873548.87043.148.958648.95711.5
Average48.873248.87052.748.957948.95641.48
Table 5. Comparison of different laser adjustment methods.
Table 5. Comparison of different laser adjustment methods.
MethodRepeatabilityDynamic Delayσ
Only dynamic mode16.2 um0.5 ms0.65 um/√Hz
Only static mode2.9 um10 ms0.38 um/√Hz
PID adjustment 10.9 um2 ms0.85 um/√Hz
The method proposed2.7 um0.5 ms0.08 um/√Hz
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Nan, Z.; Tao, W.; Zhao, H.; Lv, N. A Fast Laser Adjustment-Based Laser Triangulation Displacement Sensor for Dynamic Measurement of a Dispensing Robot. Appl. Sci. 2020, 10, 7412. https://doi.org/10.3390/app10217412

AMA Style

Nan Z, Tao W, Zhao H, Lv N. A Fast Laser Adjustment-Based Laser Triangulation Displacement Sensor for Dynamic Measurement of a Dispensing Robot. Applied Sciences. 2020; 10(21):7412. https://doi.org/10.3390/app10217412

Chicago/Turabian Style

Nan, Zhuojiang, Wei Tao, Hui Zhao, and Na Lv. 2020. "A Fast Laser Adjustment-Based Laser Triangulation Displacement Sensor for Dynamic Measurement of a Dispensing Robot" Applied Sciences 10, no. 21: 7412. https://doi.org/10.3390/app10217412

APA Style

Nan, Z., Tao, W., Zhao, H., & Lv, N. (2020). A Fast Laser Adjustment-Based Laser Triangulation Displacement Sensor for Dynamic Measurement of a Dispensing Robot. Applied Sciences, 10(21), 7412. https://doi.org/10.3390/app10217412

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop