Next Article in Journal
Research Progress of Noise in High-Speed Cutting Machining
Previous Article in Journal
RL-DOVS: Reinforcement Learning for Autonomous Robot Navigation in Dynamic Environments
Previous Article in Special Issue
Sensing and Rendering Method of 2-Dimensional Haptic Texture
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Soft Multi-Directional Force Sensor for Underwater Robotic Application

by
Rafsan Al Shafatul Islam Subad
1,
Md Mahmud Hasan Saikot
2 and
Kihan Park
1,*
1
Department of Mechanical Engineering, University of Massachusetts Dartmouth, 285 Old Westport Road, Dartmouth, MA 02747, USA
2
Department of Mechanical Engineering, Bangladesh University of Engineering and Technology, Dhaka 1000, Bangladesh
*
Author to whom correspondence should be addressed.
Sensors 2022, 22(10), 3850; https://doi.org/10.3390/s22103850
Submission received: 9 April 2022 / Revised: 17 May 2022 / Accepted: 17 May 2022 / Published: 19 May 2022
(This article belongs to the Special Issue Tactile and Force Sensors in Robotics)

Abstract

:
Tactile information is crucial for recognizing physical interactions, manipulation of an object, and motion planning for a robotic gripper; however, concurrent tactile technologies have certain limitations over directional force sensing. In particular, they are expensive, difficult to fabricate, and mostly unsuitable for underwater use. Here, we present a facile and cost-effective synthesis technique of a flexible multi-directional force sensing system, which is also favorable to be utilized in underwater environments. We made use of four flex sensors within a silicone-made hemispherical shell structure. Each sensor was placed 90 ° apart and aligned with the curve of the hemispherical shape. If the force is applied on the top of the hemisphere, all the flex sensors would bend uniformly and yield nearly identical readings. When force is applied from a different direction, a set of flex sensors would characterize distinctive output patterns to localize the point of contact as well as the direction and magnitude of the force. The deformation of the fabricated soft sensor due to applied force was simulated numerically and compared with the experimental results. The fabricated sensor was experimentally calibrated and tested for characterization including an underwater demonstration. This study would widen the scope of identification of multi-directional force sensing, especially for underwater soft robotic applications.

1. Introduction

Having the presence of a mechanoreceptor that enables sensing both the direction and the magnitude of the applied force on the fingertip instantaneously, human hands can manipulate objects and perform a variety of tasks deftly [1]. Robotic grippers analogous to human fingers nowadays are projected to handle differently shaped objects, adapting the grasp, and in addition, are able to execute their tasks in an unstructured environment [2,3,4]. Although soft robotic end effectors allow manipulators to overcome the gap between known and unexpected morphologies, operating these systems remotely with high accuracy and precision still remains a challenging problem to be addressed extensively [5,6]. Today’s typical underwater robots, for example, rely heavily on camera sensing capabilities in the visible area for detailed imaging and recording [7]; however, there exist numerous instances where an optical camera might not work properly due to the low visibility in the larger part of the underwater atmosphere. Acoustic sensors are one of the viable options for those scenarios but they are low-resolution ranging, and often provide noisy and distorted signals [8]. Tactile sensors, as a merged solution, can surely play pivotal roles in terms of sensing, controlling, and manipulating an object locally with high sensitivity and spatial resolution, especially in opaque underwater environments [9,10,11]. Moreover, targeted applications such as intact sample collections, explosive ordinance disposal (EOD) missions, repairing of unmanned underwater vehicles (UUVs), autonomous underwater vehicles (AUVs), etc., underwater require physical contact with objects [12,13,14]. In these circumstances, the integration of haptic feedback by gathering local tactile information most importantly, the identification of multi-directional force leads to an improvement in dimensional awareness and is kind of a fundamental requirement to achieve those goals [15,16]. Nowadays, commercial-grade force sensors are mostly normal force sensors. Fabrication of a soft tactile sensor capable of detecting multi-directional forces is still an active research area [17,18]. Thus, it is essential to develop a cost-effective and readily synthesizable multi-directional force sensing system that can be compared with human perception in terms of force recognition for advanced robotic manipulation.
At present, a broad range of solutions is available for tactile sensor technology depending on different types of hardware employed [19,20]; however, there are only a few studies for flexible sensors that can detect both normal and tangential forces [1]. Teshigawara et al. demonstrated a slip detection system for a multi-fingered robot using pressure-sensitive, conductive rubber [21]. The system not only distinguishes normal forces but also offers information about shear forces and slippage. Harada et al. presented an approach of utilizing resistivity to recognize touch, and slip/friction in their study [22]; however, their sensor was limited to a tactile force in one direction because of the difficulties fabricating devices on flexible substrates. Lee et al. demonstrated a flexible tactile sensor array based on the principle of capacitor with the capability of measuring both normal and shear force [23]. They used polydimethylsiloxane (PDMS) for the sensor structure and it can measure up to 131 kPa in three directions. Huang et al. and Zhang et al. also made use of a similar capacitive methodology to evaluate multi-directional forces in their studies [24,25]. Yu et al. [26] also presented a flexible tactile sensor array based on polyvinylidene fluoride (PVDF) film for measuring three-axis dynamic contact force distribution. They took advantage of similar type of sensor design and structure used in the study [23] but adopted piezoelectricity instead of capacitance as sensing mechanism. Viry et al. used conductive textile for their sensor fabrication which can detect both normal and tangential forces [27]. Alfadhel et al. introduced a magnetic nanocomposite artificial cilia implemented on magnetic microsensors for braille reading [28]. The sensor can detect both vertical and shear forces. Yuan et al. proposed a technique of vision-based optical tactile sensing of the normal, shear, and torsional load on the contact surface with a GelSight tactile sensor [29]. The system essentially measures geometry, with very high spatial resolution, which helps it to identify incipient slip as well. Recently, Wolterink et al. presented a 3D-printed piezoresistive shear and normal force sensor that can measure up to 10 N force on a fingertip phantom placed inside the sensing structure [30]. Goh et al. and Hu et al. proposed flexible and wearable pressure sensors based on the triboelectric principle [31,32]. They designed their respective sensors focusing on implementing them for a human–machine interface. He et al. also developed a piezoelectric tactile sensor array based on electrospinning and mixture process with flexible (PZT nanowires) composite films and polydimethylsiloxane (PDMS) materials claiming the potential applications of the sensor in bionics, robotics, and human–machine interaction [33]. Guo et al. demonstrated a flexible capacitive pressure sensor based on a poly(vinylidenefluoride-co-trifluoroethylene) [P(VDFTrFE)] dielectric film, a promising candidate to be employed in smart robotic skins and human–machine interfaces [34]. However, all of these sensors described can pragmatically catch forces up to two degrees of freedom, and the authors have not reported any prospects for their sensors to be utilized in an underwater environment. Brien et al. demonstrated a polyvinylidene difluoride (PVDF)-based slip sensing system to distinguish the occurrence of slippage between the fingertip and the target object and set up for use in a dexterous underwater gripper [35]. Nonetheless, most multi-directional force sensors are not capable of capturing an arbitrary force in the 3D space and only a few of them are suitable for underwater soft robotic applications.
In this paper, we propose a simple and cost-effective fabrication technique for a flexible multi-directional force sensing system. We employed four flex sensors and silicone molds to build a hemispherical shell-type sensor structure. The flex sensors are placed at 90 ° angles with one another along the circumference and aligned with the curve of the hemispherical shape. When a normal force is exerted on the top of the hemisphere, all of the flex sensors would bend homogeneously and yield nearly similar reading changes. On the other hand, when force is applied from a different direction on the sensor, flex sensors on that side of the shell would bend the most and provide unlike reading changes and distinguishable characteristic patterns. Since the flex sensors are embedded in the mold they are inherently waterproof. Thus, the fabricated sensor can be useful for an underwater soft robotic application while deciphering 3-DOF (degrees of freedom) contact forces.

2. Design of the Sensor Structure

Figure 1 illustrates the schematic diagram for the conceptual design of a multi-directional force sensing system with its working principle. When a normal force is exerted on the top of the sensor (90 ° latitude), the bending pattern of all the flex sensors would be the same while they would be different when the force is coming from other directions than normal and positions other than 90 ° latitude. Since the outputs from the flex sensor change based on the amount of its bending, distinctive patterns would be obtained for different directional forces applied on the sensor.
In order to develop the multi-directional force sensing system, four flex sensors are embedded in molded silicone (Dragon Skin Fx Pro (DSFP), Reynolds Advanced Materials, Boston, MA, USA) as demonstrated in Figure 1. We intend to integrate the sensor with our previously built soft robotic gripper [36]. Thus, the outer shell diameter is kept at 24 mm considering our soft robotic gripper finger thickness of 25 mm. In addition, the inner shell diameter is 12 mm so the sensor structure would be firm enough to handle a decent amount of force (5 N in our case) but not be too stiff to respond to a small range of force (0–5 N). Flex sensors are placed on an imaginary reference circle with a diameter of 20 mm so that they obtain a satisfactory amount of bending upon force while maintaining an adequate outer layer for waterproofing; however, it is to be mentioned that there is a decent amount of flexibility in choosing the materials and the dimensions of the sensor. They can be altered based on the applications of the sensor in real life.

3. Sensor Fabrication Process

In order to fabricate the sensor, two molds having different patterns (see Figure S1 in the Supplementary Information (SI)) have been generated in 3D modeling software and printed by a stereolithography (SLA) 3D printer (Form 3, Formlabs, Somerville, MA, USA). Four flex sensors (FS-L-0055-253-ST, Spectra Symbol, Salt Lake City, UT, USA) are cut into small pieces, 11.5 mm in length, so that they do not overlap with one another while molded inside the sensor structure. Overlapping of the sensors hampers obtaining distinctive output patterns and makes it complex to identify the nature of the force being applied. Clincher connectors are added to the flex sensors to solder them with the inserted thin wires shown in Figure 2a. Then, the flex sensors are clipped with the inner portion of the outer layer of pattern 1 before molding, as shown in step (v) of Figure 2b. Then, two parts of silicone (Part A and Part B) of DSFP are mixed at 1:1 proportion and poured into pattern 1 (Figure 2b(vi)). Properties of the silicone material are provided in Table S1 (Supplementary Information). A small amount of silicone tactile mutator (Slacker, Reynolds Advanced Materials, Boston, MA, USA) was added to the mold to make it softer and more flexible. The materials are chosen such that they can withstand but deform well within their elastic limit in response to a small amount of force (0–5 N). Due to the attached steel connector at the bottom of each flex sensor, there remained a thin space in between the flex sensor and the outer shell of pattern 1 even after clipping (Figure 2b(v)). This creates a thin outer layer of silicone over the flex sensor (Figure 2b(vi)), which keeps them in position aligned with the curvature of the shell when the silicone is cured and the clips are detached from the mold. Afterward, the silicone is cured for 1 hour at room temperature, and subsequently, the pattern is broken down to obtain the base structure of the sensor (Figure 2b(vii)). Next, the silicone mixture is poured almost half full into the hemispherical shaped pattern 2 and kept there for some time (5–10 min) to be cured a little. Then, the previous mold is placed in it (Figure 2c(viii)). Due to the gravity, the mold goes down but the slightly cured and highly viscous silicone keeps it floating. Thus, approximately 3–4 mm of the outer layer is formed over the flex sensors (Figure 2c(ix)). Finally, the inner mold is removed (Figure 2c(x)) and the sensor structure is punched out from the hemispherical pattern 2 (Figure 2c(xi)). Schematic illustrations for the fabrication process are demonstrated in Figure 2 and photos for the fabrication process are also shown in Figure S2 in the Supplementary Information section. It is to be mentioned that the choice of materials and dimensions solely depends upon the applications of the force sensor. The related fabrication processes such as choice of silicone grade, silicone mixing ratio, the addition of mutator, curing time, etc., may vary from this specific case.

4. Results and Discussions

4.1. Force Calibration

Commercially available indentation equipment (AGS-X, Shimadzu, Kyoto, Japan) with a 10 N force gauge and a 10 mm diameter indenter was used to calibrate the fabricated sensor. Since the equipment is capable of indenting in the vertical direction only, the fabricated sensor was aligned and fixed in a position to apply forces on desired locations precisely. Figure 3 shows the force calibration setup for the fabricated tactile sensor.
As discussed in the conceptual working principle of the sensor, all the flex sensors would bend in a similar fashion as the normal force exerted on the top of the shell. Figure 4 demonstrates the response of the sensor for the normal force along z-axis and validates the claim. A simple voltage divider circuit was used to obtain the output reading data from the flex sensors in addition to Savitzky–Golay finite impulse response filter for a smooth data representation [37]. As the internal pressure in the hemispherical shell structure builds up due to the applied force, the flex sensors start to bend and their respective resistance values vary. Although the reading change in each of the sensors is different than others due to their dissimilar sensitivity and proper placement limitation during the fabrication, the pattern of change shows the same trend. It is important to indicate that the sensor structure is observed to encounter plastic deformation for a force of little over 6 N (Figure S3 in the Supplementary Information). Thus, it is safe to keep the force range between (0–5) N to make sure the deformation of the sensor is within the elastic limit of the sensor materials.
We also investigated the effect of exerting other directional forces along the x- and y-axis in both positive and negative directions and along the lines with ±45 ° increments from the x- and y-axis. The effect of applying forces along ±x- ±y-direction, and the lines with ±45 °  from the x- and y-axis are illustrated in Figure 5 and Figure 6, respectively. From the figures, the output voltage values increase when putting force on the sensor parallel to xy-plane, which is quite the opposite to what happens when a normal force is applied on the sensor along the z-axis. It can be explained by the fact that force on the sensor parallel to the xy-plane would straighten the flex sensors proximal to the force exerting location as illustrated in Figure 1c. The phenomenon is theoretically equivalent to bending the flex sensors in opposite direction (Figure 7b). Thus, the relative voltage increases as the force is being exerted on the sensor parallel to the xy-plane.
Figure 5 demonstrates that the only flex sensor which is happened to be placed in line with the force along ±x- or ±y-axis and in the vicinity to the force exertion position shows the significant reading change while force being applied on the ±x- and ±y-axis. The pattern can be utilized to check whether the force is being exerted exactly on the ±x- or ±y-axis or not. It can also be evaluated from the figures that the rates of change for certain flex sensors’ data are sharp compared to the following cases where forces are applied at an angle of ±45 °  from the x- and y-axis. The reason can be elucidated by the fact that considerably greater stress is generated in these cases due to the presence of flex sensors aligned with the x- and y-axis, and straightening of the flex sensor occurs quickly.
Figure 6 represents the impact of applying force along the lines with ±45 ° from the x- and y-axis. Forces have been applied to a position in-between two flex sensors at 30 ° latitude in parallel to the xy-plane as mentioned in the simulation section. The trend of sensor responses in this scenario is quite distinctive in nature. Among four, the readings of two flex sensors positioned at the proximity of the force diverge from the other two. The force exertion effect is almost similar to the previous cases where a force is applied along the x- and y-axis; however, the sensor response is depreciated compared to the previous cases. This is because the force is not applied directly to the flex sensors in this case and the straightening of the flex sensors takes place more gently and so does the change in the readout. This distinguishable pattern can also help assess the force location on the sensor. It is to be noted that there is a minimum limit on the size of the object that the sensor can detect precisely. If the object is too thin or sharp, the sensor might not behave properly. In that case, the object might penetrate through the sensor because of the softness of the silicone material. Another scenario would be the flex sensors not bending as discussed while the force being exerted as a normal force on the hemisphere (along the z-axis) or in between two flex sensors (along ±45 ° angle with x- or y-axis in xy-plane) because force is required to apply on a minimum area to bend the desired flex sensors for defined forces. The object size must be more than a certain limit to obtain a consistent readout from the sensor. In this study, we have considered a 10 mm diameter object for applying the forces and calibrating the sensor. The effective force detection range of the sensor may vary with the alteration of the size of the object. If the object size changes, one has to calibrate the sensor accordingly. It can be regarded as one of the limitations of the sensor.
Finally, we estimated force magnitude from the sensor data by employing a calibration matrix equation. The calibration matrix equation can be generated as follows:
[ S ] n × 4 × [ A ] 4 × 3 = [ F ] n × 3
where,
[ S ] = sensor data;
[ A ] = compliance matrix;
[ F ] = force data;
n = no. of data points.
Sensor data can be split into four columns for four flex sensors and force matrix into three i.e., F x , F y , and F z ; however, we applied force along the lines of ±45 ° from the x- and y-axis, which made F x and F y be the same value. Hence, we consider only F x y in order to plot graphs instead of using F x and F y for those cases. During the calibration, we find the sensor outputs against the known force values. From those data, we calculate the left inverse (pseudo-inverse) of matrix [ A ] , which is:
[ A ] 4 × 3 = [ S ] 4 × n 1 × [ F ] n × 3
Next, with the stored compliance matrix data [ A ] , we evaluate the force value for given sensor data. The comparison results between the estimated force and the actual force values for three sample cases are depicted in Figure 8. In the case of loading along the x-axis, force estimation slightly under-predicts the actual case while somewhat over-predicts for the applied forces along the z-axis, and line with ±45 ° from the x- and y-axis. Here, the [ A ] matrix is comprised of only one set of data during calibration, which makes it susceptible to over-predict, or under-predict the force values. Although the evaluated forces show a little deviation from the actual case, they reasonably can predict the force values given the sensor data. Collecting a significant amount of data from the sensor for numerous force values and locations, and applying machine learning could possibly be another way to obtain a more robust [ A ] matrix and implement that to predict the force values more accurately and precisely.

4.2. Simulation

The deformation of the hemispherical shell structure was evaluated using the finite element method (FEM) in the commercial software, ANSYS Mechanical by Ansys Inc., Canonsburg, PA, USA. To simulate the real system, the hemispherical geometry was constructed, including the flex sensors and steel plates with soldering. The hemisphere and flex sensor dimensions were maintained exactly the same as the fabricated sensor; however, to keep the geometry relatively simple, an equivalent area on top of the flex sensor was considered for steel plate and soldering material combined. The geometry is shown in Figure 9a(i). All the material properties were assigned to the respective geometries. The material properties for the DSFP was gathered from the manufacturer’s datasheet [38]. The originally calculated Young’s modulus for DSFP was considered to be reduced by about 60% after mixing the silicone tactile mutator [39], which further softens the silicone rubber. In the case of flex sensor material properties, reasonable assumptions were made. The geometry was then meshed using unstructured mesh (Figure 9a(ii)) to perform the simulations. The ANSYS Mechanical solver utilizes the following overall equilibrium equations for linear structural static analysis [40]:
[ K ] { u } = { F a } + { F r }
where,
K = total stiffness matrix= m = 1 N K e ;
K e = element stiffness matrix;
N = number of elements;
{ u } = nodal displacement vector;
{ F r } = reaction load vector;
{ F a } = total applied load vector.
Finally, the boundary conditions were set according to the experimental setup. The sensor base was kept fixed while forces were applied on a circular area of 10 mm diameter to replicate the force from the indenter in the experimental setup. Multi-directional forces were applied to the sensor in the experiments. The forces from two latitudes that were in the same directions described in the force calibration were considered for the simulations: (i) normal to the equator on the top pole of the hemisphere (latitude 90 ° ) and (ii) parallel to the equator near the base of the hemisphere (latitude 30 ° ). Figure 9b depicts the applied force directions for both of the cases. At latitude 30 ° , forces parallel to the equator were applied on two positions: (i) in between two flex sensors and (ii) on one of the flex sensors. Only one force was considered at a time for all the simulations, creating three separate cases. The simulations were run to find out the deformation caused by the forces applied. Figure 9c shows the resulting deformations by a force of 5 N in both directions.
The force–deformation graphs for forces in the range of 0.5–5 N were generated from the simulations for all three cases, and each case was compared with the experimental results. The comparison as well as the applied force position and direction for each case are illustrated in Figure 10. Figure 10a depicts deformation due to normal force at 90 ° latitude while Figure 10b,c show deformation for two forces, one between two flex sensors and the other on one of the flex sensors, both at 30 ° latitude. From the figure, it could be concluded that the simulated model can predict the deformation of the shell with considerable accuracy. The simulations could be more accurate with more precise material properties for each of the materials. The small deviations from the experimental results could also be explained by imperfect fabrication resulting in slight changes in the geometry and symmetry. It could also be observed from Figure 10 that the forces applied in the experiments were within the elastic limit of the soft sensor.

4.3. Repeatability Test

In addition to the fundamental physical properties of the tactile force sensor, precision is one of the most important factors in determining sensor performance [41]. In order to check the repeatability of the sensor readings, we acquired the dataset from the three different cases of applied force ((a) along the z-axis, (b) along the x- and y-axis, and (c) along the lines with 45 ° from the x-axis) with three separate trials per case. The same indentation technique was adopted for multi-direction force to check the repeatability test. Figure S4 and Figure 11 demonstrate the repeatability test results for individual trial and combined cases accordingly. Since the sensor structure is hemispherical, the sensor response for other force directions parallel to the xy-plane can be regarded as interchangeable. It can be seen from the figure that the trend of the sensor responses for a specific directional loading are quite consistent excluding minute deviations. In response to the normal force along the z-axis, sensor outputs always go down as the force increases. Particular sensor output (here, F4) on which the force being exerted shows the substantial reading change for force along the y-axis case. In addition, two of the sensors (here, F1 and F4) manifest a similar pattern of rising when forces are acting in between them. Ideally, F1 and F4 should show the identical readings while a force is being applied exactly at the 45 ° angle in-between them; however, there are discrepancies from the theory due to the limitation of the fabrication method of placing each of the flex sensors perfectly in the alignment with one another and the different sensitivity of the individual flex sensor. Nonetheless, their patterns of change are identical irrespective of samples and trials. It corroborates the quality of the coherence of the sensor.

4.4. Cyclic Loading and Hysteresis Test

To determine whether there would be any hysteresis in the sensor after some loading cycle, we conducted another experiment in which a cyclic normal force is applied along the z-axis on the sensor up to 5 N and then kept at that state roughly for 30 s. Subsequently, force is released and maintained at zero for a while before the next period begins. The cycle is continuously replicated 10 times manually. The sensor output over the ten cycles for the cyclic loading on the sensor is demonstrated in Figure 12a. The corresponding force–displacement graph for the hysteresis test is shown in Figure 12b, where the average and the standard deviation of force values over the ten cycles of the cyclic loading for a certain displacement are represented. Additionally, force–displacement curves for all the ten cycles are presented in Figure S5 in the Supplementary Information. The maximum discrepancy measured during the loading–unloading cycle is found to be 0.52 N in average at 2.5 mm displacement which is 10.4% of the force range, 5 N. The area of the the hysteresis loop is 1.2 × 10 3 J in average (16.5% of the elastic energy stored during the loading cycle) which refers to the amount of energy dissipated during a cycle. It is to be mentioned that the loading data are machine tabulated and unloading ones are taken manually, which causes a greater standard deviation during the unloading cycle of the test (Figure 12b). As discussed in the previous sections, the sensor is working pragmatically within the elastic limit of the material DSFP. It can be elucidated from Figure 12 that the sensor is fairly robust against and does not encounter significant hysteresis since the area within the hysteresis loop is small and the initial values of the sensors do not diverge and can be regenerated even after a certain period of cyclic loading. These imply the prospects of the fabricated sensor for further investigation and the possibility of employing it in industrial use as well as research purposes.

4.5. Localization of Point of Contact

We consider single-point force measurement in order to configure the applied force location on the sensor. For simplicity in the calculation, we take the projection of the hemisphere on the xy-plane and divide it into the 3 × 3 grid. We place an index on each grid according to its row and column number (see Figure S6 in SI). Based on the trend of the flex sensors data, we specify the grid to be activated in response to the force. First, we form a row matrix for all the flex sensors and set the value of each item to zero. Next, we define a threshold value for all the flex sensors to pass. Readings from the flex sensors for applied force are fed, and if certain sensor reading passes the threshold, the flex sensor value would convert from zero to one in the row matrix. In that way, we would obtain a definite row matrix for each of the cases. In addition, utilizing the matrix, a decision for activating a specific grid can be taken. A table (see Table S2 in SI) has been provided in the Supplementary Information regarding the row matrix and grid activation. Figure 13 illustrates the response of the sensor for different forces and corresponding applied force locations on the sensor. It is to be noted that there has to be a certain amount of load on the sensor to pass the predefined threshold value and to specify the location of the force; however, we aim to implement a machine learning algorithm to better assess the trend of the readings from the flex sensors for different types of loading in various locations to increase the identification responsiveness of the force location as well as to better quantify their directions in three dimensions in the future scope of our study.

4.6. Underwater Test

The sensor system is inherently waterproofed since the flex sensors used here are embedded in the molded silicone. In order to verify the claim, we consider testing the sensor underwater in the lab. We kept the sensor underwater (depth less than 0.5 m) for around 30 min and tested its signal. The sensor can provide signals against exerted force while remaining underwater. Figure 14 exhibits the process we carried out our test and the time-dependent sensor response for the applied force along the ±x- and ±y-direction in the sensor system coordinate. A real-time video in the supplementary section is available to demonstrate the underwater test. The successful underwater test indicates its potential applicability for underwater exploitation. According to the International Standard (ISO 20653), the IP67 standard means that the tested object is dust-tight and can go through temporary submersion without the water causing any harmful effects [42,43,44]. Our sensor has been tested underwater, and it could reasonably achieve the IP67 level protection for now. Since we intend to utilize the sensor with our lab-made soft robotic gripper [36] for underwater manipulation, we are actively working on the modification of the fabrication methodology and enhancing the performance of the sensor for underwater applications. We are also trying to make the sensor more robust against water so that it can go through continuous submersion to achieve the IP68 standard.

5. Conclusions

In recapitulation, we have designed and fabricated a flex sensor-based multi-directional force sensing system employing a simple and low-cost methodology. The force sensing system can effectively detect and estimate forces from multiple directions. A single point of contact on the sensor has been identified on a two-dimensional 3 × 3 grid. The sensor outputs were repeatable for multi-directional forces without noticeable hysteresis detected during the cyclic loading test. Moreover, the sensor showed its waterproofness as the feasibility of potential usages in underwater applications. So far, we have reasonably estimated the protection level of the sensor to be comparable to the IP67 standard, and are working on its enhancement. These favorable results signify the promising outlook of the sensor to be implemented in soft robotics, manufacturing industries, research purposes specially in biological sampling in an underwater environment, and so on.
The future direction of the study would be to map the sensor against the force by employing a machine learning algorithm so that it can generate a force vector (including the direction, magnitude, and location) in real-time in response to a general force applied on the sensor. We also plan to integrate the sensor with our previously built soft robotic gripper [36] to check its applicability for tactile information gathering, especially in an underwater environment. Moreover, employing other types of smart materials such as electroactive polymers (EAP) or piezoelectric materials to fabricate a multi-directional soft force sensor with competitive sensitivity would be another possible direction of the study.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/s22103850/s1.

Author Contributions

Conceptualization, R.A.S.I.S. and K.P.; methodology, R.A.S.I.S.; experimental setup, R.A.S.I.S.; data collection and analysis, R.A.S.I.S.; simulation and visualization, M.M.H.S.; investigation, R.A.S.I.S. and M.M.H.S.; writing—original draft preparation, R.A.S.I.S. and M.M.H.S.; writing—review and editing, R.A.S.I.S., M.M.H.S. and K.P.; supervision, K.P.; funding acquisition, K.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research work is supported by UMass Dartmouth’s Marine and Undersea Technology (MUST) Research Program funded by the Office of Naval Research (ONR) under Grant No. N00014-20-1-2170.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All data are available upon request.

Acknowledgments

The authors of this paper would like to acknowledge the Department of Mechanical Engineering and the Department of Bioengineering at the University of Massachusetts Dartmouth for providing the lab facilities to carry out the experiments and Dapeng Li for his guidance for calibrating the sensor using the Shimadzu AGS-X Tester.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Beccai, L.; Lucarotti, C.; Totaro, M.; Taghavi, M. Soft robotics mechanosensing. In Soft Robotics: Trends, Applications and Challenges; Springer: New York, NY, USA, 2017; pp. 11–21. [Google Scholar]
  2. Kim, S.; Laschi, C.; Trimmer, B. Soft robotics: A bioinspired evolution in robotics. Trends Biotechnol. 2013, 31, 287–294. [Google Scholar] [CrossRef]
  3. Whitesides, G.M. Soft robotics. Angew. Chem. Int. Ed. 2018, 57, 4258–4273. [Google Scholar] [CrossRef]
  4. Shintake, J.; Cacucciolo, V.; Floreano, D.; Shea, H. Soft robotic grippers. Adv. Mater. 2018, 30, 1707035. [Google Scholar] [CrossRef] [Green Version]
  5. Pfeifer, R.; Lungarella, M.; Iida, F. The challenges ahead for bio-inspired’soft’robotics. Commun. ACM 2012, 55, 76–87. [Google Scholar] [CrossRef]
  6. Laschi, C.; Rossiter, J.; Iida, F.; Cianchetti, M.; Margheri, L. Soft Robotics: Trends, Applications and Challenges; Springer: New York, NY, USA, 2017. [Google Scholar]
  7. Jaffe, J.S. Underwater optical imaging: The past, the present, and the prospects. IEEE J. Ocean. Eng. 2014, 40, 683–700. [Google Scholar] [CrossRef]
  8. Hidalgo, F.; Bräunl, T. Review of underwater SLAM techniques. In Proceedings of the 2015 6th IEEE International Conference on Automation, Robotics and Applications (ICARA), Queenstown, New Zealand, 17–19 February 2015; pp. 306–311. [Google Scholar]
  9. Aggarwal, A.; Kirchner, F. Object recognition and localization: The role of tactile sensors. Sensors 2014, 14, 3227–3266. [Google Scholar] [CrossRef] [Green Version]
  10. Martinez-Hernandez, U. Tactile sensors. In Scholarpedia of Touch; Springer: New York, NY, USA, 2016; pp. 783–796. [Google Scholar]
  11. Aggarwal, A.; Kampmann, P.; Lemburg, J.; Kirchner, F. Haptic Object Recognition in Underwater and Deep-sea Environments. J. Field Robot. 2015, 32, 167–185. [Google Scholar] [CrossRef]
  12. Marani, G.; Choi, S.K.; Yuh, J. Underwater autonomous manipulation for intervention missions AUVs. Ocean Eng. 2009, 36, 15–23. [Google Scholar] [CrossRef]
  13. Yoerger, D.R.; Bradley, A.M.; Jakuba, M.; German, C.R.; Shank, T.; Tivey, M. Autonomous and remotely operated vehicle technology for hydrothermal vent discovery, exploration, and sampling. Oceanography 2007, 20, 152–161. [Google Scholar] [CrossRef] [Green Version]
  14. Kalwa, J.; Pascoal, A.; Ridao, P.; Birk, A.; Eichhorn, M.; Brignone, L.; Caccia, M.; Alves, J.; Santos, R. The European R&D-Project MORPH: Marine robotic systems of self-organizing, logically linked physical nodes. IFAC Proc. Vol. 2012, 45, 226–231. [Google Scholar]
  15. Aiguo, S.; Liyue, F. Multi-dimensional force sensor for haptic interaction: A review. Virtual Real. Intell. Hardw. 2019, 1, 121–135. [Google Scholar]
  16. Kappassov, Z.; Corrales, J.A.; Perdereau, V. Tactile sensing in dexterous robot hands. Robot. Auton. Syst. 2015, 74, 195–220. [Google Scholar] [CrossRef] [Green Version]
  17. Templeman, J.O.; Sheil, B.B.; Sun, T. Multi-axis force sensors: A state-of-the-art review. Sens. Actuators A Phys. 2020, 304, 111772. [Google Scholar] [CrossRef]
  18. Liu, Y.; Bao, R.; Tao, J.; Li, J.; Dong, M.; Pan, C. Recent progress in tactile sensors and their applications in intelligent systems. Sci. Bull. 2020, 65, 70–88. [Google Scholar] [CrossRef] [Green Version]
  19. Zou, L.; Ge, C.; Wang, Z.J.; Cretu, E.; Li, X. Novel tactile sensor technology and smart tactile sensing systems: A review. Sensors 2017, 17, 2653. [Google Scholar] [CrossRef]
  20. Subad, R.A.S.I.; Cross, L.B.; Park, K. Soft Robotic Hands and Tactile Sensors for Underwater Robotics. Appl. Mech. 2021, 2, 356–382. [Google Scholar] [CrossRef]
  21. Teshigawara, S.; Tsutsumi, T.; Shimizu, S.; Suzuki, Y.; Ming, A.; Ishikawa, M.; Shimojo, M. Highly sensitive sensor for detection of initial slip and its application in a multi-fingered robot hand. In Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China, 9–13 May 2011; pp. 1097–1102. [Google Scholar]
  22. Harada, S.; Kanao, K.; Yamamoto, Y.; Arie, T.; Akita, S.; Takei, K. Fully printed flexible fingerprint-like three-axis tactile and slip force and temperature sensors for artificial skin. ACS Nano 2014, 8, 12851–12857. [Google Scholar] [CrossRef]
  23. Lee, H.K.; Chung, J.; Chang, S.I.; Yoon, E. Normal and shear force measurement using a flexible polymer tactile sensor with embedded multiple capacitors. J. Microelectromech. Syst. 2008, 17, 934–942. [Google Scholar]
  24. Huang, Y.; Yuan, H.; Kan, W.; Guo, X.; Liu, C.; Liu, P. A flexible three-axial capacitive tactile sensor with multilayered dielectric for artificial skin applications. Microsyst. Technol. 2017, 23, 1847–1852. [Google Scholar] [CrossRef]
  25. Zhang, H.; Wang, M.Y. Multi-axis soft sensors based on dielectric elastomer. Soft Robot. 2016, 3, 3–12. [Google Scholar] [CrossRef]
  26. Yu, P.; Liu, W.; Gu, C.; Cheng, X.; Fu, X. Flexible piezoelectric tactile sensor array for dynamic three-axis force measurement. Sensors 2016, 16, 819. [Google Scholar] [CrossRef] [Green Version]
  27. Viry, L.; Levi, A.; Totaro, M.; Mondini, A.; Mattoli, V.; Mazzolai, B.; Beccai, L. Flexible three-axial force sensor for soft and highly sensitive artificial touch. Adv. Mater. 2014, 26, 2659–2664. [Google Scholar] [CrossRef] [Green Version]
  28. Alfadhel, A.; Khan, M.A.; de Freitas, S.C.; Kosel, J. Magnetic tactile sensor for braille reading. IEEE Sens. J. 2016, 16, 8700–8705. [Google Scholar] [CrossRef] [Green Version]
  29. Yuan, W.; Dong, S.; Adelson, E.H. Gelsight: High-resolution robot tactile sensors for estimating geometry and force. Sensors 2017, 17, 2762. [Google Scholar] [CrossRef] [Green Version]
  30. Wolterink, G.; Sanders, R.; van Beijnum, B.J.; Veltink, P.; Krijnen, G. A 3D-Printed Soft Fingertip Sensor for Providing Information about Normal and Shear Components of Interaction Forces. Sensors 2021, 21, 4271. [Google Scholar] [CrossRef]
  31. Goh, Q.L.; Chee, P.; Lim, E.H.; Liew, G.G. Self-powered pressure sensor based on microfluidic triboelectric principle for human–machine interface applications. Smart Mater. Struct. 2021, 30, 075012. [Google Scholar] [CrossRef]
  32. Hu, Z.; Wang, J.; Wang, Y.; Wang, C.; Wang, Y.; Zhang, Z.; Xu, P.; Zhao, T.; Luan, Y.; Liu, C.; et al. A Robust and Wearable Triboelectric Tactile Patch as Intelligent Human-Achine Interface. Materials 2021, 14, 6366. [Google Scholar] [CrossRef]
  33. He, J.; Guo, X.; Yu, J.; Qian, S.; Hou, X.; Cui, M.; Yang, Y.; Mu, J.; Geng, W.; Chou, X. A high-resolution flexible sensor array based on PZT nanofibers. Nanotechnology 2020, 31, 155503. [Google Scholar] [CrossRef]
  34. Guo, Y.; Gao, S.; Yue, W.; Zhang, C.; Li, Y. Anodized aluminum oxide-assisted low-cost flexible capacitive pressure sensors based on double-sided nanopillars by a facile fabrication method. ACS Appl. Mater. Interfaces 2019, 11, 48594–48603. [Google Scholar] [CrossRef]
  35. O’Brien, D.; Lane, D. Force and explicit slip sensing for the AMADEUS underwater gripper. Int. J. Syst. Sci. 1998, 29, 471–483. [Google Scholar] [CrossRef]
  36. Cross, L.; Subad, R.; Park, K. Multi-modal Sensing Soft End-Effector for Underwater Applications. Adv. Robot. Mech. Eng. 2022, 3, 377–389. [Google Scholar]
  37. Schafer, R.W. What is a Savitzky-Golay filter? [Lecture notes]. IEEE Signal Process. Mag. 2011, 28, 111–117. [Google Scholar] [CrossRef]
  38. Dragon Skin FX-Pro. Available online: https://www.smooth-on.com/tb/files/DRAGON_SKIN_FX_PRO_TB.pdf (accessed on 24 March 2022).
  39. Slacker. Available online: https://www.smooth-on.com/products/slacker/. (accessed on 24 March 2022).
  40. ANSYS Mechanical APDL Theory Reference; ANSYS Inc.: Canonsburg, PA, USA, 2013; Chapter 15; pp. 761–762.
  41. Honda, S.; Zhu, Q.; Satoh, S.; Arie, T.; Akita, S.; Takei, K. Textile-based flexible tactile force sensor sheet. Adv. Funct. Mater. 2019, 29, 1807957. [Google Scholar] [CrossRef]
  42. Zhou, Y.; Cong, L.; Peng, L.; Zhou, Y.; Zhang, Y.; Yun, X. System and method of drip test device for testing waterproof performance of large equipment. In IOP Conference Series: Earth and Environmental Science; IOP Publishing: Bristol, UK, 2021; Volume 631, p. 012025. [Google Scholar]
  43. Lu, Z.; Zhai, J.; Qian, J. Road vehicles—Protection level (IP code)—Protection of electrical equipment against foreign objects, water and contact. Environ. Technol. 2008, 29, 40–47. [Google Scholar]
  44. Łukjanow, S.; Zieliński, W. A concept of the assessment of Electric Vehicles’ Operational Safety (EVOS). In IOP Conference Series: Materials Science and Engineering; IOP Publishing: Bristol, UK, 2016; Volume 148, p. 012058. [Google Scholar]
Figure 1. Schematic diagram of the (a) sensor structure, and working principle of the multi-directional force sensing system against (b) normal and (c) shear force; red arrows depict applied force directions.
Figure 1. Schematic diagram of the (a) sensor structure, and working principle of the multi-directional force sensing system against (b) normal and (c) shear force; red arrows depict applied force directions.
Sensors 22 03850 g001
Figure 2. Schematic diagram of the step-by-step fabrication process of the flex sensor-based multi-directional force sensing system: (a) flex sensor preparation; (b) placing the flex sensors inside the mold; (c) creating a thicker outer layer over the flex sensors.
Figure 2. Schematic diagram of the step-by-step fabrication process of the flex sensor-based multi-directional force sensing system: (a) flex sensor preparation; (b) placing the flex sensors inside the mold; (c) creating a thicker outer layer over the flex sensors.
Sensors 22 03850 g002
Figure 3. Force calibration setup for the multi-directional tactile sensor: (a) force along z-axis and (b) force exerted from the different directions of xy-plane.
Figure 3. Force calibration setup for the multi-directional tactile sensor: (a) force along z-axis and (b) force exerted from the different directions of xy-plane.
Sensors 22 03850 g003
Figure 4. Force calibration against the normal force on the top of the hemispherical sensor; top view of the sensor system is shown, where four flex sensors are numbered as F1, F2, F3, and F4 accordingly. The green dot represents the force direction along z-axis into the page.
Figure 4. Force calibration against the normal force on the top of the hemispherical sensor; top view of the sensor system is shown, where four flex sensors are numbered as F1, F2, F3, and F4 accordingly. The green dot represents the force direction along z-axis into the page.
Sensors 22 03850 g004
Figure 5. Force calibration against forces on the sides (specifically on the inserted flex sensors) of the hemispherical sensor (at 30 ° latitude), along (a) x-axis, (b) -y-axis, (c) -x-axis, and (d) y-axis; top view of the sensor system is illustrated and the green arrow depicts the applied force directions.
Figure 5. Force calibration against forces on the sides (specifically on the inserted flex sensors) of the hemispherical sensor (at 30 ° latitude), along (a) x-axis, (b) -y-axis, (c) -x-axis, and (d) y-axis; top view of the sensor system is illustrated and the green arrow depicts the applied force directions.
Sensors 22 03850 g005
Figure 6. Force calibration against forces on the sides of the hemispherical sensor (at 30 ° latitude),(in-between the inserted flex sensors) with 45 ° along (a) -y-axis, (b) -x-axis, (c) y-axis, and (d) x-axis (measuring angle clockwise); top view of the sensor system is shown and the green arrow indicates the exerted force directions.
Figure 6. Force calibration against forces on the sides of the hemispherical sensor (at 30 ° latitude),(in-between the inserted flex sensors) with 45 ° along (a) -y-axis, (b) -x-axis, (c) y-axis, and (d) x-axis (measuring angle clockwise); top view of the sensor system is shown and the green arrow indicates the exerted force directions.
Sensors 22 03850 g006
Figure 7. Effect of applying (a) shear force on the sensor (b) equivalent systems; blue squares represent fixed and greenish ones portray partially moving boundary conditions; in both of the cases, red arrows symbolize applied force direction.
Figure 7. Effect of applying (a) shear force on the sensor (b) equivalent systems; blue squares represent fixed and greenish ones portray partially moving boundary conditions; in both of the cases, red arrows symbolize applied force direction.
Sensors 22 03850 g007
Figure 8. Force estimation utilizing sensor data and calibration matrix; applied force direction along (a) z-axis, (b) y-axis, and (c) line with 45 ° from the x-axis.
Figure 8. Force estimation utilizing sensor data and calibration matrix; applied force direction along (a) z-axis, (b) y-axis, and (c) line with 45 ° from the x-axis.
Sensors 22 03850 g008
Figure 9. Simulation steps to evaluate the sensor shell deformation: (a) (i) geometry of the sensor and (ii) mesh; (b) direction of the applied forces: force parallel to (i) z-axis and (ii) xy-plane; (c) total deformation contour as the result of applied force along (i) z-axis and parallel to (ii) xy-plane.
Figure 9. Simulation steps to evaluate the sensor shell deformation: (a) (i) geometry of the sensor and (ii) mesh; (b) direction of the applied forces: force parallel to (i) z-axis and (ii) xy-plane; (c) total deformation contour as the result of applied force along (i) z-axis and parallel to (ii) xy-plane.
Sensors 22 03850 g009
Figure 10. Sensor deformation for applied force (a) at 90 ° latitude; (b) at 30 ° latitude, between two sensors; (c) at 30 ° latitude, on one of the sensors.
Figure 10. Sensor deformation for applied force (a) at 90 ° latitude; (b) at 30 ° latitude, between two sensors; (c) at 30 ° latitude, on one of the sensors.
Sensors 22 03850 g010
Figure 11. Repeatability test for force calibration for the forces along (a) z-axis, (b) y-axis, and (c) 45 ° angle from the x-axis; sensor responses for all three trials for each case are shown in the graphs accordingly; green dot and arrow represent the force directions; top view of the sensor system is also presented.
Figure 11. Repeatability test for force calibration for the forces along (a) z-axis, (b) y-axis, and (c) 45 ° angle from the x-axis; sensor responses for all three trials for each case are shown in the graphs accordingly; green dot and arrow represent the force directions; top view of the sensor system is also presented.
Sensors 22 03850 g011
Figure 12. (a) Cyclic loading test and (b) hysteresis test results; green dot in (a) representing the exerted force direction along z-axis, and shaded area in (b) depicting the standard deviation of force for a certain displacement value.
Figure 12. (a) Cyclic loading test and (b) hysteresis test results; green dot in (a) representing the exerted force direction along z-axis, and shaded area in (b) depicting the standard deviation of force for a certain displacement value.
Sensors 22 03850 g012
Figure 13. Exerted force location recognition in the grid: (a) sensor response due to the applied force and (b) corresponding force location generation; top view of the sensor system and coordinate axis are depicted in the lower right part.
Figure 13. Exerted force location recognition in the grid: (a) sensor response due to the applied force and (b) corresponding force location generation; top view of the sensor system and coordinate axis are depicted in the lower right part.
Sensors 22 03850 g013
Figure 14. Underwater test for the sensor (a) exerting forces and (b) corresponding readings of the sensor.
Figure 14. Underwater test for the sensor (a) exerting forces and (b) corresponding readings of the sensor.
Sensors 22 03850 g014
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Subad, R.A.S.I.; Saikot, M.M.H.; Park, K. Soft Multi-Directional Force Sensor for Underwater Robotic Application. Sensors 2022, 22, 3850. https://doi.org/10.3390/s22103850

AMA Style

Subad RASI, Saikot MMH, Park K. Soft Multi-Directional Force Sensor for Underwater Robotic Application. Sensors. 2022; 22(10):3850. https://doi.org/10.3390/s22103850

Chicago/Turabian Style

Subad, Rafsan Al Shafatul Islam, Md Mahmud Hasan Saikot, and Kihan Park. 2022. "Soft Multi-Directional Force Sensor for Underwater Robotic Application" Sensors 22, no. 10: 3850. https://doi.org/10.3390/s22103850

APA Style

Subad, R. A. S. I., Saikot, M. M. H., & Park, K. (2022). Soft Multi-Directional Force Sensor for Underwater Robotic Application. Sensors, 22(10), 3850. https://doi.org/10.3390/s22103850

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop