Basic human-robot interactions (impacts).
1. Introduction
Tactile sensing enables robots to interact safely and effectively with unstructured environments and humans in case of both voluntary and reactive interaction tasks. Focusing on humanoid robots, there is increasing interest in avoiding negative human feelings towards the “entity” [1], enabling robots to interact with humans in more intuitive and meaningful ways [2-4]. This requires designing methods for extracting important information from tactile stimuli leading to classification of touch modalities [5-8]. It is still unclear, however, whether touch modality actually plays an important role in the communication of social messages. A very interesting research area consists in exploring social touch for roboticsthrough an interpretation of emotions and other social messages [9].
Together with the social aspects of human-robot interactions, research in this field of robotics has focused largely on transduction principles and transduction technologies [10]. A survey of the state-of-the-art in robot tactile sensing is given by [11], with references to various sensor types. The functional requirements of a robotic skin remain debatable and are at least partially dependent on the specific application. However, some basic requirements can be identified. Sensors should be robust, stable, reproducible, showing a high sensitivity, capable of detecting a wide range of information and both static and dynamic touch (approximately in the 0 - 1 kHz frequency range). Moreover, this application demands mechanical flexibility and conformability, and the skin should be adaptable to various three-dimensional robotic platforms. Finally, the fabrication of the skin should be simple, low cost, replicable and scalable. All hardware should be portable and easily adaptable and electronics should be designed for minimum power consumption and minimum size.
Various technical issues have strongly limited the transition from small matrix prototypes to a large scale integrated solution. An example of truly scalable robot skin systems for humanoid robots has been proposed by Ohmura and Kunihoshi [12]. They approached the problem at system level introducing a networked architecture featuring peripheral nodes (chips) scanning (locally) a limited number of taxels. All the electronics and the transducers are embedded on a PCB support which allows a simple mechanical integration of the sensor over curved surfaces. However, the spatial resolution is quite low, and the adopted infrared (IR) optical transducers have quite large power consumption. The issue of fault tolerance, for infrared based sensors was previously addressed by Um and Lumelsky [13], who tackled the problem via component redundancy for a system featuring over 1000 sensing elements. Another example of artificial skin system for a humanoid robot has been proposed by Tajika et al. [14]. The sensor has been designed with the aim of detecting stimuli coming from people trying to interact with the robot and features PVDF based transducers, but the skin has low spatial resolution (the transducer area is of about 25 cm2).
At a high level, the goal of the ROBOSKIN European Project VII FP, http://www.roboskin.eu
Following the system approach of the ROBOSKIN project, the research activities have been carried out by considering the skin as a system, which is as well a part of the overall robot architecture. Towards this perspective, a combined approach based on modelling and experimental testing is at the basis of the results achieved so far in the sensor manufacturing technology, the interface electronics, the tactile data processing, the embedded system architecture and the system integration. Main achievements in each of the cited fields will be outlined in this chapter.
The chapter will be organized as follows. To move towards an optimized design of the tactile sensing system, a preliminary experimental study has been carried out to classify the tactile stimuli in basic human-robot interactions. This aspect will be detailed in Section 2. The identified contact stress/force range has been used as reference for the design of the skin system.
In Section 3 attention will be focused on tactile sensing systems based on piezoelectric transducers. First, the electromechanical characterization of the
The proposed skin system is made by conformable patches of triangular shape, interconnected in order to form a network structure [21]. Manufacturing and testing of triangular prototypes based on piezoelectric arrays are discussed in Section 5. Consequently, some system aspects related to prototype integration into the target robot platform, data transmission to the robot communication infrastructure and data processing requirements and algorithms are reported in Section 6. In relation to data processing, one of the goals of our research is the real-time implementation of tactile data processing by dedicated embedded digital circuits. In this view, an algorithm to provide the contact forces from sensor readings will be discussed.
An assessment of the achieved results and of the open issues paving the way for new research targets and novel design solutions will conclude the chapter.
2. From perception to tactile stimulus: human-robot interaction
A big challenge in robotics consists in designing a robot that is able to “feel,” “understand” and respond to touch in accord with human expectations. The human-like robot response to external stimuli is far beyond the scopes of this chapter, but a first step in this direction is to design a tactile sensing system which enables the robot to “effectively” interact with humans. This requires recognizing and classifying different
More concretely, we have tried to quantify the magnitude of the mechanical stimuli involved in basic human-robot interactions. As we deal with piezoelectric transducers which do not perceive static stimuli, only impact forces have been considered. Basically, we aim at designing a tactile system which is able to measure and distinguish between light/tender touches and strong impacts.
To enable this quantitative study, a “modally tuned impulse force hammer” (PCB Piezotronics, Model 086C03) which is equipped with an integrated piezoelectric load cell has been used. The load cell acquires the temporal signal of an impact force, i.e. it measures the
The idea is to associate a
To set the skin input stress range, maximum and minimum applied stimuli have to be quantified. To define those limits, the question is how to play with the involved variables, i.e. the indenter size/material and the material of the touched surface, in order to decide whether “force” or “pressure” is the meaningful quantity. The idea is to use “perception” as a definition criterion.
Contrary to our intuitive understanding based on personal experience, the brain is not a camera that passively records the external world. Perception is a product of the brain's abstraction and elaboration of sensory input. The somatic sensory system transmits information about four major modalities: touch, proprioception, pain, and temperature sense. The four modalities are conveyed in separate ascending pathways to the thalamus and cerebral cortex. The perception of touch or pressure is consistent when touch-pressure receptors are electrically stimulated [22].
When touching the human skin, upper limits for the mechanical stimulus can be considered those associated with a “pain” feeling. Pain is, of course, a sub-modality of somatic sensation like touch, pressure, and position sense and serves as an important protective function. It is a complex perception. Its highly individual and subjective nature is one of the factors which makes it difficult to define and to treat clinically. More than any other sensory modality it is influenced by emotional state and environmental contingencies. Therefore, the same stimulus can produce different responses in different individuals under similar conditions. However, average behaviors are interesting in this context and the pain feeling can be used to approximately identify the stimulus upper limit. In particular, when testing different hardness indenters on different parts of the body, we observed that pain limits the maximum stress. The
Given the considerations above, the maximum stress corresponds to approximately 5.5 MPa, which corresponds to a force of 120-130 N (small indenter radius equal to 2.7 mm). On the other hand, to quantify the smallest force we used the PLATE-like indenter (radius equal to 35 mm), and the value we found is F = 0.2 N, which corresponds to approximately 50 Pa. Therefore, the application range goes from 50 Pa to 5 MPa (over 5 orders of magnitude). Moreover, the stiffness difference in various skin areas seems to influence the measured contact force by a factor of approximately 3-4, with softer samples producing lower amplitudes. Results are summarized in Table 1.
CONTACT FORCE (N) | PRESSURE (MPa) | Contact DIAMETER (mm) | ||||
Poke / finger mark | 0.2 - 1.4 | 0.016 - 0.11 | SOFT SPHERICAL INDENTER | 4 | Cheek, arm, belly (SOFT); shinbone, knee, back (HARD) | LIGHT |
Poke / finger mark | 20 - 130 | 0.86 - 5.6 | SOFT SPHERICAL INDENTER | 5,45 | Thigh, Cheek, forearm, belly (SOFT); cheekbone, knee, back (HARD) | HARD |
Light touch / caress | 0.2 - 1.4 | 5.2·10-5 - 3.6·10-4 | BIG PLATE | 70 | Cheek, belly (SOFT); back (HARD) | SUPER SOFT |
Smack / slap | 70 - 170 | 0.018 - 0.044 | BIG PLATE | 70 | Cheek, belly (SOFT); back (HARD) | HARD |
Our results are in accordance with literature, where typical human interactions are basically considered to range from approximately 1 N for a soft stroke up to approximately 100 N for a push or slap. In a recent paper published on Nature Materials [23], authors state that normal manipulation tasks involve stresses of the order of 10-100 kPa, while gentle touches correspond to stress values which are lower than 10 kPa.
We also compared our estimations with the specifications of commercial products which are today on the market, i.e. the Barrett hand http://www.barrett.com/robot/DS_BarretHand.pdf http://www.syntouchllc.com/TechSpecSheet.pdf
3. Assessment of the skin behavior
3.1. Electromechanical characterization of PVDF films
Commercial 100μm thick PVDF sheets from Measurement Specialties Inc. http://www.meas-spec.com/default.aspx
Linear electro-elastic constitutive equations are commonly used to describe the coupling of dielectric, elastic, and piezoelectric properties in piezoelectric materials [24].
In the frequency domain (
where strain
In our application, the PVDF behavior is usefully described by the second row of constitutive equations:
The structures of the piezoelectric and the permittivity matrices are due to the reported material symmetry.
As the charge signal is measured with a charge amplifier, which converts the charge input into a voltage without supplying any electric field, the electric field can be set to null. Therefore, when the film is used in
For the present application, characterizing the electromechanical behavior of the piezoelectric polymer means to retrieve the frequency behavior of the
The employed experimental equipment has been thoroughly discussed in a previous publication [25], which reports more complete characterization results of the PVDF electromechanical behavior.Briefly, the experimental setup (see Figure 2) consists of a rigid frame with a lower fixed plate to which an electro-mechanical shaker is assembled. A piezoelectric force transducer is fixed to the upper head of the frame. Samples are mounted between the force transducer and the shaker. They are pressed between two metals heads of square cross-section with machined and polished contact surfaces. The lower head is assembled to the shaker head with an interposed PMMA block, and the upper head contrasts through a spherical joint with a similar block connected to the force transducer, for self-alignment of the contact planes. Conductive glue creates a stiff connection between the sample and the heads thus excluding possible variations in the contact area during measurements.
The test is controlled by a computer in a completely automatic way. A swept sine signal is fed into the shaker. Frequency spacing and total duration of the test are determined by the settable frequency range and number of steps. The output charge signals (response) and force transducer (stimulus) are continuously acquired and processed in frequency to give the complex piezoelectric modulus. Normally the range between 10 and 1000 Hz can be explored without difficulties.
The frequency behavior of the
3.2. Electromechanical modeling of the skin structure
In order to associate the PVDF charge response to the effective load applied on the outer skin surface, a skin model which is based on the Boussinesq’s equation has been considered.
Approximately, the relation between a point load F applied on the outer surface and the stress at a given point inside the cover layer is given by the Boussinesq’s equation [27]:
where all bold faced symbols represent tensors or vectors,e
Equation (4) is applied to a sensor located on the bottom of the elastic cover of thickness
Then we obtain:
For a vertical force (
As
under the hypotheses that the sensor size is sufficiently smaller than its distance from the point force, the total charge measured by the sensor can be approximated by:
3.3. Experimental assessment of the single taxelbehavior
In order to optimize the design of the skin prototypes we checked the pertinence/limits of the mechanical model, thus quantifying the PVDF electrical response to the external mechanical stimuli and testing the effect of the protective layer (material and thickness) on the PVDF response. We performed the tests on basic single taxel prototypes, where a single circular PVDF film is covered with an elastomeric cover to protect the sensor from physical damage by shocks or chemical contamination by oil and other materials. Attention has been focused on gel/rubber layers, in that they are more controllable and reproducible systems which also allowed for the required dynamics.
An experimental campaign has been carried out in order to quantify the sensor output charge in common tactile interaction tasks. The mechanical input stimuli range from 50 Pa to 5 MPa, as reported in section 2.
The “modally tuned impulse force hammer” (see Section 2) has been used to mechanically stimulate the single taxel sample. In this case, we recall that the load cell measures a contact force, which depends both on the indenter and on the protective layer materials. The measured charge over the 5 kPa - 5 MPa stress range has been compared with the model presented in the previous section and results are reported in Figure 5. In this case, on the horizontal axis the peak amplitude of the
A good accordance between model and experimental data is recorded for high loads, which allows extending the model linear behavior for lower loads, thus covering the whole stress range which is of interest for the application (50Pa - 5MPa). Therefore, both charge and force ranges cover 5 orders of magnitude, the typical output charge ranging from 0.01 pC to 1 nC. This information has been a reference point for the design of the electronics.
4. Interface electronics
In Figure 6 the basic block diagram of the interface electronics is shown. The interface electronics converts the charge developed by the PVDF – as a result of the applied stress – to a voltage signal. It includes a Charge Amplifier (CA) cascaded with a Low Pass Filter (LPF) with high
The mathematical expression of the charge generated by the PVDF sensor can be found from the piezoelectric constitutive equation (2) of Section 3.1. Considering the op amp as ideal, the electric field
where the stress
Figure 7
where
The sensitivity of the CA is given by the ratio between the maximum output voltage (i.e. the supply voltage in the ideal case) to the maximum input charge. The sensitivity sets the value to be given to the feedback capacitance
4.1. Effects of the operational amplifier non idealities
The objective of the present section is to analyze the limitations which come into play when the op amp non idealities are taken into account. The non-idealities influence the behavior both of the op amp and of the PVDF tactile sensor.
4.1.1. Finite op amp open-loop gain
The open-loop gain of an op amp,
where the first term
106 (120dB) | V/V | |
100 | pF | |
2.7 | nF | |
1 | nF | |
100 | MΩ | |
9 | kΩ | |
1 | kΩ | |
3.6 | kΩ | |
7.5 | kΩ | |
N.A. | Ω | |
N.A. | Ω |
In order to quantify how the finite open-loop gain could contribute to the generated charge let us give the following example. Let the op amp be the OPA703 http://www.ti.com/lit/ds/symlink/opa703.pdf
As it can be seen from the values reported in Table 4, the charge,
Piezoelectric constant (a) | -20 | pC/N | |
Permittivity (a) | 106 | pF/m | |
Relative permittivity (a) | 12 | ||
PVDF thin film Length | 5 | mm | |
PVDF thin film Width | 5 | mm | |
PVDF thin film Thickness (a) | 110 | µm | |
PVDF electrode surface (b) | 25e-6 | m2 | |
Static Capacitance (b) | 24 | pF | |
Input charge | 0.2 ( | pC | |
Equivalent PVDF voltage source | 2e-3 ( | V |
Fc [N] | qF [pC] | [pC] |
0.01 | -2 | -48.2e-9 |
25 | -500 | -120 e-9 |
Moreover, if we consider the finite op amp open-loop gain, the CA frequency response becomes:
The module of (13) at low frequency tends to zero, while for high frequencies, it tends to:
For high values of the op amp finite open-loop gain the term
The influence of the finite op amp open-loop gain can be considered negligible both as contribution to the generated charge and as contribution to the output frequency response of the CA. Therefore, for the analysis the op amp can be approximately considered as ideal.
4.1.2. Finite Gain-bandwidth product (GBP)
The gain-bandwidth product (GBP) defines the limit of the op amp amplification, introducing a
Both the package size and supply voltage are two important specs to be considered because of the small space available on the robot. In fact, the use of single supply op amps allows reducing the number of components without degrading the circuit performance – negative voltage regulators are not necessary thus reducing the required number of components. Components with small packages should be preferred to save space. Therefore, according to the considered op amp specs summarized in Table 5 the OPA347 is the better tradeoff.
OPA703 | OPA347* | OPA348† | ||
GBP | 1 MHz | 350 kHz | 1 MHz | |
Open-loop gain | 120 dB | 115 dB | 108 dB | |
Supply voltage | Double/Single ±2V to ±6V 4V to 12V | Single +2.3V to +5.5V | Single +2.1V to +5.5V | |
Package | Type | SOT23-8 SO-8 | WCSP-8 | SOT23-8 SO-8 |
Size (mm) | W x L x H 2.8x2.9x1.45 | W x L x H 2x1x0.625 | W x L x H 2.8x2.9x1.45 |
Figure 8shows that op amps in Table 5 satisfy the 1 Hz ÷ 1 kHz bandwidth specification for the
The experimental results validate the proposed circuit approach. The behaviour of the interface electronics is linear in the given frequency range. The input signal range of the interface electronics was able to measure up to 3 orders of input force magnitude range. In order to extend the input range of the detectable signal up to the 5 orders of magnitude expected for the application, a variable gain amplifier is currently under development.
5. Skin technology and experimental results
The basic structure of skin prototypes based on PVDF arrays is reported in Figure 9. Piezoelectric sensors have to be integrated on a rigid substrate and an elastomer layer is integrated on top as protective layer. This section briefly describes the technological solutions adopted to assemble the different building blocks. Details will be contained in a forthcoming publication.
The triangular geometry, taxel size and positions have been chosen to reproduce existing conformable skin patches manufactured at IIT (Italian Institute of Technology, Genoa) and based on capacitive transducers (
Among technology solutions, how to provide PVDF films with metal contacts is a crucial point. Although metalized PVDF is commercially available, the brittleness of some of the available coatings (Copper over nickel, aluminum on chrome), the high roughness of the screen-printed silver ink solution and the impossibility of obtaining - as a prototyping service - custom patterning of the conducting film from the suppliers, convinced us that operating a “home-made” metallization was a better choice. We thus purchased
A whole metal layer (common ground) is deposited on top of the PVDF film, while patterned contacts with the same geometry of metal contacts on PCB (Figure 9) are deposited on the PVDF bottom side. Conductive glue has been used to fix the PVDF film on the PCB. The cover lay avoids short-circuits between taxels due to the employed glue. The protective layer is finally integrated on top. A Two-part silicone Sylgard® 184 Silicone Elastomer (
Figure 10 shows some results of experimental tests on triangular prototypes. A sinusoidal mechanical stimulus has been applied in correspondence of a certain taxel, by means of an indenter stiffly connected to an electromechanical shaker.
The tests have been conducted by varying the amplitude of the input force for different frequency values. Figure 10 shows the measured charge at 12 Hz, 162 Hz and 362 Hz compared with the value obtained using the Boussinesq's equation (see Section 3.2). As it can be seen a good correspondence can be found. A good linearity is achieved over the whole explored range, and the same voltage-to-force behavior for different frequencies is recorded (in accordance with
6. Towards system integration
6.1. Data processing
As for humans the cerebral cortex constructs an image of touched objects from the fragmented information provided by skin receptors, in a similar way tactile data processing is needed to enable the robot response to external stimuli. Starting from sensor data, the development of methods for touch interpretation is not an easy task.
Towards this scope, this chapter presents the basic ideas of a
The proposed model exploits a discretization of the original continuous problem by constructing an array of concentrated forces at discrete points on the skin surface, starting from the information provided by the sensor array (normal stress measurements).
If the force distribution is discretized into an array of point forces, a superposition of the Boussinesq equations (Section 3.1) for the single point forces can be used as a particularly simple and attractive approximation in the case of linear elasticity.
Mathematically it reduces to a linear vector equation
The inverse Boussinesq’s problem has a direct and unique solution only if
We examined a solution where the number of point forces (applied to the nodes of a pre-determined grid) is equal to the number of sensors. Initial assumptions are made (some can be relaxed in further developments) in that the problem is considered to be static, the surface plane, deflections are small and the elastomer layer Poisson ratio close to 0.5. The method consists in creating a series of
A check of the algorithm was made in MATLAB on a modeled skin structure consisting in a rectangular patch 40×20 mm2 in size with a 10×10 point-like sensor grid at the bottom and 3mm thick elastomer layer (Figure 12). Anhertzian force distribution with normal and tangential components (directed at 45° to the longitudinal axis of the patch) was applied to an elliptical area on the outer surface. The model was previously evaluated by a FEM computation and the normal stress at the center of each sensor was calculated.
The algorithm described above has been applied to retrieve the 3 traction components on the loading area, having the sensor stress values as inputs (
The shape of the distribution as well as its peak value appears to be in very good accord with the assigned data. The tangential components, which are not shown in the present context, can be also retrieved within a certain approximation.
A crucial feature of the present research is that the proposed algorithm should be efficiently implemented on digital hardware. This in turn allows for real-time implementation of tactile data processing into embedded electronics systems.
In a wider perspective, this work is intended as a first step towards the integration of different techniques for tactile information processing (e.g. computational intelligence), possibly implemented at different levels of the transmission line towards the robot central processor. In its difference from statistical approaches such as Machine Learning, the advantage of the present algorithm is that it does not require time-consuming training and data set analysis.
6.2. System architecture
A robot skin can be seen as a complex system formed by a large number of spatially distributed sensing elements with embedded local processing electronics [30]. The robotic skin should be designed in order to be independent from and compliant to different robotic platforms. Small/large scale-tailor-made robotic skin could require different transduction principles (capacitive, piezoelectric, etc.) for the multimodal transduction of contact features.
The robot skin design should focus on the following topics:
Robot skin as a system. The Robot skin is intended to be a set of flexible or curved and compliant patches covering a large area of the robot body. Each patch is composed of a given set of tactile sensing arrays (i.e. 2-D arrays of taxels) and of embedded and dedicated electronics. Patches can be interconnected and networked to each other in order to achieve large sensing surfaces, where contacts or interactions are mostly expected to happen.
Robot skin as a sensor. The tactile sensor is intended to be multimodal and it should include detection and measurement capabilities (i.e. contact event, force distributions, temperature, etc.).
Robot skin electronics. Development of large parts of robot skin with a modular approach: i.e. configuring robot skin parts as the functional, electrical and mechanical aggregation of basic tactile sensing arrays with dedicated and embedded interface electronics, local data acquisition and processing. Each module will be networked with the others in order to configure scalable and modular arrangements.
Despite innovative designs, a large number of sensors have been rendered “bench top,” as the emphasis has been on the sensors, and the system (in particular the underlying embedded electronic system) has largely been ignored [11]. Only few tactile sensing arrays with electronic circuitry on chip with sensors have been presented so far. Those having any possess circuitry with minimal complexity, e.g., a single MOS transistor associated with each transducer.
To overcome the limits of current implementations, i.e. to design and develop large area tactile sensing arrays to be flexible, conformable, and stretchable and at the same time to be intimately integrated with the embedded electronic system and with functional (i.e. PVDF in our case) and structural materials, researchers need to address the development of
The functions to be implemented by the
Based on the assessment of the sensing devices performance and on the system requirements, researchers need to address a proper and cost effective partitioning of the
Dedicated communication strategies are needed to transmit the large amount of data (due to the high sampling rate as in the case of the PVDF sensors, i.e. at least 2 kSamples/s per sensor, and due to the large number of sensors in each array) collected by the tactile sensors arrays distributed over the whole body [31]. In this context, the hierarchical architecture of the communication bus and the local data processing (for a number of tasks e.g. feature extraction, data compression, etc.) is explored. Going from lower levels (i.e. skin) to higher levels (i.e. central processing unit) protocols are different. The desired operation speed, noise and number of wires put a constraint on the type of communication channel used for interaction with higher levels. Serial communication buses are used (e.g. I2C, Can bus, Flexray, Ethernet, etc.) to decrease wiring. The buses using CAN protocol are generally a preferred choice mostly due to the real-time capabilities, high reliability, and readily availability on most microcontrollers. But, the CAN bus suffers from a moderate transmission bandwidth (up to 1 Mbits/s) which will either slow down transmission of tactile data from a large number of sensors or put a cap on the number of touch sensors on the body. These issues can be solved either by using buses with higher transmission bandwidth (e.g. up to 10 Mbits/scan be achieved with FlexRay) or using more buses in parallel - which is anyway undesirable.
Due to the requirement of real time needed to use the tactile feedback in the control loop, deterministic protocols are mandatory. Going from periphery upwards, bandwidth of the bus increases in order to accommodate an increasing amount of data; protocol complexity increases as well. At lower levels high speed, lower connectivity and short distance wiring buses are preferred (e.g. I2C). Moving up in the hierarchy, more complex protocols and longer wiring buses are preferred (e.g. CAN, Flexray, real-time Ethernet like Ethercat).
The tactile sensing system based on PVDF transducer arrays proposed in this chapter [30] is based on a conformable mesh of sensor patches having a triangular shape [32]. On the bottom of the triangular substrate – which is in contact with the robot structure – the blocks of the interface and the local data acquisition/processing electronics are embedded (see Figure 14). The top surface hosts an array of 12 sensors/detectors covered by a PDMS protective layer. Each triangle is interconnected to each other to create a networked structure. Each patch is implemented on a flexible substrate allowing the system to conform to smooth curved surfaces of the robot body (i.e. upper limbs, torso, back, etc.). The PVDF film transducer is provided of two electrodes connected to wires which transfer the generated charge to the interface electronics. The PVDF sensor is used to detect tactile stimuli in the 1 Hz to 1 kHz range (corresponding to the human tactile sensing bandwidth). In the architecture shown in Figure 14, the 12 output signals from the triangle array are in input to the interface electronics (see Section 4). The interface electronics outputs the signals to three ADCs (MAX11613 http://datasheets.maxim-ic.com/en/ds/MAX11612-MAX11617.pdf http://ww1.microchip.com/downloads/en/devicedoc/39940c.pdf www.icub.org
To be able to integrate the interface and the data acquisition/local processing electronics onto the bottom of each triangle, and due to the small space available, an application-specific integrated circuit (ASIC), see Figure 15, which embeds: a) the interface electronics; b) data acquisition; c) dedicated signal processing; d) communication bus interface should be pursued. The feasibility and integration of the tactile sensing system on the robot will mainly depend on the design of the architecture of the ASIC.
7. Conclusions
The main objective of the research activity in this area is the design and manufacturing of robotic skin systems based on arrays of PVDF film transducers. We addressed issues concerning the manufacturing technology, the interface electronics and the system integration. The main achievements are summarized below.
The electromechanical characterization of PVDF thin films working in thickness mode has been achieved. The experimental
A number of elementary qualitative tactile perceptions have been experimentally quantified i.e. the corresponding mechanical contact force/stress have been evaluated. The contact pressure spans on about 5 orders of magnitude ranging from 50Pa to 5MPa. Achieved results complete relevant information in the latest literature about skin and perceived contacts. The contact stress/force range has been used as reference for the development of the interface electronics.
The PVDF transducer charge response to contact stresses has been evaluated in the defined range. We measured the charge response of a set of single taxel prototypes (i.e. PVDF thin film + cover layer) and we focused on gel/rubber layers excluding foams, to get more controllable and reproducible systems which also allow for the required dynamics. Measured charge spans over a range from about 0.01pC up to 1-2nC. The charge response results have been compared with an electromechanical model of the skin structure and have been used as reference specifications to design the interface electronics.
The interface electronics has been designed, implemented and tested. Experimental results validate the proposed solution in the frequency band of interest. The output signal ranges over three orders of magnitude. The experimental tests highlighted the need of a variable gain electronics solution to be able to measure the wide range of tactile stimuli expected for the application (i.e. 5 orders of magnitude for the expected mechanical stress due to contact).
The manufacturing technology for PVDF sensors arrays has been identified. In particular, the thickness (i.e. approximately 3mm) and material (PDMS) of the protective layer for the triangular prototypes have been assessed and tested. Some prototypes of triangular sensor arrays have been manufactured and experimental results are encouraging. In this context, the next development is related to assess the reproducibility of the array behavior. Moreover, durability and calibration tests will be necessary to demonstrate the effective viability and reliability of the proposed technology.
A data processing algorithm for the estimation of the force distribution at the top surface of the covering layer is being currently investigated. Some additional work is however required, which is related to the optimization of the cost functional. Next step is toward the algorithm implementation into a dedicated embedded electronic system interfacing the tactile skin with the upper levels of the robot processing system. Once the force distribution has been obtained, the
The system architecture (i.e. from the sensors arrays to the local microcontroller) has been identified. It is based on the following structure: PVDF sensor array (i.e. triangle), interface electronics (one for each channel), ADC converter with I2C communication interface, I2C bus, microcontroller.
Acknowledgement
This work is supported by the ROBOSKIN European Project about “Skin-Based Technologies and Capabilities for Safe, Autonomous and Interactive Robots”, under grant agreement no. 231500.
References
- 1.
Shimada M. Minato T. Itakura S. lshiguro H. 2007 Uncanny valley of androids and its lateral inhibition hypothesis. In Proc. IEEE International Symposium on Robot and Human interactive Communication,374 379 - 2.
Breazeal C. 2003 Toward sociable robots 42 167 175 - 3.
Velonaki M. Rye D. Scheding S. Williams S. 2005 Fish-Bird: Autonomous interactions in a new media arts setting In Proc. Vital Signs: Creative Practice and New Media Now,29 - 4.
Robins B. Dautenhahn K. Dubowski J. 2005 Robots as isolators or mediators for children with autism? A cautionary tale. Proceedings of the AISB’05 Symposium on Robot Companions Hard Problems and Open Challenges in Human-Robot Interaction,82 88 - 5.
Naya F. Yamato J. Shinozawa K. 1999 Recognizing human touching behaviors using a haptic interface for a pet-robot In Proc. IEEE International Conference on Systems, Man, and Cybernetics,2 1030 1034 - 6.
Iwata H. Sugano S. 2005 Human-robot-contact-state identification based on tactile recognitio n.52 6 1468 - 7.
Stiehl W. D. Lieberman J. Breazeal C. Basel L. Lalla L. Wolf M. 2005 Design of a Therapeutic Robotic Companion for Relational, Affective Touch. Proceedings of the International Workshop on Robots and Human Interactive Communication.408 415 - 8.
Koo S. Lim J. G. Kwon D. 2008 Online touch behavior recognition of hard-cover robot using temporal decision tree classifier. In Proc. IEEE International Symposium on Robot and Human Interactive Communication,425 429 - 9.
Silvera Tawil. D. Rye D. Velonaki M. 2011 Touch modality interpretation for an EIT-based sensitive skin. In Proc. IEEE International Conference on Robotics and Automation,3770 3776 - 10.
Lee M. Nicholls H. 1999 Tactile sensing for mechatronics: A state of the art survey Mechatronics.9 1 - 11.
Dahiya R. S. Metta G. Valle M. Sandini G. 2010 Tactile Sensing: From Humans to Humanoid s.26 1 1 20 - 12.
Ohmura Y. Kuniyoshi Y. Nagakubo A. 2006 Conformable and scalable tactile sensor skin for curved surfaces. In Proc. IEEE International Conference on Robotics and Automation,1348 1353 - 13.
Um D. Lumelsky V. 1999 Fault tolerance via component redundancy for a modularized sensitive skin In Proceedings IEEE International Conference on Robotics and Automation,1 722 EOF - 14.
Tajika T. Miyashita T. Ishiguro H. et al. 2006 Automatic Categorization of Haptic Interactions-What are the Typical Haptic Interactions Between a Human and a Robot. In Proceeding of IEEE-RAS International Conference on Humanoid Robots, Humanoids 2006, Genova,4 6 December 2006. - 15.
Reston R. Kolesar E. 1989 Pressure-sensitive field-effect transistor sensor array fabricated from a piezoelectric polyvinylidene fluoride film. In Proc. Annual International Conference of the IEEE Engineering in Medicine and Biology Society,3 918 919 - 16.
Hosoda K. 2003 Robot finger design for developmental tactile interaction: Anthropomorphic robotic soft fingertip with randomly distributed receptors. In Proc. Embodied Artificial Intelligence,2865 219 230 - 17.
Tanaka Y. Tanaka M. Chonan S. 2006 Development of a sensor system for measuring tactile sensation. In Proc. IEEE Conference on Sensors,554 557 - 18.
Dahiya R. Valle M. Metta G. Lorenzelli L. 2007 POSFET tactile sensor arrays. In Proc. IEEE International Conference on Electronics, Circuits and Systems,1075 1078 - 19.
Ishiguro H. Nishio S. 2007 Building artificial humans to understand humans 10 3 133 142 - 20.
Takamuku S. Gómez G. Hosoda K. Pfeifer R. 2007 Haptic discrimination of material properties by a robotic hand. In Proc. IEEE International Conference on Development and Learning,1 6 - 21.
Sandini G. Maggiali M. Cannata G. Metta G. 2007 Tactile sensor arrangement and corresponding sensory system. United States Patent20100234997 - 22.
Kandel E. R. Schwartz J. H. Jessell T. M. Principles of Neural Science McGraw-Hill/Appleton & Lange; 4th edition (January 5,2000 - 23.
Mannsfeld S. C. B. Tee-K B. C. Stoltenberg R. M. Chen-H C. V. H. Barman S. Muir B. V. O. Sokolov A. N. Reese C. Bao Z. 2010 Highly sensitive flexible pressure sensors with microstructured rubber dielectric layer s,9 859 864 - 24.
Ikeda T. 1996 Fundamentals of Piezoelectricity Oxford Science Publications. - 25.
Seminara L. Capurro M. Cirillo P. Cannata G. Valle M. 2011 Electromechanical characterization of piezoelectric PVDF polymer films for tactile sensors in robotics applications Sens. Actuators A.169 1 49 58 - 26.
Vinogradov A. M. Holloway F. 1999 Electro-mechanical properties of the piezoelectric polymer PVDF 226 169 181 - 27.
Johnson K. L. 1985 Description of Contact Mechanics and Boussinesq equation in elastic surface, in Contact Mechanics, Cambridge University Press, New York, NY. - 28.
Selvadurai A.P.S. 2001 On Boussinesq’s problem 39 317 322 - 29.
Albert A. 1972 Regression and the Moore-Penrose pseudoinverse Academic Press Ink. New York. - 30.
Pinna L. Carlini G. Seminara L. Valle M. 2011 Interface electronics for tactile sensing arrays. Electronics, Circuits and Systems (ICECS), 2011. 18th IEEE International Conference on.468 471 - 31.
Ravinder R. S. Valle M. 2012 Robotic Tactile Sensing- The Silicon way to System. Elsevier Publishing. - 32.
Cannata G. Maggiali M. Metta G. Sandini G. 2008 An embedded artificial skin for humanoid robots MFI 2008.434 438
Notes
- VII FP, http://www.roboskin.eu
- http://www.barrett.com/robot/DS_BarretHand.pdf
- http://www.syntouchllc.com/TechSpecSheet.pdf
- http://www.meas-spec.com/default.aspx
- http://www.ti.com/lit/ds/symlink/opa703.pdf
- http://datasheets.maxim-ic.com/en/ds/MAX11612-MAX11617.pdf
- http://ww1.microchip.com/downloads/en/devicedoc/39940c.pdf
- www.icub.org