Submitted:
06 July 2026
Posted:
08 July 2026
You are already at the latest version
Abstract

Keywords:
1. Introduction
2. Concept of Proprioception and Object Shape Recognition with a Robotic Hand
2.1. Biomimetic Design and Sensor Placement
2.2. Shape Recognition Framework
2.3. Sensor Technology
2.4. Contributions and Implications
3. Flexible Stretch and Pressure Sensors
3.1. Flexible Stretch Sensor
3.2. Pressure Sensor
3.3. Sensor Characterization
3.3.1. Flexible Stretch Sensor Characterization
3.3.2. Palm Pressure Sensor Characterization
4. Hardware and Software Implementation
5. Object Shape Recognition using Multi-Layer Perceptron (MLP)
5.1. Experimental Objects
5.2. Data Acquisition Protocol
5.3. Sensor Channel Selection
5.4. Data Preprocessing
- Stage 1—Z-score standardization
- 2.
- Stage 2—Min-max scaling to [[-1, 1]
5.5. MLP Architecture
5.6. Training Configuration
6. Recognition Performance Comparison
7. Conclusion and Future Work
Supplementary Materials
Acknowledgments
References
- Dahiya, R.S.; Mittendorfer, P.; Valle, M.; Cheng, G.; Lumelsky, V.J. Directions toward effective utilization of tactile skin: A review. IEEE Sens. J. 2013, 13, 4121–4138. [Google Scholar] [CrossRef]
- Calandra, R.; Owens, A.; Upadhyaya, M.; Yuan, W.; Lin, J.; Adelson, E.H.; Levine, S. The Feeling of Success: Does Touch Sensing Help Predict Grasp Outcomes? 2025. Available online: http://arxiv.org/abs/1710.05512.
- Klatzky, R.L.; Lederman, S.J.; Metzger, V.A. Identifying objects by touch: An expert system; 1985. [Google Scholar]
- Li, D.; Yang, Y.; Y.-Z. Song, T.M. Hospedales, Learning to Generalize: Meta-Learning for Domain Generalization. 2017. Available online: http://arxiv.org/abs/1710.03463.
- Kaboli, M.; Yao, K.; Feng, D.; Cheng, G. Tactile-based active object discrimination and target object search in an unknown workspace. Auton. Robot. 2019, 43, 123–152. [Google Scholar] [CrossRef]
- Pezzementi, Z.; Plaku, E.; Reyda, C.; Hager, G.D. Tactile-object recognition from appearance information. IEEE Trans. Robot. 2011, 27, 473–487. [Google Scholar] [CrossRef]
- Tang, Q.; Liang, J.; Zhu, F. A comparative review on multi-modal sensors fusion based on deep learning. Signal Process. 2023, 213. [Google Scholar] [CrossRef]
- Dahiya, R.S.; Metta, G.; Valle, M.; Sandini, G. Tactile sensing-from humans to humanoids. IEEE Trans. Robot. 2010, 26, 1–20. [Google Scholar] [CrossRef]
- Taunyazov, T.; Sng, W.; See, H.H.; Lim, B.; Kuan, J.; Ansari, A.F.; Tee, B.C.K.; Soh, H. Event-Driven Visual-Tactile Sensing and Learning for Robots. In Robotics: Science and Systems; MIT Press Journals, 2020. [Google Scholar] [CrossRef]
- Dahiya, R.S.; Valle, M. Robotic tactile sensing: Technologies and system; Springer Netherlands, 2014. [Google Scholar] [CrossRef]
- Mannsfeld, S.C.B.; Tee, B.C.K.; Stoltenberg, R.M.; Chen, C.V.H.H.; Barman, S.; Muir, B.V.O.; Sokolov, A.N.; Reese, C.; Bao, Z. Highly sensitive flexible pressure sensors with microstructured rubber dielectric layers. Nat. Mater. 2010, 9, 859–864. [Google Scholar] [CrossRef] [PubMed]
- Tactile Sensing for an Anthropomorphic Robotic Hand: Hardware and Signal Processing. In IEEE; 2009.
- Xu, J.; Song, S.; Ciocarlie, M. TANDEM: Learning Joint Exploration and Decision Making with Tactile Sensors. 2022. Available online: http://arxiv.org/abs/2203.00798.
- Jamali, N.; Sammut, C. Majority voting: Material classification by tactile sensing using surface texture. IEEE Trans. Robot. 2011, 27, 508–521. [Google Scholar] [CrossRef]
- Lambeta, M.; Chou, P.W.; Tian, S.; Yang, B.; Maloon, B.; Most, V.R.; Stroud, D.; Santos, R.; Byagowi, A.; Kammerer, G.; Jayaraman, D.; Calandra, R. DIGIT: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation. IEEE Robot. Autom. Lett. 2020, 5, 3838–3845. [Google Scholar] [CrossRef]
- Fan, W.; Li, H.; Zhang, D. MagicTac: A Novel High-Resolution 3D Multi-layer Grid-Based Tactile Sensor. 2024. Available online: http://arxiv.org/abs/2402.01366.
- Luo, S.; Bimbo, J.; Dahiya, R.; Liu, H. Robotic tactile perception of object properties: A review. Mechatronics 2017, 48, 54–67. [Google Scholar] [CrossRef]
- Cutkosky, M.R.; Howe, R.D.; Provancher, W.R. Force and Tactile Sensors. In Springer Handbook of Robotics; Springer Berlin Heidelberg, 2008; pp. 455–476. [Google Scholar] [CrossRef]
- Jing, X.; Qian, K. Reducing Cross-Sensor Domain Gaps in Tactile Sensing via Few-Sample-Driven Style-to-Content Unsupervised Domain Adaptation. Sensors 2025, 25. [Google Scholar] [CrossRef] [PubMed]
- Deng, C.; Li, Y.; Weng, L.; Liu, H.; Zheng, W.; Guo, D.; Sun, F. Robust tactile object recognition in open-set scenarios using Gaussian prototype learning. n.d. Available online: https://sites.gatech.edu/hrl/mr-gan/.
- Lederman, S.J.; Klatzky, R.L. Hand Movements: A Window into Haptic Object Recognition; 1987. [Google Scholar]
- The Skeletal System—Phalanges, The Skeletal System. n.d. Available online: https://www.theskeletalsystem.net/phalanges (accessed on 26 September 2025).
- Khin, P.M.; Low, J.H.; Ang, M.H.; Yeow, C.H. In-Hand Object Recognition for Sensorized Soft Hand. In Lecture Notes in Networks and Systems; Springer Science and Business Media Deutschland GmbH, 2022; pp. 351–364. [Google Scholar] [CrossRef]
- Yu, S.H.; Chang, J.S.; Tsai, C.H.D. Grasp to see—object classification using flexion glove with support vector machine. Sensors 2021, 21, 1–14. [Google Scholar] [CrossRef] [PubMed]
- Yong, S.; Aw, K. Multi-Layered Carbon-Black/Elastomer-Composite-Based Shielded Stretchable Capacitive Sensors for the Underactuated Robotic Hand. Robotics 2022, 11. [Google Scholar] [CrossRef]
- Devaraj, H.; Schober, R.; Picard, M.; Teo, M.Y.; Lo, C.Y.; Gan, W.C.; Aw, K.C. Highly elastic and flexible multi-layered carbon black/elastomer composite based capacitive sensor arrays for soft robotics. Meas. Sens. 2019, 2–4. [Google Scholar] [CrossRef]
- Rob Matheson, M.N. Smart glove can identify objects by touch, MIT CSAIL. 2019. Available online: https://www.csail.mit.edu/news/csail-smart-glove-can-identify-objects-touch (accessed on 26 September 2025).
- Amjadi, M.; Kyung, K.U.; Park, I.; Sitti, M. Stretchable, Skin-Mountable, and Wearable Strain Sensors and Their Potential Applications: A Review. Adv. Funct. Mater. 2016, 26, 1678–1698. [Google Scholar] [CrossRef]
- Aldien, Y.; Welcome, D.; Rakheja, S.; Dong, R.; Boileau, P.E. Contact pressure distribution at hand-handle interface: Role of hand forces and handle size. Int. J. Ind. Ergon. 2005, 35, 267–286. [Google Scholar] [CrossRef]













| Object | Hand Gesture | Palm Force Distribution |
|---|---|---|
| Cylindrical | Progressive MCP-PIP flexion forming a smooth arc with moderate, uniform angles | Elongated, longitudinal force distribution with gradual gradients |
| Conical | Systematic joint angle variation; greater flexion near the apex than base | Asymmetric, wedge-shaped force gradient with higher pressure at narrow end |
| Cuboidal | More extended fingers with specific angles aligned to flat faces | Rectangular pressure map with sharp boundaries; force at edges and vertices |
| Spherical | Large, uniform MCP-PIP flexion forming a dome-shaped hand | Centralised, circular, radially symmetric force pattern |
| Parameter | Standard Variant (Index, Middle, Ring) | Compact Variant (Thumb, Little Finger) | Notes |
|---|---|---|---|
| Total Length | 80 mm | 60 mm | Full sensor, including all layers |
| Bottom Electrode (Layer 2) | 70 mm × 10 mm | 50 mm × 10 mm | Continuous CB/Ecoflex |
| Top Electrode —PIP Segment | 25 mm × 10 mm | 15 mm × 10 mm | PIP Segment |
| Top Electrode —MCP Segment | 35 mm × 10 mm | 25 mm × 10 mm | MCP Segment |
| Inter-electrode Gap | 10 mm | 10 mm | Pure Ecoflex isolation |
| Core Width | 10 mm | 10 mm | Central electrode region |
| Lateral Tab Extensions | Variable (trimmed to fit) | Variable (trimmed to fit) | Mounting tabs |
| Sensor Type | Location | F-Score | Retained |
|---|---|---|---|
| MCP | Thumb | 8.45 | No |
| MCP | Index finger | 7.12 | No |
| MCP | Middle finger | 6.89 | No |
| MCP | Ring finger | 7.45 | No |
| MCP | Little finger | 6.23 | No |
| PIP | Thumb | 15.23 | Yes |
| PIP | Index finger | 28.91 | Yes |
| PIP | Middle finger | 26.34 | Yes |
| PIP | Ring finger | 24.67 | Yes |
| PIP | Little finger | 22.18 | Yes |
| Palm | 1 | 14.56 | Yes |
| Palm | 2 | 13.78 | Yes |
| Palm | 3 | 16.43 | Yes |
| Palm | 4 | 12.87 | Yes |
| Palm | 5 | 11.92 | Yes |
| Palm | 6 | 10.67 | Yes |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).