Tactile Communication System for the Interaction between Deafblind and Robots
Conference paper
Authors | Oliver Ozioko, Navaraj, W. T., Yogeswaran, N., Hersh, M. and Dahiya, R. |
---|---|
Type | Conference paper |
Abstract | This paper presents a touch-based system for communication by deafblind people with humans and robots. With presented system the deafblind people can send control signal to robots by writing block letters on an array of 8 × 8 diamond-shaped capacitive touch sensors. For better conformability with curved surfaces, the touch sensors arrays have been fabricated on flexible polyvinyl chloride (PVC) substrate. The characters written by deafblind on the tactile sensing array are recognized by Convolution Neural Network (CNN), which is trained with data from Extended Modified National Institute of Standards and Technology (EMNIST) database. A mobile app was also developed to efficiently recognize and display the written letters. Finally, a Baxter robot was simulated using Robot Operating System (ROS) and was remotely controlled by deafblind through English block letters written on the tactile sensing array. The result shows that the robot could successfully execute the `pick or drop' task. The developed system demonstrates the efficacy of tactile based communication by deafblind people to independently interact with a robot and their environment. |
Keywords | Tactile sensors; Sensor arrays ; Electrodes ; Vibrations |
Year | 2018 |
Conference | 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) |
Publisher | IEEE |
ISSN | 1944-9437 |
Digital Object Identifier (DOI) | https://doi.org/10.1109/roman.2018.8525725 |
Web address (URL) | https://eprints.gla.ac.uk/201386/1/201386.pdf |
https://ieeexplore.ieee.org/document/8525725 | |
Journal citation | pp. 1-6 |
ISBN | 78-1-5386-7980-7 |
Output status | Published |
Publication dates | 08 Nov 2018 |
Publication process dates | |
Deposited | 20 Jun 2024 |
https://repository.derby.ac.uk/item/q6z2w/tactile-communication-system-for-the-interaction-between-deafblind-and-robots
9
total views0
total downloads1
views this month0
downloads this month