A Tool to Assist in the Analysis of Gaze Patterns in Upper Limb Prosthetic Use

Journal article


Kyberd, P., Popa, A. F. and Cojean, T. 2023. A Tool to Assist in the Analysis of Gaze Patterns in Upper Limb Prosthetic Use. Prosthesis. 5 (3), pp. 1-18. https://doi.org/10.3390/prosthesis5030063
AuthorsKyberd, P., Popa, A. F. and Cojean, T.
Abstract

Gaze tracking, where the point of regard of a subject is mapped onto the image of the scene the subject sees, can be employed to study the visual attention of the users of prosthetic hands. It can show whether the user is pays greater attention to the actions of their prosthetic hand as they use it to perform manipulation tasks, compared with the general population. Conventional analysis of the video data requires a human operator to identify the key areas of interest in every frame of the video data. Computer vision techniques can assist with this process, but a fully automatic systems requires large training sets. Prosthetic investigations tend to be limited in numbers. However, if the assessment task is well controlled, it is possible to make a much simpler system that uses initial input from an operator to identify the areas of interest and then the computer tracks the objects throughout the task. The tool described here, employs colour separation and edge detection on images of the visual field to identify the objects to be tracked. To simplify the computer's task further, this test uses the Southampton Hand Assessment Procedure (SHAP), to define the activity spatially and temporarily, reducing the search space for the computer. The work reported here is the development a software tool capable of identifying and tracking the Points of Regard and Areas of Interest, throughout an activity with minimum human operator input. Gaze was successfully tracked for fourteen unimpaired subjects, which was compared with the gaze of four users of myoelectric hands. The SHAP cutting task is described and the differences in attention observed with a greater number of shorter fixations by the prosthesis users compared to unimpaired subjects. There was less looking ahead to the next phase of the task by the prosthesis users.

Keywordsupper limb prosthesis; gaze fixation; automatic detection; point of regard; SHAP
Year2023
JournalProsthesis
Journal citation5 (3), pp. 1-18
PublisherMDPI
ISSN2673-1592
Digital Object Identifier (DOI)https://doi.org/10.3390/prosthesis5030063
Web address (URL)https://www.mdpi.com/2673-1592/5/3/63
Accepted author manuscript
License
File Access Level
Open
Output statusPublished
Publication dates
Online08 Sep 2023
Publication process dates
Accepted04 Sep 2023
Deposited18 Sep 2023
Permalink -

https://repository.derby.ac.uk/item/q0w82/a-tool-to-assist-in-the-analysis-of-gaze-patterns-in-upper-limb-prosthetic-use

Download files


Accepted author manuscript
Kyberd23c.pdf
License: CC BY 4.0
File access level: Open

  • 10
    total views
  • 4
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

3D Printing in LMICs: Functional design for upper limb prosthetics in Uganda
Hussani, A., Kyberd, P., Mulindwa, B., Ssekitoleko, R., Keeble, W., Kenney, L. and Howard, D. 2023. 3D Printing in LMICs: Functional design for upper limb prosthetics in Uganda. Prosthesis. 5 (1), pp. 130-147. https://doi.org/10.3390/prosthesis5010011
Slip Detection Strategies for Automatic Grasping in Prosthetic Hands
Kyberd, P. 2023. Slip Detection Strategies for Automatic Grasping in Prosthetic Hands. Sensors. 23 (9), p. 4433. https://doi.org/10.3390/s23094433
An investigation of proprioception illusion using a stimulator with feedback control
Ruth Leskovar, Joseph Moore, Joshua James Robertson, Timothy Exell, Chantel Ostler and Kyberd, P. 2022. An investigation of proprioception illusion using a stimulator with feedback control. 2022 International Conference on Rehabilitation Robotics (ICORR). Rotterdam, Netherlands 25 - 29 Jul 2022 IEEE Xplore. https://doi.org/10.1109/icorr55369.2022.9896564
Outcome measures
Kyberd, P. 2022. Outcome measures. in: Dario Farina and Oskar C. Aszmann (ed.) Bionic Limb Reconstruction Springer. pp. 57-74
A strengthened and sensorised custom silicone glove for use with an intelligent prosthetic hand
Kyberd, P., Duncan Findlayson, Madhupani Jayasuriya and Felipe Chibante 2022. A strengthened and sensorised custom silicone glove for use with an intelligent prosthetic hand. Medical Engineering & Physics. 107 (September), p. 103845. https://doi.org/10.1016/j.medengphy.2022.103845
Making Hands: A History of Prosthetic Arms
Kyberd, P. 2021. Making Hands: A History of Prosthetic Arms. Kidlington Elsevier BV.
Control of a semi-autonomous powered wheelchair
David Sanders, G. Tewkesbury, M. Haddad, Kyberd, P., Shikun Zhou and M. Langner 2021. Control of a semi-autonomous powered wheelchair. 2021 2nd International Symposium on Automation, Information and Computing (ISAIC 2021) 03/12/2021 - 06/12/2021 Online. 03 - 06 Dec 2021 IOP Publishing. https://doi.org/10.1088/1742-6596/2224/1/012098
Design of an occupancy monitoring unit: a thermal imaging based people counting solution for socio-technical energy saving systems in hospitals
Ahmad Taha, Jan Krabicka, Ruiheng Wu, Kyberd, P. and Neil Adams 2020. Design of an occupancy monitoring unit: a thermal imaging based people counting solution for socio-technical energy saving systems in hospitals. 2019 11th Computer Science and Electronic Engineering (CEEC). 18 - 20 Sep 2019 IEEE Xplore. https://doi.org/10.1109/ceec47804.2019.8974311
Embedded research in rehabilitation engineering
David Foord and Kyberd, P. 2020. Embedded research in rehabilitation engineering. Prometheus. 36 (3), pp. 217-234. https://doi.org/10.2307/j50022063
Clinical evaluation of the refined clothespin relocation test: a pilot study
Ali Hussaini, Wendy Hill and Kyberd, P. Clinical evaluation of the refined clothespin relocation test: a pilot study. Prosthetics and Orthotics International. 43 (5), pp. 485--491. https://doi.org/10.1177/0309364619843779
Blood pressure lowering effects of a novel isometric exercise device following a 4-week isometric handgrip intervention
Daniel S. Baddeley-White, Cheri L. McGowan, Rueben Howden, Benjamin D. H. Gordon, Kyberd, P. and Ian L. Swaine 2019. Blood pressure lowering effects of a novel isometric exercise device following a 4-week isometric handgrip intervention. Open Access Journal of Sports Medicine. Vol 10 (2019), pp. 89 - 98. https://doi.org/10.2147/oajsm.s193008
Upper- and lower-limb amputees show reduced levels of eeriness for images of prosthetic hands
Gavin Gavin Buckingham, Johnny Parr, Greg Wood, Sarah Day, Alix Chadwell, Adam Galpin, John Head, Laurence Kenny, Kyberd, P., Emma Gowen and Ellen Poliakoff 2019. Upper- and lower-limb amputees show reduced levels of eeriness for images of prosthetic hands. Psychonomic Bulletin & Review. 26, pp. 1295-1302. https://doi.org/10.3758/s13423-019-01612-x
Control options for upper limb externally powered components
Kyberd, P., Greg Bush and Ali Murtuza Hussaini 2018. Control options for upper limb externally powered components. in: Joseph Ivan Krajbich, Michael S. Pinzur, LTC Benjamin K. Potter and Phillip M. Stevens MEd (ed.) Atlas of Amputations and Limb Deficiencies Rosemont, IL Wolters Kluwer. pp. 193-201
Investigating an A-star algorithm-based fitness function for mobile robot evolution
Shanker Prabhu, Kyberd, P. and Jodie Wetherall 2018. Investigating an A-star algorithm-based fitness function for mobile robot evolution. 2018 22nd International Conference on System Theory, Control and Computing (ICSTCC). Romania 10 - 12 Oct 2018 IEEE Xplore. https://doi.org/10.1109/icstcc.2018.8540734
Characterisation of the Clothespin Relocation Test as a functional assessment tool
Kyberd, P., Ali Hussaini and Ghislain Maillet 2018. Characterisation of the Clothespin Relocation Test as a functional assessment tool. Journal of Rehabilitation and Assistive Technologies Engineering. Vol 5. https://doi.org/10.1177/2055668317750810
Investigating the Uncanny Valley for Prosthetic Hands
Poliakoff, E., O'Kane, S., Carefoot, O., Kyberd, P. and Gowen, E. 2018. Investigating the Uncanny Valley for Prosthetic Hands. Prosthetics and Orthotics International. 42 (1), pp. 21-27. https://doi.org/10.1177/0309364617744083
A survey on evolutionary-aided design in robotics
Shanker Radhakrishna Prabhu, Richard Seals, Kyberd, P. and Jodie Wetherall 2018. A survey on evolutionary-aided design in robotics. Robotica. 36 (12), pp. 1804--1821. https://doi.org/10.1017/s0263574718000747
Refined clothespin relocation test and assessment of motion
Ali Hussaini and Kyberd, P. 2017. Refined clothespin relocation test and assessment of motion. Prosthetics and Orthotics International. 41 (3), pp. 294-302. https://doi.org/10.1177/0309364616660250
High cable forces deteriorate pinch force control in voluntary-closing body-powered prostheses
Hichert, M., Abbink, D.A., Kyberd, P. and Plettenburg, D.A. 2017. High cable forces deteriorate pinch force control in voluntary-closing body-powered prostheses. PLos ONE. 21 (1), p. e0169996. https://doi.org/10.1371/journal.pone.0169996
Skill assessment in upper limb myoelectric prosthesis users: Validation of a clinically feasible method for characterising upper limb temporal and amplitude variability during the performance of functional tasks
Thies, S., Kenney, P.J., Sobhu, M., Galpin, A., Kyberd, P., Stine, R. and Major, M. 2017. Skill assessment in upper limb myoelectric prosthesis users: Validation of a clinically feasible method for characterising upper limb temporal and amplitude variability during the performance of functional tasks. Medical engineering and physics. 47, pp. 137-143. https://doi.org/10.1016/j.medengphy.2017.03.010
From design to research: Upper limb prosthetic research and development in Canada, 1960-2000
Foord, D. and Kyberd, P. 2015. From design to research: Upper limb prosthetic research and development in Canada, 1960-2000. Scientia Canadensis. 38 (1), pp. 50-71. https://doi.org/10.7202/1036042ar
System training and assessment in simultaneous proportional myoelectric prosthesis control
Anders L. Fougner, Oyvind Stavdahl and Kyberd, P. 2014. System training and assessment in simultaneous proportional myoelectric prosthesis control. Journal of NeuroEngineering and Rehabilitation. Vol 11 (Issue 1), p. 75. https://doi.org/10.1186/1743-0003-11-75
Visuomotor behaviours when using a myoelectric prosthesis
Mohammad M. D. Sobuh, Laurence P. J. Kenny, Adam J. Galpin, Sibylle B. Thies, Jane McLaughlin, Jai Kulkarni and Kyberd, P. 2014. Visuomotor behaviours when using a myoelectric prosthesis. Journal of Neuro Engineering and Rehabilitation. Vol 11 (Issue 1), p. 72. https://doi.org/10.1186/1743-0003-11-72
Bridging the gap between robotic technology and health care
Adriano O. Andrade, Adriano A. Pereira, Steffen Walter, Rosimary Almeida, Rui Loureiro, Diego Compagne and Kyberd, P. 2014. Bridging the gap between robotic technology and health care. Biomedical Signal Processing and Control. Vol 10 (Mar 2014), pp. 65-78. https://doi.org/10.1016/j.bspc.2013.12.009