An Abstract Architecture for Explainable Autonomy in Hazardous Environments

Conference paper


Matt Luckcuck, Hazel M Taylor and Marie Farrell 2022. An Abstract Architecture for Explainable Autonomy in Hazardous Environments. 2022 IEEE 30th International Requirements Engineering Conference Workshops (REW). IEEE Xplore. https://doi.org/10.1109/rew56159.2022.00027
AuthorsMatt Luckcuck, Hazel M Taylor and Marie Farrell
TypeConference paper
Abstract

Autonomous robotic systems are being proposed for use in hazardous environments, often to reduce the risks to human workers. In the immediate future, it is likely that human workers will continue to use and direct these autonomous robots, much like other computerised tools but with more sophisticated decision-making. Therefore, one important area on which to focus engineering effort is ensuring that these users trust the system. Recent literature suggests that explainability is closely related to how trustworthy a system is. Like safety and security properties, explainability should be designed into a system, instead of being added afterwards. This paper presents an abstract architecture that supports an autonomous system explaining its behaviour (explainable autonomy), providing a design template for implementing explainable autonomous systems. We present a worked example of how our architecture could be applied in the civil nuclear industry, where both workers and regulators need to trust the system’s decision-making capabilities.

KeywordsAutonomous robotic systems; hazardous environments; sophisticated decision-making
Year2022
Conference2022 IEEE 30th International Requirements Engineering Conference Workshops (REW)
PublisherIEEE Xplore
ISSN2770-6834
Digital Object Identifier (DOI)https://doi.org/10.1109/rew56159.2022.00027
Web address (URL)https://pure.manchester.ac.uk/ws/files/224727952/re4es_3.pdf
http://dx.doi.org/10.1109/rew56159.2022.00027
ISBN9781665460002
Web address (URL) of conference proceedingshttps://ieeexplore.ieee.org/document/9920144
Output statusPublished
Publication dates20 Oct 2022
Publication process dates
Deposited31 Jan 2023
Permalink -

https://repository.derby.ac.uk/item/9w93z/an-abstract-architecture-for-explainable-autonomy-in-hazardous-environments

  • 16
    total views
  • 0
    total downloads
  • 1
    views this month
  • 0
    downloads this month

Export as

Related outputs

CSP2Turtle: Verified Turtle Robot Plans
Dara MacConville, Marie Farrell, Luckcuck, M. and Rosemary Monahan 2023. CSP2Turtle: Verified Turtle Robot Plans. Robotics. 12 (62), pp. 1-22. https://doi.org/10.3390/robotics12020062
Modelling the Turtle Python library in CSP
MacConville, D., Farrell, M., Matt Luckcuck and Monahan, R. 2022. Modelling the Turtle Python library in CSP. Second Workshop on Agents and Robots for reliable Engineered Autonomy. Open Publishing Association, Australia. https://doi.org/10.4204/eptcs.362.4
Bridging the gap between single- and multi-model predictive runtime verification
Angelo Ferrando, Rafael C. Cardoso, Marie Farrell, Matt Luckcuck, Fabio Papacchini, Michael Fisher and Viviana Mascardi 2022. Bridging the gap between single- and multi-model predictive runtime verification. Formal Methods in System Design. 59, p. 44–76. https://doi.org/10.1007/s10703-022-00395-7
Formal Verification of a Map Merging Protocol in the Multi-agent Programming Contest
Luckcuck, M. and Cardoso, R. C. 2022. Formal Verification of a Map Merging Protocol in the Multi-agent Programming Contest. in: Alechina, N., Baldoni, M. and Logan, B. (ed.) Engineering Multi-Agent Systems Switzerland Springer. pp. 198–217
Evolution of the IEEE P7009 Standard: Towards Fail-Safe Design of Autonomous Systems
Farrell, M., Luckcuck, M., Pullum, L., Fisher, M., Hessami, A., Danit, G., Murahwi, Z. and Wallace, K. 2022. Evolution of the IEEE P7009 Standard: Towards Fail-Safe Design of Autonomous Systems. 2021 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW). IEEE Xplore. https://doi.org/10.1109/issrew53611.2021.00109
Towards Refactoring FRETish Requirements
Farrell, M., Luckcuck, M., Sheridan, O. and Monahan, R. 2022. Towards Refactoring FRETish Requirements. in: Deshmukh, J. V., Havelund, K. and Perez, I. (ed.) NASA Formal Methods Switzerland Springer. pp. 272–279
FRETting About Requirements: Formalised Requirements for an Aircraft Engine Controller
Farrell, M., Luckcuck, M., Sheridan, O. and Monahan, R. 2022. FRETting About Requirements: Formalised Requirements for an Aircraft Engine Controller. in: Gervasi, V. and Vogelsang, A. (ed.) Requirements Engineering: Foundation for Software Quality Switzerland Springer. pp. 96-111
Using formal methods for autonomous systems: Five recipes for formal verification
Luckcuck, M. Using formal methods for autonomous systems: Five recipes for formal verification. Journal of Risk and Reliability. pp. 1-19. https://doi.org/10.1177/1748006x211034970
An Overview of Verification and Validation Challenges for Inspection Robots
Fisher, M., Cardoso, R. C., Collins, E. C., Dadswell, C., Denis, L. A., Dixon, C., Farrell, M., Ferrando, A., Huang, X., Jump, M., Kourtis, G., Lisista, A., Luckcuck, M., Luo, S., Page, V., Papacchini, F. and Webster, M. 2021. An Overview of Verification and Validation Challenges for Inspection Robots. Robotics. 10 (2), pp. 1-29. https://doi.org/10.3390/robotics10020067
MLFC: From 10 to 50 Planners in the Multi-Agent Programming Contest
Cardoso, R. C., Ferrando, A., Papacchini, F., Luckcuck, M., Linker, S. and Payne, T. R. 2021. MLFC: From 10 to 50 Planners in the Multi-Agent Programming Contest. in: Ahlbrecht, T., Dix, J., Fiekas, N. and Krausburg, T. (ed.) The Multi-Agent Programming Contest 2021 One-and-a-Half Decades of Exploring Multi-Agent Systems Switzerland Springer. pp. 82–107
Towards Compositional Verification for Modular Robotic Systems
Luckcuck, M., Cardoso, R., Dennis, L., Farrell, M. and Fisher, M. 2020. Towards Compositional Verification for Modular Robotic Systems. Second International Workshop on Formal Methods for Autonomous Systems. . https://doi.org/10.4204/eptcs.329.2
Heterogeneous Verification of an Autonomous Curiosity Rover
Cardoso, R. C., Farrell, M., Luckcuck, M., Ferrando, A. and Fisher, M. 2020. Heterogeneous Verification of an Autonomous Curiosity Rover. in: Lee, R., Jha, S., Mavridou, A. and Giannakopoulou, D. (ed.) NASA Formal Methods Switzerland Springer. pp. 353–360
Formal specification and verification of autonomous robotic systems: A survey
Luckcuck, M., Farrell, M., Dennis, L.A., Dixon, C. and Fisher, M. 2019. Formal specification and verification of autonomous robotic systems: A survey. ACM Computing Surveys. 52 (5), pp. 1-41. https://doi.org/10.1145/3342355
A Summary of Formal Specification and Verification of Autonomous Robotic Systems
Luckcuck, M., Farrell, M., Denis, L. A., Dixon, C. and Fisher, M. 2019. A Summary of Formal Specification and Verification of Autonomous Robotic Systems. in: Ahrendt, W. and Tarifa, S. L. T. (ed.) Integrated Formal Methods Switzerland Springer. pp. 538–541
Robotics and Integrated Formal Methods: Necessity Meets Opportunity
Luckcuck, M., Farrell, M. and Fisher, M. 2018. Robotics and Integrated Formal Methods: Necessity Meets Opportunity. in: Furia, C. A. and Winter, K. (ed.) Integrated Formal Methods Switzerland Springer. pp. 161–171
Verifiable Self-Certifying Autonomous Systems
Fisher, M., Collins, E., Dennis, L., Luckcuck, M., Webster, M., Jump, M., Page, V., Patchett, C., Dinmohammadi, F., Flynn, D., Robu, V. and Zhao, X. 2018. Verifiable Self-Certifying Autonomous Systems. 29th IEEE International Symposium on Software Reliability Engineering Workshops, ISSREW 2018. IEEE Xplore. https://doi.org/10.1109/issrew.2018.00028
A Formal Model of the Safety-Critical Java Level 2 Paradigm
Luckcuck, M., Cavalcanti, A. and Wellings, A. 2016. A Formal Model of the Safety-Critical Java Level 2 Paradigm. in: Ábrahám, E. and Huisman, M. (ed.) Integrated Formal Methods Switzerland Springer. pp. 226–241
Safety-Critical Java: level 2 in practice
Luckcuck, M., Wellings, A. and Cavalcanti, A. 2016. Safety-Critical Java: level 2 in practice. Concurrency Computation. https://doi.org/10.1002/cpe.3951
A Formal Model for the SCJ Level 2 Paradigm
Luckcuck, M. 2015. A Formal Model for the SCJ Level 2 Paradigm. Doctoral Symposium of Formal Methods 2015. University of Oslo.