Computer Aided Design of Self-Learning Robotic System using Imitation Learning

Conference paper


Jadeja, Y., Shafik, M. and Wood, P. 2022. Computer Aided Design of Self-Learning Robotic System using Imitation Learning. Shafik, M. and Case, K. (ed.) Proceedings of the 19th International Conference on Manufacturing Research, Incorporating the 36th National Conference on Manufacturing Research. IOS Press. https://doi.org/10.3233/ATDE220564
AuthorsJadeja, Y., Shafik, M. and Wood, P.
TypeConference paper
Abstract

Artificial intelligence (AI), imitation learning, big data, cloud and distributed computing, robotics cells, and information communication technology, are some of the key tools and elements of the future digital and smart manufacturing facility. There are a number of challenges that digital and smart manufacturing is facing, especially with the complication of AI (i.e., machine, deep and cognitive learning) algorithms, great amount of data to process, and essential complex coding required, which makes immediate changes needed in manufacturing facilities not straightforward. This is notable in small manufacturing cells which is an integrated part of future smart factories such manufacturing facilities are usually needed some annual and regular updates to meet the update in the design specifications of next generation of products. Imitation learning is offering a great opportunity to overcome these challenges and simplify such complications, where human skills, ability to perform specific tasks, knowledge, and talent could be transferred. This is conveying the knowledge, and skills transfer using imitation learning. However, smart manufacturing and industrial revolution needs robotics cells that has skills beyond this, especially when it comes to process optimisation. Therefore, deep imitation learning could come in to help in the development of self-learning robotic systems and cells. Off course with the powerful tools such as distributed computing, blockchain, cloud computing, edge computing, and 5G the collaboration between such self-learning robotic cells will be possible. This will certainly not eliminate human existence but will enhance the manufacturing environment. This paper is focused on presenting the outcomes of CAD simulation and modelling phase of the ongoing research programme that focused on developing a self-learning robotic system using imitation learning. CAD tools have been used and some initial results is presented.

KeywordsImitation learning ; Self-learning robotic arm ; CNN; Resnet-50 ; Relu
Year2022
ConferenceProceedings of the 19th International Conference on Manufacturing Research, Incorporating the 36th National Conference on Manufacturing Research
PublisherIOS Press
Digital Object Identifier (DOI)https://doi.org/10.3233/ATDE220564
Web address (URL)https://ebooks.iospress.nl/doi/10.3233/ATDE220564
Publisher's version
License
File Access Level
Open
ISBN978-1-64368-331-7
Output statusPublished
Publication dates
Online2022
Publication process dates
Deposited13 Mar 2024
EditorsShafik, M. and Case, K.
Permalink -

https://repository.derby.ac.uk/item/9q6y2/computer-aided-design-of-self-learning-robotic-system-using-imitation-learning

Download files


Publisher's version
ATDE-25-ATDE220564.pdf
License: CC BY-NC 4.0
File access level: Open

  • 7
    total views
  • 3
    total downloads
  • 0
    views this month
  • 0
    downloads this month

Export as

Related outputs

Microstructure Evolution in AM Produced Superalloy Thin Struts at Low Plastic Strain
Wood, P., Gunputh, U., Delcuse, L, Bahi, S., Ben Haj Slama, A., Guitton, A., Rusinek, A., Maloufi, N. and Williams, G. 2024. Microstructure Evolution in AM Produced Superalloy Thin Struts at Low Plastic Strain. Materials Today Communications. https://doi.org/10.1016/j.mtcomm.2024.108739
Orientation effects on the fracture behaviour of additively manufactured stainless steel 316L subjected to high cyclic fatigue
Kopec, M., Gunputh, U., Macek, W., Kowalewski, Z. L. and Wood, P. 2024. Orientation effects on the fracture behaviour of additively manufactured stainless steel 316L subjected to high cyclic fatigue. Theoretical and Applied Fracture Mechanics. 130, pp. 1-9. https://doi.org/10.1016/j.tafmec.2024.104287
Thin-walled LPBF-manufactured Inconel 718 honeycomb structures: Multiscale characterization
Wood, P. 2024. Thin-walled LPBF-manufactured Inconel 718 honeycomb structures: Multiscale characterization. in: Zikry, M, A. (ed.) Innovative Lightweight and High-Strength Alloys: Multiscale Integrated Processing, Experimental, and Modeling Techniques Amsterdam Elsevier.
Long Sump Life Effects of a Naturally Aged Bio-Ester Oil Emulsion on Tool Wear in Finish Turning a Ni-Based Superalloy
Paul Wood, Andrew Mantle, Fathi Boud, Carter, W., Gunputh, U., Pawlik, M., Lu, Y., José Díaz-Álvarez and María Henar Miguélez Garrido Long Sump Life Effects of a Naturally Aged Bio-Ester Oil Emulsion on Tool Wear in Finish Turning a Ni-Based Superalloy. Metals. https://doi.org/10.3390/met13091610
Modular reactors: What can we learn from modular industrial plants and off site construction research
Paul Wrigley, Paul Wood, Daniel Robertson, Jason Joannou, Sam O'Neill and Richard hall 2023. Modular reactors: What can we learn from modular industrial plants and off site construction research. Nuclear Engineering and Technology. 56 (1), pp. 1-11. https://doi.org/10.1016/j.net.2023.07.023
Effect of Powder Bed Fusion Laser Sintering on Dimensional Accuracy and Tensile Properties of Reused Polyamide 11
Gunputh, U., Williams, G., Pawlik, M., Lu, Y. and Wood, P. 2023. Effect of Powder Bed Fusion Laser Sintering on Dimensional Accuracy and Tensile Properties of Reused Polyamide 11. Polymers. https://doi.org/10.3390/polym15234602
Effect of Grain Structure on Machinability of LPBF Inconel 718: A Critical Review
Hama, J., Gunputh, U., Lu, Y., Wood, P. and Alvarez, J. 2023. Effect of Grain Structure on Machinability of LPBF Inconel 718: A Critical Review. 20th International Conference on Manufacturing Research, Incorporating the 37th National Conference on Manufacturing Research. IOS Press. https://doi.org/10.3233/ATDE230896
Characterisation of impact resistance of composite reinforced by hybridised carbon-flax fibres in polyfurfuryl alcohol resin
Lu, Y., Pawlik, M., Ganapathi, S. P., Wood, P., Gunputh, U. and Le, H. 2023. Characterisation of impact resistance of composite reinforced by hybridised carbon-flax fibres in polyfurfuryl alcohol resin. The 2nd International Conference on Mechanical Automation and Engineering Materials (MAEM 2023) . IOP Publishing. https://doi.org/10.1088/1742-6596/2612/1/012013
Prediction of carbon nanotubes reinforced interphase properties in fuzzy fibre reinforced polymer via inverse analysis and optimisation
Pawlik, M., Le, H., Wood, P. and Lu, Y. 2023. Prediction of carbon nanotubes reinforced interphase properties in fuzzy fibre reinforced polymer via inverse analysis and optimisation. Computational Material Science. 231, pp. 1-11. https://doi.org/10.1016/j.commatsci.2023.112548
Microstructure Effects on the Machinability of AM-Produced Superalloys
Wood, P., Díaz-Álvarez, J., Lu, Y., Rusinek, A., Gunputh, U., Bahi, S., Díaz-Álvarez, A., Miguélez, M. H., Lu, Y., Platek, P. and Sienkiewicz, J. 2023. Microstructure Effects on the Machinability of AM-Produced Superalloys. Crystals. 13 (8), pp. 1-16. https://doi.org/10.3390/cryst13081190
Low cycle fatigue predictions of a space thruster built with a new refractory high entropy alloy
Valvano, S., Canale, G., Maligno, A. and Wood, P. 2023. Low cycle fatigue predictions of a space thruster built with a new refractory high entropy alloy. The Fourth International Conference on Damage Mechanics, Baton Rouge, Louisiana, USA, MAY 15 18, 2023.
Microstructure and geometry effects on the compressive behavior of LPBF-manufactured inconel 718 honeycomb structures
Voyiadjis, G. z., Znemah, R. A. and Paul Wood 2023. Microstructure and geometry effects on the compressive behavior of LPBF-manufactured inconel 718 honeycomb structures. Journal of Materials Research and Technology. 24, pp. 1562-1578. https://doi.org/10.1016/j.jmrt.2023.03.093
Design and Manufacture of One-Size-Fits-All Healthcare Face Shields for the NHS During the COVID-19 Pandemic
Gunputh, U., Williams, G., Leighton, A., Carter, W., Varasteh, H., Pawlik, M., Lu, Y., Sims, R., Lyons, M., Clementson, J., Tripathi, G., Nick Chambers, Matt Roe and Wood, P. 2022. Design and Manufacture of One-Size-Fits-All Healthcare Face Shields for the NHS During the COVID-19 Pandemic. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.4258668
On the Lubricity and Comparative Life Cycle of Biobased Synthetic and Mineral Oil Emulsions in Machining Titanium Ti-6Al-4V at Low Cutting Speed
Wood, P., Boud, F., Carter, W., Varasteh, H., Gunputh, U., Pawlik, M., Clementson, J., Lu, Y. and Hossain, S. 2022. On the Lubricity and Comparative Life Cycle of Biobased Synthetic and Mineral Oil Emulsions in Machining Titanium Ti-6Al-4V at Low Cutting Speed. Journal of Manufacturing and material processing. 6 (6), pp. 1-16. https://doi.org/10.3390/jmmp6060154
Advances in Transdisciplinary Engineering
Shafik, M. and Case, K. 2022. Advances in Transdisciplinary Engineering. 19th International Conference in Manufacturing Research . IOS Press.
Surface engineering of carbon fibre/epoxy composites with woven steel mesh for adhesion strength enhancement
Pawlik, M., Cheah, L.Y.Y, Gunputh, U., Le, H., Wood, P. and Lu, Y. 2022. Surface engineering of carbon fibre/epoxy composites with woven steel mesh for adhesion strength enhancement. International Journal of Adhesion and Adhesives. 114, pp. 1-8. https://doi.org/10.1016/j.ijadhadh.2022.103105
Advances in Manufacturing Technology XXXIV
Shafik, Mahmoud and Case, Keith 2021. Advances in Manufacturing Technology XXXIV. IOS Press. https://doi.org/10.3233/ATDE15
Machinability of INCONEL718 alloy with a porous microstructure produced by laser melting powder bed fusion at higher energy densities
Wood, Paul K, Díaz-Álvarez, Antonio, Díaz-Álvarez, José, Miguélez, María Henar, Rusinek, Alexis, Williams, Gavin, Bahi, Slim, Sienkiewicz, Judyta, Płatek, Paweł, Gunputh, Urvashi Fowdar and wood, paul 2020. Machinability of INCONEL718 alloy with a porous microstructure produced by laser melting powder bed fusion at higher energy densities. Materials. 13 (24). https://doi.org/10.3390/ma13245730
Off-site modular construction and design in nuclear power: A systematic literature review
Wood, P., Wrigley, P., O'Neill, S., R. Hall and D. Robertson 2021. Off-site modular construction and design in nuclear power: A systematic literature review. Progress in Nuclear Energy. https://doi.org/10.1016/j.pnucene.2021.103664
Strain Rate and Temperature Effects in Nanoindentation Testing on Hardness in Selective Laser Melting IN718
Reem Abo Znemah, George Z. Voyiadjis, Paul Wood and Edris Akbari 2021. Strain Rate and Temperature Effects in Nanoindentation Testing on Hardness in Selective Laser Melting IN718. Journal of Engineering Materials and Technology. https://doi.org/10.1115/1.4051691
Simple shear behavior and constitutive modeling of 304 stainless steel over a wide range of strain rates and temperatures
B. Jia, A. Rusinek, R. Pesci, R. Bernier, S. Bahi, A. Bendarma and Wood, P. 2021. Simple shear behavior and constitutive modeling of 304 stainless steel over a wide range of strain rates and temperatures. International Journal of Impact Engineering. https://doi.org/10.1016/j.ijimpeng.2021.103896
Simple shear behavior of 2024-T351 aluminum alloy over a wide range of strain rates and temperatures: Experiments and constitutive modeling
Bin Jia, Alexis Rusinek, Xinke Xiao and Paul Wood 2021. Simple shear behavior of 2024-T351 aluminum alloy over a wide range of strain rates and temperatures: Experiments and constitutive modeling. International Journal of Impact Engineering. https://doi.org/10.1016/j.ijimpeng.2021.103972
High strain rate effect on tensile ductility and fracture of AM fabricated Inconel 718 with voided microstructures
Wood, P., A. Rusinek, P. Platek, Jacek Janiszewski, J. Sienkiewicz, Gunputh, U., K. Rajkowski and M.H. Miguélez 2021. High strain rate effect on tensile ductility and fracture of AM fabricated Inconel 718 with voided microstructures. Materials & Design. https://doi.org/10.1016/j.matdes.2021.109908
Additive manufacturing of graded structures in IN718
Wood, Paul and Gunputh, Urvashi 2019. Additive manufacturing of graded structures in IN718.
Selective laser melting of a high precision turbomachinery application in IN718 alloy
Wood, Paul, Gunputh, Urvashi, Williams, Gavin, Carter, Wayne, Boud, Fathi, Bahi, Slim, Rusinek, Alexis, Kowalewski, Zbigniew, Nowak, Zdzisław, Libura, Tomasz, Voyiadjis, George, Diaz-Alvarez, Jose and Miguelez, María 2021. Selective laser melting of a high precision turbomachinery application in IN718 alloy.
Analysis of machining performance of Inconel 718 printed by PBF-LM (powder bed fusion laser melting)
Diaz-Alvarez, A, Diaz-Alvarez, J, Wood, P, Gunputh, U, Rusinek, A and Miguelez, M 2021. Analysis of machining performance of Inconel 718 printed by PBF-LM (powder bed fusion laser melting).
Selective laser melting of stainless steel 316L pressure fittings
Wood, Paul 2019. Selective laser melting of stainless steel 316L pressure fittings.
Analysis of parameters influencing build accuracy of a SLM printed compressor outlet guide vane
Otubusin, Adetayo, Wood, Paul, Appleby, John and Adamczuk, Rafael 2018. Analysis of parameters influencing build accuracy of a SLM printed compressor outlet guide vane. American Society of Mechanical Engineers. https://doi.org/10.1115/GT2018-75548
Effect of element wall thickness on the homogeneity and isotropy of hardness in SLM IN718 using nanoindentation
Abo Znemah, Reem, Wood, Paul, Gunputh, Urvashi Fowdar and Zhang, Cheng 2020. Effect of element wall thickness on the homogeneity and isotropy of hardness in SLM IN718 using nanoindentation. Mechanics Research Communications. https://doi.org/10.1016/j.mechrescom.2020.103568
Influences of horizontal and vertical build orientations and post-fabrication processes on the fatigue behavior of stainless steel 316l produced by selective laser melting
Wood, Paul, Libura, Tomasz, Kowalewski, Zbigniew L., Williams, Gavin and Serjouei, Ahmad 2019. Influences of horizontal and vertical build orientations and post-fabrication processes on the fatigue behavior of stainless steel 316l produced by selective laser melting. Materials. 12 (24), p. 4203. https://doi.org/10.3390/ma12244203
A novel technique for dynamic shear testing of bulk metals with application to 304 austenitic stainless steel
Jia, B., Rusinek, A., Pesci, R., Bernier, R., Bahi, S. and Wood, P. 2020. A novel technique for dynamic shear testing of bulk metals with application to 304 austenitic stainless steel. International Journal of Solids and Structures. 204-205, pp. 153-171. https://doi.org/10.1016/j.ijsolstr.2020.08.019
Effect of powder bed fusion laser melting process parameters, build orientation and strut thickness on porosity, accuracy and tensile properties of an auxetic structure in IN718 alloy
Bahi, S., Gunputh, U., Rusinek, A., Wood, P. and Miguelez, M.H. 2020. Effect of powder bed fusion laser melting process parameters, build orientation and strut thickness on porosity, accuracy and tensile properties of an auxetic structure in IN718 alloy. Additive Manufacturing. 36, p. 101339. https://doi.org/10.1016/j.addma.2020.101339
Design for plant modularisation: nuclear and SMR.
Wrigley, Paul, Wood, Paul, Stewart, Paul, Hall, Richard and Robertson, Dan 2018. Design for plant modularisation: nuclear and SMR. 2018 26th International Conference on Nuclear Engineering Conference Proceedings. https://doi.org/10.1115/ICONE26-81760
Module layout optimization using a genetic algorithm in light water modular nuclear reactor power plants.
Wrigley, P.A., Wood, P., Stewart, Paul and Robertson, D. 2018. Module layout optimization using a genetic algorithm in light water modular nuclear reactor power plants. Nuclear Engineering and Design. https://doi.org/10.1016/j.nucengdes.2018.10.023
Deployment of assisted living technology solution platform using smart body sensors for elderly people health monitoring.
Elsaadi, Riyad and Mahmoud, Shafik 2017. Deployment of assisted living technology solution platform using smart body sensors for elderly people health monitoring. International Journal of Robotics and Mechatronics.
Mechanical properties and microstructure of AZ31B magnesium alloy processed by I-ECAP.
Gzyl, Michal, Rosochowski, Andrzej, Pesci, Raphael, Olejnik, Lech, Yakushina, Evgenia and Wood, Paul 2013. Mechanical properties and microstructure of AZ31B magnesium alloy processed by I-ECAP. Metallurgical and Materials Transactions A. https://doi.org/10.1007/s11661-013-2094-z
Module layout optimization using a genetic algorithm in light water modular nuclear reactor power plants.
Wrigley, P., Wood, Paul, Stewart, Paul, Hall, Richard and Robertson, D. 2018. Module layout optimization using a genetic algorithm in light water modular nuclear reactor power plants. Nuclear Engineering and Design. https://doi.org/10.1016/j.nucengdes.2018.10.023
Editorial note: Innovation is the only pathway for manufacturer, visionary and scholars, to improve the quality of human beings daily life
Shafik, Mahmoud 2014. Editorial note: Innovation is the only pathway for manufacturer, visionary and scholars, to improve the quality of human beings daily life. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v1i1.146
Editorial note: why we fail to ignite and sustain innovation in the majority of our business organisations?
Shafik, Mahmoud 2014. Editorial note: why we fail to ignite and sustain innovation in the majority of our business organisations? International Journal of Robotics and Mechatronics.
Editorial note: Robotics and industrial automation technology
Shafik, Mahmoud 2015. Editorial note: Robotics and industrial automation technology. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v2i2.881
Editorial note: The key elements of the future smart cities
Shafik, Mahmoud 2016. Editorial note: The key elements of the future smart cities. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v2i4.904
Computer simulation and modelling of passive humidification device cavity for intensive care patient medical applications
Shafik, Mahmoud and Lechevretel, Anne 2014. Computer simulation and modelling of passive humidification device cavity for intensive care patient medical applications. American Society of Mechanical Engineers. https://doi.org/10.1115/IMECE2014-36505
Micro-hydro generator using eco-wheel system for domestic and industrial building applications
Komlanvi, Moglo, Shafik, Mahmoud and Ashu, Mfortaw, Elvis 2014. Micro-hydro generator using eco-wheel system for domestic and industrial building applications. International Journal of Robotics and Mechatronics. https://doi.org/10.21535/ijrm.v1i3.69
Piezoelectric ultrasonic servo control feed drive renovate electro-discharge machining system industrial applications and transfer the technology into a new era
Shafik, Mahmoud 2014. Piezoelectric ultrasonic servo control feed drive renovate electro-discharge machining system industrial applications and transfer the technology into a new era. International Journal of Robotics and Mechatronics. https://doi.org/10.21535/ijrm.v1i1.78
Innovation in micro actuators and Big Data technology transform visually impaired daily life activities and Improve their access to information technology resources
Shafik, Mahmoud 2014. Innovation in micro actuators and Big Data technology transform visually impaired daily life activities and Improve their access to information technology resources. International Journal of Robotics and Mechatronics. https://doi.org/10.21535/ijrm.v1i3.182
3D sustainable renewable micro power station for smart grid industrial applications
Komlanvi, Moglo, Shafik, Mahmoud and Ashu, Mfortaw Elvis 2015. 3D sustainable renewable micro power station for smart grid industrial applications. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v2i4.874
A smart ultrasonic actuator with multidegree of freedom for autonomous vehicle guidance industrial applications
Shafik, Mahmoud, Ashu, Mfortaw, Elvis and Nyathi, B. 2015. A smart ultrasonic actuator with multidegree of freedom for autonomous vehicle guidance industrial applications. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v2i2.875
An intelligent medical care solution for elderly people with long term health condition based on wireless sensors network technology
Elsaadi, Riyad and Shafik, Mahmoud 2015. An intelligent medical care solution for elderly people with long term health condition based on wireless sensors network technology. International Journal of Robotics and Mechatronics. https://doi.org/10.21535%2Fijrm.v2i1.873
A smart 3D ultrasonic actuator for unmanned vehicle guidance industrial applications
Shafik, Mahmoud, Ashu, Mfortaw, Elvis and Nyathi, B. 2015. A smart 3D ultrasonic actuator for unmanned vehicle guidance industrial applications. UNSYS Digital. https://doi.org/10.21535%2FProICIUS.2015.v11.652
Evaluation of 3D renewable micro power station for smart grid applications
Komlanvi, Moglo, Shafik, Mahmoud and Ashu, Mfortaw, Elvis 2016. Evaluation of 3D renewable micro power station for smart grid applications. in: IOS Press.
An ultrasonic atomisation unit for heat and moisture exchange humidification device for intensive care medicine applications
Mahmoud Shafik 2016. An ultrasonic atomisation unit for heat and moisture exchange humidification device for intensive care medicine applications. World Journal of Research and Review (WJRR).
A multi degree of freedom actuation
Elvis Ashu, Mfortaw, Shafik, Mahmoud and Oraifige, Ilias 2016. A multi degree of freedom actuation. IOS Press. https://doi.org/10.3233/978-1-61499-668-2-211
An intelligent anti-collision system for electric vehicles applications
Chinazaekpere Ijeh, Ikenna and Shafik, Mahmoud 2016. An intelligent anti-collision system for electric vehicles applications. IOS Press. https://doi.org/10.3233/978-1-61499-668-2-305
Deployment of assisted living technology using intelligent body sensors platform for elderly people health monitoring
Elsaadi, Riyad and Shafik, Mahmoud 2016. Deployment of assisted living technology using intelligent body sensors platform for elderly people health monitoring. Proceedings of the 14th International Conference on Manufacturing Research (ICMR 2016). https://doi.org/10.3233/978-1-61499-668-2-219
Design optimisation of passive humidification device for intensive care medical applications
Shafik, Mahmoud and Lechevretel, Anne 2016. Design optimisation of passive humidification device for intensive care medical applications. IOS Press. https://doi.org/10.3233/978-1-61499-668-2-263
A micro investigation into electro discharge machining industrial applications processing parameters and product surface profile using Piezoelectric ultrasonic feed drive
Shafik, Mahmoud, Abdalla, H. S. and Wilmshurst, Tim 2011. A micro investigation into electro discharge machining industrial applications processing parameters and product surface profile using Piezoelectric ultrasonic feed drive. Journal of Manufacturing Science and Engineering. https://doi.org/10.1115/1.4004687
A linear piezo-electric ultrasonic motor using a single flexural vibrating bar for electro-discharge system industrial applications
Shafik, Mahmoud, Shehab, E. M. and Abdalla, H. S. 2009. A linear piezo-electric ultrasonic motor using a single flexural vibrating bar for electro-discharge system industrial applications. The International Journal of Advanced Manufacturing Technology. https://doi.org/10.1007/s00170-009-1955-5