Human-Robot Interface Usability Perception Analysis for A Virtual Assistant

Robinson Jiménez-Moreno, Anny Astrid Espitia-Cubillos, Esperanza Rodríguez-Carmona

Abstract

The increasing human-robot development in both domestic and industrial environments makes it necessary to include user perception in aspects such as human-robot behavior conditioning in the design phase and evaluate the interaction model that guides user-centered development. This paper presents a statistical analysis developed to evaluate the perceived usability of a human-robot interface using factor analysis. This analysis was performed based on the interaction of a virtual assistant robot for the supervision of physical training exercises with a human user in a closed environment. Developing a theoretical model with three factors that initially group 11 variables to obtain an evaluation metric in the human-robot interaction. To collect this information, a video of the interaction between the user and the virtual bot in the supervision interface was recorded and presented to a group of participants. They then completed a survey using a Likert scale to rate each variable, which also included two open-ended questions aimed at identifying ideas for improvement to propose future research. The application of confirmatory factor analysis allows us to conclude that the model for measuring interface usability consists of a factor that groups 10 variables. In addition, future research should focus on making human-robot interactions more natural.

 

Keywords: Factor Analysis; Human-Robot Interface; Usability; Virtual Robot; Deep Learning.

 

https://doi.org/10.55463/issn.1674-2974.52.1.2


Full Text:

PDF


References


LU X., LI X., HU C., DENG J., SHENG W., and ZHU L. A two-branch deep learning with spatial and pose constraints for social group detection. Engineering Applications of Artificial Intelligence, 2023, 124: 106583. https://doi.org/10.1016/j.engappai.2023.106583

CHOI S. H., KIM M., and LEE J.Y. Smart and user-centric manufacturing information recommendation using multimodal learning to support human-robot collaboration in mixed reality environments. Robotics and Computer-Integrated Manufacturing, 2025, 91: 102836, https://doi.org/10.1016/j.rcim.2024.102836

FALERNI M. M., POMPONI V., KARIMI H.R., NICORA M.L., DAO L.A., MALOSIO M., and ROVEDA L. A framework for human–robot collaboration enhanced by preference learning and ergonomics. Robotics and Computer-Integrated Manufacturing, 2024, 89: 102781, https://doi.org/10.1016/j.rcim.2024.102781

LIAO Z., and WANG Y. Trust-based variable impedance control of human–robot cooperative manipulation. Robotics and Computer-Integrated Manufacturing, 2024, 88: 102730. https://doi.org/10.1016/j.rcim.2024.102730

BOSE S. R., KUMAR V. S., and SREEKAR, C. S. In-situ enhanced anchor-free deep CNN framework for a high-speed human-machine interaction. Engineering Applications of Artificial Intelligence, 2023, 126(Part B): 106980. https://doi.org/10.1016/j.engappai.2023.106980

BAMANI E., NISSINMAN E., MEIR I., KOENIGSBERG L., and SINTOV, A., Ultra-Range Gesture Recognition using a web-camera in Human–Robot Interaction. Engineering Applications of Artificial Intelligence, 2024, 132: 108443. https://doi.org/10.1016/j.engappai.2024.108443

SHI X., WANG C., SHI L., ZHOU H., PHILLIPS T. K., BI K., CUI W., SUN C. and WAN, D. Research on human-robot interaction for robotic spatial 3D printing based on real-time hand gesture control. Robotics and Computer-Integrated Manufacturing, 2024, 89: 102788. https://doi.org/10.1016/j.rcim.2024.102788

LI C., ZHENG P., YIN Y., PANG Y. M., and HUO S. An AR-assisted Deep Reinforcement Learning-based approach towards mutual-cognitive safe human-robot interaction. Robotics and Computer-Integrated Manufacturing, 2023, 80: 102471. https://doi.org/10.1016/j.rcim.2022.102471

JOCELYN S., LEDOUX É., MARRERO I. A., BURLET-VIENNEY D., CHINNIAH Y., BONEV I. A., MOSBAH A.B., and BERGER I. Classification of collaborative applications and key variability factors to support the first step of risk assessment when integrating cobots. Safety Science, 2023, 166: 106219. https://doi.org/10.1016/j.ssci.2023.106219

DU Y., WANG J., WANG Z., YU F., and ZHENG C. Robotic manufacturing systems: A survey on technologies to improve the cognitive level in HRI. Procedia CIRP, 2022, 107: 1497-1502. https://doi.org/10.1016/j.procir.2022.05.181

YANG X., ZHOU Z., SØRENSEN J. H., CHRISTENSEN C. B., ÜNALAN M., and ZHANG X. Automation of SME production with a Cobot system powered by learning-based vision. Robotics and Computer-Integrated Manufacturing, 2023, 83: 102564. https://doi.org/10.1016/j.rcim.2023.102564

BITON A., SHOVAL S., and LERMAN Y. The Use of Cobots for Disabled and Older Adults, IFAC-PapersOnLine, 2022, 55(2): 96-101. https://doi.org/10.1016/j.ifacol.2022.04.176

PABOLU V. K. R. A CoBot Reinforcement Framework to Facilitate Assembly Line Workers. Procedia CIRP, 2023, 118: 241-246. https://doi.org/10.1016/j.procir.2023.06.042.

WANG T., FAN J., and ZHENG, P. An LLM-based vision and language cobot navigation approach for Human-centric Smart Manufacturing. Journal of Manufacturing Systems, 2024, 75: 299-305. https://doi.org/10.1016/j.jmsy.2024.04.020

BERX N., DECRÉ W., and PINTELON L. A tool to evaluate industrial cobot safety readiness from a system-wide perspective: An empirical validation. Safety Science, 2024, 170: 106380. https://doi.org/10.1016/j.ssci.2023.106380

SILVA A., SIMÕES A. C., and BLANC R. Supporting decision-making of collaborative robot (cobot) adoption: the development of a framework. Technological Forecasting and Social Change, 2024, 204: 123406. https://doi.org/10.1016/j.techfore.2024.123406

FOURNIER É., JEOFFRION C., HMEDAN B., PELLIER D., FIORINO H., and LANDRY A. Human-cobot collaboration’s impact on success, time completion, errors, workload, gestures and acceptability during an assembly task. Applied Ergonomics, 2024, 119: 104306. https://doi.org/10.1016/j.apergo.2024.104306

MATAS A. Diseño del formato de escalas tipo Likert: un estado de la cuestión. Revista Electrónica de Investigación Educativa, 2018, 20(1): 38-47, https://doi.org/10.24320/redie.2018.20.1.1347.

JIMÉNEZ-MORENO R. and CASTILLO R. A. Deep learning speech recognition for residential assistant robot. IAES International Journal of Artificial Intelligence, 2023, 12(2): 585–592, https://doi.org/10.11591/ijai.v12.i2.pp585-592

HERRERA J. J., JIMENEZ-MORENO R., and BAQUERO J. E. M. Virtual environment for assistant mobile robot. International Journal of Electrical and Computer Engineering, 2023, 13(6): 6174–6184, https://doi.org/10.11591/ijece.v13i6.pp6174-6184.

JIMENEZ-MORENO R., ESPITIA CUBILLOS A., and RODRIGUEZ CARMONA E. Virtual assistant robot for physical training exercises supervision. IJEEE Iranian Journal of Electrical and Electronic Engineering, 2024, 20(4): 34289. https://doi: 10.22068/IJEEE.20.4.3428

ESPITIA CUBILLOS A. A., RODRÍGUEZ CARMONA E., and JIMÉNEZ-MORENO R. Usability measurement model of the human-robot interactive communication interface for human assistance tasks. Proceedings of the 22nd LACCEI International Multi-Conference for Engineering, Education, and Technology, San José, Costa Rica, 2024, 1672. https://doi.org/10.18687/LACCEI2024.1.1.1672

KIM W., KIM N., LYONS J. B., and NAM C. S. Factors affecting trust in high-vulnerability human-robot interaction contexts: A structural equation modelling approach. Applied ergonomics, 2020, 85: 103056. https://doi.org/10.1016/j.apergo.2020.103056.

KWON M., BIYIK E., TALATI A., BHASIN K., LOSEY D. P., and SADIGH D. When humans aren’t optimal: Robots that collaborate with risk-aware humans. Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, New York, U.S.A., 2020, pp. 43–52. https://doi.org/10.1145/3319502.3374832

WINKLE K., CALEB-SOLLY P., LEONARDS U., TURTON A., and BREMNER P. Assessing and addressing ethical risk from anthropomorphism and deception in socially assistive robots. Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction, New York, USA, 2021, pp. 101–109. https://doi.org/10.1145/3434073.3444666

ZHONG M., FRAILE M., CASTELLANO G., and WINKLE K. A case study in designing trustworthy interactions: implications for socially assistive robotics. Frontiers in Computer Science, 2023, 5: 1152532. https://doi.org/10.3389/fcomp.2023.1152532

HASSANI H., and SIRIMAL SILVA E. A Kolmogorov-Smirnov Based Test for Comparing the Predictive Accuracy of Two Sets of Forecasts. Econometrics, 2015, 3(3): 590-609,

https://doi.org/10.3390/econometrics3030590

SUNANDAR A., PRATAMA A., HANDAYANI A., and FERTILIA N.C., Analysis of Tourism Village Development Infrastructure in Five Super Priority Destinations on Tourist Satisfaction. ADRI International Journal of Civil Engineering, 2022, 7(1): 118-123.

KIM W., KIM N., LYONS J., and NAM C. Factors affecting trust in high-vulnerability human-robot interaction contexts: A structural equation modelling approach. Applied Ergonomics, 2020, 85: 103056. https://doi.org/10.1016/j.apergo.2020.103056

NAKYEJWE K.S., KASIMU S., and SABI H. M., Sustainable entrepreneurship of small businesses in Uganda: A confirmatory factor analysis. African journal of Business Management, 2021, 15(5): 139-151. https://doi.org/10.5897/AJBM2021.9207


Refbacks

  • There are currently no refbacks.