The Effect of Real-Time Visual Information on the Effectiveness of an Automation Interface for Remote Supervision of Agricultural Machines
- 1 Department of Biosystem Engineering, University of Manitoba, Winnipeg, Canada
- 2 Department of Agricultural Mechanization Engineering, Xinjiang Agricultural University, Urumqi, China
- 3 Department of Biosystem Engineering, University of Manitoba, Winnipeg, Canada
- 4 Department of Biosystem Engineering, University of Manitoba, Winnipeg, Canada
Abstract
The increasing use of autonomous agricultural machines (AAM) demands intuitive, effective human–machine interfaces (HMIs) for remote supervision. This study evaluated the usability and situation awareness performance of two interface designs: one that combines graphical indicators with real-time video, and one that uses indicators only. Twenty participants interacted with both interfaces in randomized trials simulating common sprayer malfunctions. Usability was measured using the System Usability Scale (SUS), while situation awareness performance metrics included error detection accuracy and response time. Results showed significantly higher SUS scores for the video-based HMI, indicating better perceived usability. Although response times did not differ significantly, participants achieved greater detection accuracy with the video interface. These findings suggest that integrating real-time video into HMIs enhances comprehension and operator confidence without compromising efficiency. The study emphasizes the significance of visual feedback and user-centred design in creating interfaces that enhance trust, accuracy, and informed decision-making in the supervision of autonomous agricultural equipment.
- Steward, B.L., Tekeste, M.Z., Gai, J. and Tang, L. (2021) Modeling, Simulation, and Visualization of Agricultural and Field Robotic Systems. In: Karkee, M. and Zhang, Q., Eds., Fundamentals of Agricultural and Field Robotics , Springer International Publishing, 297-334. https://doi.org/10.1007/978-3-030-70400-1_12
- Berenstein, R.E.Y. and H.I.B. (2012) A Remote Interface for a Human-Robot Co-Operative Vineyard Sprayer. International Society of Precision Agriculture, 15-18.
- Edet, U. and Mann, D. (2022) Remote Supervision of Autonomous Agricultural Machines: Concepts and Feasibility. Canadian Biosystems Engineering , 62, 2.1-2.12. https://doi.org/10.7451/cbe.2020.62.2.1
- Edit, U., Hawley, E. and Mann, D. (2018) Remote Supervision of Autonomous Agricultural Sprayers: The Farmer’s Perspective. Canadian Biosystems Engineering , 60, 2.19-2.31. https://doi.org/10.7451/cbe.2018.60.2.19
- Panfilov, I. and Mann, D. (2018) The Importance of Real-Time Visual Information for the Remote Supervision of an Autonomous Agricultural Machine. Canadian Bio systems Engineering , 60, 2.11-2.18. https://doi.org/10.7451/cbe.2018.60.2.11
- Nielsen, J. (1992) Finding Usability Problems through Heuristic Evaluation. Proceedings of the SIGCHI Conference on Human Factors in Computing Syste ms — CHI ’92, Monterey, 3-7 May 1992, 373-380. https://doi.org/10.1145/142750.142834
- Adamides, G., Katsanos, C., Constantinou, I., Christou, G., Xenos, M., Hadzilacos, T., et al . (2017) Design and Development of a Semi-Autonomous Agricultural Vineyard Sprayer: Human-Robot Interaction Aspects. Journal of Field Robotics , 34, 1407-1426. https://doi.org/10.1002/rob.21721
- Irizarry, J., Gheisari, M. and Walker, B.N. (2012) Usability Assessment of Drone Technology as Safety Inspection Tools. Electronic Journal of Information Technology in Construction , 17, 194-212.
- Ergonomics, C. (2006) Contemporary Ergonomics 2006.
- Martins, A.I., Queirós, A., Silva, A.G. and Rocha, N.P. (2015) Usability Evaluation Methods. In: Information Resources Management Association, Ed., Human - Computer Interaction : Concepts , Methodologies , Tools , and Applications , IGI Global, 613-636. https://doi.org/10.4018/978-1-4666-8789-9.ch027
- Lewis, J.R. and Sauro, J. (2021) Usability and User Experience: Design and Evaluation. In: Salvendy, G. and Karwowski, W., Eds., Handbook of Human Factors and Ergonomics , John Wiley & Sons, Inc., 972-1015.