Practical Application of a Tongue-Operated Joystick Device with Force Feedback Mechanism
- 1 Department of Mechanical Engineering and Intelligent Systems, Tohoku Gakuin University, Tagajo, Japan
- 2 THK CO., LTD, Shibaura, Tokyo, Japan
Abstract
The human tongue has superior movement and tactile sensations. For individuals with severe disabilities, a tongue operated interface device can be used to operate life-support equipment, such as powered wheelchairs and robotic manipulators. A joystick-type device can directly translate various tongue motions to external equipment behavior. In addition, the user can interactively communicate with the equipment by tactile feedback. This helps the user to control the equipment safely and skillfully. Considering these factors, in a previous study [1] , we developed a novel tongue-operated joystick device with reaction force feedback mechanism. We described the design process including the analysis of human tongue movement and tactile sensations and showed fundamental performances of reaction force feedback with the prototype device. In this study, we discuss the shape of the operational part that is used by the tongue. Two types of operational tools are prepared and their operability and perception of reaction force feedback are compared. Furthermore, we confirm the effectiveness of reaction force feedback to operate the joystick device safely and skillful controlling a mobile robot in an unknown environment.
- Ohba, T. and Kajikawa, S. (2017) Tongue-Operated Joystick Device with Reaction Force Feedback Mechanism. 2017 IEEE International Conference on Advanced Intelligent Mechatronics, Munich, 3-7 July 2017, 207-212. https://doi.org/10.1109/AIM.2017.8014019
- Rudigkeit, N., Gebhard, M. and Graser, A. (2015) Evaluation of Control Modes for Head Motion-Based Control with Motion Sensors. 2015 IEEE International Symposium on Medical Measurements and Application, Turin, 7-9 May 2015, 135-140. https://doi.org/10.1109/MeMeA.2015.7145187
- Barea, R., Boquete, L., Mazo, M. and Lopez, E. (2002) System for Assisted Mobility Using Eye Movements Based on Electrooculography. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 10, 209-218. https://doi.org/10.1109/TNSRE.2002.806829
- Krolak, A. and Strumillo, P. (2008) Vision-Based Blink Monitoring System for Human-Computer Interfacing. 2008 IEEE International Conference on Human System Interactions, Krakow, Poland, 25-27 May 2008, 994-998. https://doi.org/10.1109/HSI.2008.4581580
- Iturrate, I., Antelis, J.M., Kubler, A. and Minguez, J. (2009) A Noninvasive Brainactuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation. IEEE Transactions on Robotics, 25, 614-627. https://doi.org/10.1109/TRO.2009.2020347
- Sasaki, M., Suhaimi, M.S.A.B., Ito, S. and Rusydi, M.L. (2015) Robot Control System Based on Electrooculography and Electromyogram. Journal of Computer and Communications, 3, 113-120. https://doi.org/10.4236/jcc.2015.311018
- Shima, K., Fukuda, O. and Tsuji, T. (2012) EMG-Based Control for a Feeding Support Robot Using a Probabilistic Neural Network. 2012 IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics, Rome, 24-27 June 2012, 1788-1793. https://doi.org/10.1109/BioRob.2012.6290876
- Wei, L. and Hu, H. (2011) A Hybrid Human-Machine Interface for Hands-Free Control of an Intelligent Wheelchair. International Journal Mechatronics and Automation, 1, 97-111. https://doi.org/10.1504/IJMA.2011.040040
- Kandel, E.R., Schwartz, J.H. and Jessell, T.M. (2000) Principles of Neural Science. 5th Edition, McGraw-Hill, New York.
- Kimura, T. (2012) User Interface Detects Tongue Movement with Kinect. https://www.youtube.com/watch?v=jWIl3CtH6SE
- Saponas, T.S., Kelly, D., Parvix, B.A. and Tan, D.S. (2009) Optically Sensing Tongue Gestures for Computer Input. 22nd Annual ACM Symposium on User Interface Software and Technology, Victoria, 4-7 October 2009, 177-180. https://doi.org/10.1145/1622176.1622209