Abstract
Problem statement: Wheelchairs have a widespread usage both as a rehabilitation tool and as an assistive device in the daily lives of people with disabilities. However, some disabilities make it difficult to use traditional wheelchairs that are operated manually or with a joystick. This paper describes an intelligent control system for wheelchair automatization, which allows the user to give commands by different means—voice, eye movements, muscle tension. The object recognition system and logical processing of commands supports a wide variety of interfaces and commands. To achieve these goals, a semiotic model of the world is used. Purpose of research: development of a control system for a robotic wheelchair that supports multimodal interfaces and has a high level of automation that enables efficient operation for users with various disabilities. Results: The paper describes the developed architecture of the control system based on the semiotic model of the world, modules for the speech interface, gaze control, and the interface based on myosensors. The navigation system and the processing module for the semiotic world model ensure the safe execution of user commands, including movement, object recognition and processing of commands that contain references to known objects. The system supports interfacing with a manipulator, which is controlled using a linguistic model: a language for describing actions representing the admissible movements of the manipulator in the form of a formal grammar. The study tested the proposed system on a developed model of the robot and a detailed model of the room in a Gazebo environment, as well as on the corresponding software and hardware implementation of the robotic wheelchair. Practical significance: Automation and the use of models and methods of artificial intelligence in the development of wheelchairs allows us to make them more versatile, which increases the number of users for whom a particular model is suitable, reduces the strain on the operator of the wheelchair and expands the capabilities of the wheelchair. The proposed usage of the sign models achieves these goals by combining logical processing of commands as a means of handling multimodal interfaces and executing complex commands.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
World Health Organization, World Bank. World report on disability (2011)
Osipov, G.S., et al.: Semiotic world representation for subject of behaviour, p. 264. Fizmatlit, Moscow (2018). in Russian
Karpov, V.E., et al.: Architecture of a wheelchair control system for disabled people: towards multifunctional robotic solution with neurobiological interfaces. Sovrem Tehnol. v Med. 11(1), 90 (2019)
Rovbo, M., Moscowsky, A., Sorokoumov, P.: Hierarchical control architecture for a learning robot based on heterogenic behaviors. Commun. Comput. Inf. Sci. 1093 (2019)
Fox, D., Burgard, W., Thrun, S.: The dynamic window approach to collision avoidance. IEEE Robot. Autom. Mag. 4(1), 23–33 (1997)
Rösmann, C., Hoffmann, F., Bertram, T.: Integrated online trajectory planning and optimization in distinctive topologies. Rob. Auton. Syst. 88, 142–153 (2017)
Liu, Z., et al.: Motion description language for trajectory generation of a robot manipulator (2017)
Zhao, R.: Trajectory planning and control for robot manipulations. Université Paul Sabatier, Toulouse III, (2015)
Brockett, R.W.: Hybrid models for motion control systems BT—essays on control: perspectives in the theory and its applications. In: Trentelman, H.L., Willems, J.C. (eds.), pp. 29–53. Birkhäuser Boston, Boston, MA (1993)
Brockett, R.: Language driven hybrid systems. Proceedings of 1994 33rd IEEE Conference on Decision and Control. 4, 4210–4214 (1994)
Liu, Z., et al.: A new type of industrial robot trajectory generation component based on motion modularity technology. J. Robot, 2020 (2020)
Manikonda, V., Krishnaprasad, P., Hendler, J.: Languages, pp. 199–226. Hybrid architectures and motion control, Math. Control Theory Behav. (1998)
Barry, J.L.: Manipulation with diverse actions. Massachusetts Institute of Technology. Massachusetts Institute of Technology, p. 201 (2013)
Acknowledgements
The work was supported by NRC “Kurchatov institute”, order № 1361 from 25.06.2019.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Sorokoumov, P.S., Rovbo, M.A., Moscowsky, A.D., Malyshev, A.A. (2021). Robotic Wheelchair Control System for Multimodal Interfaces Based on a Symbolic Model of the World. In: Gorodetskiy, A.E., Tarasova, I.L. (eds) Smart Electromechanical Systems. Studies in Systems, Decision and Control, vol 352. Springer, Cham. https://doi.org/10.1007/978-3-030-68172-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-68172-2_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-68171-5
Online ISBN: 978-3-030-68172-2
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)