Abstract
With the extensive deployment of Internet of things (IoTs), artificial intelligence (AI), virtual reality (VR), and augmented reality (AR), more and more novel and amazing human-machine interfacing (HMI) equipment and applications are launched and gradually change human’s life and the world. The meaning of HMI is utilizing various techniques to design and realize the interfaces between users and machines, where the machines are defined as any mechanical or electrical devices that assist in the human tasks. Triboelectric nanogenerators (TENGs), as a natural and effective mechanical-to-electrical conversion technology, present excellent advantages in material selection and structure type. These advantages promote TENGs have been successfully utilized to realize many types of HMI, including intelligent keyboard, handwriting recognition device, gesture recognition device, acoustic sensor, remote controller, assistive technology for special groups, virtual application, instructed application, and light-emitting-based display. The research progress of the TENG-enabled HMI are systematically and thoroughly introduced. In addition, the development roadmap for intelligent keyboard of Wang’s team is also reviewed. In this year, the commercial smart keyboard product has been successfully produced. Compared with the conventional keyboard, the smart keyboard is just like equipped with a lock to judge and recognize the input information. Finally, the perspectives in this emerging field are also discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ba YY, Bao JF, Wang ZY, Deng HT, Wen DL, Zhang XR, Tu C, Zhang XS (2021) Self-powered trajectory-tracking microsystem based on electrode-miniaturized triboelectric nanogenerator. Nano Energy 82. https://doi.org/10.1016/j.nanoen.2020.105730
Cao R, Pu XJ, Du XY, Yang W, Wang JN, Guo HY, Zhao SY, Yuan ZQ, Zhang C, Li CJ, Wang ZL (2018) Screen-printed washable electronic textiles as self-powered touch/gesture tribo-sensors for intelligent human-machine interaction. ACS Nano 12(6):5190–5196. https://doi.org/10.1021/acsnano.8b02477
Chen J, Zhu G, Yang J, Jing QS, Bai P, Yang WQ, Qi XW, Su YJ, Wang ZL (2015) Personalized keystroke dynamics for self-powered human–machine interfacing. ACS Nano 9(1):105–116. https://doi.org/10.1021/nn506832w
Chen S, Jiang JX, Xu F, Gong SQ (2019) Crepe cellulose paper and nitrocellulose membrane-based triboelectric nanogenerators for energy harvesting and self-powered human-machine interaction. Nano Energy 61:69–77. https://doi.org/10.1016/j.nanoen.2019.04.043
Chen S, Pang YK, Cao YT, Tan XB, Cao CY (2021) Soft robotic manipulation system capable of stiffness variation and dexterous operation for safe human–machine interactions. Adv Mater Technol 6(5):2100084. https://doi.org/10.1002/admt.202100084
Ding WB, Wang AC, Wu CS, Guo HY, Wang ZL (2019) Human-machine interfacing enabled by triboelectric nanogenerators and tribotronics. Adv Mater Technol 4(1):1800487. https://doi.org/10.1002/admt.201800487
Doganay D, Cicek MO, Durukan MB, Altuntas B, Agbahca E, Coskun S, Unalan HE (2021) Fabric based wearable triboelectric nanogenerators for human machine interface. Nano Energy 89. https://doi.org/10.1016/j.nanoen.2021.106412
Fan FR, Tian ZQ, Wang ZL (2012) Flexible triboelectric generator. Nano Energy 1(2):328–334. https://doi.org/10.1016/j.nanoen.2012.01.004
Fan X, Chen J, Yang J, Bai P, Li ZL, Wang ZL (2015) Ultrathin, rollable, paper-based triboelectric nanogenerator for acoustic energy harvesting and self-powered sound recording. ACS Nano 9(4):4236–4243. https://doi.org/10.1021/acsnano.5b00618
Guo HY, Pu XJ, Chen J, Meng Y, Yeh MH, Liu GL, Tang Q, Chen BD, Liu D, Qi S, Wu CS, Hu CG, Wang J, Wang ZL (2018) A highly sensitive, self-powered triboelectric auditory sensor for social robotics and hearing aids. Sci Robot 3(20). https://doi.org/10.1126/scirobotics.aat2516
Guo H, Wan J, Wang HB, Wu HX, Xu C, Miao LM, Han MD, Zhang HX (2021) Self-powered intelligent human-machine interaction for handwriting recognition. Research 2021:4689869. https://doi.org/10.34133/2021/4689869
He TYY, Sun ZD, Shi QF, Zhu ML, Anaya DV, Xu MY, Chen T, Yuce MR, Thean AVY, Lee CK (2019) Self-powered glove-based intuitive interface for diversified control applications in real/cyber space. Nano Energy 58:641–651. https://doi.org/10.1016/j.nanoen.2019.01.091
Hou C, Geng JJ, Yang Z, Tang TY, Sun YY, Wang FX, Liu HC, Chen T, Sun LN (2020) A delta-parallel-inspired human machine interface by using self-powered triboelectric nanogenerator toward 3D and VR/AR manipulations. Adv Mater Technol 6(1):2000912. https://doi.org/10.1002/admt.202000912
Jeon SB, Kim WG, Park SJ, Tcho IW, Jin IK, Han JK, Kim D, Choi YK (2019) Self-powered wearable touchpad composed of all commercial fabrics utilizing a crossline array of triboelectric generators. Nano Energy 65. https://doi.org/10.1016/j.nanoen.2019.103994
Ji XL, Zhao TK, Zhao X, Lu XF, Li TH (2020) Triboelectric nanogenerator based smart electronics via machine learning. Adv Mater Technol 5(2). https://doi.org/10.1002/admt.201900921
Jiang CM, Li XJ, Yao Y, Lan LY, Shao YZ, Zhao FN, Ying YB, Ping JF (2019) A multifunctional and highly flexible triboelectric nanogenerator based on MXene-enabled porous film integrated with laser-induced graphene electrode. Nano Energy 66. https://doi.org/10.1016/j.nanoen.2019.104121
Jiang DJ, Du MX, Qu XC, Gai YS, Sun W, Xue JT, Li YS, Li Z, Wang ZL (2022) Self-powered intelligent voice navigation tactile pavement based on high-output hybrid nanogenerator. Adv Mater Technol:2200270. https://doi.org/10.1002/admt.202200270
Lee Y, Cha SH, Kim YW, Choi D, Sun JY (2018) Transparent and attachable ionic communicators based on self-cleanable triboelectric nanogenerators. Nat Commun 9. https://doi.org/10.1038/s41467-018-03954-x
Li SM, Peng WB, Wang J, Lin L, Zi YL, Zhang G, Wang ZL (2016) All-elastomer-based triboelectric nanogenerator as a keyboard cover to harvest typing energy. ACS Nano 10(8):7973–7981. https://doi.org/10.1021/acsnano.6b03926
Li RN, Wei XL, Xu JH, Chen JH, Li B, Wu ZY, Wang ZL (2021) Smart wearable sensors based on triboelectric nanogenerator for personal healthcare monitoring. Micromachines 12(4):352. https://doi.org/10.3390/mi12040352
Lu CX, Chen J, Jiang T, Gu GQ, Tang W, Wang ZL (2018) A stretchable, flexible triboelectric nanogenerator for self-powered real-time motion monitoring. Adv Mater Technol 3(6). https://doi.org/10.1002/admt.201800021
Lu YJ, Tian H, Cheng J, Zhu F, Liu B, Wei SS, Ji LH, Wang ZL (2022) Decoding lip language using triboelectric sensors with deep learning. Nat Commun 13(1):1401. https://doi.org/10.1038/s41467-022-29083-0
Luo Y, Wang ZH, Wang JY, Xiao X, Li Q, Ding WB, Fu HY (2021) Triboelectric bending sensor based smart glove towards intuitive multi-dimensional human-machine interfaces. Nano Energy 89:106330. https://doi.org/10.1016/j.nanoen.2021.106330
Ma LY, Wu RH, Liu S, Patil A, Gong H, Yi J, Sheng FF, Zhang YZ, Wang J, Wang J, Guo WX, Wang ZL (2020) A machine-fabricated 3D honeycomb-structured flame-retardant triboelectric fabric for fire escape and rescue. Adv Mater 32(38):e2003897. https://doi.org/10.1002/adma.202003897
Maharjan P, Bhatta T, Salauddin M, Rasel MS, Rahman MT, Rana SMS, Park JY (2020) A human skin-inspired self-powered flex sensor with thermally embossed microstructured triboelectric layers for sign language interpretation. Nano Energy 76. https://doi.org/10.1016/j.nanoen.2020.105071
Nie JH, Ren ZW, Shao JJ, Deng CR, Xu L, Chen XY, Li MC, Wang ZL (2018) Self-powered microfluidic transport system based on triboelectric nanogenerator and electrowetting technique. ACS Nano 12(2):1491–1499. https://doi.org/10.1021/acsnano.7b08014
Pang YK, Li J, Zhou T, Yang ZW, Luo JJ, Zhang LM, Dong GF, Zhang C, Wang ZL (2017) Flexible transparent tribotronic transistor for active modulation of conventional electronics. Nano Energy 31:533–540. https://doi.org/10.1016/j.nanoen.2016.11.042
Pu XJ, Guo HY, Chen J, Wang X, Xi Y, Hu CG, Wang ZL (2017) Eye motion triggered self-powered mechnosensational communication system using triboelectric nanogenerator. Sci Adv 3(7):e1700694. https://doi.org/10.1126/sciadv.1700694
Qin K, Chen C, Pu XJ, Tang Q, He WC, Liu YK, Zeng QX, Liu GL, Guo HY, Hu CG (2021) Magnetic array assisted triboelectric nanogenerator sensor for real-time gesture interaction. Nano-Micro Lett 13(1):51. https://doi.org/10.1007/s40820-020-00575-2
Qiu CK, Wu F, Lee CK, Yuce MR (2020) Self-powered control interface based on gray code with hybrid triboelectric and photovoltaics energy harvesting for IoT smart home and access control applications. Nano Energy 70. https://doi.org/10.1016/j.nanoen.2020.104456
Shan LT, Liu YQ, Zhang XH, Li EL, Yu RJ, Lian QM, Chen X, Chen HP, Guo TL (2021) Bioinspired kinesthetic system for human-machine interaction. Nano Energy 88. https://doi.org/10.1016/j.nanoen.2021.106283
Shi QF, Lee CK (2019) Self-powered bio-inspired spider-net-coding interface using single-electrode triboelectric nanogenerator. Adv Sci 6(15):1900617. https://doi.org/10.1002/advs.201900617
Shi QF, Zhang ZX, Chen T, Lee CK (2019) Minimalist and multi-functional human machine interface (HMI) using a flexible wearable triboelectric patch. Nano Energy 62:355–366. https://doi.org/10.1016/j.nanoen.2019.05.033
Shi YX, Wang F, Tian JW, Li SY, Fu EG, Nie JH, Lei R, Ding YF, Chen XY, Wang ZL (2021) Self-powered electro-tactile system for virtual tactile experiences. Sci Adv 7(6):eabe2943. https://doi.org/10.1126/sciadv.abe2943
Shi X, Luo JJ, Luo JZ, Li XJ, Han K, Li D, Cao X, Wang ZL (2022) Flexible wood-based triboelectric self-powered smart home system. ACS Nano 16(2):3341–3350. https://doi.org/10.1021/acsnano.1c11587
Tan PC, Han X, Zou Y, Qu XC, Xue JT, Li T, Wang YQ, Luo RZ, Cui X, Xi Y, Wu L, Xue B, Luo D, Fan Y, Chen X, Li Z, Wang ZL (2022) Self-powered gesture recognition wristband enabled by machine learning for full keyboard and multicommand input. Adv Mater 34(21):2200793. https://doi.org/10.1002/adma.202200793
Tang YJ, Zhou H, Sun XP, Diao NH, Wang JB, Zhang BS, Qin C, Liang EJ, Mao YC (2020) Triboelectric touch-free screen sensor for noncontact gesture recognizing. Adv Funct Mater 30(5). https://doi.org/10.1002/adfm.201907893
Wang XC, Sun JL, Dong L, Lv CF, Zhang KK, Shang YY, Yang T, Wang JZ, Shan C-X (2019a) Stretchable and transparent electroluminescent device driven by triboelectric nanogenerator. Nano Energy 58:410–418. https://doi.org/10.1016/j.nanoen.2019.01.058
Wang JQ, Wang HY, Li XY, Zi YL (2019b) Self-powered electrowetting optical switch driven by a triboelectric nanogenerator for wireless sensing. Nano Energy 66:104140. https://doi.org/10.1016/j.nanoen.2019.104140
Wang H, Cheng J, Wang ZZ, Ji LH, Wang ZL (2021) Triboelectric nanogenerators for human-health care. Sci Bull 66(5):490–511. https://doi.org/10.1016/j.scib.2020.10.002
Wei XY, Wang XD, Kuang SY, Su L, Li HY, Wang Y, Pan C, Wang ZL, Zhu G (2016) Dynamic triboelectrification-induced electroluminescence and its use in visualized sensing. Adv Mater 28(31):6656–6664. https://doi.org/10.1002/adma.201600604
Wen F, Sun ZD, He TYY, Shi QF, Zhu ML, Zhang ZX, Li LH, Zhang T, Lee CK (2020) Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR/AR applications. Adv Sci 7(14):2000261. https://doi.org/10.1002/advs.202000261
Wu CS, Ding WB, Liu RY, Wang JY, Wang AC, Wang J, Li SM, Zi YL, Wang ZL (2018a) Keystroke dynamics enabled authentication and identification using triboelectric nanogenerator array. Mater Today 21(3):216–222. https://doi.org/10.1016/j.mattod.2018.01.006
Wu HX, Su ZM, Shi MY, Miao LM, Song Y, Chen HT, Han MD, Zhang HX (2018b) Self-powered noncontact electronic skin for motion sensing. Adv Funct Mater 28(6):1704641. https://doi.org/10.1002/adfm.201704641
Xiang SX, Tang JF, Yang L, Guo YJ, Zhao ZB, Zhang WQ (2022) Deep learning-enabled real-time personal handwriting electronic skin with dynamic thermoregulating ability. NPJ Flexible Electron 6(1):59. https://doi.org/10.1038/s41528-022-00195-3
Xu ZY, Zhou FH, Yan HZ, Gao GR, Li HJ, Li R, Chen T (2021) Anti-freezing organohydrogel triboelectric nanogenerator toward highly efficient and flexible human-machine interaction at −30 °C. Nano Energy 90:106614. https://doi.org/10.1016/j.nanoen.2021.106614
Yang J, Chen J, Su YJ, Jing QS, Li ZL, Yi F, Wen XN, Wang ZN, Wang ZL (2015) Eardrum-inspired active sensors for self-powered cardiovascular system characterization and throat-attached anti-interference voice recognition. Adv Mater 27(8):1316–1326. https://doi.org/10.1002/adma.201404794
Yang WF, Gong W, Gu W, Liu ZX, Hou CY, Li YG, Zhang QH, Wang HZ (2021) Self-powered interactive fiber electronics with visual-digital synergies. Adv Mater 33(45):e2104681. https://doi.org/10.1002/adma.202104681
Yang J, An J, Sun YS, Zhang JJ, Zu LL, Li H, Jiang T, Chen BD, Wang ZL (2022) Transparent self-powered triboelectric sensor based on PVA/PA hydrogel for promoting human-machine interaction in nursing and patient safety. Nano Energy 97:107199. https://doi.org/10.1016/j.nanoen.2022.107199
Yi J, Dong K, Shen S, Jiang Y, Peng X, Ye CY, Wang ZL (2021) Fully fabric-based triboelectric nanogenerators as self-powered human-machine interactive keyboards. Nano-Micro Lett 13(1):103. https://doi.org/10.1007/s40820-021-00621-7
Yuan ZQ, Zhou T, Yin YY, Cao R, Li CJ, Wang ZL (2017) Transparent and flexible triboelectric sensing array for touch security applications. ACS Nano 11(8):8364–8369. https://doi.org/10.1021/acsnano.7b03680
Zhang WQ, Deng LF, Yang L, Yang P, Diao DF, Wang PF, Wang ZL (2020) Multilanguage-handwriting self-powered recognition based on triboelectric nanogenerator enabled machine learning. Nano Energy 77:105174. https://doi.org/10.1016/j.nanoen.2020.105174
Zhang TT, Xie LJ, Li JY, Huang ZG, Lei H, Liu YN, Wen Z, Xie YL, Sun XH (2021) All-in-one self-powered human-machine interaction system for wireless remote telemetry and control of intelligent cars. Nano 11(10):2711. https://doi.org/10.3390/nano11102711
Zhang RY, Hummelgård M, Örtegren J, Olsen M, Andersson H, Yang Y, Olin H, Wang ZL (2022a) Utilising the triboelectricity of the human body for human-computer interactions. Nano Energy 100:107503. https://doi.org/10.1016/j.nanoen.2022.107503
Zhang Q, Jin T, Cai JG, Xu L, He TYY, Wang TH, Tian YZ, Li L, Peng Y, Lee CK (2022b) Wearable triboelectric sensors enabled gait analysis and waist motion capture for IoT-based smart healthcare applications. Adv Sci 9(4):2103694. https://doi.org/10.1002/advs.202103694
Zheng L, Wu YL, Chen XY, Yu AF, Xu L, Liu YS, Li HX, Wang ZL (2017) Self-powered electrostatic actuation systems for manipulating the movement of both microfluid and solid objects by using triboelectric nanogenerator. Adv Funct Mater 27(16):1606408. https://doi.org/10.1002/adfm.201606408
Zhou H, Li DX, He XM, Hui XD, Guo HY, Hu CG, Mu XJ, Wang ZL (2021) Bionic ultra-sensitive self-powered electromechanical sensor for muscle-triggered communication application. Adv Sci 8(15):2101020. https://doi.org/10.1002/advs.202101020
Zhu PC, Zhang BS, Wang HY, Wu YH, Cao HJ, He LB, Li CY, Luo XP, Li X, Mao YC (2022) 3D printed triboelectric nanogenerator as self-powered human-machine interactive sensor for breathing-based language expression. Nano Res 15:7460–7467. https://doi.org/10.1007/s12274-022-4339-x
Zu LL, Liu D, Shao JJ, Liu Y, Shu S, Li CY, Shi X, Chen BD, Wang ZL (2021) A self-powered early warning glove with integrated elastic-arched triboelectric nanogenerator and flexible printed circuit for real-time safety protection. Adv Mater Technol 7(5):2100787. https://doi.org/10.1002/admt.202100787
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2023 Springer Nature Switzerland AG
About this entry
Cite this entry
Wu, Z. (2023). Triboelectric Nanogenerator for Human-Machine Interfacing. In: Wang, Z.L., Yang, Y., Zhai, J., Wang, J. (eds) Handbook of Triboelectric Nanogenerators. Springer, Cham. https://doi.org/10.1007/978-3-031-05722-9_44-1
Download citation
DOI: https://doi.org/10.1007/978-3-031-05722-9_44-1
Received:
Accepted:
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-05722-9
Online ISBN: 978-3-031-05722-9
eBook Packages: Springer Reference Chemistry and Mat. ScienceReference Module Physical and Materials ScienceReference Module Chemistry, Materials and Physics