A bimodal soft electronic skin for tactile and touchless interaction in real time

Nature Communications - Tập 10 Số 1
Ge Jin1, Xu Wang1, Michael Drack2, Oleksii M. Volkov1, Mo Liang1, Gilbert Santiago Cañón Bermúdez1, Rico Illing1, Changan Wang1, Shengqiang Zhou1, J. Faßbender1, Martin Kaltenbrunner2, Denys Makarov1
1Helmholtz-Zentrum Dresden-Rossendorf e.V., Institute of Ion Beam Physics and Materials Research, Bautzner Landstrasse 400, 01328 Dresden, Germany
2Soft Materials Lab, Linz Institute of Technology, Johannes Kepler University Linz, Altenberger Strasse 69, 4040, Linz, Austria

Tóm tắt

AbstractThe emergence of smart electronics, human friendly robotics and supplemented or virtual reality demands electronic skins with both tactile and touchless perceptions for the manipulation of real and virtual objects. Here, we realize bifunctional electronic skins equipped with a compliant magnetic microelectromechanical system able to transduce both tactile—via mechanical pressure—and touchless—via magnetic fields—stimulations simultaneously. The magnetic microelectromechanical system separates electric signals from tactile and touchless interactions into two different regions, allowing the electronic skins to unambiguously distinguish the two modes in real time. Besides, its inherent magnetic specificity overcomes the interference from non-relevant objects and enables signal-programmable interactions. Ultimately, the magnetic microelectromechanical system enables complex interplay with physical objects enhanced with virtual content data in augmented reality, robotics, and medical applications.

Từ khóa


Tài liệu tham khảo

Wang, S. et al. Skin electronics from scalable fabrication of an intrinsically stretchable transistor array. Nature 555, 83–88 (2018).

Kim, Y. et al. A bioinspired flexible organic artificial afferent nerve. Science 360, 998–1003 (2018).

Miyamoto, A. et al. Inflammation-free, gas-permeable, lightweight, stretchable on-skin electronics with nanomeshes. Nat. Nanotechnol. 12, 907–913 (2017).

Larson, C. et al. Highly stretchable electroluminescent skin for optical signaling and tactile sensing. Science 351, 1071–1074 (2016).

Kang, S.-K. et al. Bioresorbable silicon electronic sensors for the brain. Nature 530, 71–76 (2016).

Gao, W. et al. Fully integrated wearable sensor arrays for multiplexed in situ perspiration analysis. Nature 529, 509–514 (2016).

Chortos, A., Liu, J. & Bao, Z. Pursuing prosthetic electronic skin. Nat. Mater. 15, 937 (2016).

Kaltenbrunner, M. et al. An ultra-lightweight design for imperceptible plastic electronics. Nature 499, 458–463 (2013).

Hammock, M. L. et al. 25th anniversary article: the evolution of electronic skin (E-Skin): a brief history, design considerations, and recent progress. Adv. Mater. 25, 5997–6038 (2013).

Maisto, M. et al. Evaluation of wearable haptic systems for the fingers in augmented reality applications. IEEE Trans. Haptics 10, 511–522 (2017).

Giordano, M. et al. Mid-air haptics for control interfaces. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems p.W15, (ACM, 2018).

Lee, L. H. & Hui, P. Interaction methods for smart glasses: a survey. IEEE Access 6, 28712–28732 (2018).

Cantón, P., González, Á. L., Mariscal, G. & Ruiz, C. Applying new interaction paradigms to the education of children with special educational needs. In International Conference on Computers for Handicapped Persons 65–72 (Springer, Berlin, Heidelberg, 2012).

Huang, D.-Y. et al. DigitSpace: designing thumb-to-fingers touch interfaces for one-handed and eyes-free interactions. In Proc. 2016 CHI Conference on Human Factors in Computing Systems 1526–1537 (ACM, 2016).

Pan, L. et al. An ultra-sensitive resistive pressure sensor based on hollow-sphere microstructure induced elasticity in conducting polymer film. Nat. Commun. 5, 3002 (2014).

Jin, G. et al. A stretchable electronic fabric artificial skin with pressure-, lateral strain-, and flexion-sensitive properties. Adv. Mater. 28, 722–728 (2016).

Lee, S. et al. A transparent bending-insensitive pressure sensor. Nat. Nanotechnol. 11, 472–478 (2016).

Dagdeviren, C. et al. Conformable amplified lead zirconate titanate sensors with enhanced piezoelectric response for cutaneous pressure monitoring. Nat. Commun. 5, 4496 (2014).

Wu, W., Wen, X. & Wang, Z. L. Taxel-addressable matrix of vertical-nanowire piezotronic transistors for active/adaptive tactile imaging. Science 340, 952–957 (2013).

Sungmook, J. et al. Reverse-micelle-induced porous pressure-sensitive rubber for wearable human–machine interfaces. Adv. Mater. 26, 4825–4830 (2014).

Jun, F. et al. Giant moisture responsiveness of VS2 ultrathin nanosheets for novel touchless positioning interface. Adv. Mater. 24, 1969–1974 (2012).

Katalin, S. et al. Touchless optical finger motion tracking based on 2D nanosheets with giant moisture responsiveness. Adv. Mater. 27, 6341–6348 (2015).

Melzer, M. et al. Imperceptible magnetoelectronics. Nat. Commun. 6, 6080 (2015).

Michael, M. et al. Wearable magnetic field sensors for flexible electronics. Adv. Mater. 27, 1274–1280 (2015).

Cañón Bermúdez, G. S. et al. Magnetosensitive e-skins with directional perception for augmented reality. Sci. Adv. 4, eaao2623 (2018).

Martin, Z. et al. An all-printed ferroelectric active matrix sensor network based on only five functional materials forming a touchless control interface. Adv. Mater. 23, 2069–2074 (2011).

Oh, N. et al. Double-heterojunction nanorod light-responsive LEDs for display applications. Science 355, 616–619 (2017).

Zhang, B. et al. Dual functional transparent film for proximity and pressure sensing. Nano Res. 7, 1488–1496 (2014).

Sarwar, M. S. et al. Bend, stretch, and touch: Locating a finger on an actively deformed transparent sensor array. Sci. Adv. 3, e1602200 (2017).

Black, D. et al. Auditory display as feedback for a novel eye-tracking system for sterile operating room interaction. Int. J. Comput. Assist. Radiol. Surg. 13, 37–45 (2018).

Ming, Y. et al. Silicon nanomembranes for fingertip electronics. Nanotechnology 23, 344004 (2012).

Bartolozzi, C., Natale, L., Nori, F. & Metta, G. Robots with a sense of touch. Nat. Mater. 15, 921–925 (2016).

Tai, K., El-Sayed, A.-R., Shahriari, M., Biglarbegian, M. & Mahmud, S. State of the art robotic grippers and applications. Robotics 5, 11 (2016).

Boland, J. J. Within touch of artificial skin. Nat. Mater. 9, 790–792 (2010).

Park, S. et al. Stretchable energy-harvesting tactile electronic skin capable of differentiating multiple mechanical stimuli modes. Adv. Mater. 26, 7324–7332 (2014).

Pang, C. et al. A flexible and highly sensitive strain-gauge sensor using reversible interlocking of nanofibres. Nat. Mater. 11, 795–801 (2012).

Wang, X., Gu, Y., Xiong, Z., Cui, Z. & Zhang, T. Silk-molded flexible, ultrasensitive, and highly stable electronic skin for monitoring human physiological signals. Adv. Mater. 26, 1336–1342 (2014).

Cañón Bermúdez, G. S. et al. Electronic-skin compasses for geomagnetic field-driven artificial magnetoreception and interactive electronics. Nat. Electron. 1, 589–595 (2018).

Wang, Z., Shaygan, M., Otto, M., Schall, D. & Neumaier, D. Flexible Hall sensors based on graphene. Nanoscale 8, 7683–7687 (2016).

Granell, P. N. et al. Highly compliant planar Hall effect sensor with sub 200 nT sensitivity. npj Flex. Electron. 3, 3 (2019).