Machine-learning reprogrammable metasurface imager

Nature Communications - Tập 10 Số 1
Lianlin Li1, Hengxin Ruan1, Che Liu2, Ying Li3, Ya Shuang1, Andrea Alù4, Cheng‐Wei Qiu3, Tie Jun Cui2
1State Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronics, Peking University, 100871, Beijing, China
2State Key Laboratory of Millimeter Waves, Southeast University, 210096, Nanjing, China
3Department of Electrical and Computer Engineering, National University of Singapore, 4 Engineering Drive 3, Singapore 117583, Singapore
4Photonics Initiative, Advanced Science Research Center, City University of New York, 85 St. Nicholas Terrace, New York, NY, 10031, USA

Tóm tắt

AbstractConventional microwave imagers usually require either time-consuming data acquisition, or complicated reconstruction algorithms for data post-processing, making them largely ineffective for complex in-situ sensing and monitoring. Here, we experimentally report a real-time digital-metasurface imager that can be trained in-situ to generate the radiation patterns required by machine-learning optimized measurement modes. This imager is electronically reprogrammed in real time to access the optimized solution for an entire data set, realizing storage and transfer of full-resolution raw data in dynamically varying scenes. High-accuracy image coding and recognition are demonstrated in situ for various image sets, including hand-written digits and through-wall body gestures, using a single physical hardware imager, reprogrammed in real time. Our electronically controlled metasurface imager opens new venues for intelligent surveillance, fast data acquisition and processing, imaging at various frequencies, and beyond.

Từ khóa


Tài liệu tham khảo

Hunt, J. et al. Metamaterial apertures for computational imaging. Science 339, 310 (2013).

Wang, L., Li, L., Li, Y., Zhang, H. & Cui, T. J. Single-shot and single-sensor high/super-resolution microwave imaging based on metasurface. Sci. Rep. 6, 26959 (2016).

Gollub, J. N. et al. Large metasurface aperture for millimeter wave computational imaging at the human-scale. Sci. Rep. 7, 42650 (2016).

Marks, D. L., Gollub, J. & Smith, D. R. Spatially resolving antenna arrays using frequency diversity. JOSA A 33, 899–912 (2016).

Fromenteze, T. et al. Computational polarimetric microwave imaging. Opt. Express 25, 27488–27505 (2017).

Redo-Sanchez, A. et al. Terahertz time-gated spectral imaging for content extraction through layered structures. Nat. Commun. 7, 12665 (2016).

Patel, V. M., Mait, J. N., Prather, D. W. & Hedden, A. S. Computational millimeter wave imaging. IEEE Sig. Proc. Mag. 1053, 5888 (2016).

Chan, W., Charan, K., Takhar, D. & Kelly, K. A single-pixel terahertz imaging system based on compressed sensing. Appl. Phys. Lett. 93, 121105 (2008).

Sankaranarayanan, A. C., Turaga, P., Herman, M. A. & Kelly, K. F. Enhanced compressive imaging using model-based acquisition. IEEE Sig. Proc. Mag. 1053, 5888 (2016).

Neifeld, M. A. & Shankar, P. Feature-specific imaging. Appl. Opt. 42, 3379–3389 (2003).

Pal, H. S., Ganotra, D. & Neifeld, M. A. Face recognition by using feature-specific imaging. Appl. Opt. 44, 3378–3794 (2005).

Kulkarni, K. & Turaga, P. Reconstruction-free action inference from compressive imagers. IEEE Trans. Pattern Anal. Mach. Intell. 38, 772–784 (2016).

Nayar, S. K. & Branzoi, V. Programmable imaging: toward a flexible camera. Int. J. Comput. Vision. 20, 7–22 (2006).

Jolliffe, I. T. Principal Component Analysis. (Springer, New York, 2002).

Tipping, M. E. & Bishop, C. M. Probabilistic principal component analysis. J. R. Stat. Soc. 61, 611–622 (1999).

Halko, N., Martinsson, P. G. & Tropp, J. A. Finding structure randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev. 53, 217–288 (2011).

Cui, T. J., Qi, M. Q., Wan, X., Zhao, J. & Cheng, Q. Coding metamaterials, digital metamaterials and programmable metamaterials. Light Sci. Appl. 3, e218 (2014).

Li, L. et al. Electromagnetic reprogrammable coding metasurface holograms. Nat. Commun. 8, 197 (2017).

Li, Y. B. et al. Transmission-type 2-bit programmable metasurface for single-sensor and single-frequency microwave imaging. Sci. Rep. 6, 23731 (2016).

Yang, H. et al. A programmable metasurface with dynamic polarization, scattering and focusing control. Sci. Rep. 6, 35692 (2016).

Shitrit, N. et al. Spin-optical metamaterial route to spin-controlled photonics. Science 340, 724–726 (2013).

Ni, X., Kildishev, A. V. & Shalaev, V. M. Metasurface holograms for visible light. Nat. Commun. 4, 3807 (2013).

Zheng, G. et al. Metasurface holograms reaching 80% efficiency. Nat. Nanotechnol. 10, 308–312 (2015).

Yu, N. et al. Light propagation with phase discontinuities: generalized laws of reflection and refraction. Science 334, 333–337 (2011).

Ni, X., Emani, N. K., Kildishev, A. V., Boltasseva, A. & Shalaev, V. M. Broadband light bending with plasmonic nanoantennas. Science 335, 427–427 (2012).

Larouche, S., Tsai, Y.-J., Tyler, T., Jokerst, N. M. & Smith, D. R. Infrared metamaterial phase holograms. Nat. Mater. 11, 450–454 (2012).

Liu, H. C. et al. Single-pixel computational ghost imaging with helicity-dependent metasurface hologram. Sci. Adv. 3, e1701477 (2017).

Walther, B. et al. Spatial and spectral light shaping with metamaterials. Adv. Mater. 24, 6300–6304 (2012).

Genevet, P., Lin, J., Kats, M. A. & Capasso, F. Holographic detection of the orbital angular momentum of light with plasmonic photodiodes. Nat. Commun. 3, 1278 (2012).

Dicken, M. J. et al. Frequency tunable near-infrared metamaterials based on VO2 phase transition. Opt. Express 17, 18330 (2009).

Yao, Y. et al. Broad electrical tuning of graphene-loaded plasmonic antennas. Nano Lett. 13, 1257–1264 (2013).

Ou, J.-Y., Plum, E., Zhang, J. & Zheludev, N. I. An electromechanically reconfigurable plasmonic metamaterial operating in the near-infrared. Nat. Nanotechnol. 8, 252–255 (2013).

Wang, Q. et al. Optically reconfigurable metasurfaces and photonic devices based on phase change materials. Nat. Photonics 10, 60–65 (2015).

Kaplan, G., Aydin, K. & Scheuer, J. Dynamically controlled plasmonic nano-antenna phased array utilizing vanadium dioxide. Opt. Mater. Express 5, 2513 (2015).

Huang, Y.-W. et al. Gate-tunable conducting oxide metasurfaces. Nano Lett. 16, 5319–5325 (2016).

Ou, J. Y., Plum, E., Jiang, L. & Zheludev, N. I. Reconfigurable photonic metamaterials. Nano Lett. 11, 2142–2144 (2011).