Advances in photonic reservoir computing

Nanophotonics - Tập 6 Số 3 - Trang 561-576 - 2017
Guy Van der Sande1, Daniel Brunner2, Miguel C. Soriano3
1Applied Physics Research Group (APHY), Vrije Universiteit Brussel (VUB), Pleinlaan 2, 1050 Brussels, Belgium
2UMR CNRS FEMTO-ST 6174/Optics Department, Université de Bourgogne Franche-Comté, 15 Avenue des Montboucon, F-25030 Besançon Cedex, France
3Instituto de Física Interdisciplinar y Sistemas Complejos, IFISC (CSIC-UIB), Campus Universitat de les Illes Balears, 07122 Palma de Mallorca, Spain

Tóm tắt

AbstractWe review a novel paradigm that has emerged in analogue neuromorphic optical computing. The goal is to implement a reservoir computer in optics, where information is encoded in the intensity and phase of the optical field. Reservoir computing is a bio-inspired approach especially suited for processing time-dependent information. The reservoir’s complex and high-dimensional transient response to the input signal is capable of universal computation. The reservoir does not need to be trained, which makes it very well suited for optics. As such, much of the promise of photonic reservoirs lies in their minimal hardware requirements, a tremendous advantage over other hardware-intensive neural network models. We review the two main approaches to optical reservoir computing: networks implemented with multiple discrete optical nodes and the continuous system of a single nonlinear device coupled to delayed feedback.

Từ khóa


Tài liệu tham khảo

Nguimdo, 2014, der Fast photonic information processing using semiconductor lasers with delayed optical feedback : role of phase dynamics, Opt Express, 22, 8672, 10.1364/OE.22.008672

Vinckier, 2015, High - performance photonic reservoir computer based on a coherently driven passive cavity, Optica, 2, 438, 10.1364/OPTICA.2.000438

Lukoševičius, 2009, Reservoir computing approaches to recurrent neural network training, Comput Sci Rev, 3, 127, 10.1016/j.cosrev.2009.03.005

Selmi, 2014, Relative refractory period in an excitable semiconductor laser, Phys Rev Lett, 112, 183902, 10.1103/PhysRevLett.112.183902

Soriano, 2013, Optoelectronic reservoir computing : tackling noise - induced performance degradation, Opt Express, 21, 12, 10.1364/OE.21.000012

Hopfield, 1985, Neural computation of decisions in optimization problems, Biol Cybern, 52, 141, 10.1007/BF00339943

Fernando, 2003, Pattern recognition in a bucket In eds Advances in Artificial Life in Computer vol Berlin, ECAL Lecture Notes Science, 2801

Hermans, 2015, Optoelectronic systems trained with backpropagation through time Neural Netw Learn, IEEE Trans Syst, 26, 1545

Soriano, 2015, Delay - based reservoir computing : noise effects in a combined analog and digital implementation Neural Netw Learn, IEEE Trans Syst, 26, 388

Furber, 2006, Neural systems engineering, Soc Interf, 4, 193, 10.1098/rsif.2006.0177

Nguimdo, 2015, der Simultaneous computation of two independent tasks using reservoir computing based on a single photonic nonlinear node with optical feedback Neural Netw Learn, IEEE Trans Syst, 26, 3301

Martinenghi, 2012, Photonic nonlinear transient computing with multiple - delay wavelength dynamics, Phys Rev Lett, 108, 244101, 10.1103/PhysRevLett.108.244101

Brunner, 2013, Parallel photonic information processing at gigabyte per second data rates using transient states, Nat Commun, 4, 1364, 10.1038/ncomms2368

Rast, 2011, Concurrent heterogeneous neural model simulation on real - time neuromimetic hardware, Neural Networks, 24, 961, 10.1016/j.neunet.2011.06.014

Coomans, 2011, der Solitary and coupled semiconductor ring lasers as optical spiking neurons, Phys Rev E, 84, 036209, 10.1103/PhysRevE.84.036209

Rodan, 2011, Minimum complexity echo state network, IEEE Trans Neural Netw, 22, 131, 10.1109/TNN.2010.2089641

Brunner, 2013, High - speed optical vector and matrix operations using a semiconductor laser, IEEE Photonics Tech Lett, 25, 1680, 10.1109/LPT.2013.2273373

Psaltis, 1990, Holography in artificial neural networks, Nature, 343, 325, 10.1038/343325a0

Vandoorne, 2014, Experimental demonstration of reservoir computing on a silicon photonics chip, Nat Commun, 5, 1, 10.1038/ncomms4541

Erneux, 2009, Applied delayed differential equations New York Springer Media, Science Business

Cireşan, 2010, Deep , big , simple neural nets for handwritten digit recognition, Neural Comput, 22, 3207, 10.1162/NECO_a_00052

Argyris, 2005, Chaos - based communications at high bit rates using commercial fibre - optic links, Nature, 438, 343, 10.1038/nature04275

Krizhevsky, 2012, Imagenet classification with deep convolutional neural networks Adv Neural Inf, Process Syst, 25, 1106

Hurtado, 2012, Investigation of vertical cavity surface emitting laser dynamics for neuromorphic photonic systems Paper number, Appl Phys Lett, 100, 103703, 10.1063/1.3692726

Shastri, 2016, Spike processing with a graphene excitable laser, Sci Rep, 6, 19126, 10.1038/srep19126

Nakajima, 2014, Exploiting short - term memory in soft body dynamics as a computational resource, Soc Interf, 11, 20140437, 10.1098/rsif.2014.0437

Soriano, 2013, Complex photonics : dynamics and applications of delay - coupled semiconductors lasers, Rev Mod Phys, 85, 421, 10.1103/RevModPhys.85.421

Vandoorne, 2011, Parallel reservoir computing using optical amplifiers, IEEE Trans Neural Netw, 22, 1469, 10.1109/TNN.2011.2161771

Soriano, 2015, Minimal approach to neuro - inspired information processing, Front Comput Neurosci, 9, 68, 10.3389/fncom.2015.00068

Steil, 2004, Backpropagation - decorrelation : online recurrent learning with O complexity, IJCNN, 1, 843

Ivakhnenko, 1971, Polynomial theory of complex systems, IEEE T Syst Man Cyb, 1, 364, 10.1109/TSMC.1971.4308320

Lukoševičius, 2012, Reservoir computing trends, KI Künstliche Intelligenz, 26, 365, 10.1007/s13218-012-0204-5

Duport, 2016, Fully analogue photonic reservoir computer, Sci Rep, 6, 22381, 10.1038/srep22381

Caluwaerts, 2012, Locomotion without a brain : physical reservoir computing in tensegrity structures, Artif Life, 19, 35, 10.1162/ARTL_a_00080

Huang, 2011, Extreme learning machines : a survey, Int J Mach Learn Cyber, 2, 107, 10.1007/s13042-011-0019-y

Maass, 2002, Real - time computing without stable states : a new framework for neural computation based on perturbations, Neural Comput, 14, 2531, 10.1162/089976602760407955

Brunner, 2015, Reconfigurable semiconductor laser networks based on diffractive coupling, Opt lett, 40, 3854, 10.1364/OL.40.003854

Duport, 2016, Virtualization of a photonic reservoir computer, J Lightwave Technol, 34, 2085, 10.1109/JLT.2016.2524559

Jutamulia, 1996, Overview of hybrid optical neural networks, Opt Laser Technol, 28, 59, 10.1016/0030-3992(95)00070-4

Dejonckheere, 2014, All - optical reservoir computer based on saturation of absorption, Opt Express, 22, 10868, 10.1364/OE.22.010868

Silver, 2016, Mastering the game of go with deep neural networks and tree search, Nature, 529, 484, 10.1038/nature16961

Nakayama, 2016, Laser dynamical reservoir computing with consistency : an approach of a chaos mask signal, Opt Express, 24, 8679, 10.1364/OE.24.008679

Dambre, 2012, Information processing capacity of dynamical systems, Sci Rep, 2, 514, 10.1038/srep00514

Barbay, 2011, Excitability in a semiconductor laser with saturable absorber, Opt Lett, 36, 4476, 10.1364/OL.36.004476

Tait, 2014, Broadcast and weight : an integrated network for scalable photonic spike processing, J Lightwave Technol, 32, 3427, 10.1109/JLT.2014.2345652

Ikeda, 1980, Optical turbulence : chaotic behavior of transmitted light from a ring cavity, Phys Rev Lett, 45, 709, 10.1103/PhysRevLett.45.709

Vaerenbergh, 2012, Cascadable excitability in microrings, Opt Express, 20, 20292, 10.1364/OE.20.020292

Nguimdo, 2016, der Reducing the phase sensitivity of laser - based optical reservoir computing systems, Opt Express, 24, 1238, 10.1364/OE.24.001238

Lavrov, 2010, Nonlocal nonlinear electro - optic phase dynamics demonstrating Gb / s chaos communications, IEEE J Quantum Elect, 46, 1430, 10.1109/JQE.2010.2049987

Uchida, 2008, Fast physical random bit generation with chaotic semiconductor lasers, Nat Photon, 2, 728, 10.1038/nphoton.2008.227

Paquot, 2012, Optoelectronic reservoir computing, Sci Rep, 2, 287, 10.1038/srep00287

Hicke, 2013, Information processing using transient dynamics of semiconductor lasers subject to delayed feedback, IEEE J Sel Top Quant, 19, 1501610, 10.1109/JSTQE.2013.2241738

Nahmias, 2015, Excitable laser processing network node in hybrid silicon : analysis and simulation, Opt Express, 23, 26800, 10.1364/OE.23.026800

Verstraeten, 2007, An experimental unification of reservoir computing methods, Neural Networks, 20, 391, 10.1016/j.neunet.2007.04.003

Merolla, 2014, A million spiking - neuron integrated circuit with a scalable communication network and interface, Science, 345, 668, 10.1126/science.1254642

Hauser, 2011, Towards a theoretical foundation for morphological computation with compliant bodies, Biol Cybern, 105, 355, 10.1007/s00422-012-0471-0

Oliver, 2015, Consistency properties of a chaotic semiconductor laser driven by optical feedback, Phys Rev Lett, 114, 123902, 10.1103/PhysRevLett.114.123902

Vandoorne, 2008, Toward optical signal processing using photonic reservoir computing, Opt Express, 16, 11182, 10.1364/OE.16.011182

Uchida, 2008, Local conditional Lyapunov exponent characterization of consistency of dynamical response of the driven Lorenz system, Phys Rev E Stat Nonlin Soft Matter Phys, 78, 036203, 10.1103/PhysRevE.78.036203

Appeltant, 2014, der Constructing optimized binary masks for reservoir computing with delay systems, Sci Rep, 4, 3629, 10.1038/srep03629

Goedgebuer, 1998, Chaos in wavelength with a feedback tunable laser diode, Phys Rev E, 57, 2795, 10.1103/PhysRevE.57.2795

Larger, 2012, Photonic information processing beyond turing : an optoelectronic implementation of reservoir computing, Opt Express, 20, 3241, 10.1364/OE.20.003241

Jaeger, 2004, Harnessing nonlinearity : predicting chaotic systems and saving energy in wireless communication, Science, 304, 78, 10.1126/science.1091277

Duport, 2012, All - optical reservoir computing, Opt Express, 20, 22783, 10.1364/OE.20.022783

Salehi, 2014, Optical signal processing using photonic reservoir computing, J Mod Opt, 61, 144, 10.1080/09500340.2014.940017

Woods, 2012, Optical computing : photonic neural networks, Nat Phys, 8, 257, 10.1038/nphys2283

Appeltant, 2011, der Information processing using a single dynamical node as complex system, Nat Commun, 2, 468, 10.1038/ncomms1476

Ortín, 2015, A unified framework for reservoir computing and extreme learning machines based on a single time - delayed neuron, Sci Rep, 5, 14945, 10.1038/srep14945

Hermans, 2015, Photonic delay systems as machine learning implementations, J Mach Learn Res, 16, 2081