Emulating short-term synaptic dynamics with memristive devices

Scientific Reports - Tập 6 Số 1
Radu Berdan1, Eleni Vasilaki2, Ali Khiat3, Giacomo Indiveri4, Alexantrou Serb3, Themistoklis Prodromakis3
1Dept. of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK
2Department of Computer Science, University of Sheffield, Sheffield, UK
3Nano Research Group, School of Electronics and Computer Science, University of Southampton, Southampton SO17 1BJ, UK
4Institute of Neuroinformatics, University of Zurich and ETH Zurich, CH.

Tóm tắt

AbstractNeuromorphic architectures offer great promise for achieving computation capacities beyond conventional Von Neumann machines. The essential elements for achieving this vision are highly scalable synaptic mimics that do not undermine biological fidelity. Here we demonstrate that single solid-state TiO2 memristors can exhibit non-associative plasticity phenomena observed in biological synapses, supported by their metastable memory state transition properties. We show that, contrary to conventional uses of solid-state memory, the existence of rate-limiting volatility is a key feature for capturing short-term synaptic dynamics. We also show how the temporal dynamics of our prototypes can be exploited to implement spatio-temporal computation, demonstrating the memristors full potential for building biophysically realistic neural processing systems.

Từ khóa


Tài liệu tham khảo

Markram, H., Wang, Y. & Tsodyks, M. Differential signaling via the same axon of neocortical pyramidal neurons. Proc Natl Acad Sci USA 95, 5323–5328 (1998).

Le Be, J.-V. & Markram, H. Spontaneous and evoked synaptic rewiring in the neonatal neocortex. Proc Natl Acad Sci USA 103, 13214–13219 (2006).

Rinaldi, T. Hyper-connectivity and hyper-plasticity in the medial prefrontal cortex in the valproic acid animal model of autism. Front. Neural Circuits 2 (2008).

Testa-Silva, G. et al. Hyperconnectivity and slow synapses during early development of medial prefrontal cortex in a mouse model for mental retardation and autism. Cerebral Cortex 22, 1333–1342 (2012).

Varela, J. A. et al. A quantitative description of short-term plasticity at excitatory synapses in layer 2/3 of rat primary visual cortex. Journal of Neuroscience 17, 7926–7940 (1997).

Tsodyks, M. V. & Markram, H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc Natl Acad Sci USA 94, 719–723 (1997).

Costa, R. P., Sjoestroem, P. J. & van Rossum, M. C. W. Probabilistic inference of short-term synaptic plasticity in neocortical microcircuits. Front Comput Neurosci 7 (2013).

Rotman, Z. & Klyachko, V. A. Role of synaptic dynamics and heterogeneity in neuronal learning of temporal code. Journal of Neurophysiology 110, 2275–2286 (2013).

Romani, A. et al. Computational modeling of the effects of amyloid-beta on release probability at hippocampal synapses. Front Comput Neurosci 7 (2013).

Hennig, M. H. Theoretical models of synaptic short term plasticity. Front Comput Neurosci 7 (2013).

Natschläger, T., Maass, W. & Zador, A. Efficient temporal processing with biologically realistic dynamic synapses. Network 12, 75–87 (2001).

Buonomano, D. & Carvalho, T. P. A novel learning rule for long-term plasticity of short-term synaptic plasticity enhances temporal processing. Frontiers in Integrative Neuroscience 5, 1–11 (2011).

Gütig, R. & Sompolinsky, H. The tempotron: a neuron that learns spike timing–based decisions. Nat Neurosci 9, 420–428 (2006).

Pfister, J.-P., Dayan, P. & Lengyel, M. Synapses with short-term plasticity are optimal estimators of presynaptic membrane potentials. Nat Neurosci 13, 1271–1275 (2010).

Wang, Y. et al. Heterogeneity in the pyramidal network of the medial prefrontal cortex. Nat Neurosci 9, 534–542 (2006).

Esposito, U., Giugliano, M., van Rossum, M. & Vasilaki, E. Measuring symmetry, asymmetry and randomness in neural network connectivity. PLoS One 9, e100805 (2014).

Vasilaki, E. & Giugliano, M. Emergence of Connectivity Patterns from Long-Term and Short-Term Plasticities. Proceedings of International Conference on Artificial Neural Networks and Machine Learning (2012).

Vasilaki, E. & Giugliano, M. Emergence of Connectivity Motifs in Networks of Model Neurons with Short- and Long-Term Plastic Synapses. PLoS One 9, e84626–17 (2014).

Esposito, U., Giugliano, M. & Vasilaki, E. Adaptation of short-term plasticity parameters via error-driven learning may explain the correlation between activity-dependent synaptic properties, connectivity motifs and target specificity. Front Comput Neurosci 8 (2015).

Chua, L. O. Memristor-The missing circuit element. Circuit Theory, IEEE Transactions on 18, 507–519 (1971).

Rasche, C. & Hahnloser, R. H. R. Silicon synaptic depression. Biol Cybern 84, 57–62 (2001).

Bartolozzi, C. & Indiveri, G. Synaptic dynamics in analog VLSI. Neural computation 19, 2581–2603 (2007).

Dowrick, T., Hall, S. & McDaid, L. J. Silicon-based dynamic synapse with depressing response. IEEE Transactions on Neural Networks and Learning Systems 23 (2012).

Chicca, E., Indiveri, G. & Douglas, R. An adaptive silicon synapse. in 1 (2003).

Rajendran, B. et al. Specifications of Nanoscale Devices and Circuits for Neuromorphic Computational Systems. IEEE Trans. Electron Devices 60, 246–253 (2013).

Govoreanu, B. et al. 10×10nm2 Hf/HfOx crossbar resistive RAM with excellent performance, reliability and low-energy operation. International Technical Digest on Electron Devices Meeting 31–34 (2011), doi: 10.1109/IEDM.2011.6131652.

Waser, R. & Aono, M. Nanoionics-based resistive switching memories. Nature Materials 6, 833–840 (2007).

Yang, X. & Chen, I.-W. Dynamic-Load-Enabled Ultra-low Power Multiple-State RRAM Devices. Sci. Rep. 2 (2012).

Zamarreño-Ramos, C. et al. On spike-timing-dependent-plasticity, memristive devices and building a self-learning visual cortex. Front Neurosci 5 (2011).

Serrano-Gotarredona, T., Masquelier, T., Prodromakis, T., Indiveri, G. & Linares-Barranco, B. STDP and STDP Variations with Memristors for Spiking Neuromorphic Learning Systems. Frontiers in … 7, 1–15 (2013).

Li, Y. et al. Ultrafast Synaptic Events in a Chalcogenide Memristor. Sci. Rep. 3 (2013).

Indiveri, G., Linares-Barranco, B., Legenstein, R., Deligeorgis, G. & Prodromakis, T. Integration of nanoscale memristor synapses in neuromorphic computing architectures. Nanotechnology 24, 384010 (2013).

Alibart, F., Zamanidoost, E. & Strukov, D. B. Pattern classification by memristive crossbar circuits using ex situ and in situ training. Nature Communications 4, 1–7 (2013).

Subramaniam, A., Cantley, K., Bersuker, G., Gilmer, D. & Vogel, E. Spike-timing-dependent Plasticity using Biologically Realistic Action Potentials and Low-temperature Materials. (2013).

Kuzum, D., Jeyasingh, R. G. D., Lee, B. & Wong, H. S. P. Nanoelectronic Programmable Synapses Based on Phase Change Materials for Brain-Inspired Computing. Nano Lett 12, 2179–2186 (2012).

Jo, S. H. et al. Nanoscale Memristor Device as Synapse in Neuromorphic Systems. Nano Lett 10, 1297–1301 (2010).

Yu, S., Wu, Y., Jeyasingh, R., Kuzum, D. & Wong, H. P. An electronic synapse device based on metal oxide resistive switching memory for neuromorphic computation. IEEE Trans. Electron Devices 58, 2729–2737 (2011).

Seo, K. et al. Analog memory and spike-timing-dependent plasticity characteristics of a nanoscale titanium oxide bilayer resistive switching device. Nanotechnology 22, 254023 (2011).

Strukov, D. B. & Williams, R. S. Exponential ionic drift: fast switching and low volatility of thin-film memristors. Applied Physics A: Materials Science & Processing 94, 515–519 (2009).

Ohno, T. Short-term plasticity and long-term potentiation mimicked in single inorganic synapses. Nature Materials 10, 591–595 (2011).

Markram, H. H. & Tsodyks, M. M. Redistribution of synaptic efficacy between neocortical pyramidal neurons. Nature 382, 807–810 (1996).

Chang, T., Jo, S. H. & Lu, W. Short-Term Memory to Long-Term Memory Transition in a Nanoscale Memristor. ACS Nano 5, 7669–7676 (2011).

Lim, H., Kim, I., Kim, J.-S., Seong Hwang, C. & Jeong, D. S. Short-term memory of TiO 2-based electrochemical capacitors: empirical analysis with adoption of a sliding threshold. Nanotechnology 24, 384005–9 (2013).

Hermiz, J., Chang, T., Du, C. & Lu, W. Interference and memory capacity effects in memristive systems. Appl. Phys. Lett. 102, 083106–6 (2013).

Zhu, L. Q., Wan, C. J., Guo, L. Q., Shi, Y. & Wan, Q. Artificial synapse network on inorganic proton conductor for neuromorphic systems. Nature Communications 5, 1–7 (2015).

Tsodyks, M. V. M. & Markram, H. H. The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability. Proc Natl Acad Sci USA 94, 719–723 (1997).

Buonomano, D. V. D. & Merzenich, M. M. M. Temporal information transformed into a spatial code by a neural network with realistic properties. Science 267, 1028–1030 (1995).

Pershin, Y. V. & Di Ventra, M. Memory effects in complex materials and nanoscale systems. Advances in Physics 60, 145–227 (2011).

Prodromakis, T., Toumazou, C. & Chua, L. Two centuries of memristors. Nature Materials 11, 478–481 (2012).

Fursina, A., Sofin, R., Shvets, I. & Natelson, D. Origin of hysteresis in resistive switching in magnetite is Joule heating. Phys. Rev. B 79 (2009).

Carta, D. et al. X-ray Absorption Spectroscopy Study of TiO2–xThin Films for Memory Applications. J. Phys. Chem. C 119, 4362–4370 (2015).

Strukov, D. B., Snider, G. S., Stewart, D. R. & Williams, R. S. The missing memristor found. Nature 453, 80–83 (2008).

Yang, J. J. et al. Memristive switching mechanism for metal/oxide/metal nanodevices. Nature Nanotech 3, 429–433 (2008).

Hur, J., Lee, M.-J., Lee, C., Kim, Y.-B. & Kim, C. J. Modeling for bipolar resistive memory switching in transition-metal oxides. Phys. Rev. B 82 (2010).

Wuttig, M. & Yamada, N. Phase-change materials for rewriteable data storage. Nature Materials 6, 824–832 (2007).

Driscoll, T., Kim, H. T., Chae, B. G., Di Ventra, M. & Basov, D. N. Phase-transition driven memristive system. Appl. Phys. Lett. 95, 043503 (2009).

Kwon, D.-H. et al. Atomic structure of conducting nanofilaments in TiO2 resistive switching memory. Nature Nanotech 5, 148–153 (2010).

Yang, Y. Y. et al. Observation of conducting filament growth in nanoscale resistive memories. Nature Communications 3, 732–732 (2012).

Sawa, A. Resistive switching in transition metal oxides. Materials Today 11, 28–36 (2008).

Kim, K. M., Jeong, D. S. & Hwang, C. S. Nanofilamentary resistive switching in binary oxide system; a review on the present status and outlook. Nanotechnology 22, 254002 (2011).

Meijer, G. I. Materials Science: Who Wins the Nonvolatile Memory Race? Science 319, 1625–1626 (2008).

Shihong, M. W., Prodromakis, T., Salaoru, I. & Toumazou, C. Modelling of Current Percolation Channels in Emerging Resistive Switching Elements. arXiv.orgcond-mat.mes-hall, (2012).

Prodromakis, T., Salaoru, I., Khiat, A. & Toumazou, C. Concurrent Resistive and Capacitive Switching of Nanoscale TiO2 Memristors. in (2012).

Valov, I. et al. Atomically controlled electrochemical nucleation at superionic solid electrolyte surfaces. Nature Materials 11, 1–6 (2012).

Li, Q., Khiat, A., Salaoru, I., Xu, H. & Prodromakis, T. Stochastic switching of TiO2-based memristive devices with identical initial memory states. Nanoscale Research Letters 9, 293 (2014).

Berdan, R. et al. A μ-Controller-Based System for Interfacing Selectorless RRAM Crossbar Arrays. IEEE Trans. Electron Devices 62, 2190–2196 (2015).

Tsodyks, M., Pawelzik, K. & Markram, H. Neural networks with dynamic synapses. Neural computation 10, 821–835 (1998).

Li, Q., Serb, A., Prodromakis, T. & Xu, H. A Memristor SPICE Model Accounting for Synaptic Activity Dependence. PLoS One 10, e0120506–12 (2015).

Indiveri, G., Linares-Barranco, B., Legenstein, R., Deligeorgis, G. & Prodromakis, T. Integration of nanoscale memristor synapses in neuromorphic computing architectures. Nanotechnology 24, 384010 (2013).

Indiveri, G. G. et al. Neuromorphic silicon neuron circuits. Front Neurosci 5, 73–73 (2011).

Brette, R. Adaptive Exponential Integrate-and-Fire Model as an Effective Description of Neuronal Activity. Journal of Neurophysiology 94, 3637–3642 (2005).

Movshon, J. A. J. Reliability of Neuronal Responses. Neuron 27, 3–3 (2000).

Feinerman, O., Rotem, A. & Moses, E. Reliable neuronal logic devices from patterned hippocampal cultures. Nat Phys 4, 967–973 (2008).