p-bits for probabilistic spin logic

Applied Physics Reviews - Tập 6 Số 1 - 2019
Kerem Y. Çamsarı1, Brian Sutton1, Supriyo Datta1
1School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, 47907, USA

Tóm tắt

We introduce the concept of a probabilistic or p-bit, intermediate between the standard bits of digital electronics and the emerging q-bits of quantum computing. We show that low barrier magnets or LBMs provide a natural physical representation for p-bits and can be built either from perpendicular magnets designed to be close to the in-plane transition or from circular in-plane magnets. Magnetic tunnel junctions (MTJs) built using LBMs as free layers can be combined with standard NMOS transistors to provide three-terminal building blocks for large scale probabilistic circuits that can be designed to perform useful functions. Interestingly, this three-terminal unit looks just like the 1T/MTJ device used in embedded magnetic random access memory technology, with only one difference: the use of an LBM for the MTJ free layer. We hope that the concept of p-bits and p-circuits will help open up new application spaces for this emerging technology. However, a p-bit need not involve an MTJ; any fluctuating resistor could be combined with a transistor to implement it, while completely digital implementations using conventional CMOS technology are also possible. The p-bit also provides a conceptual bridge between two active but disjoint fields of research, namely, stochastic machine learning and quantum computing. First, there are the applications that are based on the similarity of a p-bit to the binary stochastic neuron (BSN), a well-known concept in machine learning. Three-terminal p-bits could provide an efficient hardware accelerator for the BSN. Second, there are the applications that are based on the p-bit being like a poor man's q-bit. Initial demonstrations based on full SPICE simulations show that several optimization problems, including quantum annealing are amenable to p-bit implementations which can be scaled up at room temperature using existing technology.

Từ khóa


Tài liệu tham khảo

2010, Advances and future prospects of spin-transfer torque random access memory, IEEE Trans. Magn., 46, 1873, 10.1109/TMAG.2010.2042041

2002, Transition from ferromagnetism to superparamagnetism on the nanosecond time scale, Phys. Rev. B, 65, 224406, 10.1103/PhysRevB.65.224406

2014, Noise-enhanced synchronization of stochastic magnetic oscillators, Phys. Rev. Appl., 2, 034009, 10.1103/PhysRevApplied.2.034009

2018, Superparamagnetic perpendicular magnetic tunnel junctions for true random number generators, AIP Adv., 8, 055903, 10.1063/1.5006422

2017, Low-energy truly random number generation with superparamagnetic tunnel junctions for unconventional computing, Phys. Rev. Appl., 8, 054045, 10.1103/PhysRevApplied.8.054045

2018, Circuit-level evaluation of the generation of truly random bits with superparamagnetic tunnel junctions, 1

2018, Designing stochastic nanomagnets for probabilistic spin logic, IEEE Magn. Lett., 9, 4305205, 10.1109/LMAG.2018.2860547

1999, Single-domain circular nanomagnets, Phys. Rev. Lett., 83, 1042, 10.1103/PhysRevLett.83.1042

2016, Experimental demonstration of nanomagnet networks as hardware for Ising computing, 34.3.1

2017, Intrinsic optimization using stochastic nanomagnets, Sci. Rep., 7, 44370, 10.1038/srep44370

2017, Low-barrier nanomagnets as p-bits for spin logic, IEEE Magn. Lett., 8, 1, 10.1109/LMAG.2017.2685358

2017, Stochastic p-bits for invertible logic, Phys. Rev. X, 7, 031014, 10.1103/PhysRevX.7.031014

2017, Implementing p-bits with embedded MTJ, IEEE Electron Device Lett., 38, 1767, 10.1109/LED.2017.2768321

2018, Neural-like computing with populations of superparamagnetic basis functions, Nat. Commun., 9, 1533, 10.1038/s41467-018-03963-w

2017, Current control of time-averaged magnetization in superparamagnetic tunnel junctions, Appl. Phys. Lett., 111, 243107, 10.1063/1.5012091

2016, A building block for hardware belief networks, Sci. Rep., 6, 29893, 10.1038/srep29893

1982, Simulating physics with computers, Int. J. Theor. Phys., 21, 467, 10.1007/BF02650179

1985, A learning algorithm for Boltzmann machines, Cognit. Sci., 9, 147, 10.1207/s15516709cog0901_7

1992, Connectionist learning of belief networks, Artif. Intell., 56, 71, 10.1016/0004-3702(92)90065-6

2016, Dot-product engine for neuromorphic computing: Programming 1t1m crossbar to accelerate matrix-vector multiplication, 19

2017, Spintronics based random access memory: A review, Mater. Today, 20, 530, 10.1016/j.mattod.2017.07.007

2012, Modeling circuits with spins and magnets for all-spin logic, 36

B. Behin-Aein, “Computing multi-magnet based devices and methods for solution of optimization problems,” U.S. patent 8,698,517 (2014).

2014, A magnetic tunnel junction based true random number generator with conditional perturb and real-time output probability tracking, 12

2014, Spin dice: A scalable truly random number generator based on spintronics, Appl. Phys. Express, 7, 083001, 10.7567/APEX.7.083001

2015, Spin-transfer torque magnetic memory as a stochastic memristive synapse for neuromorphic systems, IEEE Trans. Biomed. Circuits Syst., 9, 166, 10.1109/TBCAS.2015.2414423

2016, Probabilistic deep spiking neural systems enabled by magnetic tunnel junction, IEEE Trans. Electron Devices, 63, 2963, 10.1109/TED.2016.2568762

2017, A single magnetic-tunnel-junction stochastic computing unit, 36

1984, Stochastic relaxation, gibbs distributions, and the bayesian restoration of images, IEEE Trans. Pattern Anal. Mach. Intell., 6, 721, 10.1109/TPAMI.1984.4767596

Weighted p-bits for fpga implementation of probabilistic circuits, IEEE Trans. Neural Networks Learn. Syst.

2005, A probabilistic CMOS switch and its realization by exploiting noise

2003, A high-speed oscillator-based truly random number source for cryptographic applications on a smart card IC, IEEE Trans. Comput., 52, 403, 10.1109/TC.2003.1190581

2009, Power-up SRAM state as an identifying fingerprint and source of true random numbers, IEEE Trans. Comput., 58, 1198, 10.1109/TC.2008.212

2005, Programmable spintronics logic device based on a magnetic tunnel junction element, J. Appl. Phys., 97, 10D509, 10.1063/1.1857655

2008, Fabrication of a nonvolatile full adder based on logic-in-memory architecture using magnetic tunnel junctions, Appl. Phys. Express, 1, 091301, 10.1143/APEX.1.091301

2010, Magnetic tunnel junction for nonvolatile cmos logic, 9

2011, Magnetic tunnel junction logic architecture for realization of simultaneous computation and communication, IEEE Trans. Magn., 47, 2970, 10.1109/TMAG.2011.2158527

2012, Magnetic tunnel junction-based spintronic logic units operated by spin transfer torque, IEEE Trans. Nanotechnol., 11, 120, 10.1109/TNANO.2011.2158848

2016, Spintronic nanodevices for bioinspired computing, Proc. IEEE, 104, 2024, 10.1109/JPROC.2016.2597152

2014, Spin-torque building blocks, Nat. Mater., 13, 11, 10.1038/nmat3823

Y. Cao, T. Sato, D. Sylvester, M. Orshansky, and C. Hu, “Predictive technology model,” (2002), see http://ptm.asu.edu.

2017, Stochastic spiking neural networks enabled by magnetic tunnel junctions: From nontelegraphic to telegraphic switching regimes, Phys. Rev. Appl., 8, 064017, 10.1103/PhysRevApplied.8.064017

2015, Benchmarking of beyond-cmos exploratory devices for logic integrated circuits, IEEE J. Explor. Solid-State Comput. Devices Circuits, 1, 3, 10.1109/JXCDC.2015.2418033

2018, Equivalent circuit for magnetoelectric read and write operations, Phys. Rev. Appl., 9, 044020, 10.1103/PhysRevApplied.9.044020

2017, Experimental demonstration of complete 180° reversal of magnetization in isolated co nanomagnets on a pmn–pt substrate with voltage generated strain, Nano Lett., 17, 3478, 10.1021/acs.nanolett.7b00439

2018, Beyond cmos computing with spin and polarization, Nat. Phys., 14, 338, 10.1038/s41567-018-0101-4

2017, A random number generator based on insulator-to-metal electronic phase transitions, 1

1973, Generalized feedback shift register pseudorandom number algorithm, J. ACM, 20, 456, 10.1145/321765.321777

1992, A functional MOS transistor featuring gate-level weighted sum and threshold operations, IEEE Trans. Electron Devices, 39, 1444, 10.1109/16.137325

O. Hassan, K. Y. Camsari, and S. Datta, “Voltage-driven building block for hardware belief networks,” e-print arXiv:1801.09026 [cs] (2018).

2004, Design of Interconnection Networks for Programmable Logic

2014, A million spiking-neuron integrated circuit with a scalable communication network and interface, Science, 345, 668, 10.1126/science.1254642

2017, Hardware emulation of stochastic p-bits for invertible logic, Sci. Rep., 7, 10994, 10.1038/s41598-017-11011-8

2015, Modular approach to spintronics, Sci. Rep., 5, 10571, 10.1038/srep10571

2007, Probabilistic system-on-a-chip architectures, ACM Trans. Des. Autom. Electron. Syst. (TODAES), 12, 29, 10.1145/1255456.1255466

2015, Bioinspired programming of memory devices for implementing an inference engine, Proc. IEEE, 103, 1398, 10.1109/JPROC.2015.2437616

2017, Stochastic spin-orbit torque devices as elements for bayesian inference, Sci. Rep., 7, 14101, 10.1038/s41598-017-14240-z

2016, Real-time prediction of acute cardiovascular events using hardware-implemented bayesian networks, Comput. Biol. Med., 69, 245, 10.1016/j.compbiomed.2015.08.015

2017, Vlsi implementation of deep neural network using integral stochastic computing, IEEE Trans. Very Large Scale Integr. (VLSI) Syst., 25, 2688, 10.1109/TVLSI.2017.2654298

2018, Low-energy deep belief networks using intrinsic sigmoidal spintronic-based probabilistic neurons, 15

2007, Restricted Boltzmann machines for collaborative filtering, 791

2002, Training products of experts by minimizing contrastive divergence, Neural Comput., 14, 1771, 10.1162/089976602760128018

2016, Memristive Boltzmann machine: A hardware accelerator for combinatorial optimization and deep learning, 1

Accelerating machine learning using stochastic embedded mtj

1992, Modeling Brain Function: The World of Attractor Neural Networks

2016, A 20k-spin ising chip to solve combinatorial optimization problems with cmos annealing, IEEE J. Solid-State Circuits, 51, 303, 10.1109/JSSC.2015.2498601

2016, A fully programmable 100-spin coherent ising machine with all-to-all connections, Science, 354, 614, 10.1126/science.aah5178

2017, Ising computation based combinatorial optimization using spin-hall effect (she) induced stochastic magnetization reversal, J. Appl. Phys., 121, 193902, 10.1063/1.4983636

T. Wang and J. Roychowdhury, “Oscillator-based ising machine,” preprint arXiv:1709.08102 (2017).

2018, How coherent ising machines push circuit design in silicon photonics to its limits (conference presentation), Proc. SPIE, 10537, 105370D, 10.1117/12.2288586

G. E. Hinton, “A practical guide to training restricted Boltzmann machines,” in Neural networks: Tricks of the trade (Springer, 1985); available at https://link.springer.com/chapter/10.1007/978-3-642-35289-8_32.

1987, Some np-complete problems in quadratic and nonlinear programming, Math. Program., 39, 117, 10.1007/BF02592948

1999, Polynomial-time algorithms for prime factorization and discrete logarithms on a quantum computer, SIAM Rev., 41, 303, 10.1137/S0036144598347011

2017, Polynomial-time solution of prime factorization and np-complete problems with digital memcomputing machines, Chaos, 27, 023107, 10.1063/1.4975761

2018, Perspective: Memcomputing: Leveraging memory and physics to compute efficiently, J. Appl. Phys., 123, 180901, 10.1063/1.5026506

2014, Ising formulations of many np problems, Front. Phys., 2, 5, 10.3389/fphy.2014.00005

2008, Quantum adiabatic algorithm for factorization and its experimental implementation, Phys. Rev. Lett., 101, 220405, 10.1103/PhysRevLett.101.220405

P. Henelius and S. Girvin, “A statistical mechanics approach to the factorization problem,” e-print arXiv:1102.1296 [cond-mat].

2018, Quantum annealing for prime factorization, Sci. Rep., 8, 1, 10.1038/s41598-018-36058-z

1983, Optimization by simulated annealing, Science, 220, 671, 10.1126/science.220.4598.671

1999, Josephson persistent-current qubit, Science, 285, 1036, 10.1126/science.285.5430.1036

2011, Quantum annealing with manufactured spins, Nature, 473, 194, 10.1038/nature10012

2018, Adiabatic quantum computation, Rev. Mod. Phys., 90, 015002, 10.1103/RevModPhys.90.015002

K. Y. Camsari, S. Chowdhury, and S. Datta, “Scaled quantum circuits emulated with room temperature p-bits,” preprint arXiv:1810.07144 (2018).

2016, Ultrafast spin-transfer-torque switching of synthetic ferrimagnets, IEEE Magn. Lett., 7, 1, 10.1109/LMAG.2016.2610942

U. Atxitia, T. Birk, S. Selzer, and U. Nowak, “Superparamagnetic limit of antiferromagnetic nanoparticles,” preprint arXiv:1808.07665 (2018).

Thông tin
Thông tin xuất bản

Applied Physics Reviews

Tập 6 Số 1

Thông tin tác giả