Superconducting Neural Networks: from an Idea to Fundamentals and, Further, to Application

S. Ginosar, A. Bar, G. Kohavi, et al., in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2019, p. 3497.

J. H. T. Yip, X. Zhang, Y. Wang, et al., arXiv: 1910.07813 (2019).

H. Rebecq, R. Ranftl, V. Koltun, and D. Scaramuzza, IEEE Trans. Pattern Anal. Mach. Intell., 1964 (2019). https://doi.org/10.1109/TPAMI.2019.2963386

K.-A. Aliev, D. Ulyanov, and V. Lempitsky, arXiv: 1906.08240 (2019).

P. G. Breen, C. N. Foley, T. Boekholt, and S. P. Zwart, Mon. Not. R. Astron. Soc. 494, 2465 (2020). https://doi.org/10.1093/mnras/staa713

H. H. Szu, “Superconducting neural network computer and sensor array,” Google Patents (1990).

R. Callan, The Essence of Neural Networks (Prentice Hall, Englewood Cliffs, 1998).

M. B. Berkinblit, Neuron Networks (MIROS VZMSh RAO, Moscow, 1993) [in Russian].

W. S. McCulloch and W. Pitts, “A logical calculus of the ideas immanent in nervous activity,” in Automata Studies, Ed. by C. E. Shannon and J. McCarthy (Princeton Univ. Press, Princeton, 1956).

D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach, 2nd ed. (Prentice Hall, Englewood Cliffs, 2011), p. 792.

A. K. Dzhein, Zh. Mao, and K. M. Moiuddin, Otkryt. Sist. 4 (97), 16 (1997).

P. Dostál and P. Pokorný, Cluster Analysis and Neural Network (Dep. Inform., Brno Univ. Technol. Inst. Math., 2009).

F. D. Foresee and M. T. Hagan, in Proceedings of International Conference on Neural Networks (ICNN’97) on Gauss-Newton Approximation to Bayesian Learning, Houston, TX, USA, June 12, 1997, Vol. 3, p. 1930. https://doi.org/10.1109/ICNN.1997.614194

J. Saxe and K. Berlin, “Deep neural network based malware detection using two dimensional binary program features,” in Proceedings of the 2015 10th International Conference on Malicious and Unwanted Software (MALWARE), Fajardo, PR, USA, Oct. 20–22, 2015, p. 11. https://doi.org/10.1109/MALWARE.2015.7413680

J. Zheng, Expert Syst. Appl. 36, 2116 (2009). https://doi.org/10.1016/j.eswa.2007.12.029

Y. G. Maguire, M. G. Shapiro, T. R. Cybulski, et al., Front. Comput. Neurosci. 7, 137 (2013). https://doi.org/10.3389/fncom.2013.00137

M. Forssell, Inform. Flow Networks 18, 1 (2014).

P. Moerland and E. Fiesler, “Neural network adaptations to hardware implementations,” in IDIAP, Handbook of Neural Computation E1.2:1-13 (Inst. Phys. Publ., Oxford Univ. Publ., New York, 1997).

M. D. Pickett and R. S. Williams, Nanotechnology 24, 384002 (2013). https://doi.org/10.1088/0957-4484/24/38/384002

S. Haykin, Neural Networks: A Comprehensive Foundation (Prentice Hall, Englewood Cliffs, 1998).

R. C. Frye, E. A. Rietman, and C. C. Wong, IEEE Trans. Neural Networks 2, 110 (1991). https://doi.org/10.1109/72.80296

S. S. Kim and S. Jung, “Hardware implementation of a real time neural network controller with a DSP and an FPGA,” in Proceedings of the IEEE International Conference on Robotics and Automation, New Orleans, LA, USA (2004), Vol. 5, p. 4639. https://doi.org/10.1109/ROBOT.2004.1302449

H. Hikawa, Neural Netw. 18, 514 (2005). https://doi.org/10.1016/j.neunet.2005.06.012

P. K. Meher, J. Valls, T.-B. Juang, et al., IEEE Trans. Circuits Syst. I: Regul. Pap. 56, 1893 (2009). https://doi.org/10.1109/TCSI.2009.2025803

P. A. Merolla, J. V. Arthur, R. Alvarez-Icaza, et al., Science (Washington, DC, U. S.) 345 (6197), 668 (2014). https://doi.org/10.1126/science.1254642

Y. E. Wang, G.-Y. Wei, and D. Brooks, arXiv: 1907.10701 (2019).

V. Aparin and J. A. Levin, “Methods and systems for CMOS implementation of neuron synapse,” Google Patent No. US8694452B2 (2014).

P. W. Hollis and J. J. Paulos, IEEE J. Solid-State Circuits 25, 849 (1992). https://doi.org/10.1109/4.102684

G. Indiveri and T. K. Horiuchi, Front. Neurosci. 5, 118 (2011). https://doi.org/10.3389/fnins.2011.00118

F. C. Hoppensteadt and E. M. Izhikevich, IEEE Trans. Neural Networks 11, 734 (2000). https://doi.org/10.1109/72.846744

L. Chua, IEEE Trans. Circuit Theory 18, 507 (1971). https://doi.org/10.1109/TCT.1971.1083337

D. B. Strukov, G. S. Snider, D. R. Stewart, and R. S. Williams, Nature (London, U.K.) 453 (7191), 80 (2008). https://doi.org/10.1038/nature06932

Y. V. Pershin and M. di Ventra, Neural Netw. 23, 881 (2010). https://doi.org/10.1016/j.neunet.2010.05.001

S. H. Jo, T. Chang, I. Ebong, et al., Nano Lett. 10, 1297 (2010). https://doi.org/10.1021/nl904092h

A. Chanthbouala, V. Garcia, R. O. Cherifi, et al., Nat. Mater. 11, 860 (2012). https://doi.org/10.1038/nmat3415

K. Seo, I. Kim, S. Jung, et al., Nanotechnology 22, 254023 (2011). https://doi.org/10.1088/0957-4484/22/25/254023

T. Ohno, T. Hasegawa, T. Tsuruoka, et al., Nat. Mater. 10, 591 (2011). https://doi.org/10.1038/nmat3054

C. Sung, H. Hwang, and I. K. Yoo, J. Appl. Phys. 124, 151903 (2018). https://doi.org/10.1063/1.5037835

M. Prezioso, F. Merrikh-Bayat, B. D. Hoskins, et al., Nature (London, U.K.) 521 (7550), 61 (2015). https://doi.org/10.1038/nature14441

F. Akopyan, J. Sawada, A. Cassidy, et al., IEEE Trans. Comput. Des. Integr. Circuits Syst. 34, 1537 (2015). https://doi.org/10.1109/TCAD.2015.2474396

https://ru.wikipedia.org/wiki/Stockfish.

https://deepmind.com/blog/alphazero-shedding-new-light-grand-games-chess-shogi-and-go/.

D. Silver, T. Hubert, J. Schrittwieser, et al., arXiv: 1712.01815 (2017).

I. I. Soloviev, N. V. Klenov, S. V. Bakurskiy, et al., Beilstein J. Nanotechnol. 8, 2689 (2017). https://doi.org/10.3762/bjnano.8.269

H. H. Szu, “Superconducting neural network computer and sensor array,” Google Patent (1990).

http://data-mining.philippe-fournier-viger.com/too-many-machine-learning-papers/.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You only look once: Unified, real-time object detection,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, LV, USA, June 26–July 1, 2016, p. 779.

G. J. Scott, M. R. Engl, W. A. Starms, et al., IEEE Geosci. Remote Sens. Lett. 14, 549 (2017). https://doi.org/10.1109/LGRS.2017.2657778

S. Hochreiter and J. Schmidhuber, Neural Comput. 9, 1735 (1997). https://doi.org/10.1162/neco.1997.9.8.1735

Y. LeCun, Y. Bengio, and G. Hinton, Nature (London, U.K.) 521 (7553), 436 (2015). https://doi.org/10.1038/nature14539

A. Esteva, B. Kuprel, R. A. Novoa, et al., Nature (London, U.K.) 542 (7639), 115 (2017). https://doi.org/10.1038/nature21056

J. Nickolls and W. J. Dally, IEEE Micro. 30 (2), 56 (2010). https://doi.org/10.1109/MM.2010.41

P. Crotty, D. Schult, and K. Segall, Phys. Rev. E 82, 11914 (2010). https://doi.org/10.1103/PhysRevE.82.011914

V. V. Ryazanov, V. V. Bol’ginov, D. S. Sobanin, et al., Phys. Proc. 36, 35 (2012). https://doi.org/10.1016/j.phpro.2012.06.126

A. V. Emelyanov, K. E. Nikiruy, A. V. Serenko, et al., Nanotechnology 31, 45201 (2019). https://doi.org/10.1088/1361-6528/ab4a6d

V. A. Demin, D. V. Nekhaev, I. A. Surazhevsky, et al., Neural Netw. 134, 64 (2021). https://doi.org/10.1016/j.neunet.2020.11.005

I. A. Surazhevsky, V. A. Demin, A. I. Ilyasov, et al., Chaos Solitons Fractals 146, 110890 (2021). https://doi.org/10.1016/j.chaos.2021.110890

A. Perez-Tomas, D. J. Rogers, E. Chikoidze, and J. A. Garrido, “A walk on the frontier of energy electronics with power ultra-wide bandgap oxides and ultra-thin neuromorphic 2D materials,” Proc. SPIE 11687, 116871Y (2021). https://doi.org/10.1117/12.2590747

D. Caimi, H. Schmid, T. Morf, et al., Solid State Electron. 185, 108077 (2021). https://doi.org/10.1016/j.sse.2021.108077

Y. Mizugaki, K. Nakajima, Y. Sawada, and T. Yamashita, IEEE Trans. Appl. Supercond. 4, 1 (1994). https://doi.org/10.1109/77.273058

T. Onomi and K. Nakajima, J. Phys.: Conf. Ser. 507, 42029 (2014). https://doi.org/10.1088/1742-6596/507/4/042029

V. K. Kornev, I. I. Soloviev, A. V. Sharafiev, et al., IEEE Trans. Appl. Supercond. 23, 1800405 (2012). https://doi.org/10.1109/TASC.2012.2232691

L. Spietz, K. Irwin, and J. Aumentado, Appl. Phys. Lett. 95, 92505 (2009). https://doi.org/10.1063/1.3220061

O. A. Mukhanov, in History of Superconductor Analog-to-Digital Converters. 100 Years of Superconductivity, Ed. by H. Rogalla and P. Kes (Taylor Francis, London, UK, 2011), p. 440.

Q. Yan, M. Li, F. Chen, et al., IEEE Trans. Wireless Commun. 13, 5893 (2014). https://doi.org/10.1109/TWC.2014.2339218

S. Munjuluri and R. M. Garimella, Proc. Comput. Sci. 46, 1156 (2015). https://doi.org/10.1016/j.procs.2015.01.028

M. Z. Farooqi, S. M. Tabassum, M. H. Rehmani, and Y. Saleem, J. Netw. Comput. Appl. 46, 166 (2014). https://doi.org/10.1016/j.jnca.2014.09.002

Y. Harada and E. Goto, IEEE Trans. Magn. 27, 2863 (1991). https://doi.org/10.1109/20.133806

E. Goto, Proc. IRE 47, 1304 (1959). https://doi.org/10.1109/JRPROC.1959.287195

G.-B. Huang, Q.-Y. Zhu, and C.-K. Siew, Neurocomputing 70, 489 (2006). https://doi.org/10.1016/j.neucom.2005.12.126

G. E. Santoro and E. Tosatti, J. Phys. A: Math. Gen. 39, R393 (2006). https://doi.org/10.1088/0305-4470/39/36/R01

P. Hauke, H. G. Katzgraber, W. Lechner, and H. Nishimori, Rep. Prog. Phys. 83, 54401 (2020). https://doi.org/10.1088/1361-6633/ab85b8

W. Winci, L. Buffoni, H. Sadeghi, et al., Mach. Learn. Sci. Technol. 1, 45028 (2020). https://doi.org/10.1088/2632-2153/aba220

R. Cheng, U. S. Goteti, and M. C. Hamilton, J. Appl. Phys. 124, 152126 (2018). https://doi.org/10.1063/1.5042421

M. L. Schneider, C. A. Donnelly, S. E. Russek, et al., in Proceedings of the 2017 IEEE International Conference on Rebooting Computing (ICRC), 2017, p. 1. https://doi.org/10.1109/ICRC.2017.8123634

M. L. Schneider, C. A. Donnelly, and S. E. Russek, J. Appl. Phys. 124, 161102 (2018). https://doi.org/10.1063/1.5042425

E. Toomey, K. Segall, and K. Berggren, Front. Neurosci. 13, 933 (2019). https://doi.org/10.3389/fnins.2019.00933

M. L. Schneider, C. A. Donnelly, S. E. Russek, et al., Sci. Adv. 4, e1701329 (2018). https://doi.org/10.1126/sciadv.1701329

J. M. Shainline, S. M. Buckley, A. N. McCaughan, et al., J. Appl. Phys. 124, 152130 (2018). https://doi.org/10.1063/1.5038031

J. M. Shainline, Appl. Phys. Lett. 118, 160501 (2021). https://doi.org/10.1063/5.0040567

S. Buckley, J. Chiles, A. N. McCaughan, et al., Appl. Phys. Lett. 111, 141101 (2017). https://doi.org/10.1063/1.4994692

J. M. Shainline, S. M. Buckley, N. Nader, et al., Opt. Express 25, 10322 (2017). https://doi.org/10.1364/OE.25.010322

J. M. Shainline, S. M. Buckley, R. P. Mirin, and S. W. Nam, Phys. Rev. Appl. 7, 34013 (2017). https://doi.org/10.1103/PhysRevApplied.7.034013

I. I. Soloviev, A. E. Schegolev, N. V. Klenov, et al., J. Appl. Phys. 124, 152113 (2018). https://doi.org/10.1063/1.5042147

A. E. Schegolev, N. V. Klenov, I. I. Soloviev, and M. V. Tereshonok, Beilstein J. Nanotechnol. 7, 1397 (2016). https://doi.org/10.3762/bjnano.7.130

N. V. Klenov, A. E. Schegolev, I. I. Soloviev, et al., IEEE Trans. Appl. Supercond. 28, 1301006 (2018). https://doi.org/10.1109/TASC.2018.2836903

N. V. Klenov, A. V. Kuznetsov, A. E. Schegolev, et al., Low Temp. Phys. 45, 769 (2019). https://doi.org/10.1063/1.5111305

S. Bakurskiy, M. Kupriyanov, N. Klenov, et al., Beilstein J. Nanotechnol. 11, 1336 (2020). https://doi.org/10.3762/bxiv.2020.69.v1

A. E. Schegolev, N. V. Klenov, M. V. Tereshonok, and S. S. Adjemov, “Elements of hybrid opto-superconducting convolutional neural networks,” in Proceedings of the 8th International Conference on Photonics, Optics and Laser Technology, 2020, p. 135.

A. Schegolev, N. Klenov, I. Soloviev, and M. Tereshonok, Supercond. Sci. Technol. 34, 15006 (2020). https://doi.org/10.1088/1361-6668/abc569

K. K. Likharev, Rev. Mod. Phys. 51, 101 (1979).

A. Gudkov, Elektron.: Nauka, Tekhnol. Biznes, S65 (2014).

A. L. Gudkov, M. Yu. Kupriyanov, and A. N. Samus’, J. Exp. Theor. Phys. 114, 818 (2012).

S. K. Tolpygo, V. Bolkhovsky, T. J. Weir, et al., IEEE Trans. Appl. Supercond. 26 (3), 1 (2016). https://doi.org/10.1109/TASC.2016.2519388

K. Ishida, I. Byun, I. Nagaoka, et al., IEEE Micro 41 (3), 19 (2021). https://doi.org/10.1109/MM.2021.3070488

G. Tzimpragos, J. Volk, D. Vasudevan, et al., IEEE Micro 41 (3), 71 (2021).

C. L. Ayala, T. Tanaka, R. Saito, et al., IEEE J. Solid-State Circuits 56, 1152 (2020). https://doi.org/10.1109/JSSC.2020.3041338