Prediction of the critical temperature of a superconductor by using the WOA/MARS, Ridge, Lasso and Elastic-net machine learning techniques

Neural Computing and Applications - Tập 33 Số 24 - Trang 17131-17145 - 2021
P.J. Garcı́a Nieto1, Esperanza García–Gonzalo1, José P. Paredes–Sánchez2
1Department of Mathematics, Faculty of Sciences, University of Oviedo, 33007 Oviedo, Spain
2Department of Energy, College of Mining, Energy and Materials Engineering, University of Oviedo, 33004 Oviedo, Spain

Tóm tắt

AbstractThis study builds a predictive model capable of estimating the critical temperature of a superconductor from experimentally determined physico-chemical properties of the material (input variables): features extracted from the thermal conductivity, atomic radius, valence, electron affinity and atomic mass. This original model is built using a novel hybrid algorithm relied on the multivariate adaptive regression splines (MARS) technique in combination with a nature-inspired meta-heuristic optimization algorithm termed the whale optimization algorithm (WOA) that mimics the social behavior of humpback whales. Additionally, the Ridge, Lasso and Elastic-net regression models were fitted to the same experimental data for comparison purposes. The results of the current investigation indicate that the critical temperature of a superconductor can be successfully predicted using this proposed hybrid WOA/MARS-based model. Furthermore, the results obtained with the Ridge, Lasso and Elastic-net regression models are clearly worse than those obtained with the WOA/MARS-based model.

Từ khóa


Tài liệu tham khảo

Ashcroft NW (2003) Solid state physics. Thomson Press Ltd, Delhi

Tinkham M (2004) Introduction to superconductivity. Dover Publications, New York

Kittel C (2005) Introduction to solid state physics. Wiley, New York

Annett JF (2004) Superconductivity, superfluids, and condensates. Oxford University Press, Oxford

Poole CP Jr, Prozorov R, Farach HA, Creswick RJ (2014) Superconductivity. Elsevier, Amsterdam

Abrikosov AA (2017) Fundamentals of the theory of metals. Dover Publications, New York

Hamidieh K (2018) A data-driven statistical model for predicting the critical temperature of a superconductor. Comput Mat Sci 154:346–354

Huebener RP (2019) Conductors, semiconductors, superconductors: an introduction to solid-state physics. Springer, Berlin

Matthias BT (1955) Empirical relation between superconductivity and the number of electrons per atom. Phys Rev 97:74–76

Riaz M, Hashmi MR (2019) Linear diophantine fuzzy set and its applications towards multi-attribute decision-making problems. J Intell Fuzzy Syst 37:5417–5439

Riaz M, Garg H, Farid HMA, Chinram R (2021) Multi-criteria decision making based on bipolar picture fuzzy operators and new distance measures. Comput Model Eng Sci 127(2):771–800

Riaz M, Naeem K, Chinram R, Iampan A (2021) Pythagorean m-polar fuzzy weighted aggregation operators and algorithm for the investment strategic decision making. J Math 2021(ID6644994):1–19

Riaz M, Hashmi MR, Pamucar D, Chu Y (2021) Spherical linear diophantine fuzzy sets with modeling uncertainties in MCDM. Comput Model Eng Sci 126:1125–1164

Riaz M, Hamid T, Afzal D, Pamucar D, Chu Y (2021) Multi-criteria decision making in robotic agri-farming with q-rung orthopair m-polar fuzzy sets. PLoS ONE 16(2):e0246485

Friedman JH (1991) Multivariate adaptive regression splines. Ann Stat 19:1–141

Sekulic SS, Kowalski BR (1992) MARS: A tutorial. J Chemometr 6:199–216

Friedman JH, Roosen CB (1995) An introduction to multivariate adaptive regression splines. Stat Methods Med Res 4:197–217

Hastie T, Tibshirani R, Friedman JH (2003) The elements of statistical learning. Springer, New York

Zhang WG, Goh ATC (2013) Multivariate adaptive regression splines for analysis of geotechnical engineering systems. Comput Geotech 48:82–95

Mirjalili S, Lewis A (2016) The whale optimization algorithm. Adv Eng Softw 95:51–67

Gharehchopogh FS, Gholizadeh H (2019) A comprehensive survey: Whale Optimization Algorithm and its applications. Swarm Evol Comput 48:1–24

Ebrahimgol H, Aghaie M, Zolfaghari A, Naserbegi A (2020) A novel approach in exergy optimization of a WWER1000 nuclear power plant using whale optimization algorithm. Ann Nucl Energy 145:107540

Yildirim H, Özkale MR (2019) The performance of ELM based ridge regression via the regularization parameters. Expert Syst Appl 134:225–233

Moreno-Salinas D, Moreno R, Pereira A, Aranda J, de la Cruz JM (2019) Modelling of a surface marine vehicle with kernel ridge regression confidence machine. Appl Soft Comput 76:237–250

Melkumova LE, Shatskikh SY (2017) Comparing Ridge and LASSO estimators for data analysis. Procedia Eng 201:746–755

Spencer B, Alfandi O, Al-Obeidat F (2018) A refinement of Lasso regression applied to temperature forecasting. Procedia Comput Sci 130:728–735

Wang S, Ji B, Zhao J, Liu W, Xu T (2018) Predicting ship fuel consumption based on LASSO regression. Transp Res D Transp Environ 65:817–824

Al-Obeidat F, Spencer B, Alfandi O (2020) Consistently accurate forecasts of temperature within buildings from sensor data using ridge and lasso regression. Future Gener Comput Syst 110:382–392

Zhao H, Tang J, Zhu Q, He H, Li S, Jin L, Zhang X, Zhu L, Guo J, Zhang D, Luo Q, Chen G (2020) Associations of prenatal heavy metals exposure with placental characteristics and birth weight in Hangzhou Birth Cohort: Multi-pollutant models based on elastic net regression. Sci Total Environ 742:140613

Chou S-M, Lee S-M, Shao YE, Chen I-F (2004) Mining the breast cancer pattern using artificial neural networks and multivariate adaptive regression splines. Expert Syst Appl 27:133–142

de Cos Juez FJ, Sánchez Lasheras F, García Nieto PJ, Suárez Suárez MA (2009) A new data mining methodology applied to the modelling of the influence of diet and lifestyle on the value of bone mineral density in post-menopausal women. Int J Comput Math 86:1878–1887

Álvarez Antón JC, García Nieto PJ, de Cos Juez FJ, Sánchez Lasheras F, Blanco Viejo C, Roqueñí Gutiérrez N (2013) Battery state-of-charge estimator using the MARS technique. IEEE Trans Power Electron 28:3798–3805

Chen M-Y, Cao M-T (2014) Accurately predicting building energy performance using evolutionary multivariate adaptive regression splines. Appl Soft Comput 22:178–188

Zhang W, Goh ATC, Zhang Y, Chen Y, Xiao Y (2015) Assessment of soil liquefaction based on capacity energy concept and multivariate adaptive regression splines. Eng Geol 188:29–37

Kisi O (2015) Pan evaporation modeling using least square support vector machine, multivariate adaptive regression splines and M5 model tree. J Hydrol 528:312–320

Vu DT, Tran X-L, Cao M-T, Tran TC, Hoang N-D (2020) Machine learning based soil erosion susceptibility prediction using social spider algorithm optimized multivariate adaptive regression spline. Measurement 164:108066

Kumar S, Rai B, Biswas R, Samui P, Kim D (2020) Prediction of rapid chloride permeability of self-compacting concrete using multivariate adaptive regression spline and minimax probability machine regression. J Build Eng 32:101490

Zheng G, Yang P, Zhou H, Zeng C, Yang X, He X, Yu X (2019) Evaluation of the earthquake induced uplift displacement of tunnels using multivariate adaptive regression splines. Comput Geotech 113:103099

Li DHW, Chen W, Li S, Lou S (2019) Estimation of hourly global solar radiation using multivariate adaptive regression spline (MARS)—a case study of Hong Kong. Energy 186:115857

García-Nieto PJ, García-Gonzalo E, Alonso Fernández JR, Díaz Muñiz C (2019) Modeling algal atypical proliferation using the hybrid DE-MARS-based approach and M5 model tree in La Barca reservoir: a case study in northern Spain. Ecol Eng 130:198–212

García-Nieto PJ, García-Gonzalo E, Bové J, Arbat G, Duran-Ros M, Puig-Bargues J (2017) Modeling pressure drop produced by different filtering media in microirrigation sand filters using the hybrid ABC-MARS-based approach, MLP neural network and M5 model tree. Comput Electron Agr 139:65–74

Wang T, Ma H, Liu J, Luo Q, Wang Q, Zhan Y (2021) Assessing frost heave susceptibility of gravelly soils based on multivariate adaptive regression splines model. Cold Reg Sci Technol 181:103182

Superconducting Material (SuperCon) Database (2021) National Institute for Materials Science (NIMS), Japan. https://supercon.nims.go.jp/en

Le TD, Noumeir R, Quach HL, Kim JH, Kim JH, Kim HM (2020) Critical temperature prediction for a superconductor: a variational Bayesian neural network approach. IEEE T Appl Supercon 30(4):1–5

Li S, Dan Y, Li X, Hu T, Dong R, Cao Z, Hu J (2020) Critical temperature prediction of superconductors based on atomic vectors and deep learning. Symmetry 12(262):1–13

Roter B, Dordevic SV (2020) Predicting new superconductors and their critical temperatures using machine learning. Physica C 575:1353689575

Dua D, Graff C (2019) UCI machine learning repository. School of Information and Computer Sciences, University of California, Irvine, CA, USA. http://archive.ics.uci.edu/ml

Freedman D, Pisani R, Purves R (2007) Statistics. W.W. Norton & Company, New York

Knafl GJ, Ding K (2016) Adaptive regression for modeling nonlinear relationships. Springer, Berlin

McClave JT, Sincich TT (2016) Statistics. Pearson, New York

Wasserman L (2003) All of statistics: a concise course in statistical inference. Springer, New York

Simon D (2013) Evolutionary optimization algorithms. Wiley, New York

Picard R, Cook D (1984) Cross-validation of regression models. J Am Stat Assoc 79:575–583

Milborrow S (2020) Earth: multivariate adaptive regression spline models, R Package, version 4.5.0, R Foundation for Statistical Computing, Vienna, Austria. https://cran.r-project.org/web/packages/earth/index.html. Accessed 11 Oct 2020

Friedman JH, Hastie T, Tibshirani R (2010) Regularization paths for generalized linear models via coordinate descent. J Stat Softw 33:1–22