Backpropagation Neural Network optimization and software defect estimation modelling using a hybrid Salp Swarm optimizer-based Simulated Annealing Algorithm

Knowledge-Based Systems - Tập 244 - Trang 108511 - 2022
Sofian Kassaymeh1,2,3, Mohamad Al-Laham4, Mohammed Azmi Al-Betar2,5, Mohammed Alweshah3,6, Salwani Abdullah1, Sharif Naser Makhadmeh2
1Data Mining and Optimization Research Group, Center for Artificial Intelligence Technology, Universiti Kebangsaan Malaysia, Bangi, Selangor, Malaysia
2Artificial Intelligence Research Center (AIRC), College of Engineering and Information Technology, Ajman University, Ajman, United Arab Emirates
3Prince Abdullah bin Ghazi Faculty of Information and Communication Technology, Al-Balqa Applied University, Al-Salt, Jordan
4MIS Department, Amman University College, Al-Balqa Applied University, Amman, Jordan
5Al-Huson University College, Al-Balqa Applied University, Irbid, Jordan
6Artificial Intelligence Department,College of Information Technology, Aqaba University of Technology, Aqaba, Jordan

Tài liệu tham khảo

Kassaymeh, 2021, Salp swarm optimizer for modeling software reliability prediction problems, Neural Process. Lett., 1 Sheta, 2014, Estimating the number of test workers necessary for a software testing process using artificial neural networks, Int. J. Adv. Comput. Sci. Appl., 5, 186 Kassaymeh, 2021, Salp swarm optimizer for modeling the software fault prediction problem, J. King Saud Univ.-Comput. Inf. Sci. Shukla, 2021, An extreme learning machine based approach for software effort estimation, 47 Wang, 2016, Self-adaptive extreme learning machine, Neural Comput. Appl., 27, 291, 10.1007/s00521-015-1874-3 Yi, 2016, Improved probabilistic neural networks with self-adaptive strategies for transformer fault diagnosis problem, Adv. Mech. Eng., 8, 10.1177/1687814015624832 Cui, 2018, Detection of malicious code variants based on deep learning, IEEE Trans. Ind. Inform., 14, 3187, 10.1109/TII.2018.2822680 Wang, 2013, Wavelet neural network using multiple wavelet functions in target threat assessment, Sci. World J., 2013 Carrozza, 2013, Analysis and prediction of mandelbugs in an industrial software system, 262 Yuan, 2000, An application of fuzzy clustering to software quality prediction, 85 Alshareef, 2015, A case-based reasoning approach for pattern detection in Malaysia rainfall data, Int. J. Big Data Intell., 2, 285, 10.1504/IJBDI.2015.072172 Wan, 2020 Chen, 2020, A novel selective naïve bayes algorithm, Knowl.-Based Syst., 192, 10.1016/j.knosys.2019.105361 Rathore, 2017, Towards an ensemble based system for predicting the number of software faults, Exp. Syst. Appl., 82, 357, 10.1016/j.eswa.2017.04.014 Malhotra, 2015, A systematic review of machine learning techniques for software fault prediction, Appl. Soft Comput., 27, 504, 10.1016/j.asoc.2014.11.023 Bowes, 2018, Software defect prediction: do different classifiers find the same defects?, Softw. Qual. J., 26, 525, 10.1007/s11219-016-9353-3 Rashid, 2020, Study of software development cost estimation techniques and models, Mehran Univ. Res. J. Eng. Technol., 39, 413, 10.22581/muet1982.2002.18 Abdullah, 2019, Drug users prediction using backpropagation educational method, 1361 Chaudhary, 2015, A survey on backpropagation algorithm for neural networks, Int. J. Technol. Res. Eng., 2 Vora, 2014, A survey on backpropagation algorithms for feedforward neural networks, Int. J. Eng. Dev. Res. Ever, 2019, Comparison of machine learning techniques for prediction problems, 713 Sekeroglu, 2019, Student performance prediction and classification using machine learning algorithms, 7 Ogidan, 2018, Machine learning for expert systems in data analysis, 1 Abusnaina, 2018, Training neural networks using salp swarm algorithm for pattern classification, 17 Wu, 2019, Improved salp swarm algorithm based on weight factor and adaptive mutation, J. Exp. Theor. Artif. Intell., 31, 493, 10.1080/0952813X.2019.1572659 Khazaiepoor, 2020, A hybrid approach for software development effort estimation using neural networks, genetic algorithm, multiple linear regression and imperialist competitive algorithm, Int. J. Nonlinear Anal. Appl., 11, 207 Sheta, 2015, Software effort and function points estimation models based radial basis function and feedforward artificial neural networks, Int. J. Next-Gener. Comput., 6, 192 Kassaymeh, 2021, A hybrid salp swarm algorithm with artificial neural network model for predicting the team size required for software testing phase, 1 Bui, 2019, Metaheuristic algorithms in optimizing neural network: a comparative study for forest fire susceptibility mapping in Dak Nong, Vietnam, Geomatics Nat. Hazard. Risk, 10, 136, 10.1080/19475705.2018.1509902 Kumar Ojha, 2017, Metaheuristic design of feedforward neural networks: A review of two decades of research, Eng. Appl. Artif. Intell., 60, 97, 10.1016/j.engappai.2017.01.013 Mavrovouniotis, 2015, Training neural networks with ant colony optimization algorithms for pattern classification, Soft Computing, 19, 1511, 10.1007/s00500-014-1334-5 Mirjalili, 2017, Salp swarm algorithm: A bio-inspired optimizer for engineering design problems, Adv. Eng. Softw., 114, 163, 10.1016/j.advengsoft.2017.07.002 Faris, 2020, Time-varying hierarchical chains of salps with random weight networks for feature selection, Exp. Syst. Appl., 140, 10.1016/j.eswa.2019.112898 Aljarah, 2020, A dynamic locality multi-objective salp swarm algorithm for feature selection, Comput. Ind. Eng., 147, 10.1016/j.cie.2020.106628 Aljarah, 2018, Asynchronous accelerating multi-leader salp chains for feature selection, Appl. Soft Comput., 71, 964, 10.1016/j.asoc.2018.07.040 Zhang, 2018, Parameter estimation for soil water retention curve using the salp swarm algorithm, Water, 10, 815, 10.3390/w10060815 El-Fergany, 2018, Extracting optimal parameters of PEM fuel cells using salp swarm optimizer, Renew. Energy, 119, 641, 10.1016/j.renene.2017.12.051 Hussien, 2017, Swarming behaviour of salps algorithm for predicting chemical compound activities, 315 Wang, 2018, A novel hybrid interval prediction approach based on modified lower upper bound estimation in combination with multi-objective salp swarm algorithm for short-term load forecasting, Energies, 11, 1561, 10.3390/en11061561 Abd Elaziz, 2020, A competitive chain-based Harris Hawks Optimizer for global optimization and multi-level image thresholding problems, Appl. Soft Comput. Zhang, 2021, Ensemble mutation-driven salp swarm algorithm with restart mechanism: Framework and fundamental analysis, Exp. Syst. Appl., 165, 10.1016/j.eswa.2020.113897 El-Fergany, 2019, Salp swarm optimizer to solve optimal power flow comprising voltage stability analysis, Neural Comput. Appl., 1 Ibrahim, 2018, Improved salp swarm algorithm based on particle swarm optimization for feature selection, J. Ambient Intell. Hum. Comput., 1 Çetin, 2021, Optimization of thermodynamic performance with simulated annealing algorithm: A geothermal power plant, Renew. Energy, 172, 968, 10.1016/j.renene.2021.03.101 Abbassi, 2020, Parameters identification of photovoltaic cell models using enhanced exploratory salp chains-based approach, Energy, 117 Tubishat, 2020, Improved salp swarm algorithm based on opposition based learning and novel local search algorithm for feature selection, Exp. Syst. Appl., 145, 113, 10.1016/j.eswa.2019.113122 Yin, 2020, Enhanced salp swarm algorithm based on random walk and its application to training feedforward neural networks, Soft Comput., 1 Mahmoud, 2020, Improved salp–swarm optimizer and accurate forecasting model for dynamic economic dispatch in sustainable power systems, Sustainability, 12, 576, 10.3390/su12020576 Ibrahim, 2020, Breast cancer segmentation from thermal images based on chaotic salp swarm algorithm, IEEE Access, 8, 122121, 10.1109/ACCESS.2020.3007336 Faris, 2018, An efficient binary salp swarm algorithm with crossover scheme for feature selection problems, Knowl.-Based Syst., 154, 43, 10.1016/j.knosys.2018.05.009 Zhang, 2020, A multi-strategy enhanced salp swarm algorithm for global optimization, Eng. Comput., 1 Wang, 2020, Modified salp swarm algorithm based multilevel thresholding for color image segmentation, Math. Biosci. Eng., 17, 700, 10.3934/mbe.2020036 Assad, 2018, A hybrid harmony search and simulated annealing algorithm for continuous optimization, Inform. Sci., 450, 246, 10.1016/j.ins.2018.03.042 Mafarja, 2017, Hybrid whale optimization algorithm with simulated annealing for feature selection, Neurocomputing, 260, 302, 10.1016/j.neucom.2017.04.053 Yu, 2020, A quantum-behaved simulated annealing algorithm-based moth-flame optimization method, Appl. Math. Modelling, 87, 1, 10.1016/j.apm.2020.04.019 Zaidan, 2019, A new hybrid algorithm of simulated annealing and simplex downhill for solving multiple-objective aggregate production planning on fuzzy environment, Neural Comput. Appl., 31, 1823, 10.1007/s00521-017-3159-5 Salama, 2021, Adaptive neighborhood simulated annealing for sustainability-oriented single machine scheduling with deterioration effect, Appl. Soft Comput., 110, 10.1016/j.asoc.2021.107632 Agahian, 2021, Battle royale optimizer for training multi-layer perceptron, Evol. Syst., 1 Ding, 2011, An optimizing BP neural network algorithm based on genetic algorithm, Artif. Intell. Rev., 36, 153, 10.1007/s10462-011-9208-z Jin, 2015, Prediction approach of software fault-proneness based on hybrid artificial neural network and quantum particle swarm optimization, Appl. Soft Comput., 35, 717, 10.1016/j.asoc.2015.07.006 Riese, 2020, Supervised, semi-supervised, and unsupervised learning for hyperspectral regression, 187 Alweshah, 2020, African Buffalo algorithm: training the probabilistic neural network to solve classification problems, J. King Saud Univ.-Comput. Inf. Sci. Alweshah, 2020, Water evaporation algorithm with probabilistic neural network for solving classification problems, Jordanian J. Comput. Inf. Technol., 6 Baklacioglu, 2018, Metaheuristic approach for an artificial neural network: exergetic sustainability and environmental effect of a business aircraft, Transp. Res. D, 63, 445, 10.1016/j.trd.2018.06.013 Alweshah, 2020, Improved water cycle algorithm with probabilistic neural network to solve classification problems, Clust. Comput., 1 Porter, 1990, Empirically guided software development using metric-based classification trees, IEEE Softw., 7, 46, 10.1109/52.50773 Catal, 2011, Software fault prediction: A literature review and current trends, Exp. Syst. Appl., 38, 4626, 10.1016/j.eswa.2010.10.024 Li, 2017, Software defect prediction via convolutional neural network, 318 Thota, 2020, Survey on software defect prediction techniques, Int. J. Appl. Sci. Eng., 17, 331 Turabieh, 2019, Iterated feature selection algorithms with layered recurrent neural network for software fault prediction, Exp. Syst. Appl., 122, 27, 10.1016/j.eswa.2018.12.033 Safa Omri, Carsten Sinz, Deep learning for software defect prediction: A survey, in: Proceedings of the IEEE/ACM 42nd International Conference on Software Engineering Workshops, 2020, pp. 209–214. Ma, 2019, A comprehensive improved salp swarm algorithm on redundant container deployment problem, IEEE Access, 7, 136452, 10.1109/ACCESS.2019.2933265 Zhong, 2020, Structural reliability assessment by salp swarm algorithm–based FORM, Qual. Reliab. Eng. Int., 36, 1224, 10.1002/qre.2626 Ma, 2020, A transformed salp swarm algorithm on container deployment problem, Int. J. Innov. Comput. Inf. Control, 16, 283 Fang, 2020, Multi-objective evolutionary simulated annealing optimisation for mixed-model multi-robotic disassembly line balancing with interval processing time, Int. J. Prod. Res., 58, 846, 10.1080/00207543.2019.1602290 Wang, 2019, Modeling and optimization of multi-objective partial disassembly line balancing problem considering hazard and profit, J. Clean. Prod., 211, 115, 10.1016/j.jclepro.2018.11.114 Wi, 2000 Koru, 2008, Theory of relative defect proneness, Empir. Softw. Eng., 13, 473, 10.1007/s10664-008-9080-x Jayanthi, 2019, Software defect prediction techniques using metrics based on neural network classifier, Clust. Comput., 22, 77, 10.1007/s10586-018-1730-1 Miholca, 2018, A novel approach for software defect prediction through hybridizing gradual relational association rules with artificial neural networks, Inform. Sci., 441, 152, 10.1016/j.ins.2018.02.027 Li, 2016, Three-way decisions based software defect prediction, Knowl.-Based Syst., 91, 263, 10.1016/j.knosys.2015.09.035 Pan, 2016, The impact of data normalization on stock market prediction: using svm and technical indicators, 72 Qiao, 2020, Deep learning based software defect prediction, Neurocomputing, 385, 100, 10.1016/j.neucom.2019.11.067 Akilli, 2020, Evaluation of normalization techniques on neural networks for the prediction of 305-day milk yield, Turk. J. Agric. Eng. Res., 1, 354, 10.46592/turkager.2020.v01i02.011 Goyal, 2021, Effective software defect prediction using support vector machines (SVMs), Int. J. Syst. Assur. Eng. Manage., 1 Goyal, 2021, Software fault prediction using lion optimization algorithm, Int. J. Inf. Technol., 1 Rong, 2016, A model for software defect prediction using support vector machine based on CBA, Int. J. Intell. Syst. Technol. Appl., 15, 19 Cai, 2020, An under-sampled software defect prediction method based on hybrid multi-objective cuckoo search, Concurr. Comput.: Pract. Exp., 32, e5478, 10.1002/cpe.5478 Anbu, 2019, Feature selection using firefly algorithm in software defect prediction, Clust. Comput., 22, 10925, 10.1007/s10586-017-1235-3 De Carvalho, 2010, A symbolic fault-prediction model based on multiobjective particle swarm optimization, J. Syst. Softw., 83, 868, 10.1016/j.jss.2009.12.023 Goyal, 2019, GA based dimensionality reduction for effective software effort estimation using ANN, Adv. Appl. Math. Sci., 18, 637 Hassouneh, 2021, Boosted whale optimization algorithm with natural selection operators for software fault prediction, IEEE Access, 9, 14239, 10.1109/ACCESS.2021.3052149 Wahono, 2014, Metaheuristic optimization based feature selection for software defect prediction, J. Softw., 9, 1324, 10.4304/jsw.9.5.1324-1333 Emary, 2016, Binary ant lion approaches for feature selection, Neurocomputing, 213, 54, 10.1016/j.neucom.2016.03.101 Rashedi, 2010, BGSA: binary gravitational search algorithm, Nat. Comput., 9, 727, 10.1007/s11047-009-9175-3 Kennedy, 1997, A discrete binary version of the particle swarm algorithm, 4104 Mafarja, 2018, Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems, Knowl.-Based Syst., 145, 25, 10.1016/j.knosys.2017.12.037 E. Kaya, A. Çinar, O. Uymaz, S. Korkmaz, M. Kıran, The binary salp swarm algorithm with using transfer functions, in: Proc. Int. Conf. Adv. Technol., Comput. Eng. Sci.(ICATCES), 2018. Thaher, 2020, Efficient multi-swarm binary harris hawks optimization as a feature selection approach for software fault prediction, 249 Wang, 2015, A multi-objective evolutionary algorithm for feature selection based on mutual information with a new redundancy measure, Inform. Sci., 307, 73, 10.1016/j.ins.2015.02.031 Canul-Reich, 2012, Iterative feature perturbation as a gene selector for microarray data, Int. J. Pattern Recognit. Artif. Intell., 26, 10.1142/S0218001412600038 Tohma, 1989, Structural approach to the estimation of the number of residual software faults based on the hyper-geometric distribution, IEEE Trans. Softw. Eng., 15, 345, 10.1109/32.21762