Feature Selection Based on Modified Bio-inspired Atomic Orbital Search Using Arithmetic Optimization and Opposite-Based Learning
Tóm tắt
Feature selection (FS) has the largest influence on the performance of machine learning methods. FS can remove the irrelevant and redundancy features from the data while preserving the same quality of increasing it. However, the traditional FS methods are time-consuming and can be stuck in local optima. So, the metaheuristic (MH) techniques are used to avoid these limitations since they have several operators that explore and exploit the search domain better than traditional methods. Besides these behaviors of MH, we present an improved atomic orbital search (IAOS) algorithm using a global search strategy that uses the operators of arithmetic optimization algorithm (AOA), which has proven a good exploration ability to provide a promising candidate solution. The opposite-based learning (OBL) is applied to enhance the initial population, which leads to enhancing the convergence rate towards the optimal solution. In addition, a dynamic photon rate is used to enhance the balance between exploration and exploitation. Finally, the sequential backward selection (SBS) is used as a local search strategy to improve the best solution, and this leads to obtaining a set of relevant features that increase the classification accuracy. To evaluate the performance of the presented IAOS-SBS as an FS method, a set of twenty UCI datasets is used; also, it is compared with other well-known FS methods. The results show the superiority of IAOS-SBS among the performance measures. Finally, it is concluded that IAOS-SBS can select fewer features with achieving high classification accuracy for most of the datasets utilized in the study. This indicates the use of OBL and SBS leads to enhancing the original AOS.
Tài liệu tham khảo
Pintas JT, Fernandes LAF, Garcia ACB. Feature selection methods for text classification: a systematic literature review. Artif Intell Rev. 2021;54:6149–200.
Stańczyk U, Zielosko B, Jain LC. Advances in feature selection for data and pattern recognition: an introduction. Intell Syst Ref Libr. 2018.
Bolón-Canedo V, Remeseiro B. Feature selection in image analysis: a survey. Artif Intell Rev. 2020;53:2905–31.
Tadist K, Najah S, Nikolov NS, Mrabti F, Zahi A. Feature selection methods and genomic big data: a systematic review. J Big Data. 2019;6:79.
Nguyen BH, Xue B, Zhang M. A survey on swarm intelligence approaches to feature selection in data mining. Swarm Evol Comput. 2020;54.
Remeseiro B, Bolon-Canedo V. A review of feature selection methods in medical applications. Comput Biol Med. 2019.
Alelyani S, Tang J, Liu H. Feature selection for clustering. Springer Reference. 2011.
Zhao Z, Liu H. Spectral feature selection for supervised and unsupervised learning. In: ACM Int Conf Proceeding Ser. 2007. p. 1151–7.
Xue B, Zhang M, Browne WN, Yao X. A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput. 2016;20:606–26.
Whitney AW. A direct method of nonparametric measurement selection. IEEE Trans Comput. 1971;100:1100–3.
Marill T, Green DM. On the effectiveness of receptors in recognition systems. IEEE Trans Inf Theory. 1963;9:11–7.
Shreem SS, Abdullah S, Nazri MZA. Hybrid feature selection algorithm using symmetrical uncertainty and a harmony search algorithm. Int J Syst Sci. 2016;47:1312–29.
Loughrey J, Cunningham P. Overfitting in wrapper-based feature subset selection: the harder you try the worse it gets. In: Bramer M, Coenen F, Allen T, editors. Research and Development in Intelligent Systems XXI. London: Springer; 2007. p. 33–43.
Azizi M. Atomic orbital search: a novel metaheuristic algorithm. Appl Math Model. 2021;93:657–83.
Azizi M, Talatahari S, Giaralis A. Optimization of engineering design problems using atomic orbital search algorithm. IEEE Access. 2021;9:102497–519.
Abualigah L, Diabat A, Mirjalili S, Abd Elaziz M, Gandomi AH. The arithmetic optimization algorithm. Comput Methods Appl Mech Eng. 2021;376.
Khatir S, Tiachacht S, Le Thanh C, Ghandourah E, Mirjalili S, Abdel Wahab M. An improved Artificial neural network using arithmetic optimization algorithm for damage assessment in FGM composite plates. Compos Struct. 2021;273.
Abualigah L, Diabat A, Sumari P, Gandomi AH. A novel evolutionary arithmetic optimization algorithm for multilevel thresholding segmentation of covid-19 ct images. Processes. 2021;9:1155.
Premkumar M, Jangir P, Kumar BS, Sowmya R, Alhelou HH, Abualigah L, et al. A new arithmetic optimization algorithm for solving real-world multiobjective CEC-2021 constrained optimization problems: diversity analysis and validations. IEEE Access. 2021;9:84263–95.
Zellagui M, Lasmari A, Settoul S, El-Bayeh CZ, Chenni R, Belbachir N. Arithmetic optimization algorithm for optimal installation of DSTATCOM into distribution system based on various voltage stability indices. 2021. pp. 1–6.
Ramya VJ. Enhanced deep CNN based arithmetic optimization algorithm for acute myelogenous leukemia detection. Ann Romanian Soc Cell Biol. 2021;25:2999–3021.
ZorarpacI E, Özel SA. A hybrid approach of differential evolution and artificial bee colony for feature selection. Expert Syst Appl. 2016;62:91–103.
O’Boyle NM, Palmer DS, Nigsch F, Mitchell JB. Simultaneous feature selection and parameter optimisation using an artificial ant colony: case study of melting point prediction. Chem Cent J. 2008;2:21.
Nakamura RYM, Pereira LAM, Rodrigues D, Costa KAP, Papa JP, Yang XS. Binary bat algorithm for feature selection. In: Swarm Intelligence and Bio-Inspired Computation. 2013. p. 225–37.
Moradi P, Gholampour M. A hybrid particle swarm optimization for feature subset selection by integrating a novel local search strategy. Appl Soft Comput J. 2016;43:117–30.
Emary E, Zawbaa HM, Hassanien AE. Binary grey wolf optimization approaches for feature selection. Neurocomputing. 2016;172:371–81.
Faris H, Mafarja MM, Heidari AA, Aljarah I, Al-Zoubi AM, Mirjalili S, et al. An efficient binary salp swarm algorithm with crossover scheme for feature selection problems. Knowl Based Syst. 2018;154:43–67.
Abd Elaziz M, Oliva D, Xiong S. An improved opposition-based sine cosine algorithm for global optimization. Expert Syst Appl. 2017;90:484–500.
Pashaei E, Aydin N. Binary black hole algorithm for feature selection and classification on biological data. Appl Soft Comput. 2017;56:94–106.
Maheshwari R, Kumar M, Kumar S. Optimization of feature selection in face recognition system using differential evolution and genetic algorithm. Adv Intell Syst Comput. 2016. p. 363–74.
Ghosh M, Kundu T, Ghosh D, Sarkar R. Feature selection for facial emotion recognition using late hill-climbing based memetic algorithm. Multimed Tools Appl. 2019;78:25753–79.
Jona JB, Nagaveni N. A hybrid swarm optimization approach for feature set reduction in digital mammograms. WSEAS Trans Inf Sci Appl. 2012;9:340–9.
Javaid S, Ali I, Mushtaq N, Faiz Z, Sadiq HA, Javaid N. Enhanced differential evolution and crow search algorithm based home energy management in smart grid. In International Conference on Broadband and Wireless Computing, Communication and Applications. Springer: Cham; 2017. p. 76–86.
Javaid N, Mohsin SM, Iqbal A, Yasmeen A, Ali I. A hybrid bat-crow search algorithm based home energy management in smart grid. In Conference on Complex, Intelligent, and Software Intensive Systems. Springer: Cham; 2018. p. 75–88.
Kumar L, Bharti KK. A novel hybrid BPSO–SCA approach for feature selection. Nat Comput. 2021;20:39–61.
Khushaba RN, Al-Ani A, Alsukker A, Al-Jumaily A. A combined ant colony and differential evolution feature selection algorithm. Lect Notes Comput Sci (including Subser Lect Notes Artif Intell Lect Notes Bioinformatics). 2008.
Abualigah L, Dulaimi AJ. A novel feature selection method for data mining tasks using hybrid sine cosine algorithm and genetic algorithm. Cluster Comput. 2021.
Xue B, Zhang M, Browne WN. Particle swarm optimisation for feature selection in classification: novel initialisation and updating mechanisms. Appl Soft Comput J. 2014.
Gu S, Cheng R, Jin Y. Feature selection for high-dimensional classification using a competitive swarm optimizer. Soft Comput. 2018.
Kaya Y. Feature selection using binary cuckoo search algorithm [Ikili guguk kuşu arama algoritmasi ile öznitelik seçimi]. In: 26th IEEE Signal Process Commun Appl Conf SIU 2018. 2018.
Sayed GI, Tharwat A, Hassanien AE. Chaotic dragonfly algorithm: an improved metaheuristic algorithm for feature selection. Appl Intell. 2019;49:188–205.
Ouadfel S, Abd Elaziz M. Enhanced crow search algorithm for feature selection. Expert Syst Appl. 2020.
Jia H, Li J, Song W, Peng X, Lang C, Li Y. Spotted hyena optimization algorithm with simulated annealing for feature selection. IEEE Access. 2019;7:71943–62.
Ghosh KK, Ahmed S, Singh PK, Geem ZW, Sarkar R. Improved binary sailfish optimizer based on adaptive β-Hill climbing for feature selection. IEEE Access. 2020;8:83548–60.
Tizhoosh HR. Opposition-based learning: a new scheme for machine intelligence. Int Conf Intell Agents Web Technol Internet. 2005;1:695–701.
Liang X, Cai Z, Wang M, Zhao X, Chen H, Li C. Chaotic oppositional sine–cosine method for solving global optimization problems. Eng Comput. 2020;38:1223–39.
Rahnamayan S, Tizhoosh HR, Salama MM. Opposition-based differential evolution. Stud. Comput Intell. 2008;143:155–71.
Mahdavi S, Rahnamayan S, Deb K. Partial opposition-based learning using current best candidate solution. In: 2016 IEEE Symp Ser Comput Intell SSCI 2016. IEEE; 2017.
Verma OP, Aggarwal D, Patodi T. Opposition and dimensional based modified firefly algorithm. Expert Syst Appl. 2016;44:168–76.
Mirjalili S. SCA: a sine cosine algorithm for solving optimization problems. Knowl Based Syst. 2016;96:120–33.
Kennedy J, Eberhart RC. Discrete binary version of the particle swarm algorithm. Proc IEEE Int Conf Syst Man Cybern. 1997;5:4104–8.
Mirjalili S, Gandomi AH, Mirjalili SZ, Saremi S, Faris H, Mirjalili SM. Salp swarm algorithm: a bio-inspired optimizer for engineering design problems. Adv Eng Softw. 2017;114:163–91.
Storn R, Price K. Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J Glob Optim. 1997;11:341–59.
Hashim FA, Houssein EH, Mabrouk MS, Al-Atabany W, Mirjalili S. Henry gas solubility optimization: a novel physics-based algorithm. Futur Gener Comput Syst. 2019;101:646–67.
Singh N, Singh SB. A novel hybrid GWO-SCA approach for optimization problems. Eng Sci Technol an Int J. 2017;20:1586–601.
Arora S, Sharma M, Anand P. A novel chaotic interior search algorithm for global optimization and feature selection. Appl Artif Intell. 2020;34:292–328.
Hu P, Pan JS, Chu SC. Improved binary grey wolf optimizer and its application for feature selection. Knowl Based Syst. 2020;195.
Samareh Moosavi SH, Khatibi Bardsiri V. Satin bowerbird optimizer: a new optimization algorithm to optimize ANFIS for software development effort estimation. Eng Appl Artif Intell. 2017;60:1–15.
Rashedi E, Nezamabadi-Pour H, Saryazdi S. BGSA: Binary gravitational search algorithm. Nat Comput. 2010;9:727–45.
Mirjalili S, Mirjalili SM, Yang XS. Binary bat algorithm Neural Comput Appl. 2014;25:663–81.
Joshi H, Arora S. Enhanced grey Wolf optimization algorithm for global optimization. Fundam Inform. 2017;153:235–64.
Simon D. Biogeography-based optimization. IEEE Trans Evol Comput. 2008;12:702–13.
Mafarja M, Mirjalili S. Whale optimization approaches for wrapper feature selection. Appl Soft Comput J. 2018;62:441–53.
Mafarja M, Aljarah I, Heidari AA, Hammouri AI, Faris H, Al-Zoubi AM, et al. Evolutionary population dynamics and grasshopper optimization approaches for feature selection problems. Knowl Based Syst. 2018;145:25–45.
Arora S, Singh H, Sharma M, Sharma S, Anand P. A new hybrid algorithm based on grey wolf optimization and crow search algorithm for unconstrained function optimization and feature selection. IEEE Access. 2019;7:26343–61.