A Stable, Unified Density Controlled Memetic Algorithm for Gene Regulatory Network Reconstruction Based on Sparse Fuzzy Cognitive Maps
Tóm tắt
Gene regulatory networks (GRNs) denote the interrelation among genes in the genomic level. GRNs have a sparse network structures, and as a simulation of GRNs, the density of The Dialogue for Reverse Engineering Assessments and Methods (DREAM) challenge is less than 5%. So using sparse models to represent GRNs is a meaningful task. Fuzzy cognitive maps (FCMs) have been used to reconstruct GRNs.
However, the networks learned by automated derivate-free methods is much denser than those in practical applications. Moreover, the performance of current sparse FCM learning algorithms is worse than what we expect. Therefore, proposing a fast, simple and sparse FCM learning algorithm is a realistic demand. Here, we propose a new unified algorithm: Density Controlled Memetic Algorithm (DC-MA) for learning sparse FCMs. As a simple and good-performance algorithm, memetic algorithm (MA) is chosen as the framework of DC-MA. In DC-MA, a new crossover operator and a mutation operator are designed to optimize the target, control the density and ensure the stability; the local search is used to improve the accuracy and a special self-learning operator is proposed to adjust density. To test the effectiveness of our algorithm, DC-MA is performed on synthetic data with varying sizes and densities. The results show that DC-MA obtains good performance in learning sparse FCMs from time series. On the benchmark datasets DREAM3, DREAM4 and large-scale GRN reconstruction DREAM5 dataset, DC-MA shows high accuracy. The good performance in learning sparse FCMs shows the effectiveness of DC-MA, and the simplicity and scalability of the framework ensure that DC-MA can be adapted to a wide range of needs.
Tài liệu tham khảo
Acampora G, Pedrycz W, Vitiello A (2015) A competent memetic algorithm for learning fuzzy cognitive maps. IEEE Trans Fuzzy Syst 23(6):2397–2411
Aguilar J (2005) A survey about fuzzy cognitive maps papers. Int J Comput Cognit 3(2):27–33
Axelrod R (2015) Structure of decision: the cognitive maps of political elites. Princeton university Press, Princeton
Bhuvana J, Aravindan C (2016) Memetic algorithm with Preferential Local Search using adaptive weights for multi-objective optimization problems. Soft Comput 20(4):1365–1388
Bueno S, Salmeron JL (2009) Benchmarking main activation functions in fuzzy cognitive maps. Expert Syst Appl 36(3):5221–5229
Chen Y, Mazlack LJ, Lu LJ (2012) Inferring fuzzy cognitive map models for gene regulatory networks from gene expression data. In: 2012 IEEE international conference on bioinformatics and biomedicine (BIBM), IEEE, pp 1–4
Chen Y, Mazlack L, Lu L (2012) Learning fuzzy cognitive maps from data by ant colony optimization. In: Proceedings of the 14th annual conference on Genetic and evolutionary computation, ACM, pp 9–16
Chi Y, Liu J (2014) Learning large-scale fuzzy cognitive maps using a hybrid of memetic algorithm and neural network. In: Proceedings of the 2014 IEEE international conference on fuzzy systems, China, pp 1036–1040
Chi Y, Liu J (2016) Learning of fuzzy cognitive maps with varying densities using a multiobjective evolutionary algorithm. IEEE Trans Fuzzy Syst 24(1):71–81
Chi Y, Liu J (2016) Reconstructing gene regulatory networks with a memetic-neural hybrid based on fuzzy cognitive maps. Nat Comput 18:1–12
Davidson E, Levin M (2005) Gene regulatory networks. Proc Natl Acad Sci 102(14):4935
Deb K, Beyer HG (2001) Self-adaptive genetic algorithms with simulated binary crossover. Evolut Comput 9(2):197–221
Dogu E, Albayrak YE (2018) Criteria evaluation for pricing decisions in strategic marketing management using an intuitionistic cognitive map approach. Soft Comput 22:1–17
Eshelman LJ, Schaffer JD (1993) Real-coded genetic algorithms and interval-schemata. Foundations of genetic algorithms, vol 2. Elsevier, Amsterdam, pp 187–202
Froelich W, Pedrycz W (2017) Fuzzy cognitive maps in the modeling of granular time series. Knowl Based Syst 115:110–122
Ghazanfari M, Alizade S, Fathian M, Koulouriotis DE (2007) Comparing simulated annealing and genetic algorithm in learning FCM. Appl Math Comput 192(1):56–68
Greenfield A, Madar A, Ostrer H, Bonneau R (2010) DREAM4: combining genetic and dynamic information to identify biological networks and dynamical models. PLoS ONE 5(10):e13397
Herrera F, Lozano M, Verdegay JL (1998) Tackling real-coded genetic algorithms: operators and tools for behavioural analysis. Artif Intell Rev 12(4):265–319
Hsieh YH, Chen IH, Yuan ST (2014) FCM-based customer expectation-driven service dispatch system. Soft Comput 18(2):359–378
Kosko B (1986) Fuzzy cognitive maps. Int J Man Mach Stud 24(1):65–75
Liu J, Chi Y, Zhu C (2016) A dynamic multiagent genetic algorithm for gene regulatory network reconstruction based on fuzzy cognitive maps. IEEE Trans Fuzzy Syst 24(2):419–431
Liu J, Chi Y, Zhu C, Jin Y (2017) A time series driven decomposed evolutionary optimization approach for reconstructing large-scale gene regulatory networks based on fuzzy cognitive maps. BMC Bioinform 18(1):241
Lu W, Yang J, Liu X, Pedrycz W (2014) The modeling and prediction of time series based on synergy of high-order fuzzy cognitive map and fuzzy c-means clustering. Knowl Based Syst 70:242–255
Marbach D, Schaffter T, Mattiussi C, Floreano D (2009) Generating realistic in silico gene networks for performance assessment of reverse engineering methods. J Comput Biol 16(2):229–239
Martin N, Rani JK, Aleeswari A, Pandiammal P (2017) An analysis of the associated implications of green manufacturing using fuzzy cognitive maps. Mater Today Proc 4(2):4219–4227
Mencía R, Sierra MR, Mencía C, Varela R (2015) Memetic algorithms for the job shop scheduling problem with operators. Appl Soft Comput 34:94–105
Moscato P (1989) On evolution, search, optimization, genetic algorithms and martial arts: towards memetic algorithms. Caltech concurrent computation program, C3P Report, 826
Nápoles G, Grau I, Bello R, Grau R (2014) Two-steps learning of Fuzzy Cognitive Maps for prediction and knowledge discovery on the HIV-1 drug resistance. Expert Syst Appl 41(3):821–830
Nasiruzzaman A B M, Rabbani M G (2008) An educational purpose GUI for evolutionary computation in economic dispatch problem. In: International conference on electrical and computer engineering, pp 355–359
Papageorgiou EI (2012) Learning algorithms for fuzzy cognitive maps—a review study. IEEE Trans Syst Man Cybern Part C Appl Rev 42(2):150–163
Papageorgiou EI, Groumpos P (2003) Optimization of fuzzy cognitive map model in clinical radiotherapy through differential evolution algorithm. Int J Biomed Soft Comput Human Sci Off J Biomed Fuzzy Syst Assoc 9(2):25–31
Papageorgiou EI, Aggelopoulou KD, Gemtos TA, Nanos GD (2013) Yield prediction in apples using fuzzy cognitive map learning approach. Comput Electron Agric 91:19–29
Papageorgiou EI, Parsopoulos KE, Stylios CS, Groumpos PP, Vrahatis MN (2005) Fuzzy cognitive maps learning using particle swarm optimization. J Intell Inform Syst 25(1):95–121
Papageorgiou EI, Stylios CD, Groumpos PP (2004) Active Hebbian learning algorithm to train fuzzy cognitive maps. Int J Approx Reason 37(3):219–249
Papageorgiou E, Stylios C, Groumpos P (2003) Fuzzy cognitive map learning based on nonlinear Hebbian rule. Australasian joint conference on artificial intelligence. Springer, Berlin, pp 256–268
Pedrycz W, Jastrzebska A, Homenda W (2016) Design of fuzzy cognitive maps for modeling time series. IEEE Trans Fuzzy Syst 24(1):120–130
Salmeron JL, Palos-Sanchez PR (2017) Uncertainty propagation in fuzzy grey cognitive maps with Hebbian-like learning algorithms. IEEE Trans Cybern 99:1–10
Salmeron JL, Papageorgiou EI (2014) Fuzzy grey cognitive maps and nonlinear Hebbian learning in process control. Appl Intell 41(1):223–234
Salmeron JL, Ruiz-Celma A, Mena A (2017) Learning FCMs with multi-local and balanced memetic algorithms for forecasting industrial drying processes. Neurocomputing 232:52–57
Socha K, Dorigo M (2008) Ant colony optimization for continuous domains. Eur J Oper Res 185(3):1155–1173
Song HJ, Miao CY, Wuyts R, Shen ZQ, D’Hondt M, Catthoor F (2011) An extension to fuzzy cognitive maps for classification and prediction. IEEE Trans Fuzzy Syst 19(1):116–135
Stach W, Kurgan L, Pedrycz W (2007) Parallel learning of large fuzzy cognitive maps. In: Proceeding of the 2007 IEEE international joint conference on neural networks, USA
Stach W, Kurgan L, Pedrycz W (2008) Data-driven nonlinear Hebbian learning method for fuzzy cognitive maps. In: Fuzzy systems, 2008. FUZZ-IEEE 2008, (IEEE World Congress on Computational Intelligence), pp 1975–1981
Stach W, Kurgan L, Pedrycz W (2010) A divide and conquer method for learning large fuzzy cognitive maps. Fuzzy Sets and Syst 161(19):2515–2532
Stach W, Kurgan L, Pedrycz W, Reformat M (2005) Genetic learning of fuzzy cognitive maps. Fuzzy Sets Syst 153(3):371–401
Stach W, Pedrycz W, Kurgan LA (2012) Learning of fuzzy cognitive maps using density estimate. IEEE Trans Systems Man Cybern Part B 42(3):900–912
Stolovitzky G, Monroe DON, Califano A (2007) Dialogue on reverse-engineering assessment and methods. Ann New York Acad Sci 1115(1):1–22
Tsadiras A, Zitopoulos G (2017) Fuzzy cognitive maps as a decision support tool for container transport logistics. Evol Syst 8(1):19–33
Wright AH (1991) Genetic algorithms for real parameter optimization. Foundations of genetic algorithms, vol 1. Elsevier, Asterdam, pp 205–218
Wu K, Liu J (2016) Robust learning of large-scale fuzzy cognitive maps via the lasso from noisy time series. Knowl Based Syst 113:23–38
Yang S, Liu J (2018) Time series forecasting based on high-order fuzzy cognitive maps and wavelet transform. IEEE Trans Fuzzy Syst 26:3391–3402
Yesil E, Dodurka MF (2013) Goal-oriented decision support using big bang-big crunch learning based fuzzy cognitive map: an ERP management case study. In: Proceeding of 2013 IEEE international conference on fuzzy systems, pp 1–8
Zhong W, Liu J, Xue M, Jiao L (2004) A multiagent genetic algorithm for global numerical optimization. IEEE Trans Syst Man Cybern Part B 34(2):1128–1141
Zhu Y, Zhang W (2008) An integrated framework for learning fuzzy cognitive map using RCGA and NHL algorithm. In: IEEE conference on wireless communications, networking and mobile computing, Dalian, China, pp 1–5
Zou X, Liu J (2017) A mutual information based two-phase memetic algorithm for large-scale fuzzy cognitive map learning. IEEE Trans Fuzzy Syst 26:2120–2134
Zheng R, Li M, Chen X, Wu FX, Pan Y, Wang J (2018) BiXGBoost: a scalable, flexible boosting-based method for reconstructing gene regulatory networks. Bioinformatics 35(11):1893–1900
Yu B, Xu JM, Li S, Chen C, Chen RX, Wang L, Zhang Y, Wang MH (2017) Inference of time-delayed gene regulatory networks based on dynamic Bayesian network hybrid learning method. Oncotarget 8(46):80373
Zhang XJ, Liu KQ, Liu ZP et al (2013) NARROMI: a noise and redundancy reduction technique improves accuracy of gene regulatory network inference. Bioinformatics 29(1):106–113
Zhang XJ, Zhao J, Hao JK et al (2015) Conditional mutual inclusive information enables accurate quantification of associations in gene regulatory networks. Nucleic Acids Res 43(5):e31
Wang J, Qing G (2018) Ensemble interval-valued fuzzy cognitive maps. IEEE Access 6:38356–38366
Papageorgiou EI, Arthi K (2012) Fuzzy cognitive map ensemble learning paradigm to solve classification problems: application to autism identification. Appl Soft Comput 12(12):3798–3809
Wu K, Liu J, Chi Y (2017) Wavelet fuzzy cognitive maps. Neurocomputing 232:94–103