A survey of deep neural network architectures and their applications

Abdel Zaher, 2016, Breast cancer classification using deep belief networks, Exp. Syst. Appl., 46, 139, 10.1016/j.eswa.2015.10.015 Agostinelli, 2013, Adaptive multi-column deep neural networks with application to robust image denoising, Adv. Neural Inf. Process. Syst., 26, 1493 Arel, 2010, Deep machine learning-a new frontier in artificial intelligence research [research frontier], IEEE Comput. Intell. Mag., 5, 13, 10.1109/MCI.2010.938364 Arias Castro, 2009, Does median filtering truly preserve edges better than linear filtering?, Ann. Stat., 37, 1172, 10.1214/08-AOS604 Arnold, 2011, An introduction to deep learning, ESANN, 477 Aryal, 2016, Data driven articulatory synthesis with deep neural networks, Comput. Speech Lang., 36, 260, 10.1016/j.csl.2015.02.003 Baker, 2009, Developments and directions in speech recognition and understanding [dsp education], IEEE Trans. Signal Process. Mag., 26, 75, 10.1109/MSP.2009.932166 Ballard, 1982 Bell, 2015, Learning visual similarity for product design with convolutional neural networks, ACM Trans. Graph. (TOG), 34, 98, 10.1145/2766959 Bengio, 2009, Learning deep architectures for AI, Found. Trends Mach. Learn., 2, 1, 10.1561/2200000006 Bengio, 2013, Representation learning: A review and new perspectives, IEEE Pattern Anal. Mach. Intell., 35, 1798, 10.1109/TPAMI.2013.50 Bengio, 2009, Justifying and generalizing contrastive divergence, Neural Comput., 21, 1601, 10.1162/neco.2008.11-07-647 Bengio, 2007, Greedy layer-wise training of deep networks, Adv. Neural Inf. Process. Syst., 19, 153 Bishop, 2006 Bourlard, 1988, Auto-association by multilayer perceptrons and singular value decomposition, Biol. Cybern., 59, 291, 10.1007/BF00332918 Y.L. Boureau, N.L. Roux, F. Bach, J. Ponce, Y. LeCun, Ask the locals: multi-way local pooling for image recognition, in: 2011 IEEE International Conference on Computer Vision (ICCV), 2011, pp. 2651–2658. Y.L. Boureau, J. Ponce, Y. LeCun, A theoretical analysis of feature pooling in visual recognition, in: Proceedings of the 27th International Conference on Machine Learning (ICML-10), 2010, pp. 111–118. R.G. Brown, P.Y. Hwang, Introduction to random signals and applied kalman filtering: with matlab exercises and solutions, Introduction to random signals and applied Kalman filtering: with MATLAB exercises and solutions, by Brown, Robert Grover.; Hwang, Patrick YC New York: Wiley, c1997, vol. 1, 1997. Chandra, 2016, Fast learning in deep neural networks, Neurocomputing, 171, 1205, 10.1016/j.neucom.2015.07.093 Chen, 2015, Multitask learning of deep neural networks for low-resource speech recognition, IEEE/ACM Trans. Audio, Speech, Lang. Process., 23, 1172 Chen, 2016, Pinning controllability of autonomous Boolean control networks, Sci. China Inf. Sci., 59, 1, 10.1007/s11432-016-5579-8 Chen, 2016, Cnntracker, Appl. Soft Comput., 38, 1088, 10.1016/j.asoc.2015.06.048 X. Chen, Y. Xu, D.W.K. Wong, T.Y. Wong, J. Liu, Glaucoma detection based on deep convolutional neural network, in: Engineering in Medicine and Biology Society (EMBC), in: Proceedings of the 37th Annual International Conference of the IEEE, 2015, pp. 715–718. Ciresan, 2012, Multi-column deep neural network for traffic sign classification, Neural Netw., 32, 333, 10.1016/j.neunet.2012.02.023 D. Ciresan, U. Meier, J. Schmidhuber, Multi-column deep neural networks for image classification, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 3642–3649. R. Collobert, J. Weston, A unified architecture for natural language processing: Deep neural networks with multitask learning, in: Proceedings of the 25th international conference on Machine learning, 2008, pp. 160–167. Cui, 2015, Data augmentation for deep neural network acoustic modeling, IEEE/ACM Trans. Audio, Speech Lang. Process. (TASLP), 23, 1469, 10.1109/TASLP.2015.2438544 Dahl, 2012, Context-dependent pre-trained deep neural networks for large-vocabulary speech recognition, IEEE Trans. Audio, Speech, Lang. Process., 20, 30, 10.1109/TASL.2011.2134090 J. Deng, W. Dong, R. Socher, L.J. Li, K. Li, L. Fei-Fei, Imagenet: A large-scale hierarchical image database, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2009, 2009, pp. 248–255. Deng, 2012, Three classes of deep learning architectures and their applications: a tutorial survey, APSIPA Trans. Signal Inf. Process. Deng, 2014, A tutorial survey of architectures, algorithms, and applications for deep learning, APSIPA Trans. Signal Inf. Process., 3, e2, 10.1017/atsip.2013.9 Deng, 1991, Phonemic hidden markov models with continuous mixture output densities for large vocabulary word recognition, IEEE Trans. Signal Process., 39, 1677, 10.1109/78.134406 L. Deng, J. Li, J.T. Huang, K. Yao, D. Yu, F. Seide, M. Seltzer, G. Zweig, X. He, J. Williams, Y. Gong, A. Acero, Recent advances in deep learning for speech research at microsoft, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 8604–8608. Deng, 1990, Large vocabulary word recognition using context-dependent allophonic hidden markov models, Comput. Speech Lang., 4, 345, 10.1016/0885-2308(90)90015-X L. Deng, D. Yu, Deep convex net: A scalable architecture for speech pattern classification, in: Proceedings of the Interspeech, 2011. G. Desjardins, Y. Bengio, Empirical evaluation of convolutional RBMs for vision, Département d′Informatique et de Recherche Opérationnelle, Université de Montréal, Tech. Rep. 1327, 2008. Ding, 2015, Head motion synthesis from speech using deep neural networks, Multimed. Tools Appl., 74, 9871, 10.1007/s11042-014-2156-2 Dong, 2015, Image super-resolution using deep convolutional networks, IEEE Trans. Pattern Anal. Mach. Intell., 38, 295, 10.1109/TPAMI.2015.2439281 Dong, 2015, Adaptive cascade deep convolutional neural networks for face alignment, Comput. Stand. Interfaces, 42, 105, 10.1016/j.csi.2015.06.004 D. Eigen, J. Rolfe, R. Fergus, Y. LeCun, Understanding deep architectures using a recursive convolutional network, arXiv:1312.1847, 2013. Elfwing, 2015, Expected energy-based restricted boltzmann machine for classification, Neural Netw., 64, 29, 10.1016/j.neunet.2014.09.006 O. Emad, I.A. Yassine, A.S. Fahmy, Automatic localization of the left ventricle in cardiac mri images using deep learning, in: Engineering in Medicine and Biology Society (EMBC), 2015 Proceedings of the 37th Annual International Conference of the IEEE, 2015, pp. 683–686. Felzenszwalb, 2010, Object detection with discriminatively trained part-based models, IEEE Trans. Pattern Anal. Mach. Intell., 32, 1627, 10.1109/TPAMI.2009.167 F. Feng, X. Wang, R. Li, Cross-modal retrieval with correspondence autoencoder, in: Proceedings of the ACM International Conference on Multimedia, 2014, pp. 7–16. A. Fischer, C. Igel, Training RBMs based on the signs of the CD approximation of the log-likelihood derivatives, in: ESANN, 2011. Fukushima, 1980, Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position, Biol. Cybern., 36, 193, 10.1007/BF00344251 X. Glorot, A. Bordes, Y. Bengio, Domain adaptation for large-scale sentiment classification: A deep learning approach, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 513–520. Gong, 2016, Change detection in synthetic aperture radar images based on deep neural networks, IEEE Trans. Neural Netw. Learn. Syst., 27, 125, 10.1109/TNNLS.2015.2435783 Gonzalez-Dominguez, 2015, Frame-by-frame language identification in short utterances using deep neural networks, Neural Netw., 64, 49, 10.1016/j.neunet.2014.08.006 Guo, 2015, 3D mesh labeling via deep convolutional neural networks, ACM Trans. Graph. (TOG), 35, 3, 10.1145/2835487 P. Hamel, D. Eck, Learning features from music audio with deep belief networks, in: ISMIR, 2010, pp. 339–344. Han, 2015, Two-stage learning to predict human eye fixations via SADEs, IEEE Trans. Cybern., 46, 487, 10.1109/TCYB.2015.2404432 M. Henderson, B. Thomson, S. Young, Deep neural network approach for the dialog state tracking challenge, in: Proceedings of the SIGDIAL 2013 Conference, 2013, pp. 467–471. J. Hennrich, C. Herff, D. Heger, T. Schultz, Investigating deep learning for FNIRs based BCI, in: Engineering in Medicine and Biology Society (EMBC), 2015 Proceedings of the 37th Annual International Conference of the IEEE, 2015, pp. 2844–2847. Hinton, 2012, A practical guide to training restricted Boltzmann machines, Neural Netw.: Tricks Trade, 599 Hinton, 2002, Training products of experts by minimizing contrastive divergence, Neural Comput., 14, 1771, 10.1162/089976602760128018 Hinton, 1995, The “wake-sleep” algorithm for unsupervised neural networks, Science, 268, 1158, 10.1126/science.7761831 Hinton, 2012, Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups, Signal Process. Mag., IEEE, 29, 82, 10.1109/MSP.2012.2205597 Hinton, 2006, A fast learning algorithm for deep belief nets, Neural Comput., 18, 1527, 10.1162/neco.2006.18.7.1527 Hinton, 2006, Reducing the dimensionality of data with neural networks, Science, 313, 504, 10.1126/science.1127647 Hinton, 1994, Autoencoders, minimum description length, and Helmholtz free energy, Adv. Neural Inf. Process. Syst., 3 Hong, 2015, Multimodal deep autoencoder for human pose recovery, IEEE Trans. Image Process., 24, 5659, 10.1109/TIP.2015.2487860 Hou, 2016, Non-fragile state estimation for discrete Markovian jumping neural networks, Neurocomputing, 179, 238, 10.1016/j.neucom.2015.11.089 Hu, 2014, State estimation for a class of discrete nonlinear systems with randomly occurring uncertainties and distributed sensor delays, Int. J. Gen. Syst., 43, 387, 10.1080/03081079.2014.892251 Hu, 2016, On co-design of filter and fault estimator against randomly occurring nonlinearities and randomly occurring deception attacks, Int. J. Gen. Syst., 45, 619, 10.1080/03081079.2015.1106730 Hu, 2015, Transferring deep convolutional neural networks for the scene classification of high-resolution remote sensing imagery, Remote Sens., 7, 14680, 10.3390/rs71114680 Hu, 2016, Estimation, filtering and fusion for networked systems with network-induced phenomena: New progress and prospects, Inf. Fusion, 31, 65, 10.1016/j.inffus.2016.01.001 Hu, 2016, A variance-constrained approach to recursive state estimation for time-varying complex networks with missing measurements, Automatica, 64, 155, 10.1016/j.automatica.2015.11.008 Hu, 2013, Quantised recursive filtering for a class of nonlinear systems with multiplicative noises and missing measurements, Int. J. Control, 86, 650, 10.1080/00207179.2012.756149 Hu, 2016, Transfer learning for short-term wind speed prediction with deep neural networks, Renew. Energy, 85, 83, 10.1016/j.renene.2015.06.034 J.T. Huang, J. Li, D. Yu, L. Deng, Y. Gong, Cross-language knowledge transfer using multilingual deep neural network with shared hidden layers, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2013, pp. 7304–7308. Huang, 2013, Fine-grained semi-supervised labeling of large shape collections, ACM Trans. Graph. (TOG), 32, 190, 10.1145/2508363.2508364 Hubel, 1962, Receptive fields, binocular interaction and functional architecture in the cat's visual cortex, J. Physiol., 160, 106, 10.1113/jphysiol.1962.sp006837 I.G.Y. Bengio, A. Courville, Deep learning, book in preparation for MIT Press [Online], 2016. Indiveri, 2015, Memory and information processing in neuromorphic systems, Proc. IEEE, 103, 1379, 10.1109/JPROC.2015.2444094 N. Jaitly, G. Hinton, Learning a better representation of speech soundwaves using restricted Boltzmann machines, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 5884–5887. K. Jarrett, K. Kavukcuoglu, M. Ranzato, Y. LeCun, What is the best multi-stage architecture for object recognition? in: Proceedings of IEEE Proceedings of the 12th International Conference on Computer Vision, 2009, pp. 2146–2153. Y. Jia, C. Huang, T. Darrell, Beyond spatial pyramids: Receptive field learning for pooled image features, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 3370–3377. Juang, 1986, Maximum likelihood estimation for multivariate mixture observations of markov chains (corresp.), IEEE Trans. Inf. Theory, 32, 307, 10.1109/TIT.1986.1057145 Kalogerakis, 2010, Learning 3D mesh segmentation and labeling, ACM Trans. Graph. (TOG), 29, 102, 10.1145/1778765.1778839 Kang, 2015, NMF-based target source separation using deep neural network, IEEE Signal Process. Lett., 22, 229, 10.1109/LSP.2014.2354456 R. Kelley, L. Wigand, B. Hamilton, K. Browne, M. Nicolescu, M. Nicolescu, Deep networks for predicting human intent with respect to objects, in: Proceedings of the Seventh Annual ACM/IEEE International Conference on Human-Robot Interaction, 2012, pp. 171–172. Kim, 2016, Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia, NeuroImage, 124, 127, 10.1016/j.neuroimage.2015.05.018 Kim, 2015, Handwritten hangul recognition using deep convolutional neural networks, Int. J. Doc. Anal. Recognit. (IJDAR), 18, 1, 10.1007/s10032-014-0229-4 Kim, 2015, Human detection and activity classification based on micro-doppler signatures using deep convolutional neural networks, IEEE Geosci. Remote Sens. Lett., 13, 8, 10.1109/LGRS.2015.2491329 Krizhevsky, 2012, Imagenet classification with deep convolutional neural networks, Adv. Neural Inf. Process. Syst. 25, 1097 A. Krizhevsky, G.E. Hinton, Convolutional deep belief networks on cifar-10, Unpublished manuscript, vol. 40, 2010. N.D. Lane, P. Georgiev, Can deep learning revolutionize mobile sensing? in: Proceedings of the 16th International Workshop on Mobile Computing Systems and Applications, 2015, pp. 117–122. H. Larochelle, Y. Bengio, Classification using discriminative restricted Boltzmann machines, in: Proceedings of the 25th international conference on Machine learning, 2008, pp. 536–543. LeCun, 1995, Convolutional networks for images, speech, and time series, Handb. brain Theory Neural Netw., 3361 LeCun, 2015, Deep learning, Nature, 521, 436, 10.1038/nature14539 LeCun, 1998, Gradient-based learning applied to document recognition, Proc. IEEE, 86, 2278, 10.1109/5.726791 Y. LeCun, F.J. Huang, L. Bottou, Learning methods for generic object recognition with invariance to pose and lighting, in: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2004, vol. 2, pp. 97–104. H. Lee, R. Grosse, R. Ranganath, A.Y. Ng, Convolutional deep belief networks for scalable unsupervised learning of hierarchical representations, in: Proceedings of the 26th Annual International Conference on Machine Learning, 2009, pp. 609–616. Lee, 2009, Unsupervised feature learning for audio classification using convolutional deep belief networks, Adv. Neural Inf. Process. Syst., 22, 1096 Lerouge, 2015, IODA: an input/output deep architecture for image labeling, Pattern Recognit., 48, 2847, 10.1016/j.patcog.2015.03.017 Li, 2016, Temperature based restricted Boltzmann machines, Sci. Rep., 6 S. Li, Z.Q. Liu, A. Chan, Heterogeneous multi-task learning for human pose estimation with deep convolutional neural network, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2014, pp. 482–489. Li, 2015, A comparative study on selecting acoustic modeling units in deep neural networks based large vocabulary chinese speech recognition, Neurocomputing, 170, 251, 10.1016/j.neucom.2014.07.087 Liao, 2015, An image retrieval method for binary images based on DBN and Softmax classifier, IETE Tech. Rev., 32, 294, 10.1080/02564602.2015.1015631 Ling, 2015, Deep learning for acoustic modeling in parametric speech generation: a systematic review of existing techniques and future trends, IEEE Signal Process. Mag., 32, 35, 10.1109/MSP.2014.2359987 Liu, 2015, Event-based H∞ consensus control of multi-agent systems with relative output feedback: the finite-horizon case, IEEE Trans. Autom. Control, 60, 2553, 10.1109/TAC.2015.2394872 Liu, 2015, Event-based recursive distributed filtering over wireless sensor networks, IEEE Trans. Autom. Control, 60, 2470, 10.1109/TAC.2015.2390554 Q. Liu, Z. Wang, X. He, G. Ghinea, F.E. Alsaadi, A resilient approach to distributed filter design for time-varying systems under stochastic nonlinearities and sensor degradation, IEEE Transactions on Signal Processing, accepted for publication. Luus, 2015, Multiview deep learning for land-use classification, IEEE Geosci. Remote Sens. Lett., 12, 2448, 10.1109/LGRS.2015.2483680 Ma, 2016, Event-triggered mean-square consensus control for time-varying stochastic multi-agent system with sensor saturations, IEEE Trans. Autom. Control Ma, 2016, Distributed event-based set-membership filtering for a class of nonlinear systems with sensor saturations over sensor networks, IEEE Trans. Cybern. Ma, 2016, Robust filtering for a class of nonlinear stochastic systems with probability constraints, Autom. Remote Control, 77, 37, 10.1134/S0005117916010033 Ma, 2016, Mean-square H∞ consensus control for a class of nonlinear time-varying stochastic multiagent systems: the finite-horizon case, IEEE Trans. Syst., Man Cybern.: Syst. Makhzani, 2013, K.-sparse autoencoders Manor, 2015, Convolutional neural network for multi-category rapid serial visual presentation BCI, Front. Comput. Neurosci., 9, 10.3389/fncom.2015.00146 Masci, 2011, Stacked convolutional auto-encoders for hierarchical feature extraction, Artif. Neural Netw. Mach. Learn.-ICANN 2011, 52, 10.1007/978-3-642-21735-7_7 Mathieu, 2013, Fast Train. convolutional Netw. FFTs Miao, 2015, Speaker adaptive training of deep neural network acoustic models using I-vectors, IEEE/ACM Trans. Audio, Speech, Lang. Process., 23, 1938, 10.1109/TASLP.2015.2457612 V. Mnih, H. Larochelle, G.E. Hinton, Conditional restricted Boltzmann machines for structured output prediction, arXiv:1202.3748 2012. Mohamed, 2012, Acoustic modeling using deep belief networks, IEEE Trans. Audio, Speech, Lang. Process., 20, 14, 10.1109/TASL.2011.2109382 Mohamed, 2009, Deep belief networks for phone recognition, Nips Workshop Deep Learn. Speech Recognit. Relat. Appl., 1, 39 Mohamed, 2010, Investigation of full-sequence training of deep belief networks for speech recognition, INTERSPEECH, 2846, 10.21437/Interspeech.2010-304 A. Mohamed, T.N. Sainath, G. Dahl, B. Ramabhadran, G.E. Hinton, M.A. Picheny, Deep belief networks using discriminative features for phone recognition, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011, pp. 5060–5063. Morgan, 2012, Deep and wide: multiple layers in automatic speech recognition, IEEE Trans. Audio, Speech, Lang. Process., 20, 7, 10.1109/TASL.2011.2116010 Nair, 2009, 3D object recognition with deep belief nets, Adv. Neural Inf. Process. Syst., 1339 Najafabadi, 2015, Deep learning applications and challenges in big data analytics, J. Big Data, 2, 1, 10.1186/s40537-014-0007-7 J. Ngiam, A. Khosla, M. Kim, J. Nam, H. Lee, A.Y. Ng, Multimodal deep learning, in: Proceedings of the 28th international conference on machine learning (ICML-11), 2011, pp. 689–696. A. Nguyen, J. Yosinski, J. Clune, Deep neural networks are easily fooled: High confidence predictions for unrecognizable images, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 427–436. Noda, 2015, Audio-visual speech recognition using deep learning, Appl. Intell., 42, 722, 10.1007/s10489-014-0629-7 Padmanabhan, 2015, Machine learning in automatic speech recognition: a survey, IETE Tech. Rev., 32, 240, 10.1080/02564602.2015.1010611 Y. Pan, W. Huang, Z. Lin, W. Zhu, J. Zhou, J. Wong, Z. Ding, Brain tumor grading based on neural networks and convolutional neural networks, in: Proceedings of the 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2015, pp. 699–702. Poultney, 2006, Efficient learning of sparse representations with an energy-based model, Adv. Neural Inf. Process. Syst., 1137 Quang, 2014, DANN: a deep learning approach for annotating the pathogenicity of genetic variants, Bioinformatics, 31, 761, 10.1093/bioinformatics/btu703 Rabiner, 1989, A tutorial on hidden markov models and selected applications in speech recognition, Proc. IEEE, 77, 257, 10.1109/5.18626 Ren, 2016, Local visual feature fusion via maximum margin multimodal deep neural network, Neurocomputing, 175, 427, 10.1016/j.neucom.2015.10.076 Richardson, 2015, Deep neural network approaches to speaker and language recognition, IEEE Signal Process. Lett., 22, 1671, 10.1109/LSP.2015.2420092 S. Rifai, P. Vincent, X. Muller, X. Glorot, Y. Bengio, Contractive auto-encoders: Explicit invariance during feature extraction, in: Proceedings of the 28th International Conference on Machine Learning (ICML-11), 2011, pp. 833–840. Sainath, 2015, Deep convolutional neural networks for large-scale speech tasks, Neural Netw., 64, 39, 10.1016/j.neunet.2014.08.005 T.N. Sainath, B. Kingsbury, A.r. Mohamed, B. Ramabhadran, Learning filter banks within a deep neural network framework, in: Proceedings of IEEE Workshop on Automatic Speech Recognition and Understanding (ASRU), 2013, pp. 297–302. R. Salakhutdinov, G.E. Hinton, Using deep belief nets to learn covariance kernels for gaussian processes, in: Proceedings of the Conference on Neural Information Processing Systems, 2007, pp. 1249–1256. Schmidhuber, 2015, Deep learning in neural networks: an overview, Neural Netw., 61, 85, 10.1016/j.neunet.2014.09.003 P. Sermanet, S. Chintala, Y. LeCun, Convolutional neural networks applied to house numbers digit classification, in: Proceedings of the 21st International Conference on Pattern Recognition (ICPR), 2012, pp. 3288–3291. T. Shinozaki, S. Watanabe, Structure discovery of deep neural network based on evolutionary algorithms, in: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015, pp. 4979–4983. Silver, 2016, Mastering the game of go with deep neural networks and tree search, Nature, 529, 484, 10.1038/nature16961 Singh, 2014, Subjective and objective analysis of speech enhancement algorithms for single channel speech patterns of indian and english languages, IETE Tech. Rev., 31, 10.1080/02564602.2014.890840 Song, 2016, Recursive approach to networked fault estimation with packet dropouts and randomly occurring uncertainties, Neurocomputing, 214, 340, 10.1016/j.neucom.2016.06.016 Song, 2016, Resilisent finite-time stabilization of fuzzy stochastic systems with randomly occurring uncertainities and randomly occurring gain fluctuations, Neurocomputing, 171, 444, 10.1016/j.neucom.2015.06.054 Sonka, 2014, Image processing, analysis, and machine vision, Cengage Learn. N. Srivastava, R. Salakhutdinov, Learning representations for multimodal data with deep belief nets, in: Proceedings of International Conference on Machine Learning Workshop, 2012. Sun, 2016, Unseen noise estimation using separable deep auto encoder for speech enhancement, IEEE/ACM Trans. Audio, Speech, Lang. Process., 24, 93, 10.1109/TASLP.2015.2498101 I. Sutskever, T. Tieleman, On the convergence properties of contrastive divergence, in: Proceedings of International Conference on Artificial Intelligence and Statistics, vol. 9, (2010) pp. 789–795. Szegedy, 2013, Deep neural networks for object detection, Adv. Neural Inf. Process. Syst., 2553 Tang, 2015, A real-time hand posture recognition system using deep neural networks, ACM Trans. Intell. Syst. Technol. (TIST), 6, 21 Tang, 2015, Compressed-domain ship detection on spaceborne optical image using deep neural network and extreme learning machine, IEEE Trans. Geosci. Remote Sens., 53, 1174, 10.1109/TGRS.2014.2335751 Y. Tang, R. Salakhutdinov, G.E. Hinton, Deep lambertian networks, arXiv:1206.6445, 2012. Y. Tang, R. Salakhutdinov, G.E. Hinton, Robust boltzmann machines for recognition and denoising, in: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012, pp. 2264–2271. Taylor, 2011, Two distributed-state models for generating high-dimensional time series, J. Mach. Learn. Res., 12, 1025 Vincent, 2011, A connection between score matching and denoising autoencoders, Neural Comput., 23, 1661, 10.1162/NECO_a_00142 P. Vincent, H. Larochelle, Y. Bengio, P.A. Manzagol, Extracting and composing robust features with denoising autoencoders, in: Proceedings of the 25th International Conference on Machine Learning, 2008, pp. 1096–1103. Vincent, 2010, Stacked denoising autoencoders: learning useful representations in a deep network with a local denoising criterion, J. Mach. Learn. Res., 11, 3371 Wang, 2015, DeepCNF-D: predicting protein order/disorder regions by weighted deep convolutional neural fields, Int. J. Mol. Sci., 16, 17315, 10.3390/ijms160817315 Wen, 2015, Pose estimation-dependent identification method for field moth images using deep learning architecture, Biosyst. Eng., 136, 117, 10.1016/j.biosystemseng.2015.06.002 Wu, 2016, Regional deep learning model for visual tracking, Neurocomputing, 175, 310, 10.1016/j.neucom.2015.10.064 Wu, 2015, Acoustic to articulatory mapping with deep neural network, Multimed. Tools Appl., 74, 9889, 10.1007/s11042-014-2183-z Xue, 2014, Fast adaptation of deep neural network based on discriminant codes for speech recognition, IEEE/ACM Trans. Audio, Speech, Lang. Process., 22, 1713, 10.1109/TASLP.2014.2346313 Yang, 2016, A new approach to non-fragile state estimation for continuous neural networks with time-delays, Neurocomputing, 197, 205, 10.1016/j.neucom.2016.02.062 Yang, 2016, Almost sure H∞ sliding mode control for nonlinear stochastic systems with Markovian switching and time-delays, Neurocomputing, 175, 392, 10.1016/j.neucom.2015.10.071 Yoshioka, 2015, Environmentally robust asr front-end for deep neural network acoustic models, Comput. Speech Lang., 31, 65, 10.1016/j.csl.2014.11.008 Yu, 2011, Deep learning and its applications to signal and information processing [exploratory dsp], IEEE Signal Process. Mag., 28, 145, 10.1109/MSP.2010.939038 Yu, 2016, Design of non-fragile state estimators for discrete time-delayed neural networks with parameter uncertainties, Neurocomputing, 182, 18, 10.1016/j.neucom.2015.11.079 Yuan, 2014, Delay-dependent stability criteria for time-varying delay neural networks in the delta domain, Neurocomputing, 125, 17, 10.1016/j.neucom.2012.09.040 Yuan, 2015, Finite frequency property-based robust control for singularly perturbed system, IET Control Theory Appl., 9, 203, 10.1049/iet-cta.2013.0854 Yuan, 2015, Resilient control in the presence of DoS Attack: switched system approach, Int. J. Control, Autom., Syst., 13, 1425, 10.1007/s12555-014-0261-7 Y. Yuan, H. Yuan, L. Guo, H. Yang, S. Sun, Robust control of networked control system under DoS attacks: a unified game approach, IEEE transactions on Industrial Informatics, doi:10.1109/TII.2016.2542208. M.D. Zeiler, R. Fergus, Stochastic pooling for regularization of deep convolutional neural networks, arXiv:1301.3557, 2013. Zeng, 2016, A novel switching delayed PSO algorithm for estimating unknown parameters of lateral flow immunoassay, Cogn. Comput., 8, 143, 10.1007/s12559-016-9396-6 Zeng, 2016, Deep belief networks for quantitative analysis of a gold immunochromatographic strip, Cogn. Comput., 8, 684, 10.1007/s12559-016-9404-x Zeng, 2016, Inferring nonlinear lateral flow immunoassay state-space models via an unscented Kalman filter, Sci. China Inf. Sci., 59, 112204, 10.1007/s11432-016-0280-9 Zhang, 2016, Passivity analysis for discrete-time neural networks with mixed time-delays and randomly occurring quantization effects, Neurocomputing, 216, 657, 10.1016/j.neucom.2016.08.020 Zhou, 2015, Combining heterogeneous deep neural networks with conditional random fields for chinese dialogue act recognition, Neurocomputing, 168, 408, 10.1016/j.neucom.2015.05.086 Zhu, 2015, Deep neural network based image annotation, Pattern Recognit. Lett., 65, 103, 10.1016/j.patrec.2015.07.037