Monitoring seasonal influenza epidemics by using internet search data with an ensemble penalized regression model

Scientific Reports - Tập 7 Số 1
Pi Guo1, Jianjun Zhang1, Li Wang1, Shaoyi Yang1, Ganfeng Luo1, Changyu Deng1, Ye Wen1, Qingying Zhang1
1Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, 515041, Guangdong, People's Republic of China

Tóm tắt

AbstractSeasonal influenza epidemics cause serious public health problems in China. Search queries-based surveillance was recently proposed to complement traditional monitoring approaches of influenza epidemics. However, developing robust techniques of search query selection and enhancing predictability for influenza epidemics remains a challenge. This study aimed to develop a novel ensemble framework to improve penalized regression models for detecting influenza epidemics by using Baidu search engine query data from China. The ensemble framework applied a combination of bootstrap aggregating (bagging) and rank aggregation method to optimize penalized regression models. Different algorithms including lasso, ridge, elastic net and the algorithms in the proposed ensemble framework were compared by using Baidu search engine queries. Most of the selected search terms captured the peaks and troughs of the time series curves of influenza cases. The predictability of the conventional penalized regression models were improved by the proposed ensemble framework. The elastic net regression model outperformed the compared models, with the minimum prediction errors. We established a Baidu search engine queries-based surveillance model for monitoring influenza epidemics, and the proposed model provides a useful tool to support the public health response to influenza and other infectious diseases.

Từ khóa


Tài liệu tham khảo

World Health Organization. Influenza (Seasonal) http://www.who.int/mediacentre/factsheets/fs211/en/ (Date of access: 26/01/2017) (2014).

He, Q. et al. Effectiveness of seasonal influenza vaccine against clinically diagnosed influenza over 2 consecutive seasons in children in Guangzhou, China: a matched case-control study. Human Vaccines & Immunotherapeutics 9, 1720–1724 (2013).

H, Y. et al. Regional variation in mortality impact of the 2009 A(H1N1) influenza pandemic in China. Influenza & Other Respiratory Viruses 7, 1350–1360 (2013).

Freifeld, C., Mandl, K., Reis, B. & Brownstein, J. HealthMap: global infectious disease monitoring through automated classification and visualization of Internet media reports. Journal of the American Medical Informatics Association 15, 150–157 (2008).

Chew, C. & Eysenbach, G. Pandemics in the age of Twitter: content analysis of Tweets during the 2009 H1N1 outbreak. Plos One 5, e14118 (2010).

Brownstein, J. S., Freifeld, C. C. & Madoff, L. C. Digital disease detection–harnessing the Web for public health surveillance. New England Journal of Medicine 360, 1656–1658 (2009).

Eysenbach, G. Infodemiology: tracking flu-related searches on the web for syndromic surveillance. AMIA Annual Symposium Proceedings. 244, 244–248 (2006).

Ginsberg, J. et al. Detecting influenza epidemics using search engine query data. Nature 457, 1012–1014 (2009).

Ou, C., Deng, Z. & Yang, L. Prediction of Influenza-like Illness Using Auto-regression Model. Chinese Journal of Health Statistics 24, 569–571 (2007).

Zhao, Y. U., Fang, Q. S., Zhou, M., Lian-Hong, L. I. & Wang, W. Surveillance of influenza in Zhejiang, 2008–2012. Disease Surveillance 27, 1003–9961 (2012).

Yuan, Q. et al. Monitoring Influenza Epidemics in China with Search Query from Baidu. Plos One 8, e64323–e64323 (2013).

Tibshirani, R. Regression shrinkage and selection via the lasso: a retrospective. Journal of the Royal Statistical Society 73, 273–282 (2011).

Guo, P. et al. Improved Variable Selection Algorithm Using a LASSO-Type Penalty, with an Application to Assessing Hepatitis B Infection Relevant Factors in Community Residents. Plos One 10, e0134151 (2015).

Efron, B. & Gong, G. A Leisurely Look at the Bootstrap, the Jackknife, and Cross-Validation. American Statistician 37, 36–48 (2012).

Guo, P. et al. Gene expression profile based classification models of psoriasis. Genomics 103, 48–55 (2014).

Cohen, J. A coefficient of agreement of nominal scales. Educational and Psychological Measurement 20, 37–46 (1960).

Datta, S., Pihur, V. & Datta, S. An adaptive optimal ensemble classifier via bagging and rank aggregation with applications to high dimensional data. BMC Bioinformatics 11, 427 (2010).

Althouse, B. M., Ng, Y. Y. & Cummings, D. A. T. Prediction of Dengue Incidence Using Search Query Surveillance. Plos Neglected Tropical Diseases 5, e1258–e1258 (2011).

Zou, H. The Adaptive Lasso and Its Oracle Properties. Journal of the American Statistical Association 101, 1418–1429 (2012).

Guo, P. et al. Blood lead levels and associated factors among children in Guiyu of China: a population-based study. Plos One 9, e105470–e105470 (2014).

Pihur, V., Datta, S. & Datta, S. Weighted rank aggregation of cluster validation measures: a Monte Carlo cross-entropy approach. Bioinformatics 23, 1607–1615 (2007).

Breiman, L. Bagging predictors. Machine Learning 24, 123–140 (1996).

Fagin, R., Kumar, R. & Sivakumar, D. Comparing top k lists. SIAM Journal on Discrete Mathematics 17, 28–36 (2003).

Pihur, V., Datta, S. & Datta, S. RankAggreg, an R package for weighted rank aggregation. BMC Bioinformatics 10, 62 (2009).

Hoens, T. R. & Chawla, N. V. Generating Diverse Ensembles to Counter the Problem of Class Imbalance. Advances in Knowledge Discovery and Data Mining 6119, 488–499 (2010).

Panov, P. & Džeroski, S. Combining Bagging and Random Subspaces to Create Better Ensembles. Advances in Intelligent Data Analysis VII 4723, 118–129 (2007).

Breiman, L. Random Forests. Machine Learning 45, 5–32 (2001).

Makridakis, S. Accuracy measures: theoretical and practical concerns. International Journal of Forecasting 9, 527–529 (1993).

Kang, M., Zhong, H., He, J., Rutherford, S. & Yang, F. Using Google Trends for influenza surveillance in South China. Plos One 8, e55205–e55205 (2012).

Gu, Y. et al. Early detection of an epidemic erythromelalgia outbreak using Baidu search data. Scientific Reports 5, 12649 (2015).

Salathé, M., Freifeld, C. C., Mekaru, S. R., Tomasulo, A. F. & Brownstein, J. S. Influenza A (H7N9) and the importance of digital epidemiology. New England Journal of Medicine 369, 401–404 (2013).

China Internet Network Information Center. The Chinese search engine market research report in 2013 http://www.cnnic.net.cn/hlwfzyj/hlwxzbg/ (Date of access: 26/01/2017) (2013).

npm Enterprise. selenium-webdriver https://www.npmjs.com/package/selenium-webdriver (Date of access: 26/01/2017) (2016).

Roberts, S. & Nowak, G. Stabilizing the lasso against cross-validation variability. Computational Statistics & Data Analysis 70, 198–211 (2014).

Lam, T. T. et al. Dissemination, divergence and establishment of H7N9 influenza viruses in China. Nature 522, 102–105 (2015).

Olson, D. R., Konty, K. J., Paladini, M., Viboud, C. & Simonsen, L. Reassessing Google Flu Trends data for detection of seasonal and pandemic influenza: a comparative epidemiological study at three geographic scales. PLOS Computational Biology 9, e1003256 (2013).

Valdivia, A. et al. Rapid communications Monitoring influenza activity in Europe with Google Flu Trends: comparison with the findings of sentinel physician networks -results for 2009–10. Euro Surveill 15, 2–7 (2010).