Guidelines for including grey literature and conducting multivocal literature reviews in software engineering
Tóm tắt
Từ khóa
Tài liệu tham khảo
Kitchenham, 2004, Evidence-based software engineering, 273
Kitchenham, 2009, Systematic literature reviews in software engineering–a systematic literature review, Inf. Softw. Technol., 51, 7, 10.1016/j.infsof.2008.09.009
Petersen, 2015, Guidelines for conducting systematic mapping studies in software engineering: an update, Inf. Softw. Technol., 64, 1, 10.1016/j.infsof.2015.03.007
Daigneault, 2014, Using systematic review methods within a Ph.D. dissertation in political science: challenges and lessons learned from practice, Int. J. Soc. Res. Methodol., 17, 267, 10.1080/13645579.2012.730704
Garousi, 2015, Software test-code engineering: a systematic mapping, J. Inf. Softw. Technol., 58, 123, 10.1016/j.infsof.2014.06.009
Olsson, 2014, Including systematic reviews in PhD programmes and candidatures in nursing – ‘Hobson's choice’?, Nurse Educ. Pract., 14, 102, 10.1016/j.nepr.2014.01.005
Gopalakrishnan, 2013, Systematic reviews and Meta-analysis: understanding the best evidence in primary healthcare, J. Family Med. Prim. Care, 2, 9, 10.4103/2249-4863.109934
Schlosser, 2006, The role of systematic reviews in evidence-based practice, research, and development, FOCUS, 15
Garousi, 2018, What we know about testing embedded software, IEEE Softw.
Glass, 2006
Wohlin, 2012, 259
Ogawa, 1991, Towards rigor in reviews of multivocal literatures: applying the exploratory case study method, Rev. Educ. Res., 61, 265, 10.3102/00346543061003265
Patton, 1991, Towards utility in reviews of multivocal literatures, Rev. Educ. Res., 61, 287, 10.3102/00346543061003287
Alberani, 1990, The use of grey literature in health sciences: a preliminary survey, Bull. Med. Libr. Assoc., 78, 358
Saleh, 2014, Grey literature searching for Health Sciences Systematic Reviews: a prospective study of time spent and resources utilized, Evid. Based Libr. Inf. Pract., 9, 28, 10.18438/B8DW3K
Hopewell, 2007, Grey literature in meta-analyses of randomized trials of health care interventions, Cochrane Database Syst. Rev.
Adams, 2016, Shades of grey: guidelines for working with the grey literature in systematic reviews for management and organizational studies, Int. J. Manag. Rev.
J.P. Higgins and S. Green, "Including unpublished studies in systematic reviews " in Cochrane Handbook for Systematic Reviews of Interventions, http://handbook.cochrane.org/chapter_10/10_3_2_including_unpublished_studies_in_systematic_reviews.htm, Last accessed: Dec. 2017.
McAuley, 2000, Does the inclusion of grey literature influence estimates of intervention effectiveness reported in meta-analyses?, The Lancet, 356, 1228, 10.1016/S0140-6736(00)02786-0
Petersen, 2008, Systematic mapping studies in software engineering
B. Kitchenham and S. Charters, "Guidelines for Performing Systematic Literature Reviews in Software engineering," in "EBSE Technical Report," 2007, vol. EBSE-2007-01.
Schöpfel, 2010, Grey literature, 2029
Lefebvre, 2008, Searching for studies
Giustini, 2017, Finding the hard to finds: searching for grey (Gray) literature, UBC
Mathers, 2008, Global epidemiology of injecting drug use and HIV among people who inject drugs: a systematic review, The Lancet, 372, 1733, 10.1016/S0140-6736(08)61311-2
Kitchenham, 2015
Santos, 2015, Investigating bias in the search phase of Software Engineering secondary studies, 488
Garousi, 2016, A systematic literature review of literature reviews in software testing, Inf. Softw. Technol., 80, 195, 10.1016/j.infsof.2016.09.002
Garousi, 2016, Citations, research topics and active countries in software engineering: a bibliometrics study, Elsevier Comput. Sci. Rev., 19, 56, 10.1016/j.cosrev.2015.12.002
Garousi, 2015, A bibliometric analysis of the Turkish software engineering research community, Springer J. Scientometr., 105, 23
Garousi, 2017, Quantity versus impact of software engineering papers: a quantitative study, Scientometrics, 112, 963, 10.1007/s11192-017-2419-6
Garousi, 2017, What we know about testing embedded software, IEEE Sof.,
Garousi, 2013, A systematic mapping study of web application testing, Elsevier J. Inf. Softw. Technol., 55, 1374, 10.1016/j.infsof.2013.02.006
Banerjee, 2013, Graphical User Interface (GUI) Testing: systematic Mapping and Repository, Inf. Softw. Technol., 55, 1679, 10.1016/j.infsof.2013.03.004
Garousi, 2013, UML-Driven Software Performance Engineering: a Systematic Mapping and Trend Analysis
Escoffery, 2014, A grey literature review of special events for promoting cancer screenings, BMC Cancer, 14, 454, 10.1186/1471-2407-14-454
Favin, 2012, Why children are not vaccinated: a review of the grey literature, Int. Health, 4, 229, 10.1016/j.inhe.2012.07.004
Kennell, 2009, A grey literature review of the cultural Olympiad, Cultural Trends, 18, 83, 10.1080/09548960802651294
Tomka, 2013, Reconceptualizing cultural participation in Europe: grey literature review, Cultural Trends, 22, 259, 10.1080/09548963.2013.819657
Garousi, 2016, The need for multivocal literature reviews in software engineering: complementing systematic literature reviews with grey literature, 171
Raulamo, 2017, Choosing the right test automation tool: a grey literature review, 21
Garousi, 2017, Software test maturity assessment and test process improvement: a multivocal literature review, Inf. Softw. Technol., 85, 16, 10.1016/j.infsof.2017.01.001
Garousi, 2016, When and what to automate in software testing? A multivocal literature review, Inf. Softw. Technol., 76, 92, 10.1016/j.infsof.2016.04.015
Elmore, 1991, Comment on "Towards rigor in reviews of multivocal Literatures: applying the exploratory case study method", Rev. Educ. Res., 61, 293, 10.3102/00346543061003293
Garousi, 2018, Introducing automated GUI testing and observing its benefits: an industrial case study in the context of law-practice management software, 138
Sahaf, 2014, When to automate software testing? decision support based on system dynamics – an industrial case study, 149
Amannejad, 2014, A search-based approach for cost-effective software test automation decision support and an industrial case study, 302
Garousi, 2016, When to automate software testing? a decision-support approach based on process simulation, Wiley J. Softw., 28, 272
Yasin, 2012
Rainer, 2017, Using argumentation theory to analyses software practitioners’ defeasible evidence, inference and belief, Inf. Softw. Technol., 87, 62, 10.1016/j.infsof.2017.01.011
Walton, 2008
Kulesovs, 2015, iOS applications testing, 138
Mäntylä, 2016, Gamification of software testing - An MLR, 611
Lwakatare, 2016, Relationship of DevOps to agile, lean and continuous deployment: a multivocal literature review study, 399
Franca, 2016, Characterizing DevOps by hearing multiple voices, 53
Sauerwein, 2017, Threat intelligence sharing platforms: an exploratory study of software vendors and research perspectives
Calderón, 2018, A multivocal literature review on serious games for software process standards education, Comput. Stand. Inter., 57, 36, 10.1016/j.csi.2017.11.003
Garousi, 2018, Smells in software test code: a survey of knowledge in industry and academia, J. Syst. Softw., 138, 52, 10.1016/j.jss.2017.12.013
Bajwa, 2016, How do software startups pivot? Empirical results from a multiple case study, 169
Sulayman, 2009, A systematic literature review of software process improvement in small and medium web companies, 59, 1
Garousi, 2018, What we know about software test maturity and test process improvement, IEEE Softw., 35, 84, 10.1109/MS.2017.4541043
Kuhrmann, 2017, On the pragmatic design of literature studies in software engineering: an experience-based guideline, Empir. Softw. Eng., 22, 2852, 10.1007/s10664-016-9492-y
Doğan, 2014, Web application testing: a systematic literature reviewr, J. Syst. Softw., 91, 174, 10.1016/j.jss.2014.01.010
Yusifoğlu, 2014, Software test-code engineering: a systematic mapping, Journal of Information and Software Technology
Farhoodi, 2013, Development of scientific software: a systematic mapping, bibliometrics Study and a paper repository, Int'l J. Softw. Eng. Knowl. Eng., 23, 463, 10.1142/S0218194013500137
Garousi, 2011, Classification and trend analysis of UML books (1997-2009), J. Softw. Syst. Modeling (SoSyM)
Zhi, 2014, Cost, benefits and quality of software development documentation: a systematic mapping, J. Syst. Softw.
Ogawa, 1991, A response to commentaries on "Towards rigor in reviews of multivocal literatures... ", Rev. Educ. Res., 61, 307
Tyndall, 2017, AACODS checklist, Arch. Flinders Acad. Commons
Yin, 1991, Advancing rigorous methodologies: a review of "Towards rigor in reviews of multivocal literatures... ", Rev. Educ. Res., 61, 299, 10.3102/00346543061003299
Godin, 2015, Applying systematic review search methods to the grey literature: a case study examining guidelines for school-based breakfast programs in Canada, Syst. Rev., 4, 138, 10.1186/s13643-015-0125-0
Bellefontaine, 2014, Between black and white: examining grey literature in Meta-analyses of psychological research, J. Child Family Stud., 23, 1378, 10.1007/s10826-013-9795-1
Banks, 2010, Blog posts and tweets: the next frontier for grey literature
Hopewell, 2006, Grey literature and systematic reviews
Libraries
McGrath, 2006, Review of grey literature on drug prevention among young people, Natl. Inst. Health Clin. Excell.
Adams, 2016, Searching and synthesising ‘grey literature’ and ‘grey information’ in public health: critical reflections on three case studies, Syst. Rev., 5, 164, 10.1186/s13643-016-0337-y
Mahood, 2014, Searching for grey literature for systematic reviews: challenges and benefits, Res. Synth. Methods, 5, 221, 10.1002/jrsm.1106
Benzies, 2006, State-of-the-Evidence reviews: advantages and challenges of including grey literature, Worldviews Evid. Based Nurs., 3, 55, 10.1111/j.1741-6787.2006.00051.x
Lawrence, 2014, Where is the evidence: realising the value of grey literature for public policy and practice, Swinburne Inst. Soc. Res.
Garousi
Gargani, 2011, What works for whom, where, why, for what, and when? Using evaluation evidence to take action in local contexts, New Dir. Eval., 2011, 17, 10.1002/ev.362
Petersen, 2009, Context in industrial software engineering research
Briand, 2017, The case for context-driven software engineering research: generalizability is overrated, IEEE Softw., 34, 72, 10.1109/MS.2017.3571562
Petersen, 2009, Context in industrial software engineering research, 401
Dybå, 2012, What works for whom, where, when, and why? On the role of context in empirical software engineering, 19
V.R. Basili, "Software modeling and measurement: the Goal/Question/Metric paradigm," Technical Report, University of Maryland at College Park 1992.
Easterbrook, 2008, Selecting empirical methods for software engineering research, 285
Wohlin, 2014, Guidelines for snowballing in systematic literature studies and a replication in software engineering
Board
Bourque, 2014, Guide to the software engineering body of knowledge (SWEBOK), version 3.0, IEEE Comput. Soc. Press
A.N. Langville and C.D. Meyer, Google's PageRank and Beyond: The Science of Search Engine Rankings. Princeton University Press.
Host, 2007, Checklists for software engineering case study research, 479
da Silva, 2011, Six years of systematic literature reviews in software engineering: an updated tertiary study, Inf. Softw. Technol., 53, 899, 10.1016/j.infsof.2011.04.004
Garousi, 2017, Experience-based guidelines for effective and efficient data extraction in systematic reviews in software engineering, 170
Cruzes, 2010, Synthesizing evidence in software engineering research
Raulamo-Jurvanen, 2016, Using surveys and web-scraping to select tools for software testing consultancy, 285
Miles, 2014
Toffel, 2016, Enhancing the practical relevance of research, Prod. Oper. Manag., 25, 1493, 10.1111/poms.12558
Garousi, 2016, Developing, verifying and maintaining high-quality automated test scripts, IEEE Softw., 33, 68, 10.1109/MS.2016.30
Dingsøyr, 2009, What do we know about knowledge management? Practical implications for software engineering, IEEE Softw., 26, 100, 10.1109/MS.2009.82
Giardino, 2014, What do we know about software development in startups?, IEEE Softw., 31, 28, 10.1109/MS.2014.129
Shull, 2010, What do we know about test-driven development?, IEEE Softw., 27, 16, 10.1109/MS.2010.152
Dyba, 2009, What do we know about agile software development?, IEEE Softw., 26, 6, 10.1109/MS.2009.145
Garousi, 2017, Worlds apart: industrial and academic focus areas in software testing, IEEE Softw., 34, 38, 10.1109/MS.2017.3641116
Harman, 2010, Search based software engineering: introduction to the special issue of the IEEE transactions on software engineering, IEEE Trans. Softw. Eng., 36, 737, 10.1109/TSE.2010.106
Harman, 2012, Search-based software engineering: trends, techniques and applications, ACM Comput. Surv., 45, 1, 10.1145/2379776.2379787
Harman