Co-existing Notions of Research Quality: A Framework to Study Context-specific Understandings of Good Research

Adler, Nancy J., and Anne-Wil Harzing. 2009. When Knowledge Wins: Transcending the Sense and Nonsense of Academic Rankings. Academy of Management Learning and Education 8(1): 72–95.

Aksnes, Dag, Mats Benner, Siri Brorstad Borlaug, Hanne Foss Hansen, Egil Kallerud, Ernst Kristiansen, Liv Langfeldt, Antti Pelkonen, and Gunnar Sivertsen. 2012. Centres of Excellence in the Nordic Countries: A Comparative Study of Research Excellence Policy and Excellence Centre Schemes in Denmark, Finland, Norway and Sweden. Oslo: NIFU Working Paper 4/2012.

Bazeley, Pat. 2010. Conceptualising Research Performance. Studies in Higher Education 35(8): 889–903.

Becher, Tony. 1989. Academic Tribes and Territories: Intellectual Enquiry and the Cultures of Disciplines. Buckingham: Open University Press.

Ben-David, Joseph. 1971. The Scientist’s Role in Society. Englewood Cliffs, NJ: Prentice Hall.

Benner, Mats, and Gunnar Öquist. 2014. Room for Increased Ambitions? Oslo: Research Council of Norway.

Benner, Mats, and Sverker Sörlin. 2007. Shaping Strategic Research: Power, Resources, and Interests in Swedish Research Policy. Minerva 45(1): 31–48.

Borlaug, Siri Brorstad. 2015. Moral Hazard and Adverse Selection in Research Funding: Centres of Excellence in Norway and Sweden. Science and Public Policy 43: 352–362.

Cahan, David. 2003. Institutions and Communities. In From Natural Philosophy to the Sciences: Writing the History of Nineteenth-Century Science, ed. David Cahan, 291–328. Chicago: University of Chicago Press.

Caldwell, Bruce J. 2010. Beyond Positivism: Economic Methodology in the Twentieth Century. London: Routledge.

Chalmers, Alan F. 2013. What is This Thing Called Science, 4th ed. Indianapolis: Hackett Publishing Company.

Chou, Meng-Hsuan, and Åse Gornitzka (eds.). 2014. Building the Knowledge Economy in Europe: New Constellations in European Research and Higher Education Governance. Cheltenham: Edward Elgar.

Chubin, Daryl, and Edward J. Hackett. 1990. Peerless Science: Peer Review and U.S. Science Policy. New York: State University of New York Press.

Cole, Stephen. 1983. The Hierarchy of the Sciences? The American Journal of Sociology 89(1): 111–139.

Douglass, John A. (ed.). 2015. The New Flagship University: Changing the Paradigm from Global Ranking to National Relevancy. Basingstoke: Palgrave Macmillan.

Edler, Jakob, Daniela Frischer, Michaela Glanz, and Michael Stampfer. 2014. Funding Individuals—Changing Organisations: The Impact of the ERC on Universities. In Organizational Transformation and Scientific Change: The Impact of Institutional Restructuring on Universities and Intellectual Innovation, eds. Richard Whitley and Jochen Gläser, 77–109. Bingley: Emerald Group Publishing Limited.

Elken, Mari, and Trude Røsdal. 2017. Professional Higher Education Institutions as Organizational Actors. Tertiary Education and Management 4(23): 376–387.

Etzkowitz, Henry, Andrew Webster, and Peter Healey (eds.). 1998. Capitalizing Knowledge: New Intersection Between Industry and Academia. Albany: State University of New York Press.

Feuer, Michael J., Lisa Towne, and Richard J. Shavelson. 2002. Scientific Culture and Educational Research. Educational Researcher 31(8): 4–14.

Flink, Tim. 2016. Die Entstehung des Europäischen Forschungsrates: Marktimperative—Geostrategie—Frontier Research. Weilerswist-Metternich: Velbrück Wissenschaft.

Flink, Tim, and Tobias Peter. 2018. Excellence and Frontier Research as Travelling Concepts in Science Policymaking. Minerva 56(4): 431–452.

Fourcade, Marion. 2009. Economists and Societies. Princeton: Princeton University Press.

Frodeman, Robert, and Adam Briggle. 2012. The Dedisciplining of Peer Review. Minerva 50(1): 3–19.

Geuna, Aldo, and Ben R. Martin. 2003. University Research Evaluation and Funding: An International Comparison. Minerva 41(4): 277–304.

Gläser, Jochen. 2016. German Universities on Their Way to Performance-Based Management of Research Portfolios. Sociologia Italiana 8(October): 151–176.

Gornitzka, Åse, and Ingvild Marheim Larsen. 2004. Towards Professionalisation? Restructuring of Administrative Work Force in Universities. Higher Education 47: 455–471.

Gulbrandsen, J. Magnus. 2000. Research Quality and Organisational Factors: An Investigation of the Relationship. Trondheim: Department of Industrial Economics and Technology Management, Norwegian University of Science and Technology.

Gulbrandsen, Magnus, and Liv Langfeldt. 1997. Hva er forskningskvalitet? En intervjustudie blant norske forskere [What is research quality? An interview study among Norwegian Researchers]. Oslo: NIFU-rapport 9/97.

Heinze, Thomas. 2008. How to Sponsor Ground-Breaking Research: A Comparison of Funding Schemes. Science and Public Policy 35(5): 302–318.

Hellström, Tomas. 2011. Homing in on Excellence: Dimensions of appraisal in Center of Excellence Program Evaluations. Evaluation 17: 117–131.

Hemlin, Sven. 1991. Quality in Science. Researchers’ Conceptions and Judgements. Göteborg: Department of Psychology, University of Göteborg, Doctoral dissertation.

Höhle, Ester. 2015. From Apprentice to Agenda-Setter: Comparative Analysis of the Influence of Contract Conditions on Roles in the Scientific Community. Studies in Higher Education 40(8): 1423–1437.

Howells, Jeremy, Maria Nedeva, and Luke Georghiou. 1998. Industry-Academic Links in the UK. Bristol: HEFCE.

Hug, Sven E., Michael Ochsner, and Hans-Dieter Daniel. 2013. Criteria for Assessing Research Quality in the Humanities: A Delphi Study Among Scholars of English Literature, German Literature and Art History. Research Evaluation 22(5): 369–383.

Jacob, Merle, Tomas Hellström, Niclas Adler, and Flemming Norrgren. 2002. From Sponsorship to Partnership in Academy-Industry Relationships. R&D Management 30(3): 255–262.

Jasanoff, Sheila. 1990. The Fifth Branch. Cambridge: Harvard University Press.

Johnson, David R., and Joseph C. Hermanowicz. 2017. Peer Review: Sacred Ideals and Profane Realities. In Higher Education: Handbook of Theory and Research, ed. Michael B. Paulsen, 485. Dordrecht: Springer.

Keller, Evelyn Fox. 1990. Physics and the Emergence of Molecular Biology: A History of Cognitive and Political Synergy. Journal of the History of Biology 23(3): 389–409.

Kuhlmann, Stefan, and Arie Rip. 2014. The Challenge of addressing Grand Challenges. A think piece on how innovation can be driven towards the “Grand Challenges” as defined under the European Union Framework Programme Horizon 2020, Report to ERIAB; https://doi.org/10.13140/2.1.4757.184 .

Lamont, Michèle. 2009. How Professors Think: Inside the Curious World of Academic Judgment. Cambridge, MA: Harvard University Press.

Lamont, Michèle, Marcel Fournier, Joshua Guetzkow, Grégoire Mallard, and Roxane Bernier. 2007. Evaluating Creative Minds: The Assessment of Originality in Peer Review. In Knowledge, Communication and Creativity, eds. Arnaud Sales and Marcel Fournier, 166–181. London: SAGE Publications Ltd.

Langfeldt, Liv. 2001. The Decision-Making Constraints and Processes of Grant Peer Review, and Their Effects on the Review Outcome. Social Studies of Science 31(6): 820–841.

Langfeldt, Liv, and Lisa Scordato. 2016. Efficiency and Flexibility in Research Funding. A Comparative Study of Funding Instruments and Review Criteria. Oslo: NIFU Report 9/2016.

Larédo, Philippe, and Philippe Mustar (eds.). 2001. Research and Innovation Policies in the Economy. Cheltenham: Edward Elgar.

Laudel, Grit, and Jochen Gläser. 2014. Beyond Breakthrough Research: Epistemic Properties of Research and Their Consequence for Research Funding. Research Policy 43: 1204–1216.

Laudel, Grit, and Elke Weyer. 2014. Where have all the Scientists Gone? Building Research Profiles at Dutch Universities and its Consequences for Research. In Organizational Transformation and Scientific Change: The Impact of Institutional Restructuring on Universities and Intellectual Innovation, eds. Richard Whitley and Jochen Gläser, 111–140. Bingley: Emerald Group Publishing Limited.

Lee, Carole J. 2015. Commensuration Bias in Peer Review. Philosophy of Science 82(5): 1272–1283.

Lepori, Benedetto, Emanuela Reale, and Andrea Orazio Spinello. 2018. Conceptualising and Measuring Performance Orientation in Research Funding Systems. Research Evaluation 27(3): 171–183.

Luukkonen, Terttu. 2012. Conservatism and Risk-Taking in Peer Review: Emerging ERC Practices. Research Evaluation 21(1): 48–60.

Mårtensson, Pär, Uno Forsb, Sven-Bertil Wallinc, Udo Zanderd, and Gunnar H. Nilsson. 2016. Evaluating Research: A Multidisciplinary Approach to Assessing Research Practice and Quality. Research Policy 45(3): 593–603.

Merton, Robert K. 1942. The Normative Structure of Science, in Merton, R.K. (1973). In The Sociology of Science. Chicago: University of Chicago Press.

Merton, Robert K. 1957. Priorities in Scientific Discoveries, in Merton, R.K. (1973). In The Sociology of Science. Chicago: University of Chicago Press.

Merton, Robert K. 1960. “Recognition and Excellence”: Instructive Ambiguities, in Merton, R.K. (1973). In The Sociology of Science. Chicago: University of Chicago Press.

Mukerji, Chandra. 1989. A Fragile Power. Scientists and the State. Princeton: Princeton University Press.

Nedeva, Maria. 2010. Public Sciences and Change: Science Dynamics Revisited. In Society, Culture and Technology at the Dawn of the 21st Century, eds. Janusz Mucha and Katarzyna Leszczynska, 19–38. Cambridge: Cambridge Scholars Publishing.

Nedeva, Maria. 2013. Between the Global and the National: Organising European Science. Research Policy 42(1): 220–230.

Nedeva, Maria, and Rebecca Boden. 2006. Changing Science: The Advent of Neo-liberalism. Prometheus 24(3): 269–281.

Nedeva, Maria et al. 2012a. Understanding and Assessing the Impact and Outcomes of the ERC and its Funding Schemes. EURECIA Final Synthesis Report, http://erc.europa.eu/sites/default/files/document/file/eurecia_final_synthesis_report.pdf .

Nedeva, Maria, Rebecca Boden, and Yanuar Nugroho. 2012b. Rank and File: Managing Individual Performance in University Research. Higher Education Policy 25(3): 335–360.

Nightingale, Paul, and Alister Scott. 2007. Peer Review and the Relevance Gap: Ten Suggestions for Policy-Makers. Science and Public Policy 34(8): 543–553.

Niiniluoto, Ilka. 1987. Peer Review: Problems and Prospects. In Evaluation of Research. Nordic Experiences. Nordic Science Policy Council, FPR-publication No. 5 (NORD 1987:30).

OECD. 2014. Promoting Research Excellence: New Approaches to Funding. Paris: OECD Publishing. https://doi.org/10.1787/9789264207462-en .

Oreskes, Naomi, and John Krige (eds.). 2014. Science and Technology in the Global Cold War. Cambridge, MA: MIT Press.

Paradeise, Catherine, and Jean-Claude Thoenig. 2015. In Search of Academic Quality. Houndmills, Basingstoke: Palgrave Macmillan.

Piro, Fredrik Niclas, and Gunnar Sivertsen. 2016. How can Differences in University Rankings be Explained? Scientometrics 109(3): 2263–2278.

Polanyi, Michael. 1962/2000. The Republic of Science: Its Political and Economic Theory. Minerva 1:54–73 (Reprinted in Minerva 38:1–32).

Rafols, Ismael, Loet Leydesdorff, Alice O’Hare, Paul Nightingale, and Andy Stirling. 2012. How Journal Rankings Can Suppress Interdisciplinary Research: A Comparison Between Innovation Studies and Business and Management. Research Policy 41(7): 1262–1282.

Ravetz, Jerome R. 1971. Scientific Knowledge and Its Social Problems. Oxford: Clarendon Press.

Rennie, Drummond. 2016. Make Peer Review Scientific. Nature 535: 31–33.

Rip, Arie. 1994. The Republic of Science in the 1990s. Higher Education 28(1): 3–23.

Salö, Linus. 2015. The Linguistic Sense of Placement: Habitus and the Entextualization of Translingual Practices in Swedish Academia. Journal of Sociolinguistics 19(4): 511–534.

Salö, Linus. 2017. The Sociolinguistics of Academic Publishing: Language and the Practices of Homo Academicus. New York: Palgrave Macmillan.

Sarewitz, Daniel. 2016. Saving Science. New Atlantis 49: 4–40.

Sauder, Michael, and Wendy N. Espeland. 2009. The Discipline of Rankings: Tight Coupling and Organizational Change. American Sociological Review 74(1): 63–82.

Seglen, Per O. 1997. Why Impact Factors of Journals Should not be Used for Evaluating Research. BMJ: British Medical Journal 314(7079): 498–502.

Shapin, Steven. 2008. The Scientific Life. Chicago: University of Chicago Press.

Shils, Edward. 1961a. Metropolis and Province in the Intellectual Community. Reprinted in: Shils, The Intellectuals and the Powers and Other Essays. Chicago, IL & London: The University of Chicago Press, 1972.

Shils, Edward. 1961b. Center and Periphery. Reprinted in: Shils, Center and Periphery: Essays in Macrosociology. Chicago, IL & London: The University of Chicago Press, 1975.

Shils, Edward. 1988. Center and Periphery: An Idea and Its Career, 1935–1987. In Center: Ideas and Institutions, eds. Liah Greenfeld and Michael Martin, 250–282. Chicago and London: The University of Chicago Press.

Sörlin, Sverker (ed.). 2005. “I den absoluta frontlinjen”: En bok om forskningsstiftelserna, konkurrenskraften och politikens möjligheter [“On the Absolute Frontline”: A Book on Research Foundations, Competitiveness, and What Politics Can Do]. Stockholm: Nya Doxa.

Sörlin, Sverker. 2007. Funding Diversity: Performance-based Funding Regimes as Drivers of Differentiation in Higher Education Systems. Higher Education Policy 20(4): 313–440.

Sörlin, Sverker. 2018. Humanities of Transformation: From Crisis and Critique Towards the Emerging Integrative Humanities. Research Evaluation 27(4): 287–297.

Star, Susan Leigh, and James R. Griesemer. 1989. Institutional Ecology, Translations’ and Boundary Objects: Amateurs and Professionals in Berkeley’s Museum of Vertebrate Zoology, 1907–1939. Social Studies of Science 19(3): 387–420.

Tranøy, Knut Erik. 1976. Norms of Inquiry: Methodologies as Normative Systems. In Contemporary Aspects of Philosophy, ed. Gilbert Ryle, 1–13. London: Oriel Press.

Tranøy, Knut Erik. 1986. Vitenskapen—Samfunnsmakt og livsform [Science–social Power and Way of Life]. Oslo: Universitetsforlaget.

van Arensbergen, Pleun, Inge van der Weijden, and Peter van den Besselaar. 2014. The Selection of Talent as a Group Process. A Literature Review on the Social Dynamics of Decision Making in Grant Panels. Research Evaluation 23(4): 298–311.

van der Meulen, Barend. 1998. Science Policies as Principal-Agent Games: Institutionalization and Path Dependency in the Relation Between Government and Science. Research Policy 27(4): 397–414.

Van Raan, Anthony F.J., Antonius J. Nederhof, and Henk F. Moed. 1989. Science and Technology Indicators: Their Use in Science Policy and Their Role in Science: Select Proceedings of the First International Workshop on Science and Technology Indicators. Leiden: DSWO Press.

Vessuri, Hebe, J.C. Guédon, and A.M. Cetto. 2014. Excellence or Quality? Impact of the Current Competition Regime on Science and Scientific Publishing in Latin America and Its Implications for Development. Current Sociology 62(5): 647–665.

Weinberg, Alvin M. 1963/2000. Criteria for scientific choice. Minerva 1(2): 159–171 (Reprinted in Minerva 38(3): 255–266).

Weingart, Peter, and Nico Stehr (eds.). 2000. Practising Interdisciplinarity. Toronto: University of Toronto Press.

Weller, Ann C. 2001. Editorial Peer Review. Its Strengths and Weaknesses. Medford, NJ: Information Today.

Whitley, Richard. 2000. The Intellectual and Social Organization of the Sciences, 2nd ed. Oxford: Oxford University Press.

Whitley, Richard. 2011. Changing Governance and Authority Relationships in the Public Sciences. Minerva 49(4): 359–385.

Whitley, Richard, Jochen Gläser, and Lars Engwall (eds.). 2010. Reconfiguring Knowledge Production: Changing Authority Relationships in the Sciences and Their Consequences for Intellectual Innovation. Oxford: Oxford University Press.

Whitley, Richard, Jochen Gläser, and Grit Laudel. 2018. The Impact of Funding and Authority Relationships on Scientific Innovations. Minerva 56(1): 109–134.

Zuckerman, Harriet. 1977. Scientific Elite: Nobel Laureates in the United States. New York: Basic Books.