Change theory and theory of change: what’s the difference anyway?
Tóm tắt
This commentary focuses on the difference between a theory of change and change theory, as it relates to systemic change projects in STEM higher education. A theory of change is project-specific and related to evaluation. It makes the underlying rationale of a project explicit, which supports planning, implementation, and assessment of the project. In addition, a theory of change is often required by funding agencies as part of grant proposals. In contrast, change theories represent theoretical and empirically grounded knowledge about how change occurs that goes beyond any one project. Ideally, a theory of change is informed by change theories. This essay describes the connections between a theory of change and change theory and provides examples of how change theory can inform a project’s theory of change. Grounding projects in change theory allows change agents to draw on existing knowledge and to better contribute to our collective knowledge about how to achieve meaningful change in STEM higher education.
Từ khóa
Tài liệu tham khảo
Ajzen, I. (1991). The theory of planned behavior. Organizational Behavior and Human Decision Processes, 50(2), 179–211. https://doi.org/10.1016/0749-5978(91)90020-T.
American Association for the Advancement of Science. (2011). Vision and Change in Undergraduate Biology Education: A call to action. Washington, D.C.: American Association for the Advancement of Science.
American Association for the Advancement of Science. (2012). Describing & Measuring Undergraduate STEM Teaching Practices. Retrieved from American Association for the Advancement of Science website: https://live-ccliconference.pantheonsite.io/measuring-teaching-practices/ Accessed 12 Sept 2019.
Anderson, A. (2005). The community builder’s approach to theory of change: A practical guide to theory development. Retrieved from Aspen Institute Roundtable on Community Change website: http://www.theoryofchange.org/pdf/TOC_fac_guide.pdf. .
Andrews, T. C., Conaway, E. P., Zhao, J., & Dolan, E. L. (2016). Colleagues as change agents for undergraduate teaching. CBE-Life Sciences Education, 15(2), 1–17. https://doi.org/10.1187/cbe.15-08-0170.
Andrews, T. C., & Lemons, P. P. (2015). It’s personal: Biology instructors prioritize personal evidence over empirical evidence in teaching decisions. CBE—Life Sciences Education, 14(1), ar7.
Andrews, T. M., Leonard, M. J., Colgrove, C. A., & Kalinowski, S. T. (2011). Active learning not associated with student learning in a random sample of college biology courses. CBE—Life Sciences Education, 10(4), 394–405. https://doi.org/10.1187/cbe.11-07-0061.
Argyris, C. (1976). Single-loop and double-loop models in research on decision making. Administrative Science Quarterly, 363–375.
Aspen Institute Roundtable on Community Change. (2003). Guided example: Project Superwoman. Retrieved from https://www.theoryofchange.org/pdf/Superwomen_Example.pdf. .
Bandura, A. (1997). Self-efficacy: The exercise of control. New York: Freeman.
Bolman, L. G., & Deal, T. E. (2008). Reframing organizations: Artistry, choice, and leadership. San Francisco, CA: Jossey-Bass.
Brancaccio-Taras, L., Pape-Lindstrom, P., Peteroy-Kelly, M., Aguirre, K., Awong-Taylor, J., Balser, T., et al. (2016). The PULSE vision & change rubrics, Version 1.0: A valid and equitable tool to measure transformation of life sciences departments at all institution types. CBE—Life Sciences Education, 15(4), ar60. https://doi.org/10.1187/cbe.15-12-0260.
Center for Disease Control. (2018). Evaluation guide: Developing and using a logic model. Retrieved from https://www.cdc.gov/eval/logicmodels/index.htm. .
Chasteen, S., Chattergoon, R., Prather, E., & Hilborn, R. (2016, July 20-21). Evaluation methodology and results for the new faculty workshops. Paper presented at Physics Education Research Conference 2016, Sacramento, CA. Retrieved from http://www.compadre.org/Repository/document/ServeFile.cfm?ID=14196&DocID=4548. .
Chen, H. T. (1990). Theory-driven evaluations. Thousand Oaks, CA: Sage.
Clark, H., & Anderson, A. A. (2004). Theories of change and logic models: Telling them apart. Annual Meeting of the American Evaluation Association. Presented at Atlanta, GA.
Cobb, P., Confrey, J., Disessa, A., Lehrer, R., & Schauble, L. (2003). Design experiments in educational research. Educational Researcher, 32(1), 9–13. https://doi.org/10.3102/0013189X032001009.
Connolly, M. R., & Seymour, E. (2015). Why theories of change matter (No. WCER Working Paper No. 2015-2). Retrieved from Wisconsin Center for Education Research website: https://wcer.wisc.edu/docs/working-papers/Working_Paper_No_2015_02.pdf. .
Cooperrider, D., & Whitney, D. (2001). A positive revolution in change: Appreciative inquiry. Public Administration and Public Policy, 87, 611–630.
Coryn, C. L. S., Noakes, L. A., Westine, C. D., & Schröter, D. C. (2011). A systematic review of theory-driven evaluation practice from 1990 to 2009. American Journal of Evaluation, 32(2), 199–226. https://doi.org/10.1177/1098214010389321.
Crossan, M. M., Lane, H. W., & White, R. E. (1999). An organizational learning framework: From intuition to institution. The Academy of Management Review, 24(3), 522–537. https://doi.org/10.2307/259140.
Dancy, M., Henderson, C., & Turpen, C. (2016). How faculty learn about and implement research-based instructional strategies: The case of peer instruction. Physical Review Physics Education Research, 12(1), 010110. https://doi.org/10.1103/PhysRevPhysEducRes.12.010110.
Derting, T. L., Ebert-May, D., Henkel, T. P., Maher, J. M., Arnold, B., & Passmore, H. A. (2016). Assessing faculty professional development in STEM higher education: Sustainability of outcomes. Science Advances, 2(3), e1501422.
Ebert-May, D., Derting, T. L., Henkel, T. P., Middlemis Maher, J., Momsen, J. L., Arnold, B., & Passmore, H. A. (2015). Breaking the cycle: future faculty begin teaching with learner-centered strategies after professional development. CBE—Life Sciences Education, 14(2), ar22.
Ebert-May, D., Derting, T. L., Hodder, J., Momsen, J. L., Long, T. M., & Jardeleza, S. E. (2011). What we say is not what we do: Effective evaluation of faculty professional development programs. BioScience, 61(7), 550–558.
Elrod, S., & Kezar, A. (2015). Increasing student success in STEM: A guide to systemic institutional change. A Keck/PKAL Project at the Association of American Colleges & Universities.
Enderle, P. J., Southerland, S. A., & Grooms, J. A. (2013). Exploring the context of change: Understanding the kinetics of a studio physics implementation effort. Physical Review Special Topics-Physics Education Research, 9(1), 010114.
Grunspan, D. Z., Wiggins, B. L., & Goodreau, S. M. (2014). Understanding classrooms through social network analysis: a primer for social network analysis in education research. CBE-Life Sciences Education, 13(2), 167–178. https://doi.org/10.1187/cbe.13-08-0162.
Hayward, C. N., & Laursen, S. L. (2018). Supporting instructional change in mathematics: using social network analysis to understand online support processes following professional development workshops. International Journal of STEM Education, 5(1), 28. https://doi.org/10.1186/s40594-018-0120-9.
Henderson, C. (2008). Promoting instructional change in new faculty: An evaluation of the physics and astronomy new faculty workshop. American Journal of Physics, 76(2), 179–187.
Henderson, C., Beach, A., & Finkelstein, N. (2011). Facilitating change in undergraduate STEM instructional practices: an analytic review of the literature. Journal of Research in Science Teaching, 48(8), 952–984.
Henderson, C., Dancy, M., & Niewiadomska-Bugaj, M. (2012). Use of research-based instructional strategies in introductory physics: where do faculty leave the innovation-decision process? Physical Review Special Topics - Physics Education Research, 8(2), 020104. https://doi.org/10.1103/PhysRevSTPER.8.020104.
Howard Hughes Medical Institute. (2019). Inclusive excellence new competition announcement. Retrieved from https://www.hhmi.org/science-education/programs/inclusive-excellence-new-competition-announcement. .
Kezar, A. J., & Holcombe, E. M. (2019). Leveraging multiple theories of change to promote reform: an examination of the AAU STEM initiative. Educational Policy, 0895904819843594. https://doi.org/10.1177/0895904819843594.
Kotter, J. P. (1996). Leading change. Boston, MA: Harvard Business Review Press.
Lewis, C. (2015). What is improvement science? Do we need it in education? Educational Researcher, 44(1), 54–61. https://doi.org/10.3102/0013189X15570388.
Means, D., Stanton, J., Mekonnen, B., Oni, O., Breeden, R., Babatola, O., Osondu, C., Beckham, M., & Marshall, B. A deeper calling: the aspirations and persistence of black undergraduate students in Science. American Education Research Journal in review.
National Academies of Sciences, Engineering, and Medicine. (2018). Indicators for Monitoring Undergraduate STEM Education. Retrieved from The National Academies Press website: doi: https://doi.org/10.17226/24943
National Science Foundation. (2019). Improving Undergraduate STEM Education: Education and Human Resources (IUSE: EHR). Retrieved from https://www.nsf.gov/publications/pub_summ.jsp?ods_key=nsf19601. .
Olmstead, A., & Turpen, C. (2016). Assessing the interactivity and prescriptiveness of faculty professional development workshops: The real-time professional development observation tool. Physical Review Physics Education Research, 12(2), 020136.
Pawson, R., & Tilley, N. (1997). Realistic evaluation. London, UK: Sage.
Penuel, W. R., Fishman, B. J., Cheng, B. H., & Sabelli, N. (2011). Organizing research and development at the intersection of learning, implementation, and design. Educational Researcher, 40(7), 331–337.
Quardokus, K., & Henderson, C. (2015). Promoting instructional change: Using social network analysis to understand the informal structure of academic departments. Higher Education, 70(3), 315–335. https://doi.org/10.1007/s10734-014-9831-0.
Reinholz, D. L., & Apkarian, N. (2018). Four frames for systemic change in STEM departments. International Journal of STEM Education, 5(1), 3. https://doi.org/10.1186/s40594-018-0103-x.
Reinholz, D. L., Corbo, J. C., Dancy, M., & Finkelstein, N. (2017). Departmental Action Teams: Supporting faculty learning through departmental change. Learning Communities Journal, 9, 5–32.
Reinholz, D. L., Ngai, C., Quan, G., Pilgrim, M. E., Corbo, J. C., & Finkelstein, N. (2019). Fostering sustainable improvements in science education: An analysis through four frames. Science Education. https://doi.org/10.1002/sce.21526.
Stains, M., Harshman, J., Barker, M. K., Chasteen, S. V., Cole, R., DeChenne-Peters, S. E., et al. (2018). Anatomy of STEM teaching in North American universities. Science, 359(6383), 1468–1470.
Stains, M., Pilarz, M., & Chakraverty, D. (2015). Short and long-term impacts of the Cottrell Scholars collaborative new faculty workshop. Journal of Chemical Education, 92(9), 1466–1476.
University of Kansas Center for Community Health and Development. (2018). Community Toolbox: Developing a logic model or theory of change. Retrieved from https://ctb.ku.edu/en/table-of-contents/overview/models-for-community-health-and-development/logic-model-development/main. Accessed 20 April 20 2019.
W.K. Kellogg Foundation. (2004). Logic model development guide: Using logic models to bring together planning, evaluation, & action. Battle Creek, MI: W.K. Kellogg Foundation.
Weiss, C. H. (1995). Nothing as practical as good theory: Exploring theory-based evaluation for comprehensive community initiatives for children and families. New Approaches to Evaluating Community Initiatives: Concepts, Methods, and Contexts, 1, 65–92.
Wiggins, G. P., & McTighe, J. (2005). Understanding by design. Alexandria, VA: Association for Supervision and Curriculum Development.
Woodbury, S., & Gess-Newsome, J. (2002). Overcoming the paradox of change without difference: A model of change in the arena of fundamental school reform. Educational Policy, 16(5), 763–782. https://doi.org/10.1177/089590402237312.