User experience and motivation with engineering design challenges in general chemistry laboratory

Aguinis, H., & Gottfredson, R. K. (2010). Best-practice recommendations for estimating interaction effects using moderated multiple regression. Journal of Organizational Behavior, 31(6), 776–786. https://doi.org/10.1002/job.686 Bandura, A., Freeman, W. H., & Lightsey, R. (1999). Self-efficacy: the exercise of control. Journal of Cognitive Psychotherapy, 13(2), 158–166. https://doi.org/10.1891/0889-8391.13.2.158 Barrie, S. C., Bucat, R. B., Buntine, M. A., Burke da Silva, K., Crisp, G. T., George, A. V., Jamie, I. M., Kable, S. H., Lim, K. F., Pyke, S. M., Read, J. R., Sharma, M. D., & Yeung, A. (2015). Development, evaluation and use of a student experience survey in undergraduate science laboratories: The advancing science by enhancing learning in the laboratory student laboratory learning experience survey. International Journal of Science Education, 37(11), 1795–1814. https://doi.org/10.1080/09500693.2015.1052585 Beier, M. E., Kim, M. H., Saterbak, A., Leautaud, V., Bishnoi, S., & Gilberto, J. M. (2018). The effect of authentic project-based learning on attitudes and career aspirations in STEM. Journal of Research in Science Teaching. https://doi.org/10.1002/tea.21465 Bentler, P. M., & Bonett, D. G. (1980). Significance tests and goodness of fit in the analysis of covariance structures. Psychological Bulletin, 88(3), 588–606. https://doi.org/10.1037/0033-2909.88.3.588 Bong, M. (2001). Role of self-efficacy and task-value in predicting college students’ course performance and future enrollment intentions. Contemporary Educational Psychology, 26(4), 553–570. https://doi.org/10.1006/ceps.2000.1048 Brainard, S. G., & Carlin, L. (1998). A six-year longitudinal study of undergraduate women in engineering and science*. Journal of Engineering Education, 87(4), 369–375. https://doi.org/10.1002/j.2168-9830.1998.tb00367.x Brewe, E. (2008). Modeling theory applied: Modeling Instruction in introductory physics. American Journal of Physics, 76(12), 1155–1160. https://doi.org/10.1119/1.2983148 Brown, E. R., Smith, J. L., Thoman, D. B., Allen, J. M., & Muragishi, G. (2015). From Bench to Bedside: A communal utility value intervention to enhance students’ biomedical science motivation. Journal of Educational Psychology, 107(4), 1116–1135. https://doi.org/10.1037/edu0000033 Canning, E. A., & Harackiewicz, J. M. (2015). Teach It, Don’t Preach It: The differential effects of directly-communicated and self-generated utility value information. Motivation Science, 1(1), 47–71. https://doi.org/10.1037/mot0000015 Cech, E., Rubineau, B., Silbey, S., & Seron, C. (2011). Professional role confidence and gendered persistence in engineering. American Sociological Review, 76(5), 641–666. https://doi.org/10.1177/0003122411420815 Chachra, D., Kilgore, D., Loshbaugh, H., McCain, J., & Chen, H. L. (2008). Being and becoming: Gender and identity formation of engineering students. 13.250.1–13.250.20. https://peer.asee.org/3597 Chen, S., Binning, K. R., Manke, K. J., Brady, S. T., McGreevy, E. M., Betancur, L., Limeri, L. B., & Kaufmann, N. (2021). Am I a science person? A strong science identity bolsters minority students’ sense of belonging and performance in college. Personality and Social Psychology Bulletin, 47(4), 593–606. https://doi.org/10.1177/0146167220936480 Chen, X., & Soldner, M. (2013). STEM attrition: College students’ paths into and out of STEM fields (Statistical Analysis Report (SAR) NCES 2014–001). U. S. Department of Education. https://nces.ed.gov/pubs2014/2014001rev.pdf Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Lawrence Erlbaum Associates. https://doi.org/10.4324/9780203771587 Crippen, K. J., Imperial, L., Wu, C.-Y., Korolev, M., Brucat, P., & Payne, C. (2018). General chemistry laboratory as situated engineering design. Proceedings of the American Society for Engineering Education. American Society for Engineering Education (ASEE) Annual Conference & Exposition, Salt Lake City, UT. https://doi.org/10.18260/1-2--29965 Curry, K. W., Spencer, D., Pesout, O., & Pigford, K. (2019). Utility value interventions in a college biology lab: The impact on motivation. Journal of Research in Science Teaching. https://doi.org/10.1002/tea.21592 Driscoll, D. M., Zawojewski, J. S., & Stahura, J. (2008). Learning from first-year engineering student surveys. In J. S. Zawojewski, H. A. Diefes-Dux, & K. J. Bowman (Eds.), Models and Modeling in Engineering Education (pp. 11–136). Sense Publishers. Earnshaw, Y., Tawfik, A. A., & Schmidt, M. (2018). User Experience Design. In R. E. West (Ed.), Foundations of Learning and Instructional Design Technology: The Past, Present, and Future of Learning and Instructional Design Technology. EdTech Books. Retrieved from https://edtechbooks.org/lidtfoundations. Eccles, J. (1983). Expectancies, values and academic behaviors. In J. T. Spence (Ed.), Psychological and sociological approaches (pp. 75–146). Freeman. Eccles, J. S., & Wigfield, A. (1995). In the Mind of the Actor: The Structure of Adolescents’ Achievement Task Values and Expectancy-Related Beliefs. Personality and Social Psychology Bulletin, 21(3), 215–225. https://doi.org/10.1177/0146167295213003 Eccles, J. S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53, 109–132. https://doi.org/10.1146/annurev.psych.53.100901.135153 Eccles, J. S., & Wigfield, A. (2020). From expectancy-value theory to situated expectancy-value theory: A developmental, social cognitive, and sociocultural perspective on motivation. Contemporary Educational Psychology. https://doi.org/10.1016/j.cedpsych.2020.101859 Eccles, J. S. (2005). Subjective task value and the eccles et al. model of achievement-related choices. In A. J. Elliot & C. S. Dweck (Eds.), Handbook of Competence and Motivation (1st ed.). Guilford Press. Estrada, M., Eroy-Reveles, A., & Matsui, J. (2018). The influence of affirming kindness and community on broadening participation in STEM career pathways. Social Issues and Policy Review, 12(1), 258–297. https://doi.org/10.1111/sipr.12046 Gasiewski, J. A., Eagan, M. K., Garcia, G. A., Hurtado, S., & Chang, M. J. (2012). From gatekeeping to engagement: A multicontextual, mixed method study of student academic engagement in introductory STEM courses. Research in Higher Education, 53(2), 229–261. https://doi.org/10.1007/s11162-011-9247-y Gaspard, H., Dicke, A.-L., Flunger, B., Schreier, B., Häfner, I., Trautwein, U., & Nagengast, B. (2015). More value through greater differentiation: Gender differences in value beliefs about math. Journal of Educational Psychology, 107(3), 663–677. https://doi.org/10.1037/edu0000003 Gaspard, H., Häfner, I., Parrisius, C., Trautwein, U., & Nagengast, B. (2017). Assessing task values in five subjects during secondary school: Measurement structure and mean level differences across grade level, gender, and academic subject. Contemporary Educational Psychology, 48, 67–84. https://doi.org/10.1016/j.cedpsych.2016.09.003 Goodman, I., & Cunningham, C. (2002). Final Report of the Women’s Experiences in College Engineering (WECE) Project (No. ED507394). Goodman Research Group. Harackiewicz, J. M., Canning, E. A., Tibbetts, Y., Giffen, C. J., Blair, S. S., Rouse, D. I., & Hyde, J. S. (2014). Closing the Social Class Achievement Gap for First-Generation Students in Undergraduate Biology. Journal of Educational Psychology, 106(2), 375–389. https://doi.org/10.1037/a0034679 Harackiewicz, J. M., Canning, E. A., Tibbetts, Y., Priniski, S. J., & Hyde, J. S. (2016). Closing achievement gaps with a utility-value intervention: Disentangling race and social class. Journal of Personality and Social Psychology, 111(5), 745–765. https://doi.org/10.1037/pspp0000075 Harackiewicz, J. M., & Priniski, S. J. (2018). Improving student outcomes in higher education: The science of targeted intervention. Annual Review of Psychology, 69, 409–435. https://doi.org/10.1146/annurev-psych-122216-011725 Harris, R. B., Mack, M. R., Bryant, J., Theobald, E. J., & Freeman, S. (2020). Reducing achievement gaps in undergraduate general chemistry could lift underrepresented students into a “hyperpersistent zone”. Science Advances, 6(24), eaaz5687. https://doi.org/10.1126/sciadv.aaz5687 Henderson, C., Beach, A., & Finkelstein, N. (2011). Facilitating change in undergraduate STEM instructional practices: An analytic review of the literature. Journal of Research in Science Teaching, 48(8), 952–984. https://doi.org/10.1002/tea.20439 Hester, S. D., Nadler, M., Katcher, J., Elfring, L. K., Dykstra, E., Rezende, L. F., & Bolger, M. S. (2018). Authentic inquiry through modeling in biology (AIM-Bio): An introductory laboratory curriculum that increases undergraduates’ scientific agency and skills. CBE Life Sciences Education, 17(4), ar63. https://doi.org/10.1187/cbe.18-06-0090 Hulleman, C. S., Barron, K. E., Kosovich, J. J., & Lazowski, R. A. (2016). Student Motivation: Current Theories, Constructs, and Interventions Within an Expectancy-Value Framework. In A. A. Lipnevich, F. Preckel, & R. D. Roberts (Eds.), Psychosocial skills and school systems in the 21st century (pp. 241–278). Springer International Publishing. https://doi.org/10.1007/978-3-319-28606-8_10 Hulleman, C. S., Kosovich, J. J., Barron, K. E., & Daniel, D. B. (2017). Making connections: Replicating and extending the utility value intervention in the classroom. Journal of Educational Psychology, 109(3), 387–404. https://doi.org/10.1037/edu0000146 IBM Corp. (2019). IBM SPSS Statistics for Macintosh (28.0) [Computer software]. IBM Corp. Johri, A., & Olds, B. M. (2011). Situated engineering learning: Bridging engineering education research and the learning sciences. Journal of Engineering Education, 100(1), 151–185. Jones, B. D., Paretti, M. C., Hein, S. F., & Knott, T. W. (2010). An analysis of motivation constructs with first-year engineering students: relationships among expectancies, values, achievement, and career plans. Journal of Engineering Education, 99(4), 319–336. https://doi.org/10.1002/j.2168-9830.2010.tb01066.x Kang, J., Hense, J., Scheersoi, A., & Keinonen, T. (2019). Gender study on the relationships between science interest and future career perspectives. International Journal of Science Education, 41(1), 80–101. https://doi.org/10.1080/09500693.2018.1534021 Keller, J. M. (2010). Motivational design for learning and performance. Springer, US. https://doi.org/10.1007/978-1-4419-1250-3 Krapp, A., & Prenzel, M. (2011). Research on interest in science: Theories, methods, and findings. International Journal of Science Education, 33(1), 27–50. https://doi.org/10.1080/09500693.2010.518645 Marra, R. M., Rodgers, K. A., Shen, D., & Bogue, B. (2012). Leaving engineering: A multi-year single institution study. Journal of Engineering Education, 101(1), 6–27. https://doi.org/10.1002/j.2168-9830.2012.tb00039.x McColl-Kennedy, J., & Schneider, U. (2000). Measuring customer satisfaction: Why, what and how. Total Quality Management, 11(7), 883–896. https://doi.org/10.1080/09544120050135434 Miyake, A., Kost-Smith, L. E., Finkelstein, N. D., Pollock, S. J., Cohen, G. L., & Ito, T. A. (2010). Reducing the gender achievement gap in college science: A classroom study of values affirmation. Science, 330(6008), 1234–1237. https://doi.org/10.1126/science.1195996 National Academy of Engineering [NAE]. (2008). Grand Challenges - 14 Grand Challenges for Engineering. http://www.engineeringchallenges.org National Research Council [NRC] (Ed.). (2012). Discipline-Based Education Research: Understanding and Improving Learning in Undergraduate Science and Engineering. National Academies Press. https://doi.org/10.17226/13362 National Science Foundation [NSF]. (n.d.). U. S. National Science Foundation definition of groups underrepresented . US NSF - MPS - DMR - Broadening Participation. Retrieved March 5, 2021, from https://www.nsf.gov/mps/dmr/diversity.jsp Osborne, J. W., & Walker, C. (2006). Stereotype threat, identification with academics, and withdrawal from school: Why the most successful students of colour might be most likely to withdraw. Educational Psychology, 26(4), 563–577. https://doi.org/10.1080/01443410500342518 Oyserman, D., Bybee, D., & Terry, K. (2006). Possible selves and academic outcomes: How and when possible selves impel action. Journal of Personality and Social Psychology, 91(1), 188–204. https://doi.org/10.1037/0022-3514.91.1.188 Pajares, F. (1996). Self-efficacy beliefs in academic settings. Review of Educational Research, 66(4), 543–578. https://doi.org/10.3102/00346543066004543 Patrick, B. C., Hisley, J., & Kempler, T. (2000). “What’s Everybody So Excited About?”: The Effects of Teacher Enthusiasm on Student Intrinsic Motivation and Vitality. Informa UK Limited. https://doi.org/10.1080/00220970009600093 Payne, C., Crippen, K. J., Imperial, L., Wu, C.-Y., Brucat, P., & Korolev, M. (2019). Persistence of First-year Engineering Majors with a Design-based Chemistry Laboratory Curriculum In- and Out-of-Sequence. Proceedings of the American Society for Engineering Education. American Society for Engineering Education (ASEE) Annual Conference & Exposition, Tampa, FL. https://doi.org/10.18260/1-2--32326 Payne, C., Crippen, K. J., & Imperial, L. (2021). An Exploration of Perceptions of Justice in a Career-Forward Undergraduate Chemistry Laboratory Course. Journal for STEM Education Research. https://doi.org/10.1007/s41979-021-00063-1 Perez, T., Cromley, J. G., & Kaplan, A. (2014). The role of identity development, values, and costs in college STEM retention. Journal of Educational Psychology, 106(1), 315–329. https://doi.org/10.1037/a0034027 Robbins, S. B., Lauver, K., Le, H., Davis, D., Langley, R., & Carlstrom, A. (2004). Do psychosocial and study skill factors predict college outcomes? A Meta-Analysis. Psychological Bulletin, 130(2), 261–288. https://doi.org/10.1037/0033-2909.130.2.261 Robinson, K. A., Perez, T., Carmel, J. H., & Linnenbrink-Garcia, L. (2019). Science identity development trajectories in a gateway college chemistry course: Predictors and relations to achievement and STEM pursuit. Contemporary Educational Psychology, 56, 180–192. https://doi.org/10.1016/j.cedpsych.2019.01.004 Robinson, K. A., Perez, T., Nuttall, A. K., Roseth, C. J., & Linnenbrink-Garcia, L. (2018). From science student to scientist: Predictors and outcomes of heterogeneous science identity trajectories in college. Developmental Psychology, 54(10), 1977–1992. https://doi.org/10.1037/dev0000567 Rosenzweig, E. Q., Wigfield, A., & Eccles, J. S. (2019). Expectancy-Value Theory and Its Relevance for Student Motivation and Learning. In The cambridge handbook of motivation and learning (pp. 617–644). Cambridge University Press. https://doi.org/10.1017/9781316823279.026 R Core Team. (2020). R: A language and environment for statistical computing (4.0.2) [Computer software]. R Foundation for Statistical Computing. https://www.R-project.org Sauro, J., & Dumas, J. S. (2009). Comparison of three one-question, post-task usability questionnaires. Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 09, 1599. https://doi.org/10.1145/1518701.1518946 Sauro, J. (2018). Benchmarking the User Experience. MeasuringU Press. Schmidt, M., Tawfik, A. A., Jahnke, I., & Earnshaw, Y. (Eds.). (2020). Learner and user experience research an introduction for the field of learning design & technology. Ed Tech Books. https://edtechbooks.org/ux Schoffstall, A. M., & Gaddis, B. A. (2007). Incorporating guided-inquiry learning into the organic chemistry laboratory. Journal of Chemical Education, 84(5), 848. https://doi.org/10.1021/ed084p848 Schukajlow, S., Leiss, D., Pekrun, R., Blum, W., Müller, M., & Messner, R. (2012). Teaching methods for modelling problems and students’ task-specific enjoyment, value, interest and self-efficacy expectations. Educational Studies in Mathematics, 79(2), 215–237. https://doi.org/10.1007/s10649-011-9341-2 Smith, J. L., Cech, E., Metz, A., Huntoon, M., & Moyer, C. (2014). Giving back or giving up: Native American student experiences in science and engineering. Cultural Diversity & Ethnic Minority Psychology, 20(3), 413–429. https://doi.org/10.1037/a0036945 Su, R., & Rounds, J. (2015). All STEM fields are not created equal: People and things interests explain gender disparities across STEM fields. Frontiers in Psychology, 6, 189. https://doi.org/10.3389/fpsyg.2015.00189 Tabachnick, B. G., & Fidell, L. S. (2012). Using Multivariate Statistics (p. 1024). Pearson Higher Ed. Talanquer, V., & Pollard, J. (2010). Let’s teach how we think instead of what we know. Chemical Education Research and Practice, 11(2), 74–83. https://doi.org/10.1039/C005349J Thoman, D. B., Brown, E. R., Mason, A. Z., Harmsen, A. G., & Smith, J. L. (2015). The role of altruistic values in motivating underrepresented minority students for biomedicine. BioScience, 65(2), 183–188. https://doi.org/10.1093/biosci/biu199 Trede, F., Macklin, R., & Bridges, D. (2012). Professional identity development: A review of the higher education literature. Studies in Higher Education, 37(3), 365–384. https://doi.org/10.1080/03075079.2010.521237 Tullis, T., & Albert, B. (2013). Measuring the user experience: Collecting, analyzing and presenting usability metrics (Second). Elsevier. Verdin, D., & Godwin, A. (2015). First in the family: A comparison of first-generation and non-first-generation engineering college students. IEEE Frontiers in Education Conference (FIE), 2015, 1–8. https://doi.org/10.1109/FIE.2015.7344359 Walton, G. M., & Cohen, G. L. (2007). A question of belonging: Race, social fit, and achievement. Journal of Personality and Social Psychology, 92(1), 82–96. https://doi.org/10.1037/0022-3514.92.1.82 Walton, G. M., & Cohen, G. L. (2011). A brief social-belonging intervention improves academic and health outcomes of minority students. Science, 331(6023), 1447–1451. https://doi.org/10.1126/science.1198364 Walton, G. M., Logel, C., Peach, J. M., Spencer, S. J., & Zanna, M. P. (2015). Two brief interventions to mitigate a “chilly climate” transform women’s experience, relationships, and achievement in engineering. Journal of Educational Psychology, 107(2), 468–485. https://doi.org/10.1037/a0037461 Weston, T. J. (2019). Patterns of switching and relocation. In E. Seymour & A.-B. Hunter (Eds.), Talking about Leaving Revisited: Persistence, Relocation, and Loss in Undergraduate STEM Education (pp. 55–85). Springer International Publishing. https://doi.org/10.1007/978-3-030-25304-2_2 Wheeler, L. B., Clark, C. P., & Grisham, C. M. (2017). Transforming a traditional laboratory to an inquiry-based course: importance of training TAs when redesigning a curriculum. Journal of Chemical Education, 94(8), 1019–1026. https://doi.org/10.1021/acs.jchemed.6b00831 Wigfield, A., & Eccles, J. S. (2000). Expectancy-value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81. https://doi.org/10.1006/ceps.1999.1015