Validation of a short form of an indecision test: the vocational assessment test
Tóm tắt
The purpose of this research was to validate the scores of a short form of a new instrument, l’Épreuve de décision vocationnelle, forme scolaire (EDV-9S; vocational assessment test), which measures six indecision-related problems (lack of self-knowledge, lack of readiness, lack of method in decision making, lack of information, external barriers, and dysfunctional beliefs). In Study 1 (n = 778; M
age = 17.7 years; female = 55.4 %), we first assess the reliability and factorial validity of the EDV-9S scores. Subsequently, 24 of 48 items were selected using Rasch modeling. In Study 2 (n
1 = 757; M
age = 18.0 years; female = 55.9 %), we assess the reliability, factorial validity, and convergent and divergent validity of the short form scores and their invariance across gender and over time. Findings from both studies suggest that the original as well as the short form scores present adequate psychometric properties and could be used to assess indecision problems in French-speaking students in higher education.
Tài liệu tham khảo
Andersen, E. B. (1977). Sufficient statistics and latent trait models. Psychometrika, 42, 69–81. doi:10.1007/BF02293746.
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573. doi:10.1007/BF02293814.
Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037/0033-2909.107.2.238.
Bentler, P. M. (2006). EQS structural equations program manual. Encico, CA: Multivariate Software Inc.
Browne, M. W., & Cudeck, R. (1993). Alternative ways of assessing model fit. In K. Bollen & R. Stine (Eds.), Testing structural equation models (pp. 136–162). Newbury Park, CA: Sage. doi:10.1177/0049124192021002005.
Byrne, B. M. (1995). Structural equation modeling with EQS and EQS/Windows: Basic concepts, applications, and programming. Thousand Oaks, CA: Sage.
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56, 81–105. doi:10.1037/h0046016.
Campbell, D. T., & O’Connell, E. J. (1967). Methods factors in multitrait-multimethod matrices: Multiplicative rather than additive? Multivariate Behavioral Research, 2, 409–426.
Campbell, D. T., & O’Connell, E. J. (1982). Methods as diluting trait relationships rather than adding irrelevant systematic variance. New Directions for Methodology of Social and Behavioral Science, 12, 93–111. doi:10.1207/s15327906mbr0204_1.
Chartrand, J. M., & Robbins, S. B. (1997). Career factors inventory: Applications and technical guide. Palo Alto, CA: Consulting Psychologists.
Cole, J. C., Rabin, A. S., Smith, T. M., & Kaufman, A. S. (2004). Development and validation of a Rasch-derived CES-D short form. Psychological Assessment, 16, 360–372. doi:10.1037/1040-3590.16.4.360.
Conseil Supérieur de l’Éducation. (2008). The student’s engagement in his educational plan at the college level: A shared responsibility among all college stakeholders (Abridged version). Québec, Canada: Author.
Crocker, L., & Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Harcourt Brace-Jovanovich.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. doi:10.1007/BF02310555.
Deal, J. E., Halverson, C. F., Jr., Martin, R. P., Victor, J., & Baker, S. (2007). The inventory of children’s individual differences: Development and validation of a short version. Journal of Personality Assessment, 89, 162–166. doi:10.1080/00223890701468550.
Field, A. (2005). Discovering statistics using SPSS (2nd ed.). Thousand Oaks, CA: Sage. doi:10.1111/j.1365-2648.2007.04270_1.x.
Forner, Y. (2000). Indécision et adaptation à l’université [Indecision and adjustment to the university]. L’Orientation Scolaire et Professionnelle, 29, 499–517.
Forner, Y. (2007). L’indécision de carrière des adolescents [Adolescents’ career indecision]. Le Travail Humain, 70, 213–214.
Forner, Y. (2009). EDV Épreuve de Décision Vocationnelle [EDV Vocational Decision Test]. Paris, France: Eurotests Éditions.
Forner, Y. (2010). L’évaluation de l’indécision vocationnelle: L’EDV-9 (forme S). [The validation of the EDV-9S]. L’Orientation Scolaire et Professionnelle, 39, iv–xxii.
Gati, I., & Asher, I. (2001). The PIC model for career decision making: Prescreening, in-depth exploration, and choice. In F. T. L. Leong & A. Barak (Eds.), Contemporary models in vocational psychology (pp. 7–54). Mahwah, NJ: Erlbaum.
Gati, I., Gadassi, R., & Mashiah-Cohen, R. (2012). Career decision-making profiles vs. styles. Convergent and incremental validity. Journal of Vocational Behavior, 81, 2–16. doi:10.1016/j.jvb.2012.03.004.
Gati, I., Krausz, M., & Osipow, S. H. (1996). A taxonomy of difficulties in career decision making. Journal of Counseling Psychology, 43, 510–526. doi:10.1037/0022-0167.43.4.510.
Germeijs, V., & Verschueren, K. (2006). High school students’ career decision-making process: Development and validation of the Study Choice Task Inventory. Journal of Career Assessment, 14, 449–471. doi:10.1177/1069072706286510.
Gosling, S. D., Rentfrow, P. J., & Swann, W. B., Jr. (2003). A very brief measure of the big-five personality domains. Journal of Research in Personality, 37, 504–528. doi:10.1016/S0092-6566(03)00046-1.
Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576. doi:10.1146/annurev.psych.58.110405.085530.
Graunke, S. S., & Woosley, S. A. (2005). An exploration of the factors that affect the academic success of college sophomores. College Student Journal, 39, 367–377.
Holland, J. L., Fritzsche, B. A., & Powell, A. B. (1994). Self-directed search: Technical manual. Odessa, FL: Psychological Assessment Resources.
Hu, L.-T., & Bentler, P. M. (1999). Cutoff criteria for fix indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(10), 1–55. doi:10.1080/10705519909540118.
Kelly, K. R., & Lee, W.-C. (2002). Mapping the domain of career decision problems. Journal of Vocational Behavior, 61, 302–326. doi:10.1006/jvbe.2001.1858.
Kline, P. (1999). The handbook of psychological testing (2nd ed.). London: Routledge.
Las Hayas, C., Quintana, J. M., Padierna, J. A., Bilboa, A., & Munoz, P. (2010). Use of Rasch methodology to develop a short version of the health related quality of life for eating disorders questionnaire: a prospective study. Health and Quality of Life Outcomes, 8(29), 1–12. doi:10.1186/1477-7525-8-29.
Lent, R. W., Brown, S. D., & Hackett, G. (1994). Toward a unifying social cognitive theory of career and academic interest, choice, and performance. Journal of Vocational Behavior, 45, 79–122. doi:10.1006/jvbe.1994.1027.
Linacre, J. M. (1994). FACETS. Rasch model computer program (version 2.7) [Computer software and software manual]. Chicago IL: MESA.
Linacre, J. M. (2002). What do infit and outfit, mean-square and standardized mean? Rasch Measurement Transactions, 16, 878.
Linacre, J. M., & Wright, B. D. (1999). WINSTEPS: Rasch-model computer program (Version 2.88) [computer software]. Chicago, IL: MESA.
Marsh, H. W., & Butler, S. (1984). Evaluating reading diagnostic tests: An application of confirmatory factor analysis to multitrait-multimethod data. Applied Psychological Measurement, 8, 307–320. doi:10.1177/014662168400800308.
Marsh, H. W., Ellis, L., Parada, L., Richards, G., & Heubeck, B. G. (2005). A short version of the self description questionnaire II: Operationalizing criteria for short-form evaluation with new applications of confirmatory factor analyses. Psychological Assessment, 17, 81–102. doi:10.1037/1040-3590.17.1.81.
Marsh, H. W., Hau, K.-T., Balla, J. R., & Grayson, D. (1998). Is more ever too much? The number of indicators per factor in confirmatory factor analysis. Multivariate Behavioral Research, 33, 181–201.
Marsh, H. W., & Hocevar, D. (1988). A new, more powerful approach to multitrait-multimethod analyses: Application of second-order confirmatory factor analysis. Journal of Applied Psychology, 73(1), 107–117. doi:10.1037/0021-9010.73.1.107.
Morgan, T., & Ness, D. (2003). Career decision-making difficulties of first-year students. The Canadian Journal of Career Development, 2, 33–39.
Muck, P. M., Hell, B., & Gosling, S. D. (2007). Construct validation of a short five-factor model instrument. European Journal of Psychological Assessment, 23, 166–175. doi:10.1027/1015-5759.23.3.166.
Neuville, S., & Frenay, M. (2012). La persévérance des étudiants de 1er baccalauréat à la lumière du modèle expectancy-value. [Persistence among first-year college students based on the expectancy-value model]. In M. Romainville & C. Michaut (Eds.), Réussite, échec et abandon dans l’enseignement supérieur (pp. 157–175). Bruxelles, Belgium: De Boeck.
Nunally, J. C. (Ed.). (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill.
Osipow, S. H. (1987). Manual for the career decision scale. Odessa, FL: Psychological Assessment Resources.
Panagiotis, G. S., Sideridis, G. D., Protopapas, A., & Mouzaki, A. (2011). Psychometric evaluation of a receptive vocabulary test for Greek elementary students. Assessment for Effective Intervention, 37(1), 34–49. doi:10.1177/1534509411413254.
Picard, F., Boutin, N., & Skakni, I. (2010). La session d’accueil et d’intégration: Un nouveau parcours d’accès à l’enseignement supérieur québécois [The transition session: A new pathway into Québec’s higher education system]. Éducation et Sociétés, 26(2), 29–43.
Poitras, C., Guay, F., & Ratelle, C. (2012). Using the self-directed search in research: Selecting a representative pool of items to measure vocational interests. Journal of Career Development, 39, 186–207. doi:10.1177/0894845310384593.
Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less. A 10-item short version of the Big Five Inventory in English and German. Journal of Research in Personality, 41, 203–212. doi:10.1016/j.jrp.2006.02.001.
Robins, R. W., Hendin, H. M., & Trzesniewski, K. H. (2001). Measuring global self-esteem: Construct validation of a single-item measure and the Rosenberg Self-Esteem Scale. Personality and Social Psychology Bulletin, 27, 151–161.
Rose, H. A., & Elton, C. F. (1971). Attrition and the vocationally undecided student. Journal of Vocational Behavior, 1, 99–103. doi:10.1016/0001-8791(71)90011-X.
Sabourin, S., Valois, P., & Lussier, Y. (2005). Development and validation of a brief version of the Dyadic adjustment scale with nonparametric item analysis model. Psychological Assessment, 17, 15–27. doi:10.1037/1040-3590.17.1.15.
Schumacker, R. E., & Lomax, R. G. (1996). A beginner’s guide to structural equation modeling. Mahwah, NJ: Lawrence Erlbaum Associates.
Steiger, J. H. (1990). Structural model evaluation and modification: An interval estimation. approach. Multivariate Behavioral Research, 25, 173–180. doi:10.1207/s15327906mbr2502_4.
Taylor, K. M. (1982). An investigation of vocational indecision in college students: Correlates and moderators. Journal of Vocational Behavior, 21, 318–329. doi:10.1016/0001-8791(82)90040-9.
Tucker, L. R., & Lewis, C. (1973). A reliability coefficient for maximum likelihood factor analysis. Psychometrika, 38, 1–10. doi:10.1007/BF02291170.
van de Schoot, R., Lugtig, P., & Hox, J. (2012). Developmetrics. A checklist for testing measurement invariance. European Journal of Developmental Psychology, 9, 486–492. doi:10.1080/17405629.2012.686740.
Weller, J. A., Dieckmann, N. F., Tusler, M., Mertz, C. K., Burns, W. J., & Peters, E. (2012). Development and testing of an abbreviated numeracy scale. A Rasch analysis approach. Journal of Behavioral Decision Making. Advance online publication. doi:10.1002/bdm.1751.
Wright, B. D., & Linacre, J. (1989). Observations are always ordinal; measurement, however, must be interval. Archive of Physical Medicine and Rehabilitation, 71, 857–860.
Wright, B. D., & Masters, G. N. (1982). Rating scale analysis: Rasch measurement. Chicago, IL: MESA.