A Pragmatic Approach for Evaluating and Accrediting Digital Competence of Digital Profiles: A Case Study of Entrepreneurs and Remote Workers

Abedi, J. (2006). Language issues in item development. Handbook of test development, 377–398. Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14(3), 219–234 Aesaert, K., Van Nijlen, D., Vanderlinde, R., & van Braak, J. (2014). Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale. Computers & Education, 76, 168–181 Aesaert, K., Voogt, J., Kuiper, E., & van Braak, J. (2017). Accuracy and bias of ICT self-efficacy: An empirical study into students’ over-and underestimation of their ICT competences. Computers in Human Behavior, 75, 92–102 Ala-Mutka, K. (2011). Mapping digital competence: Towards a conceptual understanding. Sevilla: Institute for Prospective Technological Studies, 7-60. American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, & Psychological Testing (US). (1999). Standards for educational and psychological testing. Amer Educational Research Assn. Autor, D. H. (2015). Why are there still so many jobs? The history and future of workplace automation. Journal of Economic Perspectives, 29(3), 3–30 Bacigalupo, M., Kampylis, P., Punie, Y., & Van den Brande, G. (2016). EntreComp: The entrepreneurship competence framework. Luxembourg: Publication Office of the European Union, 10, 593884 BAIT (n.d.). Evaluation and certification system of digital competences in the Basque Country. Retrieved October 28, 2019, from http://www.bait.eus. Baruch, A. F., & Erstad, O. (2018). Upbringing in a digital world: Opportunities and possibilities. Technology, Knowledge and Learning, 23(3), 377–390 Beliaeva, T., Ferasso, M., Kraus, S., & Damke, E. J. (2019). Dynamics of digital entrepreneurship and the innovation ecosystem. International Journal of Entrepreneurial Behavior & Research. Bennett, R. E., & Bejar, I. I. (1998). Validity and automad scoring: It’s not only the scoring. Educational Measurement: Issues and Practice, 17(4), 9–17 Bi, R., Davison, R. M., & Smyrnios, K. X. (2017). E-business and fast growth SMEs. Small Business Economics, 48(3), 559–576 Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In Assessment and teaching of 21st century skills (pp. 17–66). Springer, Dordrecht. Carretero, S., Vuorikari, R., & Punie, Y. (2017). DigComp 2.1: The Digital Competence Framework for Citizens. Publications Office of the European Union. Cascio, W. F., & Montealegre, R. (2016). How technology is changing work and organizations. Annual Review of Organizational Psychology and Organizational Behavior, 3, 349–375 Cedefop. (2015). European guidelines for validating non-formal and informal learning. Luxembourg: Publications Office. Cedefop reference series; No 104. https://doi.org/10.2801/008370 Colbert, A., Yee, N., & George, G. (2016). The digital workforce and the workplace of the future. Compass (n.d.). Up-skilling online training course for young unemployed people. Retrieved October 28, 2019, from https://www.compassdigitalskills.eu/. de Macêdo, T. A. M., Cabral, E. L. D. S., Silva Castro, W. R., de Souza Junior, C. C., da Costa Junior, J. F., Pedrosa, F. M., & Másculo, F. S. (2020). Ergonomics and telework: A systematic review. Work, (Preprint), 1–11. Dhaliwal, A., & Sahay, A. (2020). Factors influencing the success of women entrepreneurs in Emerging Markets: A Study of Indian women entrepreneurs. Journal of Asia Entrepreneurship and Sustainability, 16(2), 21–72 Digital Competence Wheel (n.d.). An Online Testing Tool That Maps Your Digital Competences. Retrieved October 28, 2019, from https://digitalekompetencer.dk/. Digitale, interaktive Didaktik (n.d.). Digital skills self-assessment tool for employees and managers of the Dach region. Retrieved October 28, 2019, from http://www.forum-did.de/digcomp. Dingel, J. I., & Neiman, B. (2020). How many jobs can be done at home? (No. w26948). National Bureau of Economic Research. Durkin, M., McGowan, P., & McKeown, N. (2013). Exploring social media adoption in small to medium-sized enterprises in Ireland. Journal of Small Business and Enterprise Development. EC. (2015). A Digital Single Market Strategy for Europe—Analysis and Evidence—Commission Staff Working Document. EC. (2016b). European Commission. Digital Economy and Society Index (DESI). Retrieved October 28, 2019, from https://ec.europa.eu/digital-single-market/en/desi. Engelhardt, L., Goldhammer, F., Naumann, J., & Frey, A. (2017). Experimental validation strategies for heterogeneous computer-based assessment items. Computers in Human Behavior, 76, 683–692 ENTRECOM4ALL (n.d.). EntreCom4All, enhancing your entrepreneurship competences. Retrieved October 28, 2019, from http://entrecom4all.eu/. Eurofound, . (2016). What do Europeans do at work? A task-based analysis: European Jobs Monitor 2016. Publications Office of the European Union. Eurofound and the International Labour Office (2017), Working anytime, anywhere: The effects on the world of work, Publications Office of the European Union, Luxembourg, and the International Labour Office, Geneva. European Commission. (2019). Erasmus+ Programme Guide. Retrieved October 28, 2019, from https://ec.europa.eu/programmes/erasmus-plus/resources/documents/treoirleabhar-erasmus-2019_en European Commission. (2016). A new skills agenda for Europe: Working together to strengthen human capital, employability and competitiveness. European Commission. (2017b). The digital skills and jobs coalition. https://ec.europa.eu/digital-single-market/en/digital-skills-jobscoalition. European Commission. (n.d.). European multilingual classification of Skills, Competences, Qualifications and Occupations (ESCO). Retrieved October 28, 2019, from https://ec.europa.eu/esco/portal/home. European Parliament and the Council. (2006). Recommendation of the European Parliament and of the Council of 18 December 2006 on key competences for lifelong learning. Official Journal of the European Union, L394/310. European Parliament and the Council. (2008b). Recommendation of the European Parliament and of the Council on the establishment of the European Qualifications Framework for lifelong learning. Official Journal of the European Union, C111/111. Eurostat. (2017). Digital economy and society statistics‐households and individuals. https://ec.europa.eu/eurostat/statistics-explained/index.php/Digital_economy_and_society_statistics_-_households_and_individuals. Evangelinos, G., & Holley, D. (2014). Developing a digital competence self-assessment toolkit for nursing students. In Proceedings of the EDEN 2014 annual conference, from education to employment and meaningful work with ICT E-learning at work and the workplace. Evans, D. S., & Schmalensee, R. (2016). Matchmakers: The new economics of multisided platforms. Harvard Business Review Press. Felstead, A., & Henseke, G. (2017). Assessing the growth of remote working and its consequences for effort, well-being and work-life balance. New Technology, Work and Employment, 32(3), 195–212 Ferrari, A. (2012). Digital competence in practice: An analysis of frameworks. Sevilla: JRC IPTS. https://doi.org/10.2791/82116. Ferrari, A. (2013). DIGCOMP: A framework for developing and understanding digital competence in Europe. Publications Office of the European Union. Garrett, R. K., & Danziger, J. N. (2007). Which telework? Defining and testing a taxonomy of technology-mediated work at a distance. Social Science Computer Review, 25(1), 27–47 Gilbert, N. (2019). 20 Best Office Software Solutions in 2019. FinancesOnline. https://financesonline.com/office-software/. Global Entrepreneurship Monitor. (2018). Retrieved October 28, 2019, from https://www.gemconsortium.org/report/50012. Greiff, S., Wüstenberg, S., & Avvisati, F. (2015). Computer-generated log-file analyses as a window into students’ minds? A showcase study based on the PISA 2012 assessment of problem solving. Computers & Education, 91, 92–105 Guillén-Gámez, F. D., Mayorga-Fernández, M. J., & Álvarez-García, F. J. (2018). A study on the actual use of digital competence in the practicum of education degree. (pp. 1–18). Technology. Haddon, L., & Brynin, M. (2005). The character of telework and the characteristics of teleworkers. New Technology, Work and Employment, 20(1), 34–46 Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15(3), 309–333 Handel, M. J. (2016). The O* NET content model: Strengths and limitations. Journal for Labour Market Research, 49(2), 157–176 Hair, N., Wetsch, L.R., Hull, C.E., Perotti, V. & Hung, Y.T.C. (2012). Market orientation in digital entrepreneurship: advantages and challenges in a Web 2.0 networked world. International Journal of Innovation and Technology Management, Vol. 9 No. 6, pp. 1–17. Harmer, B. M., & Pauleen, D. J. (2012). Attitude, aptitude, ability and autonomy: The emergence of ‘offroaders’, a special class of nomadic worker. Behaviour & Information Technology, 31(5), 439–451 Hayter, C. S., Lubynsky, R., & Maroulis, S. (2017). Who is the academic entrepreneur? The role of graduate students in the development of university spinoffs. The Journal of Technology Transfer, 42(6), 1237–1254 Hull, C. E., Hung, Y.-T.C., Hair, N., Perotti, V., & De Martino, R. (2007). Taking advantage of digital opportunities: a typology of digital entrepreneurship. International Journal of Networking and Virtual Organisations, 4(3), 290–303 IC3 (n.d.). Certiport Internet and Computing Core Certification. Retrieved October 28, 2019, from https://certiport.pearsonvue.com/Certifications/IC3/. IKANOSTEST (n.d.). Digital competences self-diagnosis test. Retrieved October 28, 2019, from https://www.ikanos.eus/en/. Iñiguez-Berrozpe, T., & Boeren, E. (2019). Twenty-first century skills for all: Adults and problem solving in technology rich environments. (pp. 1–23). Technology. ICDL (n.d.) International Computer Drivers Licence. Retrieved October 28, 2019, from https://icdl.org/. Janssen, J., Stoyanov, S., Ferrari, A., Punie, Y., Pannekeet, K., & Sloep, P. (2013). Experts’ views on digital competence: Commonalities and differences. Computers and Education, 68, 473–481. https://doi.org/10.1016/j.compedu.2013.06.008 Kluzer, S., & Priego, L. P. (2018). DigComp into action: Get inspired, make it happen. A user guide to the European Digital Competence Framework (No. JRC110624). Joint Research Centre (Seville site). Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121 Kuo, C. Y., & Wu, H. K. (2013). Toward an integrated model for designing assessment systems: An analysis of the current status of computer-based assessments in science. Computers & Education, 68, 388–403 Laanpere, M. (2019). Recommendations on Assessment tools for monitoring digital literacy within UNESCO's Digital Literacy Global Framework. Information Paper No, 56. Law, N. W. Y., Woo, D. J., de la Torre, J., & Wong, K. W. G. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4. 2. Litchfield, B. C., & Dempsey, J. V. (2015). Authentic assessment of knowledge, skills, and attitudes. New Directions for Teaching and Learning, 142(142), 65–80 Mahler, J. (2012). The telework divide: Managerial and personnel challenges of telework. Review of Public Personnel Administration, 32(4), 407–418 Marsh, E. (2018). Understanding the effect of digital literacy on employees’ digital workplace continuance intentions and individual performance. International Journal of Digital Literacy and Digital Competence (IJDLDC), 9(2), 15–33 McCallum, E., Weicht, R., McMullan, L., & Price, A. (2018). EntreComp into action-Get inspired, make it happen: A user guide to the European Entrepreneurship Competence Framework (No. JRC109128). Joint Research Centre (Seville site). McIntyre, D. P., & Srinivasan, A. (2017). Networks, platforms, and strategy: Emerging views and next steps. Strategic management journal, 38(1), 141–160 Microsoft Digital Literacy Standard Curriculum (n.d.). Retrieved October 28, 2019, from https://www.microsoft.com/es/digitalliteracy/curriculum4.aspx. Millán, J. M., Lyalkov, S., Burke, A., Millán, A., & van Stel, A. (2019). ‘Digital divide’ among European entrepreneurs: Which types benefit most from ICT implementation?. Journal of Business Research. Mohammadyari, S., & Singh, H. (2015). Understanding the effect of e-learning on individual performance: The role of digital literacy. Computers & Education, 82, 11–25 MuSA (n.d.). Museum Sector Alliance project. Retrieved October 28, 2019, from http://www.project-musa.eu. Nambisan, S. (2017). Digital entrepreneurship: Toward a digital technology perspective of entrepreneurship. Entrepreneurship Theory and Practice, 41(6), 1029–1055 Nambisan, S., Siegel, D., & Kenney, M. (2018). On open innovation, platforms, and entrepreneurship. Strategic Entrepreneurship Journal, 12(3), 354–368 Newman, D. (2016). Is mobility the answer to better employee productivity? Forbes. https://www.forbes.com/sites/danielnewman/2016/03/29/is-mobility-the-answer-to-better-employee-productivity/#7075a0ce131c. Oggero, N., Rossi, M. C., & Ughetto, E. (2019). Entrepreneurial spirits in women and men. The role of financial literacy and digital skills. Small Business Economics, 1–15. Olsson, A. K., & Bernhard, I. (2020). Keeping up the pace of digitalization in small businesses–Women entrepreneurs' knowledge and use of social media. International Journal of Entrepreneurial Behavior & Research. Organisation for Economic Co-operation and Development (OECD). (2019). OECD skills outlook 2019: Thriving in a digital world. OECD. Osborne, R., Dunne, E., & Farrand, P. (2013). Integrating technologies into ‘‘authentic’’assessment design: an affordances approach. Research in Learning Technology, 21. Pajares, F., & Graham, L. (1999). Self-efficacy, motivation constructs, and mathematics performance of entering middle school students. Contemporary educational psychology, 24(2), 124–139 Peterson, N. G., Mumford, M. D., Borman, W. C., Jeanneret, P. R., Fleishman, E. A., Levin, K. Y., & Gowing, M. K. (2001). Understanding work using the Occupational Information Network (O* NET): Implications for practice and research. Personnel Psychology, 54(2), 451–492 PIX. (n.d.). Online platform for digital skills evaluation and certification. Retrieved October 28, 2019, from https://pix.fr/. Plath, J., & Leiss, D. (2018). The impact of linguistic complexity on the solution of mathematical modelling tasks. ZDM Mathematics Education, 50(1–2), 159–171 REACT. (n.d.). Reinforcing Entrepreneurship in Adults through Communication Technologies. Retrieved October 28, 2019, from https://www.reactproject.online/. Sahut, J. M., Iandoli, L., & Teulon, F. (2019). The age of digital entrepreneurship. Small Business Economics, 1–11. Schallenmueller, S. (2016). Smart workplace technology buzz. In the impact of ICT on work (pp. 127–150). Springer, Singapore. Schwab, K. (2018). The Future of Jobs Report. (pp. 1–133). World Economic Forum. Scuotto, V., & Morellato, M. (2013). Entrepreneurial knowledge and digital competence: Keys for a success of student entrepreneurship. Journal of the Knowledge Economy, 4(3), 293–303 Shute, V. J., & Rahimi, S. (2017). Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1), 1–19 Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016). Taking a future perspective by learning from the past—A systematic review of assessment instruments that aim to measure primary and secondary school students’ ICT literacy. Educational Research Review, 19, 58–84 Siegel, K., & Hadi, K. (2017). Articulate Storyline 3 & 360: The Essentials. IconLogic. Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107 SMARTIVEMAP. (n.d.). A digital competence mapping tool to start digital transformation. Retrieved October 28, 2019, from https://www.smartive.company/smartivemap-test-en. Sostero, M., Milasi, S., Hurley, J., Fernandez-Macias, E., & Bisello, M. (2020). Teleworkability and the COVID-19 crisis: a new digital divide?. European Commission, Seville, JRC121193. Sparks, J. R., Katz, I. R., & Beile, P. M. (2016). Assessing digital information literacy in higher education: A review of existing frameworks and assessments with recommendations for next-generation assessment. ETS Research Report Series, 2016(2), 1–33 Srinivasan, A., & Venkatraman, N. (2018). Entrepreneurship in digital platforms: A network-centric view. Strategic Entrepreneurship Journal, 12(1), 54–71 Steininger, D. M. (2019). Linking information systems and entrepreneurship: A review and agenda for IT-associated and digital entrepreneurship research. Information Systems Journal, 29(2), 363–407 Stödberg, U. (2012). A research review of e-assessment. Assessment & Evaluation in Higher Education, 37(5), 591–604 Sussan, F., & Acs, Z. J. (2017). The digital entrepreneurial ecosystem. Small Business Economics, 49(1), 59–73 The Digital Skills Gap in Europe. (2017). Factsheets. Digital skills in Europe. http://ec.europa.eu/newsroom/dae/document.cfm?doc_id=47880. Accessed October 28, 2019. Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assessment in a digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3), 454–476 TUCERTICYL. (n.d.). The new digital competence certification system in Castilla León. Retrieved October 28, 2019, from https://tucerticyl.es/. UNESCO Institute for Statistics (UIS). (2019). Recommendations on assessment tools for monitoring digital literacy within UNESCO's Digital Literacy Global Framework. Van Deursen, A. J., & Helsper, E. J. (2015). The third-level digital divide: Who benefits most from being online?. In Communication and information technologies annual (pp. 29–52). Emerald Group Publishing Limited. Van Deursen, A. J., Helsper, E. J., & Eynon, R. (2016). Development and validation of the Internet Skills Scale (ISS). Information, Communication & Society, 19(6), 804–823 Vargas-Llave, O., Mandl, I., Weber, T., & Wilkens, M. (2020). Telework and ICT-based mobile work: Flexible working in the digital age. Publications Office of the European Union. Voogt, J., Erstad, O., Dede, C., & Mishra, P. (2013). Challenges to learning and schooling in the digital networked world of the 21st century. Journal of Computer Assisted Learning, 29(5), 403–413. https://doi.org/10.1111/jcal.12029 Voogt, J., & Roblin, N. P. (2012). A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. Journal of Curriculum Studies, 44(3), 299–321 Vuorikari, R., Punie, Y., Carretero Gomez S., Van den Brande, G. (2016). DigComp 2.0: The Digital Competence Framework for Citizens. Update Phase 1: The Conceptual Reference Model (No. JRC101254). Joint Research Centre (Seville site). World Economic Forum. (2017). Accelerating workforce reskilling for the fourth industrial revolution: An agenda for leaders to shape the future of education, gender and work. World Economic Forum. WOW. (n.d.). We are dreamers, we are shapers, we are what we want to be!. Retrieved October 28, 2019, from https://uwawme.eu/. Yunis, M., Tarhini, A., & Kassar, A. (2018). The role of ICT and innovation in enhancing organizational performance: the catalysing effect of corporate entrepreneurship. Journal of Business Research, 88, 344–356 Zamfir, A. M., & Aldea, A. B. (2020). Digital Skills and Labour Market Resilience. Postmodern Openings/Deschideri Postmoderne, 11.