Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
DE
EN
Books
Journals
Events
Topic Page
Marketing
Log in
Learn more about individual access
Request company access
Electric Powertrains and Energy Systems 2025 | 26 + 27 March 2025

19th International MTZ Congress on Future Powertrains

Take this opportunity to attend the conference. Experts from the automotive industry, energy providers, and grid operators will meet up with representatives from politics and science to discuss important topics for this sector.
EXTENDED SEARCH
Log in
Top
Technology, Knowledge and Learning
Published in:

29-04-2021 | Original research

A Pragmatic Approach for Evaluating and Accrediting Digital Competence of Digital Profiles: A Case Study of Entrepreneurs and Remote Workers

Authors: Juan Bartolomé, Pablo Garaizar, Xabier Larrucea

Published in: Technology, Knowledge and Learning | Issue 3/2022

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

During the last decades, digital competence has become essential at workplace. Nowadays, it is difficult to find a job where no ICT skills are required. At the same time, there is a lack of ecosystems for adult reskilling in digital competence. Moreover, most of them do not use of a common language and terminology, decreasing the possibilities of being used by a wider public. In addition, the assessment of digital competence cannot be done using simple self-assessment tests, but more complex tools such as simulations or other activities based on real scenarios. Considering this, we designed a performance-based evaluation system following a pragmatic approach based on DigComp framework. We carried out a needs analysis based on expert consultation (63 teleworkers and 82 entrepreneurs) to create an assessment syllabus and implement the assessment modules. Then, we conducted an analysis by experts (n = 21) of the relationship between the content of the tests and the construct it was intended to measure. After refinement, the system was piloted by end-users all over Europe (n = 525). Results confirmed that DigComp was the most appropriate reference when considering the transversality of digital competence, providing researchers with well-defined clear criteria.
previous article The Patterns of School Improvement in Digitally Innovative Schools
next article Methodological Elements for the Implementation of Data Acquisition Systems as Support for Experimental Activity in the Physics Teaching

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now
Appendix
Available only for authorised users
Literature
Abedi, J. (2006). Language issues in item development. Handbook of test development, 377–398.
Abedi, J., & Lord, C. (2001). The language factor in mathematics tests. Applied Measurement in Education, 14(3), 219–234CrossRef
Aesaert, K., Van Nijlen, D., Vanderlinde, R., & van Braak, J. (2014). Direct measures of digital information processing and communication skills in primary education: Using item response theory for the development and validation of an ICT competence scale. Computers & Education, 76, 168–181CrossRef
Aesaert, K., Voogt, J., Kuiper, E., & van Braak, J. (2017). Accuracy and bias of ICT self-efficacy: An empirical study into students’ over-and underestimation of their ICT competences. Computers in Human Behavior, 75, 92–102CrossRef
Ala-Mutka, K. (2011). Mapping digital competence: Towards a conceptual understanding. Sevilla: Institute for Prospective Technological Studies, 7-60.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education, Joint Committee on Standards for Educational, & Psychological Testing (US). (1999). Standards for educational and psychological testing. Amer Educational Research Assn.
Autor, D. H. (2015). Why are there still so many jobs? The history and future of workplace automation. Journal of Economic Perspectives, 29(3), 3–30CrossRef
Bacigalupo, M., Kampylis, P., Punie, Y., & Van den Brande, G. (2016). EntreComp: The entrepreneurship competence framework. Luxembourg: Publication Office of the European Union, 10, 593884
Baruch, A. F., & Erstad, O. (2018). Upbringing in a digital world: Opportunities and possibilities. Technology, Knowledge and Learning, 23(3), 377–390CrossRef
Beliaeva, T., Ferasso, M., Kraus, S., & Damke, E. J. (2019). Dynamics of digital entrepreneurship and the innovation ecosystem. International Journal of Entrepreneurial Behavior & Research.
Bennett, R. E., & Bejar, I. I. (1998). Validity and automad scoring: It’s not only the scoring. Educational Measurement: Issues and Practice, 17(4), 9–17CrossRef
Bi, R., Davison, R. M., & Smyrnios, K. X. (2017). E-business and fast growth SMEs. Small Business Economics, 48(3), 559–576CrossRef
Binkley, M., Erstad, O., Herman, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining twenty-first century skills. In Assessment and teaching of 21st century skills (pp. 17–66). Springer, Dordrecht.
Carretero, S., Vuorikari, R., & Punie, Y. (2017). DigComp 2.1: The Digital Competence Framework for Citizens. Publications Office of the European Union.
Cascio, W. F., & Montealegre, R. (2016). How technology is changing work and organizations. Annual Review of Organizational Psychology and Organizational Behavior, 3, 349–375CrossRef
Colbert, A., Yee, N., & George, G. (2016). The digital workforce and the workplace of the future.
de Macêdo, T. A. M., Cabral, E. L. D. S., Silva Castro, W. R., de Souza Junior, C. C., da Costa Junior, J. F., Pedrosa, F. M., & Másculo, F. S. (2020). Ergonomics and telework: A systematic review. Work, (Preprint), 1–11.
Dhaliwal, A., & Sahay, A. (2020). Factors influencing the success of women entrepreneurs in Emerging Markets: A Study of Indian women entrepreneurs. Journal of Asia Entrepreneurship and Sustainability, 16(2), 21–72
Dingel, J. I., & Neiman, B. (2020). How many jobs can be done at home? (No. w26948). National Bureau of Economic Research.
Durkin, M., McGowan, P., & McKeown, N. (2013). Exploring social media adoption in small to medium-sized enterprises in Ireland. Journal of Small Business and Enterprise Development.
EC. (2015). A Digital Single Market Strategy for Europe—Analysis and Evidence—Commission Staff Working Document.
Engelhardt, L., Goldhammer, F., Naumann, J., & Frey, A. (2017). Experimental validation strategies for heterogeneous computer-based assessment items. Computers in Human Behavior, 76, 683–692CrossRef
Eurofound, . (2016). What do Europeans do at work? A task-based analysis: European Jobs Monitor 2016. Publications Office of the European Union.
Eurofound and the International Labour Office (2017), Working anytime, anywhere: The effects on the world of work, Publications Office of the European Union, Luxembourg, and the International Labour Office, Geneva.
European Commission. (2016). A new skills agenda for Europe: Working together to strengthen human capital, employability and competitiveness.
European Parliament and the Council. (2006). Recommendation of the European Parliament and of the Council of 18 December 2006 on key competences for lifelong learning. Official Journal of the European Union, L394/310.
European Parliament and the Council. (2008b). Recommendation of the European Parliament and of the Council on the establishment of the European Qualifications Framework for lifelong learning. Official Journal of the European Union, C111/111.
Evangelinos, G., & Holley, D. (2014). Developing a digital competence self-assessment toolkit for nursing students. In Proceedings of the EDEN 2014 annual conference, from education to employment and meaningful work with ICT E-learning at work and the workplace.
Evans, D. S., & Schmalensee, R. (2016). Matchmakers: The new economics of multisided platforms. Harvard Business Review Press.
Felstead, A., & Henseke, G. (2017). Assessing the growth of remote working and its consequences for effort, well-being and work-life balance. New Technology, Work and Employment, 32(3), 195–212CrossRef
Ferrari, A. (2013). DIGCOMP: A framework for developing and understanding digital competence in Europe. Publications Office of the European Union.
Garrett, R. K., & Danziger, J. N. (2007). Which telework? Defining and testing a taxonomy of technology-mediated work at a distance. Social Science Computer Review, 25(1), 27–47CrossRef
Greiff, S., Wüstenberg, S., & Avvisati, F. (2015). Computer-generated log-file analyses as a window into students’ minds? A showcase study based on the PISA 2012 assessment of problem solving. Computers & Education, 91, 92–105CrossRef
Guillén-Gámez, F. D., Mayorga-Fernández, M. J., & Álvarez-García, F. J. (2018). A study on the actual use of digital competence in the practicum of education degree. (pp. 1–18). Technology.
Haddon, L., & Brynin, M. (2005). The character of telework and the characteristics of teleworkers. New Technology, Work and Employment, 20(1), 34–46CrossRef
Haladyna, T. M., Downing, S. M., & Rodriguez, M. C. (2002). A review of multiple-choice item-writing guidelines for classroom assessment. Applied Measurement in Education, 15(3), 309–333CrossRef
Handel, M. J. (2016). The O* NET content model: Strengths and limitations. Journal for Labour Market Research, 49(2), 157–176CrossRef
Hair, N., Wetsch, L.R., Hull, C.E., Perotti, V. & Hung, Y.T.C. (2012). Market orientation in digital entrepreneurship: advantages and challenges in a Web 2.0 networked world. International Journal of Innovation and Technology Management, Vol. 9 No. 6, pp. 1–17.
Harmer, B. M., & Pauleen, D. J. (2012). Attitude, aptitude, ability and autonomy: The emergence of ‘offroaders’, a special class of nomadic worker. Behaviour & Information Technology, 31(5), 439–451CrossRef
Hayter, C. S., Lubynsky, R., & Maroulis, S. (2017). Who is the academic entrepreneur? The role of graduate students in the development of university spinoffs. The Journal of Technology Transfer, 42(6), 1237–1254CrossRef
Hull, C. E., Hung, Y.-T.C., Hair, N., Perotti, V., & De Martino, R. (2007). Taking advantage of digital opportunities: a typology of digital entrepreneurship. International Journal of Networking and Virtual Organisations, 4(3), 290–303CrossRef
Iñiguez-Berrozpe, T., & Boeren, E. (2019). Twenty-first century skills for all: Adults and problem solving in technology rich environments. (pp. 1–23). Technology.
Kluzer, S., & Priego, L. P. (2018). DigComp into action: Get inspired, make it happen. A user guide to the European Digital Competence Framework (No. JRC110624). Joint Research Centre (Seville site).
Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77(6), 1121CrossRef
Kuo, C. Y., & Wu, H. K. (2013). Toward an integrated model for designing assessment systems: An analysis of the current status of computer-based assessments in science. Computers & Education, 68, 388–403CrossRef
Laanpere, M. (2019). Recommendations on Assessment tools for monitoring digital literacy within UNESCO's Digital Literacy Global Framework. Information Paper No, 56.
Law, N. W. Y., Woo, D. J., de la Torre, J., & Wong, K. W. G. (2018). A Global Framework of Reference on Digital Literacy Skills for Indicator 4.4. 2.
Litchfield, B. C., & Dempsey, J. V. (2015). Authentic assessment of knowledge, skills, and attitudes. New Directions for Teaching and Learning, 142(142), 65–80CrossRef
Mahler, J. (2012). The telework divide: Managerial and personnel challenges of telework. Review of Public Personnel Administration, 32(4), 407–418CrossRef
Marsh, E. (2018). Understanding the effect of digital literacy on employees’ digital workplace continuance intentions and individual performance. International Journal of Digital Literacy and Digital Competence (IJDLDC), 9(2), 15–33CrossRef
McCallum, E., Weicht, R., McMullan, L., & Price, A. (2018). EntreComp into action-Get inspired, make it happen: A user guide to the European Entrepreneurship Competence Framework (No. JRC109128). Joint Research Centre (Seville site).
McIntyre, D. P., & Srinivasan, A. (2017). Networks, platforms, and strategy: Emerging views and next steps. Strategic management journal, 38(1), 141–160CrossRef
Millán, J. M., Lyalkov, S., Burke, A., Millán, A., & van Stel, A. (2019). ‘Digital divide’ among European entrepreneurs: Which types benefit most from ICT implementation?. Journal of Business Research.
Mohammadyari, S., & Singh, H. (2015). Understanding the effect of e-learning on individual performance: The role of digital literacy. Computers & Education, 82, 11–25CrossRef
Nambisan, S. (2017). Digital entrepreneurship: Toward a digital technology perspective of entrepreneurship. Entrepreneurship Theory and Practice, 41(6), 1029–1055CrossRef
Nambisan, S., Siegel, D., & Kenney, M. (2018). On open innovation, platforms, and entrepreneurship. Strategic Entrepreneurship Journal, 12(3), 354–368CrossRef
Oggero, N., Rossi, M. C., & Ughetto, E. (2019). Entrepreneurial spirits in women and men. The role of financial literacy and digital skills. Small Business Economics, 1–15.
Olsson, A. K., & Bernhard, I. (2020). Keeping up the pace of digitalization in small businesses–Women entrepreneurs' knowledge and use of social media. International Journal of Entrepreneurial Behavior & Research.
Organisation for Economic Co-operation and Development (OECD). (2019). OECD skills outlook 2019: Thriving in a digital world. OECD.
Osborne, R., Dunne, E., & Farrand, P. (2013). Integrating technologies into ‘‘authentic’’assessment design: an affordances approach. Research in Learning Technology, 21.
Pajares, F., & Graham, L. (1999). Self-efficacy, motivation constructs, and mathematics performance of entering middle school students. Contemporary educational psychology, 24(2), 124–139CrossRef
Peterson, N. G., Mumford, M. D., Borman, W. C., Jeanneret, P. R., Fleishman, E. A., Levin, K. Y., & Gowing, M. K. (2001). Understanding work using the Occupational Information Network (O* NET): Implications for practice and research. Personnel Psychology, 54(2), 451–492CrossRef
Plath, J., & Leiss, D. (2018). The impact of linguistic complexity on the solution of mathematical modelling tasks. ZDM Mathematics Education, 50(1–2), 159–171CrossRef
Sahut, J. M., Iandoli, L., & Teulon, F. (2019). The age of digital entrepreneurship. Small Business Economics, 1–11.
Schallenmueller, S. (2016). Smart workplace technology buzz. In the impact of ICT on work (pp. 127–150). Springer, Singapore.
Schwab, K. (2018). The Future of Jobs Report. (pp. 1–133). World Economic Forum.
Scuotto, V., & Morellato, M. (2013). Entrepreneurial knowledge and digital competence: Keys for a success of student entrepreneurship. Journal of the Knowledge Economy, 4(3), 293–303CrossRef
Shute, V. J., & Rahimi, S. (2017). Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1), 1–19CrossRef
Siddiq, F., Hatlevik, O. E., Olsen, R. V., Throndsen, I., & Scherer, R. (2016). Taking a future perspective by learning from the past—A systematic review of assessment instruments that aim to measure primary and secondary school students’ ICT literacy. Educational Research Review, 19, 58–84CrossRef
Siegel, K., & Hadi, K. (2017). Articulate Storyline 3 & 360: The Essentials. IconLogic.
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema, 26(1), 100–107
Sostero, M., Milasi, S., Hurley, J., Fernandez-Macias, E., & Bisello, M. (2020). Teleworkability and the COVID-19 crisis: a new digital divide?. European Commission, Seville, JRC121193.
Sparks, J. R., Katz, I. R., & Beile, P. M. (2016). Assessing digital information literacy in higher education: A review of existing frameworks and assessments with recommendations for next-generation assessment. ETS Research Report Series, 2016(2), 1–33CrossRef
Srinivasan, A., & Venkatraman, N. (2018). Entrepreneurship in digital platforms: A network-centric view. Strategic Entrepreneurship Journal, 12(1), 54–71CrossRef
Steininger, D. M. (2019). Linking information systems and entrepreneurship: A review and agenda for IT-associated and digital entrepreneurship research. Information Systems Journal, 29(2), 363–407CrossRef
Stödberg, U. (2012). A research review of e-assessment. Assessment & Evaluation in Higher Education, 37(5), 591–604CrossRef
Sussan, F., & Acs, Z. J. (2017). The digital entrepreneurial ecosystem. Small Business Economics, 49(1), 59–73CrossRef
Timmis, S., Broadfoot, P., Sutherland, R., & Oldfield, A. (2016). Rethinking assessment in a digital age: Opportunities, challenges and risks. British Educational Research Journal, 42(3), 454–476CrossRef
UNESCO Institute for Statistics (UIS). (2019). Recommendations on assessment tools for monitoring digital literacy within UNESCO's Digital Literacy Global Framework.
Van Deursen, A. J., & Helsper, E. J. (2015). The third-level digital divide: Who benefits most from being online?. In Communication and information technologies annual (pp. 29–52). Emerald Group Publishing Limited.
Van Deursen, A. J., Helsper, E. J., & Eynon, R. (2016). Development and validation of the Internet Skills Scale (ISS). Information, Communication & Society, 19(6), 804–823CrossRef
Vargas-Llave, O., Mandl, I., Weber, T., & Wilkens, M. (2020). Telework and ICT-based mobile work: Flexible working in the digital age. Publications Office of the European Union.
Voogt, J., & Roblin, N. P. (2012). A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. Journal of Curriculum Studies, 44(3), 299–321CrossRef
Vuorikari, R., Punie, Y., Carretero Gomez S., Van den Brande, G. (2016). DigComp 2.0: The Digital Competence Framework for Citizens. Update Phase 1: The Conceptual Reference Model (No. JRC101254). Joint Research Centre (Seville site).
World Economic Forum. (2017). Accelerating workforce reskilling for the fourth industrial revolution: An agenda for leaders to shape the future of education, gender and work. World Economic Forum.
Yunis, M., Tarhini, A., & Kassar, A. (2018). The role of ICT and innovation in enhancing organizational performance: the catalysing effect of corporate entrepreneurship. Journal of Business Research, 88, 344–356CrossRef
Zamfir, A. M., & Aldea, A. B. (2020). Digital Skills and Labour Market Resilience. Postmodern Openings/Deschideri Postmoderne, 11.
Metadata
Title
A Pragmatic Approach for Evaluating and Accrediting Digital Competence of Digital Profiles: A Case Study of Entrepreneurs and Remote Workers
Authors
Juan Bartolomé
Pablo Garaizar
Xabier Larrucea
Publication date
29-04-2021
Publisher
Springer Netherlands
Published in
Technology, Knowledge and Learning / Issue 3/2022
Print ISSN: 2211-1662
Electronic ISSN: 2211-1670
DOI
https://doi.org/10.1007/s10758-021-09516-3

Other articles of this Issue 3/2022

Towards an Institutional Blended Learning Adoption Model for Higher Education Institutions

  • Original research

The Promises and Pitfalls of Self-regulated Learning Interventions in MOOCs

  • Original research

Methodological Elements for the Implementation of Data Acquisition Systems as Support for Experimental Activity in the Physics Teaching

  • Original research

MOOCs in STEM Education: Teacher Preparation and Views

  • Original research

Details Matter: How Contrasting Design Features in Two MUVEs Impact Learning Outcomes

  • Original research

Usable and Useful Help in Literature Database Search? A Pedagogical Implementation and the Evaluation of an Interactive Screencast for Iraqi University Students

  • Open Access
  • Original research

Premium Partners

    Image Credits