Comparative European DigCompEdu Framework (JRC) and Common Framework for Teaching Digital Competence (INTEF) through expert judgment

Quadro Comparativo Europeu DigCompEdu (JRC) e Quadro Comum para o Ensino de Competência Digital (INTEF) por meio de opinião de especialistas

Abstract

Digital technology, as one of the elements of the Knowledge Society, assumes a determining role in educational systems, where the role of teachers is fundamental. Along these lines, different institutions support the importance of teaching digital skills, proposing models and conceptual frameworks. In them, the knowledge and skills that teachers must develop are classified, combining technological, professional, organizational and pedagogical capacities, with different dimensions and descriptors. The objective of this article is to compare and evaluate the feasibility of the DigCompEdu European Digital Competence Framework for Teachers (JRC) and the Common Framework for Teaching Digital Competence (INTEF). To do this, it is decided to carry out a theoretical reflection on said frameworks and a subsequent Delphi study with the coefficient of expert competence (CEC). 335 people participated, of which 275 (82.1%) were considered experts (CEC ≥ 0.8). The results indicate that, although they are very similar, the European DigCompEdu Teaching Digital Competence Framework is the most endorsed by experts. Finally, the idea that both are viable proposals to develop teaching digital skills through personalized training itineraries is presented.

Keywords:
Teaching digital competence; DigCompEdu; Evaluation; Delphi

Resumo

A tecnologia digital, como um dos elementos da Sociedade do Conhecimento, assume um papel determinante nos sistemas educativos, onde o papel do professor é fundamental. Nesse sentido, diferentes instituições defendem a importância do ensino de competências digitais, propondo modelos e marcos conceituais. Neles, classificam-se os conhecimentos e as competências que os professores devem desenvolver, combinando capacidades tecnológicas, profissionais, organizacionais e pedagógicas, com diferentes dimensões e descritores. O objetivo deste artigo é comparar e avaliar a viabilidade do DigCompEdu European Digital Competence Framework for Teachers (JRC) e do Common Framework for Teaching Digital Competence (INTEF). Para tal, opta-se por realizar uma reflexão teórica sobre os referidos enquadramentos e posterior estudo Delphi com o coeficiente de competência do perito (CCP). Participaram 335 pessoas, das quais 275 (82,1%) foram consideradas especialistas (CCP ≥ 0,8). Os resultados indicam que, embora sejam muito semelhantes, o European DigCompEdu Teaching Digital Competence Framework é o mais endossado por especialistas. Por fim, apresenta-se a ideia de que ambas são propostas viáveis para desenvolver o ensino de competências digitais por meio de roteiros de treinamento personalizados.

Palavras-chave:
Ensino de competência digital; DigCompEdu; Avaliação; Delphi

1 Introduction

One of the radical transformations that has taken place in education has come as a consequence of the strong presence that Information and Communication Technologies are having in these institutions.

But, unfortunately, this presence has not always been accompanied, regardless of educational level, by training plans (OTERO; MORANTE; LÓPEZ, 2018; SUÁREZ-RODRÍGUEZ et al., 2018; SILVA et al., 2019). As some authors have pointed out, many times they have even been given little importance (BERNAL-BRAVO et al., 2019). Other studies affirm that even this phenomenon occurs for those who in the future would dedicate themselves to teaching (BERNAL-BRAVO et al., 2019).

The reasons pointed out by teachers for their low training do not refer to interest in ICT, but rather as a consequence of lack of institutional support, time, lack of resources and the non-existence of training plans (MÁRQUEZ; LEIVA-OLIVENCIA; LÓPEZ-MENESES, 2018). On the other hand, when the training has been carried out, it has been carried out under models focused more on instrumental and technological aspects than on pedagogical and didactic dimensions (SEMERCI; AYDIN, 2018; CABERO ALMENARA; MARTÍNEZ GIMENO, 2019).

This aspect leads to coining terms such as Digital Teaching Competence (DTC). This concept does not refer exclusively to training processes focused on the mere instrumental management of technologies. The European Union (2018) points out that this is one of the key competences that citizens must master in general and teachers specifically in the Knowledge Society.

Such is the significance that the DTC theme is acquiring, which is becoming a consolidated line of research in the Spanish scientific context (RODRÍGUEZ-GARCÍA; SÁNCHEZ; RUIZ-PALMERO, 2019). This ranges from its description to the search for diagnostic instruments (ESTEVE-MON; GISBERT-CERVERA; LÁZARO-CANTABRANA, 2016; DURÁN CUARTERO; PRENDES ESPINOSA; GUTIÉRREZ PORLÁN, 2019; INTEF, 2017; PADILLA-HERNÁNDEZ; GÁMIZ-SÁNCHEZ; ROMERO-LÓPEZ, 2019), and their certification (DURÁN CUARTERO; PRENDES ESPINOSA; GUTIÉRREZ PORLÁN, 2019; AMAYA AMAYA et al., 2018; GUDMUNDSDOTTIR; HATLEVIK, 2017).

In general, the DTC can be understood as that set of knowledge, skills or strategies of the teaching profession that allow solving the educational problems and challenges posed by the so-called Knowledge Society (PRENDES ESPINOSA; GUTIÉRREZ PORLÁN, 2011; CABERO-ALMENARA; BARROSO-OSUNA, et al., 2020). In short, as Durán Cuartero, Prendes Espinosa, and Gutiérrez Porlán (2019) point out, they are a set of knowledge, skills and attitudes necessary for a teacher to make effective use of ICT from its different aspects, assuming pedagogical-didactic criteria for an effective integration of the ICT in your teaching experience.

Throughout more than a decade, there have been many attempts to define indicators, standards or models that are considered essential in the Teaching Digital Competence (CABERO-ALMENARA; BARROSO-OSUNA, et al., 2020; CABERO-ALMENARA; ROMERO-TENA; PALACIOS-RODRÍGUEZ, 2020). In this article, those frameworks that can be considered the most used at the Spanish level have been selected (CABERO ALMENARA; MARTÍNEZ GIMENO, 2019; LÁZARO-CANTABRANA; USART-RODRÍGUEZ; GISBERT-CERVERA, 2019; PADILLA-HERNÁNDEZ; GÁMIZ-SÁNCHEZ; ROMERO-LÓPEZ, 2019; RODRÍGUEZ-GARCÍA; SÁNCHEZ; RUIZ-PALMERO, 2019; SILVA et al., 2019; CABERO-ALMENARA; PALACIOS-RODRÍGUEZ, 2019):

• European Framework for Teaching Digital Competence DigCompEdu (REDECKER; PUNIE, 2017).

• Common Framework for Teaching Digital Competence (INTEF, 2017).

1.1 European Framework of Digital Competence for Teaching DigCompEdu

The European Framework for Digital Teaching Competence DigCompEdu is designed by the Joint Research Center of the European Union or JRC (REDECKER; PUNIE, 2017) at the end of 2017. Its purpose is to unite European educational policies having said framework of reference. DigCompEdu is the product of a series of scientific studies carried out at the local, national, European and international levels (CABERO-ALMENARA; GUTIÉRREZ-CASTILLO, et al., 2020; GHOMI; REDECKER, 2019; REDECKER; PUNIE, 2017; REISOĞLU; ÇEBI, 2020). Furthermore, this framework is presented as a Digital Competence model with 6 differentiated competence areas (Figure 1).

Figure 1
DigCompEdu model.

Each area is associated with a series of competencies that teachers must possess in order to promote effective, inclusive and innovative learning strategies, using digital tools (REDECKER; PUNIE, 2017). Specifically, its areas are:

1. Professional engagement: focuses on teachers’ work environment.

2. Digital resources: related to the sources, creation and distribution of digital resources.

3. Teaching and learning: the fundamental competence of the whole “DigCompEdu” framework is knowing how to design, plan and implement the use of digital technologies in the different stages of the teaching and learning process.

4. Assesment: linked to the use of digital tools and strategies in the evaluation and improvement of teaching-learning processes.

5. Empowering learners: use of digital tools for the empowerment of students.

6. Facilitating learners´ digital competence: on how to develop and facilitate students’ Digital Competence.

In turn, DigCompEdu proposes six levels depending on the competence qualification (Figure 2). The most basic level is called Newcomer (A1), which would correspond to teachers with very little experience and contact with educational technology, and the highest, Pioneer (C2), where teachers who lead innovation with ICT would be found.

Figure 2
Proficiency levels of DigCompEdu.

1.2 Common Framework for Teaching Digital Competence

The Ministry of Education, Culture and Sport of Spain launches, through the National Institute of Educational Technologies and Teacher Training (INTEF), a project to define the Common Framework for Digital Teaching Competence. For this, it is based on the DigComp digital competence model, Digital Competence for Citizenship, defined by JRC (FERRARI, 2013; VUORIKARI et al., 2016; INTEF, 2017). Like DigCompEdu, it is a generic digital competence model for trainers, whose areas can be seen reflected in Figure 3.

Figure 3
INTEF model.

These areas can be summarized as:

1. Information and data literacy: identify, locate, retrieve, store, organize and analyze digital information, evaluating its purpose and relevance.

2. Communication and collaboration: communicate in digital environments, share resources through online tools, connect and collaborate with others through digital tools, interact and participate in communities and networks; intercultural awareness.

3. Digital content creation: create and edit new content (texts, images, videos …), integrate and rework previous knowledge and content, make artistic productions, multimedia content and computer programming, know how to apply intellectual property rights and licenses use.

4. Safety: personal protection, data protection, protection of digital identity, use of security, safe and sustainable use.

5. Problem solving: identifying needs and digital resources, making decisions when choosing the appropriate digital tool, according to the purpose or need, solving conceptual problems through digital means, solving technical problems, creative use of technology, update your own competence and that of others.

In addition, each area is associated with a series of competencies that are developed in Figure 4. Finally, six progressive levels of management skills are established. This structure is designed to identify a teacher’s level of digital competence. A progressive level of development and autonomy is established that starts from level A1 and continues up to the maximum level, C2.

Figure 4
Competences associated with the INTEF model.

Based on the comments, this article aims to compare and evaluate the DigCompEdu European Digital Competence Framework for Teachers (JRC) and the Common Framework for Teaching Digital Competence (INTEF).

2 Methodology

This research aims to compare and evaluate the DigCompEdu European Digital Competence Framework for Teachers (JRC) and the Common Framework for Teaching Digital Competence (INTEF). That is, to know their differences in content and evaluations regarding their suitability. To do this, two analysis techniques are combined:

1. Comparison of the content of the competence frameworks through crossed matrix.

2. Evaluation of the frames using Delphi design with coefficient of expert competence (CEC) and contrast study with effect size.

2.1 Expert judgment

The expert judgment basically consists of requesting a series of people to demand a judgment about an object, an instrument, a teaching material, or their opinion regarding a specific aspect (CABERO ALMENARA; CARMEN LLORENTE CEJUDO, 2013).

This strategy is increasingly widespread in educational research-evaluation (ROBLES GARROTE; CARMEN ROJAS, 2015; GALICIA ALARCÓN; BALDERRAMA TRÁPAGA; EDEL NAVARRO, 2017), and specifically in the type of studies that concern us (CABERO ALMENARA; CARMEN LLORENTE CEJUDO, 2013). In addition, it is closely associated with Delphi studies (LÓPEZ-GÓMEZ, 2017). The recurring problem with this method is that the concept of expert is quite polysemic. Therefore, there is no unambiguous conceptualization of it that helps to specify its defining characteristics. Therefore, the results obtained depend directly on the quality of the experts selected for the evaluation process. For this, there are different procedures that range from contemplating the profile of the selected expert to other more complex ones such as the CEC (CABERO ALMENARA; BARROSO OSUNA, 2013; ALMENARA; MORO, 2014; LÓPEZ-GÓMEZ, 2017).

In the present study, two mechanisms were established for their selection; First, we selected them taking into account that they met the following criteria:

• Teaching at Universities in the subjects of ”Educational Technology”, ”New Technologies applied to Education”, or ”Information and Communication Technologies Applied to Education”.

• To have experience in the field of teacher training in ICT.

• To have published an article on literacy in educational technology, digital skills, audiovisual literacy, in Spanish and Latin American magazines, in the last five years.

One of the problems associated with expert judgment concerns the number of experts required for the application. Most of the proposals range between 15 - 20 experts (MALLA; ZABALA, 1978) and 15 -35 (LANDETA RODRÍGUEZ, 2002). In this case, since there were problems working with a large database and only one round of evaluations was made, the decision is made to work with as many as possible.

2.2 Selection and profile of experts

The interest in refining the selection process of the final experts is carried out by applying the CEC (CABERO ALMENARA; BARROSO OSUNA, 2013; ALMENARA; MORO, 2014; LÓPEZ-GÓMEZ, 2017). This is obtained from the self-perception that the expert has about his level of knowledge regarding the subject analyzed, as well as from the sources that allow him to argue the decision adopted.

To obtain it, the formula is used: $K=\frac{1}{2}\left(Kc+Ka\right)$. Where Kc is the ”knowledge coefficient” and Ka is the argumentation coefficient.

The values used to determine the position of the expert are:

• 0.8 < K < 1.0 = high competition coefficient

• 0.5 < K < 0.8 = mean competition coefficient

• K < 0.5 = low coefficient of competition

The number of emails sent according to the criteria initially taken into account was 747.35 responses were received. Of the total responses and, after making the appropriate calculations, 275 experts have a K > 0.8, making up the sample of this study.

3 Resultados

3.1 Content analysis

Regarding the areas, unlike the Common Framework for Teaching Digital Competence published by INTEF which is divided into five areas, DigCompEdu is divided into six. It is not about a differentiation only in nomenclature, but in concepts and contents. The difference between the two frameworks is purely conceptual, since the Spanish framework strictly focuses on the digital competence of teaching staff, while the one published by JRC establishes other variables more focused on the digital competence of students or educational organizations.

Likewise, another fundamental difference between DigCompEdu and the Spanish Teaching Digital Competence Framework is that the latter includes 21 competencies while DigCompEdu raises them to 22. However, as can be seen in the following distribution comparison (Table 1); Although with different nomenclature, most of the competences published by the INTEF have been considered in DigCompEdu.

Table 1
Similarities between the DigCompEdu and INTEF model.

DigCompEdu	NTEF
6.1 Information and media literacy	1.1. Navigation, search and filtering of information, data and digital content
6.1. Information and media literacy	1.2. Evaluation of information, data and digital content
6.5. Digital troubleshooting	1.3. Storage and retrieval of information, data and digital content
1.1. Organizational communication	2.1. Interaction through digital technologies
3.2. Accompaniment
5.1. Accessibility and inclusion
5.2. Differentiation and customization
2.3. Manage, protect and share digital resources	2.2. Share information and digital content
5.3. Active students	2.3. Online citizen participation
6.2. Communication and digital collaboration
1.2. Professional collaboration	2.4. Collaboration through digital channels
3.4. Self-regulated learning
6.2. Communication and digital collaboration
6.4. Responsible use	2.5. Netiquette
It is not contemplated	2.6. Digital identity management
6.3. Creation of digital content	3.1. Development of digital content
2.2. Creation and modification of digital resources	3.2. Integration and reworking of digital content
3.1. Teaching
2.3. Organize, share and publish digital resources	3.3. Copyrights and licenses
6.3. Digital content creation
It is not contemplated	3.4. Programming
6.4. Responsible use	4.1. Device protection
6.4. Responsible use	4.2. Protection of personal data and digital identity
6.4. Responsible use	4.3. Health protection
It is not contemplated	4.4. Protection of the environment
6.5. Digital troubleshooting	5.1. Resolution of technical problems
5.1. Accessibility and inclusión	5.2. Identification of technological needs and responses
5.2. Differentiation and customization
3.4. Self-regulated learning	5.3. Innovation and creative use of digital technology
5.3. Active students
1.4. Continuous Digital Professional Development (CPD)	5.4. Identification of gaps in digital competence
3.4. Self-regulated learning

• Source: INTEF and JRC.

The only competencies in the Digital Teaching Competency Framework published by INTEF that are not mentioned in DigCompEdu are competencies 2.6., 3.4. and 4.4.

Finally, DigCompEdu establishes the same competency levels that are used in the INTEF model, being level A1 the most basic level and C2 the most advanced. Together, DigCompEdu assigns a role nomenclature. In the case of INTEF model, it is not applicable since its objective is to serve as the basis for an official certification of said competence; it is not a descriptive objective as in the case of DigCompEdu.

3.2 Expert judgment

It begins by presenting the means and standard deviations achieved for each frame, globally and in each of the dimensions (Tables 2 and 3). For a correct interpretation of the scores, it must be taken into account that the response scale used ranges from 1 = VN = Very negative / strongly disagree to 6 = VP = Very positive / Strongly agree.

Table 2
Expert judgment results: DigCompEdu.

DigCompEdu model	M	SD
Proffesional engagement: Ability to use digital technologies not only to im- prove teaching, but also to interact professionally with colleagues, students, family and different agents of the educational community. In addition, this communication through technology allows individual professional develop- ment and collective and continuous innovation in the educational organiza- tion.	5.670	0.55
Digital resources: Identify good educational resources. Additionally, you should be able to modify, create, and share them to suit your goals, learners, and teaching style. At the same time, you must know how to use and manage digital content responsibly, respecting copyright rules and protecting personal data.	5.675	0.55
Teaching and learning: Knowing how to design, plan and implement the use of digital technologies in the different stages of the teaching and learning process. In addition, a change in approaches and methodologies that are student-centered is advocated.	5.675	0.58
Assessment: Digital technologies can improve existing evaluation strategies and lead to new and better evaluation methods. Additionally, by analyzing the vast amount of (digital) data available on individual students’ (inter-) actions, teachers can offer more specific feedback and support.	5.520	0.67
Empowering learners: One of the key strengths of digital technologies in education is their potential to promote the active participation of students in the learning process and their autonomy over it. In addition, digital technologies can be used to offer learning activities tailored to each student’s level of competence, interests, and learning needs. However, care must be taken not to exacerbate existing inequalities (for example, in access to digital technologies) and to ensure accessibility for all students, including those with special learning needs.	5.550	0.68
Facilitating learners’ digital competence: The ability to facilitate students’ digital competence is an integral part of teachers’ digital competence and is the main theme of this competence area. The response options are organized by different levels of commitment to digital technologies.	5.655	0.55
TOTAL	5.625	0.40

• Source: Own elaboration.

Table 3
Expert judgment results: INTEF.

INTEF model	M	SD
Information and data literacy: Identify, locate, obtain, store, organize and analyze digital information, data and digital content, evaluating their purpose and relevance for teaching tasks.	5.475	0.71
Communication and collaboration: Communicate in digital environments, share resources through online tools, connect and collaborate with others through digital tools, interact and participate in communities and networks; intercultural awareness.	5.550	0.67
Digital content creation: Create and edit new digital content, integrate and rework previous knowledge and content, make artistic productions, multi- media content and computer programming, know how to apply intellectual property rights and licenses for use.	5.355	0.85
Safety: Protection of information and personal data, protection of digital identity, protection of digital content, security measures and responsible and safe use of technology.	5.385	0.86
Problem solving: Identify needs for the use of digital resources, make in- formed decisions about the most appropriate digital tools according to the purpose or need, solve conceptual problems through digital media, use tech- nologies creatively, solve technical problems, update their own competence and the of others.	5.465	0.76
TOTAL	5.450	0.58

• Source: Own elaboration.

The analysis of the scores achieved indicates three fundamental aspects:

1. In both frames the mean scores are very high. This denotes the high perceptions shown by the judges, regarding their usefulness.

2. The DigCompEdu model scores slightly higher than the INTEF model.

3. The low standard deviations indicate a strong agreement between the diversity of the answers offered by the judges.

Next, in order to know if there are statistically significant differences in the assessments made by the experts on the adequacy of the frameworks, the following hypotheses are formulated:

• H0 (null hypothesis): There are no significant differences between the assessments made by the experts, with an alpha risk of 0.05.

• H1 (alternative hypothesis): There are significant differences between the evaluations made by the experts, with an alpha risk of 0.05.

For this, the Wilcoxon signed rank test for related samples (SIEGEL, 1976) is used, as well as Cohen (1988) to analyze the effect size. These tests are applied to the total assessment of both models as it is not possible to make a comparison between areas. The results are presented in Table 4.

Table 4
Wilcoxon test and Cohen’s D.

Statistical	Value
W	11027,000
Standard error W	1319,665
Standardized test W	-6,023
Significance W	.000
Cohen’s D	.351

• Source: Own elaboration.

As can be seen, the results allow rejecting H0 (p ≤ .05). This indicates that there are significant differences between the assessments made by the experts. Considering the values of Cohen (1988), this difference is considered moderate.

4 Conclusions

The work allows to obtain a series of conclusions. First, the similarities and differences of the two proposed models are exposed: DigCompEdu and INTEF. Although the general structure is very similar, DigCompEdu establishes other variables focused on the digital competence of students or educational organizations. Second, the different frameworks and competencies that are incorporated within them have been positively scored by judges. This leads us to point out that they are well-consolidated proposals and that they serve to indicate to teachers the digital skills that they must develop to carry out their professional activity (FALLOON, 2020). At the same time, the assessments that different authors have made regarding the fact that the frameworks presented are those that have the greatest significance from an international perspective are confirmed (PRENDES ESPINOSA; GUTIÉRREZ PORLÁN, 2011; DURÁN CUARTERO; PRENDES ESPINOSA; GUTIÉRREZ PORLÁN, 2019; CABERO ALMENARA; MARTÍNEZ GIMENO, 2019; LÁZARO-CANTABRANA; USART-RODRÍGUEZ; GISBERT-CERVERA, 2019; RODRÍGUEZ-GARCÍA; SÁNCHEZ; RUIZ-PALMERO, 2019; SILVA et al., 2019; CABERO-ALMENARA; PALACIOS-RODRÍGUEZ, 2019; CABEZAS et al., 2020).

Another of the contributions of the work also allows to point out that there has been discrimination between the frames by the judges. In other words, the judges value the DigCompEdu model more significantly. Such finding will serve in the project that finances this study to approach the teacher training plan from the perspective selected by the judges, although they must also indicate to our institutions the guidelines on where to establish the training plans for teachers in DTC. In any case, it is important not to confuse the results with the fact that the INTEF model is not significant for acquiring DTC (PADILLA-HERNÁNDEZ; GÁMIZ-SÁNCHEZ; ROMERO-LÓPEZ, 2019). It is recalled that the results depend on expert judges and that the INTEF model has also been scored very positively.

The study presents a series of limitations that open future lines of research that must be considered. On the one hand, it should be noted that, although a very conscientious process has been used for the selection of experts, there is always doubt about the significance of their choice. Therefore, it is proposed to carry out research of a similar nature on the specific features of teaching in each discipline / subject: both university and non-university. The study can also be replicated in two or three rounds, this would require less use of experts and would require a prior commitment from them to participate in the research in a longer time.

Finally, as a future prospect, the results of this research can be used to guide teachers in the recognition and effective development of digital skills for the use of ICT in training processes (BARRAGÁN-SÁNCHEZ et al., 2020). In addition, a possible strategy for the development of digital skills for teachers could be consolidated according to the assessment of the experts.

References

• ALMENARA, Julio Cabero; MORO, Alfonso Infante. Empleo del método Delphi y su empleo en la investigación en comunicación y educación. Edutec. Revista Electrónica de Tecnología Educativa, Edutec, n. 48, a272, June 2014. DOI: 10.21556/edutec.2014.48.187. Available from: <https://www.edutec.es/revista/index.php/edutec-e/article/view/187>.
  » https://doi.org/10.21556/edutec.2014.48.187» https://www.edutec.es/revista/index.php/edutec-e/article/view/187
• AMAYA AMAYA, Arturo et al. Empoderar a los profesores en su quehacer académico a través de certificaciones internacionales en competencia digitales. Apertura, v. 10, n. 1, p. 104-115, 2018. Available from: <http://www.udgvirtual.udg.mx/apertura/index.php/apertura/article/view/1174>.
  » http://www.udgvirtual.udg.mx/apertura/index.php/apertura/article/view/1174
• BARRAGÁN-SÁNCHEZ, Raquel et al. Teaching Digital Competence and Eco-Responsible Use of Technologies: Development and Validation of a Scale. Sustainability, MDPI AG, v. 12, n. 18, p. 7721, Sept. 2020. DOI: 10.3390/su12187721. Available from: <https://doi.org/10.3390/su12187721>.
  » https://doi.org/10.3390/su12187721» https://doi.org/10.3390/su12187721
• BERNAL-BRAVO, César et al. Relación entre formación universitaria y competencia mediática del profesorado. Revista Complutense de Educación, Universidad Complutense de Madrid (UCM), v. 30, n. 4, p. 1113-1126, June 2019. DOI: 10.5209/rced.60188. Available from: <https://doi.org/10.5209/rced.60188>.
  » https://doi.org/10.5209/rced.60188» https://doi.org/10.5209/rced.60188
• CABERO ALMENARA, Julio; BARROSO OSUNA, Julio. La utilización del juicio de experto para la evaluación de TIC: el Coeficiente de competencia experta. Bordón. Revista de Pedagogía, v. 65, n. 2, p. 25-38, 2013. Available from: <https://recyt.fecyt.es/index.php/BORDON/article/view/22403>.
  » https://recyt.fecyt.es/index.php/BORDON/article/view/22403
• CABERO ALMENARA, Julio; CARMEN LLORENTE CEJUDO, María del. La aplicación del juicio de experto como técnica de evaluación de las tecnologías de la información y comunicación (TIC). Eduweb. Revista de Tecnología de Información y Comunicación en Educación, v. 7, n. 2, p. 11-22, 2013.
• CABERO ALMENARA, Julio; MARTÍNEZ GIMENO, Almudena. Las tecnologías de la información y comunicación y la formación inicial de los docentes: modelos y competencias digitales. Profesorado, Revista de Currículum y Formación del Profesorado, Editorial de la Universidad de Granada, v. 23, n. 3, p. 247-268, Sept. 2019. DOI: 10.30827/profesorado.v23i3.9421. Available from: <https://idus.us.es/handle/11441/89544>.
  » https://doi.org/10.30827/profesorado.v23i3.9421» https://idus.us.es/handle/11441/89544
• CABERO-ALMENARA, Julio; BARROSO-OSUNA, Julio, et al. Validación del cuestionario de competencia digital para futuros maestros mediante ecuaciones estructurales. Bordón. Revista de Pedagogía , Sociedad Espanola de Pedagogia, v. 72, n. 2, p. 45, June 2020. DOI: 10.13042/bordon.2020.73436. Available from: <https://recyt.fecyt.es/index.php/BORDON/article/view/73436>.
  » https://doi.org/10.13042/bordon.2020.73436» https://recyt.fecyt.es/index.php/BORDON/article/view/73436
• CABERO-ALMENARA, Julio; GUTIÉRREZ-CASTILLO, Juan-Jesús, et al. Development of the Teacher Digital Competence Validation of DigCompEdu Check-In Questionnaire in the University Context of Andalusia (Spain). Sustainability , MDPI AG, v. 12, n. 15, p. 6094, July 2020. DOI: 10.3390/su12156094. Available from: <https://www.mdpi.com/2071-1050/12/15/6094>.
  » https://doi.org/10.3390/su12156094» https://www.mdpi.com/2071-1050/12/15/6094
• CABERO-ALMENARA, Julio; PALACIOS-RODRÍGUEZ, Antonio. Marco Europeo de Competencia Digital Docente «DigCompEdu». Traducción y adaptación del cuestionario «DigCompEdu Check-In». EDMETIC, Cordoba University Press (UCOPress), v. 9, n. 1, p. 213-234, Dec. 2019. DOI: 10.21071/edmetic.v9i1.12462. Available from: <https://www.uco.es/ucopress/ojs/index.php/edmetic/article/view/12462>.
  » https://doi.org/10.21071/edmetic.v9i1.12462» https://www.uco.es/ucopress/ojs/index.php/edmetic/article/view/12462
• CABERO-ALMENARA, Julio; ROMERO-TENA, Rosalía; PALACIOS-RODRÍGUEZ, Antonio. Evaluation of Teacher Digital Competence Frameworks Through Expert Judgement: the Use of the Expert Competence Coefficient. Journal of New Approaches in Educational Research, University of Alicante, v. 9, n. 2, p. 275, July 2020. DOI: 10.7821/naer.2020.7.578. Available from: <https://naerjournal.ua.es/article/view/v9n2-9>.
  » https://doi.org/10.7821/naer.2020.7.578» https://naerjournal.ua.es/article/view/v9n2-9
• CABEZAS, Adiela Ruiz et al. Formación del Profesorado Universitario en la Competencia Digital. Pixel-Bit, Revista de Medios y Educación, Editorial Universidad de Sevilla, n. 58, p. 181-215, 2020. DOI: 10.12795/pixelbit.74676. Available from: <https://institucional.us.es/revistas/PixelBit/2020/74676.pdf>.
  » https://doi.org/10.12795/pixelbit.74676» https://institucional.us.es/revistas/PixelBit/2020/74676.pdf
• COHEN, Jacob. Statistical Power Analysis for the Behavioral Sciences. Hillsdale, NJ: Lawrence Erlbaum Associates, 1988.
• DURÁN CUARTERO, Marta; PRENDES ESPINOSA, Mª Paz; GUTIÉRREZ PORLÁN, Isabel. Certificación de la Competencia Digital Docente: propuesta para el profesorado universitario. RIED. Revista Iberoamericana de Educación a Distancia, UNED - Universidad Nacional de Educacion a Distancia, v. 22, n. 1, p. 187, Jan. 2019. DOI: 10.5944/ried.22.1.22069. Available from: <http://revistas.uned.es/index.php/ried/article/view/22069>.
  » https://doi.org/10.5944/ried.22.1.22069» http://revistas.uned.es/index.php/ried/article/view/22069
• ESTEVE-MON, Francesc M.; GISBERT-CERVERA, Mercè; LÁZARO-CANTABRANA, José Luis. La competencia digital de los futuros docentes: ¿cómo se ven los actuales estudiantes de educación? Perspectivas Educacional, v. 55, n. 2, p. 38-54, 2016. Available from: <http://perspectivaeducacional.cl/index.php/peducacional/article/viewFile/412/207>.
  » http://perspectivaeducacional.cl/index.php/peducacional/article/viewFile/412/207
• EUROPEAN UNION, Council of the. Recomendación del Consejo, de 22 de mayo de 2018, relativa a las competencias clave para el aprendizaje permanente. Bruselas: Diario Oficial de la Unión Europea, 2018.
• FALLOON, Garry. From digital literacy to digital competence: the teacher digital competency (TDC) framework. Educational Technology Research and Development, Springer Science and Business Media LLC, v. 68, n. 5, p. 2449-2472, Mar. 2020. DOI: 10.1007/s11423-020-09767-4. Available from: <https://link.springer.com/article/10.1007/s11423-020-09767-4>.
  » https://doi.org/10.1007/s11423-020-09767-4
• FERRARI, Anusca. DIGCOMP: a framework for developing and understanding digital competence in Europe. Luxembourg: Publications Office of the European Commission, 2013. DOI: 10.2788/52966. Available from: <https://data.europa.eu/doi/10.2788/52966>.
  » https://doi.org/10.2788/52966» https://data.europa.eu/doi/10.2788/52966
• GALICIA ALARCÓN, Liliana Aidé; BALDERRAMA TRÁPAGA, Jorge Arturo; EDEL NAVARRO, Rubén. Content validity by experts judgment: Proposal for a virtual tool. Apertura , Universidad de Guadalajara, v. 9, n. 2, p. 42-53, Oct. 2017. DOI: 10.32870/ap.v9n2.993. Available from: <http://www.udgvirtual.udg.mx/apertura/index.php/apertura/article/view/993>.
  » https://doi.org/10.32870/ap.v9n2.993» http://www.udgvirtual.udg.mx/apertura/index.php/apertura/article/view/993
• GHOMI, Mina; REDECKER, Christine. Digital Competence of Educators (DigCompEdu): Development and Evaluation of a Self-assessment Instrument for Teachers’ Digital Competence. In: PROCEEDINGS of the 11th International Conference on Computer Supported Education. [S.l.]: SCITEPRESS - Science and Technology Publications, 2019. DOI: 10.5220/0007679005410548. Available from: <https://www.scitepress.org/Link.aspx?doi=10.5220/0007679005410548>.
  » https://doi.org/10.5220/0007679005410548» https://www.scitepress.org/Link.aspx?doi=10.5220/0007679005410548
• GUDMUNDSDOTTIR, Greta Björk; HATLEVIK, Ove Edvard. Newly qualified teachers’ professional digital competence: implications for teacher education. European Journal of Teacher Education, Informa UK Limited, v. 41, n. 2, p. 214-231, Dec. 2017. DOI: 10.1080/02619768.2017.1416085. Available from: <https://www.tandfonline.com/doi/abs/10.1080/02619768.2017.1416085>.
  » https://doi.org/10.1080/02619768.2017.1416085» https://www.tandfonline.com/doi/abs/10.1080/02619768.2017.1416085
• INTEF. Marco Común de Competencia Digital Docente. Madrid: Instituto Nacional de Tecnologías Educativas y Formación del Profesorado, Oct. 2017. Available from: <https://aprende.intef.es/sites/default/files/2018-05/2017_1020_Marco-Com%C3%BAn-de-Competencia-Digital-Docente.pdf>.
  » https://aprende.intef.es/sites/default/files/2018-05/2017_1020_Marco-Com%C3%BAn-de-Competencia-Digital-Docente.pdf
• LANDETA RODRÍGUEZ, Jon. El método Delphi: una técnica de previsión del futuro. [S.l.]: Ariel, 2002. (Ariel Practicum).
• LÁZARO-CANTABRANA, José Luis; USART-RODRÍGUEZ, Mireia; GISBERT-CERVERA, Mercè. Assessing Teacher Digital Competence: the Construction of an Instrument for Measuring the Knowledge of Pre-Service Teachers. Journal of New Approaches in Educational Research , University of Alicante, v. 8, n. 1, p. 73-78, Jan. 2019. DOI: 10.7821/naer.2019.1.370. Available from: <https://naerjournal.ua.es/article/view/v8n1-10>.
  » https://doi.org/10.7821/naer.2019.1.370» https://naerjournal.ua.es/article/view/v8n1-10
• LÓPEZ-GÓMEZ, Ernesto. El método Delphi en la investigación actual en educación: una revisión teórica y metodológica. Educación XX1, UNED - Universidad Nacional de Educacion a Distancia, v. 21, n. 1, Nov. 2017. DOI: 10.5944/educxx1.20169. Available from: <http://revistas.uned.es/index.php/educacionXX1/article/view/20169>.
  » https://doi.org/10.5944/educxx1.20169» http://revistas.uned.es/index.php/educacionXX1/article/view/20169
• MALLA, F.; ZABALA, I. La previsión del futuro en la empresa (III): el método Delphi. Estudios Empresariales, v. 39, p. 13-24, 1978.
• MÁRQUEZ, Esther Fernández; LEIVA-OLIVENCIA, Juan José; LÓPEZ-MENESES, Eloy. Competencias digitales en docentes de Educación Superior. Revista Digital de Investigación en Docencia Universitaria, Universidad Peruana de Ciencias Aplicadas, p. 213-231, June 2018. DOI: 10.19083/ridu.12.558. Available from: <https://revistas.upc.edu.pe/index.php/docencia/article/view/558>.
  » https://doi.org/10.19083/ridu.12.558.» https://revistas.upc.edu.pe/index.php/docencia/article/view/558
• OTERO, Lorena Casal; MORANTE, Carmen Fernández; LÓPEZ, Beatriz Cebreiro. La Competencia en TIC del profesorado no universitario. Revista Interuniversitaria de Investigación en Tecnología Educativa, Servicio de Publicaciones de la Universidad de Murcia, p. 22-39, Dec. 2018. DOI: 10.6018/riite/2018/334851. Available from: <https://revistas.um.es/riite/article/view/334851>.
  » https://doi.org/10.6018/riite/2018/334851» https://revistas.um.es/riite/article/view/334851
• PADILLA-HERNÁNDEZ, Angelina Lorelí; GÁMIZ-SÁNCHEZ, Vanesa M.ª; ROMERO-LÓPEZ, M.ª Asunción. Niveles de desarrollo de la Competencia Digital Docente: una mirada a marcos recientes del ámbito internacional. Innoeduca. International Journal of Technology and Educational Innovation, Malaga University, v. 5, n. 2, p. 140, Dec. 2019. DOI: 10.24310/innoeduca.2019.v5i2.5600. Available from: <https://revistas.uma.es/index.php/innoeduca/article/view/5600>.
  » https://doi.org/10.24310/innoeduca.2019.v5i2.5600» https://revistas.uma.es/index.php/innoeduca/article/view/5600
• PRENDES ESPINOSA, M. Paz; GUTIÉRREZ PORLÁN, Isabel. Competencias tecnológicas del profesorado en las Universidades españolas. Revista de Educación, Secretaría General Técnica. Subdirección General de Documentación y Publicaciones, 2011. ISSN 1988-592X. DOI: 10.4438/1988-592X-RE-2011-361-140. Available from: <http://www.educacionyfp.gob.es/revista-de-educacion/numeros-revista-educacion/numeros-anteriores/2013/re361/re361-08.html>.
  » https://doi.org/10.4438/1988-592X-RE-2011-361-140» http://www.educacionyfp.gob.es/revista-de-educacion/numeros-revista-educacion/numeros-anteriores/2013/re361/re361-08.html
• REDECKER, Christine; PUNIE, Yves. European framework for the digital competence of educators: DigCompEdu. Luxembourg: Publications Office of the European Union, 2017. DOI: 10.2760/159770. Available from: <https://data.europa.eu/doi/10.2760/159770>.
  » https://doi.org/10.2760/159770» https://data.europa.eu/doi/10.2760/159770
• REISOĞLU, İlknur; ÇEBI, Ayça. How can the digital competences of pre-service teachers be developed? Examining a case study through the lens of DigComp and DigCompEdu. Computers & Education, Elsevier BV, v. 156, p. 103940, Oct. 2020. DOI: 10.1016/j.compedu.2020.103940. Available from: <https://www.sciencedirect.com/science/article/abs/pii/S036013152030138X>.
  » https://doi.org/10.1016/j.compedu.2020.103940» https://www.sciencedirect.com/science/article/abs/pii/S036013152030138X
• ROBLES GARROTE, Pilar; CARMEN ROJAS, Manuela del. La validación por juicio de expertos: dos investigaciones cualitativas en Lingüística aplicada. Revista Nebrija de Lingüística Aplicada, v. 18, 2015.
• RODRÍGUEZ-GARCÍA, Antonio-Manuel; SÁNCHEZ, Francisco Raso; RUIZ-PALMERO, Julio. Competencia digital, educación superior y formación del profesorado: un estudio de meta-análisis en la web of science. Pixel-Bit, Revista de Medios y Educación , Editorial Universidad de Sevilla, n. 54, p. 65-82, 2019. DOI: 10.12795/pixelbit.2019.i54.04. Available from: <https://doi.org/10.12795/pixelbit.2019.i54.04>.
  » https://doi.org/10.12795/pixelbit.2019.i54.04» https://doi.org/10.12795/pixelbit.2019.i54.04
• SEMERCI, Ali; AYDIN, M. Kemal. Examining High School Teachers’ Attitudes towards ICT Use in Education. International Journal of Progressive Education, Pen Academic Publishing, v. 14, n. 2, p. 93-105, Apr. 2018. DOI: 10.29329/ijpe.2018.139.7. Available from: <https://ijpe.penpublishing.net/makale/471>.
  » https://doi.org/10.29329/ijpe.2018.139.7» https://ijpe.penpublishing.net/makale/471
• SIEGEL, Sidney. Estadística no paramétrica aplicada a las ciencias de la conducta. México: Trillas, 1976.
• SILVA, Juan et al. La competencia digital docente en formación inicial: Estudio a partir de los casos de Chile y Uruguay. education policy analysis archives, Education Policy Analysis Archives, v. 27, p. 93, Aug. 2019. DOI: 10.14507/epaa.27.3822. Available from: <https://epaa.asu.edu/ojs/article/view/3822>.
  » https://doi.org/10.14507/epaa.27.3822» https://epaa.asu.edu/ojs/article/view/3822
• SUÁREZ-RODRÍGUEZ, Jesús et al. A basic model of integration of ICT by teachers: competence and use. Educational Technology Research and Development, Springer Science and Business Media LLC, v. 66, n. 5, p. 1165-1187, Apr. 2018. DOI: 10.1007/s11423-018-9591-0. Available from: <https://link.springer.com/article/10.1007%2Fs11423-018-9591-0>.
  » https://doi.org/10.1007/s11423-018-9591-0» https://link.springer.com/article/10.1007%2Fs11423-018-9591-0
• VUORIKARI, Riina et al. DigComp 2.0: the digital competence framework for citizens. Luxembourg: Publications Office of the European Union , 2016. DOI: 10.2791/11517. Available from: <https://data.europa.eu/doi/10.2791/11517>.
  » https://doi.org/10.2791/11517» https://data.europa.eu/doi/10.2791/11517

• Funding

  This article is part of the project Design, production and evaluation of t-Mooc for the acquisition by teachers of teaching digital skills (RTI2018-097214-B-C31) funded by the Ministry of Science, Innovation and Universities.

Edited by

Edited by:

Leonardo Araújo

Publication Dates

• Publication in this collection
  27 June 2022
• Date of issue
  2021

History

• Received
  09 Oct 2020
• Accepted
  04 Jan 2021
• Published
  08 Mar 2021