CEN/TR 17802:2022

SLOVENSKI STANDARD
01-junij-2022
Kazalniki učinkovitosti e-usposobljenosti in skupne meritve
e-Competence performance indicators and common metrics
Leistungsindikatoren für E-Kompetenz und gemeinsame Metriken
e-Compétences : indicateurs de performance et métriques communes
Ta slovenski standard je istoveten z: CEN/TR 17802:2022
ICS:
35.020 Informacijska tehnika in Information technology (IT) in
tehnologija na splošno general
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

CEN/TR 17802
TECHNICAL REPORT
RAPPORT TECHNIQUE
April 2022
TECHNISCHER BERICHT
ICS 35.020
English Version
e-Competence performance indicators and common
metrics
e-Compétences : indicateurs de performance et Leistungsindikatoren für E-Kompetenz und
métriques communes gemeinsame Metriken

This Technical Report was approved by CEN on 27 March 2022. It has been drawn up by the Technical Committee CEN/TC 428.

CEN members are the national standards bodies of Austria, Belgium, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia,
Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway,
Poland, Portugal, Republic of North Macedonia, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Turkey and
United Kingdom.
EUROPEAN COMMITTEE FOR STANDARDIZATION
COMITÉ EUROPÉEN DE NORMALISATION

EUROPÄISCHES KOMITEE FÜR NORMUNG

CEN-CENELEC Management Centre: Rue de la Science 23, B-1040 Brussels
© 2022 CEN All rights of exploitation in any form and by any means reserved Ref. No. CEN/TR 17802:2022 E
worldwide for CEN national Members.

Contents Page
European foreword . 3
Introduction . 4
1 Scope . 6
2 Normative references . 6
3 Terms and definitions . 6
4 Using EN 16234-1 for recognition and validation of e-Competences . 7
4.1 e-Competences from EN 16234-1 (e-CF): abilities of ICT professionals . 7
4.2 Recognition and validation of e-Competences . 8
5 Assessment of e-Competences in different contexts . 11
5.1 Context assessment: general considerations . 11
5.2 Customization of EN 16234-1 (e-CF) . 12
5.3 Typical use cases for validation and recognition of e-Competences . 13
6 Guidelines for development and application of indicators and metrics . 16
6.1 The process for deciding if a person is proficient in an e-Competence at a certain level . 16
6.2 How to derive indicators and metrics from EN 16234-1 (e-CF) . 17
6.3 Adapting recognition and validation mechanisms to use cases . 29
6.4 Application of the assessment process to a candidate . 30
Annex A (informative) The EN 16234-1 (e-CF) adoption Maturity Model . 35
Annex B (informative) Methods for recognition and validation of e-Competences . 39
Annex C (informative) Examples of Indicators . 42
Bibliography . 65

European foreword
This document (CEN/TR 17802:2022) has been prepared by Technical Committee CEN/TC 428 “ICT
Professionalism and Digital Competences” the secretariat of which is held by UNI.
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. CEN shall not be held responsible for identifying any or all such patent rights.
Any feedback and questions on this document should be directed to the users’ national standards body.
A complete listing of these bodies can be found on the CEN website.
Introduction
Recognition of competences is not a new field, many contributions have explored this topic and have
developed assessment tools and methods to pursue clarity and precision, trying to be as unambiguous
and non-judgmental as possible. There is an urgent need in the ICT field to find practical solutions related
to the recognition and assessment of capabilities of ICT professionals whenever/wherever such
competences have been acquired or developed.
This document is not intended as a general guideline as many valuable and authoritative papers already
exist (e.g. from CEDEFOP and SFIA). This document is focused on providing guidance and a method for
applying the EN 16234-1, e-Competence Framework (e-CF) - A common European Framework for ICT
Professionals in all industry sectors — Part 1: Framework and related documents to the process for
competence assessment of ICT professionals.
Therefore, this document provides guidance to e-CF users by supporting the use of indicators, metrics
and criteria that support the assessment of an individual’s e- competence at a specific level of proficiency
as specified in EN 16234-1 (e-CF).
This document provides:
a) Guidelines to derive indicators and metrics from the reference documents.
Most information, related to e-Competences, is described in EN 16234-1 (e-CF) its user guide and
other associated documents such as CWA 16458-1 (ICT Profiles). Complementary to this
information, e-CF users may seek the additional guidance and a methodology offered in this
document to identify indicators and metrics in support of assessment.
The EN 16234-1 (e-CF) and the CWA 16458-1 (ICT Profiles) are references provided for all
stakeholders and users in Europe and worldwide. They are flexible structures and are adaptable to
meet requirements across a broad and in-depth ICT Professional environment. Therefore, it is
impossible to create a complete and exhaustive catalogue of all possible indicators and metrics that
are context specific across for all possible roles and competences. In support of this application
flexibility, this document offers a range of examples which may be applied or used as inspiration for
specific or unique requirements.
b) Guidelines to generate a customized set of indicators, metrics, criteria and methods to collect pieces
of evidence.
Once a satisfactory catalogue of indicators or metrics have been defined to start the assessment, the
next task is to customize them for a specific use case. This customization usually entails the selection
of methods for the collection of supporting evidence and indicators as well as the criteria used to
determine the ICT professional’s proficiency level for each situation. Depending on the use case (see
a list of typical use cases in 5.3) the assessor or organization (e.g. an organization planning to recruit
or address workforce development) may select and adapt:
— the methods used to collect information;
— the criteria used to evaluate if an individual is proficient at a specific e-CF competence level.
This adaptation process is assisted by the guidelines in this document. Furthermore, the document
guides the process by highlighting the weaknesses and strengths of each option by providing
examples of adaptation to specific situations.
c) Awareness on the typical assessment process to evaluate the level of a candidate’s e-Competences.
When all of the elements for an assessment are ready (indicators, metrics, criteria, methods for
collecting pieces of evidence, etc.), the process of assessing e-Competences can start. The process
may involve collection of information in the form of documents, samples, etc. or the collection of
information through direct interaction with the ICT professional or other informed persons using
interviews, forms, tests, exercises, observation, etc. An illustrative catalogue of methods for collecting
information is described in Annex B. This document offers examples of pieces of evidence and the
contribution they may provide. The assessor is offered guidelines to manage the assessment process
and to generate a set of assessment results and this document shows examples of results to illustrate
the process.
Finally, it is important to underline that the aim of deploying the e-CF as a competence assessment tool
is to provide objectivity (i.e. unbiased, based on facts and not influenced by personal feelings,
interpretations, or prejudice). This is naturally limited by the experience and capability of the individual
assessor and this is the reasoning has inspired the development of present document designed to offer
pragmatic guidance and inspiration.
This document is structured by six Clauses.
Clauses 1, 2 and 3 describe the scope, the normative references and the relevant terms and definitions
used.
Clause 4 analyses the content of EN 16234-1 (e-CF) from the perspective of the identification of elements
useful in assessing e-competences and proficiency levels.
Clause 5 illustrates the importance of the context of an assessment and describes the factors that affect
the methods, indicators and metrics to be used.
Clause 6 contains a description of a typical process for the assessment and a methodology to identify and
consistently map the indicators.
1 Scope
The aim of this document is to enable unbiased and consistent use of indicators and measurements to
enable verification of an individual’s competence to the EN 16234-1 (e-CF) to facilitate its consistent
application.
The document addresses the assessment of competence as articulated within the EN 16234-1 (e-CF),
regardless of where, when and how the competence was attained or developed.
The aim is to provide guidance on the use of indicators and measurements to support the assessment
and/or verification of an IT professional’s competence.
Guidance is confined to possible indicators and how they can be applied to achieve consistency and
transparency for the verification of an e-CF competence at a specific level (1-5).
This document guides readers through objective assessment of e-CF competence to avoid possible
influence from personal feelings, interpretations or prejudice.
Finally, this document aims to offer, at least, examples of indicators and metrics for each of the e-
competences listed in EN 16234-1 (e-CF).
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
EN 16234 (all parts), e-Competence Framework (e-CF) - A common European Framework for ICT
Professionals in all industry sectors
3 Terms and definitions
For the purposes of this document, the terms and definitions given in EN 16234 (all parts) and the
following apply.
ISO and IEC maintain terminological databases for use in standardization at the following addresses:
— IEC Electropedia: available at https://www.electropedia.org/
— ISO Online browsing platform: available at https://www.iso.org/obp
3.1
indicator
observable aspect or characteristic of an e-Competence that indicates its presence in an individual at a
particular proficiency level
Note 1 to entry: The observation or measurement of an indicator results in one or several qualitative or
quantitative values.
3.2
metric
total or partial value of an indicator where the measured entity is a person (ICT professional), the
attribute is mainly an e-Competence at a competence level and is determined according to well-defined
rules
Note 1 to entry: A metric could be qualitative or quantitative, objective or subjective, and direct or indirect. It may
express value in a range of ways from very basic scales like a classification (e.g. classify an entity according to a mere
type) to sophisticated quantitative metrics (like number of years).
3.3
criterion
principle used to decide if an ICT professional has acquired an e-Competence at an e-CF level of
proficiency
Note 1 to entry: It can be determined by a value such as the threshold of a metric or of an indicator or possibly a
combination of values such as absolute numbers, percentages, etc.
4 Using EN 16234-1 for recognition and validation of e-Competences
4.1 e-Competences from EN 16234-1 (e-CF): abilities of ICT professionals
EN 16234-1 (e-CF) has established a common language for e-Competences that is independent of
education systems and qualification structures. In order to effectively use the e-CF for e-competence
assessment, a crucial factor is the users comprehensive and holistic understanding of the concept of
competence in e-CF: “Competence is a demonstrated ability to apply knowledge, skills and attitudes for
achieving observable results” (see EN 16234-1:2019, 3.5). For org
...