SIST EN ISO/IEC 25059:2024

SLOVENSKI STANDARD
01-december-2024
Programsko inženirstvo - Zahteve za kakovost in vrednotenje sistemov in
programske opreme (SQuaRE) - Model kakovosti za sisteme UI (ISO/IEC
25059:2023)
Software engineering - Systems and software Quality Requirements and Evaluation
(SQuaRE) - Quality model for AI systems (ISO/IEC 25059:2023)
System- und Software-Engineering - Qualitätskriterien und Bewertung von Systemen
und Softwareprodukten (SQuaRE) - Qualitätsmodell für KI-Systeme (ISO/IEC
25059:2023)
Ingénierie des systèmes et des logiciels - Critères de qualité et évaluation des systèmes
et des produits logiciels (SQuaRE) - Modèle de qualité pour les systèmes d’IA (ISO/IEC
25059:2023)
Ta slovenski standard je istoveten z: EN ISO/IEC 25059:2024
ICS:
35.080 Programska oprema Software
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

EUROPEAN STANDARD EN ISO/IEC 25059

NORME EUROPÉENNE
EUROPÄISCHE NORM
August 2024
ICS 35.080
English version
Software engineering - Systems and software Quality
Requirements and Evaluation (SQuaRE) - Quality model
for AI systems (ISO/IEC 25059:2023)
Ingénierie du logiciel - Exigences de qualité et System- und Software-Engineering - Qualitätskriterien
évaluation des systèmes et du logiciel (SQuaRE) - und Bewertung von Systemen und Softwareprodukten
Modèle de qualité pour les systèmes d'IA (ISO/IEC (SQuaRE) - Qualitätsmodell für KI-Systeme (ISO/IEC
25059:2023) 25059:2023)
This European Standard was approved by CEN on 1 August 2024.

CEN and CENELEC members are bound to comply with the CEN/CENELEC Internal Regulations which stipulate the conditions for
giving this European Standard the status of a national standard without any alteration. Up-to-date lists and bibliographical
references concerning such national standards may be obtained on application to the CEN-CENELEC Management Centre or to
any CEN and CENELEC member.
This European Standard exists in three official versions (English, French, German). A version in any other language made by
translation under the responsibility of a CEN and CENELEC member into its own language and notified to the CEN-CENELEC
Management Centre has the same status as the official versions.

CEN and CENELEC members are the national standards bodies and national electrotechnical committees of Austria, Belgium,
Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland, Ireland, Italy,
Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Republic of North Macedonia, Romania, Serbia,
Slovakia, Slovenia, Spain, Sweden, Switzerland, Türkiye and United Kingdom.

CEN-CENELEC Management Centre:
Rue de la Science 23, B-1040 Brussels
© 2024 CEN/CENELEC All rights of exploitation in any form and by any means
Ref. No. EN ISO/IEC 25059:2024 E
reserved worldwide for CEN national Members and for
CENELEC Members.
Contents Page
European foreword . 3

European foreword
The text of ISO/IEC 25059:2023 has been prepared by Technical Committee ISO/IEC JTC 1 "Information
technology” of the International Organization for Standardization (ISO) and has been taken over as
secretariat of which is held by DS.
This European Standard shall be given the status of a national standard, either by publication of an
identical text or by endorsement, at the latest by February 2025, and conflicting national standards
shall be withdrawn at the latest by February 2025.
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. CEN-CENELEC shall not be held responsible for identifying any or all such patent rights.
Any feedback and questions on this document should be directed to the users’ national standards body.
A complete listing of these bodies can be found on the CEN and CENELEC websites.
According to the CEN-CENELEC Internal Regulations, the national standards organizations of the
following countries are bound to implement this European Standard: Austria, Belgium, Bulgaria,
Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Germany, Greece, Hungary, Iceland,
Ireland, Italy, Latvia, Lithuania, Luxembourg, Malta, Netherlands, Norway, Poland, Portugal, Republic of
North Macedonia, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, Türkiye and the
United Kingdom.
Endorsement notice
The text of ISO/IEC 25059:2023 has been approved by CEN-CENELEC as EN ISO/IEC 25059:2024
without any modification.
INTERNATIONAL ISO/IEC
STANDARD 25059
First edition
2023-06
Software engineering — Systems and
software Quality Requirements and
Evaluation (SQuaRE) — Quality model
for AI systems
Reference number
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
ISO/IEC 25059:2023(E)
© ISO/IEC 2023
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Contents Page
Foreword .iv
Introduction .v
1 Scope . 1
2 Normative references . 1
3 Terms and definitions . 1
3.1 General . 1
3.2 Product quality . 2
3.3 Quality in use . 3
4 Abbreviated terms . 3
5 Product quality model .3
5.1 General . 3
5.2 User controllability . 4
5.3 Functional adaptability. 4
5.4 Functional correctness . 4
5.5 Robustness . 4
5.6 Transparency . 5
5.7 Intervenability . 5
6 Quality in use model .6
6.1 General . 6
6.2 Societal and ethical risk mitigation . 6
6.3 Transparency . 7
Annex A (informative) SQuaRE. 8
Annex B (informative) How a risk-based approach relates to a quality-based approach and
quality models .10
Annex C (informative) Performance .13
Bibliography .14
iii
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance
are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria
needed for the different types of document should be noted. This document was drafted in
accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
ISO and IEC draw attention to the possibility that the implementation of this document may involve the
use of (a) patent(s). ISO and IEC take no position concerning the evidence, validity or applicability of
any claimed patent rights in respect thereof. As of the date of publication of this document, ISO and IEC
had not received notice of (a) patent(s) which may be required to implement this document. However,
implementers are cautioned that this may not represent the latest information, which may be obtained
from the patent database available at www.iso.org/patents and https://patents.iec.ch. ISO and IEC shall
not be held responsible for identifying any or all such patent rights.
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 42, Artificial intelligence.
Any feedback or questions on this document should be directed to the user’s national standards
body. A complete listing of these bodies can be found at www.iso.org/members.html and
www.iec.ch/national-committees.
iv
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Introduction
High-quality software products and computer systems are crucial to stakeholders. Quality models,
quality requirements, quality measurement, and quality evaluation are standardized within the
International Standards on SQuaRE, see Annex A for further information.
AI systems require additional properties and characteristics of systems to be considered, and
stakeholders have varied needs. AI systems have different properties and characteristics. For example,
AI systems can:
— replace human decision-making;
— be based on noisy, or incomplete data;
— be probabilistic;
— adapt during operation.
[2]
According to ISO/IEC TR 24028, trustworthiness has been understood and treated as both an ongoing
organizational process as well as a non-functional requirement specifying emergent properties of a
system — that is, a set of inherent characteristics with their attributes — within the context of quality
of use as indicated in ISO/IEC 25010.
ISO/IEC TR 24028 discusses the applicability to AI systems of that have been developed for conventional
software. According to ISO/IEC TR 24028, does not sufficiently address the data-driven unpredictable
nature of AI systems. While considering the existing body of work, ISO/IEC TR 24028 identifies the
need for developing new International Standards for AI systems that can go beyond the characteristics
and requirements of conventional software development.
ISO/IEC TR 24028 contains a related discussion on different approaches to testing and evaluation
of AI systems. It states that for testing of an AI system, modified versions of existing software and
hardware verification and validation techniques are needed. It identifies several conceptual differences
between many AI systems and conventional systems and concludes that “the ability of the [AI] system
to achieve the planned and desired result … may not always be measurable by conventional approaches
[3]
to software testing”. Testing of AI systems is addressed in ISO/IEC TR 29119-11:2020.
This document outlines an application-specific AI system extension to the SQuaRE quality model
specified in ISO/IEC 25010.
AI systems perform tasks. One or more tasks can be defined for an AI system. Quality requirements can
be specified for the evaluation of task fulfilment.
The quality model is considered from two perspectives, product quality as described in Clause 5 and
quality in use in Clause 6. The relevance of these terms is explained, and links to other standardization
[4][5]
deliverables (e.g. the ISO/IEC 24029 series ) are highlighted.
[6]
ISO/IEC 25012:2008 contains a model for data quality that is complementary to the model defined in
[7]
this document. ISO/IEC 25012:2008 is being extended for AI systems by the ISO/IEC 5259 series.
v
© ISO/IEC 2023 – All rights reserved

INTERNATIONAL STANDARD ISO/IEC 25059:2023(E)
Software engineering — Systems and software Quality
Requirements and Evaluation (SQuaRE) — Quality model
for AI systems
1 Scope
This document outlines a quality model for AI systems and is an application-specific extension to
the standards on SQuaRE. The characteristics and sub-characteristics detailed in the model provide
consistent terminology for specifying, measuring and evaluating AI system quality. The characteristics
and sub-characteristics detailed in the model also provide a set of quality characteristics against which
stated quality requirements can be compared for completeness.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 25010:2011, Systems and software engineering — Systems and software Quality Requirements
and Evaluation (SQuaRE) — System and software quality models
ISO/IEC 22989:2022, Information technology — Artificial intelligence — Artificial intelligence concepts
and terminology
ISO/IEC 23053:2022, Framework for Artificial Intelligence (AI) Systems Using Machine Learning (ML)
3 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO/IEC 22989:2022,
ISO/IEC 23053:2022 and the following apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at https:// www .electropedia .org/
3.1 General
3.1.1
measure, noun
variable to which a value is assigned as the result of measurement
Note 1 to entry: The term “measures” is used to refer collectively to base measures, derived measures, and
indicators.
[SOURCE: ISO/IEC/IEEE 15939:2017, 3.15]
3.1.2
measure, verb
make a measurement
[SOURCE: ISO/IEC 25010:2011, 4.4.6]
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
3.1.3
software quality measure
measure of internal software quality, external software quality or software quality in use
Note 1 to entry: Internal measure of software quality, external measure of software quality or software quality
in use measure are described in the quality model in ISO/IEC 25010.
[SOURCE: ISO/IEC 25040:2011, 4.61]
3.1.4
risk treatment measure
protective measure
action or means to eliminate hazards or reduce risks
[SOURCE: ISO/IEC Guide 51:2014, 3.13, modified — change reduction to treatment.]
3.1.5
transparency
degree to which appropriate information about the AI system is communicated to relevant stakeholders
Note 1 to entry: Appropriate information for AI system transparency can include aspects such as features,
components, procedures, measures, design goals, design choices and assumptions.
3.2 Product quality
3.2.1
user controllability
degree to which a user can appropriately intervene in an AI system’s functioning in a timely manner
3.2.2
functional adaptability
degree to which an AI system can accurately acquire information from data, or the result of previous
actions, and use that information in future predictions
3.2.3
functional correctness
degree to which a product or system provides the correct results with the needed degree of precision
Note 1 to entry: AI systems, and particularly those using machine learning models, do not usually provide
functional correctness in all observed circumstances.
[SOURCE: ISO/IEC 25010:2011, 4.2.1.2, modified — Note to entry added.]
3.2.4
intervenability
degree to which an operator can intervene in an AI system’s functioning in a timely manner to prevent
harm or hazard
3.2.5
robustness
degree to which an AI system can maintain its level of functional correctness under any circumstances
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
3.3 Quality in use
3.3.1
societal and ethical risk mitigation
degree to which an AI system mitigates potential risk to society
Note 1 to entry: Societal and ethical risk mitigation includes accountability, fairness, transparency and
explainability, professional responsibility, promotion of human value, privacy, human control of technology,
community involvement and development, respect for the rule of law, respect for international norms of
behaviour and labour practices.
4 Abbreviated terms
AI artificial intelligence
ML machine learning
5 Product quality model
5.1 General
An AI system product quality model is detailed in Figure 1. The model is based on a modified version of
a general system model provided in ISO/IEC 25010. New and modified sub-characteristics are identified
using a lettered footnote. Some of the sub-characteristics have different meanings or contexts as
compared to the ISO/IEC 25010 model. The modifications, additions and differences are described in
this clause. The unmodified original characteristics are part of the AI system product model and shall
be interpreted in accordance with ISO/IEC 25010.

a
New sub-characteristics.
m
Modified sub-characteristics.
Figure 1 — AI system product quality model
© ISO/IEC 2023 – All rights reserved

ISO/IEC 25059:2023(E)
Each of these modified or new sub-characteristics are listed in the remainder of this clause.
5.2 User controllability
User controllability is a new sub-characteristic of usability. User controllability is a property of an AI
system such that a human or another external agent can intervene in its functioning in a timely manner.
Enhanced controllability is helpful if unexpected behaviour cannot be completely avoided and that can
lead to negative consequences.
User controllability is related to controllability, which is described in ISO/IEC 22989:2022, 5.12.
5.3 Functional adaptability
Functi
...