ISO/IEC 23001-11:2023

ISO/IEC JTC 1/SC 29
ISO/IEC JTC 1/SC 29
Date: 2022‐06-2911
ISO/IEC 23001‐11
ISO/IEC JTC 1/SC 29/WG 11
ISO/IEC FDIS 23001‐11:2022(E)
ISO/IEC JTC 1/SC 29/WG 11
Secretariat:JISC
Information technology — MPEG Systems Technologies — Part 11: Energy‐
Efficient Media Consumption (Green Metadata)
Élément introductif — Élément central — Partie 1: Titre de la partie
Information technology — MPEG Systems Technologies — Part 11: Energy‐Efficient
Media Consumption (Green Metadata)
Technologies de l'information — Technologies des systèmes MPEG — Partie 11: Consommation
des supports éconergétiques (métadonnées vertes)
© ISO/IEC 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of
this publication may be reproduced or utilized otherwise in any form or by any means, electronic or
mechanical, including photocopying, or posting on the internet or an intranet, without prior written
permission. Permission can be requested from either ISO at the address below or ISO’s member body in the
country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland

---------------------- Page: 1 ----------------------
Contents Page
Foreword . 55
Introduction . 66
1  Scope . 11
2  Normative references . 11
3  Terms, definitions, symbols, abbreviated terms . 11
3.1  Terms and definitions . 11
3.2  Symbols and abbreviated terms . 3
4  Conventions . 4
4.1  Arithmetic operators . 4
4.2  Relational operators . 4
4.3  Bit‐wise operators . 5
4.4  Assignment operators . 5
4.5  Range notation . 6
4.6  Mathematical functions . 66
4.7  Specification of syntax functions and descriptors . 6
5  Functional architecture . 7
5.1  Description of the functional architecture. 7
5.2  Definition of components in the functional architecture . 8
6  Decoder power reduction . 9
6.1  General . 9
6.2  Complexity metrics for decoder‐power reduction . 9
6.3  Interactive signalling for remote decoder‐power reduction . 43
7  Display power reduction using display adaptation . 45
7.1  General . 45
7.2  Syntax . 45
7.3  Signalling . 46
7.4  Semantics . 47
8  Energy‐efficient media selection . 49
8.1  General . 49
8.2  Syntax . 49
8.3  Signalling . 49
8.4  Semantics . 51
9  Metrics for quality recovery after low‐power encoding . 53
9.1  General . 53
9.2  Syntax . 53
9.3  Signalling . 53
9.4  Semantics . 54
10  Conformance and reference software . 56
Annex A (normative) Supplemental Enhancement Information (SEI) syntax . 57
A.1  Syntax and semantics of green metadata SEI message carried in AVC NAL units . 57
2

---------------------- Page: 2 ----------------------
A.1.1  Syntax . 57
A.1.2  Semantics . 58
A.2  Syntax and semantics of green metadata SEI message carried in HEVC NAL units. 58
A.2.1  Syntax . 58
A.2.2  Semantics . 60
A.3  Syntax and semantics of green metadata SEI message carried in VVC NAL units . 60
A.3.1  Syntax . 60
A.3.2  Semantics . 62
Annex B (informative) Implementation guidelines for the usage of green metadata . 63
B.1  Codec dynamic voltage frequency scaling for decoder‐power reduction . 63
B.1.1  General . 63
B.1.2  Derivation of the complexity metrics . 63
B.1.2.1 Deriving the worst‐case, largest value for N (i) . 63
maxNumSixTapFiltPic
B.1.2.2 Deriving the worst‐case, largest value for N (i) . 67
maxAlphaPointDbfsPic
B.1.3  Example usage of C‐DVFS metadata . 70
B.2  Display adaptation . 72
B.2.1  General . 72
B.2.2  Example usage of display‐adaptation metadata . 72
B.2.2.1 Example usage of display‐adaptation metadata for contrast enhancement . 72
B.2.2.2 Preventing flicker arising from control latency . 74
B.2.2.3 Metadata for DA on displays with control‐frequency limitations . 74
B.2.2.4 DA metadata to prevent flicker from large variations . 75
B.3  Energy‐efficient media selection in adaptive streaming . 77
B.3.1  General . 77
B.3.2  Green metadata production and transmission at the server side . 77
B.3.3  Use of green metadata at the client . 85
B.4  Interactive signalling for remote decoder‐power reduction . 90
B.4.1  General . 90
B.4.2  Decoding operations reduction request computation and transmission . 90
B.4.3  Use of decoding operations reduction request . 91
B.5  Cross‐segment decoding for quality recovery after low‐power encoding . 94
B.5.1  General . 94
B.5.2  Green metadata Usage . 94
Annex C (normative) Conformance and reference software . 96
C.1  Complexity metrics for decoder‐power reduction . 96
C.1.1  Conformance test vectors . 96
C.1.2  Reference software . 97
3

---------------------- Page: 3 ----------------------
C.2  Display‐power reduction using display adaptation . 97
C.2.1  Conformance test vectors . 97
C.2.2  Reference software . 97
C.3  Energy‐efficient media selection . 98
C.3.1  Conformance test vectors . 98
C.3.2  Reference software . 98
C.4  Metrics for quality recovery after low‐power encoding . 99
C.4.1  Conformance test vectors . 99
C.4.2  Reference software . 100
Annex D (informative) Objective distortion metrics . 101
D.1  General . 101
D.2  PSNR . 101
D.3  wPSNR . 102
D.4  WS‐PSNR . 103103
D.4.1  WS‐PSNR calculation for equi‐rectangular projection (ERP) format with optional
padding . 104
D.4.2  WS‐PSNR calculation for cubemap projection (CMP) and hemisphere cubemap
projection (HCMP) formats . 104
D.5  SSIM . 104
Bibliography . 108108
4

---------------------- Page: 4 ----------------------
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical activity.
ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of document should be noted. This document was drafted in accordance with the editorial
rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details
of any patent rights identified during the development of the document will be in the Introduction and/or
on the ISO list of patent declarations received (see www.iso.org/patents) or the IEC list of patent
declarations received (see https://patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the World
Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding-standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
This third edition cancels and replaces the second edition (ISO/IEC 23001-11:2019), which has been
technically revised.
The main changes are as follows:
— The clause 6.2— 6.2 related to complexity metrics for decoder-power reduction is amended by the
specification of a new VVC SEI message carrying complexity metrics for decoder-power reduction.
— The clause 9— Clause 9 related to metrics for quality recovery after low-power encoding is
amended by the specification of additional metrics for quality recovery after low-power encoding in
the newly added VVC SEI message.
— The clause 6.3— 6.3 related to interactive signalling for remote decoder-power reduction is amended
by adding new syntax elements allowing a finer control by decoder of the encoding operations.
A list of all parts in the ISO/IEC 23001 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www.iso.org/members.html and www.iec.ch/national-
committeeswww.iso.org/members.html and www.iec.ch/national-committees.
5

---------------------- Page: 5 ----------------------
Introduction
This document specifies the metadata (green metadata) that facilitates reduction of energy usage during
media consumption as follows:
— the format of the metadata that enables reduced decoder power consumption;
— the format of the metadata that enables reduced display power consumption;
— the format of the metadata that enables media selection for joint decoder and display power
reduction;
— the format of the metadata that enables quality recovery after low-power encoding.
This metadata facilitates reduced energy usage during media consumption without any degradation in
the quality of experience (QoE). However, it is also possible to use this metadata to get larger energy
savings, but at the expense of some QoE degradation.
The metadata for energy-efficient decoding specifies two sets of information: complexity metrics (CM)
metadata and decoding operation reduction request (DOR-Req) metadata. A decoder uses CM metadata
to vary operating frequency and thus reduce decoder power consumption. In a point-to-point video
conferencing application, the remote encoder uses the DOR-Req metadata to modify the decoding
complexity of the bitstream and thus reduce local decoder power consumption.
The metadata for energy-efficient encoding specifies quality metrics that are used by a decoder to reduce
the quality loss from low-power encoding.
The metadata for energy-efficient presentation specifies RGB-component statistics and quality levels. A
presentation subsystem uses this metadata to reduce power by adjusting display parameters, based on
the statistics, to provide a desired quality level from those provided in the metadata.
The metadata for energy-efficient media selection specifies DOR-Req parameters, RGB-component
statistics and quality levels. The client in an adaptive streaming session uses this metadata to determine
decoder and display power-saving characteristics of available video representations and to select the
representation with the optimal quality for a given power-saving.

6

---------------------- Page: 6 ----------------------
Information technology — MPEG Systems Technologies — Part
11: Energy‐Efficient Media Consumption (Green Metadata)
2

---------------------- Page: 7 ----------------------
FINAL DRAFT INTERNATIONAL STANDARD ISO/IEC FDIS 23001‐11:2022(E)

Information technology — MPEG Systems Technologies — Part 11:
Energy‐Efficient Media Consumption (Green Metadata)
1 Scope
This document specifies metadata for energy-efficient decoding, encoding, presentation, and selection of
media.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 14496-10, Information technology — Coding of audio‐visual objects — Part 10: Advanced Video
Coding
ISO/IEC 23008-2, Information technology — High efficiency coding and media delivery in heterogeneous
environments — Part 2: High efficiency video coding
ISO/IEC 23009-1, Information technology — Dynamic adaptive streaming over HTTP (DASH) — Part 1:
Media presentation description and segment formats
ISO/IEC 23090--3, Information technology — Coded representation of immersive media — Part 3: Versatile
video coding
3 Terms, definitions, symbols, abbreviated terms
3.1 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO/IEC 14496-10, ISO/IEC 23008-
2, ISO/IEC 23009-1, ISO/IEC 23090-3 and the following apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https://www.iso.org/obp
— IEC Electropedia: available at https://www.electropedia.org/
3.1.1
alpha‐point deblocking instance
APDI
single filtering operation that produces either a single, filtered output p'0 or a single, filtered output q'0,
where p' and q' are filtered samples across a 4x4 block edge
0 0
3.1.2
deblocking filtering instance
single filtering operation that produces either a single, filtered output p' or a single, filtered output q',
where p' and q' are filtered samples across an 8x8 and 4x4 block edge for HEVC and VVC, respectively
© ISO/IEC 2022 – All rights reserved 1

---------------------- Page: 8 ----------------------
ISO/IEC FDIS 23001‐11:2022(E)

3.1.3
decoding process
process that reads a bitstream and derives decoded pictures from it
Note 1 to entry: The decoding process is specified in ISO/IEC 14496-10, ISO/IEC 23008-2 or ISO/IEC 23090-3.
3.1.4
encoding process
process that produces a bitstream
Note 1 to entry: The bitstream shall conform to ISO/IEC 14496-10, ISO/IEC 23008-2 or ISO/IEC 23090-3.
3.1.5
no‐quality‐loss operating point
NQLOP
metadata-enabled operating point associated with the largest display-power reduction that can be
achieved without any quality loss (infinite PSNR)
3.1.6
non‐zero block
block containing at least one non-zero transform coefficient
3.1.7
peak signal
maximum permissible RGB component in a reconstructed frame
N
Note 1 to entry: For N-bit video, peak signal is (2 – 1).
3.1.8
period
interval over which complexity-metrics metadata are applicable
3.1.9
pixel
smallest addressable element in an all-points addressable display device
3.1.10
reconstructed frames
frames obtained after applying RGB colour-space conversion and cropping to the specific decoded picture
or pictures for which display power-reduction metadata are applicable
3.1.11
RGB colour space
colour space based on the red, green, and blue colour primaries
3.1.12
RGB component
single sample representing one of the three primary colours of the RGB colour space [3.1.11]
3.1.13
six‐tap filtering
STF
single application of the 6-tap filter to generate a single filtered sample for fractional positions using the
samples at integer-sample positions
2 © ISO/IEC 2022 – All rights reserved

---------------------- Page: 9 ----------------------
3.2 Symbols and abbreviated terms
3.2.1 Symbols
++ addition
- subtraction (as a two-argument operator) or negation (as a unary prefix operator)
* multiplication
/ integer division with truncation of the result toward zero. For example, 7 / 4 and −7 / −4
are truncated to 1 and −7 / 4 and 7 / −4 are truncated to −1
÷ division in mathematical equations where no truncation or rounding is intended

3.2.2 Abbreviations
APDIAPDI alpha-point deblocking instance
ASIC application specific integrated circuit
AVC advanced video coding – ISO/IEC 14496-10
BMFF base media file format
CM complexity metric
CMOS complementary metal oxide semiconductor
CMP cubemap projection format
CPU central processing Unit
DASH dynamic adaptive streaming over HTTP
DOR-Ratio decoding operation reduction ratio
DOR-Req decoding operation reduction request
DVFS dynamic voltage frequency scaling
ERP equi-rectangular projection format
Fps frames per second
FS fresh start
GP good picture
HEVC high efficiency video coding – ISO/IEC 23008-2
HCMP hemisphere cubemap projection format
Mbps mega bits per second
MPD media presentation description
MSD mean square difference
MV motion vector
NQLOP no-quality-loss operating point
PSNR peak signal-to-noise ratio
QoE quality of experience
RBLL remaining battery life level
© ISO/IEC 2022 – All rights reserved 3

---------------------- Page: 10 ----------------------
ISO/IEC FDIS 23001‐11:2022(E)
RGB red, green, blue
SEI supplemental enhancement information
SP start picture
STF six-tap filtering
SSIM structural similarity index measure
VVC versatile video coding – ISO/IEC 23090-3
XSD cross-segment decoding
wPSNR weighted peak signal-to-noise ratio
WS-PSNR weighted to spherically uniform peak signal-to-noise ratio
4 Conventions
4.1 Arithmetic operators
y
 x exponentiation
Inserted Cells
 x/y division where no truncation or rounding is intended
x x
Inserted Cells

division where no truncation or rounding is intended
y
y

y
y
∑
i = x summation of f()i fi with i taking all integer values from x up to and including

fi()


y
ix
y
y
∑
p in summation of 𝑓�𝑝�fp with p taking all integer location values in a block B in a
fp()


pBin picture
 Modulus.
Inserted Cells

x % y
Remainder of x divided by y, defined only for integers x and y with x >= >= 0 and
y > 0
4.2 Relational operators
> greater than
>= greater than or equal to
< less than
<= less than or equal to
= = equal to
!= not equal to
 > greater than
 >= greater than or equal to
 < less than
 <= less than or equal to
 = = equal to
4 © ISO/IEC 2022 – All rights reserved

---------------------- Page: 11 ----------------------
!= not equal to
When a relational operator is applied to a syntax element or variable that has been assigned the value
"na" (not applicable), the value "na" is treated as a distinct value for the syntax element or variable. The
value "na" is considered not to be equal to any other value.
4.3 Bit‐wise operators
x >> y arithmetic right shift of a two's complement integer representation of x by y binary digits
This function is defined only for non-negative integer values of y. Bits shifted into the most
significant bits (MSBs) as a result of the right shift have a value equal to the MSB of x prior
to the shift operation.
x << y arithmetic left shift of a two's complement integer representation of x by y binary digits
This function is defined only for non-negative integer values of y. Bits shifted into the least
significant bits (LSBs) as a result of the left shift have a value equal to 0.
 x >> y arithmetic right shift of a two's complement integer representation of x by y binary
digits
 This function is defined only for non-negative integer values of y. Bits shifted into
 the most significant bits (MSBs) as a result of the right shift have a value equal to the
MSB of x prior to the shift operation.
 x << y arithmetic left shift of a two's complement integer representation of x by y binary
digits
 This function is defined only for non-negative integer values of y. B
...

FINAL
INTERNATIONAL ISO/IEC
DRAFT
STANDARD FDIS
23001-11
ISO/IEC JTC 1/SC 29
Information technology — MPEG
Secretariat: JISC
systems technologies —
Voting begins on:
2022-11-23
Part 11:
Voting terminates on:
Energy-efficient media consumption
2023-01-18
(green metadata)
Technologies de l'information — Technologies des systèmes MPEG —
Partie 11: Consommation des supports éconergétiques (métadonnées
vertes)
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/IEC FDIS 23001-11:2022(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
NATIONAL REGULATIONS. © ISO/IEC 2022

---------------------- Page: 1 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
FINAL
INTERNATIONAL ISO/IEC
DRAFT
STANDARD FDIS
23001-11
ISO/IEC JTC 1/SC 29
Information technology — MPEG
Secretariat: JISC
systems technologies —
Voting begins on:
Part 11:
Voting terminates on:
Energy-efficient media consumption
(green metadata)
Technologies de l'information — Technologies des systèmes MPEG —
Partie 11: Consommation des supports éconergétiques (métadonnées
vertes)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2022
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting on
the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address below
or ISO’s member body in the country of the requester.
RECIPIENTS OF THIS DRAFT ARE INVITED TO
ISO copyright office
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
CP 401 • Ch. de Blandonnet 8
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
CH-1214 Vernier, Geneva
DOCUMENTATION.
Phone: +41 22 749 01 11
IN ADDITION TO THEIR EVALUATION AS
Reference number
Email: copyright@iso.org
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO­
ISO/IEC FDIS 23001­11:2022(E)
Website: www.iso.org
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
Published in Switzerland
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN­
DARDS TO WHICH REFERENCE MAY BE MADE IN
ii
  © ISO/IEC 2022 – All rights reserved
NATIONAL REGULATIONS. © ISO/IEC 2022

---------------------- Page: 2 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
Contents Page
Foreword .v
Introduction . vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions, symbols, abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Symbols and abbreviated terms . 2
3.2.1 Symbols. 2
3.2.2 Abbreviations . 3
4 Conventions . 4
4.1 Arithmetic operators . 4
4.2 Relational operators . 4
4.3 Bit­wise operators . 4
4.4 Assignment operators . 5
4.5 Range notation . 5
4.6 Mathematical functions . 5
4.7 Specification of syntax functions and descriptors . 6
5 Functional architecture . 6
5.1 Description of the functional architecture . 6
5.2 Definition of components in the functional architecture. 7
6 Decoder power reduction . 8
6.1 General . 8
6.2 Complexity metrics for decoder-power reduction . 8
6.2.1 General . 8
6.2.2 Syntax . . 8
6.2.3 Signalling .12
6.2.4 Semantics . 12
6.3 Interactive signalling for remote decoder­power reduction . 35
6.3.1 General . 35
6.3.2 Syntax . . 35
6.3.3 Signalling . 36
6.3.4 Semantics . 36
7 Display power reduction using display adaptation .37
7.1 General . 37
7.2 Syntax . 37
7.2.1 Systems without a signalling mechanism from the receiver to the
transmitter . 37
7.2.2 Systems with a signalling mechanism from the receiver to the transmitter .38
7.3 Signalling .38
7.3.1 Systems without a signalling mechanism from the receiver to the
transmitter .38
7.3.2 Systems with a signalling mechanism from the receiver to the transmitter .38
7.4 Semantics .38
8 Energy-efficient media selection .40
8.1 General .40
8.2 Syntax .40
8.3 Signalling .40
8.4 Semantics . 41
8.4.1 Decoder­power indication metadata semantics . . 41
8.4.2 Display-power indication metadata semantics . 41
9 Metrics for quality recovery after low-power encoding .42
iii
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 3 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
9.1 General . 42
9.2 Syntax . 42
9.2.1 AVC and HEVC syntax . . . 42
9.2.2 VVC syntax . 42
9.3 Signalling . 42
9.4 Semantics . 43
9.4.1 AVC and HEVC Semantics . 43
9.4.2 VVC Semantics . 43
10 Conformance and reference software. 44
Annex A (normative) Supplemental Enhancement Information (SEI) syntax.45
Annex B (informative) Implementation guidelines for the usage of green metadata .51
Annex C (normative) Conformance and reference software .73
Annex D (informative) Objective distortion metrics .78
Bibliography .83
iv
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 4 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical
activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non­governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance
are described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria
needed for the different types of document should be noted. This document was drafted in
accordance with the editorial rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives or
www.iec.ch/members_experts/refdocs).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www.iso.org/patents) or the IEC
list of patent declarations received (see https://patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to
the World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see
www.iso.org/iso/foreword.html. In the IEC, see www.iec.ch/understanding­standards.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
This third edition cancels and replaces the second edition (ISO/IEC 23001­11:2019), which has been
technically revised.
The main changes are as follows:
— 6.2 related to complexity metrics for decoder-power reduction is amended by the specification of a
new VVC SEI message carrying complexity metrics for decoder-power reduction.
— Clause 9 related to metrics for quality recovery after low-power encoding is amended by the
specification of additional metrics for quality recovery after low-power encoding in the newly
added VVC SEI message.
— 6.3 related to interactive signalling for remote decoder-power reduction is amended by adding new
syntax elements allowing a finer control by decoder of the encoding operations.
A list of all parts in the ISO/IEC 23001 series can be found on the ISO and IEC websites.
Any feedback or questions on this document should be directed to the user’s national standards
body. A complete listing of these bodies can be found at www.iso.org/members.html and
www.iec.ch/national­committees.
v
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 5 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
Introduction
This document specifies the metadata (green metadata) that facilitates reduction of energy usage
during media consumption as follows:
— the format of the metadata that enables reduced decoder power consumption;
— the format of the metadata that enables reduced display power consumption;
— the format of the metadata that enables media selection for joint decoder and display power
reduction;
— the format of the metadata that enables quality recovery after low-power encoding.
This metadata facilitates reduced energy usage during media consumption without any degradation
in the quality of experience (QoE). However, it is also possible to use this metadata to get larger energy
savings, but at the expense of some QoE degradation.
The metadata for energy-efficient decoding specifies two sets of information: complexity metrics (CM)
metadata and decoding operation reduction request (DOR-Req) metadata. A decoder uses CM metadata
to vary operating frequency and thus reduce decoder power consumption. In a point-to-point video
conferencing application, the remote encoder uses the DOR-Req metadata to modify the decoding
complexity of the bitstream and thus reduce local decoder power consumption.
The metadata for energy-efficient encoding specifies quality metrics that are used by a decoder to
reduce the quality loss from low-power encoding.
The metadata for energy-efficient presentation specifies RGB-component statistics and quality levels. A
presentation subsystem uses this metadata to reduce power by adjusting display parameters, based on
the statistics, to provide a desired quality level from those provided in the metadata.
The metadata for energy-efficient media selection specifies DOR-Req parameters, RGB-component
statistics and quality levels. The client in an adaptive streaming session uses this metadata to determine
decoder and display power-saving characteristics of available video representations and to select the
representation with the optimal quality for a given power-saving.
vi
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 6 ----------------------
FINAL DRAFT INTERNATIONAL STANDARD ISO/IEC FDIS 23001-11:2022(E)
Information technology — MPEG systems technologies —
Part 11:
Energy-efficient media consumption (green metadata)
1 Scope
This document specifies metadata for energy-efficient decoding, encoding, presentation, and selection
of media.
2 Normative references
The following documents are referred to in the text in such a way that some or all of their content
constitutes requirements of this document. For dated references, only the edition cited applies. For
undated references, the latest edition of the referenced document (including any amendments) applies.
ISO/IEC 14496­10, Information technology — Coding of audio-visual objects — Part 10: Advanced Video
Coding
ISO/IEC 23008­2, Information technology — High efficiency coding and media delivery in heterogeneous
environments — Part 2: High efficiency video coding
ISO/IEC 23009­1, Information technology — Dynamic adaptive streaming over HTTP (DASH) — Part 1:
Media presentation description and segment formats
ISO/IEC 23090­3, Information technology — Coded representation of immersive media — Part 3: Versatile
video coding
3 Terms, definitions, symbols, abbreviated terms
3.1 Terms and definitions
For the purposes of this document, the terms and definitions given in ISO/IEC 14496-10, ISO/IEC 23008-2,
ISO/IEC 23009-1, ISO/IEC 23090-3 and the following apply.
ISO and IEC maintain terminology databases for use in standardization at the following addresses:
— ISO Online browsing platform: available at https:// www .iso .org/ obp
— IEC Electropedia: available at https:// www .electropedia .org/
3.1.1
alpha-point deblocking instance
APDI
single filtering operation that produces either a single, filtered output p' or a single, filtered output q' ,
0 0
where p' and q' are filtered samples across a 4x4 block edge
0 0
3.1.2
deblocking filtering instance
single filtering operation that produces either a single, filtered output p' or a single, filtered output q',
where p' and q' are filtered samples across an 8x8 and 4x4 block edge for HEVC and VVC, respectively
1
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 7 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
3.1.3
decoding process
process that reads a bitstream and derives decoded pictures from it
Note 1 to entry: The decoding process is specified in ISO/IEC 14496-10, ISO/IEC 23008-2 or ISO/IEC 23090-3.
3.1.4
encoding process
process that produces a bitstream
Note 1 to entry: The bitstream shall conform to ISO/IEC 14496-10, ISO/IEC 23008-2 or ISO/IEC 23090-3.
3.1.5
no-quality-loss operating point
NQLOP
metadata-enabled operating point associated with the largest display-power reduction that can be
achieved without any quality loss (infinite PSNR)
3.1.6
non-zero block
block containing at least one non-zero transform coefficient
3.1.7
peak signal
maximum permissible RGB component in a reconstructed frame
N
Note 1 to entry: For N­bit video, peak signal is (2 – 1).
3.1.8
period
interval over which complexity-metrics metadata are applicable
3.1.9
pixel
smallest addressable element in an all-points addressable display device
3.1.10
reconstructed frames
frames obtained after applying RGB colour-space conversion and cropping to the specific decoded
picture or pictures for which display power-reduction metadata are applicable
3.1.11
RGB component
single sample representing one of the three primary colours of the RGB colour space
3.1.13
six-tap filtering
STF
single application of the 6-tap filter to generate a single filtered sample for fractional positions using
the samples at integer­sample positions
3.2 Symbols and abbreviated terms
3.2.1 Symbols
+ addition
­ subtraction (as a two-argument operator) or negation (as a unary prefix operator)
* multiplication
2
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 8 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
/ integer division with truncation of the result toward zero. For example, 7 / 4 and −7 / −4
are truncated to 1 and −7 / 4 and 7 / −4 are truncated to −1
÷ division in mathematical equations where no truncation or rounding is intended
3.2.2 Abbreviations
APDI alpha­point deblocking instance
ASIC application specific integrated circuit
AVC advanced video coding – ISO/IEC 14496­10
BMFF base media file format
CM complexity metric
CMOS complementary metal oxide semiconductor
CMP cubemap projection format
CPU central processing Unit
DASH dynamic adaptive streaming over HTTP
DOR­Ratio decoding operation reduction ratio
DOR-Req decoding operation reduction request
DVFS dynamic voltage frequency scaling
ERP equi-rectangular projection format
Fps frames per second
FS fresh start
GP good picture
HEVC high efficiency video coding – ISO/IEC 23008-2
HCMP hemisphere cubemap projection format
Mbps mega bits per second
MPD media presentation description
MSD mean square difference
MV motion vector
NQLOP no-quality-loss operating point
PSNR peak signal­to­noise ratio
QoE quality of experience
RBLL remaining battery life level
RGB red, green, blue
3
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 9 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
SEI supplemental enhancement information
SP start picture
STF six-tap filtering
SSIM structural similarity index measure
VVC versatile video coding – ISO/IEC 23090­3
XSD cross­segment decoding
wPSNR weighted peak signal­to­noise ratio
WS­PSNR weighted to spherically uniform peak signal-to-noise ratio
4 Conventions
4.1 Arithmetic operators
y
x exponentiation
x/y division where no truncation or rounding is intended
division where no truncation or rounding is intended
y

summation of fi() with i taking all integer values from x up to and including y
fi()
∑
ix =
y

summation of fp() with p taking all integer location values in a block B in a picture
fp()
∑
pB in
Modulus.
x % y
Remainder of x divided by y, defined only for integers x and y with x >= 0 and y > 0
4.2 Relational operators
> greater than
>= greater than or equal to
< less than
<= less than or equal to
= = equal to
!= not equal to
When a relational operator is applied to a syntax element or variable that has been assigned the value
"na" (not applicable), the value "na" is treated as a distinct value for the syntax element or variable. The
value "na" is considered not to be equal to any other value.
4.3 Bit-wise operators
x >> y arithmetic right shift of a two's complement integer representation of x by y binary digits
4
  © ISO/IEC 2022 – All rights reserved

---------------------- Page: 10 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
This function is defined only for non-negative integer values of y. Bits shifted into the
most significant bits (MSBs) as a result of the right shift have a value equal to the MSB
of x prior to the shift operation.
x << y arithmetic left shift of a two's complement integer representation of x by y binary digits
This function is defined only for non-negative integer values of y. Bits shifted into the

least significant bits (LSBs) as a result of the left shift have a value equal to 0.
4.4 Assignment operators
= assignment operator
++ increment, i.e., x++ is equivalent to x = x + 1; when used in an array index, evaluates to
the value of the variable prior to the increment operation
− − decrement, i.e., x− − is equivalent to x = x − 1; when used in an array index, evaluates to
the value of the variable prior to the decrement operation
+= increment by amount specified, i.e., x += 3 is equivalent to x = x + 3, and x += (−3) is
equivalent to x = x + (−3)
−= decrement by amount specified, i.e., x −= 3 is equivalent to x = x − 3, and x −= (−3) is
equivalent to x = x − (−3)
4.5 Range notation
x = y.z x takes on integer values starting from y to z, inclusive, with x, y, and z being integer
numbers and z being greater than or equal to y
4.6 Mathematical functions
Mathematical functions are defined as follows:
−x ,   x < 0

Abs(x)= (4­1)

  x ,   x 0≥

   xx,   < 256

Clip(x)= (4­2)

255,   otherwise

xz; < x


Clip3( x, y, z ) = yz; > y (4­3)


z ;otherwise

Floor(x) is the greatest integer less than or equal to x (4­4)
Log10(x) returns the base­10 logarithm of x (4­5)
Round(x) = Sign(x) * Floor(Abs(x) + 0.5) (4­6)
−1,   x < 0

Sign(x)= (4­7)

 10,   x ≥

y
x specifies x to the power of y (4­8)
5
© ISO/IEC 2022 – All rights reserved

---------------------- Page: 11 ----------------------
ISO/IEC FDIS 23001-11:2022(E)
power(x, y) specifies x to the power of y (4­9)
4.7 Specification of syntax functions and descriptors
The following function is used in the specification of the syntax:
read_bits( n ) reads the next n bits from the bitstream and advances the bitstream pointer by n bit
positions. When n is equal to 0, read_bits( n ) is specified to return a value equal to 0 and to not advance
the bitstream pointer.
The following descriptors specify the parsing process of each syntax element:
— u(n): unsigned integer using n bits. The parsing process for this descriptor is specified by the return
value of the function read_bits( n ) interpreted as a binary representation of an unsigned integer
with most significant bit written first.
— s(n): signed integer using n bits. The parsing process for this descriptor is specified by the return
value of the function read_bits( n ) interpreted as a two's complement integer representation with
...