SIST ES 204 083 V1.1.1:2025
(Main)Environmental Engineering (EE) - Energy Efficiency measurement methodology and metrics for heterogeneous servers
Environmental Engineering (EE) - Energy Efficiency measurement methodology and metrics for heterogeneous servers
The present document is based upon benchmark for server Energy Efficiency (EE) tool for general and heterogeneous servers [i.6].
The present document specifies:
1) test conditions and product configuration for the assessment of EE of heterogeneous servers using reliable, accurate and reproducible measurement methods;
2) an EE metric to support procurement requirements;
3) requirements for equipment to perform the measurements and analysis;
4) requirements for the measurement process;
5) requirements for the management of the EE metric calculation;
6) operation or run rules to configure, execute, and monitor the testing;
7) documentation and reporting requirements.
The metrics and methods apply to heterogeneous servers with various configurations, including type and count of APAs, CPU, memory, storage and any other add-on hardware expected to be present when deployed.
NOTE: Products whose feature set and intended operation are not addressed by active mode testing parameters are excluded from this evaluation method.
Okoljski inženiring (EE) - Metodologija merjenja energijske učinkovitosti in metrike za heterogene strežnike
Ta dokument temelji na primerjavi orodja za merjenje energijske učinkovitosti (EE) splošnih in heterogenih strežnikov [i.6]. Ta dokument določa: 1) preskusne pogoje in konfiguracijo izdelka za ocenjevanje energijske učinkovitosti heterogenih strežnikov z uporabo zanesljivih, natančnih in ponovljivih merilnih metod; 2) metriko energijske učinkovitosti za podporo zahtev glede nabave; 3) zahteve za opremo v zvezi z izvajanjem meritev in analize; 4) zahteve za postopek merjenja; 5) zahteve za upravljanje izračuna metrike energijske učinkovitosti; 6) pravila delovanja za konfiguriranje, izvajanje in spremljanje preskusov; 7) zahteve za dokumentiranje in poročanje. Metrike in metode se uporabljajo za strežnike z različnimi konfiguracijami, vključno z vrsto in številom pomožnih procesorskih pospeševalnikov (APA), centralnih procesnih enot (CPU), pomnilnikov, shramb ter poljubne druge dodatne strojne opreme, za katero se pričakuje, da je prisotna ob razmestitvi. OPOMBA: Izdelki z naborom funkcij in predvidenim delovanjem, ki jih parametri za preskušanje aktivnega delovanja ne obravnavajo, so izvzeti iz te metode vrednotenja.
General Information
Standards Content (Sample)
Final draft ETSI ES 204 083 V1.0.0 (2025-02)
ETSI STANDARD
Environmental Engineering (EE);
Energy Efficiency measurement methodology
and metrics for heterogeneous servers
2 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
Reference
DES/EE-EEPS46
Keywords
energy efficiency, power, server, sustainability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871
Important notice
The present document can be downloaded from the
ETSI Search & Browse Standards application.
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format on ETSI deliver repository.
Users should be aware that the present document may be revised or have its status changed,
this information is available in the Milestones listing.
If you find errors in the present document, please send your comments to
the relevant service listed under Committee Support Staff.
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure (CVD) program.
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.
Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.
© ETSI 2025.
All rights reserved.
ETSI
3 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
Introduction . 7
1 Scope . 8
2 References . 8
2.1 Normative references . 8
2.2 Informative references . 8
3 Definition of terms, symbols and abbreviations . 9
3.1 Terms . 9
3.2 Symbols . 11
3.3 Abbreviations . 11
4 Heterogeneous server product categories and representative product configurations. 12
4.1 General . 12
4.2 Applications and metric applicability . 12
4.3 Product categories . 13
4.3.1 General requirements . 13
4.3.2 Form-factors . 13
4.3.3 Categories . 13
4.4 Product family configuration . 13
4.4.1 General . 13
4.4.2 "High-end" performance configuration . 14
4.4.3 "Low-end" performance configuration . 14
5 Metrics . 15
5.1 Worklets . 15
5.2 Formulae. 15
5.2.1 General . 15
5.2.2 Weightings . 16
6 Test setup . 16
6.1 General . 16
6.2 Environmental conditions . 16
6.2.1 Ambient Temperature . 16
6.2.2 Relative Humidity . 16
6.3 Temperature sensor . 16
6.4 Input power . 17
6.5 Power requirements . 17
6.6 Energy consumption analyser. 17
6.7 Test tool . 18
6.8 Controller system . 18
7 Equipment Under Test. 18
7.1 Configuration . 18
7.2 Test procedure . 20
8 Measurement . 21
8.1 Measurement for active state . 21
8.2 Re-verification and audits . 21
8.3 Measurement for power supply . 22
8.3.1 Measurement for internal power supply . 22
8.3.2 Measurement for test board power supply . 22
8.3.2.1 General . 22
8.3.2.2 Test loads . 22
8.3.2.3 Test leads and wiring . 22
ETSI
4 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
8.3.2.4 Warm up time . 22
8.3.2.5 Power measurements . 23
9 Measurement report . 23
History . 24
ETSI
5 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
List of tables
Table 1: Configuration of EUT .18
Table 2: Test configuration of EUT .20
Table 3: Measurement of active state efficiency .21
Table 4: Measurement of internal power supply .22
ETSI
6 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI IPR online database.
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its
Members. 3GPP™, LTE™ and 5G™ logo are trademarks of ETSI registered for the benefit of its Members and of the
3GPP Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of ®
the oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This final draft ETSI Standard (ES) has been produced by ETSI Technical Committee Environmental Engineering (EE),
and is now submitted for the ETSI Membership Approval Procedure (MAP).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
7 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
Introduction
Computer server and data centers have experienced a rapid increase, playing the central role in digital services. With the
development of Artificial Intelligence (AI), heterogeneous servers equipped with more than one type of processors
(CPU, GPU, FPGA, ASIC, etc., the abbreviations defined in clauses 3.1 and 3.3) play an increasingly important role
and take a growing market share in computing industry. Heterogeneous servers gain extra performance by adding the
dissimilar coprocessors, usually incorporating specialized processing capabilities to handle particular tasks [i.4].
Categories of heterogeneous servers include CPU+GPU server, CPU+FPGA server, CPU+ASIC server. The most
popular heterogeneous server type is the CPU+GPU server, which is commonly used to accelerate the training process
of deep learning by parallel computing.
For heterogeneous servers, the better performance the higher the energy consumption. There is a tradeoff between the
performance and energy consumption for the high performance heterogeneous servers. Energy Efficiency (EE) that
scales the server performance and energy consumption is one of the critical factors of the server operation and
maintenance. ETSI EN 303 470 [i.5] specifies the metric and method for EE assessment of general servers. However,
there is currently no standard for EE assessment of heterogeneous servers.
The present document specifies a metric for the assessment of EE of heterogeneous servers using reliable, accurate and
reproducible measurement methods, which take into account the recognized state-of-the-art. The present document
formalizes the tools, conditions and calculations used to generate a single figure of merit of a single heterogeneous
server representing its relative EE and power consumption. The single figure EE metric is targeted for use as a tool in
the selection process of heterogeneous servers to be provisioned.
For comparisons, evaluations should be conducted across similar heterogeneous server types or categories. The EE
metric is targeted for identify energy saving servers by differentiating the ability of heterogeneous servers to be
provisioned for mainstream market. The present document does not prescribe the levels or values for acceptance but
prescribes a method of evaluation which EE programs could use to establish such criteria.
As there are many operational deployments of heterogeneous servers resulting in a range of specialized equipment and
configurations for a single heterogeneous server product, an EE metric that evaluates provisioning impacts to general
purpose operations may not be applicable. ICT equipment, and servers in particular, are generally customized and
commissioned on site for deployment. As with most ICT equipment, new technologies are regularly introduced, which
may require product level customization or an industry wide tool upgrade to more appropriately represent the EE of the
heterogeneous servers.
The present document categorizes heterogeneous servers to address applicability, configuration groupings to represent a
diversity of heterogeneous servers to address the broad range of custom configurations, as wells as a tool revision
control to ensure comparability and consistency of the resulting metric value.
The present document was developed jointly by ETSI TC EE and ITU-T Study Group 5 and published by ITU and
ETSI as Recommendation ITU-T L.EE_sgpu [i.6] and ETSI ES 204 083 (V1.1.1) (the present document), which are
technically equivalent.
ETSI
8 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
1 Scope
The present document is based upon benchmark for server Energy Efficiency (EE) tool for general and heterogeneous
servers [i.6].
The present document specifies:
1) test conditions and product configuration for the assessment of EE of heterogeneous servers using reliable,
accurate and reproducible measurement methods;
2) an EE metric to support procurement requirements;
3) requirements for equipment to perform the measurements and analysis;
4) requirements for the measurement process;
5) requirements for the management of the EE metric calculation;
6) operation or run rules to configure, execute, and monitor the testing;
7) documentation and reporting requirements.
The metrics and methods apply to heterogeneous servers with various configurations, including type and count of
APAs, CPU, memory, storage and any other add-on hardware expected to be present when deployed.
NOTE: Products whose feature set and intended operation are not addressed by active mode testing parameters
are excluded from this evaluation method.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found in the
ETSI docbox.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] IEEE 802.3az™: "The road to energy efficient ethernet".
[2] EN 62623:2013: "Desktop and notebook computers. Measurement of energy consumption",
(produced by CEN).
[3] IEEE 802.3™: "IEEE Standard for Ethernet".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
ETSI
9 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Commission Regulation (EU) 2019/424 of 15 March 2019 laying down ecodesign requirements
for servers and data storage products pursuant to Directive 2009/125/EC of the European
Parliament and of the Council and amending Commission Regulation (EU) No 617/2013.
[i.2] EN 60297 series: "Mechanical structures for electrical and electronic equipment. Dimensions of
mechanical structures of the 482,6 mm (19 in) series", (produced by CEN).
[i.3] ETSI EN 300 119 series: "Equipment Engineering (EE); European telecommunication standard for
equipment practice".
[i.4] Shan, Amar (2006): "Heterogeneous Processing: a Strategy for Augmenting Moore's Law". ®
Linux Journal. ®
NOTE: Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
[i.5] ETSI EN 303 470 (V1.1.1) (2019): "Environmental Engineering (EE); Energy Efficiency
Measurement methodology and metrics for servers".
[i.6] Recommendation ITU-T L.EE_sgpu on Energy Efficiency measurement methodology and metrics
for heterogeneous servers.
NOTE: Recommendation ITU-T L.EE_sgpu is at the time of publication only the draft working title.
Recommendation ITU-T L.1311 should be the official number to be decided in May/June 2025.
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
active state: operational state of a computer server (as opposed to the idle state) in which the computer server is
carrying out work in response to prior or concurrent external requests (e.g. instruction over the network)
NOTE 1: The work in the present document includes, but is not restricted to, active processing and data
seeking/retrieval from memory, cache, or internal/external storage while awaiting further input over the
network.
NOTE 2: See ETSI EN 303 470 [i.5].
Application-Specific Integrated Circuit (ASIC): integrated circuit designed and manufactured according to specific
user requirements and specific electronic system requirements
NOTE 1: Processor units belong to ASIC include, but are not limited to:
a) Tensor Processing Unit (TPU): an AI accelerator ASIC that is developed specifically for neural
network machine learning by Google;
b) Vision Processing Unit (VPU): a specific type of AI accelerator, designed to accelerate machine
vision tasks;
c) Neural Processing Unit (NPU): a specialized processing unit that is designed to accelerate artificial
intelligence and machine learning applications, including artificial neural networks and machine
vision;
d) Deep Learning Processing Unit (DPU): a processor designed for deep learning that has the ability
to handle large-scale neural networks.
NOTE 2: DSP is used in Embedded and Real-time Systems.
ETSI
10 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
Auxiliary Processing Accelerator (APA): additional compute device installed in the computer server that handles
parallelized workloads
NOTE 1: This includes, but is not limited to, Graphical Processing Units (GPUs), Field Programmable Gate Array
(FPGA) or Application-Specific Integrated Circuit (ASIC) chips which can be installed in a server either
on Graphics or Extension add-in cards installed in general-purpose add-in expansion slots (e.g. GPGPUs,
CPU accelerators, etc. installed in a PCI/PCIe slot) or directly attached to a server component such as the
motherboard.
NOTE 2: There are two specific types of APAs used in servers:
a) Expansion APA: an APA that is on an add-in card installed in an add-in expansion slot
(e.g. GPGPUs, CPU accelerators, etc. installed in a PCI/PCIe slot). An expansion APA add-in card
may include one or more APAs.
b) Integrated APA: an APA that is integrated into the motherboard or CPU package or an expansion
APA that has part of its subsystem, such as switches, included in the non-APA server configuration
that would be used to run the energy efficiency test.
NOTE 3: See ETSI EN 303 470 [i.5].
blade chassis: enclosure that contains shared resources for the operation of blade servers and other blade form-factor
devices
NOTE 1: Shared resources provided by a chassis include, but are not restricted to, power supplies, data storage, and
hardware for d.c. power distribution, thermal management, system management, and network services.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
blade server: computer server, designed for use in a blade chassis, that is a high-density device and functions as an
independent computer server and includes at least one processor and system memory, which is dependent upon shared
blade chassis resources (e.g. power supplies, cooling) for operation
NOTE 1: A processor or memory module that is intended to scale up a standalone server is not considered a blade
server.
NOTE 2: See ETSI EN 303 470 [i.5].
blade system: blade chassis and one or more removable blade servers and/or other units which provide a scalable
means for combining multiple blade server or storage units in a single enclosure
NOTE 1: A blade system is designed to allow service technicians to easily add or replace (hot-swap) blades in the
field.
NOTE 2: See ETSI EN 303 470 [i.5].
controller system: computer or computer server that manages a benchmark evaluation process
deployed power: average power level of the utilization applicable to the total number of servers provisioned to meet an
aggregate peak load
hypervisor: supervisory system level software that establishes and manages a virtualized environment which enables
multiple operating systems to run on a single physical system at the same time
pedestal server: self-contained computer server that is designed with power supply units, cooling, input/output devices,
and other resources necessary for stand-alone operation within a frame similar to that of a tower client computer
NOTE: See ETSI EN 303 470 [i.5].
processor: digital circuit which performs operations on some external data source, usually memory or some other data
stream
NOTE: This includes, but is not limited to, Central Processing Unit (CPU), Graphics Processing Unit (GPU),
Neural Processing Unit (NPU), Tensor Processing Unit (TPU), Deep Learning Processing Unit (DPU),
Vision Processing Unit (VPU), etc.
ETSI
11 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
rack-mounted server: computer server that is designed for deployment in a standard 19 inch ICT equipment rack
NOTE 1: As defined by EN 60297 [i.2] or ETSI EN 300 119 [i.3].
NOTE 2: For the purposes of the present document, a blade server is considered under a separate product category
and excluded from the rack-mounted product category.
server: computing product that provides services and manages networked resources for client devices
NOTE 1: Client devices such as desktop computers, notebook computers, desktop thin clients, internet protocol
telephones, smartphones, tablets, tele-communication, automated systems or other servers, primarily
accessed via network connections, and not through direct user input devices, such as a keyboard or a
mouse and with the following characteristics:
a) it is designed to support server Operating Systems (OSs) and/or hypervisors, and targeted to run user-installed
enterprise applications;
b) it supports error-correcting code and/or buffered memory (including both buffered dual in-line memory
modules and buffered on board configurations);
c) all processors have access to shared system memory and are independently visible to a single OS or
hypervisor.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
single-wide blade server: blade server requiring the width of a standard blade server bay
NOTE: See ETSI EN 303 470 [i.5].
worklet: synthetic software routine, using real application functions focused on a particular type of computing activity,
which stresses a particular characteristic of the system
NOTE 1: A floating point and integer performance stress code is an example of a CPU worklet.
NOTE 2: An image classification training code is an example of AI worklet.
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
a.c, AC alternating current
ACPI Advanced Configuration and Power Interface
APA Auxiliary Processing Accelerator
ASIC Application-Specific Integrated Circuit
BIOS Basic Input/Output System
CENELEC European Committee for Electrotechnical Standardization
CPU Central Processing Unit
CSJ Correctly predicted Samples per Joule
d.c, DC direct current
DDR Double Data Rate
DIMM Dual In-line Memory Module
DPU Deep learning Processing Unit
DRAM Dynamic Random Access Memory
DSP Digital Signal Processor
EDP Energy Delay Product
EE Energy Efficiency
EEE Energy Efficient Ethernet
EUT Equipment Under Test
FPGA Field Programmable Gate Array
ETSI
12 Final draft ETSI ES 204 083 V1.0.0 (2025-02)
GPGPU General-Purpose computing on Graphical Processing Units
GPU Graphical Processing Unit
HDD Hard Disk Drive
I/O Input/Output
ICT Information and Communications Technology
ISO/IEC International Organization for Standardization/International Electrotechnical Commission
NPU Neural Processing Unit
OS Operating System
PCI Peripheral Component Interconnect
PCIe Peripheral Component Interconnect express
PDU Power Distribution Unit
PSU Power Supply Unit
RMS Root Mean Square
SSD Solid State Drive
TPU Tensor Processing Unit
UPS Uninterruptable Power
...
ETSI ES 204 083 V1.1.1 (2025-04)
ETSI STANDARD
Environmental Engineering (EE);
Energy Efficiency measurement methodology
and metrics for heterogeneous servers
2 ETSI ES 204 083 V1.1.1 (2025-04)
Reference
DES/EE-EEPS46
Keywords
energy efficiency, power, server, sustainability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871
Important notice
The present document can be downloaded from the
ETSI Search & Browse Standards application.
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format on ETSI deliver repository.
Users should be aware that the present document may be revised or have its status changed,
this information is available in the Milestones listing.
If you find errors in the present document, please send your comments to
the relevant service listed under Committee Support Staff.
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure (CVD) program.
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.
Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.
© ETSI 2025.
All rights reserved.
ETSI
3 ETSI ES 204 083 V1.1.1 (2025-04)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
Introduction . 7
1 Scope . 8
2 References . 8
2.1 Normative references . 8
2.2 Informative references . 8
3 Definition of terms, symbols and abbreviations . 9
3.1 Terms . 9
3.2 Symbols . 11
3.3 Abbreviations . 11
4 Heterogeneous server product categories and representative product configurations. 12
4.1 General . 12
4.2 Applications and metric applicability . 12
4.3 Product categories . 13
4.3.1 General requirements . 13
4.3.2 Form-factors . 13
4.3.3 Categories . 13
4.4 Product family configuration . 13
4.4.1 General . 13
4.4.2 "High-end" performance configuration . 14
4.4.3 "Low-end" performance configuration . 14
5 Metrics . 15
5.1 Worklets . 15
5.2 Formulae. 15
5.2.1 General . 15
5.2.2 Weightings . 16
6 Test setup . 16
6.1 General . 16
6.2 Environmental conditions . 16
6.2.1 Ambient Temperature . 16
6.2.2 Relative Humidity . 16
6.3 Temperature sensor . 16
6.4 Input power . 17
6.5 Power requirements . 17
6.6 Energy consumption analyser. 17
6.7 Test tool . 18
6.8 Controller system . 18
7 Equipment Under Test. 18
7.1 Configuration . 18
7.2 Test procedure . 20
8 Measurement . 21
8.1 Measurement for active state . 21
8.2 Re-verification and audits . 21
8.3 Measurement for power supply . 22
8.3.1 Measurement for internal power supply . 22
8.3.2 Measurement for test board power supply . 22
8.3.2.1 General . 22
8.3.2.2 Test loads . 22
8.3.2.3 Test leads and wiring . 22
ETSI
4 ETSI ES 204 083 V1.1.1 (2025-04)
8.3.2.4 Warm up time . 22
8.3.2.5 Power measurements . 23
9 Measurement report . 23
History . 24
ETSI
5 ETSI ES 204 083 V1.1.1 (2025-04)
List of tables
Table 1: Configuration of EUT .18
Table 2: Test configuration of EUT .20
Table 3: Measurement of active state efficiency .21
Table 4: Measurement of internal power supply .22
ETSI
6 ETSI ES 204 083 V1.1.1 (2025-04)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI IPR online database.
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its
Members. 3GPP™, LTE™ and 5G™ logo are trademarks of ETSI registered for the benefit of its Members and of the
3GPP Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of ®
the oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This ETSI Standard (ES) has been produced by ETSI Technical Committee Environmental Engineering (EE).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
7 ETSI ES 204 083 V1.1.1 (2025-04)
Introduction
Computer server and data centers have experienced a rapid increase, playing the central role in digital services. With the
development of Artificial Intelligence (AI), heterogeneous servers equipped with more than one type of processors
(CPU, GPU, FPGA, ASIC, etc., the abbreviations defined in clauses 3.1 and 3.3) play an increasingly important role
and take a growing market share in computing industry. Heterogeneous servers gain extra performance by adding the
dissimilar coprocessors, usually incorporating specialized processing capabilities to handle particular tasks [i.4].
Categories of heterogeneous servers include CPU+GPU server, CPU+FPGA server, CPU+ASIC server. The most
popular heterogeneous server type is the CPU+GPU server, which is commonly used to accelerate the training process
of deep learning by parallel computing.
For heterogeneous servers, the better performance the higher the energy consumption. There is a tradeoff between the
performance and energy consumption for the high performance heterogeneous servers. Energy Efficiency (EE) that
scales the server performance and energy consumption is one of the critical factors of the server operation and
maintenance. ETSI EN 303 470 [i.5] specifies the metric and method for EE assessment of general servers. However,
there is currently no standard for EE assessment of heterogeneous servers.
The present document specifies a metric for the assessment of EE of heterogeneous servers using reliable, accurate and
reproducible measurement methods, which take into account the recognized state-of-the-art. The present document
formalizes the tools, conditions and calculations used to generate a single figure of merit of a single heterogeneous
server representing its relative EE and power consumption. The single figure EE metric is targeted for use as a tool in
the selection process of heterogeneous servers to be provisioned.
For comparisons, evaluations should be conducted across similar heterogeneous server types or categories. The EE
metric is targeted for identify energy saving servers by differentiating the ability of heterogeneous servers to be
provisioned for mainstream market. The present document does not prescribe the levels or values for acceptance but
prescribes a method of evaluation which EE programs could use to establish such criteria.
As there are many operational deployments of heterogeneous servers resulting in a range of specialized equipment and
configurations for a single heterogeneous server product, an EE metric that evaluates provisioning impacts to general
purpose operations may not be applicable. ICT equipment, and servers in particular, are generally customized and
commissioned on site for deployment. As with most ICT equipment, new technologies are regularly introduced, which
may require product level customization or an industry wide tool upgrade to more appropriately represent the EE of the
heterogeneous servers.
The present document categorizes heterogeneous servers to address applicability, configuration groupings to represent a
diversity of heterogeneous servers to address the broad range of custom configurations, as wells as a tool revision
control to ensure comparability and consistency of the resulting metric value.
The present document was developed jointly by ETSI TC EE and ITU-T Study Group 5 and published by ITU and
ETSI as Recommendation ITU-T L.EE_sgpu [i.6] and ETSI ES 204 083 (V1.1.1) (the present document), which are
technically equivalent.
ETSI
8 ETSI ES 204 083 V1.1.1 (2025-04)
1 Scope
The present document is based upon benchmark for server Energy Efficiency (EE) tool for general and heterogeneous
servers [i.6].
The present document specifies:
1) test conditions and product configuration for the assessment of EE of heterogeneous servers using reliable,
accurate and reproducible measurement methods;
2) an EE metric to support procurement requirements;
3) requirements for equipment to perform the measurements and analysis;
4) requirements for the measurement process;
5) requirements for the management of the EE metric calculation;
6) operation or run rules to configure, execute, and monitor the testing;
7) documentation and reporting requirements.
The metrics and methods apply to heterogeneous servers with various configurations, including type and count of
APAs, CPU, memory, storage and any other add-on hardware expected to be present when deployed.
NOTE: Products whose feature set and intended operation are not addressed by active mode testing parameters
are excluded from this evaluation method.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found in the
ETSI docbox.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] IEEE 802.3az™: "The road to energy efficient ethernet".
[2] EN 62623:2013: "Desktop and notebook computers. Measurement of energy consumption",
(produced by CEN).
[3] IEEE 802.3™: "IEEE Standard for Ethernet".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
ETSI
9 ETSI ES 204 083 V1.1.1 (2025-04)
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Commission Regulation (EU) 2019/424 of 15 March 2019 laying down ecodesign requirements
for servers and data storage products pursuant to Directive 2009/125/EC of the European
Parliament and of the Council and amending Commission Regulation (EU) No 617/2013.
[i.2] EN 60297 series: "Mechanical structures for electrical and electronic equipment. Dimensions of
mechanical structures of the 482,6 mm (19 in) series", (produced by CEN).
[i.3] ETSI EN 300 119 series: "Equipment Engineering (EE); European telecommunication standard for
equipment practice".
[i.4] Shan, Amar (2006): "Heterogeneous Processing: a Strategy for Augmenting Moore's Law". ®
Linux Journal. ®
NOTE: Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
[i.5] ETSI EN 303 470 (V1.1.1) (2019): "Environmental Engineering (EE); Energy Efficiency
Measurement methodology and metrics for servers".
[i.6] Recommendation ITU-T L.EE_sgpu on Energy Efficiency measurement methodology and metrics
for heterogeneous servers.
NOTE: Recommendation ITU-T L.EE_sgpu is at the time of publication only the draft working title.
Recommendation ITU-T L.1311 should be the official number to be decided in May/June 2025.
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
active state: operational state of a computer server (as opposed to the idle state) in which the computer server is
carrying out work in response to prior or concurrent external requests (e.g. instruction over the network)
NOTE 1: The work in the present document includes, but is not restricted to, active processing and data
seeking/retrieval from memory, cache, or internal/external storage while awaiting further input over the
network.
NOTE 2: See ETSI EN 303 470 [i.5].
Application-Specific Integrated Circuit (ASIC): integrated circuit designed and manufactured according to specific
user requirements and specific electronic system requirements
NOTE 1: Processor units belong to ASIC include, but are not limited to:
a) Tensor Processing Unit (TPU): an AI accelerator ASIC that is developed specifically for neural
network machine learning by Google;
b) Vision Processing Unit (VPU): a specific type of AI accelerator, designed to accelerate machine
vision tasks;
c) Neural Processing Unit (NPU): a specialized processing unit that is designed to accelerate artificial
intelligence and machine learning applications, including artificial neural networks and machine
vision;
d) Deep Learning Processing Unit (DPU): a processor designed for deep learning that has the ability
to handle large-scale neural networks.
NOTE 2: DSP is used in Embedded and Real-time Systems.
ETSI
10 ETSI ES 204 083 V1.1.1 (2025-04)
Auxiliary Processing Accelerator (APA): additional compute device installed in the computer server that handles
parallelized workloads
NOTE 1: This includes, but is not limited to, Graphical Processing Units (GPUs), Field Programmable Gate Array
(FPGA) or Application-Specific Integrated Circuit (ASIC) chips which can be installed in a server either
on Graphics or Extension add-in cards installed in general-purpose add-in expansion slots (e.g. GPGPUs,
CPU accelerators, etc. installed in a PCI/PCIe slot) or directly attached to a server component such as the
motherboard.
NOTE 2: There are two specific types of APAs used in servers:
a) Expansion APA: an APA that is on an add-in card installed in an add-in expansion slot
(e.g. GPGPUs, CPU accelerators, etc. installed in a PCI/PCIe slot). An expansion APA add-in card
may include one or more APAs.
b) Integrated APA: an APA that is integrated into the motherboard or CPU package or an expansion
APA that has part of its subsystem, such as switches, included in the non-APA server configuration
that would be used to run the energy efficiency test.
NOTE 3: See ETSI EN 303 470 [i.5].
blade chassis: enclosure that contains shared resources for the operation of blade servers and other blade form-factor
devices
NOTE 1: Shared resources provided by a chassis include, but are not restricted to, power supplies, data storage, and
hardware for d.c. power distribution, thermal management, system management, and network services.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
blade server: computer server, designed for use in a blade chassis, that is a high-density device and functions as an
independent computer server and includes at least one processor and system memory, which is dependent upon shared
blade chassis resources (e.g. power supplies, cooling) for operation
NOTE 1: A processor or memory module that is intended to scale up a standalone server is not considered a blade
server.
NOTE 2: See ETSI EN 303 470 [i.5].
blade system: blade chassis and one or more removable blade servers and/or other units which provide a scalable
means for combining multiple blade server or storage units in a single enclosure
NOTE 1: A blade system is designed to allow service technicians to easily add or replace (hot-swap) blades in the
field.
NOTE 2: See ETSI EN 303 470 [i.5].
controller system: computer or computer server that manages a benchmark evaluation process
deployed power: average power level of the utilization applicable to the total number of servers provisioned to meet an
aggregate peak load
hypervisor: supervisory system level software that establishes and manages a virtualized environment which enables
multiple operating systems to run on a single physical system at the same time
pedestal server: self-contained computer server that is designed with power supply units, cooling, input/output devices,
and other resources necessary for stand-alone operation within a frame similar to that of a tower client computer
NOTE: See ETSI EN 303 470 [i.5].
processor: digital circuit which performs operations on some external data source, usually memory or some other data
stream
NOTE: This includes, but is not limited to, Central Processing Unit (CPU), Graphics Processing Unit (GPU),
Neural Processing Unit (NPU), Tensor Processing Unit (TPU), Deep Learning Processing Unit (DPU),
Vision Processing Unit (VPU), etc.
ETSI
11 ETSI ES 204 083 V1.1.1 (2025-04)
rack-mounted server: computer server that is designed for deployment in a standard 19 inch ICT equipment rack
NOTE 1: As defined by EN 60297 [i.2] or ETSI EN 300 119 [i.3].
NOTE 2: For the purposes of the present document, a blade server is considered under a separate product category
and excluded from the rack-mounted product category.
server: computing product that provides services and manages networked resources for client devices
NOTE 1: Client devices such as desktop computers, notebook computers, desktop thin clients, internet protocol
telephones, smartphones, tablets, tele-communication, automated systems or other servers, primarily
accessed via network connections, and not through direct user input devices, such as a keyboard or a
mouse and with the following characteristics:
a) it is designed to support server Operating Systems (OSs) and/or hypervisors, and targeted to run user-installed
enterprise applications;
b) it supports error-correcting code and/or buffered memory (including both buffered dual in-line memory
modules and buffered on board configurations);
c) all processors have access to shared system memory and are independently visible to a single OS or
hypervisor.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
single-wide blade server: blade server requiring the width of a standard blade server bay
NOTE: See ETSI EN 303 470 [i.5].
worklet: synthetic software routine, using real application functions focused on a particular type of computing activity,
which stresses a particular characteristic of the system
NOTE 1: A floating point and integer performance stress code is an example of a CPU worklet.
NOTE 2: An image classification training code is an example of AI worklet.
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
a.c, AC alternating current
ACPI Advanced Configuration and Power Interface
APA Auxiliary Processing Accelerator
ASIC Application-Specific Integrated Circuit
BIOS Basic Input/Output System
CENELEC European Committee for Electrotechnical Standardization
CPU Central Processing Unit
CSJ Correctly predicted Samples per Joule
d.c, DC direct current
DDR Double Data Rate
DIMM Dual In-line Memory Module
DPU Deep learning Processing Unit
DRAM Dynamic Random Access Memory
DSP Digital Signal Processor
EDP Energy Delay Product
EE Energy Efficiency
EEE Energy Efficient Ethernet
EUT Equipment Under Test
FPGA Field Programmable Gate Array
ETSI
12 ETSI ES 204 083 V1.1.1 (2025-04)
GPGPU General-Purpose computing on Graphical Processing Units
GPU Graphical Processing Unit
HDD Hard Disk Drive
I/O Input/Output
ICT Information and Communications Technology
ISO/IEC International Organization for Standardization/International Electrotechnical Commission
NPU Neural Processing Unit
OS Operating System
PCI Peripheral Component Interconnect
PCIe Peripheral Component Interconnect express
PDU Power Distribution Unit
PSU Power Supply Unit
RMS Root Mean Square
SSD Solid State Drive
TPU Tensor Processing Unit
UPS Uninterruptable Power Supply
VPU Vision Processing Unit
4 Heterogeneous
...
SLOVENSKI STANDARD
01-september-2025
Okoljski inženiring (EE) - Metodologija merjenja energijske učinkovitosti in metrike
za heterogene strežnike
Environmental Engineering (EE) - Energy Efficiency measurement methodology and
metrics for heterogeneous servers
Ta slovenski standard je istoveten z: ETSI ES 204 083 V1.1.1 (2025-04)
ICS:
33.040.01 Telekomunikacijski sistemi Telecommunication systems
na splošno in general
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
ETSI ES 204 083 V1.1.1 (2025-04)
ETSI STANDARD
Environmental Engineering (EE);
Energy Efficiency measurement methodology
and metrics for heterogeneous servers
2 ETSI ES 204 083 V1.1.1 (2025-04)
Reference
DES/EE-EEPS46
Keywords
energy efficiency, power, server, sustainability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - APE 7112B
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° w061004871
Important notice
The present document can be downloaded from the
ETSI Search & Browse Standards application.
The present document may be made available in electronic versions and/or in print. The content of any electronic and/or
print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any
existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI
deliverable is the one made publicly available in PDF format on ETSI deliver repository.
Users should be aware that the present document may be revised or have its status changed,
this information is available in the Milestones listing.
If you find errors in the present document, please send your comments to
the relevant service listed under Committee Support Staff.
If you find a security vulnerability in the present document, please report it through our
Coordinated Vulnerability Disclosure (CVD) program.
Notice of disclaimer & limitation of liability
The information provided in the present deliverable is directed solely to professionals who have the appropriate degree of
experience to understand and interpret its content in accordance with generally accepted engineering or
other professional standard and applicable regulations.
No recommendation as to products and services or vendors is made or should be implied.
No representation or warranty is made that this deliverable is technically accurate or sufficient or conforms to any law
and/or governmental rule and/or regulation and further, no representation or warranty is made of merchantability or fitness
for any particular purpose or against infringement of intellectual property rights.
In no event shall ETSI be held liable for loss of profits or any other incidental or consequential damages.
Any software contained in this deliverable is provided "AS IS" with no warranties, express or implied, including but not
limited to, the warranties of merchantability, fitness for a particular purpose and non-infringement of intellectual property
rights and ETSI shall not be held liable in any event for any damages whatsoever (including, without limitation, damages
for loss of profits, business interruption, loss of information, or any other pecuniary loss) arising out of or related to the use
of or inability to use the software.
Copyright Notification
No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and
microfilm except as authorized by written permission of ETSI.
The content of the PDF version shall not be modified without the written authorization of ETSI.
The copyright and the foregoing restriction extend to reproduction in all media.
© ETSI 2025.
All rights reserved.
ETSI
3 ETSI ES 204 083 V1.1.1 (2025-04)
Contents
Intellectual Property Rights . 6
Foreword . 6
Modal verbs terminology . 6
Introduction . 7
1 Scope . 8
2 References . 8
2.1 Normative references . 8
2.2 Informative references . 8
3 Definition of terms, symbols and abbreviations . 9
3.1 Terms . 9
3.2 Symbols . 11
3.3 Abbreviations . 11
4 Heterogeneous server product categories and representative product configurations. 12
4.1 General . 12
4.2 Applications and metric applicability . 12
4.3 Product categories . 13
4.3.1 General requirements . 13
4.3.2 Form-factors . 13
4.3.3 Categories . 13
4.4 Product family configuration . 13
4.4.1 General . 13
4.4.2 "High-end" performance configuration . 14
4.4.3 "Low-end" performance configuration . 14
5 Metrics . 15
5.1 Worklets . 15
5.2 Formulae. 15
5.2.1 General . 15
5.2.2 Weightings . 16
6 Test setup . 16
6.1 General . 16
6.2 Environmental conditions . 16
6.2.1 Ambient Temperature . 16
6.2.2 Relative Humidity . 16
6.3 Temperature sensor . 16
6.4 Input power . 17
6.5 Power requirements . 17
6.6 Energy consumption analyser. 17
6.7 Test tool . 18
6.8 Controller system . 18
7 Equipment Under Test. 18
7.1 Configuration . 18
7.2 Test procedure . 20
8 Measurement . 21
8.1 Measurement for active state . 21
8.2 Re-verification and audits . 21
8.3 Measurement for power supply . 22
8.3.1 Measurement for internal power supply . 22
8.3.2 Measurement for test board power supply . 22
8.3.2.1 General . 22
8.3.2.2 Test loads . 22
8.3.2.3 Test leads and wiring . 22
ETSI
4 ETSI ES 204 083 V1.1.1 (2025-04)
8.3.2.4 Warm up time . 22
8.3.2.5 Power measurements . 23
9 Measurement report . 23
History . 24
ETSI
5 ETSI ES 204 083 V1.1.1 (2025-04)
List of tables
Table 1: Configuration of EUT .18
Table 2: Test configuration of EUT .20
Table 3: Measurement of active state efficiency .21
Table 4: Measurement of internal power supply .22
ETSI
6 ETSI ES 204 083 V1.1.1 (2025-04)
Intellectual Property Rights
Essential patents
IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The declarations
pertaining to these essential IPRs, if any, are publicly available for ETSI members and non-members, and can be
found in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to
ETSI in respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the
ETSI IPR online database.
Pursuant to the ETSI Directives including the ETSI IPR Policy, no investigation regarding the essentiality of IPRs,
including IPR searches, has been carried out by ETSI. No guarantee can be given as to the existence of other IPRs not
referenced in ETSI SR 000 314 (or the updates on the ETSI Web server) which are, or may be, or may become,
essential to the present document.
Trademarks
The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.
ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no
right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does
not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.
DECT™, PLUGTESTS™, UMTS™ and the ETSI logo are trademarks of ETSI registered for the benefit of its
Members. 3GPP™, LTE™ and 5G™ logo are trademarks of ETSI registered for the benefit of its Members and of the
3GPP Organizational Partners. oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and of ®
the oneM2M Partners. GSM and the GSM logo are trademarks registered and owned by the GSM Association.
Foreword
This ETSI Standard (ES) has been produced by ETSI Technical Committee Environmental Engineering (EE).
Modal verbs terminology
In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and
"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of
provisions).
"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.
ETSI
7 ETSI ES 204 083 V1.1.1 (2025-04)
Introduction
Computer server and data centers have experienced a rapid increase, playing the central role in digital services. With the
development of Artificial Intelligence (AI), heterogeneous servers equipped with more than one type of processors
(CPU, GPU, FPGA, ASIC, etc., the abbreviations defined in clauses 3.1 and 3.3) play an increasingly important role
and take a growing market share in computing industry. Heterogeneous servers gain extra performance by adding the
dissimilar coprocessors, usually incorporating specialized processing capabilities to handle particular tasks [i.4].
Categories of heterogeneous servers include CPU+GPU server, CPU+FPGA server, CPU+ASIC server. The most
popular heterogeneous server type is the CPU+GPU server, which is commonly used to accelerate the training process
of deep learning by parallel computing.
For heterogeneous servers, the better performance the higher the energy consumption. There is a tradeoff between the
performance and energy consumption for the high performance heterogeneous servers. Energy Efficiency (EE) that
scales the server performance and energy consumption is one of the critical factors of the server operation and
maintenance. ETSI EN 303 470 [i.5] specifies the metric and method for EE assessment of general servers. However,
there is currently no standard for EE assessment of heterogeneous servers.
The present document specifies a metric for the assessment of EE of heterogeneous servers using reliable, accurate and
reproducible measurement methods, which take into account the recognized state-of-the-art. The present document
formalizes the tools, conditions and calculations used to generate a single figure of merit of a single heterogeneous
server representing its relative EE and power consumption. The single figure EE metric is targeted for use as a tool in
the selection process of heterogeneous servers to be provisioned.
For comparisons, evaluations should be conducted across similar heterogeneous server types or categories. The EE
metric is targeted for identify energy saving servers by differentiating the ability of heterogeneous servers to be
provisioned for mainstream market. The present document does not prescribe the levels or values for acceptance but
prescribes a method of evaluation which EE programs could use to establish such criteria.
As there are many operational deployments of heterogeneous servers resulting in a range of specialized equipment and
configurations for a single heterogeneous server product, an EE metric that evaluates provisioning impacts to general
purpose operations may not be applicable. ICT equipment, and servers in particular, are generally customized and
commissioned on site for deployment. As with most ICT equipment, new technologies are regularly introduced, which
may require product level customization or an industry wide tool upgrade to more appropriately represent the EE of the
heterogeneous servers.
The present document categorizes heterogeneous servers to address applicability, configuration groupings to represent a
diversity of heterogeneous servers to address the broad range of custom configurations, as wells as a tool revision
control to ensure comparability and consistency of the resulting metric value.
The present document was developed jointly by ETSI TC EE and ITU-T Study Group 5 and published by ITU and
ETSI as Recommendation ITU-T L.EE_sgpu [i.6] and ETSI ES 204 083 (V1.1.1) (the present document), which are
technically equivalent.
ETSI
8 ETSI ES 204 083 V1.1.1 (2025-04)
1 Scope
The present document is based upon benchmark for server Energy Efficiency (EE) tool for general and heterogeneous
servers [i.6].
The present document specifies:
1) test conditions and product configuration for the assessment of EE of heterogeneous servers using reliable,
accurate and reproducible measurement methods;
2) an EE metric to support procurement requirements;
3) requirements for equipment to perform the measurements and analysis;
4) requirements for the measurement process;
5) requirements for the management of the EE metric calculation;
6) operation or run rules to configure, execute, and monitor the testing;
7) documentation and reporting requirements.
The metrics and methods apply to heterogeneous servers with various configurations, including type and count of
APAs, CPU, memory, storage and any other add-on hardware expected to be present when deployed.
NOTE: Products whose feature set and intended operation are not addressed by active mode testing parameters
are excluded from this evaluation method.
2 References
2.1 Normative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found in the
ETSI docbox.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
The following referenced documents are necessary for the application of the present document.
[1] IEEE 802.3az™: "The road to energy efficient ethernet".
[2] EN 62623:2013: "Desktop and notebook computers. Measurement of energy consumption",
(produced by CEN).
[3] IEEE 802.3™: "IEEE Standard for Ethernet".
2.2 Informative references
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
referenced document (including any amendments) applies.
NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee
their long term validity.
ETSI
9 ETSI ES 204 083 V1.1.1 (2025-04)
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] Commission Regulation (EU) 2019/424 of 15 March 2019 laying down ecodesign requirements
for servers and data storage products pursuant to Directive 2009/125/EC of the European
Parliament and of the Council and amending Commission Regulation (EU) No 617/2013.
[i.2] EN 60297 series: "Mechanical structures for electrical and electronic equipment. Dimensions of
mechanical structures of the 482,6 mm (19 in) series", (produced by CEN).
[i.3] ETSI EN 300 119 series: "Equipment Engineering (EE); European telecommunication standard for
equipment practice".
[i.4] Shan, Amar (2006): "Heterogeneous Processing: a Strategy for Augmenting Moore's Law". ®
Linux Journal. ®
NOTE: Linux is the registered trademark of Linus Torvalds in the U.S. and other countries.
[i.5] ETSI EN 303 470 (V1.1.1) (2019): "Environmental Engineering (EE); Energy Efficiency
Measurement methodology and metrics for servers".
[i.6] Recommendation ITU-T L.EE_sgpu on Energy Efficiency measurement methodology and metrics
for heterogeneous servers.
NOTE: Recommendation ITU-T L.EE_sgpu is at the time of publication only the draft working title.
Recommendation ITU-T L.1311 should be the official number to be decided in May/June 2025.
3 Definition of terms, symbols and abbreviations
3.1 Terms
For the purposes of the present document, the following terms apply:
active state: operational state of a computer server (as opposed to the idle state) in which the computer server is
carrying out work in response to prior or concurrent external requests (e.g. instruction over the network)
NOTE 1: The work in the present document includes, but is not restricted to, active processing and data
seeking/retrieval from memory, cache, or internal/external storage while awaiting further input over the
network.
NOTE 2: See ETSI EN 303 470 [i.5].
Application-Specific Integrated Circuit (ASIC): integrated circuit designed and manufactured according to specific
user requirements and specific electronic system requirements
NOTE 1: Processor units belong to ASIC include, but are not limited to:
a) Tensor Processing Unit (TPU): an AI accelerator ASIC that is developed specifically for neural
network machine learning by Google;
b) Vision Processing Unit (VPU): a specific type of AI accelerator, designed to accelerate machine
vision tasks;
c) Neural Processing Unit (NPU): a specialized processing unit that is designed to accelerate artificial
intelligence and machine learning applications, including artificial neural networks and machine
vision;
d) Deep Learning Processing Unit (DPU): a processor designed for deep learning that has the ability
to handle large-scale neural networks.
NOTE 2: DSP is used in Embedded and Real-time Systems.
ETSI
10 ETSI ES 204 083 V1.1.1 (2025-04)
Auxiliary Processing Accelerator (APA): additional compute device installed in the computer server that handles
parallelized workloads
NOTE 1: This includes, but is not limited to, Graphical Processing Units (GPUs), Field Programmable Gate Array
(FPGA) or Application-Specific Integrated Circuit (ASIC) chips which can be installed in a server either
on Graphics or Extension add-in cards installed in general-purpose add-in expansion slots (e.g. GPGPUs,
CPU accelerators, etc. installed in a PCI/PCIe slot) or directly attached to a server component such as the
motherboard.
NOTE 2: There are two specific types of APAs used in servers:
a) Expansion APA: an APA that is on an add-in card installed in an add-in expansion slot
(e.g. GPGPUs, CPU accelerators, etc. installed in a PCI/PCIe slot). An expansion APA add-in card
may include one or more APAs.
b) Integrated APA: an APA that is integrated into the motherboard or CPU package or an expansion
APA that has part of its subsystem, such as switches, included in the non-APA server configuration
that would be used to run the energy efficiency test.
NOTE 3: See ETSI EN 303 470 [i.5].
blade chassis: enclosure that contains shared resources for the operation of blade servers and other blade form-factor
devices
NOTE 1: Shared resources provided by a chassis include, but are not restricted to, power supplies, data storage, and
hardware for d.c. power distribution, thermal management, system management, and network services.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
blade server: computer server, designed for use in a blade chassis, that is a high-density device and functions as an
independent computer server and includes at least one processor and system memory, which is dependent upon shared
blade chassis resources (e.g. power supplies, cooling) for operation
NOTE 1: A processor or memory module that is intended to scale up a standalone server is not considered a blade
server.
NOTE 2: See ETSI EN 303 470 [i.5].
blade system: blade chassis and one or more removable blade servers and/or other units which provide a scalable
means for combining multiple blade server or storage units in a single enclosure
NOTE 1: A blade system is designed to allow service technicians to easily add or replace (hot-swap) blades in the
field.
NOTE 2: See ETSI EN 303 470 [i.5].
controller system: computer or computer server that manages a benchmark evaluation process
deployed power: average power level of the utilization applicable to the total number of servers provisioned to meet an
aggregate peak load
hypervisor: supervisory system level software that establishes and manages a virtualized environment which enables
multiple operating systems to run on a single physical system at the same time
pedestal server: self-contained computer server that is designed with power supply units, cooling, input/output devices,
and other resources necessary for stand-alone operation within a frame similar to that of a tower client computer
NOTE: See ETSI EN 303 470 [i.5].
processor: digital circuit which performs operations on some external data source, usually memory or some other data
stream
NOTE: This includes, but is not limited to, Central Processing Unit (CPU), Graphics Processing Unit (GPU),
Neural Processing Unit (NPU), Tensor Processing Unit (TPU), Deep Learning Processing Unit (DPU),
Vision Processing Unit (VPU), etc.
ETSI
11 ETSI ES 204 083 V1.1.1 (2025-04)
rack-mounted server: computer server that is designed for deployment in a standard 19 inch ICT equipment rack
NOTE 1: As defined by EN 60297 [i.2] or ETSI EN 300 119 [i.3].
NOTE 2: For the purposes of the present document, a blade server is considered under a separate product category
and excluded from the rack-mounted product category.
server: computing product that provides services and manages networked resources for client devices
NOTE 1: Client devices such as desktop computers, notebook computers, desktop thin clients, internet protocol
telephones, smartphones, tablets, tele-communication, automated systems or other servers, primarily
accessed via network connections, and not through direct user input devices, such as a keyboard or a
mouse and with the following characteristics:
a) it is designed to support server Operating Systems (OSs) and/or hypervisors, and targeted to run user-installed
enterprise applications;
b) it supports error-correcting code and/or buffered memory (including both buffered dual in-line memory
modules and buffered on board configurations);
c) all processors have access to shared system memory and are independently visible to a single OS or
hypervisor.
NOTE 2: See Commission Regulation (EU) 2019/424 [i.1].
single-wide blade server: blade server requiring the width of a standard blade server bay
NOTE: See ETSI EN 303 470 [i.5].
worklet: synthetic software routine, using real application functions focused on a particular type of computing activity,
which stresses a particular characteristic of the system
NOTE 1: A floating point and integer performance stress code is an example of a CPU worklet.
NOTE 2: An image classification training code is an example of AI worklet.
3.2 Symbols
Void.
3.3 Abbreviations
For the purposes of the present document, the following abbreviations apply:
a.c, AC alternating current
ACPI Advanced Configuration and Power Interface
APA Auxiliary Processing Accelerator
ASIC Application-Specific Integrated Circuit
BIOS Basic Input/Output System
CENELEC European Committee for Electrotechnical Standardization
CPU Central Processing Unit
CSJ Correctly predicted Samples per Joule
d.c, DC direct current
DDR Double Data Rate
DIMM Dual In-line Memory Module
DPU Deep learning Processing Unit
DRAM Dynamic Random Access Memory
DSP Digital Signal Processor
EDP Energy Delay Product
EE Energy Efficiency
EEE Energy Efficient Ethernet
EUT Equipment Under Test
FPGA Field Programmable Gate Array
ETSI
12 ETSI ES 204 083 V1.1.1 (2025-04)
GPGPU General-Purpose computing on Graphical Processing Units
GPU Graphical Processing Unit
HDD Hard Disk Drive
I/O Input/Output
ICT Information and Communications Technology
ISO/IEC International Organization for Standardization/International El
...












Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.
Loading comments...