SIST ES 203 539 V1.1.1:2020

SLOVENSKI STANDARD
SIST ES 203 539 V1.1.1:2020
01-maj-2020

Okoljski inženiring (EE) - Metoda merjenja energijske učinkovitosti virtualizacije

Environmental Engineering (EE) - Measurement method for energy efficiency of Network

2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

The present document may be made available in electronic versions and/or in print. The content of any electronic and/or

print versions of the present document shall not be modified without the prior written authorization of ETSI. In case of any

existing or perceived difference in contents between such versions and/or in print, the prevailing version of an ETSI

deliverable is the one made publicly available in PDF format at www.etsi.org/deliver.

Users of the present document should be aware that the document may be subject to revision or change of status.

Information on the current status of this and other ETSI documents is available at

If you find errors in the present document, please send your comment to one of the following services:

No part may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying

The content of the PDF version shall not be modified without the written authorization of ETSI.

DECT , PLUGTESTS , UMTS and the ETSI logo are trademarks of ETSI registered for the benefit of its Members.

3GPP and LTE are trademarks of ETSI registered for the benefit of its Members and

oneM2M™ logo is a trademark of ETSI registered for the benefit of its Members and

Intellectual Property Rights ................................................................................................................................ 4

Foreword ............................................................................................................................................................. 4

Modal verbs terminology .................................................................................................................................... 4

Introduction ........................................................................................................................................................ 4

1 Scope ........................................................................................................................................................ 5

2 References ................................................................................................................................................ 5

2.1 Normative references ......................................................................................................................................... 5

2.2 Informative references ........................................................................................................................................ 6

3 Definition of terms, symbols and abbreviations ....................................................................................... 7

3.1 Terms .................................................................................................................................................................. 7

3.2 Symbols .............................................................................................................................................................. 7

3.3 Abbreviations ..................................................................................................................................................... 7

4 Metrics definition ..................................................................................................................................... 8

4.1 Overview of System Under Test ........................................................................................................................ 8

4.2 Metrics of VNFs ............................................................................................................................................... 10

4.2.0 General ........................................................................................................................................................ 10

4.2.1 VNF energy efficiency ................................................................................................................................ 10

4.2.2 VNF resource efficiency ............................................................................................................................. 11

4.3 Metrics of NFVI ............................................................................................................................................... 11

5 Measurement methods ............................................................................................................................ 12

5.1 Measurement conditions ................................................................................................................................... 12

5.2 Measurement procedure ................................................................................................................................... 13

5.3 Measurement method for power consumption of VNF .................................................................................... 14

5.4 Measurement method for resource consumption of VNF ................................................................................ 14

5.5 Measurement method for energy efficiency of NFVI ...................................................................................... 15

6 Measurement Report .............................................................................................................................. 15

Annex A (informative): Example of VNF measurement ..................................................................... 16

History .............................................................................................................................................................. 19

IPRs essential or potentially essential to normative deliverables may have been declared to ETSI. The information

pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found

in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in

respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web

Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee

can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web

The present document may include trademarks and/or tradenames which are asserted and/or registered by their owners.

ETSI claims no ownership of these except for any which are indicated as being the property of ETSI, and conveys no

right to use or reproduce any trademark and/or tradename. Mention of those trademarks in the present document does

not constitute an endorsement by ETSI of products, services or organizations associated with those trademarks.

This ETSI Standard (ES) has been produced by ETSI Technical Committee Environmental Engineering (EE).

The present document was developed jointly by ETSI TC EE and ITU-T Study Group 5. It is published respectively by

ITU and ETSI as Recommendation ITU-T L.1361 [i.14] and ETSI ES 203 539 (the present document), which are

In the present document "shall", "shall not", "should", "should not", "may", "need not", "will", "will not", "can" and

"cannot" are to be interpreted as described in clause 3.2 of the ETSI Drafting Rules (Verbal forms for the expression of

"must" and "must not" are NOT allowed in ETSI deliverables except when used in direct citation.

Network Functions Virtualisation (NFV) changes the traditional telecom network architecture to layered model by

replacing physical equipment with network functions running on standard server platform. Three main domains are

identified in high-level NFV architecture: Virtualised Network Functions (VNFs) is the software implementation of a

network functions which is capable of running over the NFV Infrastructure (NFVI). NFVI include diversity of physical

resources and virtualised resources to support the execution of the VNFs. NFV Management and Orchestration

(MANO) covers the orchestration and lifecycle management of physical and/or software resources that support the

infrastructure virtualisation, and the lifecycle management of VNF. The three decoupled elements with connection of

standardized and open interface can be provided by different vendors. VNFs and NFVI are the dominant parts from

Therefore the present document defines energy efficiency metrics and measurement methods for NFV components

including VNFs and NFVI. The energy efficiency of VNF is evaluated according to hardware energy consumption,

resource consumption and utilization related with VNF. The energy efficiency of NFVI is evaluated as resource

provision capability which is expressed as service capacity of reference VNFs running on it with amount of energy

The present document defines the metrics and measurement methods for the energy efficiency of functional components

of NFV environment. The NFV functional components include Virtualised Network Functions (VNFs) and NFV

Infrastructure (NFVI) defined in NFV architecture framework as described in ETSI GS NFV 002 [i.1]. Management

and Orchestration (MANO) is not included as system under test, but will be eventually taken as test environment.

The measurement method described in the present document is intended to be used to assess and compare the energy

efficiency of same functional components independently in lab testing and pre-deployment testing. Energy efficiency of

co-located VNFs sharing same platform resources cannot be compared using the defined method in present document.

The scope of the document is not to define measurement method in operational NFV environment.

The present document is intended to define common energy efficiency measurement methods for NFV environments,

not try to cover all different types of VNFs (e.g. firewall, gateway, etc.), but it provides the basis to make extensible

References are either specific (identified by date of publication and/or edition number or version number) or

non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the

Referenced documents which are not found to be publicly available in the expected location might be found at

NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee

The following referenced documents are necessary for the application of the present document.

References are either specific (identified by date of publication and/or edition number or version number) or

non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the

NOTE: While any hyperlinks included in this clause were valid at the time of publication, ETSI cannot guarantee

The following referenced documents are not necessary for the application of the present document but they assist the

[i.1] ETSI GS NFV 002 (V1.1.1): "Network Functions Virtualisation (NFV); Architectural

[i.2] ETSI GS NFV-INF 001 (V1.1.1): "Network Functions Virtualisation (NFV); Infrastructure

[i.3] ETSI EN 303 470: "Environmental Engineering (EE); Energy Efficiency measurement

[i.4] ETSI ES 203 136 (V1.1.1): "Environmental Engineering (EE); Measurement methods for energy

[i.5] ETSI GS NFV-TST 001 (V1.1.1): "Network Functions Virtualisation (NFV); Pre-deployment

[i.6] ETSI GS NFV-PER 001 (V1.1.2): "Network Functions Virtualisation (NFV); NFV Performance &

[i.7] IEC 62018: "Power consumption of information technology equipment - Measurement methods".

[i.8] OPNFV Yardstick project: "Network Service Benchmarking (NSB) framework extension".

NOTE: Available at https://wiki.opnfv.org/display/yardstick/Network+Service+Benchmarking.

[i.9] ETSI EN 300 132-2: "Environmental Engineering (EE); Power supply interface at the input of

Information and Communication Technology (ICT) equipment; Part 2: -48 V Direct Current

[i.10] CENELEC EN 50160: "Voltage characteristics of electricity supplied by public electricity

[i.11] ETSI GS NFV-TST 008: "Network Functions Virtualisation (NFV) Release 3; Testing; NFVI

[i.12] ETSI GS NFV-IFA 027: "Network Functions Virtualisation (NFV) Release 2; Management and

[i.13] ETSI GS NFV 003 (V1.2.1): "Network Functions Virtualisation (NFV); Terminology for Main

[i.14] Recommendation ITU-T L.1361: "Measurement method for energy efficiency of network

NOTE: It is measured in Joule or kWh (where 1 kWh = 3,6 × 106 J) and corresponds to energy use.

useful output: maximum capacity of the system under test which is depending on the different functions

NOTE: It is expressed as the number of Erlang (Erl), Packets/s (PPS), Subscribers (Sub) or Simultaneously

For the purposes of the present document, the abbreviations given in ETSI GS NFV 003 [i.13] and the following apply:

In traditional networks, physical network elements provide network functions as a combination of vendor specific

hardware and software. The System Under Test (SUT) is a physical network element which is usually taken as a "black

box" in energy efficiency measurement standards. But in NFV environment, the functionality of physical network

element is decoupled into software and hardware via Virtualisation. Network functions are executed as VNFs on NFVI

composing of general purpose computing, networking and storage hardware resources, and Virtualisation layer. All of

them are managed and orchestrated by MANO. There will be many potential suppliers for NFV sub-systems and

components, which need to be measured separately on energy efficiency performance.

The energy efficiency metrics is typically defined as functional unit of useful output divided by the energy

consumption. As shown in Figure 2, NFV architecture decompose the integrity of traditional energy efficiency

measurement which tightly connect useful service output to energy consumption. VNF is software implementation of a

network function which consumes resources provided by NFVI to produce service capacity to cloud service users.

NFVI consume energy to provide infrastructure resources to support the execution of VNF. Such decoupled architecture

introduces complexity on measurement process. Resource consumption should be monitored, internal configuration of

SUT and test environment should be specified and reported to ensure repeatability and comparability.

Figure 2: High level NFV architecture (from Figure 23 of ETSI GS NFV-INF 001 [i.2])

There are already several energy efficiency measurement standards for NFVI components, for example ETSI

In the following clauses the SUTs considered for energy efficiency measurement are a Virtualised Network

The definition of test environment and test function are described in ETSI GS NFV-TST 001 [i.5]. The test environment

consists of reference implementation of those functional NFV components from the NFV architecture which do not

represent the particular SUT, and contain test functions and entities to enable controlling the test execution and

collecting the test measurement. Test function are entities that communicate with the SUT via standardized interfaces.