SIST EN 50600-3-1:2016
(Main)Information technology - Data centre facilities and infrastructures - Part 3-1: Management and operational information
Information technology - Data centre facilities and infrastructures - Part 3-1: Management and operational information
This European Standard specifies processes for the management and operation of data centres. The primary focus of this standard is the operational processes necessary to deliver the expected level of resilience, availability, risk management, risk mitigation, capacity planning, security and energy efficiency.
The secondary focus is on management processes to align the actual and future demands of users. Figure 2 shows an overview of related processes.
The transition from planning and building to operation of a data centre is considered as part of the acceptance test process in Clause 6.
(...)
NOTE 1 Only processes specific for data centres are in the scope of this document. Business processes like people management, financial management, etc. are out of scope.
NOTE 2 Specific skill sets are required of those working in and operating a data centre.
Informationstechnik - Einrichtungen und Infrastrukturen von Rechenzentren - Teil 3-1: Informationen für das Management und den Betrieb
Technologie de l’information - Installation et infrastructures de centres de traitement de données - Partie 3-1: Informations de gestion et de fonctionnement
La présente Norme européenne spécifie les processus pour la gestion et l'exploitation des centres de traitement de données. La présente Norme a pour principal objet les processus opérationnels nécessaires pour assurer le niveau attendu de résilience, de disponibilité, de management du risque, d'atténuation du risque, de planification de la capacité, de sécurité et d'efficacité énergétique.
La présente Norme a pour deuxième objet les processus de gestion permettant de faire le lien entre les besoins actuels et futurs des utilisateurs. La Figure 2 représente une vue d’ensemble des processus correspondants.
La transition entre la planification et la construction puis l’exploitation d’un centre de traitement de données est considérée comme faisant partie du processus d’essai de réception de l’Article 6.
NOTE 1 Seuls les processus spécifiques aux centres de traitement de données relèvent du domaine d’application du présent document. Les processus d’entreprise tels que la gestion des personnes, la gestion financière, etc. ne relèvent pas du domaine d’application.
NOTE 2 Il est exigé que le personnel travaillant à l’exploitation d’un centre de traitement de données présente des compétences spécifiques.
Informacijska tehnologija - Naprave in infrastruktura podatkovnega centra - 3-1. del: Informacije o upravljanju in obratovanju
1.1 Področje uporabe
Ta evropski standard določa postopke za upravljanje in delovanje podatkovnih centrov. Osredotoča se predvsem na operativne postopke za zagotavljanje pričakovane ravni odpornosti, razpoložljivosti, varnosti in energetske učinkovitosti. Nadalje se osredotoča na postopke upravljanja za usklajevanje trenutnih zahtev uporabnikov z njihovimi predvidenimi zahtevami v prihodnosti. Na sliki 2 je prikazan pregled vseh postopkov. Poleg tega se prehod od načrtovanja in izgradnje do delovanja podatkovnega centra obravnava kot postopek za preskus ustreznosti v točki 4. Čeprav ključni kazalniki delovanja (KPI) niso v ospredju, so podani v okviru posameznih postopkov, kjer je to primerno. OPOMBA 1: Postopek odpravljanja težav ni vključen in ga lahko po potrebi nastavite.
OPOMBA 2: Področje uporabe tega dokumenta zajema samo postopke, specifične za podatkovne centre. Poslovni postopki, kot so vodenje zaposlenih, upravljanje financ ipd. niso zajeti.
OPOMBA 3: Upoštevajte zahtevano specifično usposobljenost osebja v podatkovnih centrih.
1.2 Zahteve za skladnost podatkovnega centra s tem evropskim standardom:
a) vključevati mora uveden postopek strategije podatkovnega centra;
b) vključevati mora naslednje uvedene postopke prednostnega razreda 1:
upravljanje delovnih postopkov;
upravljanje posebnih dogodkov;
upravljanje varnosti;
upravljanje odjemalcev.
c) določati mora raven učinkovitosti porabe energije;
d) mora biti v skladu s 1. ravnjo operativne odličnosti.
General Information
Relations
Standards Content (Sample)
SLOVENSKI STANDARD
01-maj-2016
Informacijska tehnologija - Naprave in infrastruktura podatkovnega centra - 3-1.
del: Informacije o upravljanju in obratovanju
Information technology - Data centre facilities and infrastructures - Part 3-1: Management
and operational information
Informationstechnik - Einrichtungen und Infrastrukturen von Rechenzentren - Teil 3-1:
Informationen für das Management und den Betrieb
Technologie de l’information - Installation et infrastructures de centres de traitement de
données - Partie 3-1: Informations de gestion et de fonctionnement
Ta slovenski standard je istoveten z: EN 50600-3-1:2016
ICS:
35.110 Omreževanje Networking
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
EUROPEAN STANDARD EN 50600-3-1
NORME EUROPÉENNE
EUROPÄISCHE NORM
March 2016
ICS 35.020; 35.110; 35.160
English Version
Information technology - Data centre facilities and infrastructures
- Part 3-1: Management and operational information
Technologie de l'information - Installation et infrastructures Informationstechnik - Einrichtungen und Infrastrukturen von
de centres de traitement de données - Partie 3-1: Rechenzentren - Teil 3-1: Informationen für das
Informations de gestion et de fonctionnement Management und den Betrieb
This European Standard was approved by CENELEC on 2016-01-26. CENELEC members are bound to comply with the CEN/CENELEC
Internal Regulations which stipulate the conditions for giving this European Standard the status of a national standard without any alteration.
Up-to-date lists and bibliographical references concerning such national standards may be obtained on application to the CEN-CENELEC
Management Centre or to any CENELEC member.
This European Standard exists in three official versions (English, French, German). A version in any other language made by translation
under the responsibility of a CENELEC member into its own language and notified to the CEN-CENELEC Management Centre has the
same status as the official versions.
CENELEC members are the national electrotechnical committees of Austria, Belgium, Bulgaria, Croatia, Cyprus, the Czech Republic,
Denmark, Estonia, Finland, Former Yugoslav Republic of Macedonia, France, Germany, Greece, Hungary, Iceland, Ireland, Italy, Latvia,
Lithuania, Luxembourg, Malta, the Netherlands, Norway, Poland, Portugal, Romania, Slovakia, Slovenia, Spain, Sweden, Switzerland,
Turkey and the United Kingdom.
European Committee for Electrotechnical Standardization
Comité Européen de Normalisation Electrotechnique
Europäisches Komitee für Elektrotechnische Normung
CEN-CENELEC Management Centre: Avenue Marnix 17, B-1000 Brussels
© 2016 CENELEC All rights of exploitation in any form and by any means reserved worldwide for CENELEC Members.
Ref. No. EN 50600-3-1:2016 E
Contents Page
European foreword . 4
Introduction . 5
1 Scope . 8
2 Normative references. 8
3 Terms, definitions and abbreviations . 9
3.1 Terms and definitions . 9
3.2 Abbreviations . 10
4 Conformance . 11
5 Operational information and parameters. 11
5.1 General . 11
5.2 Building construction as per EN 50600-2-1 . 12
5.3 Power distribution as per EN 50600-2-2 . 12
5.4 Environmental control as per EN 50600-2-3 . 13
5.5 Telecommunications cabling infrastructure as per EN 50600-2-4 . 15
5.6 Security systems as per EN 50600-2-5 . 15
6 Acceptance test . 15
6.1 General . 15
6.2 Building construction (EN 50600-2-1) tests . 16
6.3 Power distribution (EN 50600-2-2) tests . 16
6.4 Environmental control (EN 50600-2-3) tests . 16
6.5 Telecommunications cabling infrastructure (EN 50600-2-4) tests . 17
6.6 Security systems (EN 50600-2-5) tests . 17
6.7 Energy efficiency enablement tests . 17
6.8 Energy efficiency strategy tests . 17
6.9 Monitoring tests . 17
7 Operational processes . 17
7.1 General . 17
7.2 Operations management . 18
7.3 Incident management . 19
7.4 Change management . 20
7.5 Asset and configuration management . 21
7.6 Capacity management . 22
8 Management processes . 24
8.1 General . 24
8.2 Availability management . 25
8.3 Security management . 26
8.4 Resource management . 27
8.5 Energy management . 30
8.6 Product lifecycle management . 33
8.7 Cost management . 34
8.8 Data centre strategy . 35
8.9 Service level management . 37
8.10 Customer management . 38
Annex A (informative) Example for process implementation . 40
A.1 Prioritization of processes . 40
A.2 Maturity . 40
Annex B (normative) Security systems . 42
B.1 Access to the data centre premises . 42
B.2 Fire suppression systems . 45
B.3 Management of electrical interference . 46
Bibliography . 47
Figures
Figure 1 ― Schematic relationship between the EN 50600 standards . 6
Figure 2 ― Data centre management processes overview . 8
Tables
Table A.1 — Prioritization of processes . 40
Table A.2 — Operational levels . 41
European foreword
This document (EN 50600-3-1:2016) has been prepared by CLC/TC 215 “Electrotechnical aspects of
telecommunication equipment”.
The following dates are fixed:
• latest date by which this document has to be (dop) 2017–01–26
implemented at national level by publication of an
identical national standard or by endorsement
• latest date by which the national standards conflicting (dow) 2019–01–26
with this document have to be withdrawn
Attention is drawn to the possibility that some of the elements of this document may be the subject of patent
rights. CENELEC [and/or CEN] shall not be held responsible for identifying any or all such patent rights.
This document has been prepared under a mandate given to CENELEC by the European Commission and
the European Free Trade Association.
Introduction
The unrestricted access to internet-based information demanded by the information society has led to an
exponential growth of both internet traffic and the volume of stored/retrieved data. Data centres are housing
and supporting the information technology and network telecommunications equipment for data processing,
data storage and data transport. They are required both by network operators (delivering those services to
customer premises) and by enterprises within those customer premises.
Data centres need to provide modular, scalable and flexible facilities and infrastructures to easily
accommodate the rapidly changing requirements of the market. In addition, energy consumption of data
centres has become critical both from an environmental point of view (reduction of carbon footprint) and with
respect to economic considerations (cost of energy) for the data centre operator.
The implementation of data centres varies in terms of:
a) purpose (enterprise, co-location, co-hosting, or network operator facilities);
b) security level;
c) physical size;
d) accommodation (mobile, temporary and permanent constructions).
The needs of data centres also vary in terms of availability of service, the provision of security and the
objectives for energy efficiency. These needs and objectives influence the design of data centres in terms of
building construction, power distribution, environmental control and physical security. Effective management
and operational information is required to monitor achievement of the defined needs and objectives.
This series of European Standards specifies requirements and recommendations to support the various
parties involved in the design, planning, procurement, integration, installation, operation and maintenance of
facilities and infrastructures within data centres. These parties include:
1) owners, facility managers, ICT managers, project managers, main contractors;
2) architects, consultants, building designers and builders, system and installation designers;
3) facility and infrastructure integrators, suppliers of equipment;
4) installers, maintainers.
At the time of publication of this European Standard, the EN 50600 series currently comprises the following
standards:
— EN 50600-1, Information technology — Data centre facilities and infrastructures — Part 1: General
concepts;
— EN 50600-2-1, Information technology — Data centre facilities and infrastructures — Part 2-1: Building
construction;
— EN 50600-2-2, Information technology — Data centre facilities and infrastructures — Part 2-2: Power
distribution;
— EN 50600-2-3, Information technology — Data centre facilities and infrastructures — Part 2-3:
Environmental control;
— EN 50600-2-4, Information technology — Data centre facilities and infrastructures — Part 2-4:
Telecommunications cabling infrastructure;
— EN 50600-2-5, Information technology — Data centre facilities and infrastructures — Part 2-5: Security
systems;
— EN 50600-3-1, Information technology — Data centre facilities and infrastructures — Part 3-1:
Management and operational information;
— FprEN 50600-4-1, Information technology — Data centre facilities and infrastructures — Part 4-1:
Overview of and general requirements for key performance indicators;
— FprEN 50600-4-2, Information technology — Data centre facilities and infrastructures — Part 4-2: Power
Usage Effectiveness;
— FprEN 50600-4-3, Information technology — Data centre facilities and infrastructures — Part 4-3:
Renewable Energy Factor;
— CLC/TR 50600-99-1, Information technology — Data centre facilities and infrastructures — Part 99-1:
Recommended practices for energy management.
The inter-relationship of the standards within the EN 50600 series is shown in Figure 1.
Figure 1 — Schematic relationship between the EN 50600 standards
EN 50600-2-X standards specify requirements and recommendations for particular facilities and
infrastructures to support the relevant classification for “availability”, “physical security” and “energy efficiency
enablement” selected from EN 50600-1.
EN 50600-3-X documents specify requirements and recommendations for data centre operations, processes
and management.
This European Standard addresses the operational and management information (in accordance with the
requirements of EN 50600-1). A data centre’s primary function typically is to house large quantities of
computer and telecommunications hardware which affects the construction, operation, and physical security.
Most of the data centres may impose special security requirements. Therefore, the planning of a data centre
by the designer and the various engineering disciplines that will assist in the planning and implementation of
the design of the data centre i.e. electrical, mechanical, security, etc. shall be carried out in cooperation with
the IT and telecommunications personnel, network professionals, the facilities manager, the IT end users,
and any other personnel involved.
This European Standard is intended for use by and collaboration between facility managers, ICT managers,
and main contractors.
This series of European Standards does not address the selection of information technology and network
telecommunications equipment, software and associated configuration issues.
1 Scope
This European Standard specifies processes for the management and operation of data centres. The
primary focus of this standard is the operational processes necessary to deliver the expected level of
resilience, availability, risk management, risk mitigation, capacity planning, security and energy efficiency.
The secondary focus is on management processes to align the actual and future demands of users. Figure 2
shows an overview of related processes.
The transition from planning and building to operation of a data centre is considered as part of the
acceptance test process in Clause 6.
Figure 2 — Data centre management processes overview
NOTE 1 Only processes specific for data centres are in the scope of this document. Business processes like people
management, financial management, etc. are out of scope.
NOTE 2 Specific skill sets are required of those working in and operating a data centre.
2 Normative references
The following documents, in whole or in part, are normatively referenced in this document and are
indispensable for its application. For dated references, only the edition cited applies. For undated references,
the latest edition of the referenced document (including any amendments) applies.
EN 50600-1:2012, Information technology — Data centre facilities and infrastructures — Part 1: General
concepts
EN 50600-2 (all parts), Information technology — Data centre facilities and infrastructures
3 Terms, definitions and abbreviations
3.1 Terms and definitions
For the purposes of this document, the terms and definitions given in EN 50600-1, EN 50600-2-X and the
following apply.
3.1.1
availability management
process for monitoring, analysis, reporting and improvement of availability
3.1.2
capacity Management
process for monitoring, analysis, reporting and improvement of capacity
3.1.3
change management
process for recording, coordination, approval and monitoring of all changes
3.1.4
configuration item
entity managed by configuration management
3.1.5
configuration management
process for logging and monitoring of configuration items
3.1.6
cost distribution model
model to distribute costs that cannot be directly related to an infrastructure item
3.1.7
cost management
process for monitoring, analysis and reporting of all infrastructure related costs
3.1.8
customer management
process for management of customers responsibilities
3.1.9
data centre strategy
process for alignment of actual data centre’s capabilities and future demands of data centre’s users and
owners
3.1.10
energy management
process for monitoring, analysis, reporting and improvement of energy efficiency
3.1.11
incident management
process for responding to unplanned events and recovery of normal operation state
3.1.12
incident severity
incident category according to the four impact categories described EN 50600-1:2012, 4.3
3.1.13
key performance indicator
parameter used to evaluate performance
3.1.14
operations management
process for infrastructure maintenance, monitoring and event management
3.1.15
product lifecycle management
process for managing the timely renewal of infrastructure components and review of product lifecycle costs
3.1.16
provisioned capacity
capacity of the data centre’s actual installed infrastructure
3.1.17
security incident
unplanned event resulting in an actual or potential breach of security
3.1.18
security management
process for design and monitoring of security policies, analysis, reporting and improvement of security
3.1.19
service level management
process for monitoring, analysis and reporting of service level compliance
3.1.20
service level agreement
agreement defining the content and quality of the service to be delivered and the timescale in which it is to
be delivered
3.1.21
total capacity
maximum capacity the data centre was designed for at full use in terms of e.g. space, power and cooling
3.1.22
used capacity
data centre’s actual capacity used by the IT and facility in terms of e.g. space, power and cooling
3.2 Abbreviations
For the purposes of this document, the abbreviations given in EN 50600-1 and the following apply:
CRAC Computer Room Air Conditioning
CUE Carbon Usage Effectiveness
EER Energy Efficiency Ratio
ERE Energy Re-use Efficiency
HVAC Heating, Ventilation and Air Conditioning
IST Integrated Systems Test
KPI Key Performance Indicator
1)
PUE Power Usage Effectiveness
1)
pPUE Partial Power Usage Effectiveness
REF Renewable Energy Factor
SLA Service Level Agreement
TCO Total Cost of Ownership
WRE Water Re-use Effectiveness
WUE Water Usage Effectiveness
4 Conformance
For a data centre to conform to this European Standard it shall have:
a) an implemented data centre strategy defined by stated business requirements;
b) an implemented set of service management policies and procedures covering the following:
1) operations management;
2) incident management;
3) security management;
4) customer management;
c) a monitored PUE KPI;
d) an asset management policy;
e) an environmental control policy;
f) a lifecycle management policy;
g) an energy management policy.
5 Operational information and parameters
5.1 General
In general, operators should understand the designed capacity and optimum operating parameters of the
data centre. This is extremely important to maintain efficient operations and reliable service.
It is particularly important for the operators to understand the “N” design capacity to ensure that this is not
exceeded. If the “N” design capacity is exceeded then some of the design redundancy will be lost which may
effectively reduce the reliability class of the data centre.
At handover to operations instructions shall be delivered by designers and constructors on how to handle
operational parameters of the infrastructure at different loads.
———————
1) It is recognized that the term “efficiency” should be employed for PUE but “effectiveness” provides continuity with earlier market
recognition of the term.
At the beginning of data centre lifecycle IT loads will be low; therefore instructions for efficient part load
operation are very important.
The following subclauses describe the information that operation retrieves from the various data centre
subsystems of EN 50600-2-1 to EN 50600-2-5 together with operational parameters that shall be configured
during the lifecycle of the data centre to achieve the goal to run at the optimal point for the given IT load.
5.2 Building construction as per EN 50600-2-1
All information delivered by the building management systems relating to any of the other subsystems in the
building will be described in the relevant Subclauses 5.3 to 5.6.
The following information shall be handed over to operations:
a) maximum bearable load by construction;
b) escape routes;
c) technical: transmission heat/cooling;
d) documentation about installation for flood control;
e) regulatory requirements;
f) acoustic protection;
g) use of water-polluting substances (effluent water);
h) environmental regulations.
5.3 Power distribution as per EN 50600-2-2
5.3.1 General
To operate a data centre in a safe and efficient mode the following information is required at all metering
points defined by the level of granularity:
a) active power load;
b) apparent power load;
c) power factor;
d) voltage;
e) current on each phase;
f) energy usage (consumption in kWh).
The following information shall be handed over to operations:
1) main power capacity;
2) back-up power source (e.g. generator);
3) power distribution capacities;
4) UPS capacity, battery capacity, modularity and efficiency at various IT loads;
5) resilience plan;
6) plan for protection from electrostatic discharge;
7) granularity level of energy efficiency enablement.
5.3.2 Generator parameters
The generator takes over after failure of the mains power supply. When the mains power supply returns a
smooth power transition from the generator should be made. The procedure provides two parameters that
need to be defined:
a) T1 – the time between the failure of the main supply and the start of the generator;
b) T2 – the time the generator shall run before switch off.
T1 should be large enough to prevent the generator from starting when it is not really needed. The UPS will
keep the IT up and running for at least some minutes, but a safety period is needed in case the generator will
fail to start and IT needs to be shut down. Also environmental conditions shall be kept under control to
prevent overheating.
T2 should be large enough to ensure that the loading of the UPS batteries is on a level that enables a
second failure of the mains power supply to be tolerated. In the worst case the second failure of mains power
supply will happen immediately after the generator has switched off.
The ideal values of T1 and T2 will vary dependent on the capacity of the data centre and its current load. T1
and T2 shall be determined from the following:
1) IT load;
2) UPS capacity;
3) UPS battery re-charge/discharge times;
4) Expected rise of temperature after failure of the cooling;
5) Generator type and capacity.
Optimization of T1 an d T2 aims to protect the generator from bad working conditions, i.e. starting too early
when not needed, not running long enough to securely handle consecutive failings of the mains power
supply or running too long thus increasing fuel costs.
5.4 Environmental control as per EN 50600-2-3
5.4.1 General
For environmental control the basic measured parameters are temperature and humidity which need to be
reported based on the level of granularity available. Some of the spaces can have additional environmental
requirements such as control of the level of contaminants.
The following information shall be handed over to operations:
a) the cooling efficiency at various load conditions;
b) a document in which moisture control is detailed under various external environmental conditions (i.e.
dry cold winters and hot humid summers);
c) example scenarios detailing the observable parameters which determine overall cooling efficiency and
the interplay between those parameters, e.g. ventilator speeds, chilled water temperature, free cooling
capabilities, IT heat load and IT airflow requirements. Metering should be in place to facilitate this
process;
d) cooling capacity of each cooling component;
e) maximum cooling capacity of the computer room space;
f) maximum cooling capacity per cabinet.
5.4.2 Air handling parameters
With increasing IT load, computer rooms with access floor cooling require management of tiles with
openings, pressure and cold water temperature at CRACs.
At low part load, openings are required at racks loaded with IT only. Low pressure will be sufficient to provide
the necessary air flow and the cold water temperature can be higher as there is only little cooling capacity
needed.
Operations shall be provided with an instruction set on how to adjust the cooling systems to match the heat
load.
Where access floors are used for cooling this may include changing the open space in vented tiles, adding
vented tiles to new equipment locations and removing them where equipment is removed.
Where CRAC units with variable speed fans are implemented this may include adjusting the fan speed to
increase or reduce the volume of air provided for cooling.
Where chilled water cooling systems are implemented this may include varying the temperature of the cold
water supply to match the cooling requirement.
The instructions should indicate whether redundant equipment such as CRAC units should be in service
continuously or left in standby. The decision will normally depend on the relative efficiency of each operating
mode.
5.4.3 Cooling parameters
In the situation where the cooling system utilizes a chilled water circuit, the chilled water feed temperature
should be just low enough to provide sufficient cooling capacity, but otherwise as high as possible to
minimize condensation on the heat exchanger resulting in a need for humidification. The higher feed
temperature also expands the time in which the chilled water can be generated using a form of “free cooling”.
Operations will need an instruction set on how to handle cold water temperature at different conditions of
heat load and outside air temperature. In addition, instructions may be needed to adjust power of pumps to
the cooling demand.
5.4.4 Humidity parameters
Moisture control in the data centre should preferably be based on either dew point or absolute moisture
content (g/m ) measurements. Care should be taken that condensation will not occur anywhere near the IT
equipment.
Operations will need an instruction set on how to set upper and lower limit of moisture to avoid unnecessary
humidification and de-humidification.
5.5 Telecommunications cabling infrastructure as per EN 50600-2-4
There is no information expected from cabling infrastructure itself.
Automated infrastructure management systems offering real time documentation and efficient management
of the physical layer should be considered for availability and operational purposes.
It is recommended to integrate the functionality of these systems into data centre management tools offering
an overall infrastructure management.
5.6 Security systems as per EN 50600-2-5
For access control the necessary information should be delivery, visitor and employee records, access
control systems, video records, and unauthorized entry and exit alarms. For additional information on access
procedures see B.1.
For fire, the necessary information should be fire compartment penetration data (i.e. location and status of
fire barriers) and all types of warning information being generated by the various detection systems,
inspection records. A cause and effect algorithm shall be available which describes what happens at each
stage of a fire or security event. For additional information on fire suppression procedures and maintenance
of fire barriers see B.1.4 and B.2.
For other internal environmental events, the necessary information should be inspection records for leaks
etc. For additional information on EMC directive procedures see B.3.
6 Acceptance test
6.1 General
Handover to operations are described as phase 11 of the design process in EN 50600-1. A critical aspect of
this handover is acceptance testing to ensure that the constructed facility matches the original design intent.
There is a unique opportunity for extensive acceptance testing of the infrastructure prior to the first
implementation of IT and the connected starting point of productive operation of a data centre. Cross domain
tests can be carried out only during pre-production phase. All test results shall be documented.
It is strongly recommended to involve operational personnel in acceptance tests.
Documentation shall be provided by vendors and suppliers of infrastructure prior to start of tests.
No responsibility for “completed” construction areas should be undertaken by the site Operations
Management without the formal acceptance of the area according to defined criteria. These should include
the following:
a) a full commissioning programme has been successfully completed up to and including Integrated
Systems Testing (IST) with all commissioning records fully updated;
b) all required training has been completed;
c) Operations Management should not undertake any management responsibility until they have satisfied
themselves that the systems are working through acceptance testing and are able to be properly
maintained;
d) Operations Management should have the opportunity to recruit and train staff well before live operations
commence. Ideally the core staff should be present during commissioning;
e) the following documentation should be made available prior to handover into live operations:
1) up to date and accurate “As-Built” records and drawings including engineering single line diagrams;
2) a full set of Operations and Maintenance manuals, including Standard Operating Procedures,
Maintenance Operating Procedures, Emergency Operating Procedures, escalation procedures etc.;
3) comprehensive commissioning records;
4) an up to date and accurate Asset Register;
5) a documented Planned Maintenance Schedule and a full set of maintenance records;
6) all documentation required for compliance with statutory regulation;
7) all documentation required for compliance with voluntary standards and certificates.
6.2 Building construction (EN 50600-2-1) tests
Escape routes should be checked to ensure that they are free of blockages.
The technological support of the escape routes e.g. emergency lights, escape routes pictograms, etc. shall
be tested.
6.3 Power distribution (EN 50600-2-2) tests
Resilience tests require switching off parts of the infrastructure to prove fail safe operation as planned.
Testing of generators requires a significant time of operation of the generators to ensure bridging of failure of
mains power supply for multiple hours.
UPS systems shall be on load when testing the generator as power factor at UPS input may have an impact
on generator start-up conditions.
A procedure to return to mains power supply shall be described and tested.
An integrated test of the power system should be performed to ensure that the critical IT load remains
functional throughout a simulated power outage. It is important that this test is performed in all permutations
of the redundant system configurations and with a simulated IT load which matches the maximum design
capacity. All tests shall be documented.
6.4 Environmental control (EN 50600-2-3) tests
An integrated test of the cooling system should be performed to ensure that the temperature and humidity in
the computer room spaces remains within the design limits. It is important that this test is performed in all
permutations of the redundant system configurations and with a simulated IT load which matches the
maximum design capacity.
Part load operation tests shall be carried out to approve the operational instructions for HVAC and cooling
configuration.
Testing humidity control will require adding and removing moisture from the air in the computer room, either
by testing equipment or by using the CRACs, if more than one CRAC is available for this purpose.
In case of controlling contaminants testing is only possible if the contaminants can be removed without
impact on the operational conditions.
6.5 Telecommunications cabling infrastructure (EN 50600-2-4) tests
Link and/or channel tests shall be carried out and documented to provide evidence that cabling is
implemented as designed.
6.6 Security systems (EN 50600-2-5) tests
Security systems shall be tested according to the security concept. Make sure that multiple alarms are
presented to security personnel in a way that:
a) enables them to easily identify the most important alarm;
b) workflow is presented to the personnel in clear instructions;
c) actions to be taken are acknowledged and documentation is enforced by the workflow.
There may be interaction between safety and security systems, such as in case of a fire, detection escape
routes are released that are blocked in normal operation. Interactions like this are part of the safety concept
and shall be tested and approved.
Tests shall be carried out and documented to ensure that each and every fire detector functions correctly
and elicits the appropriate response from the fire alarm system, sounders, strobe lights, voice alarm systems
and links to other systems. This shall be done by reference to the design specification and the cause and
effect algorithm.
6.7 Energy efficiency enablement tests
For detailed and granular energy efficiency enablement, monitoring infrastructure shall be tested. All test
results shall be documented.
6.8 Energy efficiency strategy tests
To achieve energy efficiency at any desired level, part load operation of all infrastructure subsystems shall
be tested and approved. All test results shall be documented.
When testing environmental control systems (see 6.4) with simulated IT load, this load shall be subsequently
reduced simulating part load operation. Check that operation of the systems according to the instructions
leads to the desired energy efficiency.
6.9 Monitoring tests
During all tests of 6.2 to 6.8 accompanying monitoring tests shall be carried out to ensure event generation
due to threshold and failure detection. All test results shall be documented.
7 Operational processes
7.1 General
The following processes are considered as operational processes:
a) Operations Management – infrastructure maintenance, monitoring and event management;
b) Incident Management – responding to unplanned events, recovery of normal operation state;
c) Change management – logging, coordination, approval and monitoring of all changes;
d) Configuration management – logging and monitoring of configuration items;
e) Capacity management – monitoring, analysis, reporting and improvement of capacity.
7.2 Operations management
7.2.1 Purpose
The aim of operations management is to keep the data centre at the status of normal operation.
Maintenance of infrastructure is carried out according to the supplier’s maintenance plan. Monitoring is
implemented for detection of actual status and failures, as well as to support management processes, e.g.
energy management, lifecycle management, capacity management and availability management.
Operational parameters are adjusted according to the instructions provided in the handover documentation
referred to in Clause 6.
7.2.2 Activities
7.2.2.1 Maintenance
Operations management shall manage an overall maintenance plan for all infrastructure elements compliant
to the instructions of the vendor. Consolidation shall be carried out to minimize downtimes of structures of
resilience.
Information about scheduled and on-going maintenance shall be provided to incident management by
operations management.
When necessary, information to the customer is provided by customer management.
7.2.2.2 Monitoring
Operations management has to implement a monitoring infrastructure to provide information about the status
and failures of all data centre infrastructure elements. Additional data for use in management processes such
as energy management, lifecycle management, capacity management and availability management is
acquired by monitoring.
For larger data centres it is recommended to set-up a separate logical network for technical purposes for
monitoring and controlling of infrastructure.
7.2.2.3 Event management
The exceptional status of an infrastructure element or the total infrastructure is handled as an event. Event
management aims to define threshold values and maintain these after changes. During periods of
maintenance events should be managed in a way that unnecessary alarms are suppressed.
Event management also aims to provide confirmation, consolidation and forwarding of events to other
processes like Incident Management or energy management.
7.2.3 Base KPI
7.2.3.1 Mean time between failure (MTBF)
The aim of operations management is to maximize the time between failures.
EN 50600-1:2012, 4.3, describes four impact categories:
a) low: Loss of non-critical services;
b) medium: Failure of critical system components but no loss of redundancy;
c) high: Loss of critical system redundancy but no loss of service to clients;
d) critical: Loss of critical service to one or more clients or loss of life (which may be extended to address
personal injury).
The KPI shall be reported for every impact category.
MTBF is a well-known KPI, but it requires a set of failures to be calculated. Before the second failure, it is not
possible to determine a “time between failures”. Before the third failure, there is no concept of “mean”.
Therefore it can be useful to report the actual time between failures, especially for the higher impact
categories.
7.2.3.2 Number of incidents
Prevention of failures leads to less incidents. Therefore, the number of incidents is a KPI for operations
management.
7.2.4 Advanced KPI
7.2.4.1 Availability
A failure can impact the availability of the data centre. The focus of operations management is to maintain
availability. Therefore availability is an advanced KPI for operations management.
7.2.4.2 Unplanned replacement of infrastructure components
Maintenance as an activity in operations management aims to replace components under controlled
conditions, i.e. scheduled, budgeted and approved. The need for unplanned replacement of infrastructure is
a deviation from good maintenance. Therefore, unplanned replacement of infrastructure components is an
advanced KPI for operations management.
7.3 Incident management
7.3.1 Purpose
The aim of Incident Management is removal of failures and recovery to normal operation state. Accidents
should be handled as an incident category.
7.3.2 Activities
7.3.2.1 Removal of failures
Incident Management receives messages about failures from Event Management. Incidents are registered,
monitored, solved and closed.
In addition, every incident is categorized with respect to the incident severity according to the four impact
categories described EN 50600-1:2012, 4.3:
a) low: Loss of non-critical services;
b) medium: Failure of critical system components but no loss of redundancy;
c) high: Loss of critical system redundancy
...








Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.
Loading comments...