ETSI EG 202 798 V1.1.1 (2010-11)

ETSI EG 202 798 V1.1.1 (2011-01)
ETSI Guide
Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing

2 ETSI EG 202 798 V1.1.1 (2011-01)

Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: +33 4 92 94 42 00  Fax: +33 4 93 65 47 16

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3 ETSI EG 202 798 V1.1.1 (2011-01)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 11
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 29
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI
4 ETSI EG 202 798 V1.1.1 (2011-01)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48

ETSI
5 ETSI EG 202 798 V1.1.1 (2011-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS).
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI
6 ETSI EG 202 798 V1.1.1 (2011-01)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): "Information technology - Open Systems Interconnection - Conformance
testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI
7 ETSI EG 202 798 V1.1.1 (2011-01)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range".
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI
8 ETSI EG 202 798 V1.1.1 (2011-01)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI
9 ETSI EG 202 798 V1.1.1 (2011-01)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI
10 ETSI EG 202 798 V1.1.1 (2011-01)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoperability testing.
ETSI
11 ETSI EG 202 798 V1.1.1 (2011-01)
4.2 ITS environment
The ITS architecture is presented in [i.13], [i.22] using different views. Main views presented are the top level
networking view and the ITS station reference architecture view.
The top level networking view [i.13], [i.22] is presented in figure 1. A more implementation-oriented presentation is
given in [i.17]. It is presumed that communication within a single network does not meet all the requirements of all ITS
applications. Instead combinations of networks are envisioned, in which multiple ITS access and networking
technologies are applied.
Figure 1: Top level networking view of ITS
The networks are grouped into
• ITS domain:
- ITS station-internal network;
- ITS station-external network:
� ITS ad-hoc network;
� ITS access network.
• Generic domain:
- all other networks.
ITS are composed of four different ITS sub-systems, i.e. vehicular sub-system (cars, trucks, emergency vehicles, etc.),
road-side sub-systems, central sub-systems and personal (portable) sub-systems as specified in [i.22], [i.13] presented in
figure 2.
ETSI
12 ETSI EG 202 798 V1.1.1 (2011-01)

Figure 2: ITS sub-systems [i.13], [i.22]
Each ITS sub-system contains an ITS station with functionality as specified in the ITS station reference architecture
presented in figure 3.
NOTE: The term "ITS station" (ITS-S) indicates a set of possible functionalities rather than a physical unit.
ITS stations act as peer stations in communication networks applying different access technologies, different
networking & transport protocols, different facility protocols and the related security and management functionalities.
The communication media usually are wireless. The various layers and entities in the ITS station reference architecture
are interconnected via interfaces MI, MN, MF, MA, SI, SN, SF, SA, MS, IN, NF, FA [i.22], [i.13], see figure 3.
Applications
MA FA SA
Facilities
NF
Networking &
Transport
IN
Access
MS
Figure 3: ITS station reference architecture [i.13], [i.22]
ETSI
13 ETSI EG 202 798 V1.1.1 (2011-01)
Accessibility of these interfaces may be dependent on the implementation.
Table 1 presents the layers and entities of the ITS station reference architecture being present in ITS-functional
components.
Table 1: Summary of ITS layers and entities in ITS-S functional components
Main objects ITS-S Layers and entities
(ITS sub-systems) functional
Applications Facilities Networking & Access Management Security
components (FL) Transport (NL) (AL) (ME) (SE)
Vehicle ITS-S host X X X X X X
Roadside
ITS-S router  X X X X
Central
ITS-S gateway X X X X X
Personal
ITS-S border  X X X X
router
ETSI
14 ETSI EG 202 798 V1.1.1 (2011-01)
4.3 ITS base standards
Figure 4 shows a snap-shot of base standard development in several standardisation organisations as of April 2010.
Security
ETSI ES 202 910
ETSI TS 102 731 ETSI TS 102 893
ISO IS 16445
Identity
Secure services Thread Vulnerability
Handover
management and
and architecture and Risk Analysis
Architecture
protection
ISO IS 16460
ISO IS11769 IEEE 1609.2
WAVE
ISO IS 13181 ISO IS 11776
Data retention for WAVE Security
Integration Security Lawfull intercept
law enforcement Services
ISO IS 21217
Architecture
ETSI TS 102 890 IEEE 1609.3 IEEE 1609.4
Comms mngmt / WAVE IEEE 802.11 WAVE Multi-
service Networking Amendment p Channel
announcement Services Operation
ETSI EN 302 665
Architecture
ETSI ES 202 663
ETSI TS 102 637 ETSI TS 102 724
ETSI TS 102 636 5,9 GHz ETSI TS 102 687
Basic Set of Channel
GeoNetworking European Power Control
Applications Specification
Profile of 802.11
IEEE 1609.1
WAVE
ETSI TS 102 894
Facility layer
structure
IEEE 1609.0
WAVE ISO IS 21218
Architecture LL SAPs
ETSI EN 302 895
ISO IS 29283
BSA, LDM
IEEE 802.20
specification
ISO IS 29281 ISO IS 25113
ISO IS 29281
IEEE 1609.5 ISO IS 29281 ISO IS 29282 Non-IP WBB
Non-IP
WAVE Legacy Systems Satellites DSRC legacy Existing
networking
systems Systems
ISO IS 24102
ISO IS 25112 ISO IS 25111
FAST service ISO IS 16444 ISO IS 24103
WBB WBB
provision, Geo-routing MAIL
WiMAX General support
Legacy Systems
ISO IS 21215
ISO IS 24101
ISO IS 21210 ISO IS 21216 CALM M5 ISO IS 21214
Application
IP networking CALM MM International CALM IR
management
profile of 802.11
ISO IS 24978 ISO IS 15662 ISO IS 18183
ISO IS 21212 ISO IS 21213
ITS safety and TICS message ISO IS 24103 Public
2G 3G
emergency management MAIL broadcast
EDGE, GPRS UMTS, CDMA2K
notification information reception
Networking &
Applications Facilities Access Technologies
Transport
ISO IS 24102
ETSI TS 102 723 ISO IS 24101 ISO IS 29281
Station and ETSI TS 102 860
Interfaces Application FAST service
communication ITS-AID
(SAPs) management advertisement
management
Management
Figure 4: ITS base standard development
Standards displayed in figure 4, which may be subject for testing according to this ITS testing framework, are e.g.:
Access layer protocols:
• Channel specification [i.20] and power control [i.19] for ITS-G5;
• CALM media IR [i.11] and M5 [i.12];
• CALM medium service access points [i.14].
ETSI
15 ETSI EG 202 798 V1.1.1 (2011-01)
Networking & transport layer protocols:
• Basic transport protocol (for GeoNetworking) [i.17];
• GeoNetworking (media-independent functionality and media-dependent functionality ITS-G5) [i.17];
• IPv6 over GeoNetworking [i.17];
• CALM FAST networking and transport protocol [i.16];
• IPv6 in the context of ITS [i.9];
• CALM Geo-Routing (new work item at ISO TC204 WG16), referring to the basic GeoNetworking protocols
developed at ETSI.
Facilities layer protocols:
• CAM [i.18];
• DENM [i.18];
• CALM legacy system support [i.15], [i.16] e.g. CEN DSRC for electronic fee collection.
Management, security and cross-layer protocols:
• CALM FAST service advertisement [i.15], [i.16];
• "Inter ITS-SCU" management communication [i.15];
• ITS station and communication management [i.15];
• ITS architecture elements [i.13].
ETSI
16 ETSI EG 202 798 V1.1.1 (2011-01)
4.4 ITS test standards
Examples of test standards for ITS base standards being under development/being finalized at ETSI and ISO are
presented in figure 5.
Figure 5: Activities on testing ITS base standards
Some test work items identified at ETSI at time of writing the present document are [i.23] to [i.34].
5 Introduction to the ITS testing framework EG
The present document provides:
• Guidance to identify the candidate implementations under test (IUT) for conformance testing in clause 6.1 and
the equipment under test (EUTs) for interoperability in clause 7.1, i.e. answering the question "what is to be
tested".
• Guidance to define the applicable test procedures in clauses 6 and 7, i.e. answering the question "how is to be
tested".
• Guidance to develop the resulting test specifications and deliverables (for instance: TSS&TP, TP proforma,
TTCN-3 test suite and documentation) in clause 8.
ETSI
17 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 6 illustrates the ITS testing framework and the interactions with ITS base standards and ITS test specifications.
The ITS testing framework is based on concepts defined in ISO 9646 [i.7], TTCN-3 [i.4] and EG 202 237 [i.5].

Figure 6: ITS testing framework interactions
As far as possible, specific ITS protocol base standards are identified which may be subject to conformance and/or
interoperability testing according to this testing framework. However this ITS testing framework in no way restricts its
applicability to these protocols. This ITS testing framework also in support of any other ITS protocol base standard.
5.1 Conformance testing
Clause 6 provides guidelines for conformance testing, which includes:
• Identification of candidate "Implementations Under Test" (IUT);
• Identification of reference points;
• Identification of the ATM:
- abstract protocol tester;
- functional TTCN-3 test architecture.
5.2 Interoperability testing
Clause 7 provides guidelines for interoperability testing, which includes:
• Identification of candidate EUTs.
• Identification of test scenarios.
• Definition of test bed architecture.
ETSI
18 ETSI EG 202 798 V1.1.1 (2011-01)
• Identification of test bed interfaces.
5.3 Steps for development of test specifications
Clause 8 provides guidance to write test specifications and to develop TTCN-3 test suites:
• Developing "Implementation Conformance Statements" (ICS) or "Interoperable Functions Statement" (IFS)
from base standards, if not already provided as part of the base standard.
• Developing "Test Suite Structure and Test Purposes" (TSS&TP) from ICS and base standards.
• Developing "Test Descriptions" (TDs) from base standards.
• Developing ITS TTCN-3 test suite, e.g. naming conventions, code documentation, test case structure.
6 Conformance testing
The following clauses are providing conformance testing methodologies to be applied in ITS.
6.1 Candidate IUTs
The "Implementation Under Test" (IUT) is a protocol implementation considered as an object for testing. This means
that the test process will focus on verifying the compliance of this protocol implementation (IUT) with requirements set
up in the related base standard. An IUT normally is implemented in a "System Under Test" (SUT). For testing, an SUT
is connected to a test system over at least a single interface specified in the related ITS base standard. Such an interface
is identified as "Reference Point" (RP) in the present document.
NOTE: Other interfaces between the test system and the IUT may be used to control the behaviour of the IUT
during the test process.
Further details on RPs are presented in clause 6.2.
IUTs normally are protocols located in a layer or an entity of the ITS station reference architecture presented in figure 3.
Examples of IUTs and their location in the ITS station reference architecture are illustrated in figure 7. Further details
are presented in tables 2 and 3.
ETSI
19 ETSI EG 202 798 V1.1.1 (2011-01)

/
/
s
r
P
e
A g
a
S
n
o
a
t
m
s
s t
e s
c a
c c
a p
u
e
t o
r
o
g
m
S
e
T
R I
/
/
t
.
n
.
n
o .
i
e
t
a
m
c
e
i
c
n
n
u
u
m
o
n
m
o n
c a
e
U
c
i
C
v
r
S
-
e
S s
T
I T
-
r S
e
A
t
F
n
I
Figure 7: Examples of IUTs in the ITS station reference architecture
Table 2 exemplifies candidates for IUTs for RP-External identified in clause 6.2.
Table 2: Candidates for IUTs for RP-External
Layer/entity IUT (protocols) ITS specific Notes
Apps ITS-S application messages YES Not considered for conformance testing.
To be used for interoperability testing.
FL CAM [i.18] YES
DENM [i.18] YES
Legacy CI port manager [i.16] YES
15628 kernel emulator [i.16] YES
NL Basic transport protocol for GeoNetworking [i.17] YES
FAST networking and transport protocol [i.16] YES
GeoNetworking [i.17] YES
IPv6 for ITS [i.9] YES No test of IPv6 functionality from IETF,
but only tests on how to use this
functionality in the context of ITS.
IPv6 over GeoNetworking [i.17] YES
ITS-MUX [i.16] YES
Legacy protocols such as TCP, UDP NO
AL CAL extension for legacy systems [i.16] YES
CALM IR [i.11] YES
CALM M5 (ITS-G5) [i.12] YES The basic MAC and PHY is
standardized in IEEE 802.11 [i.38] and
thus not subject of tests within this ITS
framework.
CALM medium service access points/support of YES
legacy technologies [i.14]
Legacy technologies NO Covered by other testing frameworks.
ME FAST service advertisement [i.15] YES
Legacy system support [i.15] YES
SE To be defined YES Base standards are under
development.
ETSI
20 ETSI EG 202 798 V1.1.1 (2011-01)
Table 3 exemplifies candidates for IUTs for the RP-Internal-ITS-S identified in clause 6.2.
Table 3: Candidates for IUTs for RP-Internal-ITS-S
Layer/entity Protocols ITS specific Notes
ME Inter-ITS-SCU PDUs (allows for e.g. YES
remote access to SAPs) [i.15]
LAN technology protocols, wired or NO Does not require specific testing for ITS.
wireless, e.g. TCP/IP, Ethernet,
Bluetooth
NL Local forwarding of FAST packets [i.16] Yes

Tables 2 and 3 need to be amended in the following cases:
• A new protocol is identified as a new potential IUT and interacts in one of the RPs.
• A new ITS-S functional component or ITS sub-system is defined. This should be included as a SUT as long as
it interacts in one of the RPs.
• If a new RP is identified, the same analysis is done for incorporating the corresponding SUT and IUT.
6.2 Reference points
This clause illustrates candidate reference points (RPs) where test systems can be connected in order to test
conformance of ITS protocols (IUTs) with ITS base standards.
RPs listed in tables 4 and 5 are classified in two groups:
• External networking RPs (RP-External) are based on the ITS sub-systems presented in figure 2 and the
related external networks presented in figure 1.
Table 4: External networking reference points RP-External
RP Identifier RP Name ITS sub-system ITS sub-system Network
RP-ITS-Ext-1 R Vehicle Vehicle ITS ad-hoc
A
RP-ITS-Ext-2
R Vehicle Roadside ITS ad-hoc
B
RP-ITS-Ext-3 R Personal Personal ITS ad-hoc
C
RP-ITS-Ext-4 R
Roadside Personal ITS ad-hoc
D
RP-ITS-Ext-5 R Vehicle Personal ITS ad-hoc
E
RP-ITS-Ext-6 R Roadside Roadside ITS ad-hoc
F
RP-ITS-Ext-7 R Vehicle Roadside ITS ad-hoc
I
RP-ITS-Ext-8 R Roadside Personal ITS ad-hoc
J
RP-ITS-Ext-9
R Vehicle Roadside Public
K
RP-ITS-Ext-10 R Vehicle Central Public
L
RP-ITS-Ext-11 R
Roadside Personal Public
M
RP-ITS-Ext-12 R Personal Central Public
N
RP-ITS-Ext-13 R Vehicle Personal Public
O
RP-ITS-Ext-14 R Roadside Central Public
P
RP-ITS-Ext-15 R Roadside Central Private
S
RP-ITS-Ext-16
R Central Central Public/Private
Z
ETSI
21 ETSI EG 202 798 V1.1.1 (2011-01)
• Internal network RPs (RP-Internal-ITS-S) are based on the ITS-S functional components listed in clause 4.2
and taking into account the interaction via the ITS station internal network presented in figures 1 and 2
between the functional components inside the same sub-system.
Table 5: Internal networking reference points RP-Internal-ITS-S
ITS sub-system RP Name ITS-S functional ITS-S functional ID
component component
Vehicle R ITS-S host ITS-S host RP-ITS-Int-1
V1
R RP-ITS-Int-2
ITS-S host ITS-S router
V2
R ITS-S host ITS-S gateway RP-ITS-Int-3
V3
R ITS-S host ITS-S border router RP-ITS-Int-4
V4
R ITS-S router ITS-S router RP-ITS-Int-5
V5
R ITS-S router ITS-S gateway RP-ITS-Int-6
V6
R ITS-S router ITS-S border router RP-ITS-Int-7
V7
R ITS-S gateway ITS-S gateway RP-ITS-Int-8
V8
RP-ITS-Int-9
R ITS-S gateway ITS-S border router
V9
Roadside R ITS-S host ITS-S host RP-ITS-Int-10
R1
R ITS-S host ITS-S router RP-ITS-Int-11
R2
R ITS-S host ITS-S gateway RP-ITS-Int-12
R3
R ITS-S host ITS-S border router RP-ITS-Int-13
R4
RP-ITS-Int-14
R ITS-S router ITS-S router
R5
R ITS-S router ITS-S gateway RP-ITS-Int-15
R6
R RP-ITS-Int-16
ITS-S router ITS-S border router
R7
R ITS-S gateway ITS-S gateway RP-ITS-Int-17
R8
R ITS-S gateway ITS-S border router RP-ITS-Int-18
R9
Central R ITS-S host ITS-S host RP-ITS-Int-19
C1
R ITS-S host ITS-S router RP-ITS-Int-20
C2
RP-ITS-Int-21
R ITS-S host ITS-S gateway
C3
R ITS-S host ITS-S border router RP-ITS-Int-22
C4
R RP-ITS-Int-23
ITS-S router ITS-S router
C5
R ITS-S router ITS-S gateway RP-ITS-Int-24
C6
R ITS-S router ITS-S b
...

SLOVENSKI STANDARD
01-junij-2011
Inteligentni transportni sistemi (ITS) - Preskušanje - Okvir za skladnost in
preskušanje medobratovalnosti
Intelligent Transport Systems (ITS) - Testing - Framework for conformance and
interoperability testing
Ta slovenski standard je istoveten z: EG 202 798 Version 1.1.1
ICS:
35.240.60 Uporabniške rešitve IT v IT applications in transport
transportu in trgovini and trade
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.

SIST EG 202 798 V1.1.1:2011
SIST EG 202 798 V1.1.1:2011
ETSI EG 202 798 V1.1.1 (2011-01)
ETSI Guide
Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing

SIST EG 202 798 V1.1.1:2011
2 ETSI EG 202 798 V1.1.1 (2011-01)

Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE

Tel.: +33 4 92 94 42 00  Fax: +33 4 93 65 47 16

Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88

Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.

© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
SIST EG 202 798 V1.1.1:2011
3 ETSI EG 202 798 V1.1.1 (2011-01)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 11
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 29
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI
SIST EG 202 798 V1.1.1:2011
4 ETSI EG 202 798 V1.1.1 (2011-01)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48

ETSI
SIST EG 202 798 V1.1.1:2011
5 ETSI EG 202 798 V1.1.1 (2011-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS).
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI
SIST EG 202 798 V1.1.1:2011
6 ETSI EG 202 798 V1.1.1 (2011-01)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): "Information technology - Open Systems Interconnection - Conformance
testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI
SIST EG 202 798 V1.1.1:2011
7 ETSI EG 202 798 V1.1.1 (2011-01)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range".
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI
SIST EG 202 798 V1.1.1:2011
8 ETSI EG 202 798 V1.1.1 (2011-01)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI
SIST EG 202 798 V1.1.1:2011
9 ETSI EG 202 798 V1.1.1 (2011-01)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI
SIST EG 202 798 V1.1.1:2011
10 ETSI EG 202 798 V1.1.1 (2011-01)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoperability testing.
ETSI
SIST EG 202 798 V1.1.1:2011
11 ETSI EG 202 798 V1.1.1 (2011-01)
4.2 ITS environment
The ITS architecture is presented in [i.13], [i.22] using different views. Main views presented are the top level
networking view and the ITS station reference architecture view.
The top level networking view [i.13], [i.22] is presented in figure 1. A more implementation-oriented presentation is
given in [i.17]. It is presumed that communication within a single network does not meet all the requirements of all ITS
applications. Instead combinations of networks are envisioned, in which multiple ITS access and networking
technologies are applied.
Figure 1: Top level networking view of ITS
The networks are grouped into
• ITS domain:
- ITS station-internal network;
- ITS station-external network:
ITS ad-hoc network;
ITS access network.
• Generic domain:
- all other networks.
ITS are composed of four different ITS sub-systems, i.e. vehicular sub-system (cars, trucks, emergency vehicles, etc.),
road-side sub-systems, central sub-systems and personal (portable) sub-systems as specified in [i.22], [i.13] presented in
figure 2.
ETSI
SIST EG 202 798 V1.1.1:2011
12 ETSI EG 202 798 V1.1.1 (2011-01)

Figure 2: ITS sub-systems [i.13], [i.22]
Each ITS sub-system contains an ITS station with functionality as specified in the ITS station reference architecture
presented in figure 3.
NOTE: The term "ITS station" (ITS-S) indicates a set of possible functionalities rather than a physical unit.
ITS stations act as peer stations in communication networks applying different access technologies, different
networking & transport protocols, different facility protocols and the related security and management functionalities.
The communication media usually are wireless. The various layers and entities in the ITS station reference architecture
are interconnected via interfaces MI, MN, MF, MA, SI, SN, SF, SA, MS, IN, NF, FA [i.22], [i.13], see figure 3.
Applications
MA FA SA
Facilities
NF
Networking &
Transport
IN
Access
MS
Figure 3: ITS station reference architecture [i.13], [i.22]
ETSI
SIST EG 202 798 V1.1.1:2011
13 ETSI EG 202 798 V1.1.1 (2011-01)
Accessibility of these interfaces may be dependent on the implementation.
Table 1 presents the layers and entities of the ITS station reference architecture being present in ITS-functional
components.
Table 1: Summary of ITS layers and entities in ITS-S functional components
Main objects ITS-S Layers and entities
(ITS sub-systems) functional
Applications Facilities Networking & Access Management Security
components (FL) Transport (NL) (AL) (ME) (SE)
Vehicle ITS-S host X X X X X X
Roadside
ITS-S router  X X X X
Central
ITS-S gateway X X X X X
Personal
ITS-S border  X X X X
router
ETSI
SIST EG 202 798 V1.1.1:2011
14 ETSI EG 202 798 V1.1.1 (2011-01)
4.3 ITS base standards
Figure 4 shows a snap-shot of base standard development in several standardisation organisations as of April 2010.
Security
ETSI ES 202 910
ETSI TS 102 731 ETSI TS 102 893
ISO IS 16445
Identity
Secure services Thread Vulnerability
Handover
management and
and architecture and Risk Analysis
Architecture
protection
ISO IS 16460
ISO IS11769 IEEE 1609.2
WAVE
ISO IS 13181 ISO IS 11776
Data retention for WAVE Security
Integration Security Lawfull intercept
law enforcement Services
ISO IS 21217
Architecture
ETSI TS 102 890 IEEE 1609.3 IEEE 1609.4
Comms mngmt / WAVE IEEE 802.11 WAVE Multi-
service Networking Amendment p Channel
announcement Services Operation
ETSI EN 302 665
Architecture
ETSI ES 202 663
ETSI TS 102 637 ETSI TS 102 724
ETSI TS 102 636 5,9 GHz ETSI TS 102 687
Basic Set of Channel
GeoNetworking European Power Control
Applications Specification
Profile of 802.11
IEEE 1609.1
WAVE
ETSI TS 102 894
Facility layer
structure
IEEE 1609.0
WAVE ISO IS 21218
Architecture LL SAPs
ETSI EN 302 895
ISO IS 29283
BSA, LDM
IEEE 802.20
specification
ISO IS 29281 ISO IS 25113
ISO IS 29281
IEEE 1609.5 ISO IS 29281 ISO IS 29282 Non-IP WBB
Non-IP
WAVE Legacy Systems Satellites DSRC legacy Existing
networking
systems Systems
ISO IS 24102
ISO IS 25112 ISO IS 25111
FAST service ISO IS 16444 ISO IS 24103
WBB WBB
provision, Geo-routing MAIL
WiMAX General support
Legacy Systems
ISO IS 21215
ISO IS 24101
ISO IS 21210 ISO IS 21216 CALM M5 ISO IS 21214
Application
IP networking CALM MM International CALM IR
management
profile of 802.11
ISO IS 24978 ISO IS 15662 ISO IS 18183
ISO IS 21212 ISO IS 21213
ITS safety and TICS message ISO IS 24103 Public
2G 3G
emergency management MAIL broadcast
EDGE, GPRS UMTS, CDMA2K
notification information reception
Networking &
Applications Facilities Access Technologies
Transport
ISO IS 24102
ETSI TS 102 723 ISO IS 24101 ISO IS 29281
Station and ETSI TS 102 860
Interfaces Application FAST service
communication ITS-AID
(SAPs) management advertisement
management
Management
Figure 4: ITS base standard development
Standards displayed in figure 4, which may be subject for testing according to this ITS testing framework, are e.g.:
Access layer protocols:
• Channel specification [i.20] and power control [i.19] for ITS-G5;
• CALM media IR [i.11] and M5 [i.12];
• CALM medium service access points [i.14].
ETSI
SIST EG 202 798 V1.1.1:2011
15 ETSI EG 202 798 V1.1.1 (2011-01)
Networking & transport layer protocols:
• Basic transport protocol (for GeoNetworking) [i.17];
• GeoNetworking (media-independent functionality and media-dependent functionality ITS-G5) [i.17];
• IPv6 over GeoNetworking [i.17];
• CALM FAST networking and transport protocol [i.16];
• IPv6 in the context of ITS [i.9];
• CALM Geo-Routing (new work item at ISO TC204 WG16), referring to the basic GeoNetworking protocols
developed at ETSI.
Facilities layer protocols:
• CAM [i.18];
• DENM [i.18];
• CALM legacy system support [i.15], [i.16] e.g. CEN DSRC for electronic fee collection.
Management, security and cross-layer protocols:
• CALM FAST service advertisement [i.15], [i.16];
• "Inter ITS-SCU" management communication [i.15];
• ITS station and communication management [i.15];
• ITS architecture elements [i.13].
ETSI
SIST EG 202 798 V1.1.1:2011
16 ETSI EG 202 798 V1.1.1 (2011-01)
4.4 ITS test standards
Examples of test standards for ITS base standards being under development/being finalized at ETSI and ISO are
presented in figure 5.
Figure 5: Activities on testing ITS base standards
Some test work items identified at ETSI at time of writing the present document are [i.23] to [i.34].
5 Introduction to the ITS testing framework EG
The present document provides:
• Guidance to identify the candidate implementations under test (IUT) for conformance testing in clause 6.1 and
the equipment under test (EUTs) for interoperability in clause 7.1, i.e. answering the question "what is to be
tested".
• Guidance to define the applicable test procedures in clauses 6 and 7, i.e. answering the question "how is to be
tested".
• Guidance to develop the resulting test specifications and deliverables (for instance: TSS&TP, TP proforma,
TTCN-3 test suite and documentation) in clause 8.
ETSI
SIST EG 202 798 V1.1.1:2011
17 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 6 illustrates the ITS testing framework and the interactions with ITS base standards and ITS test specifications.
The ITS testing framework is based on concepts defined in ISO 9646 [i.7], TTCN-3 [i.4] and EG 202 237 [i.5].

Figure 6: ITS testing framework interactions
As far as possible, specific ITS protocol base standards are identified which may be subject to conformance and/or
interoperability testing according to this testing framework. However this ITS testing framework in no way restricts its
applicability to these protocols. This ITS testing framework also in support of any other ITS protocol base standard.
5.1 Conformance testing
Clause 6 provides guidelines for conformance testing, which includes:
• Identification of candidate "Implementations Under Test" (IUT);
• Identification of reference points;
• Identification of the ATM:
- abstract protocol tester;
- functional TTCN-3 test architecture.
5.2 Interoperability testing
Clause 7 provides guidelines for interoperability testing, which includes:
• Identification of candidate EUTs.
• Identification of test scenarios.
• Definition of test bed architecture.
ETSI
SIST EG 202 798 V1.1.1:2011
18 ETSI EG 202 798 V1.1.1 (2011-01)
• Identification of test bed interfaces.
5.3 Steps for development of test specifications
Clause 8 provides guidance to write test specifications and to develop TTCN-3 test suites:
• Developing "Implementation Conformance Statements" (ICS) or "Interoperable Functions Statement" (IFS)
from base standards, if not already provided as part of the base standard.
• Developing "Test Suite Structure and Test Purposes" (TSS&TP) from ICS and base standards.
• Developing "Test Descriptions" (TDs) from base standards.
• Developing ITS TTCN-3 test suite, e.g. naming conventions, code documentation, test case structure.
6 Conformance testing
The following clauses are providing conformance testing methodologies to be applied in ITS.
6.1 Candidate IUTs
The "Implementation Under Test" (IUT) is a protocol implementation considered as an object for testing. This means
that the test process will focus on verifying the compliance of this protocol implementation (IUT) with requirements set
up in the related base standard. An IUT normally is implemented in a "System Under Test" (SUT). For testing, an SUT
is connected to a test system over at least a single interface specified in the related ITS base standard. Such an interface
is identified as "Reference Point" (RP) in the present document.
NOTE: Other interfaces between the test system and the IUT may be used to control the behaviour of the IUT
during the test process.
Further details on RPs are presented in clause 6.2.
IUTs normally are protocols located in a layer or an entity of the ITS station reference architecture presented in figure 3.
Examples of IUTs and their location in the ITS station reference architecture are illustrated in figure 7. Further details
are presented in tables 2 and 3.
ETSI
SIST EG 202 798 V1.1.1:2011
19 ETSI EG 202 798 V1.1.1 (2011-01)

/
/
s
r
P
e
A g
a
S
n
o
a
t
m
s
s t
e s
c a
c c
a p
u
e
t o
r
o
g
m
S
e
T
R I
/
/
t
.
n
.
n
o .
i
e
t
a
m
c
e
i
c
n
n
u
u
m
o
n
m
o n
c a
e
U
c
i
C
v
r
S
-
e
S s
T
I T
-
r S
e
A
t
F
n
I
Figure 7: Examples of IUTs in the ITS station reference architecture
Table 2 exemplifies candidates for IUTs for RP-External identified in clause 6.2.
Table 2: Candidates for IUTs for RP-External
Layer/entity IUT (protocols) ITS specific Notes
Apps ITS-S application messages YES Not considered for conformance testing.
To be used for interoperability testing.
FL CAM [i.18] YES
DENM [i.18] YES
Legacy CI port manager [i.16] YES
15628 kernel emulator [i.16] YES
NL Basic transport protocol for GeoNetworking [i.17] YES
FAST networking and transport protocol [i.16] YES
GeoNetworking [i.17] YES
IPv6 for ITS [i.9] YES No test of IPv6 functionality from IETF,
but only tests on how to use this
functionality in the context of ITS.
IPv6 over GeoNetworking [i.17] YES
ITS-MUX [i.16] YES
Legacy protocols such as TCP, UDP NO
AL CAL extension for legacy systems [i.16] YES
CALM IR [i.11] YES
CALM M5 (ITS-G5) [i.12] YES The basic MAC and PHY is
standardized in IEEE 802.11 [i.38] and
thus not subject of tests within this ITS
framework.
CALM medium service access points/support of YES
legacy technologies [i.14]
Legacy technologies NO Covered by other testing frameworks.
ME FAST service advertisement [i.15] YES
Legacy system support [i.15] YES
SE To be defined YES Base standards are under
development.
ETSI
SIST EG 202 798 V1.1.1:2011
20 ETSI EG 202 798 V1.1.1 (2011-01)
Table 3 exemplifies candidates for IUTs for the RP-Internal-ITS-S identified in clause 6.2.
Table 3: Candidates for IUTs for RP-Internal-ITS-S
Layer/entity Protocols ITS specific Notes
ME Inter-ITS-SCU PDUs (allows for e.g. YES
remote access to SAPs) [i.15]
LAN technology protocols, wired or NO Does not require specific testing for ITS.
wireless, e.g. TCP/IP, Ethernet,
Bluetooth
NL Local forwarding of FAST packets [i.16] Yes

Tables 2 and 3 need to be amended in the following cases:
• A new protocol is identified as a new potential IUT and interacts in one of the RPs.
• A new ITS-S functional component or ITS sub-system is defined. This should be included as a SUT as long as
it interacts in one of the RPs.
• If a new RP is identified, the same analysis is done for incorporating the corresponding SUT and IUT.
6.2 Reference points
This clause illustrates candidate reference points (RPs) where test systems can be connected in order to test
conformance of ITS protocols (IUTs) with ITS base standards.
RPs listed in tables 4 and 5 are classified in two groups:
• External networking RPs (RP-External) are based on the ITS sub-systems presented in figure 2 and the
related external networks presented in figure 1.
Table 4: External networking reference points RP-External
RP Identifier RP Name ITS sub-system ITS sub-system Network
RP-ITS-Ext-1 R Vehicle Vehicle ITS ad-hoc
A
RP-ITS-Ext-2
R Vehicle Roadside ITS ad-hoc
B
RP-ITS-Ext-3 R Personal Personal ITS ad-hoc
C
RP-ITS-Ext-4 R
Roadside Personal ITS ad-hoc
D
RP-ITS-Ext-5 R Vehicle Personal ITS ad-hoc
E
RP-ITS-Ext-6 R Roadside Roadside ITS ad-hoc
F
RP-ITS-Ext-7 R Vehicle Roadside ITS ad-hoc
I
RP-ITS-Ext-8 R Roadside Personal ITS ad-hoc
J
RP-ITS-Ext-9
R Vehicle Roadside Public
K
RP-ITS-Ext-10 R Vehicle Central Public
L
RP-ITS-Ext-11 R
Roadside Personal Public
M
RP-ITS-Ext-12 R Personal Central Public
N
RP-ITS-Ext-13 R Vehicle Personal Public
O
RP-ITS-Ext-14 R Roadside Central Public
P
RP-ITS-Ext-15 R Roadside Central Private
S
RP-ITS-Ext-16
R Central Central Public/Private
Z
ETSI
SIST EG 202 798 V1.1.1:2011
21 ETSI EG 202 798 V1.1.1 (2011-01)
• Internal network RPs (RP-Internal-ITS-S) are based on the ITS-S functional components listed in clause 4.2
and taking into account the interaction via the ITS station internal network presente
...