SIST-V ETSI/EG 202 798 V1.1.1:2011
(Main)Intelligent Transport Systems (ITS) - Testing - Framework for conformance and interoperability testing
- Abstract
Specifies the global framework for conformance and interoperability testing in ITS.
- Status
- Published
- Publication Date
- 14-Apr-2011
- Technical Committee
- MOC - Mobile Communications
- Current Stage
- 6060 - National Implementation/Publication (Adopted Project)
- Start Date
- 07-Apr-2011
- Due Date
- 12-Jun-2011
- Completion Date
- 15-Apr-2011
Buy Documents
eg_202798v010101m - Intelligent Transport Systems (ITS); Testing; Framework for conformance and interoperability testing
eg_202798v010101p - Intelligent Transport Systems (ITS); Testing; Framework for conformance and interoperability testing
SIST-V ETSI/EG 202 798 V1.1.1:2011 is the Slovenian version of ETSI EG 202 798 V1.1.1, an ETSI Guide from the Intelligent Transport System (ITS) Technical Committee. It gives a global framework for conformance testing and interoperability testing in ITS, and it is aimed at people who develop test specifications, test systems, and test suites for ITS base standards.
What does SIST-V ETSI/EG 202 798 V1.1.1:2011 specify?
SIST-V ETSI/EG 202 798 V1.1.1:2011 specifies guidance for building ITS test strategies and test specifications. Clause 1 sets the scope around ETSI, ISO, CEN and other Standard Developing Organisations (SDOs), while clauses 6 to 8 turn that guidance into practical test development steps.
The document is organized as follows:
- Clause 1 - Scope
- Clause 2 - References
- Clause 3 - Definitions and abbreviations
- Clause 4 - ITS foundations
- Clause 5 - Introduction to the ITS testing framework EG
- Clause 6 - Conformance testing
- Clause 7 - Interoperability testing
- Clause 8 - Development of test specifications and test suites
- Annex A - Introduction to interoperability testing
In practice, the guide is about how to test ITS communications equipment in a systematic way. It is not a protocol standard itself; it tells you how to identify what to test, how to structure the test environment, and how to write the resulting test deliverables.
What are the key requirements of SIST-V ETSI/EG 202 798 V1.1.1:2011?
The document's main value is the testing framework itself. It explains how to move from a base standard to concrete conformance and interoperability test artifacts, with references to the relevant ITS architecture and testing methods.
Conformance testing in clause 6
Clause 6 defines conformance testing around an Implementation Under Test (IUT), a System Under Test (SUT), and a Reference Point (RP). The IUT is the protocol implementation being checked against the base standard, and the RP is the interface used to connect the test system. In practice, this tells test engineers where to connect the tester and which protocol behavior to verify.
Clause 6 also identifies candidate IUTs and lower-layer protocols for testing, such as CAM, DENM, GeoNetworking, IPv6 over GeoNetworking, CALM FAST, CALM IR, and CALM M5. The guide notes that some underlying technologies, such as the basic IEEE 802.11 MAC and PHY, are not the subject of ITS testing within this framework. That matters because it keeps the test scope on ITS-specific behavior rather than on every underlying radio detail.
Reference points and test architecture
Clause 6.2 groups RPs into external networking RPs and internal networking RPs. External RPs relate to communication between ITS sub-systems such as vehicle, roadside, personal, and central sub-systems; internal RPs relate to interactions inside an ITS station. This helps a test designer decide whether a test is about inter-station behavior or behavior inside one station.
Clause 6.3 describes the abstract protocol tester and the functional TTCN-3 test architecture. The abstract protocol tester emulates the peer entity, sends valid and invalid protocol messages, and evaluates the reaction of the IUT. The practical value is that testers can check whether a protocol behaves correctly without needing a full real-world traffic environment.
Interoperability testing in clause 7 and Annex A
Clause 7 shifts from protocol conformance to equipment interoperability. It defines the Equipment Under Test (EUT) as a physical ITS station or a physical subset of one, and it uses test scenarios to group EUTs that support the same use cases. This matters when a buyer, vendor, or lab wants to see whether equipment from different manufacturers works together in a realistic setup.
Clause 7.3 and 7.4 describe the test bed architecture and its interfaces. The framework separates data, control, and test-operator interfaces, so a test setup can stimulate equipment, monitor message exchange, and trace execution. Annex A then explains the relationship between conformance and interoperability testing, including interoperability testing with conformance checks and automated interoperability testing.
Test specification and test suite development in clause 8
Clause 8 gives the practical deliverables: ICS proforma, TSS&TPs, TTCN-3 abstract test suites, IFS proforma, and Test Descriptions (TDs). It explains how to structure test purposes into a Test Suite Structure (TSS), how to write a TP proforma, and how to identify each TP with a consistent naming convention. For test writers, this is the part that turns requirements into a usable, maintainable test catalog.
Clause 8 also defines the structure of TTCN-3 test suites for ITS, including naming conventions, code documentation, logging, and test case structure. That is important for labs and tool users because it supports consistent TTCN-3 code across different ITS test projects.
What terms does SIST-V ETSI/EG 202 798 V1.1.1:2011 define?
- Conformance testing - testing that an implementation is compliant with a protocol standard by using a test system that simulates the protocol.
- Interoperability testing - testing that devices from different vendors can operate together according to scenarios based on a protocol standard.
- Testing framework - a document that gives guidance and examples needed to develop and implement a test specification.
- Implementation Under Test (IUT) - the protocol implementation being tested for conformance.
- Equipment Under Test (EUT) - a physical ITS station, or a physical subset of one, being tested for interoperability.
- Reference Point (RP) - the interface used to connect a test system to the implementation or equipment under test.
- Interoperable Functions Statement (IFS) - a statement of standardized functions that an EUT must support for interoperability.
- Protocol Implementation Conformance Statement (PICS) - a statement used to select test purposes based on the protocol options and conditions supported.
Who uses SIST-V ETSI/EG 202 798 V1.1.1:2011?
SIST-V ETSI/EG 202 798 V1.1.1:2011 is used by ITS standards developers, test specification writers, test laboratories, manufacturers, and vendors of ITS communications equipment. It is relevant to people working on vehicle, roadside, central, and personal ITS sub-systems, especially where conformance and interoperability need to be proven before deployment or certification.
The guide is also useful for teams preparing interoperability test events and for organizations building automated or semi-automated ITS test beds. In practice, it helps them define test scenarios, choose reference points, write test purposes, and document TTCN-3 or test-description based test cases.
Which standards are used with SIST-V ETSI/EG 202 798 V1.1.1:2011?
The document uses ISO/IEC 9646 for conformance testing methodology and ETSI ES 201 873 for TTCN-3. It also points to ETSI EG 202 237 for interoperability testing and IFS guidance, ETSI EG 202 810 for automated interoperability testing, ETSI EG 201 058 for ICS proforma style, ETSI ETR 266 for test purpose writing, and ETSI ETS 300 406 for protocol and profile conformance testing methodology.
For ITS content, the guide cites the architecture and base standards that may be tested with this framework, including ETSI EN 302 665, ETSI TS 102 636, ETSI TS 102 637, ETSI TS 102 687, ETSI TS 102 724, ETSI TS 102 860, ETSI TS 102 731, ETSI TS 102 894, ETSI EN 302 895, and a range of ISO CALM, IEEE WAVE, and related standards. These references give the protocol context for testable functions such as CAM, DENM, GeoNetworking, BTP, CALM, and security-related ITS mechanisms.
What does the SIST-V ETSI/EG 202 798 V1.1.1:2011 document contain?
The document contains architecture views, reference-point tables, and examples showing how ITS sub-systems map to testable protocols. It includes tables of candidate IUTs and candidate RPs, plus a mapping between protocols and lower-layer protocols for conformance testing.
It also contains guidance for:
- test purpose and test suite structure writing,
- TP identifiers and TP proforma fields,
- PICS-based selection,
- TTCN-3 naming conventions and code documentation,
- interoperability test descriptions and message-sequence examples.
Annex A adds a conceptual introduction to interoperability testing, including the test bed, manual and automated approaches, and the use of conformance checks inside interoperability sessions.
Buy Documents
eg_202798v010101m - Intelligent Transport Systems (ITS); Testing; Framework for conformance and interoperability testing
eg_202798v010101p - Intelligent Transport Systems (ITS); Testing; Framework for conformance and interoperability testing
Get Certified
Connect with accredited certification bodies for this standard
BSI Group
BSI (British Standards Institution) is the business standards company that helps organizations make excellence a habit.
NYCE
Mexican standards and certification body.
Sponsored listings
Frequently Asked Questions
SIST-V ETSI/EG 202 798 V1.1.1:2011 is a standard published by the Slovenian Institute for Standardization (SIST). Its full title is "Intelligent Transport Systems (ITS) - Testing - Framework for conformance and interoperability testing". This standard covers: Specifies the global framework for conformance and interoperability testing in ITS.
Specifies the global framework for conformance and interoperability testing in ITS.
SIST-V ETSI/EG 202 798 V1.1.1:2011 is classified under the following ICS (International Classification for Standards) categories: 35.240.60 - IT applications in transport. The ICS classification helps identify the subject area and facilitates finding related standards.
SIST-V ETSI/EG 202 798 V1.1.1:2011 is available in PDF format for immediate download after purchase. The document can be added to your cart and obtained through the secure checkout process. Digital delivery ensures instant access to the complete standard document.
Standards Content (Sample)
Final draft ETSI EG 202 798 V1.1.1 (2010-11)
ETSI Guide
Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing
2 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2010.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 10
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 28
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI
4 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48
ETSI
5 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS), and is
now submitted for the ETSI standards Membership Approval Procedure.
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI
6 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): " Information technology - Open Systems Interconnection -
Conformance testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI
7 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range". .
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI
8 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI
9 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI
10 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoperability testing.
4.2 ITS environment
The ITS architecture is presented in [i.13], [i.22] using different views. Main views presented are the top level
networking view and the ITS station reference architecture view.
ETSI
11 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
The top level networking view [i.13], [i.22] is presented in figure 1. A more implementation-oriented presentation is
given in [i.17]. It is presumed that communication within a single network does not meet all the requirements of all ITS
applications. Instead combinations of networks are envisioned, in which multiple ITS access and networking
technologies are applied.
Figure 1: Top level networking view of ITS
The networks are grouped into
• ITS domain:
- ITS station-internal network;
- ITS station-external network:
� ITS ad-hoc network;
� ITS access network.
• Generic domain:
- all other networks.
ITS are composed of four different ITS sub-systems, i.e. vehicular sub-system (cars, trucks, emergency vehicles, etc.),
road-side sub-systems, central sub-systems and personal (portable) sub-systems as specified in [i.22], [i.13] presented in
figure 2.
ETSI
12 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Figure 2: ITS sub-systems [i.13], [i.22]
Each ITS sub-system contains an ITS station with functionality as specified in the ITS station reference architecture
presented in figure 3.
NOTE: The term "ITS station" (ITS-S) indicates a set of possible functionalities rather than a physical unit.
ITS stations act as peer stations in communication networks applying different access technologies, different
networking & transport protocols, different facility protocols and the related security and management functionalities.
The communication media usually are wireless. The various layers and entities in the ITS station reference architecture
are interconnected via interfaces MI, MN, MF, MA, SI, SN, SF, SA, MS, IN, NF, FA [i.22], [i.13], see figure 3.
Applications
MA FA SA
Facilities
NF
Networking &
Transport
IN
Access
MS
Figure 3: ITS station reference architecture [i.13], [i.22]
ETSI
13 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Accessibility of these interfaces may be dependent on the implementation.
Table 1 presents the layers and entities of the ITS station reference architecture being present in ITS-functional
components.
Table 1: Summary of ITS layers and entities in ITS-S functional components
Main objects ITS-S Layers and entities
(ITS sub-systems) functional
Applications Facilities Networking & Access Management Security
components (FL) Transport (NL) (AL) (ME) (SE)
Vehicle ITS-S host X X X X X X
Roadside
ITS-S router X X X X
Central
ITS-S gateway X X X X X
Personal
ITS-S border X X X X
router
ETSI
14 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
4.3 ITS base standards
Figure 4 shows a snap-shot of base standard development in several standardisation organisations as of April 2010.
Security
ETSI ES 202 910
ETSI TS 102 731 ETSI TS 102 893
ISO IS 16445
Identity
Secure services Thread Vulnerability
Handover
management and
and architecture and Risk Analysis
Architecture
protection
ISO IS 16460
ISO IS11769 IEEE 1609.2
WAVE
ISO IS 13181 ISO IS 11776
Data retention for WAVE Security
Integration Security Lawfull intercept
law enforcement Services
ISO IS 21217
Architecture
ETSI TS 102 890 IEEE 1609.3 IEEE 1609.4
Comms mngmt / WAVE IEEE 802.11 WAVE Multi-
service Networking Amendment p Channel
announcement Services Operation
ETSI EN 302 665
Architecture
ETSI ES 202 663
ETSI TS 102 637 ETSI TS 102 724
ETSI TS 102 636 5,9 GHz ETSI TS 102 687
Basic Set of Channel
GeoNetworking European Power Control
Applications Specification
Profile of 802.11
IEEE 1609.1
WAVE
ETSI TS 102 894
Facility layer
structure
IEEE 1609.0
WAVE ISO IS 21218
Architecture LL SAPs
ETSI EN 302 895
ISO IS 29283
BSA, LDM
IEEE 802.20
specification
ISO IS 29281 ISO IS 25113
ISO IS 29281
IEEE 1609.5 ISO IS 29281 ISO IS 29282 Non-IP WBB
Non-IP
WAVE Legacy Systems Satellites DSRC legacy Existing
networking
systems Systems
ISO IS 24102
ISO IS 25112 ISO IS 25111
FAST service ISO IS 16444 ISO IS 24103
WBB WBB
provision, Geo-routing MAIL
WiMAX General support
Legacy Systems
ISO IS 21215
ISO IS 24101
ISO IS 21210 ISO IS 21216 CALM M5 ISO IS 21214
Application
IP networking CALM MM International CALM IR
management
profile of 802.11
ISO IS 24978 ISO IS 15662 ISO IS 18183
ISO IS 21212 ISO IS 21213
ITS safety and TICS message ISO IS 24103 Public
2G 3G
emergency management MAIL broadcast
EDGE, GPRS UMTS, CDMA2K
notification information reception
Networking &
Applications Facilities Access Technologies
Transport
ISO IS 24102
ETSI TS 102 723 ISO IS 24101 ISO IS 29281
Station and ETSI TS 102 860
Interfaces Application FAST service
communication ITS-AID
(SAPs) management advertisement
management
Management
Figure 4: ITS base standard development
Standards displayed in figure 4, which may be subject for testing according to this ITS testing framework, are e.g.:
Access layer protocols:
• Channel specification [i.20] and power control [i.19] for ITS-G5;
• CALM media IR [i.11] and M5 [i.12];
• CALM medium service access points [i.14].
ETSI
15 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Networking & transport layer protocols:
• Basic transport protocol (for GeoNetworking) [i.17];
• GeoNetworking (media-independent functionality and media-dependent functionality ITS-G5) [i.17];
• IPv6 over GeoNetworking [i.17];
• CALM FAST networking and transport protocol [i.16];
• IPv6 in the context of ITS [i.9];
• CALM Geo-Routing (new work item at ISO TC204 WG16), referring to the basic GeoNetworking protocols
developed at ETSI.
Facilities layer protocols:
• CAM [i.18];
• DENM [i.18];
• CALM legacy system support [i.15], [i.16] e.g. CEN DSRC for electronic fee collection.
Management, security and cross-layer protocols:
• CALM FAST service advertisement [i.15], [i.16];
• "Inter ITS-SCU" management communication [i.15];
• ITS station and communication management [i.15];
• ITS architecture elements [i.13].
ETSI
16 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
4.4 ITS test standards
Examples of test standards for ITS base standards being under development/being finalized at ETSI and ISO are
presented in figure 5.
Figure 5: Activities on testing ITS base standards
Some test work items identified at ETSI at time of writing the present document are [i.23] to [i.34].
5 Introduction to the ITS testing framework EG
The present document provides:
• Guidance to identify the candidate implementations under test (IUT) for conformance testing in clause 6.1 and
the equipment under test (EUTs) for interoperability in clause 7.1, i.e. answering the question "what is to be
tested".
• Guidance to define the applicable test procedures in clauses 6 and 7, i.e. answering the question "how is to be
tested".
• Guidance to develop the resulting test specifications and deliverables (for instance: TSS&TP, TP proforma,
TTCN-3 test suite and documentation) in clause 8.
ETSI
17 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Figure 6 illustrates the ITS testing framework and the interactions with ITS base standards and ITS test specifications.
The ITS testing framework is based on concepts defined in ISO 9646 [i.7], TTCN-3 [i.4] and EG 202 237 [i.5].
Figure 6: ITS testing framework interactions
As far as possible, specific ITS protocol base standards are identified which may be subject to conformance and/or
interoperability testing according to this testing framework. However this ITS testing framework in no way restricts its
applicability to these protocols. This ITS testing framework also in support of any other ITS protocol base standard.
5.1 Conformance testing
Clause 6 provides guidelines for conformance testing, which includes:
• Identification of candidate "Implementations Under Test" (IUT);
• Identification of reference points;
• Identification of the ATM:
- abstract protocol tester;
- functional TTCN-3 test architecture.
5.2 Interoperability testing
Clause 7 provides guidelines for interoperability testing, which includes:
• Identification of candidate EUTs.
• Identification of test scenarios.
• Definition of test bed architecture.
ETSI
18 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
• Identification of test bed interfaces.
5.3 Steps for development of test specifications
Clause 8 provides guidance to write test specifications and to develop TTCN-3 test suites:
• Developing "Implementation Conformance Statements" (ICS) or "Interoperable Functions Statement" (IFS)
from base standards, if not already provided as part of the base standard.
• Developing "Test Suite Structure and Test Purposes" (TSS&TP) from ICS and base standards.
• Developing "Test Descriptions" (TDs) from base standards.
• Developing ITS TTCN-3 test suite, e.g. naming conventions, code documentation, test case structure.
6 Conformance testing
The following clauses are providing conformance testing methodologies to be applied in ITS.
6.1 Candidate IUTs
The "Implementation Under Test" (IUT) is a protocol implementation considered as an object for testing. This means
that the test process will focus on verifying the compliance of this protocol implementation (IUT) with requirements set
up in the related base standard. An IUT normally is implemented in a "System Under Test" (SUT). For testing, an SUT
is connected to a test system over at least a single interface specified in the related ITS base standard. Such an interface
is identified as "Reference Point" (RP) in the present document.
NOTE: Other interfaces between the test system and the IUT may be used to control the behaviour of the IUT
during the test process.
Further details on RPs are presented in clause 6.2.
IUTs normally are protocols located in a layer or an entity of the ITS station reference architecture presented in figure 3.
Examples of IUTs and their location in the ITS station reference architecture are illustrated in figure 7. Further details
are presented in tables 2 and 3.
ETSI
19 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
/
/
s
r
P
e
A g
a
S
n
o
a
t
m
s
s t
e s
c a
c c
a p
u
e
t o
r
o
g
m
S
e
T
R I
/
/
t
.
n
.
n
o .
i
e
t
a
m
c
e
i
c
n
n
u
u
m
o
n
m
o n
c a
e
U
c
i
C
v
r
S
-
e
S s
T
I T
-
r S
e
A
t
F
n
I
Figure 7: Examples of IUTs in the ITS station reference architecture
Table 2 exemplifies candidates for IUTs for RP-External identified in clause 6.2.
Table 2: Candidates for IUTs for RP-External
Layer/entity IUT (protocols) ITS specific Notes
Apps ITS-S application messages YES Not considered for conformance testing.
To be used for interoperability testing.
FL CAM [i.18] YES
DENM [i.18] YES
Legacy CI port manager [i.16] YES
15628 kernel emulator [i.16] YES
NL Basic transport protocol for GeoNetworking [i.17] YES
FAST networking and transport protocol [i.16] YES
GeoNetworking [i.17] YES
IPv6 for ITS [i.9] YES No test of IPv6 functionality from IETF,
but only tests on how to use this
functionality in the context of ITS.
IPv6 over GeoNetworking [i.17] YES
ITS-MUX [i.16] YES
Legacy protocols such as TCP, UDP NO
AL CAL extension for legacy systems [i.16] YES
CALM IR [i.11] YES
CALM M5 (ITS-G5) [i.12] YES The basic MAC and PHY is
standardized in IEEE 802.11 [i.38] and
thus not subject of tests within this ITS
framework.
CALM medium service access points/support of YES
legacy technologies [i.14]
Legacy technologies NO Covered by other testing frameworks.
ME FAST service advertisement [i.15] YES
Legacy system support [i.15] YES
SE To be defined YES Base standards are under
development.
Table 3 exemplifies candidates for IUTs for the RP-Internal-ITS-S identified in clause 6.2.
ETSI
20 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
Table 3: Candidates for IUTs for RP-Internal-ITS-S
Layer/entity Protocols ITS specific Notes
ME Inter-ITS-SCU PDUs (allows for e.g. YES
remote access to SAPs) [i.15]
LAN technology protocols, wired or NO Does not require specific testing for ITS.
wireless, e.g. TCP/IP, Ethernet,
Bluetooth
NL Local forwarding of FAST packets [i.16] Yes
Tables 2 and 3 need to be amended in the following cases:
• A new protocol is identified as a new potential IUT and interacts in one of the RPs.
• A new ITS-S functional component or ITS sub-system is defined. This should be included as a SUT as long as
it interacts in one of the RPs.
• If a new RP is identified, the same analysis is done for incorporating the corresponding SUT and IUT.
6.2 Reference points
This clause illustrates candidate reference points (RPs) where test systems can be connected in order to test
conformance of ITS protocols (IUTs) with ITS base standards.
RPs listed in tables 4 and 5 are classified in two groups:
• External networking RPs (RP-External) are based on the ITS sub-systems presented in figure 2 and the
related external networks presented in figure 1.
Table 4: External networking reference points RP-External
RP Identifier RP Name ITS sub-system ITS sub-system Network
RP-ITS-Ext-1 R Vehicle Vehicle ITS ad-hoc
A
RP-ITS-Ext-2 R Vehicle Roadside ITS ad-hoc
B
RP-ITS-Ext-3
R Personal Personal ITS ad-hoc
C
RP-ITS-Ext-4 R Roadside Personal ITS ad-hoc
D
RP-ITS-Ext-5 R
Vehicle Personal ITS ad-hoc
E
RP-ITS-Ext-6 R Roadside Roadside ITS ad-hoc
F
RP-ITS-Ext-7 R Vehicle Roadside ITS ad-hoc
I
RP-ITS-Ext-8 R Roadside Personal ITS ad-hoc
J
RP-ITS-Ext-9 R Vehicle Roadside Public
K
RP-ITS-Ext-10 R
Vehicle Central Public
L
RP-ITS-Ext-11 R Roadside Personal Public
M
RP-ITS-Ext-12 R Personal Central Public
N
RP-ITS-Ext-13 R Vehicle Personal Public
O
RP-ITS-Ext-14 R Roadside Central Public
P
RP-ITS-Ext-15 R Roadside Central Private
S
RP-ITS-Ext-16 R Central Central Public/Private
Z
ETSI
21 Final draft ETSI EG 202 798 V1.1.1 (2010-11)
• Internal network RPs (RP-Internal-ITS-S) are based on the ITS-S functional components listed in clause 4.2
and taking into account the interaction via the ITS station internal network presented in figures 1 and 2
between the functional components inside the same sub-system.
Table 5: Internal networking reference points RP-Internal-ITS-S
ITS sub-system RP Name ITS-S functional ITS-S functional ID
component component
Vehicle R ITS-S host ITS-S host RP-ITS-Int-1
V1
R RP-ITS-Int-2
ITS-S host ITS-S router
V2
R ITS-S host ITS-S gateway RP-ITS-Int-3
V3
R ITS-S host ITS-S border router RP-ITS-Int-4
V4
R ITS-S router ITS-S router RP-ITS-Int-5
V5
R ITS-S router ITS-S gateway RP-ITS-Int-6
V6
R ITS-S router ITS-S border router RP-ITS-Int-7
V7
R ITS-S gateway ITS-S gateway RP-ITS-Int-8
V8
RP-ITS-Int-9
R ITS-S gateway ITS-S border router
V9
Roadside R ITS-S host ITS-S host RP-ITS-Int-10
R1
R ITS-S host ITS-S router RP-ITS-Int-11
R2
R ITS-S host ITS-S gateway RP-ITS-Int-12
R3
R ITS-S host ITS-S border router RP-ITS-Int-13
R4
RP-ITS-Int-14
R ITS-S router ITS-S router
R5
R ITS-S router ITS-S gateway RP-ITS-Int-15
R6
R RP-ITS-Int-16
ITS-S router ITS-S border router
R7
R ITS-S gateway ITS-S gateway RP-ITS-Int-17
R8
R ITS-S gateway ITS-S border route
...
ETSI EG 202 798 V1.1.1 (2011-01)
ETSI Guide
Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing
2 ETSI EG 202 798 V1.1.1 (2011-01)
Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
3 ETSI EG 202 798 V1.1.1 (2011-01)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 11
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 29
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI
4 ETSI EG 202 798 V1.1.1 (2011-01)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48
ETSI
5 ETSI EG 202 798 V1.1.1 (2011-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS).
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI
6 ETSI EG 202 798 V1.1.1 (2011-01)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): "Information technology - Open Systems Interconnection - Conformance
testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI
7 ETSI EG 202 798 V1.1.1 (2011-01)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range".
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI
8 ETSI EG 202 798 V1.1.1 (2011-01)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI
9 ETSI EG 202 798 V1.1.1 (2011-01)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI
10 ETSI EG 202 798 V1.1.1 (2011-01)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoperability testing.
ETSI
11 ETSI EG 202 798 V1.1.1 (2011-01)
4.2 ITS environment
The ITS architecture is presented in [i.13], [i.22] using different views. Main views presented are the top level
networking view and the ITS station reference architecture view.
The top level networking view [i.13], [i.22] is presented in figure 1. A more implementation-oriented presentation is
given in [i.17]. It is presumed that communication within a single network does not meet all the requirements of all ITS
applications. Instead combinations of networks are envisioned, in which multiple ITS access and networking
technologies are applied.
Figure 1: Top level networking view of ITS
The networks are grouped into
• ITS domain:
- ITS station-internal network;
- ITS station-external network:
� ITS ad-hoc network;
� ITS access network.
• Generic domain:
- all other networks.
ITS are composed of four different ITS sub-systems, i.e. vehicular sub-system (cars, trucks, emergency vehicles, etc.),
road-side sub-systems, central sub-systems and personal (portable) sub-systems as specified in [i.22], [i.13] presented in
figure 2.
ETSI
12 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 2: ITS sub-systems [i.13], [i.22]
Each ITS sub-system contains an ITS station with functionality as specified in the ITS station reference architecture
presented in figure 3.
NOTE: The term "ITS station" (ITS-S) indicates a set of possible functionalities rather than a physical unit.
ITS stations act as peer stations in communication networks applying different access technologies, different
networking & transport protocols, different facility protocols and the related security and management functionalities.
The communication media usually are wireless. The various layers and entities in the ITS station reference architecture
are interconnected via interfaces MI, MN, MF, MA, SI, SN, SF, SA, MS, IN, NF, FA [i.22], [i.13], see figure 3.
Applications
MA FA SA
Facilities
NF
Networking &
Transport
IN
Access
MS
Figure 3: ITS station reference architecture [i.13], [i.22]
ETSI
13 ETSI EG 202 798 V1.1.1 (2011-01)
Accessibility of these interfaces may be dependent on the implementation.
Table 1 presents the layers and entities of the ITS station reference architecture being present in ITS-functional
components.
Table 1: Summary of ITS layers and entities in ITS-S functional components
Main objects ITS-S Layers and entities
(ITS sub-systems) functional
Applications Facilities Networking & Access Management Security
components (FL) Transport (NL) (AL) (ME) (SE)
Vehicle ITS-S host X X X X X X
Roadside
ITS-S router X X X X
Central
ITS-S gateway X X X X X
Personal
ITS-S border X X X X
router
ETSI
14 ETSI EG 202 798 V1.1.1 (2011-01)
4.3 ITS base standards
Figure 4 shows a snap-shot of base standard development in several standardisation organisations as of April 2010.
Security
ETSI ES 202 910
ETSI TS 102 731 ETSI TS 102 893
ISO IS 16445
Identity
Secure services Thread Vulnerability
Handover
management and
and architecture and Risk Analysis
Architecture
protection
ISO IS 16460
ISO IS11769 IEEE 1609.2
WAVE
ISO IS 13181 ISO IS 11776
Data retention for WAVE Security
Integration Security Lawfull intercept
law enforcement Services
ISO IS 21217
Architecture
ETSI TS 102 890 IEEE 1609.3 IEEE 1609.4
Comms mngmt / WAVE IEEE 802.11 WAVE Multi-
service Networking Amendment p Channel
announcement Services Operation
ETSI EN 302 665
Architecture
ETSI ES 202 663
ETSI TS 102 637 ETSI TS 102 724
ETSI TS 102 636 5,9 GHz ETSI TS 102 687
Basic Set of Channel
GeoNetworking European Power Control
Applications Specification
Profile of 802.11
IEEE 1609.1
WAVE
ETSI TS 102 894
Facility layer
structure
IEEE 1609.0
WAVE ISO IS 21218
Architecture LL SAPs
ETSI EN 302 895
ISO IS 29283
BSA, LDM
IEEE 802.20
specification
ISO IS 29281 ISO IS 25113
ISO IS 29281
IEEE 1609.5 ISO IS 29281 ISO IS 29282 Non-IP WBB
Non-IP
WAVE Legacy Systems Satellites DSRC legacy Existing
networking
systems Systems
ISO IS 24102
ISO IS 25112 ISO IS 25111
FAST service ISO IS 16444 ISO IS 24103
WBB WBB
provision, Geo-routing MAIL
WiMAX General support
Legacy Systems
ISO IS 21215
ISO IS 24101
ISO IS 21210 ISO IS 21216 CALM M5 ISO IS 21214
Application
IP networking CALM MM International CALM IR
management
profile of 802.11
ISO IS 24978 ISO IS 15662 ISO IS 18183
ISO IS 21212 ISO IS 21213
ITS safety and TICS message ISO IS 24103 Public
2G 3G
emergency management MAIL broadcast
EDGE, GPRS UMTS, CDMA2K
notification information reception
Networking &
Applications Facilities Access Technologies
Transport
ISO IS 24102
ETSI TS 102 723 ISO IS 24101 ISO IS 29281
Station and ETSI TS 102 860
Interfaces Application FAST service
communication ITS-AID
(SAPs) management advertisement
management
Management
Figure 4: ITS base standard development
Standards displayed in figure 4, which may be subject for testing according to this ITS testing framework, are e.g.:
Access layer protocols:
• Channel specification [i.20] and power control [i.19] for ITS-G5;
• CALM media IR [i.11] and M5 [i.12];
• CALM medium service access points [i.14].
ETSI
15 ETSI EG 202 798 V1.1.1 (2011-01)
Networking & transport layer protocols:
• Basic transport protocol (for GeoNetworking) [i.17];
• GeoNetworking (media-independent functionality and media-dependent functionality ITS-G5) [i.17];
• IPv6 over GeoNetworking [i.17];
• CALM FAST networking and transport protocol [i.16];
• IPv6 in the context of ITS [i.9];
• CALM Geo-Routing (new work item at ISO TC204 WG16), referring to the basic GeoNetworking protocols
developed at ETSI.
Facilities layer protocols:
• CAM [i.18];
• DENM [i.18];
• CALM legacy system support [i.15], [i.16] e.g. CEN DSRC for electronic fee collection.
Management, security and cross-layer protocols:
• CALM FAST service advertisement [i.15], [i.16];
• "Inter ITS-SCU" management communication [i.15];
• ITS station and communication management [i.15];
• ITS architecture elements [i.13].
ETSI
16 ETSI EG 202 798 V1.1.1 (2011-01)
4.4 ITS test standards
Examples of test standards for ITS base standards being under development/being finalized at ETSI and ISO are
presented in figure 5.
Figure 5: Activities on testing ITS base standards
Some test work items identified at ETSI at time of writing the present document are [i.23] to [i.34].
5 Introduction to the ITS testing framework EG
The present document provides:
• Guidance to identify the candidate implementations under test (IUT) for conformance testing in clause 6.1 and
the equipment under test (EUTs) for interoperability in clause 7.1, i.e. answering the question "what is to be
tested".
• Guidance to define the applicable test procedures in clauses 6 and 7, i.e. answering the question "how is to be
tested".
• Guidance to develop the resulting test specifications and deliverables (for instance: TSS&TP, TP proforma,
TTCN-3 test suite and documentation) in clause 8.
ETSI
17 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 6 illustrates the ITS testing framework and the interactions with ITS base standards and ITS test specifications.
The ITS testing framework is based on concepts defined in ISO 9646 [i.7], TTCN-3 [i.4] and EG 202 237 [i.5].
Figure 6: ITS testing framework interactions
As far as possible, specific ITS protocol base standards are identified which may be subject to conformance and/or
interoperability testing according to this testing framework. However this ITS testing framework in no way restricts its
applicability to these protocols. This ITS testing framework also in support of any other ITS protocol base standard.
5.1 Conformance testing
Clause 6 provides guidelines for conformance testing, which includes:
• Identification of candidate "Implementations Under Test" (IUT);
• Identification of reference points;
• Identification of the ATM:
- abstract protocol tester;
- functional TTCN-3 test architecture.
5.2 Interoperability testing
Clause 7 provides guidelines for interoperability testing, which includes:
• Identification of candidate EUTs.
• Identification of test scenarios.
• Definition of test bed architecture.
ETSI
18 ETSI EG 202 798 V1.1.1 (2011-01)
• Identification of test bed interfaces.
5.3 Steps for development of test specifications
Clause 8 provides guidance to write test specifications and to develop TTCN-3 test suites:
• Developing "Implementation Conformance Statements" (ICS) or "Interoperable Functions Statement" (IFS)
from base standards, if not already provided as part of the base standard.
• Developing "Test Suite Structure and Test Purposes" (TSS&TP) from ICS and base standards.
• Developing "Test Descriptions" (TDs) from base standards.
• Developing ITS TTCN-3 test suite, e.g. naming conventions, code documentation, test case structure.
6 Conformance testing
The following clauses are providing conformance testing methodologies to be applied in ITS.
6.1 Candidate IUTs
The "Implementation Under Test" (IUT) is a protocol implementation considered as an object for testing. This means
that the test process will focus on verifying the compliance of this protocol implementation (IUT) with requirements set
up in the related base standard. An IUT normally is implemented in a "System Under Test" (SUT). For testing, an SUT
is connected to a test system over at least a single interface specified in the related ITS base standard. Such an interface
is identified as "Reference Point" (RP) in the present document.
NOTE: Other interfaces between the test system and the IUT may be used to control the behaviour of the IUT
during the test process.
Further details on RPs are presented in clause 6.2.
IUTs normally are protocols located in a layer or an entity of the ITS station reference architecture presented in figure 3.
Examples of IUTs and their location in the ITS station reference architecture are illustrated in figure 7. Further details
are presented in tables 2 and 3.
ETSI
19 ETSI EG 202 798 V1.1.1 (2011-01)
/
/
s
r
P
e
A g
a
S
n
o
a
t
m
s
s t
e s
c a
c c
a p
u
e
t o
r
o
g
m
S
e
T
R I
/
/
t
.
n
.
n
o .
i
e
t
a
m
c
e
i
c
n
n
u
u
m
o
n
m
o n
c a
e
U
c
i
C
v
r
S
-
e
S s
T
I T
-
r S
e
A
t
F
n
I
Figure 7: Examples of IUTs in the ITS station reference architecture
Table 2 exemplifies candidates for IUTs for RP-External identified in clause 6.2.
Table 2: Candidates for IUTs for RP-External
Layer/entity IUT (protocols) ITS specific Notes
Apps ITS-S application messages YES Not considered for conformance testing.
To be used for interoperability testing.
FL CAM [i.18] YES
DENM [i.18] YES
Legacy CI port manager [i.16] YES
15628 kernel emulator [i.16] YES
NL Basic transport protocol for GeoNetworking [i.17] YES
FAST networking and transport protocol [i.16] YES
GeoNetworking [i.17] YES
IPv6 for ITS [i.9] YES No test of IPv6 functionality from IETF,
but only tests on how to use this
functionality in the context of ITS.
IPv6 over GeoNetworking [i.17] YES
ITS-MUX [i.16] YES
Legacy protocols such as TCP, UDP NO
AL CAL extension for legacy systems [i.16] YES
CALM IR [i.11] YES
CALM M5 (ITS-G5) [i.12] YES The basic MAC and PHY is
standardized in IEEE 802.11 [i.38] and
thus not subject of tests within this ITS
framework.
CALM medium service access points/support of YES
legacy technologies [i.14]
Legacy technologies NO Covered by other testing frameworks.
ME FAST service advertisement [i.15] YES
Legacy system support [i.15] YES
SE To be defined YES Base standards are under
development.
ETSI
20 ETSI EG 202 798 V1.1.1 (2011-01)
Table 3 exemplifies candidates for IUTs for the RP-Internal-ITS-S identified in clause 6.2.
Table 3: Candidates for IUTs for RP-Internal-ITS-S
Layer/entity Protocols ITS specific Notes
ME Inter-ITS-SCU PDUs (allows for e.g. YES
remote access to SAPs) [i.15]
LAN technology protocols, wired or NO Does not require specific testing for ITS.
wireless, e.g. TCP/IP, Ethernet,
Bluetooth
NL Local forwarding of FAST packets [i.16] Yes
Tables 2 and 3 need to be amended in the following cases:
• A new protocol is identified as a new potential IUT and interacts in one of the RPs.
• A new ITS-S functional component or ITS sub-system is defined. This should be included as a SUT as long as
it interacts in one of the RPs.
• If a new RP is identified, the same analysis is done for incorporating the corresponding SUT and IUT.
6.2 Reference points
This clause illustrates candidate reference points (RPs) where test systems can be connected in order to test
conformance of ITS protocols (IUTs) with ITS base standards.
RPs listed in tables 4 and 5 are classified in two groups:
• External networking RPs (RP-External) are based on the ITS sub-systems presented in figure 2 and the
related external networks presented in figure 1.
Table 4: External networking reference points RP-External
RP Identifier RP Name ITS sub-system ITS sub-system Network
RP-ITS-Ext-1 R Vehicle Vehicle ITS ad-hoc
A
RP-ITS-Ext-2
R Vehicle Roadside ITS ad-hoc
B
RP-ITS-Ext-3 R Personal Personal ITS ad-hoc
C
RP-ITS-Ext-4 R
Roadside Personal ITS ad-hoc
D
RP-ITS-Ext-5 R Vehicle Personal ITS ad-hoc
E
RP-ITS-Ext-6 R Roadside Roadside ITS ad-hoc
F
RP-ITS-Ext-7 R Vehicle Roadside ITS ad-hoc
I
RP-ITS-Ext-8 R Roadside Personal ITS ad-hoc
J
RP-ITS-Ext-9
R Vehicle Roadside Public
K
RP-ITS-Ext-10 R Vehicle Central Public
L
RP-ITS-Ext-11 R
Roadside Personal Public
M
RP-ITS-Ext-12 R Personal Central Public
N
RP-ITS-Ext-13 R Vehicle Personal Public
O
RP-ITS-Ext-14 R Roadside Central Public
P
RP-ITS-Ext-15 R Roadside Central Private
S
RP-ITS-Ext-16
R Central Central Public/Private
Z
ETSI
21 ETSI EG 202 798 V1.1.1 (2011-01)
• Internal network RPs (RP-Internal-ITS-S) are based on the ITS-S functional components listed in clause 4.2
and taking into account the interaction via the ITS station internal network presented in figures 1 and 2
between the functional components inside the same sub-system.
Table 5: Internal networking reference points RP-Internal-ITS-S
ITS sub-system RP Name ITS-S functional ITS-S functional ID
component component
Vehicle R ITS-S host ITS-S host RP-ITS-Int-1
V1
R RP-ITS-Int-2
ITS-S host ITS-S router
V2
R ITS-S host ITS-S gateway RP-ITS-Int-3
V3
R ITS-S host ITS-S border router RP-ITS-Int-4
V4
R ITS-S router ITS-S router RP-ITS-Int-5
V5
R ITS-S router ITS-S gateway RP-ITS-Int-6
V6
R ITS-S router ITS-S border router RP-ITS-Int-7
V7
R ITS-S gateway ITS-S gateway RP-ITS-Int-8
V8
RP-ITS-Int-9
R ITS-S gateway ITS-S border router
V9
Roadside R ITS-S host ITS-S host RP-ITS-Int-10
R1
R ITS-S host ITS-S router RP-ITS-Int-11
R2
R ITS-S host ITS-S gateway RP-ITS-Int-12
R3
R ITS-S host ITS-S border router RP-ITS-Int-13
R4
RP-ITS-Int-14
R ITS-S router ITS-S router
R5
R ITS-S router ITS-S gateway RP-ITS-Int-15
R6
R RP-ITS-Int-16
ITS-S router ITS-S border router
R7
R ITS-S gateway ITS-S gateway RP-ITS-Int-17
R8
R ITS-S gateway ITS-S border router RP-ITS-Int-18
R9
Central R ITS-S host ITS-S host RP-ITS-Int-19
C1
R ITS-S host ITS-S router RP-ITS-Int-20
C2
RP-ITS-Int-21
R ITS-S host ITS-S gateway
C3
R ITS-S host ITS-S border router RP-ITS-Int-22
C4
R RP-ITS-Int-23
ITS-S router ITS-S router
C5
R ITS-S router ITS-S gateway RP-ITS-Int-24
C6
R ITS-S router ITS-S b
...
SLOVENSKI STANDARD
01-junij-2011
Inteligentni transportni sistemi (ITS) - Preskušanje - Okvir za skladnost in
preskušanje medobratovalnosti
Intelligent Transport Systems (ITS) - Testing - Framework for conformance and
interoperability testing
Ta slovenski standard je istoveten z: EG 202 798 Version 1.1.1
ICS:
35.240.60 Uporabniške rešitve IT v IT applications in transport
transportu in trgovini and trade
2003-01.Slovenski inštitut za standardizacijo. Razmnoževanje celote ali delov tega standarda ni dovoljeno.
SIST EG 202 798 V1.1.1:2011
SIST EG 202 798 V1.1.1:2011
ETSI EG 202 798 V1.1.1 (2011-01)
ETSI Guide
Intelligent Transport Systems (ITS);
Testing;
Framework for conformance and interoperability testing
SIST EG 202 798 V1.1.1:2011
2 ETSI EG 202 798 V1.1.1 (2011-01)
Reference
DEG/ITS-0020022
Keywords
ITS, testing, conformance, interoperability
ETSI
650 Route des Lucioles
F-06921 Sophia Antipolis Cedex - FRANCE
Tel.: +33 4 92 94 42 00 Fax: +33 4 93 65 47 16
Siret N° 348 623 562 00017 - NAF 742 C
Association à but non lucratif enregistrée à la
Sous-Préfecture de Grasse (06) N° 7803/88
Important notice
Individual copies of the present document can be downloaded from:
http://www.etsi.org
The present document may be made available in more than one electronic version or in print. In any case of existing or
perceived difference in contents between such versions, the reference version is the Portable Document Format (PDF).
In case of dispute, the reference shall be the printing on ETSI printers of the PDF version kept on a specific network drive
within ETSI Secretariat.
Users of the present document should be aware that the document may be subject to revision or change of status.
Information on the current status of this and other ETSI documents is available at
http://portal.etsi.org/tb/status/status.asp
If you find errors in the present document, please send your comment to one of the following services:
http://portal.etsi.org/chaircor/ETSI_support.asp
Copyright Notification
No part may be reproduced except as authorized by written permission.
The copyright and the foregoing restriction extend to reproduction in all media.
© European Telecommunications Standards Institute 2011.
All rights reserved.
TM TM TM TM
DECT , PLUGTESTS , UMTS , TIPHON , the TIPHON logo and the ETSI logo are Trade Marks of ETSI registered
for the benefit of its Members.
TM
3GPP is a Trade Mark of ETSI registered for the benefit of its Members and of the 3GPP Organizational Partners.
LTE™ is a Trade Mark of ETSI currently being registered
for the benefit of its Members and of the 3GPP Organizational Partners.
GSM® and the GSM logo are Trade Marks registered and owned by the GSM Association.
ETSI
SIST EG 202 798 V1.1.1:2011
3 ETSI EG 202 798 V1.1.1 (2011-01)
Contents
Intellectual Property Rights . 5
Foreword . 5
Introduction . 5
1 Scope . 6
2 References . 6
2.1 Normative references . 6
2.2 Informative references . 6
3 Definitions and abbreviations . 10
3.1 Definitions . 10
3.2 Abbreviations . 10
4 ITS foundations . 10
4.1 Motivation for and structure of the document . 10
4.2 ITS environment . 11
4.3 ITS base standards . 14
4.4 ITS test standards . 16
5 Introduction to the ITS testing framework EG . 16
5.1 Conformance testing. 17
5.2 Interoperability testing . 17
5.3 Steps for development of test specifications . 18
6 Conformance testing. 18
6.1 Candidate IUTs . 18
6.2 Reference points . 20
6.3 Identification of abstract test method . 22
6.3.1 Abstract protocol tester . 22
6.3.2 Functional TTCN-3 test architecture . 24
7 Interoperability testing . 25
7.1 Candidate EUTs . 25
7.2 Test scenarios . 25
7.3 Test bed architecture . 25
7.4 Test bed interfaces . 28
8 Development of test specifications and test suites . 29
8.1 Provision of ICS pro-forma . 29
8.2 Provision of TSS&TPs . 29
8.2.1 Test suite structure (TSS) . 29
8.2.2 TP pro-forma . 30
8.2.3 TP identifier . 31
8.2.4 Test objective . 32
8.2.5 Reference . 32
8.2.6 PICS selection . 33
8.2.7 TP behaviour . 33
8.3 Development of TTCN-3 test suite . 35
8.3.1 Global TTCN-3 test architecture . 35
8.3.2 Importing ASN.1 definition . 37
8.3.3 The TTCN-3 naming conventions . 38
8.3.4 TTCN-3 code documentation . 40
8.3.5 Test cases structure . 40
8.4 Provision of IFS pro-forma . 41
8.5 Provision of Test Descriptions . 41
Annex A: Introduction to Interoperability testing . 44
ETSI
SIST EG 202 798 V1.1.1:2011
4 ETSI EG 202 798 V1.1.1 (2011-01)
A.1 Principles . 44
A.2 Interoperability testing process . 44
A.3 Interoperability testing with conformance checks . 45
A.4 Automated interoperability testing . 45
History . 48
ETSI
SIST EG 202 798 V1.1.1:2011
5 ETSI EG 202 798 V1.1.1 (2011-01)
Intellectual Property Rights
IPRs essential or potentially essential to the present document may have been declared to ETSI. The information
pertaining to these essential IPRs, if any, is publicly available for ETSI members and non-members, and can be found
in ETSI SR 000 314: "Intellectual Property Rights (IPRs); Essential, or potentially Essential, IPRs notified to ETSI in
respect of ETSI standards", which is available from the ETSI Secretariat. Latest updates are available on the ETSI Web
server (http://webapp.etsi.org/IPR/home.asp).
Pursuant to the ETSI IPR Policy, no investigation, including IPR searches, has been carried out by ETSI. No guarantee
can be given as to the existence of other IPRs not referenced in ETSI SR 000 314 (or the updates on the ETSI Web
server) which are, or may be, or may become, essential to the present document.
Foreword
This ETSI Guide (EG) has been produced by ETSI Technical Committee Intelligent Transport System (ITS).
The present document assumes that the reader has basic knowledge in testing as presented e.g. in [i.4], [i.7].
Introduction
"Intelligent Transport Systems" (ITS) are systems to support transportation of goods and humans with information and
communication technologies in order to efficiently and safely use the transport infrastructure and transport means (cars,
trains, planes, ships). With a focus on road transportation, elements of ITS for global applications are standardized in
various standardisation organisations, both on an international level at e.g. ISO TC204, and on regional levels, e.g. in
Europe at ETSI TC ITS and at CEN TC278 [i.13], [i.22].
The importance of ITS for the regional and the international market is expressed by the large number of activities of
stake-holders, within regional research projects, industry initiatives and regional and international standardisation.
In Europe, the urgent need for ITS standards and the related test standards is expressed by the new mandate M/453 of
the Commission of the European Union [i.36].
Mandate M/453 [i.36] also is given in the context of international harmonisation, as expressed by the EU-US joint
declaration of intent on research cooperation in cooperative systems [i.35].
ETSI is prepared to take over a leading role in this process towards harmonized ITS. A major effort is on conformance
and interoperability testing, which is being prepared by the present document on "ITS testing framework". The protocol
conformance and interoperability testing framework is essential for a systematic and consistent approach towards
testing of globally applicable ITS communications equipment.
ETSI
SIST EG 202 798 V1.1.1:2011
6 ETSI EG 202 798 V1.1.1 (2011-01)
1 Scope
The scope of the present document is to support ITS projects on the development of test specifications for ITS base
standards from ETSI, ISO, CEN and other "Standard Developing Organisations" (SDOs) by providing:
• An ITS testing framework for conformance testing.
• An ITS testing framework for interoperability testing.
The testing framework proposed in the present document provides guidance for development of conformance and
interoperability test strategies, test systems and the resulting test specifications for ITS.
2 References
References are either specific (identified by date of publication and/or edition number or version number) or
non-specific. For specific references, only the cited version applies. For non-specific references, the latest version of the
reference document (including any amendments) applies.
Referenced documents which are not found to be publicly available in the expected location might be found at
http://docbox.etsi.org/Reference.
NOTE: While any hyperlinks included in this clause were valid at the time of publication ETSI cannot guarantee
their long term validity.
2.1 Normative references
The following referenced documents are necessary for the application of the present document.
Not applicable.
2.2 Informative references
The following referenced documents are not necessary for the application of the present document but they assist the
user with regard to a particular subject area.
[i.1] ETSI ETR 266: "Methods for Testing and Specification (MTS); Test Purpose style guide".
[i.2] ETSI ETS 300 406: "Methods for Testing and Specification (MTS); Protocol and profile
conformance testing specifications; Standardization methodology".
[i.3] ETSI EG 201 058: "Methods for Testing and Specification (MTS); Implementation Conformance
Statement (ICS) proforma style guide".
[i.4] ETSI ES 201 873 (all parts): "Methods for Testing and Specification (MTS); The Testing and Test
Control Notation version 3".
[i.5] ETSI EG 202 237: "Methods for Testing and Specification (MTS); Internet Protocol Testing
(IPT); Generic approach to interoperability testing".
[i.6] ETSI EG 202 810: "Methods for Testing and Specification (MTS); Automated Interoperability
Testing; Methodology and Framework".
[i.7] ISO/IEC 9646 (all parts): "Information technology - Open Systems Interconnection - Conformance
testing methodology and framework".
[i.8] ISO 10746 (all parts): "Information technology - Open Distributed Processing - Reference model".
[i.9] ISO 21210: "Intelligent transport systems - Communications Access for land Mobiles (CALM) -
Non-IP networking".
ETSI
SIST EG 202 798 V1.1.1:2011
7 ETSI EG 202 798 V1.1.1 (2011-01)
[i.10] ISO 21213: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
3 G".
[i.11] ISO 21214: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
IR".
[i.12] ISO 21215: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
M5".
[i.13] ISO 21217: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Architecture".
[i.14] ISO 21218: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Medium Service Access Points".
[i.15] ISO 24102: "Intelligent Transport Systems - Communications Access for Land Mobiles (CALM) -
ITS station management".
[i.16] ISO 29281: "Intelligent transport systems - Communications Access for Land Mobiles (CALM) -
Non-IP networking".
[i.17] ETSI TS 102 636: "Intelligent Transportation System (ITS); Vehicular communications;
GeoNetworking".
[i.18] ETSI TS 102 637 (all parts): "Intelligent Transport Systems (ITS); Vehicular Communications;
Basic Set of Applications; multiple parts".
[i.19] ETSI TS 102 687: "Intelligent Transport Systems (ITS); Transmitter Power Control Mechanism
for Intelligent Transport Systems operating in the 5 GHz range".
[i.20] ETSI TS 102 724: "Intelligent Transport Systems (ITS); Harmonized Channel Specifications for
Intelligent Transport Systems operating in the 5 GHz frequency band".
[i.21] ETSI TS 102 860: "Intelligent Transport Systems (ITS); Classification and management of
applications".
[i.22] ETSI EN 302 665: "Intelligent Transport Systems (ITS); Communications Architecture".
[i.23] ETSI TS 102 760-2: "Intelligent Transport Systems (ITS); Test specifications for Intelligent
Transport Systems; Communications Access for Land Mobiles (CALM); Medium Service Access
Points (ISO 21218); Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.24] ETSI TS 102 797-2: "Intelligent Transport Systems (ITS); Road Transport and Traffic Telematics
(RTTT); Test specifications for Intelligent Transport Systems, Communications Access for Land
Mobiles (CALM), Interface Manager (ISO 24102); Part 2: Test Suite Structure and Test Purposes
(TSS & TP)".
[i.25] ETSI TS 102 859-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for Transmission of IP packets over GeoNetworking; Part 2: Test Suite Structure
and Test Purposes (TSS&TP)".
[i.26] ETSI TS 102 868-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Co-operative Awareness Messages (CAM); Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
[i.27] ETSI TS 102 869-2: "Intelligent Transport System (ITS); Testing; Conformance test specification
for Decentralized environmental Notification Messages (DNM); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.28] ETSI TS 102 870-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking Basic Transport Protocol (BTP); Part 2: Test Suite Structure and
Test Purposes (TSS&TP)".
[i.29] ETSI TS 102 871-2: "Intelligent Transport Systems (ITS); Testing; Conformance test
specifications for GeoNetworking ITS-G5; Part 2: Test Suite Structure and Test Purposes
(TSS&TP)".
ETSI
SIST EG 202 798 V1.1.1:2011
8 ETSI EG 202 798 V1.1.1 (2011-01)
[i.30] ETSI TS 102 981-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IP networking (ISO 21210); Part 2:
Test Suite Structure and Test Purposes (TSS&TP)".
[i.31] ETSI TS 102 982-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); IR (ISO 21214); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.32] ETSI TS 102 983-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); M5 (ISO 21215); Part 2: Test Suite
Structure and Test Purposes (TSS&TP)".
[i.33] ETSI TS 102 984-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Architecture (ISO 21217);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.34] ETSI TS 102 985-2: "Intelligent Transport Systems; Test specifications for Intelligent Transport
Systems; Communications Access for Land Mobiles (CALM); Non-IP networking (ISO 29281);
Part 2: Test Suite Structure and Test Purposes (TSS&TP)".
[i.35] EU-US Joint Declaration of Intent on Research Cooperation in Cooperative Systems, Washington,
D.C., EC/DGINFSO and USDOT/RITA, November 2009.
NOTE: Available at:
http://ec.europa.eu/information_society/activities/esafety/doc/library/us/joint_decl_on_coop_systems.pdf.
[i.36] Standardisation mandate addressed to CEN, CENELEC and ETSI in the field of information and
communication technologies to support the interoperability of co-operative systems for intelligent
transport in the european community, M/453, October 2009.
NOTE: Available at: http://ec.europa.eu/enterprise/sectors/ict/files/standardisation_mandate_en.pdf.
[i.37] ISO 16445: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Handover mechanisms".
[i.38] IEEE 802.11: "Telecommunications and information exchange between systems - Local and
metropolitan area networks-Specific requirements - Part 11: Wireless LAN Medium Access
Control (MAC) and Physical Layer (PHY) Specifications".
[i.39] ISO 16444: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
Geo-routing".
[i.40] ISO 16440: "Intelligent Transport Systems - Communications access for land mobiles (CALM) -
WAVE".
[i.41] ISO 16460: "Wave Intergration".
[i.42] ISO IS 24978: "Intelligent transport systems - ITS Safety and emergency messages using any
available wireless media - Data registry procedures".
[i.43] ISO IS 15662: "Intelligent transport systems - Wide area communication - Protocol management
information".
[i.44] ISO IS 24101 (all parts): "Intelligent transport systems - Communications access for land mobiles
(CALM) - Application management".
[i.45] ISO IS 24103: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Media adapted interface layer (MAIL)".
[i.46] ISO IS 25112: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using IEEE 802.16".
[i.47] ISO IS 29282: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Applications using satellite networks".
ETSI
SIST EG 202 798 V1.1.1:2011
9 ETSI EG 202 798 V1.1.1 (2011-01)
[i.48] ISO IS 21216: "Intelligent transport systems - Wireless communications - CALM using millimetre
communications".
[i.49] ISO IS 21212: "Intelligent transport systems - Communications access for land mobiles (CALM) -
2G Cellular systems".
[i.50] ISO IS 11776: "Light gauge metal containers - Non-round open-top cans - Cans defined by their
nominal capacities".
[i.51] ISO IS 25111: "Intelligent transport systems - Communications access for land mobiles (CALM) -
General requirements for using public networks".
[i.52] ISO IS 21213: "Intelligent transport systems - Communications access for land mobiles (CALM) -
3G Cellular systems".
[i.53] ISO IS 29283: "ITS CALM Mobile Wireless Broadband applications using Communications in
accordance with IEEE 802.20".
[i.54] ISO IS 25113: "Intelligent transport systems - Communications access for land mobiles (CALM) -
Mobile wireless broadband using HC-SDMA".
[i.55] ISO IS 18183: "Public broadcast reception".
[i.56] IEEE 1609.5: "Standard for Wireless Access in Vehicular Environments (WAVE) -
Communication Manager".
[i.57] IEEE 1609.1: "Standard for Dedicated Short Range Communications (DSRC) Resource Manager".
[i.58] IEEE 1609.0: "Trial-Use Standard for Wireless Access in Vehicular Environments (WAVE) -
Architecture".
[i.59] IEEE 1609.3: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Networking Services".
[i.60] IEEE 1609.4: "IEEE Draft Standard for Wireless Access in Vehicular Environments (WAVE) -
Multi-Channel Operation".
[i.61] IEEE 1609.2: "Standard for Wireless Access in Vehicular Environments - Security Services for
Applications and Management Messages".
[i.62] ETSI TS 102 731: "Intelligent Transport Systems (ITS); Security; Security Services and
Architecture".
[i.63] ETSI TS 102 894: "Intelligent Transport System (ITS); Users & Applications requirements;
Facility layer structure, functional requirements and specifications".
[i.64] ETSI EN 302 895: "Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of
Applications; Local Dynamic Map (LDM) Specification".
[i.65] ETSI TS 102 723: "Intelligent Transport Systems; OSI cross-layer topics; Part 11: Interface
between network and transport layers and facilities layer".
[i.66] ETSI TR 102 893: "Intelligent Transport Systems (ITS); Security; Threat, Vulnerability and Risk
Analysis (TVRA)".
[i.67] ETSI ES 202 910: "Intelligent Transport Systems (ITS); Security; Identity Management and
Identity Protection in ITS".
[i.68] ETSI ES 202 663: "Intelligent Transport Systems (ITS); European profile standard for the physical
and medium access control layer of Intelligent Transport Systems operating in the 5 GHz
frequency band".
[i.69] ISO IS 13181 (all parts): "CALM Security".
ETSI
SIST EG 202 798 V1.1.1:2011
10 ETSI EG 202 798 V1.1.1 (2011-01)
3 Definitions and abbreviations
3.1 Definitions
For the purposes of the present document, the terms and definitions given in [i.7], [i.8], [i.13], [i.22] and the following
apply:
conformance testing: process for testing that an implementation is compliant with a protocol standard, which is
realized by test systems simulating the protocol with test scripts executed against the implementation under test
Interoperability testing: process for testing that devices can inter-operate, which is realized by connecting devices
from different vendors and operating them, either manually or automatically, according to scenarios based on a protocol
standard
Testing framework: document providing guidance and examples necessary for the development and implementation of
a test specification
3.2 Abbreviations
For the purposes of the present document, the abbreviations given in [i.7], [i.8], [i.13], [i.22] and the following apply:
RP Reference Point
SDO Standard Developing Organisation
4 ITS foundations
4.1 Motivation for and structure of the document
In order to carry out thorough protocol conformance and interoperability testing, complex test beds would be needed. In
practice, it looks much more feasible to perform protocol conformance and interoperability tests in a simulated
environment. A protocol conformance and interoperability testing framework for ITS thus is essential for a systematic
and consistent approach towards testing of globally applicable ITS communications equipment.
The ITS testing framework presented in the present document is a set of guidelines for conformance testing and
interoperability testing. It is based on the common architecture for communications in ITS from ETSI and ISO.
Although it is referring explicitly to a consistent set of ITS base standards from ETSI and ISO, in no way it is restricted
to this set of ITS base standards. Further on, it is enabling in a sense, that a manufacturer can implement and test those
functionalities, considered to be important for market access.
The remaining part of clause 4 gives a short tutorial on communications in ITS. For more details existing base ITS
standards from ETSI and ISO are listed.
Clause 5 provides an introduction to the ITS testing framework.
Clause 6 describes the approach for conformance testing.
Clause 7 describes the approach for interoperability testing.
Clause 8 provides more detailed guidance for the development of formal ITS test specifications and test suites.
Annex A provides information on the generic approach for interoperability testing.
ETSI
SIST EG 202 798 V1.1.1:2011
11 ETSI EG 202 798 V1.1.1 (2011-01)
4.2 ITS environment
The ITS architecture is presented in [i.13], [i.22] using different views. Main views presented are the top level
networking view and the ITS station reference architecture view.
The top level networking view [i.13], [i.22] is presented in figure 1. A more implementation-oriented presentation is
given in [i.17]. It is presumed that communication within a single network does not meet all the requirements of all ITS
applications. Instead combinations of networks are envisioned, in which multiple ITS access and networking
technologies are applied.
Figure 1: Top level networking view of ITS
The networks are grouped into
• ITS domain:
- ITS station-internal network;
- ITS station-external network:
ITS ad-hoc network;
ITS access network.
• Generic domain:
- all other networks.
ITS are composed of four different ITS sub-systems, i.e. vehicular sub-system (cars, trucks, emergency vehicles, etc.),
road-side sub-systems, central sub-systems and personal (portable) sub-systems as specified in [i.22], [i.13] presented in
figure 2.
ETSI
SIST EG 202 798 V1.1.1:2011
12 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 2: ITS sub-systems [i.13], [i.22]
Each ITS sub-system contains an ITS station with functionality as specified in the ITS station reference architecture
presented in figure 3.
NOTE: The term "ITS station" (ITS-S) indicates a set of possible functionalities rather than a physical unit.
ITS stations act as peer stations in communication networks applying different access technologies, different
networking & transport protocols, different facility protocols and the related security and management functionalities.
The communication media usually are wireless. The various layers and entities in the ITS station reference architecture
are interconnected via interfaces MI, MN, MF, MA, SI, SN, SF, SA, MS, IN, NF, FA [i.22], [i.13], see figure 3.
Applications
MA FA SA
Facilities
NF
Networking &
Transport
IN
Access
MS
Figure 3: ITS station reference architecture [i.13], [i.22]
ETSI
SIST EG 202 798 V1.1.1:2011
13 ETSI EG 202 798 V1.1.1 (2011-01)
Accessibility of these interfaces may be dependent on the implementation.
Table 1 presents the layers and entities of the ITS station reference architecture being present in ITS-functional
components.
Table 1: Summary of ITS layers and entities in ITS-S functional components
Main objects ITS-S Layers and entities
(ITS sub-systems) functional
Applications Facilities Networking & Access Management Security
components (FL) Transport (NL) (AL) (ME) (SE)
Vehicle ITS-S host X X X X X X
Roadside
ITS-S router X X X X
Central
ITS-S gateway X X X X X
Personal
ITS-S border X X X X
router
ETSI
SIST EG 202 798 V1.1.1:2011
14 ETSI EG 202 798 V1.1.1 (2011-01)
4.3 ITS base standards
Figure 4 shows a snap-shot of base standard development in several standardisation organisations as of April 2010.
Security
ETSI ES 202 910
ETSI TS 102 731 ETSI TS 102 893
ISO IS 16445
Identity
Secure services Thread Vulnerability
Handover
management and
and architecture and Risk Analysis
Architecture
protection
ISO IS 16460
ISO IS11769 IEEE 1609.2
WAVE
ISO IS 13181 ISO IS 11776
Data retention for WAVE Security
Integration Security Lawfull intercept
law enforcement Services
ISO IS 21217
Architecture
ETSI TS 102 890 IEEE 1609.3 IEEE 1609.4
Comms mngmt / WAVE IEEE 802.11 WAVE Multi-
service Networking Amendment p Channel
announcement Services Operation
ETSI EN 302 665
Architecture
ETSI ES 202 663
ETSI TS 102 637 ETSI TS 102 724
ETSI TS 102 636 5,9 GHz ETSI TS 102 687
Basic Set of Channel
GeoNetworking European Power Control
Applications Specification
Profile of 802.11
IEEE 1609.1
WAVE
ETSI TS 102 894
Facility layer
structure
IEEE 1609.0
WAVE ISO IS 21218
Architecture LL SAPs
ETSI EN 302 895
ISO IS 29283
BSA, LDM
IEEE 802.20
specification
ISO IS 29281 ISO IS 25113
ISO IS 29281
IEEE 1609.5 ISO IS 29281 ISO IS 29282 Non-IP WBB
Non-IP
WAVE Legacy Systems Satellites DSRC legacy Existing
networking
systems Systems
ISO IS 24102
ISO IS 25112 ISO IS 25111
FAST service ISO IS 16444 ISO IS 24103
WBB WBB
provision, Geo-routing MAIL
WiMAX General support
Legacy Systems
ISO IS 21215
ISO IS 24101
ISO IS 21210 ISO IS 21216 CALM M5 ISO IS 21214
Application
IP networking CALM MM International CALM IR
management
profile of 802.11
ISO IS 24978 ISO IS 15662 ISO IS 18183
ISO IS 21212 ISO IS 21213
ITS safety and TICS message ISO IS 24103 Public
2G 3G
emergency management MAIL broadcast
EDGE, GPRS UMTS, CDMA2K
notification information reception
Networking &
Applications Facilities Access Technologies
Transport
ISO IS 24102
ETSI TS 102 723 ISO IS 24101 ISO IS 29281
Station and ETSI TS 102 860
Interfaces Application FAST service
communication ITS-AID
(SAPs) management advertisement
management
Management
Figure 4: ITS base standard development
Standards displayed in figure 4, which may be subject for testing according to this ITS testing framework, are e.g.:
Access layer protocols:
• Channel specification [i.20] and power control [i.19] for ITS-G5;
• CALM media IR [i.11] and M5 [i.12];
• CALM medium service access points [i.14].
ETSI
SIST EG 202 798 V1.1.1:2011
15 ETSI EG 202 798 V1.1.1 (2011-01)
Networking & transport layer protocols:
• Basic transport protocol (for GeoNetworking) [i.17];
• GeoNetworking (media-independent functionality and media-dependent functionality ITS-G5) [i.17];
• IPv6 over GeoNetworking [i.17];
• CALM FAST networking and transport protocol [i.16];
• IPv6 in the context of ITS [i.9];
• CALM Geo-Routing (new work item at ISO TC204 WG16), referring to the basic GeoNetworking protocols
developed at ETSI.
Facilities layer protocols:
• CAM [i.18];
• DENM [i.18];
• CALM legacy system support [i.15], [i.16] e.g. CEN DSRC for electronic fee collection.
Management, security and cross-layer protocols:
• CALM FAST service advertisement [i.15], [i.16];
• "Inter ITS-SCU" management communication [i.15];
• ITS station and communication management [i.15];
• ITS architecture elements [i.13].
ETSI
SIST EG 202 798 V1.1.1:2011
16 ETSI EG 202 798 V1.1.1 (2011-01)
4.4 ITS test standards
Examples of test standards for ITS base standards being under development/being finalized at ETSI and ISO are
presented in figure 5.
Figure 5: Activities on testing ITS base standards
Some test work items identified at ETSI at time of writing the present document are [i.23] to [i.34].
5 Introduction to the ITS testing framework EG
The present document provides:
• Guidance to identify the candidate implementations under test (IUT) for conformance testing in clause 6.1 and
the equipment under test (EUTs) for interoperability in clause 7.1, i.e. answering the question "what is to be
tested".
• Guidance to define the applicable test procedures in clauses 6 and 7, i.e. answering the question "how is to be
tested".
• Guidance to develop the resulting test specifications and deliverables (for instance: TSS&TP, TP proforma,
TTCN-3 test suite and documentation) in clause 8.
ETSI
SIST EG 202 798 V1.1.1:2011
17 ETSI EG 202 798 V1.1.1 (2011-01)
Figure 6 illustrates the ITS testing framework and the interactions with ITS base standards and ITS test specifications.
The ITS testing framework is based on concepts defined in ISO 9646 [i.7], TTCN-3 [i.4] and EG 202 237 [i.5].
Figure 6: ITS testing framework interactions
As far as possible, specific ITS protocol base standards are identified which may be subject to conformance and/or
interoperability testing according to this testing framework. However this ITS testing framework in no way restricts its
applicability to these protocols. This ITS testing framework also in support of any other ITS protocol base standard.
5.1 Conformance testing
Clause 6 provides guidelines for conformance testing, which includes:
• Identification of candidate "Implementations Under Test" (IUT);
• Identification of reference points;
• Identification of the ATM:
- abstract protocol tester;
- functional TTCN-3 test architecture.
5.2 Interoperability testing
Clause 7 provides guidelines for interoperability testing, which includes:
• Identification of candidate EUTs.
• Identification of test scenarios.
• Definition of test bed architecture.
ETSI
SIST EG 202 798 V1.1.1:2011
18 ETSI EG 202 798 V1.1.1 (2011-01)
• Identification of test bed interfaces.
5.3 Steps for development of test specifications
Clause 8 provides guidance to write test specifications and to develop TTCN-3 test suites:
• Developing "Implementation Conformance Statements" (ICS) or "Interoperable Functions Statement" (IFS)
from base standards, if not already provided as part of the base standard.
• Developing "Test Suite Structure and Test Purposes" (TSS&TP) from ICS and base standards.
• Developing "Test Descriptions" (TDs) from base standards.
• Developing ITS TTCN-3 test suite, e.g. naming conventions, code documentation, test case structure.
6 Conformance testing
The following clauses are providing conformance testing methodologies to be applied in ITS.
6.1 Candidate IUTs
The "Implementation Under Test" (IUT) is a protocol implementation considered as an object for testing. This means
that the test process will focus on verifying the compliance of this protocol implementation (IUT) with requirements set
up in the related base standard. An IUT normally is implemented in a "System Under Test" (SUT). For testing, an SUT
is connected to a test system over at least a single interface specified in the related ITS base standard. Such an interface
is identified as "Reference Point" (RP) in the present document.
NOTE: Other interfaces between the test system and the IUT may be used to control the behaviour of the IUT
during the test process.
Further details on RPs are presented in clause 6.2.
IUTs normally are protocols located in a layer or an entity of the ITS station reference architecture presented in figure 3.
Examples of IUTs and their location in the ITS station reference architecture are illustrated in figure 7. Further details
are presented in tables 2 and 3.
ETSI
SIST EG 202 798 V1.1.1:2011
19 ETSI EG 202 798 V1.1.1 (2011-01)
/
/
s
r
P
e
A g
a
S
n
o
a
t
m
s
s t
e s
c a
c c
a p
u
e
t o
r
o
g
m
S
e
T
R I
/
/
t
.
n
.
n
o .
i
e
t
a
m
c
e
i
c
n
n
u
u
m
o
n
m
o n
c a
e
U
c
i
C
v
r
S
-
e
S s
T
I T
-
r S
e
A
t
F
n
I
Figure 7: Examples of IUTs in the ITS station reference architecture
Table 2 exemplifies candidates for IUTs for RP-External identified in clause 6.2.
Table 2: Candidates for IUTs for RP-External
Layer/entity IUT (protocols) ITS specific Notes
Apps ITS-S application messages YES Not considered for conformance testing.
To be used for interoperability testing.
FL CAM [i.18] YES
DENM [i.18] YES
Legacy CI port manager [i.16] YES
15628 kernel emulator [i.16] YES
NL Basic transport protocol for GeoNetworking [i.17] YES
FAST networking and transport protocol [i.16] YES
GeoNetworking [i.17] YES
IPv6 for ITS [i.9] YES No test of IPv6 functionality from IETF,
but only tests on how to use this
functionality in the context of ITS.
IPv6 over GeoNetworking [i.17] YES
ITS-MUX [i.16] YES
Legacy protocols such as TCP, UDP NO
AL CAL extension for legacy systems [i.16] YES
CALM IR [i.11] YES
CALM M5 (ITS-G5) [i.12] YES The basic MAC and PHY is
standardized in IEEE 802.11 [i.38] and
thus not subject of tests within this ITS
framework.
CALM medium service access points/support of YES
legacy technologies [i.14]
Legacy technologies NO Covered by other testing frameworks.
ME FAST service advertisement [i.15] YES
Legacy system support [i.15] YES
SE To be defined YES Base standards are under
development.
ETSI
SIST EG 202 798 V1.1.1:2011
20 ETSI EG 202 798 V1.1.1 (2011-01)
Table 3 exemplifies candidates for IUTs for the RP-Internal-ITS-S identified in clause 6.2.
Table 3: Candidates for IUTs for RP-Internal-ITS-S
Layer/entity Protocols ITS specific Notes
ME Inter-ITS-SCU PDUs (allows for e.g. YES
remote access to SAPs) [i.15]
LAN technology protocols, wired or NO Does not require specific testing for ITS.
wireless, e.g. TCP/IP, Ethernet,
Bluetooth
NL Local forwarding of FAST packets [i.16] Yes
Tables 2 and 3 need to be amended in the following cases:
• A new protocol is identified as a new potential IUT and interacts in one of the RPs.
• A new ITS-S functional component or ITS sub-system is defined. This should be included as a SUT as long as
it interacts in one of the RPs.
• If a new RP is identified, the same analysis is done for incorporating the corresponding SUT and IUT.
6.2 Reference points
This clause illustrates candidate reference points (RPs) where test systems can be connected in order to test
conformance of ITS protocols (IUTs) with ITS base standards.
RPs listed in tables 4 and 5 are classified in two groups:
• External networking RPs (RP-External) are based on the ITS sub-systems presented in figure 2 and the
related external networks presented in figure 1.
Table 4: External networking reference points RP-External
RP Identifier RP Name ITS sub-system ITS sub-system Network
RP-ITS-Ext-1 R Vehicle Vehicle ITS ad-hoc
A
RP-ITS-Ext-2
R Vehicle Roadside ITS ad-hoc
B
RP-ITS-Ext-3 R Personal Personal ITS ad-hoc
C
RP-ITS-Ext-4 R
Roadside Personal ITS ad-hoc
D
RP-ITS-Ext-5 R Vehicle Personal ITS ad-hoc
E
RP-ITS-Ext-6 R Roadside Roadside ITS ad-hoc
F
RP-ITS-Ext-7 R Vehicle Roadside ITS ad-hoc
I
RP-ITS-Ext-8 R Roadside Personal ITS ad-hoc
J
RP-ITS-Ext-9
R Vehicle Roadside Public
K
RP-ITS-Ext-10 R Vehicle Central Public
L
RP-ITS-Ext-11 R
Roadside Personal Public
M
RP-ITS-Ext-12 R Personal Central Public
N
RP-ITS-Ext-13 R Vehicle Personal Public
O
RP-ITS-Ext-14 R Roadside Central Public
P
RP-ITS-Ext-15 R Roadside Central Private
S
RP-ITS-Ext-16
R Central Central Public/Private
Z
ETSI
SIST EG 202 798 V1.1.1:2011
21 ETSI EG 202 798 V1.1.1 (2011-01)
• Internal network RPs (RP-Internal-ITS-S) are based on the ITS-S functional components listed in clause 4.2
and taking into account the interaction via the ITS station internal network presente
...