ISO/IEC 18040:2019

INTERNATIONAL ISO/IEC
STANDARD 18040
First edition
2019-05
Information technology — Computer
graphics, image processing and
environmental data representation —
Live actor and entity representation in
mixed and augmented reality (MAR)
Technologies de l'information — Infographie, traitement de l'image
et représentation des données environnementales — Représentation
d'acteurs et d'entités réels en réalité mixte et augmentée (MAR)
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved

Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 3
4 Concepts of LAE representation in MAR . 3
4.1 Overview . 3
4.2 Components . 6
4.2.1 General. 6
4.2.2 LAE capturer and sensor . 7
4.2.3 LAE recognizer . 8
4.2.4 LAE tracker . 8
4.2.5 LAE spatial mapper . 8
4.2.6 LAE event mapper . 8
4.2.7 Renderer . 8
4.2.8 Display and user interface . 8
4.2.9 Scene representation . 8
5 LAE capturer and sensor . 9
5.1 Overview . 9
5.2 Computational view. 9
5.2.1 General. 9
5.2.2 LAE capturer . 9
5.2.3 LAE sensor . . .10
5.3 Informational view .12
6 Tracker and spatial mapper for an LAE .13
6.1 Overview .13
6.2 Computational view.14
6.3 Informational view .16
6.4 An example of LAE tracking and spatial mapping in MAR .17
7 Recognizer and event mapper for an LAE .17
7.1 Overview .17
7.2 Recognizer .17
7.3 Event mapper .19
7.4 Event execution .20
7.5 Examples of LAE recognizing and event mapping in MAR.21
8 Scene representation for an LAE .22
8.1 Overview .22
8.2 Scene description .23
9 Renderer .24
9.1 Overview .24
9.2 Computational view.24
9.3 Information view.25
10 Display and UI .25
11 Extensions to virtual actor and entity .25
12 System performance .26
13 Safety .27
© ISO/IEC 2019 – All rights reserved iii

14 Conformance .28
Annex A (informative) Use case examples .31
Bibliography .39
iv © ISO/IEC 2019 – All rights reserved

Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that
are members of ISO or IEC participate in the development of International Standards through
technical committees established by the respective organization to deal with particular fields of
technical activity. ISO and IEC technical committees collaborate in fields of mutual interest. Other
international organizations, governmental and non-governmental, in liaison with ISO and IEC, also
take part in the work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for
the different types of document should be noted. This document was drafted in accordance with the
editorial rules of the ISO/IEC Directives, Part 2 (see www .iso .org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject
of patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent
rights. Details of any patent rights identified during the development of the document will be in the
Introduction and/or on the ISO list of patent declarations received (see www .iso .org/patents) or the IEC
list of patent declarations received (see http: //patents .iec .ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the
World Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT) see www .iso
.org/iso/foreword .html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 24, Computer graphics, image processing and environmental data representation.
Any feedback or questions on this document should be directed to the user’s national standards body. A
complete listing of these bodies can be found at www .iso .org/members .html.
© ISO/IEC 2019 – All rights reserved v

Introduction
This document defines the scope and key concepts of a representation model for a live actor and
entity (LAE) to be included in a mixed and augmented reality (MAR) world. The relevant terms and
their definitions, and a generalized system architecture, together serve as a reference model for MAR
applications, components, systems, services and specifications. It defines representing and rendering
an LAE in an MAR scene, and interaction interfaces between an LAE and objects in an MAR scene. It
defines a set of principles, concepts and functionalities for an LAE applicable to the complete range of
current and future MAR standards. This reference model establishes the set of required modules and
their minimum functions, the associated information content, and the information models that shall
be provid
...