ISO/IEC 18039:2019

INTERNATIONAL ISO/IEC
STANDARD 18039
First edition
2019-02
Information technology — Computer
graphics, image processing and
environmental data representation —
Mixed and augmented reality (MAR)
reference model
Technologies de l'information — Infographie, traitement de l'image
et représentation des données environnementales — Modèle de
référence en réalité mixte et augmentée
Reference number
©
ISO/IEC 2019
© ISO/IEC 2019
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Fax: +41 22 749 09 47
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2019 – All rights reserved

Contents Page
Foreword .v
Introduction .vi
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 4
4 Mixed and augmented reality (MAR) domain and concepts . 4
4.1 General . 4
4.2 MAR continuum . 6
5 MAR reference model usage example . 7
5.1 Designing an MAR application or service . 7
5.2 Deriving an MAR business model . 7
5.3 Extending existing or creating new standards for MAR . 7
6 MAR reference system architecture . 8
6.1 Overview . 8
6.2 Viewpoints . 9
6.3 Enterprise viewpoint . 9
6.3.1 General. 9
6.3.2 Classes of actors .10
6.3.3 Business model of MAR systems .11
6.3.4 Criteria for successful MAR systems .12
6.4 Computational viewpoint .12
6.4.1 General.12
6.4.2 Sensors: pure sensor and real world capturer .12
6.4.3 Context analyser: recognizer and tracker .13
6.4.4 Spatial mapper .14
6.4.5 Event mapper . . .14
6.4.6 MAR execution engine .15
6.4.7 Renderer .15
6.4.8 Display and user interface .16
6.4.9 MAR system API .17
6.5 Information viewpoint .17
6.5.1 General.17
6.5.2 Sensors .17
6.5.3 Recognizer .18
6.5.4 Tracker . .19
6.5.5 Spatial mapper .19
6.5.6 Event mapper . . .19
6.5.7 Execution engine .20
6.5.8 Renderer .20
6.5.9 Display and user interface .20
7 MAR component classification framework .21
8 MAR system classes .22
8.1 General .22
8.2 MAR Class V — Visual augmentation systems.22
8.2.1 Local recognition and tracking .22
8.2.2 Local registration, remote recognition and tracking .23
8.2.3 Remote recognition, local tracking and registration .24
8.2.4 Remote recognition, registration and composition .26
8.2.5 MAR Class V-R: visual augmentation with 3D environment reconstruction .27
© ISO/IEC 2019 – All rights reserved iii

8.3 MAR type 3DV: 3D video systems .27
8.3.1 Real-time, local-depth estimation, condition-based augmentation .27
8.3.2 Real-time, local-depth estimation, model-based augmentation .28
8.3.3 Real-time, remote depth estimation, condition-based augmentation .29
8.3.4 Real-time, remote-depth estimation, model-based augmentation .30
8.3.5 Real-time, multiple remote user reconstructions, condition-based
augmentation .31
8.4 MAR Class G: points of interest (POI) — GNSS-based systems .32
8.4.1 Content-embedded POIs .32
8.4.2 Server-available POIs .33
8.5 MAR type A: audio systems .34
8.5.1 Local audio recognition . .34
8.5.2 Remote audio recognition .35
8.6 MAR type 3DA: 3D audio systems .36
8.6.1 Local audio spatialization .36
9 Conformance .37
10 Performance .38
11 Safety .38
12 Security.39
13 Privacy .39
14 Usability and accessibility .39
Annex A (informative) AR-related solutions and technologies and their relation to the MAR
reference model .41
Annex B (informative) Use case examples and coverage by the MAR reference model .45
Bibliography .60
iv © ISO/IEC 2019 – All rights reserved

ISO/IEC 18039
...