ISO/IEC 23090-8:2020
(Main)Information technology — Coded representation of immersive media — Part 8: Network based media processing
Information technology — Coded representation of immersive media — Part 8: Network based media processing
The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.
Technologies de l'information — Représentation codée de média immersifs — Partie 8: Titre manque
General Information
Buy Standard
Standards Content (Sample)
INTERNATIONAL ISO/IEC
STANDARD 23090-8
First edition
2020-12
Information technology — Coded
representation of immersive media —
Part 8:
Network based media processing
Reference number
ISO/IEC 23090-8:2020(E)
©
ISO/IEC 2020
---------------------- Page: 1 ----------------------
ISO/IEC 23090-8:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC 23090-8:2020(E)
Contents
Foreword . vii
Introduction . viii
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 4
4 Conventions . 4
5 Overview . 5
5.1 General . 5
5.2 Architecture . 5
5.3 NBMP workflow . 6
5.3.1 General . 6
5.3.2 Workflow processing model . 6
5.3.3 Task allocation and distribution . 8
5.3.4 Workflow graph . 8
5.4 Relationship between logical definitions, data objects and REST resources . 9
5.5 Description of the defined entities in this document . 10
5.5.1 NBMP APIs . 10
5.5.2 Content format . 10
5.5.3 Definitions . 10
5.5.4 Functional behaviour . 11
6 NBMP descriptions . 11
6.1 NBMP function description (FD) . 11
6.1.1 General . 11
6.1.2 Description . 11
6.1.3 Function group . 12
6.2 NBMP task description (TD) . 13
6.2.1 General . 13
6.2.2 Description . 13
6.2.2 Task lifecycle . 14
6.3 NBMP workflow description (WD) . 15
6.3.1 General . 15
6.3.2 Description . 15
6.3.3 Workflow lifecycle . 16
7 NBMP interfaces . 17
7.1 General . 17
7.2 Workflow APIs . 18
7.2.3 Workflow API operations . 18
7.3 Task APIs . 20
7.3.1 General . 20
7.3.2 Task resource . 20
7.3.3 Task API operations . 21
7.4 Function discovery APIs . 22
7.4.1 General . 22
7.4.2 Function discovery queries . 22
7.4.3 Function discovery API operations . 23
7.5 Supported protocols . 25
8 NBMP descriptors . 25
© ISO/IEC 2020 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC 23090-8:2020(E)
8.1 Scheme descriptor .25
8.1.1 General .25
8.1.2 JSON schema .26
8.2 General descriptor .27
8.2.1 General .27
8.2.2 JSON schema .28
8.3 Input descriptor .32
8.3.1 General .32
8.3.2 JSON schema .33
8.3.3 General .38
8.3.4 JSON schema .39
8.4 Processing descriptor .43
8.4.1 General .43
8.4.2 JSON schema .46
8.5 Requirements descriptor .53
8.5.1 General .53
8.5.2 JSON schema .55
8.6 Configuration descriptor .59
8.6.1 General .59
8.6.2 JSON schema .60
8.7 Startup-delay descriptor.63
8.7.1 General .63
8.7.2 JSON schema .64
8.8 Client-Assistance descriptor .64
8.8.1 General .64
8.8.2 JSON schema .65
8.9 Failover descriptor .66
8.9.1 General .66
8.9.2 JSON schema .66
8.10 Events descriptor .67
8.10.1 General .67
8.10.2 JSON schema .68
8.11 Variables descriptor.68
8.11.1 General .68
8.11.2 JSON schema .69
8.12 Monitoring descriptor .70
8.12.1 General .70
8.12.2 JSON schema .70
8.13 Reporting descriptor .71
8.13.1 General .71
8.13.2 JSON schema .72
8.14 Notification descriptor .74
8.14.1 General .74
8.14.2 JSON schema .74
8.15 Assertion descriptor .76
8.15.1 General .76
8.15.2 JSON schema .78
8.16 Request Descriptor .81
8.16.1 General .81
8.16.2 JSON schema .81
8.17 Acknowledge descriptor .82
8.17.1 General .82
8.17.2 JSON schema .82
8.18 Repository descriptor.83
8.18.1 General .83
iv © ISO/IEC 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC 23090-8:2020(E)
8.18.2 JSON schema . 84
8.19 Security descriptor . 85
8.19.1 General . 85
8.19.1 JSON schema . 86
8.20 Step descriptor . 87
8.20.1 General . 87
8.20.2 JSON schema . 87
9 NBMP parameters . 88
9.1 General . 88
9.2 Scheme descriptor parameters . 88
9.3 General descriptor parameters . 89
9.4 Input descriptor parameters . 90
9.5 Output descriptor parameters . 92
9.6 Processing descriptor parameters . 94
9.7 Requirements descriptor parameters . 95
9.7.1 Flow control parameters . 95
9.7.2 Hardware parameters . 95
9.7.3 Security requirements . 96
9.7.4 Workflow/task requirements . 97
9.7.5 Resource estimator parameters . 97
9.8 Startup-Delay descriptor parameters . 97
9.9 Client-Assistant parameters . 98
9.10 Failover parameters . 98
9.11 Events parameters . 99
9.12 Variables parameters . 99
9.13 Monitoring parameters . 100
9.14 Reporting parameters. 100
9.15 Notification parameters . 101
9.16 Assertion parameters . 101
9.17 Request parameters . 103
9.18 Acknowledge parameters . 103
9.19 Repository parameters . 104
9.20 Security parameters . 104
9.21 Step Descriptor parameters . 105
9.22 Configuration descriptor parameters . 106
9.22.1 Generic parameter representation . 106
9.22.2 Example of parameter representation . 107
10 Workflow manager, task and function repository requirements . 110
10.1 Workflow manager requirements . 110
10.2 Function repository requirements. 111
10.3 Task requirements . 111
11 NBMP support for media formats and metadata . 112
11.1 General . 112
11.2 Media formats . 112
11.3 Application formats . 112
11.4 Metadata formats . 112
12 Security considerations in NBMP . 112
12.1 Overview . 112
12.2 Secure and authenticated channels between NBMP source and NBMP workflow
manager . 113
12.2.1 General . 113
12.2.2 Secure communication channel between NBMP source and NBMP workflow manager
. 113
© ISO/IEC 2020 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC 23090-8:2020(E)
12.2.3 NBMP source authentication to workflow manager . 113
12.2.4 Workflow manager authentication to NBMP source . 113
12.2.5 Secure channels for task communication . 113
12.2.6 NBMP source authentication/authorization to workflow task . 114
12.2.7 Workflow task authentication to NBMP source . 114
12.2.8 Secure channel for NBMP source and task communication . 114
12.2.9 MPE security . 114
12.2.10 Network security . 114
Annex A (normative) JSON schemas . 115
Annex B (normative) NBMP workflow management . 116
Annex C (informative) Schema for identifying MPEG compatible functions . 119
Annex D (normative) NBMP MIME types . 120
Annex E (informative) Interface for managing function descriptions in function repository
. 123
Bibliography . 124
vi © ISO/IEC 2020 – All rights reserved
---------------------- Page: 6 ----------------------
ISO/IEC 23090-8:2020(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical activity.
ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of document should be noted. This document was drafted in accordance with the editorial
rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details
of any patent rights identified during the development of the document will be in the Introduction and/or
) or the IEC list of patent
on the ISO list of patent declarations received (see www.iso.org/patents
declarations received (see http://patents.iec.ch).
Any trade name used in this document is information given for the convenience of users and does not
constitute an endorsement.
For an explanation of the voluntary nature of standards, the meaning of ISO specific terms and
expressions related to conformity assessment, as well as information about ISO's adherence to the World
Trade Organization (WTO) principles in the Technical Barriers to Trade (TBT)
see www.iso.org/iso/foreword.html.
This document was prepared by Joint Technical Committee ISO/IEC JTC 1, Information technology,
Subcommittee SC 29, Coding of audio, picture, multimedia and hypermedia information.
A list of all parts in the ISO/IEC 23090 series ca
...
FINAL
INTERNATIONAL ISO/IEC
DRAFT
STANDARD FDIS
23090-8
ISO/IEC JTC 1/SC 29
Information technology — Coded
Secretariat: JISC
representation of immersive media —
Voting begins on:
2020-10-06
Part 8:
Voting terminates on:
Network based media processing
2020-12-01
RECIPIENTS OF THIS DRAFT ARE INVITED TO
SUBMIT, WITH THEIR COMMENTS, NOTIFICATION
OF ANY RELEVANT PATENT RIGHTS OF WHICH
THEY ARE AWARE AND TO PROVIDE SUPPOR TING
DOCUMENTATION.
IN ADDITION TO THEIR EVALUATION AS
Reference number
BEING ACCEPTABLE FOR INDUSTRIAL, TECHNO-
ISO/IEC FDIS 23090-8:2020(E)
LOGICAL, COMMERCIAL AND USER PURPOSES,
DRAFT INTERNATIONAL STANDARDS MAY ON
OCCASION HAVE TO BE CONSIDERED IN THE
LIGHT OF THEIR POTENTIAL TO BECOME STAN-
DARDS TO WHICH REFERENCE MAY BE MADE IN
©
NATIONAL REGULATIONS. ISO/IEC 2020
---------------------- Page: 1 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
COPYRIGHT PROTECTED DOCUMENT
© ISO/IEC 2020
All rights reserved. Unless otherwise specified, or required in the context of its implementation, no part of this publication may
be reproduced or utilized otherwise in any form or by any means, electronic or mechanical, including photocopying, or posting
on the internet or an intranet, without prior written permission. Permission can be requested from either ISO at the address
below or ISO’s member body in the country of the requester.
ISO copyright office
CP 401 • Ch. de Blandonnet 8
CH-1214 Vernier, Geneva
Phone: +41 22 749 01 11
Email: copyright@iso.org
Website: www.iso.org
Published in Switzerland
ii © ISO/IEC 2020 – All rights reserved
---------------------- Page: 2 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
Contents
Foreword . vii
Introduction . viii
1 Scope . 1
2 Normative references . 1
3 Terms, definitions and abbreviated terms . 1
3.1 Terms and definitions . 1
3.2 Abbreviated terms . 4
4 Conventions . 4
5 Overview . 5
5.1 General . 5
5.2 Architecture . 5
5.3 NBMP workflow . 6
5.3.1 General . 6
5.3.2 Workflow processing model . 6
5.3.3 Task allocation and distribution . 8
5.3.4 Workflow graph . 8
5.4 Relationship between logical definitions, data objects and REST resources . 9
5.5 Description of the defined entities in this document . 10
5.5.1 NBMP APIs . 10
5.5.2 Content format . 10
5.5.3 Definitions . 10
5.5.4 Functional behaviour . 11
6 NBMP descriptions . 11
6.1 NBMP function description (FD) . 11
6.1.1 General . 11
6.1.2 Description . 11
6.1.3 Function group . 12
6.2 NBMP task description (TD) . 13
6.2.1 General . 13
6.2.2 Description . 13
6.2.2 Task lifecycle . 14
6.3 NBMP workflow description (WD) . 15
6.3.1 General . 15
6.3.2 Description . 15
6.3.3 Workflow lifecycle . 16
7 NBMP interfaces . 17
7.1 General . 17
7.2 Workflow APIs . 18
7.2.3 Workflow API operations . 18
7.3 Task APIs . 20
7.3.1 General . 20
7.3.2 Task resource . 20
7.3.3 Task API operations . 21
7.4 Function discovery APIs . 22
7.4.1 General . 22
7.4.2 Function discovery queries . 22
7.4.3 Function discovery API operations . 23
7.5 Supported protocols . 25
8 NBMP descriptors . 25
© ISO/IEC 2020 – All rights reserved iii
---------------------- Page: 3 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
8.1 Scheme descriptor .25
8.1.1 General .25
8.1.2 JSON schema .26
8.2 General descriptor .27
8.2.1 General .27
8.2.2 JSON schema .28
8.3 Input descriptor .32
8.3.1 General .32
8.3.2 JSON schema .33
8.3.3 General .38
8.3.4 JSON schema .39
8.4 Processing descriptor .43
8.4.1 General .43
8.4.2 JSON schema .46
8.5 Requirements descriptor .53
8.5.1 General .53
8.5.2 JSON schema .55
8.6 Configuration descriptor .59
8.6.1 General .59
8.6.2 JSON schema .60
8.7 Startup-delay descriptor.63
8.7.1 General .63
8.7.2 JSON schema .64
8.8 Client-Assistance descriptor .64
8.8.1 General .64
8.8.2 JSON schema .65
8.9 Failover descriptor .66
8.9.1 General .66
8.9.2 JSON schema .66
8.10 Events descriptor .67
8.10.1 General .67
8.10.2 JSON schema .68
8.11 Variables descriptor.68
8.11.1 General .68
8.11.2 JSON schema .69
8.12 Monitoring descriptor .70
8.12.1 General .70
8.12.2 JSON schema .70
8.13 Reporting descriptor .71
8.13.1 General .71
8.13.2 JSON schema .72
8.14 Notification descriptor .74
8.14.1 General .74
8.14.2 JSON schema .74
8.15 Assertion descriptor .76
8.15.1 General .76
8.15.2 JSON schema .78
8.16 Request Descriptor .81
8.16.1 General .81
8.16.2 JSON schema .81
8.17 Acknowledge descriptor .82
8.17.1 General .82
8.17.2 JSON schema .82
8.18 Repository descriptor.83
8.18.1 General .83
iv © ISO/IEC 2020 – All rights reserved
---------------------- Page: 4 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
8.18.2 JSON schema . 84
8.19 Security descriptor . 85
8.19.1 General . 85
8.19.1 JSON schema . 86
8.20 Step descriptor . 87
8.20.1 General . 87
8.20.2 JSON schema . 87
9 NBMP parameters . 88
9.1 General . 88
9.2 Scheme descriptor parameters . 88
9.3 General descriptor parameters . 89
9.4 Input descriptor parameters . 90
9.5 Output descriptor parameters . 92
9.6 Processing descriptor parameters . 94
9.7 Requirements descriptor parameters . 95
9.7.1 Flow control parameters . 95
9.7.2 Hardware parameters . 95
9.7.3 Security requirements . 96
9.7.4 Workflow/task requirements . 97
9.7.5 Resource estimator parameters . 97
9.8 Startup-Delay descriptor parameters . 97
9.9 Client-Assistant parameters . 98
9.10 Failover parameters . 98
9.11 Events parameters . 99
9.12 Variables parameters . 99
9.13 Monitoring parameters . 100
9.14 Reporting parameters. 100
9.15 Notification parameters . 101
9.16 Assertion parameters . 101
9.17 Request parameters . 103
9.18 Acknowledge parameters . 103
9.19 Repository parameters . 104
9.20 Security parameters . 104
9.21 Step Descriptor parameters . 105
9.22 Configuration descriptor parameters . 106
9.22.1 Generic parameter representation . 106
9.22.2 Example of parameter representation . 107
10 Workflow manager, task and function repository requirements . 110
10.1 Workflow manager requirements . 110
10.2 Function repository requirements. 111
10.3 Task requirements . 111
11 NBMP support for media formats and metadata . 112
11.1 General . 112
11.2 Media formats . 112
11.3 Application formats . 112
11.4 Metadata formats . 112
12 Security considerations in NBMP . 112
12.1 Overview . 112
12.2 Secure and authenticated channels between NBMP source and NBMP workflow
manager . 113
12.2.1 General . 113
12.2.2 Secure communication channel between NBMP source and NBMP workflow manager
. 113
© ISO/IEC 2020 – All rights reserved v
---------------------- Page: 5 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
12.2.3 NBMP source authentication to workflow manager . 113
12.2.4 Workflow manager authentication to NBMP source . 113
12.2.5 Secure channels for task communication . 113
12.2.6 NBMP source authentication/authorization to workflow task . 114
12.2.7 Workflow task authentication to NBMP source . 114
12.2.8 Secure channel for NBMP source and task communication . 114
12.2.9 MPE security . 114
12.2.10 Network security . 114
Annex A (normative) JSON schemas . 115
Annex B (normative) NBMP workflow management . 116
Annex C (informative) Schema for identifying MPEG compatible functions . 119
Annex D (normative) NBMP MIME types . 120
Annex E (informative) Interface for managing function descriptions in function repository
. 123
Bibliography . 124
vi © ISO/IEC 2020 – All rights reserved
---------------------- Page: 6 ----------------------
ISO/IEC FDIS 23090-8:2020(E)
Foreword
ISO (the International Organization for Standardization) and IEC (the International Electrotechnical
Commission) form the specialized system for worldwide standardization. National bodies that are
members of ISO or IEC participate in the development of International Standards through technical
committees established by the respective organization to deal with particular fields of technical activity.
ISO and IEC technical committees collaborate in fields of mutual interest. Other international
organizations, governmental and non-governmental, in liaison with ISO and IEC, also take part in the
work.
The procedures used to develop this document and those intended for its further maintenance are
described in the ISO/IEC Directives, Part 1. In particular, the different approval criteria needed for the
different types of document should be noted. This document was drafted in accordance with the editorial
rules of the ISO/IEC Directives, Part 2 (see www.iso.org/directives).
Attention is drawn to the possibility that some of the elements of this document may be the subject of
patent rights. ISO and IEC shall not be held responsible for identifying any or all such patent rights. Details
of any patent rights identified during the development of the document will be in the Introduction and/or
) or the IEC list of patent
on the ISO list of patent declarations received (see www.iso.org/patents
declarations received (see http://patents.iec.ch).
Any trade name used in this document is information given for the
...
Questions, Comments and Discussion
Ask us and Technical Secretary will try to provide an answer. You can facilitate discussion about the standard in here.