ISO/IEC JTC 1/SC 29/WG 3 - MPEG Systems

This document specifies extensions to existing scene description formats in order to support MPEG media, in particular immersive media. MPEG media includes but is not limited to media encoded with MPEG codecs, media stored in MPEG containers, MPEG media and application formats as well as media provided through MPEG delivery mechanisms. Extensions include scene description format syntax and semantics and the processing model when using these extensions by a Presentation Engine. It also defines a media access function (MAF) API for communication between the Presentation Engine and the media access function for these extensions. While the extensions defined in this document can be applicable to other scene description formats, they are provided for ISO/IEC 12113.

This document specifies the system layer of the coding. It was developed principally to support the combination of the video and audio coding methods defined in Parts 2 and 3 of ISO/IEC 13818. The system layer supports six basic functions: 1) the synchronization of multiple compressed streams on decoding; 2) the interleaving of multiple compressed streams into a single stream; 3) the initialization of buffering for decoding start up; 4) continuous buffer management; 5) time identification; 6) multiplexing and signalling of various components in a system stream. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream is either a transport stream or a program stream. Both streams are constructed from PES packets and packets containing other necessary information. Both stream types support multiplexing of video and audio compressed streams from one program with a common time base. The transport stream additionally supports the multiplexing of video and audio compressed streams from multiple programs with independent time bases. For almost error-free environments the program stream is generally more appropriate, supporting software processing of program information. The transport stream is more suitable for use in environments where errors are likely. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream, whether a transport stream or a program stream, is constructed in two layers: the outermost layer is the system layer, and the innermost is the compression layer. The system layer provides the functions necessary for using one or more compressed data streams in a system. The video and audio parts of this Specification define the compression coding layer for audio and video data. Coding of other types of data is not defined by this Specification, but is supported by the system layer provided that the other types of data adhere to the constraints defined in 2.7.

This document specifies: — How to uniquely identify Digital Items (and parts thereof); — How to uniquely identify IP related to the Digital Items (and parts thereof), for example abstractions; — How to express the relationship between the two above identifiers; — How to deal with varying levels of functional granularity for Digital Item identifiers; — How to uniquely identify description schemes; — The relationship between Digital Items (and parts thereof) and existing identification systems. Annex C contains a list of relevant identification systems. This is not an exhaustive list and is subject to change over time; — How to express the relationship between two Digital Items. This document does not specify: — New identification systems for the content elements for which identification and description schemes already exist and are in use (e.g. this document does not attempt to replace the ISRC, as defined in ISO 3901, for sound recordings); — Normative description schemes for describing content.

This document specifies the Image File Format, an interoperable storage format for a single image, a collection of images, and sequences of images. The format defined in this document is built on tools defined in ISO/IEC 14496-12 and enables the interchange, editing, and display of images, as well as the carriage of metadata associated with those images. The Image File Format defines structures used to contain metadata, how to link that metadata to the images, and defines how metadata of certain forms is carried. This document also specifies brands for the storage of images and image sequences conforming to High Efficiency Video Coding (HEVC), Advanced Video Coding (AVC), JPEG, Versatile Video Coding (VVC) and Essential Video Coding (EVC). NOTE The storage of HEVC, AVC, VVC and EVC video sequences is out of scope and is provided in ISO/IEC 14496-15.

This document specifies the storage format for streams of video that is structured as NAL units, such as AVC (ISO/IEC 14496-10) and HEVC (ISO/IEC 23008-2) video streams. In addition, Annex E specifies parameters and sub-parameters applying when sample entries specified in this document are used as the 'codecs' parameter of a MIME type, as specified in IETF RFC 6381.

This document specifies a media format that enables the storage and delivery of geometry-based point cloud compression data. The geometry-based point cloud compression data can be timed or non-timed. It supports flexible extraction of geometry-based point cloud compression data at delivery or decoding time.

This document specifies extensions to existing scene description formats in order to support MPEG media, in particular immersive media. MPEG media includes but is not limited to media encoded with MPEG codecs, media stored in MPEG containers, MPEG media and application formats as well as media provided through MPEG delivery mechanisms. Extensions include scene description format syntax and semantics and the processing model when using these extensions by a Presentation Engine. It also defines a Media Access Function (MAF) API for communication between the Presentation Engine and the Media Access Function for these extensions. While the extensions defined in this document can be applicable to other scene description formats, they are provided for ISO/IEC 12113.

This document specifies the means (e.g. protocols and application programming interfaces) for converting MPEG-21 XML and RDF media contracts (ISO/IEC 21000-19, ISO/IEC 21000-20, and ISO/IEC 21000-21) to smart contracts executable on existing DLT environments.

This document specifies the system layer of the coding. It was developed principally to support the combination of the video and audio coding methods defined in Parts 2 and 3 of ISO/IEC 13818. The system layer supports six basic functions: 1) the synchronization of multiple compressed streams on decoding; 2) the interleaving of multiple compressed streams into a single stream; 3) the initialization of buffering for decoding start up; 4) continuous buffer management; 5) time identification; 6) multiplexing and signalling of various components in a system stream. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream is either a transport stream or a program stream. Both streams are constructed from PES packets and packets containing other necessary information. Both stream types support multiplexing of video and audio compressed streams from one program with a common time base. The transport stream additionally supports the multiplexing of video and audio compressed streams from multiple programs with independenttime bases. For almost error-free environments the program stream is generally more appropriate, supporting software processing of program information. The transport stream is more suitable for use in environments where errors are likely. A Rec. ITU-T H.222.0 | ISO/IEC 13818-1 multiplexed bit stream, whether a transport stream or a program stream, is constructed in two layers: the outermost layer is the system layer, and the innermost is the compression layer. The system layer provides the functions necessary for using one or more compressed data streams in a system. The video and audio parts of this Specification define the compression coding layer for audio and video data. Coding of other types of data is not defined by this Specification, but is supported by the system layer provided that the other types of data adhere to the constraints defined in 2.7.

This document specifies four data formats: User Description (UD), Context Description (CD), Service Description (SD), and Recommendation Description (RD). This document also specifies technologies related to consecutive vibration.

This document specifies the format of the event message track.

This document specifies carriage of coded media representations which comply with visual volumetric video-based coding and video-based point cloud compression (specified in ISO/IEC 23090-5).

This document specifies the format of the Session-Based Description document and the MPD's extension to be used in session-based operations with MPEG DASH (ISO/IEC 23009-1).

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.

This document defines a storage format for derived visual tracks and an initial base set of related transformation operations. The format defined in this document enables the interchange, editing, and display of timed sequences of images that result from transformation operations applied to input still images or samples of timed sequences of images in the same presentation. This format defines normative structures used to contain the description of transformation operations, how to link that transformation operations to the inputs, and defines how to process those transformation operations to obtain a timed sequence of video frames.

This document specifies the conformance and reference software for omnidirectional media format (specified in ISO/IEC 23090‑2). This document describes the reference software modules and the features that is supports. It also provides a description of how the reference software can be utilized. In addition, the document lists and describes test vectors comprising ISO base media file format files, media presentation descriptions, segments and combinations thereof that conform to ISO/IEC 23090‑2.

This document specifies immersive media metrics and the measurement framework. The immersive media metrics can be collected by service providers and used to enhance the immersive media quality and experiences. This document also includes a client reference model with observation and measurement points for collection of the metrics.

This document describes the reference software and conformance suite for the file format documents in MPEG-4 and MPEG-H. Since these documents share a lot of technology, their reference software and conformance program are being handled together. These documents are: ISO/IEC 14496-12, ISO/IEC 14496-14, ISO/IEC 14496-15, ISO/IEC 14496-30 and ISO/IEC 23008-12. The purpose of the conformance suite is to cover the set of valid features that can be exercised in the file format. Media conformance is not covered, though of course in order to exercise the file format features, media will be stored.

The network-based media processing (NBMP) framework defines the interfaces including both data formats and application programming interfaces (APIs) among the entities connected through digital networks for media processing. Users can access and configure their operations remotely for efficient, intelligent processing. This document describes and manages workflows to be applied to the media data. This process includes uploading of media data to the network, instantiation of the media processing tasks, and configuration of the tasks. The framework enables dynamic creation of media processing pipelines, as well as access to processed media data and metadata in real-time or in a deferred way. The media and metadata formats used between the media source, workflow manager and media processing entities in a media processing pipeline are also specified.

This document provides guidance for implementing and deploying systems based on ISO/IEC 23008‑1.

This document specifies the conformance and reference software implementing the test vectors comprising media presentation descriptions, segments and combinations thereof in ISO/IEC 23009‑1, and the corresponding software modules.

ISO/IEC 23008-11:2015 specifies MPEG Composition Information (CI), a method describing composition information of media for delivery of multimedia services over packet-based heterogeneous networks. The technologies for composition function specify the method associating content delivered in the format defined in this part of ISO/IEC 23008 to the presentation and the method representing synchronization between timed and non-timed content.

This document specifies the ISO base media file format, which is a general format forming the basis for a number of other more specific file formats. This format contains the timing, structure, and media information for timed sequences of media data, such as audio-visual presentations.