ISO/IEC JTC 1/SC 29/WG 1 - JPEG Coding of digital representations of images

This document specifies the framework, concepts, and methodology for securing JPEG 2000 codestreams. The scope of this document is to define: 1) a normative codestream syntax containing information for interpreting secure image data; 2) informative examples of JPSEC tools in typical use cases; 3) informative guidelines on how to implement security services and related metadata. The scope of this document is not to describe specific secure imaging applications or to limit secure imaging to specific techniques, but to create a framework that enables future extensions as secure imaging techniques evolve.

This document defines QuadBPT and TriBPT image components, collectively known as "breakpoint components", and specifies decoding and reconstruction procedures for recovering breakpoint component sample values from the codestream. This Recommendation | International Standard also specifies "breakpoint-dependent" spatial wavelet transforms that can be used in place of the transforms specified in Recommendation ITU-T T.800 | ISO/IEC 15444-1 for selected image components or tile-components. Extensions to the codestream syntax of Rec. ITU‑T T.800 | ISO/IEC 15444-1 are specified to enable the identification of breakpoint components, of components that can use a breakpoint-dependent spatial wavelet transform, and the association of breakpoint components with such breakpoint-dependent wavelet transforms.

This Document defines, in an extensible manner, syntaxes and methods for the remote interrogation and optional modification of JPEG 2000 codestreams and files in accordance with their definition in Rec. ITU-T T.800 | ISO/IEC 15444-1 and other members of the Rec. ITU-T T.8xx | ISO/IEC 15444-x family of Recommendations | Standards. In this document, the defined syntaxes and methods are referred to as the JPEG 2000 Interactive Protocol, "JPIP", and interactive applications using JPIP are referred to as "JPIP systems." JPIP specifies a protocol consisting of a structured series of interactions between a client and a server by means of which image file metadata, structure and partial or whole image codestreams can be exchanged in a manner that avoids or minimises the communication of information not required by client. This document includes definitions of the semantics and values to be exchanged, and suggests how these can be passed using a variety of existing network transports. With JPIP, the following tasks can be accomplished in varying, compatible ways: – the exchange of capabilities; – the negotiation of capabilities to use in a session; – the request and transfer of the following elements from a variety of containers, such as JPEG 2000 files, JPEG 2000 codestreams and other container files: • selective data segments; • selective and defined structures; • parts of an image or its related metadata.

This document specifies an image file format capable of linking multiple media elements, such as image and text in any box-based JPEG file format.

This document specifies the framework, concepts, methodology for testing, and criteria to be achieved to claim conformance to multiple parts of the ISO/IEC 21122 series. It lists the conformance testing procedures. This document specifies: — Conformance testing procedures for decoders implementing ISO/IEC 21122-1. — Tests to check which conformance point an ISO/IEC 21122-1 decoder conforms to, that is, whether a decoder satisfies the error bounds required for strict or relaxed conformance. — Conformance testing procedures for decoders implementing ISO/IEC 21122-3. — Tests to check codestreams for conformance to ISO/IEC 21122-1. As such, it provides means to test whether encoder implementations generate syntactically correct codestreams, and whether codestreams generated by such implementations follow the requirements of a particular profile, level and sublevel, and the buffer model implied by them. — Tests to check files for conformance to ISO/IEC 21122-3. — Conformance testing procedures that allow testing whether codestreams conform to any of the profiles specified in ISO/IEC 21122-2. — Conformance testing procedures that allow testing whether codestreams conform to the buffer model specified in ISO/IEC 21122-2 as part of a profile, level and sublevel. — Codestreams, decoded images, and error metrics to be used within the decoder testing procedures. — A buffer model test. — Abstract test suites. NOTE: This document does not specify: — Testing the reconstruction of a full resolution image from a subsampled image format. In particular, upsampling from 4:2:2 or 4:2:0 to 4:4:4 sampling is a non-normative extension and as such its testing is beyond the scope of this document. — Testing the conversion of the sample values reconstructed by an ISO/IEC 21122-3 decoder to the target colour space by means of the colour specification box of ISO/IEC 21122-3. — Testing of the composition of background and foreground for images reconstructed from ISO/IEC 21122-3 files or codestreams that contain auxiliary channels carrying opacity information. — Testing of the interpolation of a colour filter array image to a full scale colour image; this process is not normatively defined and beyond the scope of this document. — Acceptance testing: the process of determining whether an implementation satisfies acceptance criteria and enables the user to determine whether or not to accept the implementation. This includes the planning and execution of several kinds of tests (e.g. functionality, quality, and speed performance testing) that demonstrate that the implementation satisfies the user requirements. — Performance testing: measures the performance characteristics of an implementation under test (IUT) such as its throughput, responsiveness, etc. under various conditions. — Robustness testing: the process of determining how well an implementation is able to conceal problems from attempting to reconstruct an image from an ill-formed codestream.

This document specifies the conformance testing of the ISO/IEC 18181 series, also known as JPEG XL. Other desirable aspects of implementation (including robustness and performance) are outside the scope of this document.

This document contains the reference software of the ISO/IEC 21122 series. It acts as a guideline for implementation and as a reference for conformance testing.

This document provides reference implementations of ISO/IEC 18181-1 and ISO/IEC 18181-2. The software supports lossless and lossy compression of images and image sequences for a wide range of use cases such as (but not limited to) images with wide colour gamut and/or high dynamic range and responsive web images. This document includes source code and instructions for compilation and usage.

This document provides reference implementations of ISO/IEC 21794-1 and ISO/IEC 21794-2, also known as JPEG Pleno.

This document defines a set of compression methods for coding one or more images of bi-level, continuous-tone greyscale, or continuous-tone colour, or multichannel digital samples. This document: — specifies decoding processes for converting compressed image data to reconstructed image data; — specifies a codestream syntax containing information for interpreting the compressed image data; — provides guidance on encoding processes for converting source image data to compressed image data.

This document defines transport and container formats for JPEG XS codestreams as specified in ISO/IEC 21122-1. It defines file formats for working with still image and motion image sequence files on computer platforms and gives guidance on how to embed the codestream in transport streams, allowing internet-based communication. This document uses already existing specifications for file formats and extends them for the embedding of JPEG XS codestreams.

This document defines a number of subsets of the syntax specified in ISO/IEC 21122-1 as profiles. It also defines lower bounds on the throughput in the decoded domain via levels and the encoded domain via sublevels that a conforming decoder implementation shall support. Furthermore, it defines a buffer model to ensure interoperability between implementations in the presence of a latency constraint.

This document defines the syntax and an accompanying decompression process that is capable to represent continuous-tone grey-scale, or continuous-tone colour digital images without visual loss at moderate compression rates. Typical compression rates are between 2:1 and 6:1 but can also be higher depending on the nature of the image. In particular, the syntax and the decoding process specified in this document allow lightweight encoder and decoder implementations that limit the end-to-end latency to a fraction of the frame size. However, the definition of transmission channel buffer models necessary to ensure such latency is beyond the scope of this document. This document: — specifies decoding processes for converting compressed image data to reconstructed image data; — specifies a codestream syntax containing information for interpreting the compressed image data; — provides guidance on encoding processes for converting source image data to compressed image data.

This document provides the conformance testing of the ISO/IEC 21794 series, also known as JPEG Pleno.

This Recommendation | International Standard specifies the framework, concepts, methodology for testing, and criteria to be achieved to claim compliance to Rec. ITU-T T.800 | ISO/IEC 15444-1 or Rec. ITU-T T.814 | ISO/IEC 15444-15. It provides a framework for specifying abstract test suites (ATSs) and for defining the procedures to be followed during compliance testing. This Recommendation | International Standard: ‒ specifies compliance testing procedures for encoding and decoding using Rec. ITU-T T.800 | ISO/IEC 15444-1 and Rec. ITU-T T.814 | ISO/IEC 15444-15; ‒ specifies codestreams, decoded images, and error metrics to be used with the testing procedures; ‒ specifies ATSs; ‒ provides guidance for creating an encoder compliance test This Recommendation | International Standard does not include the following tests: Acceptance testing: the process of determining whether an implementation satisfies acceptance criteria and enables the user to determine whether or not to accept the implementation. This includes the planning and execution of several kinds of tests (e.g., functionality, quality, and speed performance testing) that demonstrate that the implementation satisfies the user requirements. Performance testing: measures the performance characteristics of an implementation under test (IUT) such as its throughput and responsiveness, under various conditions. Robustness testing: the process of determining how well an implementation processes data which contains errors.

Rec. ITU-T T.800 | ISO/IEC 15444-1 defines a set of lossless and lossy compression methods for coding continuous-tone, bi-level, greyscale or colour digital still images. This Recommendation | International Standard provides three independently created software reference implementations of Rec. ITU-T T.800 | ISO/IEC 15444-1, in order to assist implementers of Rec. ITU-T T.800 | ISO/IEC 15444-1 in testing and understanding its content. The packages are JASPER, JJ2000 and OPENJPEG. This Recommendation | International Standard also provides an independently created software reference implementation of Rec. ITU-T T.814 | ISO/IEC 15444-15, which specifies a high-throughput (HT) block coding algorithm that can be used in place of the block coding algorithm of Rec. ITU-T T.800 | ISO/IEC 15444-1, in order to assist implementers of Rec. ITU-T T.814 | ISO/IEC 15444-15 in testing and understanding its content. The package is TT. This Recommendation | International Standard additionally provides an independently created software reference implementation for parsing of a JP2 file format specified in Rec. ITU-T T.800 | ISO/IEC 15444-1 and a JPH file format specified in Rec. ITU-T T.814 | ISO/IEC 15444-15, The package is Codestream-parser. This Recommendation | International Standard does not define any additional part of the JPEG 2000 image coding system. Each version of the J2K reference software contains source code, which can be compiled to provide the following functionality: – Transcoding from selected, widely available image formats into a JPEG 2000 codestream. – Transcoding from selected, widely available image formats into the JP2 file format. – Selection of a wide range of JPEG 2000 encoding options (as documented in each reference software). – Decoding from a JPEG 2000 codestream to a range of selected widely available image formats. – Processing of a JP2 file to extract a JPEG 2000 codestream for decoding and conversion to a range of selected widely available image formats. – The ability to extract metadata from a JP2 file, including the contents of the Image Header box and the colour space. – The decoding of JP2 files that use the three-component matrix-based form of the restricted ICC method for the specification of colour space and the conversion of the decoded image data to the sRGB colour space for display, including limited upsampling of all decoded components to the same resolution. – The decoding of JP2 files that use the monochrome form of the restricted ICC method for the specification of colour space and the conversion of the decoded image data to the sRGB based greyscale space as defined within the JP2 file format. – The decoding of JP2 files that use the sYCC colour space and the conversion of the decoded image data to the sRGB colour space for display, including upsampling of all decoded components to the same resolution. – Some additional tools to help with evaluation and testing. The TT HTJ2K reference software contains source code, which can be compiled to provide the following functionality: – Decoding from a HTJ2K codestream to a range of selected widely available image formats. The codestream-parser reference software contains source code, which can provide the following functionality: – Parsing of JP2 file format; – Parsing of JPH file format. The reference software is intended for use as a testing and validation tool for other implementations of JPEG 2000, and to help in the understanding of Rec. ITU-T T.800 | ISO/IEC 15444-1 and Rec. ITU-T T.814 | ISO/IEC 15444-15.

This document specifies the transport and container formats for JPEG XL codestreams as specified in ISO/IEC 18181-1. This document specifies how to add metadata and extensions to JPEG XL codestreams. A file as described by this document is called a JPEG XL file.

This document specifies the encapsulation of image formats specified in the JPEG 2000 family of Recommendations | International Standards in the framework defined in ISO/IEC 23008-12.

This document specifies a series of interfaces to allow disparate systems an interoperable management of image repositories. It also specifies the general rules which govern the usage of metadata in JPSearch and provides a specification which provides rules for the representation of image metadata descriptions, consisting of the definition of the JPSearch Core Metadata Schema, provides rules for the publication of machine-readable translations between metadata terms belonging to proprietary metadata schemas and metadata terms in the JPSearch Core Metadata Schema, and provides rules for the registration and request of metadata schemas and its translation rules or links to them. JPSearch is an extensible standard. The method of extending the structures and rules beyond the JPSearch Core Metadata Schema is provided in this document.

This document specifies a coded codestream format for storage of light field modalities as well as associated metadata descriptors that are light field modality specific. This document also provides information on the encoding tools.

This document specifies the plenoptic image coding system framework architecture and its instantiation via a generic file format for storage of plenoptic modalities as well as associated metadata descriptors.

This document specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content. This document defines extensions that allow lossless coding of such content while staying compatible with the core coding system specified in ISO/IEC 18477-1.

This document specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content. This document defines the core coding system, which forms the basis for the entire ISO/IEC 18477 series.

This document specifies a coding format, referred to as JPEG XR, which is designed primarily for continuous-tone photographic content.

This document specifies privacy and security features which contribute to a system layer for JPEG standards. It defines generic structures that can be applied in all JPEG box-based file formats. In particular, this document specifies a signalling syntax supporting privacy and security features. The framework in this document is backwards-compatible with existing JPEG standards.

This Recommendation | International Standard specifies an alternate block-coding algorithm that can be used in place of the block-coding algorithm specified in Rec. ITU-T T.800 | ISO/IEC 15444-1. This alternate block-coding algorithm offers a significant increase in throughput at the expense of slightly reduced coding efficiency, while a) allowing mathematically lossless transcoding to and from codestreams that use the block-coding algorithm specified in Rec. ITU‑T T.800 | ISO/IEC 15444-1, and b) preserving codestream syntax and features specified in Rec. ITU-T T.800 | ISO/IEC 15444-1. Recommendation ITU-T T.814 (2019) is a common text with ISO/IEC 15444-15:2019, both in their first edition.

This Recommendation | International Standard defines a set of lossless (bit-preserving) and lossy compression methods for coding bi-level, continuous-tone grey-scale, palletized colour, or continuous-tone colour digital still images. This Recommendation | International Standard: ? specifies decoding processes for converting compressed image data to reconstructed image data; ? specifies a codestream syntax containing information for interpreting the compressed image data; ? specifies a file format; ? provides guidance on encoding processes for converting source image data to compressed image data; ? provides guidance on how to implement these processes in practice. NOTE ? As this specification was first published as common text only after ISO/IEC JTC1 had approved the first edition in 2000, edition numbers in the ITU and ISO/IEC versions are offset by one. This is the third edition of ITU-T T.800 and the fourth edition of ISO/IEC 15444-1.

This document specifies omnidirectional/360-degree image and motion contents using Rec. ITU-T T.81 | ISO/IEC 10918‑1, Rec. ITU-T T.800 (11/2015) | ISO/IEC 15444‑1, and ISO/IEC 18477-3.

This Recommendation | International Standard defines methods for coding bi-level images and sets of images (documents consisting of multiple pages). It is particularly suitable for bi-level images consisting of text and dithered (halftone) data. The methods defined permit lossless (bit-preserving) coding, lossy coding, and progressive coding. In progressive coding, the first image is lossy; subsequent images may be lossy or lossless. This Recommendation | International Standard also defines file formats to enclose the coded bi-level image data.

ISO/IEC 18477-5:2018 provides reference implementations of multiple parts of the ISO/IEC 18477 series, also known under the name "JPEG XT". JPEG XT is designed primarily for compression of continuous-tone photographic content.

ISO/IEC 18477-4:2017 specifies the framework, concepts, methodology for testing, and criteria to be achieved to claim conformance to one or multiple parts of ISO/IEC 18477 as listed below. It provides a framework for specifying abstract test suites and for defining the procedures to be followed during conformance testing. ISO/IEC 18477-4:2017 - specifies conformance testing procedures for decoding of ISO/IEC 18477‑1, 18477-2, ISO/IEC 18477‑6, ISO/IEC 18477‑7, ISO/IEC 18477‑8 and ISO/IEC 18477‑9, - specifies conformance testing procedures for codestreams to the above International Standards, - specifies codestreams, decoded images, and error metrics to be used within the decoder testing procedures, and - specifies abstract test suites.

ISO/IEC TR 29170-1:2017 recommends best practices for coding system evaluation of images and image sequences. ISO/IEC TR 29170-1:2017 defines a common vocabulary of terms for coding system evaluation and divides evaluation methods into three broad categories: a) subjective assessment; b) objective assessment; c) computational assessment. In addition to these broad assessment categories, this document discusses special care that is given for coding unusual imagery, e.g. high dynamic range or high colour depth. A fourth assessment category, hardware complexity, is often important for real-time or computationally complex applications; however, it is outside the scope of this document.

ISO/IEC 18477-7:2017 specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content.

ISO/IEC TR 19566-2:2016 important information with the goal of elaborating a system layer for JPEG standards, referred to as JPEG systems. ISO/IEC TR 19566-2:2016 summarizes the principles of incremental codestream and file transport that are intended to form the future building blocks JPEG systems. Industrial implementations, future codecs and systems components are encouraged to follow these guidelines.

ISO/IEC 18477-9:2016 specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content.

ISO/IEC 18477-2:2016 specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content.

ISO/IEC TR 19566-1:2016 describes common elements of a system layer for JPEG standards, referred to as JPEG Systems. ISO/IEC TR 19566-1:2016 describes the common architecture of file formats and codestream formats used in JPEG standards. It is intended that all future Systems components support codestreams and file formats following these guidelines.

ISO/IEC 18477-6:2016 specifies a coding format, referred to as JPEG XT, which is designed primarily for continuous-tone photographic content.

ISO/IEC 29170-2:2015 normalizes evaluation and grading of a light coding system used for displays and display systems, but is independent of the display technology. This procedure measures whether an observer can distinguish between an uncompressed reference and the reconstructed image to a pre-determined, statistically meaningful level. The procedure compares individual images with two possible forced choice comparison test methods. This procedure relies on subjective evaluation methods designed to discern image imperfections on electronic colour displays of any technology or size.

This Recommendation | International Standard defines a normative but optional file format for storing compound images using the JPEG 2000 file format family architecture. This format is an extension of the JP2 file format defined in Rec. ITU-T T.800 | ISO/IEC 15444-1 Annex I and uses boxes defined for both the JP2 file format and the JPX file format defined in Rec. ITU-T T.801 | ISO/IEC 15444-2 Annex M. This Recommendation | International Standard is useful for applications storing multiple pages, images with mixed content, and/or images that need more structure than provided in JP2. Applications that implement this file format shall implement it as described in this Recommendation | International Standard. This Recommendation | International Standard: ? specifies a binary container for multiple bi-level and continuous-tone images used to represent a compound image; ? specifies a mechanism by which multiple images can be combined into a single compound image, based on the mixed raster content (MRC) model; ? specifies a mechanism for grouping multiple images in a hierarchy of layout objects, pages and page collections; ? specifies a mechanism for storing JPEG 2000 and other compressed image data formats; ? specifies a mechanism by which metadata can be included in files specified by this Recommendation | International Standard.

ISO/IEC 15444-14:2012 specifies an XML document, referred to as JPXML, which is designed primarily for representing JPEG 2000 file format and marker segments in codestream, and referring method of internal data in a JPEG 2000 image. It specifies - JPXML conversion rules for general box file formats, - JPXML conversion rules for JPEG 2000 family file formats and codestream segments, and - a complete referring location path to address to an exact box or codestream data in an image. And it provides - guidance on processes for converting a source image data to an XML structural document, and - guidance on how to implement these processes in practice.

ISO/IEC 10918-5:2013 specifies the JPEG File Interchange Format (JFIF).