INTERNATIONAL ORGANISATION FOR STANDARDISATION
ORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 29/WG 11
CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11 N16403
Chengdu, CN – October 2016
Source: / Leonardo ChiariglioneTitle: / MPEG work plan
Purpose: / Work plan management
MPEG work plan
1 Video coding 1
1.1 Video Coding Independent Code Points 1
1.1.1 Additional code points for colour description 1
1.2 Advanced Video Coding 1
1.3 Video Coding for Browsers 1
1.4 Internet Video Coding 1
1.4.1 HEVC 1
1.4.2 Green Metadata for HEVC SEI message 1
1.4.3 HEVC Progressive High 10 Profile 1
1.4.4 HEVC Additional colour description indicators 1
1.4.5 Picture Repetition Indication in HEVC 1
1.4.6 Conversion and coding practices for HDR/WCG video 1
1.5 New Video Coding 1
1.6 360ᵒ 2D Video Coding 1
1.7 360ᵒ 3D Video Coding 1
1.8 Free Viewpoint Television 1
1.9 Light Field Coding 1
2 Audio coding 1
2.1 Audio Coding Independent Code Point 1
2.2 Advanced Audio Coding 1
2.2.1 Levels and Downmixing Method for 22.2 Channel Programs 1
2.3 MPEG Surround 1
2.4 Spatial Audio Object Coding 1
2.5 Unified Speech and Audio Coding 1
2.6 Dynamic Range Control 1
2.6.1 Support for MPEG-D DRC 1
2.6.2 Parametric DRC, Gain Mapping and Equalization Tools 1
2.7 MPEG-H 3D Audio 1
2.7.1 3D Audio Profiles 1
2.7.2 Carriage of systems metadata in MPEG-H 3D Audio 1
2.8 Audio Coding for AR/VR 1
2.9 Audio Wave Field Coding 1
3 3D Graphics 1
3.1 Animation Framework eXtension 1
3.1.1 Metadata for Realistic Material Representation 1
3.2 3D graphics coding for browsers 1
3.3 Point Cloud Coding 1
4 Font Coding 1
4.1 Font Collection Items 1
4.2 Updated text layout features and implementations 1
5 Digital Items 1
5.1 Media Value Chain Ontology 1
5.1.1 MVCO Extensions on Time Segments and Multi-Track Audio 1
5.2 User Description 1
6 Media context and control 1
6.1 Media Context and Control – Control Information 1
6.2 Media Context and Control – Sensory Information 1
6.3 Media Context and Control – Virtual World Object Characteristics 1
6.4 Media Context and Control – Data Formats for Interaction Devices 1
6.5 Media Context and Control – Common Types and Tools 1
7 Media Composition 1
7.1 Composition Information 1
8 Genomic Information Representation 1
9 Media Description 1
9.1 MPEG-7 Visual 1
9.2 Compact Descriptors for Visual Search 1
9.3 Compact Descriptors for Video Analysis 1
10 Systems support 1
10.1 Reconfigurable Media Coding 1
10.1.1 FU and FN extensions for Parser Instantiation 1
10.1.2 FU and FN extensions for SHVC and Main10 Profiles of SHVC 1
10.1.3 Tools for Reconfigurable Media Coding Implementations 1
10.2 IPMP 1
10.3 Media orchestration 1
11 Transport 1
11.1 MPEG-2 Transport Stream 1
11.1.1 Carriage of MPEG-H 3D audio over MPEG-2 Systems 1
11.1.2 Carriage of Quality Metadata in MPEG-2 Systems 1
11.1.3 Virtual segments in MPEG-2 Systems 1
11.1.4 Signaling of carriage of HDR/WCG video in MPEG-2 Systems 1
11.1.5 Ultra-Low-Latency mode and higher resolution support for transport of JPEG 2000 video 1
11.2 ISO Base Media File Format 1
11.2.1 DRC file format extensions 1
11.2.2 Support for Image File Format 1
11.2.3 Partial File Storage 1
11.2.4 Support for CTA 708 captioning in SEI message 1
11.2.5 Carriage of ROI coordinates 1
11.3 Carriage of NAL unit structured video in ISO BMFF 1
11.3.1 Enhanced carriage of HEVC 1
11.3.2 Layered coding of images 1
11.3.3 Decode Time Hints 1
11.4 MMT 1
11.4.1 Use of MMT Data in MPEG-H 3D Audio 1
11.4.2 MMT Enhancements for Mobile Environments 1
11.4.3 MMT Implementation Guidelines 1
11.4.4 Image file format 1
11.5 DASH 1
11.5.1 Authentication, Access Control and Multiple MPDs 1
11.5.2 Segment Independent SAP Signalling, MPD chaining and other extensions 1
11.5.3 MPEG-DASH Implementation Guidelines 1
11.5.4 Server and Network Assisted DASH 1
11.5.5 DASH with Server Push and WebSockets 1
12 Application Formats 1
12.1 Multisensorial Effects Application Format 1
12.2 Omnidirectional Media Application Format 1
12.3 Common Media Application Format 1
12.4 Visual Identity Privacy Management Application Format 1
13 Media Systems 1
13.1 MPEG-V Architecture 1
13.2 MPEG-M Architecture 1
13.3 Mixed and Augmented Reality Reference Model 1
13.4 Virtual Reality 1
13.4.1 Technical Report on Immersive Media 1
13.4.2 System viewpoint 360º Audiovisual Media with 3 degrees of freedom 1
13.4.3 Visual for Navigable Media with 6 degrees of freedom 1
13.4.4 Audio for Navigable Media with 6 degrees of freedom 1
13.4.5 Immersive Media Graphics – Point Cloud Compression 1
13.5 Media-centric Internet of Things and Wearables 1
13.6 Big Media Data 1
14 Reference implementation 1
14.1 Video 1
14.1.1 Reference Software for MVC plus depth extension of AVC 1
14.1.2 Reference Software for 3D extension of AVC 1
14.2 Reference Software for Video Coding for Browsers 1
14.3 Reference Software for Internet Video Coding 1
14.4 Reference Software for Alternative Depth Information SEI Message 1
14.5 Reference Software for HEVC 1
14.6 Reference Software for HEVC RExt 1
14.7 Reference Software for MV-HEVC 1
14.8 Reference Software for SHVC 1
14.9 Reference Software for 3D-HEVC 1
14.10 Audio 1
14.10.1 Reference Software for MPEG-4 Audio Synchronization 1
14.11 Reference Software for Support for Dynamic Range Control, New Levels for ALS Simple Profile, and Audio Synchronization 1
14.12 Reference Software for MPEG Surround Extensions for 3D Audio 1
14.13 Reference Software for SAOC and SAOC Dialogue 1
14.14 Reference Software for DRC 1
14.15 Reference Software for 3D Audio 1
14.16 3D Graphics 1
14.16.1 Reference Software for Pattern based 3D mesh compression 1
14.17 Reference Software for Graphics coding for browsers and 3D printing material 1
14.18 Digital Items 1
14.18.1 Reference Software for CEL and MCO 1
14.18.2 Reference Software and Implementation Guidelines of User Description 1
14.19 Media context and control 1
14.19.1 Reference Software for MPEG-V 1
14.20 Media Description 1
14.20.1 Reference Software for MPEG-7 Visual 1
14.20.2 Reference Software for CDVS 1
14.21 Systems support 1
14.21.1 Reference Software for Media Tool Library 1
14.22 Transport 1
14.22.1 Reference Software for File Format 1
14.22.2 Reference Software for Carriage of Green Metadata in an HEVC SEI Message 1
14.22.3 Reference Software for MMT 1
14.22.4 Reference Software for MMT with Network Capabilities 1
14.22.5 Reference Software for MPEG-DASH 1
14.23 Application Formats 1
14.23.1 Reference Software for ARAF 1
15 Conformance 1
15.1 Video 1
15.1.1 Conformance for Multi-resolution Frame Compatible Stereo Coding extension of AVC 1
15.1.2 Conformance for 3D-AVC 1
15.1.3 Conformance for Video Coding for Browsers 1
15.1.4 Conformance for MFC+Depth Extension of AVC 1
15.1.5 Conformance for Internet Video Coding 1
15.2 Conformance for HEVC 1
15.3 Audio 1
15.3.1 Conformance for New levels for AAC profiles and uniDRC support 1
15.4 Additional Conformance for Multichannel 1
15.4.1 Reference Software for MPEG Surround Extensions for 3D Audio 1
15.4.2 Conformance for SAOC and SAOC Dialogue Enhancement 1
15.4.3 Conformance for DRC 1
15.4.4 Conformance for 3D Audio 1
15.5 3D Graphics 1
15.5.1 Conformance for 3D graphics coding for browsers and 3D printing material 1
15.6 Conformance for Pattern based 3D mesh compression 1
15.6.1 Digital Items 1
15.6.2 Conformance for CEL and MCO 1
15.7 Media context and control 1
15.7.1 Conformance for MPEG-V 1
15.8 Media description 1
15.8.1 Conformance for CDVS 1
15.9 System support 1
15.9.1 Conformance for Green Metadata 1
15.9.2 Conformance for Media Tool Library 1
15.10 Transport 1
15.10.1 Conformance for File Format 1
15.10.2 Conformance for Carriage of Green Metadata in an HEVC SEI Message 1
15.11 Conformance for MMT 1
15.12 Application Formats 1
15.12.1 Conformance for ARAF 1
16 Maintenance 1
16.1 Systems coding standards 1
16.2 Video coding standards 1
16.3 Audio coding standards 1
16.4 3DG coding standards 1
16.5 Systems description coding standards 1
16.6 Visual description coding standards 1
16.7 Audio description coding standards 1
16.8 MPEG-21 standards 1
16.9 MPEG-A standards 1
1 Video coding
1.1 Video Coding Independent Code Points
Std / Pt / E/A/T / Req / Short description? / 1 / ? / ? / Currently expressed within ISO/IEC 23001-8, there is a growing set of coding-independent code points for indicating properties of video content such as colour type identifiers, aspect ratio, and frame packing types. The current approach of specifying these within a single specification that includes other types of code points, such as those for audio layouts, has become difficult to maintain, so there is a plan to move the video code points to a separate Specification text.
1.1.1 Additional code points for colour description
Std / Pt / E/A/T / Req / Short description? / 1 / ? / ? / This part of ISO/IEC 23001 specifies defines various code-points and fields which document aspects that are bit-rate and compression independent, of a video stream. They describe the characteristics of the signal before the signal is actually compressed by any encoder that is suitable for compressing such an input signal, or after decompressing the signal.
1.2 Advanced Video Coding
1.3 Video Coding for Browsers
Std / Pt / E/A/T / Req / Short description4 / 31 / E1 / Video coding standard based on technology intended to fall under Type-1 licensing. The standard is suitable to facilitate real time Web video conferencing as well as video content consumption through Web browsers. Its compression quality for relevant application cases is similar or beyond AVC constrained baseline profile.
Currently suspended waiting for resolution of a Type 3 patent declaration
1.4 Internet Video Coding
Std / Pt / E/A/T / Req / Short description4 / 33 / E1 / Internet Video Coding (IVC) aims to develop a Type 1 video coding standard with a performance as good as possible under the given constraints.
1.4.1 HEVC
1.4.2 Green Metadata for HEVC SEI message
Std / Pt / E/A/T / Req / Short descriptionB / 11 / A1 / 15210 / To define methods to carry green metadata by using HEVC SEI messages Codepoint for SEI message supporting energy-efficient media consumption (Green Metadata)
1.4.3 HEVC Progressive High 10 Profile
Std / Pt / E/A/T / Req / Short description4 / 10 / A4 / 16032 / This amendment of ISO/IEC 14496-10 will introduce an additional profile for applications that use 10 bit 4:2:0 progressive-scan video content (Progressive High 10). It will also specify additional VUI code points for video colour interpretation and an SEI message for transfer characteristics.
1.4.4 HEVC Additional colour description indicators
Std / Pt / E/A/T / Req / Short descriptionH / 2 / A1 / Specification of additional Video Usability Information (VUI) code points for video colour interpretation, in particular the ICtCp colour space.
1.4.5 Picture Repetition Indication in HEVC
Std / Pt / E/A/T / Req / Short descriptionH / 2 / ? / HEVC contains a method of representing picture repetition periods for display of video content with a fixed display frame rate. This potential amendment could add longer repetition periods in addition to those that can already be expressed in HEVC syntax.
1.4.6 Conversion and coding practices for HDR/WCG video
Std / Pt / E/A/T / Req / Short descriptionH / 14 / T1 / This technical report will describe methods that can be applied to use HEVC Main 10 profile for providing good quality of high dynamic range and wide colour gamut video content. This includes encoder optimization, bitstream signaling, as well as pre and post processing that should be applied in this context.
1.5 New Video Coding
Std / Pt / E/A/T / Req / Short description? / ? / ? / Investigation on the benefit of video coding technology which could improve the compression performance or give new functionality, as compared to HEVC. Further, test cases and evaluation methodologies for assessment of such benefits are investigated.
1.6 360ᵒ 2D Video Coding
Std / Pt / E/A/T / Req / Short description? / ? / ?
1.7 360ᵒ 3D Video Coding
Std / Pt / E/A/T / Req / Short description? / ? / ?
1.8 Free Viewpoint Television
Std / Pt / E/A/T / Req / Short description? / ? / ? / After developing various aspects of 3D video standardization since 2001 (MVC: efficient coding of multiple camera views; 3DV: viewing and display adaptation of multiview displays), MPEG is currently investigating new coding techniques for emerging super multiview 3D displays that anticipate the next generation of auto-stereoscopic display, providing ultra-realistic 3D visualization and navigation at acceptable cost. The main issue is synthesis from a lower number of input camera views (for cost reasons) and real time rendering of a large number of multi-view images on super multiview 3D displays.
1.9 Light Field Coding
Std / Pt / E/A/T / Req / Short description? / ? / ? / Light field cameras, introduced in 2010, have been introduced as a new technology that has the potential to dramatically increase the sense of immersion that can be achieved by images and video captured by cameras, and arrays of cameras focused on a particular scene.
The technology and associated applications have been deployed with interest steadily increasing across all of the constituents in the content capture, production, and distribution ecosystem, display manufacturers, and service providers.
A key issue with the technology is the incredibly large amount of data necessary to achieve the desired sense of immersion, without unwelcome impacts on the user (i.e. motion sickness, viewer fatigue, and eye strain).
In this exploration we study existing devices, applications, and use cases for light fields and light field applications with the goal to develop new technologies that can be used to compress light field data.
2 Audio coding
2.1 Audio Coding Independent Code Point
Std / Pt / E/A/T / Req / Short description? / 2 / ? / ? / This part of ISO/IEC 23001 defines various code-points and fields which document aspects that are bit-rate and compression independent, of an audio stream. They describe the characteristics of the signal before the signal is actually compressed by any encoder that is suitable for compressing such an input signal, or after decompressing the signal.
2.2 Advanced Audio Coding
2.2.1 Levels and Downmixing Method for 22.2 Channel Programs
Std / Pt / E/A/T / Req / Short description4 / 3 / A6 / 15827 / To signal and carry Dynamic Range Control data in MPEG-4 Audio elementary streams. This enables the Dynamic Range Control to be used with e.g. the AAC family of codecs.
2.3 MPEG Surround