Tweet
Last October, MPEG/ITU's Joint Video Experts Team (JVET) issued a call for proposals for video coding technology with compression capability to exceed HEVC. Fraunhofer HHI has responded to the call by submitting cutting edge coding technology. The new standard is planned to be finalized by 2020. At NAB 2018, Fraunhofer HHI will display its codec to the public for the first time. Fraunhofer says it will show significant coding efficiency improvements over HEVC are shown for content ranging from standard High Definition (HD) to High Dynamic Range Ultra-HD content.
The German research institute will show continuous live video streaming of high-resolution 360-degree video for virtual reality (VR360). Fraunhofer presents the world’s first demonstrator for continuous live video streaming of VR360 videos with a resolution beyond 4K. This includes high-resolution VR360 10K video capturing and live rendering from the Fraunhofer HHI Omnicam-360, tile-based live encoding with the Fraunhofer HHI HEVC encoder, packaging according to the MPEG-OMAF Viewport-Dependent Media Profile and high-quality playback on VR glasses and TV screens.
The three parts of the demonstrator are:
Capturing: Fraunhofer HHI’s OmniCam-360 is a worldwide unique system for recording high-resolution VR360 video. Thanks to the real-time solution (RTSE) of Fraunhofer HHI, live events can be captured with a resolution up to 10K x 4K.
Encoding: The latest generation of Fraunhofer HHI‘s H.265/MPEG HEVC software encoding technology is integrating tile-based HEVC live encoding for distribution of VR360 content. Before encoding, the content from the Omnicam-360 is spatially segmented and the resulting tiles are independently encoded at different resolutions.
Streaming: The HEVC tile streams are packaged with the MPEG-OMAF standard using the Viewport-Dependent Media Profile. Using these tiles, the devices – VR glasses and TV screen – can assemble the required image, with optimal resolution. In the user‘s line of vision, the image is therefore of high definition and behind him, the resolution is low. MPEG-OMAF and HEVC tiles enable efficient delivery of live ultra-high-resolution VR360 video to fixed and mobile devices.
The German research institute will show continuous live video streaming of high-resolution 360-degree video for virtual reality (VR360). Fraunhofer presents the world’s first demonstrator for continuous live video streaming of VR360 videos with a resolution beyond 4K. This includes high-resolution VR360 10K video capturing and live rendering from the Fraunhofer HHI Omnicam-360, tile-based live encoding with the Fraunhofer HHI HEVC encoder, packaging according to the MPEG-OMAF Viewport-Dependent Media Profile and high-quality playback on VR glasses and TV screens.
The three parts of the demonstrator are:
Capturing: Fraunhofer HHI’s OmniCam-360 is a worldwide unique system for recording high-resolution VR360 video. Thanks to the real-time solution (RTSE) of Fraunhofer HHI, live events can be captured with a resolution up to 10K x 4K.
Encoding: The latest generation of Fraunhofer HHI‘s H.265/MPEG HEVC software encoding technology is integrating tile-based HEVC live encoding for distribution of VR360 content. Before encoding, the content from the Omnicam-360 is spatially segmented and the resulting tiles are independently encoded at different resolutions.
Streaming: The HEVC tile streams are packaged with the MPEG-OMAF standard using the Viewport-Dependent Media Profile. Using these tiles, the devices – VR glasses and TV screen – can assemble the required image, with optimal resolution. In the user‘s line of vision, the image is therefore of high definition and behind him, the resolution is low. MPEG-OMAF and HEVC tiles enable efficient delivery of live ultra-high-resolution VR360 video to fixed and mobile devices.