The Video Electronics Standards Association (VESA) announced today that it has made one of the largest sources of high resolution, high dynamic range (HDR) image and video content available to the public without restriction. Over 28,000 files (over 500 gigabytes) of uncompressed HDR image and video content are now available for free download from the VESA website. The content comes from a multi-year, multi-phase research contract that VESA initiated with York University (Toronto, Canada) led by Professors Robert Allison and Laurie Wilcox. The research included validating and improving the visually lossless performance of the Display Stream Compression (DSC) and VESA Display Compression-M (VDC-M) video compression codecs for stereoscopic 3D use cases, including reality. augmented / virtual / extended (AR / VR / XR).
Although the potential applications of the published material are almost limitless, university students, faculty, and researchers can leverage the content for visual science research projects, while companies can use the material to experiment or develop the technology and AR / VR / XR display devices. Video and image files as well as instructions for downloading them are available at: https://vesa.org/vesa-display-compression-codecs/#tab-video-and-image-files-download.
“Until now, very little high-resolution 3D HDR content in uncompressed format has been available to the public or the research community,” said Professor Allison, director of the Center for Vision Research at York University. “We believe that these images and image sequences will be useful for those working with image compression, image quality and other applications. VESA’s decision to make this content publicly available after commissioning York University to test and validate its own compression standards reflects its commitment and leadership in the development of future display standards, and will benefit researchers. in vision and to companies developing stereoscopic 3D products.
Video compression has become increasingly popular as it helps improve the performance of consumer display products by addressing the bandwidth and power limitations associated with streaming video content at higher resolutions (4K and above). beyond), higher refresh rates and higher image quality. However, for the compression to be acceptable to the consumer, it must be visually lossless, which means it must be indistinguishable from uncompressed video. In recent years, VESA has supported research into visually lossless performance evaluation of video compression, which has played an important role in the development and refinement of VESA’s DSC and VDC-M standards.
“Over the past few years, VESA’s display compression standards have helped hardware developers deliver a high-quality viewing experience and add new features to monitors and televisions,” said Greg Stewart, director of system architecture at Analogix Semiconductor and chairman of the AR / VR Working Group at VESA. “This recent work between VESA and York University has further refined the VESA codecs. It is now possible to use these compression standards for the most demanding AR, VR, and XR display applications without creating visible artifacts. These test images and videos were an essential part of this work and enabled VESA member companies to perform their own tests and validate their own products. With these test images and videos now made public, it should benefit the entire display industry and ultimately the end user experience.
The first two phases of the York University research project, which ended in November 2019, focused on the subjective validation of the compression performance of stereoscopic 3D images targeting AR display headset use cases. / VR / XR (HMD). Areas of study included the extent to which compression artifacts, such as flicker, that are visible in a 2D image would still be visible in a stereoscopic 3D image.
The third phase of the project, completed in March 2020, extended this research by examining the impact of bypassing color transformation for images that have undergone chromatic aberration pre-correction. In stereoscopic HMDs, powerful lenses placed in front of the screens can cause significant image distortion. The traditional way to deal with this image distortion is to pre-distort the image so that the image is perfect after lens distortion. However, this pre-distortion can disturb the spatial correlation of the red, green and blue pixels of the screens, and thus have an impact on the compression performance and the overall quality of the display. The third phase of York University research examined whether adjusting color processing in codecs by turning off color transformation could improve the performance of DSC and VDC-M for these use cases. The research also examined how well VESA’s video compression codecs performed in dealing with chromatic aberrations in 3D imaging in general.
The results of the York University research project indicated that the DSC and VDC-M performed very well when tested in all three phases. Research has also led to improvements in codecs to further improve their performance. A fourth phase of the research project is currently underway to evaluate the performance of compression codecs for motion sequences, including camera tracking of stationary objects and the rotation and movement of objects.
According to Bill Lempesis, Executive Director of VESA, “York University is a world-class institution dedicated to research training in the visual sciences and its applications. This multi-year research study that VESA commissioned with them is an important undertaking in meeting the industry’s need for solutions to overcome the increasing demands for bandwidth and power from mobile AR and VR devices. Through rigorous testing, this research has enabled us to verify the visually lossless performance of our DSC and VDC-M compression codecs – giving product developers and researchers confidence that adoption of VESA compression standards is theirs. will give high quality results for their head-mounted display products. . “