arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jens-Rainer Ohm

77 papers · 1993–2022

1993: 11994: 01995: 01996: 11997: 31998: 01999: 22000: 02001: 22002: 12003: 62004: 22005: 22006: 32007: 42008: 22009: 12010: 52011: 42012: 42013: 52014: 32015: 22016: 52017: 52018: 22019: 32020: 22021: 52022: 2
1993peak 6 in 20032022

Frequent co-authors

Papers

showing 1–25 of 77 RSS

Overview of the High Efficiency Video Coding (HEVC) Standard

Gary J. Sullivan, Jens-Rainer Ohm, Woo-Jin Han +1 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 8,114× · DOI ↗ · more like this ·

High Efficiency Video Coding (HEVC) is currently being prepared as the newest video coding standard of the ITU-T Video Coding Experts Group and the ISO/IEC Moving Picture Experts Group. The main goal of the HEVC standardization effort is to enable significantly improved compression performance relative to existing standards-in the range of 50% bit-rate reduction for equal perceptual video quality. This paper provides an overview of the technical features and characteristics of the HEVC standard.

Overview of the Versatile Video Coding (VVC) Standard and its Applications

Benjamin Bross, Ye-Kui Wang, Yan Ye +4 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 1,641× · DOI ↗ · more like this ·

Versatile Video Coding (VVC) was finalized in July 2020 as the most recent international video coding standard. It was developed by the Joint Video Experts Team (JVET) of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) to serve an ever-growing need for improved video compression as well as to support a wider variety of today’s media content and emerging applications. This paper provides an overview of the novel technical features for new applications and the core compression technologies for achieving significant bit rate reductions in the neighborhood of 50% over its predecessor for equal video quality, the High Efficiency Video Coding (HEVC) standard, and 75% over the currently most-used format, the Advanced Video Coding (AVC) standard. It is explained how these new features in VVC provide greater versatility for applications.…

Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC)

Jens-Rainer Ohm, Gary J. Sullivan, Heiko Schwarz +2 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 1,256× · DOI ↗ · more like this ·

The compression capability of several generations of video coding standards is compared by means of peak signal-to-noise ratio (PSNR) and subjective testing results. A unified approach is applied to the analysis of designs, including H.262/MPEG-2 Video, H.263, MPEG-4 Visual, H.264/MPEG-4 Advanced Video Coding (AVC), and High Efficiency Video Coding (HEVC). The results of subjective tests for WVGA and HD sequences indicate that HEVC encoders can achieve equivalent subjective reproduction quality as encoders that conform to H.264/MPEG-4 AVC when using approximately 50% less bit rate on average. The HEVC design is shown to be especially effective for low bit rates, high-resolution video content, and low-delay communication applications. The measured subjective improvement somewhat exceeds the improvement measured by the PSNR metric.

Overview of the Multiview and 3D Extensions of High Efficiency Video Coding

Gerhard Tech, Ying Chen, Karsten Müller +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 421× · DOI ↗ · more like this ·

The High Efficiency Video Coding (HEVC) standard has recently been extended to support efficient representation of multiview video and depth-based 3D video formats. The multiview extension, MV-HEVC, allows efficient coding of multiple camera views and associated auxiliary pictures, and can be implemented by reusing single-layer decoders without changing the block-level processing modules since block-level syntax and decoding processes remain unchanged. Bit rate savings compared with HEVC simulcast are achieved by enabling the use of inter-view references in motion-compensated prediction. The more advanced 3D video extension, 3D-HEVC, targets a coded representation consisting of multiple views and associated depth maps, as required for generating additional intermediate views in advanced 3D displays. Additional bit rate reduction compared with MV-HEVC is achieved by specifying new…

Developments in International Video Coding Standardization After AVC, With an Overview of Versatile Video Coding (VVC)

Benjamin Bross, Jianle Chen, Jens-Rainer Ohm +2 more

Signal Processing · Proceedings of the IEEE · · cited 405× · DOI ↗ · more like this ·

In the last 17 years, since the finalization of the first version of the now-dominant H.264/Moving Picture Experts Group-4 (MPEG-4) Advanced Video Coding (AVC) standard in 2003, two major new generations of video coding standards have been developed. These include the standards known as High Efficiency Video Coding (HEVC) and Versatile Video Coding (VVC). HEVC was finalized in 2013, repeating the ten-year cycle time set by its predecessor and providing about 50% bit-rate reduction over AVC. The cycle was shortened by three years for the VVC project, which was finalized in July 2020, yet again achieving about a 50% bit-rate reduction over its predecessor (HEVC). This article summarizes these developments in video coding standardization after AVC. It especially focuses on providing an overview of the first version of VVC, including comparisons against HEVC. Besides further advances in…

Standardized Extensions of High Efficiency Video Coding (HEVC)

Gary J. Sullivan, Jill M. Boyce, Ying Chen +3 more

Signal Processing · IEEE Journal of Selected Topics in Signal Processing · · cited 368× · DOI ↗ · more like this ·

This paper describes extensions to the High Efficiency Video Coding (HEVC) standard that are active areas of current development in the relevant international standardization committees. While the first version of HEVC is sufficient to cover a wide range of applications, needs for enhancing the standard in several ways have been identified, including work on range extensions for color format and bit depth enhancement, embedded-bitstream scalability, and 3D video. The standardization of extensions in each of these areas will be completed in 2014, and further work is also planned. The design for these extensions represents the latest state of the art for video coding and its applications.

Video Quality Evaluation Methodology and Verification Testing of HEVC Compression Performance

Thiow Keng Tan, Rajitha Weerakkody, Marta Mrak +4 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 188× · DOI ↗ · more like this ·

The High Efficiency Video Coding (HEVC) standard (ITU-T H.265 and ISO/IEC 23008-2) has been developed with the main goal of providing significantly improved video compression compared with its predecessors. In order to evaluate this goal, verification tests were conducted by the Joint Collaborative Team on Video Coding of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29. This paper presents the subjective and objective results of a verification test in which the performance of the new standard is compared with its highly successful predecessor, the Advanced Video Coding (AVC) video compression standard (ITU-T H.264 and ISO/IEC 14496-10). The test used video sequences with resolutions ranging from 480p up to ultra-high definition, encoded at various quality levels using the HEVC Main profile and the AVC High profile. In order to provide a clear evaluation, this paper also discusses various…

Recent developments in standardization of high efficiency video coding (HEVC)

Gary J. Sullivan, Jens-Rainer Ohm

Signal Processing · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 144× · DOI ↗ · more like this ·

This paper reports on recent developments in video coding standardization, particularly focusing on the Call for Proposals (CfP) on video coding technology made jointly in January 2010 by ITU-T VCEG and ISO/IEC MPEG and the April 2010 responses to that Call. The new standardization initiative is referred to as High Efficiency Video Coding (HEVC) and its development has been undertaken by a new Joint Collaborative Team on Video Coding (JCT-VC) formed by the two organizations. The HEVC standard is intended to provide significantly better compression capability than the existing AVC (ITU-T H.264 | ISO/IEC MPEG-4 Part 10) standard. The results of the CfP are summarized, and the first steps towards the definition of the HEVC standard are described.

Special Section on the Joint Call for Proposals on High Efficiency Video Coding (HEVC) Standardization

Thomas Wiegand, Jens-Rainer Ohm, Gary J. Sullivan +4 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 94× · DOI ↗ · more like this ·

The five papers in this special section were among those submitted in response to the joint call for proposals on high efficiency video coding (HEVC) standardization. Although at this point of development it is still unclear which specific elements the final HEVC standard will contain, the selection of the papers was made such that together they would cover most of the promising tools and technologies that seem likely to be included in the standard.

The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC

Jianle Chen, Marta Karczewicz, Yu‐Wen Huang +3 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 64× · DOI ↗ · more like this ·

This paper provides an overview of the coding algorithms of the Joint Exploration Model (JEM) for video compression with capability beyond HEVC, which was developed by the Joint Video Exploration Team (JVET) of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). The goal of the JEM development and experimentation was to provide evidence that sufficient coding efficiency improvement over the High Efficiency Video Coding (HEVC) standard can be achieved, which would justify the need for a new video coding standard with a compression capability significantly exceeding that of HEVC. The development of the JEM provided an ability to conduct studies toward that goal in a verifiable and collaborative manner and led to the launching of the project to develop the new Versatile Video Coding (VVC) standard. Objective metric gains exceeding 30% were…

Rate-Complexity-Distortion Optimization for Hybrid Video Coding

Xiang Li, M Wien, Jens-Rainer Ohm

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 53× · DOI ↗ · more like this ·

In recent years, video applications on handheld devices became more and more popular. Due to limited computational capability and power supply in handheld devices, rate-complexity-distortion optimization (RCDO) algorithms at encoder side draw increasing attention. The target of RCDO is to obtain the best rate-distortion (R-D) performance under a constraint of complexity. Generally, there are three essential problems in RCDO. First, complexity needs to be properly mapped to a target in terms of coding parameters such that the control over complexity can be achieved. Second, the complexity budget should be efficiently distributed among frames or other coding units. Third, the allocated budget for each coding unit has to be effectively used to obtain good R-D performance. In this paper, these problems are well addressed. To obtain a large dynamic range in complexity control…

An object-based system for stereoscopic viewpoint synthesis

Jens-Rainer Ohm, E. Izquierdo M.

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 53× · DOI ↗ · more like this ·

This paper describes algorithms that were developed for a real-time stereoscopic videoconferencing systems with viewpoint adaptation. The goal is a real telepresence illusion, which is achieved by synthesis of intermediate views from a stereoscopic camera shot with a rather large baseline. The actual viewpoint will be adapted according to the head position of the viewer, such that the impression of motion parallax is produced. The object-based system first identifies foreground and background regions and applies disparity estimation to the foreground object. A hierarchical block matching algorithm is employed for this purpose which takes into account the position of high-activity feature points and the object/background border positions. Using the disparity estimator's output, it is possible to generate arbitrary intermediate views by projections from the left- and right-view images.…

General Video Coding Technology in Responses to the Joint Call for Proposals on Video Compression With Capability Beyond HEVC

Benjamin Bross, Kenneth Andersson, Max Bläser +8 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 48× · DOI ↗ · more like this ·

After the development of the High-Efficiency Video Coding Standard (HEVC), ITU-T VCEG and ISO/IEC MPEG formed the Joint Video Exploration Team (JVET), which started exploring video coding technology with higher coding efficiency, including development of a Joint Exploration Model (JEM) algorithm and a corresponding software implementation. The technology explored in the last version of the JEM further increases the compression capabilities of the hybrid video coding approach by adding new tools, reaching up to 30% bit rate reduction compared to HEVC based on the Bjøntegaard delta bit rate (BD-rate) metric, and further improvement beyond that in terms of subjective visual quality. This provided enough evidence to issue a joint Call for Proposals (CfP) for a new standardization activity now known as Versatile Video Coding (VVC). All technology proposed in the responses to the CfP was…

Models for Static and Dynamic Texture Synthesis in Image and Video Compression

Johannes Ballé, Aleksandar Stojanović, Jens-Rainer Ohm

Computer Vision and Pattern Recognition · IEEE Journal of Selected Topics in Signal Processing · · cited 44× · DOI ↗ · more like this ·

In this paper, we investigate the use of linear, parametric models of static and dynamic texture in the context of conventional transform coding of images and video. We propose a hybrid approach incorporating both conventional transform coding and texture-specific methods for improvement of coding efficiency. Regarding static (i.e., purely spatial) texture, we show that Gaussian Markov random fields (GMRFs) can be used for analysis/synthesis of a certain class of texture. The properties of this model allow us to derive optimal methods for classification, analysis, quantization and synthesis. For video containing dynamic textures, a linear dynamic model can be derived from frames encoded in a conventional fashion. We show that after removing effects from camera motion, this model can be used to synthesize further frames. Beyond that, we show that using synthesized frames in an…

<title>Stereo/multiview video encoding using the MPEG family of standards</title>

Jens-Rainer Ohm

Signal Processing · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 34× · DOI ↗ · more like this ·

Compression of stereoscopic and multiview video data is important, because the bandwidth necessary for storage and transmission linearly increase with the number of camera channels. This paper gives an overview about techniques that ISO's Moving Pictures Experts Group has defined in the MPEG- 2 and MPEG-4 standards, or that can be applied in the context of these standards. A good tradeoff between exploitation of spatial and temporal redundancies can be obtained by application of hybrid coding techniques, which combine motion-compensated prediction along the temporal axis, and 2D DCT transform coding within each image frame. The MPEG-2 multiview profile extends hybrid coding towards exploitation of inter-viewchannel redundancies by implicitly defining disparity-compensated prediction. The main feature of the new MPEG-4 multimedia standard with respect to video compression is the…

<title>Transition filtering and optimized quantization in interframe wavelet video coding</title>

Thomas Rusert, Konstantin Hanke, Jens-Rainer Ohm

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 31× · DOI ↗ · more like this ·

In interframe wavelet video coding, wavelet-based motion-compensated temporal filtering (MCTF) is combined with spatial wavelet decomposition, allowing for efficient spatio-temporal decorrelation and temporal, spatial and SNR scalability. Contemporary interframe wavelet video coding concepts employ block-based motion estimation (ME) and compensation (MC) to exploit temporal redundancy between successive frames. Due to occlusion effects and imperfect motion modeling, block-based MCTF may generate temporal high frequency subbands with block-wise varying coefficient statistics, and low frequency subbands with block edges. Both effects may cause declined spatial transform gain and blocking artifacts. As a modification to MCTF, we present spatial highpass transition filtering (SHTF) and spatial lowpass transition filtering (SLTF), introducing smooth transitions between motion blocks in the…

Dynamic texture synthesis for H.264/AVC inter coding

Aleksandar Stojanović, M Wien, Jens-Rainer Ohm

Signal Processing · RWTH Publications (RWTH Aachen) · · cited 21× · DOI ↗ · more like this ·

Dynamic textures are sequences of frames exhibiting certain stationarity properties over time; examples are sea-waves, whirlwind or moving crowds. We present an algorithm for dynamic texture extrapolation using only few training frames. A dynamic texture synthesizer using this algorithm has been integrated into a state-of-the-art H.264/AVC coding system, such that synthesized frames can be used by the encoder and decoder for inter prediction. For sequences not containing dynamic textures the same performance as with the conventional encoding system was achieved. In the case of sequences containing dynamic textures, intra coded macroblocks can be avoided by using the synthesized frame. Bitrate savings of up to 10% have been observed experimentally.

Deep Hashing with Hash Center Update for Efficient Image Retrieval

Abin Jose, Daniel Filbert, Christian Rohlfing +1 more

eess.IV · · cited 20× · arXiv ↗ · more like this ·

In this paper, we propose an approach for learning binary hash codes for image retrieval. Canonical Correlation Analysis (CCA) is used to design two loss functions for training a neural network such that the correlation between the two views to CCA is maximized. The first loss, maximizes the correlation between the hash centers and learned hash codes. The second loss maximizes the correlation between the class labels and classification scores. A novel weighted mean and thresholding based hash center update scheme is proposed for adapting the hash centers in each epoch. The training loss reaches the theoretical lower bound of the proposed loss functions, showing that the correlation coefficients are maximized during training and substantiating the formation of an efficient feature space for image retrieval. The measured mean average precision shows that the proposed approach outperforms…

Rate-complexity-distortion evaluation for hybrid video coding

Xiang Li, M Wien, Jens-Rainer Ohm

Signal Processing · RWTH Publications (RWTH Aachen) · · cited 19× · DOI ↗ · more like this ·

To objectively evaluate the coding efficiency of video codecs, Bj⊘ntegaard Delta PSNR (BD-PSNR) was proposed. Based on the rate-distortion (R-D) curve fitting, BD-PSNR is able to provide a good evaluation of the R-D performance. However, BD-PSNR has a critical drawback: It doesn't take the coding complexity into account. Clearly for practical video applications, especially for those on handheld devices, coding complexity has to be considered when evaluating the overall coding performance. Therefore in this paper, a new coding efficiency measurement is developed by generalizing BD-PSNR from R-D curve fitting to rate-complexity-distortion (R-C-D) surface fitting. Simulations show that a comprehensive performance evaluation can easily be obtained with the proposed method. Moreover, the idea can be used for rate-distortion optimization for complexity-constrained video coding.

Introduction to the Special Issue on HEVC Extensions and Efficient HEVC Implementations

Jens-Rainer Ohm, Gary J. Sullivan, Vivienne Sze +2 more

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 16× · DOI ↗ · more like this ·

High Efficiency Video Coding (HEVC) is the most recent standard in the series of major video coding standards jointly produced by the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). HEVC was first approved in 2013 in the ITU-T as Recommendation H.265 and in ISO/IEC as International Standard 23008-2, and it offers an unprecedented degree of compression capability for a very wide variety of applications. In the three years since its initial completion, it has been extended in several important ways to further broaden its scope. This special issue on HEVC features two sections: 1) HEVC extensions and 2) efficient HEVC implementations.

Verification testing of HEVC compression performance for UHD video

Rajitha Weerakkody, Marta Mrak, Vittorio Baroncini +3 more

Signal Processing · · cited 15× · DOI ↗ · more like this ·

This paper presents results and analysis of a compression performance test carried out within standardization activities for the HEVC standard (ITU-T H.265 and ISO/IEC 23008-2) with the focus on UHD video content. The analysis is based on subjective tests, and the performance of the new standard is compared with its predecessor AVC (ITU-T H.264 and ISO/IEC 14496-2). The Degradation Category Rating test methodology was used in a controlled laboratory environment. The test showed that a bit rate savings of more than 50 % can be achieved by HEVC for the same perceived video quality (with the tested encoding algorithms). In the high-quality coding range, an average measured bit rate savings of 60 % is reported. These results are higher than the bit rate savings measured using the PSNR objective quality metric. However, it has been shown that the bit rates required to achieve good quality of…

Physically Based Tracking of Cloth

Nils Hasler, Mark Asbach, Bodo Rosenhahn +6 more

Computer Graphics and Computer-Aided Design · Max Planck Institute for Plasma Physics · · cited 15× · OpenAlex ↗ · more like this ·

In this work a method for tracking fabrics in videos is proposed which, unlike \nmost other cloth tracking algorithms,\nemploys an analysis-by-synthesis approach. That is tracking consists of \noptimising a set of parameters of a mass-sp\nring model that is used to simulate the textile, defining on the one hand the \nfabric properties and on the other the\n positions of a limited number of constrained points of the simulated cloth. To \nimprove the tracking accuracy and to\n overcome the inherently chaotic behaviour of the real fabric several methods \nto track features on the cloth's surfa\nce and the best way to influence the simulation are evaluated.

Improved higher order motion compensation in HEVC with block-to-block translational shift compensation

Cordula Heithausen, Max Bläser, M Wien +1 more

Signal Processing · RWTH Publications (RWTH Aachen) · · cited 14× · DOI ↗ · more like this ·

Conventionally, complex motion in video sequences is approximated by smaller block units in order to be representable by a translational motion model. This approximation results in a fine block partitioning and a high prediction error, both at cost of more data rate than potentially necessary. A worthwhile data reduction has been shown to be achievable by adding a higher order motion model to the most recent video coding standard, High Efficiency Video Coding (HEVC). The benefit of this additional option of inter-frame prediction is due to the more accurate motion compensation as well as the usage of larger block sizes. This paper deals with more efficient encoding of higher order motion parameters in this context. The geometrically accurate prediction of higher order motion parameters from a neighbored block needs to consider the dependency of the block-to-block parameter difference…

Transition Filtering and Optimized Quantization in Interframe Wavelet Video Coding

Thomas Rusert, Konstantin Hanke, Jens-Rainer Ohm

Computer Vision and Pattern Recognition · RWTH Publications (RWTH Aachen) · · cited 12× · OpenAlex ↗ · more like this ·

In interframe wavelet video coding, wavelet-based motion-compensated temporal filtering (MCTF) is combined with spatial wavelet decomposition, allowing for efficient spatio-temporal decorrelation and temporal, spatial and SNR scalability. Contemporary interframe wavelet video coding concepts employ block-based motion estimation (ME) and compensation (MC) to exploit temporal redundancy between successive frames. Due to occlusion effects and imperfect motion modeling, block-based MCTF may generate temporal high frequency subbands with block-wise varying coefficient statistics, and low frequency subbands with block edges. Both effects may cause declined spatial transform gain and blocking artifacts. As a modification to MCTF, we present spatial highpass transition filtering (SHTF) and spatial lowpass transition filtering (SLTF), introducing smooth transitions between motion blocks in the…

Bit plane quantization for scalable video coding

Claudia Mayer, Holger Crysandt, Jens-Rainer Ohm

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 11× · DOI ↗ · more like this ·

A novel concept for SNR scalability with motion compensation in the enhancement layer is introduced. The quantization of the prediction error at different quantization step sizes is performed in the same loop. This allows the application of bit plane coding if the configuration of the quantizers is appropriately chosen. Since a layered prediction is employed at the encoder a drift can occur at a base layer decoder. The concept is, therefore, extended by a drift limitation operation. In this context, two approaches are investigated. One is based on a modification of the prediction error. In the second approach the drift is controlled by dynamic clipping of the enhancement prediction. The proposed SNR scalability concept is applied to the lowpass band of a wavelet-based video coding scheme. The performance is compared with a conventional approach to SNR scalability with two and three…