arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Li-Fu Ding

28 papers · 2003–2015

2003: 12004: 12005: 42006: 22007: 42008: 52009: 42010: 32011: 12012: 02013: 22014: 02015: 1
2003peak 5 in 20082015

Frequent co-authors

Papers

showing 1–25 of 28 RSS

Efficient Depth Image Based Rendering with Edge Dependent Depth Filter and Interpolation

Chen Wy, Yu-Lin Chang, Shyh-Feng Lin +2 more

Computer Vision and Pattern Recognition · · cited 167× · DOI ↗ · more like this ·

An efficient depth image based rendering with edge dependent depth filter and interpolation is proposed. The proposed method can solve the hole-filling problem in DIBR system efficiently with high quality. The PSNR of the proposed method is better than the previous work by 6 dB and the subjective view shows the quality is better. In addition to that, the number of instruction cycles is 3.7 percent compared with the previous work

A 212 MPixels/s 4096 $\times$ 2160p Multiview Video Encoder Chip for 3D/Quad Full HDTV Applications

Li-Fu Ding, Weiyin Chen, Pei-Kuei Tsung +6 more

Signal Processing · IEEE Journal of Solid-State Circuits · · cited 71× · DOI ↗ · more like this ·

Multiview video coding (MVC) plays an important role in a 3-D video system. In addition, the resolution of HDTV is increasing to present more vivid perception for users. To realize real-time processing of dozens of TOPS, VLSI solution is necessary. However, ultra high computational complexity, a large amount of external memory bandwidth and on-chip SRAM size, and complex MVC prediction structures are three main design challenges of implementation of MVC hardware architecture. In this paper, an MVC single-chip encoder is proposed for H.264/AVC Multiview High Profile and High Profile for 3-D and quad full high definition (QFHD) TV applications, respectively. The 4096 × 2160 p multiview video encoder chip is implemented on a 11.46 mm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> die with 90 nm CMOS technology. An eight-stage…

Depth Map Generation for 2D-to-3D Conversion by Short-Term Motion Assisted Color Segmentation

Yu-Lin Chang, Chih-Ying Fang, Li-Fu Ding +2 more

Computer Vision and Pattern Recognition · · cited 61× · DOI ↗ · more like this ·

This paper presented a novel depth map generation method - the short-term motion assisted color segmentation, which combines the pictorial, monocular and binocular depth cues of human vision. The proposed method utilizes a motion/edge registration technique to avoid the motion jitter error in common motion segmentation. And the motion/image segment adaptation algorithm matches the connected components with the motion segments. Even for static scene, the connected component algorithm is still working for the depth map generation. The experimental results show that the adaptation of motion and image segmentation improves quality and smoothness of the depth map both in the spatial and temporal domain.

Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding

Li-Fu Ding, Pei-Kuei Tsung, Shao‐Yi Chien +2 more

Signal Processing · IEEE Transactions on Multimedia · · cited 48× · DOI ↗ · more like this ·

3-D video will become one of the most significant video technologies in the next-generation television. Due to the ultra high data bandwidth requirement for 3-D video, effective compression technology becomes an essential part in the infrastructure. Thus multiview video coding (MVC) plays a critical role. However, MVC systems require much more memory bandwidth and computational complexity relative to mono-view video coding systems. Therefore, an efficient prediction scheme is necessary for encoding. In this paper, a new fast prediction algorithm, content-aware prediction algorithm (CAPA) with inter-view mode decision, is proposed. By utilizing disparity estimation (DE) to find corresponding blocks between different views, the coding information, such as rate-distortion cost, coding modes, and motion vectors, can be effectively shared and reused from the coded view channel. Therefore…

Cache-based integer motion/disparity estimation for quad-HD H.264/AVC and HD multiview video coding

Pei-Kuei Tsung, Weiyin Chen, Li-Fu Ding +2 more

Signal Processing · · cited 33× · DOI ↗ · more like this ·

To provide more vivid perception, more and more advanced features, like the 4k×2k resolution and the multiview functionality, are emerging for TV. For a multiview video coding (MVC) encoder, motion and disparity estimation (ME/DE) take at least half the hardware requirement. To solve these challenges, a cache-based integer ME/DE algorithm is proposed. With a cache memory as the search window buffer, a predictor-centered ME/DE algorithm is presented. The search range can be reduced to ±16 pixels with less than 0.1dB quality drop compared with full search algorithm. Based on this algorithm, an integer ME/DE chip design is realized. It can reduce 82% on-chip SRAM and 39% system bandwidth. Moreover, the search candidate requirement is also reduced by 79%. As the result, an ME/DE chip design for 4k×2k quad-HD H.264 and HDTV MVC is implemented.

Joint Prediction Algorithm and Architecture for Stereo Video Hybrid Coding Systems

Li-Fu Ding, Shao‐Yi Chien, Liang‐Gee Chen

Signal Processing · IEEE Transactions on Circuits and Systems for Video Technology · · cited 29× · DOI ↗ · more like this ·

3-D video will be the most prominent video technology in the next generation. Among the 3-D video technologies, stereo video systems are considered to be realized first in the near future. Stereo video systems require double bandwidth and more than twice the computational complexity relative to mono-video systems. Thus, an efficient coding scheme is necessary for transmitting stereo video. In this paper, a new structure of prediction core in stereo video coding systems is proposed from the algorithm level to the hardware architecture level. The joint prediction algorithm (JPA), which combines three prediction schemes, is proposed for high coding efficiency and low computational complexity. It makes the system outperform MPEG-4 temporal scalability and simple profile by 2-3 dB in rate-distortion performance. Besides, JPA also utilizes the characteristics of stereo video and successfully…

Architecture design of high performance embedded compression for high definition video coding

Weiyin Chen, Li-Fu Ding, Pei-Kuei Tsung +1 more

Signal Processing · · cited 24× · DOI ↗ · more like this ·

External memory bandwidth is an important issue in System-on-Chip (SoC) systems. Especially in high definition (HD) video coding, the bandwidth requirement of off-chip memory is critical in video processing. In recent researches, embedded compression shows high potential on off-chip memory bandwidth reduction. Works about embedded compression have been done for low power applications. However, there is no suitable efficient embedded compression with good rate-distortion performance for high throughput applications. In this paper, an algorithm and hardware architecture of high performance lossy embedded compression is proposed to ease the bus congestion problem while keeping the latency low. Using the proposed algorithm, not only the high throughput requirement of HD video encoder is met, but also the hardware cost is relatively low. From our simulation, about 70% memory bandwidth is…

Fast motion estimation with inter-view motion vector prediction for stereo and multiview video coding

Li-Fu Ding, Pei-Kuei Tsung, Weiyin Chen +2 more

Signal Processing · Proceedings of the ... IEEE International Conference on Acoustics, Speech, and Signal Processing · · cited 23× · DOI ↗ · more like this ·

3-D video will become one of the most important video technologies in the next generation of television. Due to ultra high data bandwidth requirement for 3-D video, effective compression technology becomes an essential part in the infrastructure. Thus stereo and multiview video coding (MVC) plays a critical role. However, MVC systems require much more computational complexity relative to mono-view video coding systems. Therefore, an ef..cient prediction scheme is necessary for encoding. In this paper, a new fast motion estimation (ME) algorithm is proposed. By utilizing disparity estimation (DE) to ..nd corresponding blocks between different views, the coding information such as motion vectors can be effectively shared and reused from the coded view channel. Therefore, the computation for ME in most view channels can be greatly reduced. Experimental results show that compared with the…

Single-iteration full-search fractional motion estimation for quad full HD H.264/AVC encoding

Pei-Kuei Tsung, Weiyin Chen, Li-Fu Ding +3 more

Signal Processing · · cited 19× · DOI ↗ · more like this ·

Fractional motion estimation (FME) is widely used in video compression standards. In H.264/AVC, the precision of motion vector is down to quarter pixels to improve the coding efficiency. However, FME occupies over 45% of the computation complexity in an H.264 encoder and this high complexity limits the processing capability. In this paper, a single-iteration full search FME is proposed. By the algorithm and architecture co-optimization, the bandwidth to the frame buffer is reduced by 31%. Furthermore, 82% of circuit area for the Hadamard transformation and subtraction are saved from the direct implementation. Compared with prior arts, the proposed design supports 3.39 times higher throughput with only 0.02 dB PSNR drop. Thus, the specification of 4096 times 2160 quad full high definition H.264/AVC FME processing can be achieved.

Stereo Video Coding System with Hybrid Coding Based on Joint Prediction Scheme

Li-Fu Ding, Shao‐Yi Chien, Yu‐Wen Huang +2 more

Computer Vision and Pattern Recognition · NTUR (臺灣機構典藏) · · cited 15× · DOI ↗ · more like this ·

Stereo video systems require double bandwidth and more than twice the computational complexity relative to mono-video systems. Thus, an efficient coding scheme is necessary for transmitting stereo video. We propose a novel stereo video coding system by exploiting a joint prediction scheme which combines three prediction schemes to achieve high coding efficiency and low computational complexity. Joint block compensation improves the visual quality. Motion vector prediction and mode pre-decision utilize the features of stereo video to reduce the computational complexity with up to 8-9 times acceleration. Experiments show that the proposed joint prediction scheme is 2 dB better than MPEG-4 TS and 3 dB better than MPEG-4 SP.

Single iteration view interpolation for multiview video applications

Pei-Kuei Tsung, Pin-Chih Lin, Li-Fu Ding +2 more

Computer Vision and Pattern Recognition · · cited 14× · DOI ↗ · more like this ·

Multiview video can bring the 3D and virtual reality perceptual experience to users by its multiple view point characteristic. To support the smooth and free view point switching, both matrix-based depth image based rendering and the complex virtual view interpolation schemes are required. In order to reduce the high computation complexity and avoid the iterative processing scheduling in conventional view interpolation flows, a single iteration view interpolation algorithm is proposed. By use of the proposed algorithm, the redundant warping operations are reduced by 86%. In addition, based on the proposed artifact detecting and removing algorithm, artifacts due to imperfect depth maps can be detected and eliminated at the same time. Therefore, no additional post-processing or iteration is required and the single iteration processing is achieved.

Efficient stereo video coding system for immersive teleconference with two-stage hybrid disparity estimation algorithm

Shao‐Yi Chien, Shu‐Han Yu, Li-Fu Ding +2 more

Signal Processing · · cited 13× · DOI ↗ · more like this ·

An efficient coding system is required for immersive teleconference to transmit stereo video. We propose a novel stereo video coding system by exploiting mesh-based disparity estimation and compensation scheme to achieve high coding efficiency and view synthesis ability. Based on the base-layer-enhance-layer structure, this system can provide stereoscopic scalability and compatibility to standards. With considering asymmetric spatial resolution property, good subjective quality can be achieved in ultra low bitrate situation. A novel fast disparity estimation algorithm named as two-stage iterative block and octagonal matching (TS-IBOM) algorithm is also proposed for this system. Experiments show that the proposed disparity estimation algorithm can generate accurate disparity vectors quickly. It is also shown that the proposed coding system has better coding efficiency than MPEG-4 simple…

A 216fps 4096&amp;#x00D7;2160p 3DTV set-top box SoC for free-viewpoint 3DTV applications

Pei-Kuei Tsung, Ping-Chih Lin, Kuan‐Yu Chen +8 more

Signal Processing · · cited 9× · DOI ↗ · more like this ·

3DTV promises to become the mainstream of next-generation TV systems. High resolution 3DTV provides users with a vivid watching experience. Moreover, free-viewpoint view synthesis (FVVS) extends the common two-view stereo 3D vision into virtual reality by generating unlimited views from any desired view point. In the next-generation 3DTV systems, the set-top box (STB) SoC requires both a high-definition (HD) multiview video-coding (MVC) decoder to recon struct the real camera-captured scenes and a free-viewpoint view synthesizer to generate the virtual scenes.

Computation-Free Motion Estimation with Inter-View Mode Decision for Multiview Video Coding

Li-Fu Ding, Pei-Kuei Tsung, Shao‐Yi Chien +2 more

Signal Processing · · cited 9× · DOI ↗ · more like this ·

Multiview video coding (MVC) plays a critical role in 3D-TV systems. However, MVC require much more memory bandwidth and computational complexity relative to mono-view video coding. Therefore, an efficient prediction scheme is necessary for computation reduction. In this paper, a new fast prediction algorithm, computation-free motion estimation (ME) with inter-view mode decision, is proposed. By utilizing disparity estimation to find corresponding blocks between different views, the coding information, such as modes and motion vectors, can be effectively reused from the coded view channel. Therefore, the computation for ME can be almost totally neglected in most view channels. Besides, the proposed algorithm also provides the computation scalability. Experimental results show that compared with the full search block matching algorithm (FSBMA), the proposed algorithm not only save 61-72%…

System Bandwidth Analysis of Multiview Video Coding with Precedence Constraint

Pei-Kuei Tsung, Li-Fu Ding, Weiyin Chen +3 more

Signal Processing · · cited 8× · DOI ↗ · more like this ·

Multiview video coding (MVC) systems require much more bandwidth and computational complexity relative to mono-view video systems. Thus, when designing a VLSI architecture for MVC systems, the hardware resource allocation is a critical issue. In this paper, we propose a new system bandwidth analysis scheme for various and complicated MVC structures. The precedence constraint in the graph theory is adopted for deriving the processing order of frames in a MVC system. In addition, current block centric scheduling (CBCS) and search window centric scheduling (SWCS) are proposed for MVC bandwidth analysis. By adopting data reuse schemes, several design points are explored with the aid of the proposed analysis scheme. The suitable hardware resource allocation can be easily determined.

Algorithm and architecture design of cache system for motion estimation in high definition H.264/AVC

Weiyin Chen, Li-Fu Ding, Pei-Kuei Tsung +1 more

Signal Processing · Proceedings of the ... IEEE International Conference on Acoustics, Speech, and Signal Processing · · cited 7× · DOI ↗ · more like this ·

High Definition (HD) video compression enables vivid reproduction of scenes. However, Motion Estimation (ME) requires large memory capacity and huge memory bandwidth, which are undesirable in many platforms including ASIC and SoC. In this paper, an algorithm and architecture design of cache system and fast ME in HD H.264/AVC are proposed. With the proposed cache system and hardware-oriented fast ME algorithm, the rate-distortion performance is maintained within 0.03dB difference, the size of on-chip memory reduced to only 10% to 21% of original size, while the external memory bandwidth from cache refill is also 18% to 56% less than that of level C data reuse scheme with vertical ..64 search range.

Video encoder design for high-definition 3D video communication systems

Pei-Kuei Tsung, Li-Fu Ding, Weiyin Chen +5 more

Signal Processing · IEEE Communications Magazine · · cited 6× · DOI ↗ · more like this ·

VLSI realization of video compression is the key to real-time high-definition 3D communication systems. The newly established multiview video coding standard, as an extension profile of H.264/AVC, draws more and more attention for its high compression ratio and free-viewpoint support. Besides providing the 3D experience, multiview video can also give users complete scene perception. However, the multiple-viewpoint throughput requirement of MVC increase the complexity and hardware cost dramatically. The system memory bandwidth, on-chip memory size, and processing data throughput of each module all need to be optimized in an MVC encoder. Therefore, efficient hardware solutions for MVC architecture design are needed. In this article an overview of 3D video coding standards developments and design challenges of an MVC encoder are discussed. Then the algorithm and architecture optimization…

A 212MPixels/s 4096&amp;#x00D7;2160p multiview video encoder chip for 3D/quad HDTV applications

Li-Fu Ding, Weiyin Chen, Pei-Kuei Tsung +9 more

Signal Processing · · cited 3× · DOI ↗ · more like this ·

The proposed MVC encoder chip is characterized as follows: 1) View-parallel MB-interleaved (VPMBI) scheduling with 8-stage MB pipelining is introduced to overcome the first 2 challenges. With this technique, the processing capability is 212 Mpixels/s, at least 3.4times better than the previous works. In addition, view scalability is achieved and supports real-time processing from single-view 4096times2160p to 7-view 720p videos. 2) The cache-based prediction core with a search window (SW) prefetching scheme and a predictor-centered ME/DE algorithm effectively reduces 83% on-chip memory size and 39% external memory bandwidth compared. These techniques enable the design of H.264/AVC Multiview Extension and High Profile encoder. The core size of the chip is 11.46 mm <sup xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">2</sup> , which contains 1732…

&lt;title&gt;Fast disparity estimation algorithm for mesh-based stereo image/video compression with two-stage hybrid approach&lt;/title&gt;

Shao‐Yi Chien, Shu‐Han Yu, Li-Fu Ding +2 more

Signal Processing · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 3× · DOI ↗ · more like this ·

Disparity estimation is a very important operation in stereo image and video compression. However, existing disparity estimation algorithms require too large computation power. In this paper, we propose a fast disparity estimation algorithm for mesh-based stereo image and video compression with two-stage hybrid approach, which is names as Two Stage Iterative Block and Octagonal Matching algorithm (TS-IBOM). The first stage of this algorithm is Iterative Block Matching algorithm, which can give a good initial guess of the disparity vectors with a little computation. In the second stage, Iterative Octagonal Matching algorithm is employed to refine the disparity vectors. A local updating scheme is also proposed to further accelerate the process by skipping nodes whose disparity vectors have been derived already. Experimental results show that the proposed algorithm can give good results…

Algorithm and architecture of prediction core in stereo video hybrid coding system

Li-Fu Ding, Shao‐Yi Chien, Liang‐Gee Chen

Signal Processing · NTUR (臺灣機構典藏) · · cited 2× · DOI ↗ · more like this ·

3D video will become noticeable video technology in the next generation. In this paper, a stereo video coding system is proposed from algorithm level to hardware architecture level. We propose a novel stereo video coding system by exploiting joint block compensation scheme to achieve high coding efficiency. It is also suitable for hardware implementation. Due to more than twice computational complexity relative to mono video coding systems, a new hardware architecture based on hierarchical search block matching algorithm (HSBMA) with some modification is proposed. With special data flow, no bubble cycles exist during block matching process. Proposed architecture also adopts near overlapped candidates reuse scheme (NOCRS) to save heavy burden of data access. Besides, by the proposed new scheduling, both on-chip memory requirement and offchip memory bandwidth can be reduced. A prototype…

Multiview video hybrid coding system with texture-depth synthesis

Pei-Kuei Tsung, Chun-Yi Lin, Weiyin Chen +2 more

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

Multiview video coding (MVC) is getting more and more attention in recent years because of the realistic perception it can bring. However, the current H.264-based coding scheme cannot get enough coding gain in the rate-distortion (R-D) performance. Furthermore, the view synthesis and random access between views are also design challenges. In this paper, a multiview hybrid coding system with texture-depth synthesis is proposed. By sharing the prediction information between texture and depth maps, the depth map can be reconstructed with reduced bitrate overhead. Then, after using matrix-based warping and adaptive disparity compensation, the R-D performance of the proposed system can be about 2 to 4 dB higher than the current MVC coding scheme at low bitrate range.

Fast luminance and chrominance correction based on motion compensated linear regression for multi-view video coding

Weiyin Chen, Li-Fu Ding, Liang‐Gee Chen

Signal Processing · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 1× · DOI ↗ · more like this ·

Luminance and chrominance correction (LCC) is important in multi-view video coding (MVC) because it provides better rate-distortion performance when encoding video sequences captured by ill-calibrated multi-view cameras. This paper presents a robust and fast LCC algorithm based on motion compensated linear regression which reuses the motion information from the encoder. We adopt the linear weighted prediction model in H.264/AVC as our LCC model. In our experiments, the proposed LCC algorithm outperforms basic histogram matching method up to 0.4dB with only few computational overhead and zero external memory bandwidth. So, the dataflow of this method is suitable for low bandwidth/low power VLSI design for future multi-view applications.

720 × 480 30fps Efficient Prediction Core Chip for Stereo Video Hybrid Coding System

Li-Fu Ding, Shao‐Yi Chien, Liang‐Gee Chen

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

The chip design of prediction core in the stereo video hybrid coding system is implemented with 0.18 mum 1P6M technology by TSMC. The die size is 4.53 mm. This IC can achieve real-time requirement under the operating frequency of 81 MHz for 30 D1 frames per second (fps) in the left and the right channel simultaneously, with ME/DE search range of [-64, +63] in horizontal direction and [-32, +31]/[-16, +15] in vertical direction. Compared with the hardware requirement for implementation of full search block matching algorithm (FSBMA), only 11.5% on-chip SRAM and 1/30 amount of PEs are needed. It shows that the hardware cost is quite small

FAST MOTION ESTIMATIONWITH INTER-VIEWMOTION VECTOR PREDICTION FOR STEREO ANDMULTIVIEW VIDEO CODING

Li-fu Ding, Pei-kuei Tsung, Wei-yin Chen +2 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

3-D video will become one of the most important video tech-nologies in the next generation of television. Due to ultra high data bandwidth requirement for 3-D video, effective compres-sion technology becomes an essential part in the infrastruc-ture. Thus stereo and multiview video coding (MVC) plays a critical role. However, MVC systems require much more computational complexity relative to mono-view video cod-ing systems. Therefore, an efſcient prediction scheme is nec-essary for encoding. In this paper, a new fast motion esti-mation (ME) algorithm is proposed. By utilizing disparity estimation (DE) to ſnd corresponding blocks between differ-ent views, the coding information such as motion vectors can be effectively shared and reused from the coded view channel. Therefore, the computation for ME in most view channels can be greatly reduced. Experimental results show that compared with…

7.1 A 216fps 4096×2160p 3DTV Set-Top Box SoC for Free-Viewpoint 3DTV Applications

Pei-kuei Tsung, Ping-chih Lin, Kuan-yu Chen +8 more

Signal Processing · · cited 0× · OpenAlex ↗ · more like this ·

3DTV promises to become the mainstream of next-generation TV systems. Highresolution 3DTV provides users with a vivid watching experience. Moreover, free-viewpoint view synthesis (FVVS) extends the common two-view stereo 3D vision into virtual reality by generating unlimited views from any desired viewpoint. In the next-generation 3DTV systems, the set-top box (STB) SoC requires both a high-definition (HD) multiview video-coding (MVC) decoder to reconstruct the real camera-captured scenes and a free-viewpoint view synthesizer to generate the virtual scenes [1-2]. There are three main challenges to design an efficient high-resolution 3DTV STB SoC: (1) High processing capability of both the real-view decoder and virtualview synthesizer is required to support various 2D/3D applications in HDTV. For example, 66.2TOPS of computation is consumed to synthesize one virtual view in quad full-HD…