Author

Songyu Yu

132 papers · 1989–2013

1989peak 18 in 20042013

Frequent co-authors

Papers

showing 1–25 of 132 RSS

Method for detecting all-zero DCT coefficients aheadofdiscrete cosine transformation and quantisation

Xuan Zhou, Zhenghua Yu, Songyu Yu

Signal Processing · Electronics Letters · 17 Sep 1998 · cited 78× · DOI ↗ · more like this ·

The authors present a new algorithm for detecting all-zero DCT coefficient blocks before discrete cosine transformation and quantisation in very low bit rate video coding. The proposed algorithm uses the sum of absolute difference (SAD) of each motion compensation block as the criteria. Because the SAD can be obtained after motion estimation, no additional computation is required. Results show that the proposed algorithm can be used to reduce the amount of computation significantly without sacrificing video coding quality.

Efficient Spatio-temporal Segmentation for Extracting Moving Objects in Video Sequences

Renjie Li, Songyu Yu, Xiaokang Yang

Computer Vision and Pattern Recognition · IEEE Transactions on Consumer Electronics · August 2007 · cited 44× · DOI ↗ · more like this ·

Extraction of moving objects is an important and fundamental research topic for many digital video applications. This paper addresses an efficient spatio-temporal segmentation scheme to extract moving objects from video sequences. The temporal segmentation yields a temporal mask that indicates moving regions and static regions for each frame. For localization of moving objects, a block-based motion detection method considering a novel feature measure is proposed to detect changed regions. These changed regions are coarse and need accurate spatial compensation. An edge-based morphological dilation method is presented to achieve the anisotropic expansion of the changed regions. Furthermore, to solve the temporarily stopping problem of moving objects, the inertia information of moving objects is considered in the temporal segmentation. The spatial segmentation based on the watershed…

Parallel Hough Transform-Based Straight Line Detection and Its FPGA Implementation in Embedded Vision

Xiaofeng Lu, Song Li, Sumin Shen +3 more

Computer Vision and Pattern Recognition · Sensors · 17 Jul 2013 · cited 40× · DOI ↗ · more like this ·

Hough Transform has been widely used for straight line detection in low-definition and still images, but it suffers from execution time and resource requirements. Field Programmable Gate Arrays (FPGA) provide a competitive alternative for hardware acceleration to reap tremendous computing performance. In this paper, we propose a novel parallel Hough Transform (PHT) and FPGA architecture-associated framework for real-time straight line detection in high-definition videos. A resource-optimized Canny edge detection method with enhanced non-maximum suppression conditions is presented to suppress most possible false edges and obtain more accurate candidate edge pixels for subsequent accelerated computation. Then, a novel PHT algorithm exploiting spatial angle-level parallelism is proposed to upgrade computational accuracy by improving the minimum computational step. Moreover, the FPGA based…

Improvement on performance of modified Hopfield neural network for image restoration

Yi Sun, Jie-Gu Li, Songyu Yu

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · May 1995 · cited 38× · DOI ↗ · more like this ·

By analyzing the same inequality ||u*||(1)=/<(1/2)trace(T), the authors conclude that a severely blurred image is generally restored less accurately than a mildly blurred one by the modified Hopfield neural network. This conclusion is the opposite of the statement made in Paik and Katsaggelos (1992). The authors also propose an improved new algorithm. Simulation results show that the SNRs of the images restored by the algorithm are higher by 3 to 8 db than those restored by the algorithm in Paik and Katsaggelos and the streaks in the restored images are obviously suppressed by the algorithm.

Moving Objects Detection Method Based on Brightness Distortion and Chromaticity Distortion

Rui Zhang, Sizhu Zhang, Songyu Yu

Computer Vision and Pattern Recognition · IEEE Transactions on Consumer Electronics · August 2007 · cited 37× · DOI ↗ · more like this ·

This paper addresses a new background subtraction algorithm for detecting moving objects from a static background scene. The algorithm is proposed on the basis of brightness distortion and chromaticity distortion in RGB color space. For a given video sequence, a background frame is first extracted. Statistical analysis of chromaticity value is used in background frame extraction. It can solve the problem of deleting moving traces of moving objects in the case of few frames and slow movement. Gaussian model is used to calculate the threshold of brightness distortion in object detection. It can solve the problem of manually setting the brightness distortions of different video sequences. Experimental results show that the method proposed in this paper can detect moving objects exactly and effectively. It has been used in intelligent video surveillance system and region of interest (ROI)…

Multiscale Semilocal Interpolation With Antialiasing

Kai Guo, Xiaokang Yang, Hongyuan Zha +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · 25 Aug 2011 · cited 29× · DOI ↗ · more like this ·

Aliasing is a common artifact in low-resolution (LR) images generated by a downsampling process. Recovering the original high-resolution image from its LR counterpart while at the same time removing the aliasing artifacts is a challenging image interpolation problem. Since a natural image normally contains redundant similar patches, the values of missing pixels can be available at texture-relevant LR pixels. Based on this, we propose an iterative multiscale semilocal interpolation method that can effectively address the aliasing problem. The proposed method estimates each missing pixel from a set of texture-relevant semilocal LR pixels with the texture similarity iteratively measured from a sequence of patches of varying sizes. Specifically, in each iteration, top texture-relevant LR pixels are used to construct a data fidelity term in a maximum a posteriori estimation, and a bilateral…

Confidence based optical flow algorithm for high reliability

Renjie Li, Songyu Yu

Computer Vision and Pattern Recognition · March 2008 · cited 27× · DOI ↗ · more like this ·

Estimation of optical flow is an important topic to provide motion information for motion analysis. This paper addresses an effective confidence based optical flow algorithm. It considers the bidirectional symmetry of forward and backward flow to compute the confidence measure for each flow estimate. According to the confidence, the reliable flow estimates have greater contribution to local averages while unreliable estimates are suppressed. The errors cannot be propagated. Since the image-driven and flow-driven discontinuity preserving methods have complementary advantages and limitations, we propose a region based method combining these two types of methods to preserve motion boundaries. Experiments on typical sequences have successfully demonstrated the validity of the proposed algorithm.

Efficient method for early detection of all-zeroDCT coefficients

Shi Jun, Songyu Yu

Computer Vision and Pattern Recognition · Electronics Letters · February 2001 · cited 27× · DOI ↗ · more like this ·

Based on the existing method, a more efficient algorithm for detecting all-zero DCT coefficient blocks before implementation of the discrete cosine transform and quantisation in very low bit rate video coding is proposed. The problem of the existing method is shown and an improved algorithm is provided. Simulation shows that the new method improves the detecting performance by ~10–20%.

Joint source-channel decoding for h.264 coded video stream

Yue Wang, Songyu Yu

Signal Processing · IEEE Transactions on Consumer Electronics · November 2005 · cited 22× · DOI ↗ · more like this ·

H.264 is the newest video coding standard and has achieved a significant improvement in coding efficiency. The entropy coding methods used in H.264 are CAVLC and CABAC. Although these two variable length code methods can achieve high compression, they are very sensitive to channel errors. This paper presents a joint source-channel MAP (maximum a posteriori probability) decoding method to dealing with this sensitivity to channel errors and applied it to the decoding of the motion vector in H.264 coded video stream. Although H.264 codec has proposed several error resilience methods, we believe this method could provide additional error resilience to H.264 stream. Experiment indicates that our JSCD achieves significant improvement than a separate scheme.

Object contour tracking using multi-feature fusion based particle filter

Xiaofeng Lu, Li Song, Songyu Yu +1 more

Computer Vision and Pattern Recognition · July 2012 · cited 20× · DOI ↗ · more like this ·

In this paper, a novel object contour tracking framework integrating independent multi-feature fusion object rough location and region-based temporal differencing model is proposed. In our model, the object rough location tracking is realized by color histogram and Harris corner features fusion method in particle filter framework. Thus it can achieve more robust tracking performance in many challenge scenes. And this particle filter framework is based on our previous CamShift guided particle filter [7]. With the rough object location, efficient region-based temporal differencing model is adopted for object contour detection, then this method is faster and more effective compared to active contour models or conventional global temporal differencing models. Moreover, exact contour tracking result can be used to guide the particle propagation of next frame, to enable more efficient…

Camshift Guided Particle Filter for Visual Tracking

Zhaowen Wang, Xiaokang Yang, Yi Xu +1 more

Computer Vision and Pattern Recognition · SiPS ... design and implementation - IEEE Workshop on Signal Processing Systems · October 2007 · cited 18× · DOI ↗ · more like this ·

Particle filter and mean shift are two important methods for tracking object in video sequence, and they are extensively studied by researchers. As their strength complements each other, some effort has been initiated in [1] to combine these two algorithms, on which the advantage of computational efficiency is focused. In this paper, we extend this idea by exploring even more intrinsic relationship between mean shift and particle filter, and propose a new algorithm, CamShift guided particle filter (CAMSGPF). In CAMSGPF, two basic algorithms - CamShift and particle filter - can work cooperatively and benefit from each other, so that the overall performance is improved and some redundancy in algorithms can be removed. Experimental results show that the proposed method can track objects robustly in various environments, and is much faster than the existing methods.

FPGA-based real-time object tracking for mobile robot

Xiaofeng Lu, Diqi Ren, Songyu Yu

Computer Vision and Pattern Recognition · November 2010 · cited 17× · DOI ↗ · more like this ·

This paper proposes an embedded vision system for real-time moving object tracking using modified mean-shift algorithm for mobile robot application. This design of modified mean-shift algorithm fully utilizing the advanced parallelism of Field Programmable Gate Arrays (FPGA) is capable of processing real-time PAL video of 720*576 at 25 fps. This hardware implementation realizes time-consumed color space transformation using pipeline operations, which completely removes the dependence of off-chip RAM memory. In addition, this system incorporates adaptive kernel based mass center calculation method to balance the tracking complication and precision. Finally, the time division multiplex (TDM) technology obviously saves the FPGA hardware resources. As a result, the feasibility and tracking robustness of this implementation have been demonstrated through realtime tracking videos.

Implementation of MPEG-2 transport stream remultiplexer for DTV broadcasting

Wang Xingdong, Songyu Yu, Liang Longfei

Sociology and Political Science · IEEE Transactions on Consumer Electronics · May 2002 · cited 17× · DOI ↗ · more like this ·

This paper presents the design and implementation of an MPEG-2 transport stream (TS) remultiplexer, which is one of the most important pieces of equipment in a digital television broadcasting system. To achieve high performance as well as save hardware resources, the architecture of CAM+RAM is proposed to substitute simple RAM where a PID information table is generated. Compared to other methods, the two-step PCR correction approach can simplify the system significantly. Three data insertion modes are discussed in this paper. Among of them, the host-downloading architecture supports the system to work in a standalone mode when the contents of data are repeated with a fixed time interval or change not very fast.

A modified Hopfield neural network used in bilevel image restoration and reconstruction

Yi Sun, Songyu Yu

Artificial Intelligence · 1992 · cited 15× · DOI ↗ · more like this ·

A group of threshold update algorithms with respect to simultaneous, partially simultaneous and sequential update modes is given. The network with these algorithms is asymptotically stable. The upper bounds of residuals of the convergent solutions are presented. Simulation results are shown.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>

Implementation of a new MPEG-2 transport stream processor for digital television broadcasting

Liang Longfei, Songyu Yu, Wang Xingdong

Signal Processing · IEEE Transactions on Broadcasting · December 2002 · cited 14× · DOI ↗ · more like this ·

We introduce a real-time, dual independent output MPEG-2 transport stream (TS) processor designed specific for the China HDTV testing zones. The processor is a single piece of equipment, of which the core functions are realized in FPGA and DSP. Key technologies include a program clock reference (PCR) correction and a packets controller, which are important for TS processing, are described in detail. An improved PCR correction scheme developed by the authors is also proposed.

Adaptive unequal loss protection for scalable video streaming over ip networks

Yunqiang Liu, Songyu Yu

Signal Processing · IEEE Transactions on Consumer Electronics · November 2005 · cited 13× · DOI ↗ · more like this ·

Video streaming over IP networks faces many challenges due to the varying network conditions such as time-varying packet loss and fluctuating bandwidth. In this paper, we focus on streaming scalable video over IP networks in order to enhance the received video quality. We present an adaptive video transmission scheme, which combines unequal loss protection and layer selecting. In this scheme, we estimate the packet loss effects on video quality using model-based distortion estimation approach, both for the base layer and the enhancement layers. Based the estimated distortion, the scheme adaptively assigns the unequal amount of forward error correction to each layer and adjusts the sending rate by dynamically selecting the appropriate number of layers to transmit, according to the packet loss rate and the available network bandwidth. The scheme can provide a graceful degradation of…

1-D and 2-D transforms from integers to integers

Jia Wang, Jun Sun, Songyu Yu

Signal Processing · 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03). · 22 Dec 2003 · cited 13× · DOI ↗ · more like this ·

Substituting a real valued linear transform with an integer-to-integer mapping has become very important in lots of applications. This paper introduces a new kind of matrix decomposition method called lifting-like factorization, which leads to a theorem: every 2/sup n/-order real matrix with determinant norm 1 can be expressed as the product of one permutation matrix and at most three unit triangular matrices. Rounding error of this method is analyzed. Realization of 2D integer transform is also studied and it is shown that a 2D integer-to-integer transform cannot be realized by performing two 1D integer transforms separately. Left and right permutation matrices are introduced to reduce rounding error and an application of this method to intDCT is discussed.

Image classification based on pyramid histogram of topics

Fuxiang Lu, Xiaokang Yang, Rui Zhang +1 more

Computer Vision and Pattern Recognition · June 2009 · cited 11× · DOI ↗ · more like this ·

In this paper we propose PHOTO (pyramid histogram of topics), a new representation for image classification. We partition the image into hierarchical cells and learn the topic histogram using pLSA over each cell with EM algorithm. Then we concatenate the topic histograms over the cells at all levels to form a ldquolongrdquo vector, i.e. pyramid histogram of topics. Finally AdaBoost classifiers are used to select the topics most discriminative for class recognition. Experimental results on two diverse databases show that our method performs significantly better than general topic representation.

A Novel Multiple Description Video Codec Based on Slepian-Wolf Coding

Yuhua Fan, Jia Wang, Jun Sun +2 more

Computer Vision and Pattern Recognition · DCC · March 2008 · cited 11× · DOI ↗ · more like this ·

One major task in multiple description video coding is to prevent drift on packet loss channels, where transmission errors occur in each description. We propose a distributed multiple description video coding (DMDVC) scheme excluding any prediction loops. The new codec suffers from no drift problem. In the two-channel mode of symmetry side informations (SI), one side decoder can use the SI of the other without any decoding quality degradation. Thereby, DMDVC achieves high robustness on packet loss channels.

Conservative staircase data broadcasting protocol for video on demand

GU Zhi-qi, Songyu Yu

Computer Networks and Communications · IEEE Transactions on Consumer Electronics · November 2003 · cited 11× · DOI ↗ · more like this ·

Using multiple channels to broadcast a popular video is common in near video on demand (NVOD) systems. There are various protocols that adopt this method. Among those protocols, the harmonic protocol and its derivative protocols have the best performance in reducing the viewer's waiting time under a given bandwidth. The staircase protocol is reported to have the lowest buffer requirement and disk I/O requirement to client end. However, two defects in staircase protocol that may cause video discontinuity at the client site are ignored. In this paper, we talked about these two defects and explained how they cause video discontinuity at the client site. Then, we presented the conservative staircase protocol. As its name implies, this protocol adopts a conservative bandwidth assignment to ensure the continuity of the video received. At last, we compared the performance of this protocol with…

Event recognition with time varying Hidden Markov Model

Zhaowen Wang, Erçan E. Kuruoğlu, Xiaokang Yang +2 more

Artificial Intelligence · ISTI Open Portal · April 2009 · cited 9× · DOI ↗ · more like this ·

Standard hidden Markov model (HMM) and the more general dynamic Bayesian network (DBN) models assume stationarity of state transition distribution. However, this assumption does not hold for many real life events of interest. In this paper, we propose a new time sequence model that extends HMM to time varying scenario. The time varying property is realized in our model by explicitly allowing the change of state transition density as the time spent in a particular state passes by. Rather than keeping transition densities at different time spots independent of each other, we exploit their temporal correlation by applying a hierarchical Dirichlet prior. This leads to a more robust time varying model, especially when training data are scarce. We also employ Markov chain Monte Carlo (MCMC) sampling in learning the MAP estimate of time varying parameters, with a transition kernel…

Channel-Aware Frame Dropping for Cellular Video Streaming

Hao Liu, Wenjun Zhang, Songyu Yu +1 more

Computer Vision and Pattern Recognition · 2006 · cited 9× · DOI ↗ · more like this ·

In the case of cellular video streaming over wireless channels, burst frame losses may be unavoidable. Considering the unequal importance of different frames in a group-of-pictures (GOP) and the burst-error characteristics of wireless channels, this paper proposes a channel-aware frame dropping scheme so as to shift burst losses into relatively unimportant frames in the same GOP. By using selective retransmission at the radio link layer, a base station can adaptively assign the unequal transmission attempts to different video frames. Simulation results show that the proposed scheme can be aware of the variation of wireless channel conditions, and thus significantly improve error resilience of cellular video streaming

Using Object Multiplex Technique in Data Broadcast on Digital CATV Channel

GU Zhi-qi, Songyu Yu, Z. Wenjun

Computer Networks and Communications · IEEE Transactions on Broadcasting · June 2004 · cited 9× · DOI ↗ · more like this ·

Data broadcast is a new kind of value-add service of DTV broadcasting and some data broadcast protocols have already been established. However, these protocols only describe the method for locating files in data streams, and a method for distribution of a large collection of files in one or more data streams is not provided. Research on this problem mainly focuses on how to decrease the wait time and some methods of allocating files on multiple streams based on access probability are proposed, but how to assign the file with a reasonable bandwidth is ignored. In this paper, we introduced an object multiplex algorithm to optimize the allocation of objects on a DTV channel. This method assigns different bandwidth statistically to a different object according to its size and access probability. In this method, both download time and wait time are considered. It adopts a modified virtual…

A novel error recovery scheme for H.264 video and its application in conversational services

Hongbin Yu, Ci Wang, Songyu Yu

Signal Processing · IEEE Transactions on Consumer Electronics · February 2004 · cited 8× · DOI ↗ · more like this ·

Extensive researches have been conducted to enhance robustness for Internet video transmission. It has been found that feedback channel is an effective tool to provide error recovery ability and it is most suitable for interactive and conversational environments. Multiframe is another useful approach to enhance both coding efficiency and robustness. In this paper, we propose an algorithm which combines feedback channel and multiframe to achieve rapid error recovery ability for H.264 video. Simulation results show that our scheme can best utilize the feedback information. At the end of this paper, its application in conversational services such as Internet videophone is discussed.

Advanced mirrored-pyramid broadcasting for video-on-demand

Zhenghua Zhang, Songyu Yu, Junhua Chen +1 more

Sociology and Political Science · IEEE Transactions on Consumer Electronics · February 2004 · cited 8× · DOI ↗ · more like this ·

The client's buffer requirement, the server network bandwidth, and the access latency are three key parameters for the design of video-on-demand (VoD) system. Many schemes have been proposed to provide VoD service, one of which is the mirrored-pyramid broadcasting (MPB) scheme. However, it is not optimal with regard to the client's buffer requirement, the bandwidth utilization, and the access latency. After discussing the drawbacks of the MPB scheme, we propose an advanced mirrored-pyramid broadcasting (AMPB) scheme, which has a novel channel design and a novel broadcast schedule. Experimental results show that AMPB saves up to 75% of the client's buffer and 50% of the server network bandwidth. It also achieves a better access latency.