arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Li‐Wei Kang

81 papers · 1927–2026

1967: 01968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 01978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 12004: 32005: 52006: 02007: 02008: 02009: 22010: 22011: 52012: 92013: 122014: 22015: 72016: 52017: 12018: 32019: 52020: 42021: 22022: 22023: 42024: 22025: 22026: 2
1967peak 12 in 20132026

Frequent co-authors

Papers

showing 1–25 of 81 RSS

Automatic Single-Image-Based Rain Streaks Removal via Image Decomposition

Li-Wei Kang, Chia‐Wen Lin, Yu-Hsiang Fu

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 922× · DOI ↗ · more like this ·

Rain removal from a video is a challenging problem and has been recently investigated extensively. Nevertheless, the problem of rain removal from a single image was rarely studied in the literature, where no temporal information among successive images can be exploited, making the problem very challenging. In this paper, we propose a single-image-based rain removal framework via properly formulating rain removal as an image decomposition problem based on morphological component analysis. Instead of directly applying a conventional image decomposition technique, the proposed method first decomposes an image into the low- and high-frequency (HF) parts using a bilateral filter. The HF part is then decomposed into a "rain component" and a "nonrain component" by performing dictionary learning and sparse coding. As a result, the rain component can be successfully removed from the image while…

Lightweight Deep Neural Network for Joint Learning of Underwater Object Detection and Color Conversion

Chia-Hung Yeh, Chu-Han Lin, Li-Wei Kang +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks and Learning Systems · · cited 248× · DOI ↗ · more like this ·

Underwater image processing has been shown to exhibit significant potential for exploring underwater environments. It has been applied to a wide variety of fields, such as underwater terrain scanning and autonomous underwater vehicles (AUVs)-driven applications, such as image-based underwater object detection. However, underwater images often suffer from degeneration due to attenuation, color distortion, and noise from artificial lighting sources as well as the effects of possibly low-end optical imaging devices. Thus, object detection performance would be degraded accordingly. To tackle this problem, in this article, a lightweight deep underwater object detection network is proposed. The key is to present a deep model for jointly learning color conversion and object detection for underwater images. The image color conversion module aims at transforming color images to the corresponding…

Self-Learning Based Image Decomposition With Applications to Single Image Denoising

De-An Huang, Li‐Wei Kang, Yu-Chiang Frank Wang +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 227× · DOI ↗ · more like this ·

Decomposition of an image into multiple semantic components has been an effective research topic for various image processing applications such as image denoising, enhancement, and inpainting. In this paper, we present a novel self-learning based image decomposition framework. Based on the recent success of sparse representation, the proposed framework first learns an over-complete dictionary from the high spatial frequency parts of the input image for reconstruction purposes. We perform unsupervised clustering on the observed dictionary atoms (and their corresponding reconstructed image versions) via affinity propagation, which allows us to identify image-dependent components with similar context information. While applying the proposed method for the applications of image denoising, we are able to automatically determine the undesirable patterns (e.g., rain streaks or Gaussian noise)…

Visual Depth Guided Color Image Rain Streaks Removal Using Sparse Coding

Duan-Yu Chen, Chien-Cheng Chen, Li-Wei Kang

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 185× · DOI ↗ · more like this ·

Rain removal from a single color image is a challenging problem as no temporal information among successive images can be obtained. In this paper, we propose a single-color-image-based rain removal framework by properly formulating rain removal as an image decomposition problem based on sparse representation. In our framework, an input color image is first decomposed into a low-frequency part and a high-frequency part by using the guided image filter so that the rain streaks would be in the high-frequency part with nonrain textures/edges, and the high-frequency part is then decomposed into a rain component and a nonrain component by performing dictionary learning and sparse coding. To separate rain streaks from the high-frequency part, a hybrid feature set, including histogram of oriented gradients, depth of field, and Eigen color, is employed to further decompose the high-frequency…

Multi-Scale Deep Residual Learning-Based Single Image Haze Removal via Image Decomposition

Chia-Hung Yeh, Chih-Hsiang Huang, Li-Wei Kang

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 148× · DOI ↗ · more like this ·

Images/videos captured from outdoor visual devices are usually degraded by turbid media, such as haze, smoke, fog, rain, and snow. Haze is the most common one in outdoor scenes due to the atmosphere conditions. In this paper, a novel deep learning-based architecture (denoted by MSRL-DehazeNet) for single image haze removal relying on multi-scale residual learning (MSRL) and image decomposition is proposed. Instead of learning an end-to-end mapping between each pair of hazy image and its corresponding haze-free one adopted by most existing learningbased approaches, we reformulate the problem as restoration of the image base component. Based on the decomposition of a hazy image into the base and the detail components, haze removal (or dehazing) can be achieved by both of our multi-scale deep residual learning and our simplified U-Net learning only for mapping between hazy and haze-free…

Context-Aware Single Image Rain Removal

De-An Huang, Li‐Wei Kang, Min-Chun Yang +2 more

Computer Vision and Pattern Recognition · · cited 113× · DOI ↗ · more like this ·

Rain removal from a single image is one of the challenging image denoising problems. In this paper, we present a learning-based framework for single image rain removal, which focuses on the learning of context information from an input image, and thus the rain patterns present in it can be automatically identified and removed. We approach the single image rain removal problem as the integration of image decomposition and self-learning processes. More precisely, our method first performs context-constrained image segmentation on the input image, and we learn dictionaries for the high-frequency components in different context categories via sparse coding for reconstruction purposes. For image regions with rain streaks, dictionaries of distinct context categories will share common atoms which correspond to the rain patterns. By utilizing PCA and SVM classifiers on the learned dictionaries…

Haze effect removal from image via haze density estimation in optical model

Chia-Hung Yeh, Li-Wei Kang, Ming‐Sui Lee +1 more

Computer Vision and Pattern Recognition · Optics Express · · cited 101× · DOI ↗ · more like this ·

Images/videos captured from optical devices are usually degraded by turbid media such as haze, smoke, fog, rain and snow. Haze is the most common problem in outdoor scenes because of the atmosphere conditions. This paper proposes a novel single image-based dehazing framework to remove haze artifacts from images, where we propose two novel image priors, called the pixel-based dark channel prior and the pixel-based bright channel prior. Based on the two priors with the haze optical model, we propose to estimate atmospheric light via haze density analysis. We can then estimate transmission map, followed by refining it via the bilateral filter. As a result, high-quality haze-free images can be recovered with lower computational complexity compared with the state-of-the-art approach based on patch-based dark channel prior.

Single-frame-based rain removal via image decomposition

Yu-Hsiang Fu, Li‐Wei Kang, Chia‐Wen Lin +1 more

Computer Vision and Pattern Recognition · · cited 96× · DOI ↗ · more like this ·

Rain removal from a video is a challenging problem and has been recently investigated extensively. Nevertheless, the problem of rain removal from a single image has been rarely studied in the literature, where no temporal information among successive images can be exploited, making it more challenging. In this paper, to the best of our knowledge, we are among the first to propose a single-frame-based rain removal framework via properly formulating rain removal as an image decomposition problem based on morphological component analysis (MCA). Instead of directly applying conventional image decomposition technique, we first decompose an image into the low-frequency and high frequency parts using a bilateral filter. The high-frequency part is then decomposed into "rain component" and "non rain component" via performing dictionary learning and sparse coding. As a result, the rain component…

Learning-Based Joint Super-Resolution and Deblocking for a Highly Compressed Image

Li‐Wei Kang, Chih–Chung Hsu, Boqi Zhuang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 84× · DOI ↗ · more like this ·

A highly compressed image is usually not only of low resolution, but also suffers from compression artifacts (blocking artifact is treated as an example in this paper). Directly performing image super-resolution (SR) to a highly compressed image would also simultaneously magnify the blocking artifacts, resulting in an unpleasing visual experience. In this paper, we propose a novel learning-based framework to achieve joint single-image SR and deblocking for a highly-compressed image. We argue that individually performing deblocking and SR (i.e., deblocking followed by SR, or SR followed by deblocking) on a highly compressed image usually cannot achieve a satisfactory visual quality. In our method, we propose to learn image sparse representations for modeling the relationship between low- and high-resolution image patches in terms of the learned dictionaries for image patches with and…

Feature-Based Sparse Representation for Image Similarity Assessment

Li‐Wei Kang, Chao-Yung Hsu, Hung‐Wei Chen +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 75× · DOI ↗ · more like this ·

Assessment of image similarity is fundamentally important to numerous multimedia applications. The goal of similarity assessment is to automatically assess the similarities among images in a perceptually consistent manner. In this paper, we interpret the image similarity assessment problem as an information fidelity problem. More specifically, we propose a feature-based approach to quantify the information that is present in a reference image and how much of this information can be extracted from a test image to assess the similarity between the two images. Here, we extract the feature points and their descriptors from an image, followed by learning the dictionary/basis for the descriptors in order to interpret the information present in this image. Then, we formulate the problem of the image similarity assessment in terms of sparse representation. To evaluate the applicability of the…

Scene-Based Movie Summarization Via Role-Community Networks

Chia-Ming Tsai, Li‐Wei Kang, Chia‐Wen Lin +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 67× · DOI ↗ · more like this ·

Video summarization techniques aim at condensing a full-length video to a significantly shortened version that still preserves the major semantic content of the original video. Movie summarization, being a special class of video summarization, is particularly challenging since a large variety of movie scenarios and film styles complicate the problem. In this paper, we propose a two-stage scene-based movie summarization method based on mining the relationship between role-communities since the role-communities in earlier scenes are usually used to develop the role relationship in later scenes. In the analysis stage, we construct a social network to characterize the interactions between role-communities. As a result, the social power of each role-community is evaluated by the community's centrality value and the role communities are clustered into relevant groups based on the centrality…

Sequential Dual Attention Network for Rain Streak Removal in a Single Image

Chih‐Yang Lin, Tao Zhuang, Aisheng Xu +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 63× · DOI ↗ · more like this ·

Various weather conditions, such as rain, haze, or snow, can degrade visual quality in images/videos, which may significantly degrade the performance of related applications. In this paper, a novel framework based on sequential dual attention deep network is proposed for removing rain streaks (deraining) in a single image, called by SSDRNet (Sequential dual attentionbased Single image DeRaining deep Network). Since the inherent correlation among rain steaks within an image should be stronger than that between the rain streaks and the background (non-rain) pixels, a two-stage learning strategy is implemented to better capture the distribution of rain streaks within a rainy image. The two-stage deep neural network primarily involves three blocks: residual dense blocks (RDBs), sequential dual attention blocks (SDABs), and multi-scale feature aggregation modules (MAMs), which are all…

Deep Learning-Based Weather Image Recognition

Li‐Wei Kang, Ke-Lin Chou, Ru-Hong Fu

Computer Vision and Pattern Recognition · · cited 49× · DOI ↗ · more like this ·

Image data captured from outdoor visual devices are usually degraded by turbid media, such as haze, smoke, fog, rain, or snow. Therefore, weather conditions would usually disrupt or degrade proper functioning of vision-assisted transportation systems or ADAS (advanced driver assistance systems), as well as several other outdoor surveillance-based systems. To cope with these problems, removal of weather effects (or deweathering) from images has been important and received much attention. Hence, it is important to provide a preprocessing stage to automatically determine the weather condition for an input image, and then the corresponding proper deweathering operations (e.g., removals of haze, rain, or snow) would be correctly triggered accordingly. This paper presents a deep learning-based weather image recognition framework by considering the three most common weather conditions…

Self-learning-based rain streak removal for image/video

Li‐Wei Kang, Chia‐Wen Lin, Che-Tsung Lin +1 more

Computer Vision and Pattern Recognition · · cited 44× · DOI ↗ · more like this ·

Rain removal from an image/video is a challenging problem and has been recently investigated extensively. In our previous work, we have proposed the first single-image-based rain streak removal framework via properly formulating it as an image decomposition problem based on morphological component analysis (MCA) solved by performing dictionary learning and sparse coding. However, in this previous work, the dictionary learning process cannot be fully automatic, where the two dictionaries used for rain removal were selected heuristically or by human intervention. In this paper, we extend our previous work to propose an automatic self-learning-based rain streak removal framework for single image. We propose to automatically self-learn the two dictionaries used for rain removal without additional information or any assumption. We then extend our single-image-based method to video-based rain…

Enhanced Visual Attention-Guided Deep Neural Networks for Image Classification

Chia‐Hung Yeh, Min-Hui Lin, Po-Chao Chang +1 more

Computer Vision and Pattern Recognition · IEEE Access · · cited 38× · DOI ↗ · more like this ·

A fully connected layer is essential for a CNN, i.e., convolutional neural network, which has been shown to be successful in classifying images in several related applications. A CNN begins with convolution and pooling operations for decomposing an input image into features. The result of this process is then fed into a fully connected neural network, driving the final classification decision for the input image. However, it has been found that the learned feature maps in a CNN are sometimes not good enough for being fed into the fully connected layers to get good classification results. In this article, a visual attention learning module is proposed to enhance the classification capability of the fully connected layers in a CNN. By learning better feature maps to emphasize salient regions and weaken meaningless regions, better classification performance can be obtained with integrating…

Efficient image/video dehazing through haze density analysis based on pixel-based dark channel prior

Chia‐Hung Yeh, Li‐Wei Kang, Cheng-Yang Lin +1 more

Computer Vision and Pattern Recognition · · cited 31× · DOI ↗ · more like this ·

Images/videos of outdoor scenes are usually degraded by the turbid medium in the atmosphere. In this paper, a novel single image-based dehazing framework is proposed to remove haze effects from image/video, where we propose two novel image priors, called the pixel-based dark channel prior and the pixel-based bright channel prior. Based on the two priors with the haze imaging model, we propose to accurately estimate the atmospheric light via haze density analysis. We can then accurately estimate the transmission map, followed by refining it via the bilateral filter. As a result, high-quality haze-free image can be recovered with lower computational complexity, which can be naturally extended to video dehazing.

Popularity Prediction of Social Media based on Multi-Modal Feature Mining

Chih–Chung Hsu, Li‐Wei Kang, Chia‐Yen Lee +3 more

Artificial Intelligence · · cited 30× · DOI ↗ · more like this ·

Popularity prediction of social media becomes a more attractive issue in recent years. It consists of multi-type data sources such as image, meta-data, and text information. In order to effectively predict the popularity of a specified post in the social network, fusing multi-feature from heterogeneous data is required. In this paper, a popularity prediction framework for social media based on multi-modal feature mining is presented. First, we discover image semantic features by extracting their image descriptions generated by image captioning. Second, an effective text-based feature engineering is used to construct an effective word-to-vector model. The trained word-to-vector model is used to encode the text information and the semantic image features. Finally, an ensemble regression approach is proposed to aggregate these encoded features and learn the final regressor. Extensive…

Identification and tracking of players in sport videos

Chun-Wei Lu, Chih‐Yang Lin, Chao-Yung Hsu +3 more

Computer Vision and Pattern Recognition · · cited 27× · DOI ↗ · more like this ·

In this paper, we propose a novel framework to automatically perform player tracking and identification for sport videos filmed by a single pan-tilt-zoom camera from the court view. The proposed scheme is separated into three parts. The first part is to detect players by a deformable part model. The second part is to recognize jersey numbers by gradient differences and optical character recognition. The final part applies particle filters to track players. Experimental results demonstrate the efficacy of the proposed algorithm and the feasibility for sports video analysis.

GAIN

Jianfu Zhang, Li Niu, Dexin Yang +4 more

Computer Vision and Pattern Recognition · · cited 25× · DOI ↗ · more like this ·

Image inpainting, which aims to fill the missing holes of the images, is a challenging task because the holes may contain complicated structures or different possible layouts. Deep learning methods have shown promising performance in image inpainting but still, suffer from generating poor-structured artifacts when the holes are large and irregular. Some existing methods use edge inpainting to help image inpainting, with binary edge map obtained from image gradient. However, by only using the binary edge map, these methods discard the rich information in image gradient and thus leave some critical issues (e.g. , color discrepancy) unattended. In this paper, we propose Gradient Augmented Inpainting Network (GAIN), which uses image gradient information instead of edge information to facilitate image inpainting. Specifically, we formulate a multi-task learning framework which performs image…

An error resilient coding scheme for H.264 video transmission based on data embedding

Li‐Wei Kang, Jin-Jang Leou

Signal Processing · · cited 21× · DOI ↗ · more like this ·

For entropy-coded H.264 video frames, a transmission error in a codeword will not only affect the underlying codeword but also may affect subsequent codewords, resulting in a great degradation of the received video frames. In this study, an error resilient coding scheme for H.264 video transmission is proposed. At the encoder, for an H.264 I frame, the important data for each macroblock (MB) are extracted and embedded into the next frame by the proposed MB-interleaving slice-based data embedding scheme for I frames. For an H.264 P frame, two types of important data for each MB are extracted and embedded into the next frame by the proposed MB-interleaving slice-based data embedding scheme for P frames. At the decoder, if the important data for a corrupted MB can be correctly extracted, the extracted important data for the corrupted MB will facilitate the employed error concealment scheme…

Single Image Dehazing via Deep Learning-based Image Restoration

Chia-Hung Yeh, Chih-Hsiang Huang, Li‐Wei Kang +1 more

Computer Vision and Pattern Recognition · · cited 20× · DOI ↗ · more like this ·

Images/videos captured from outdoor visual devices are usually degraded by turbid media, such as haze, smoke, fog, rain, and snow. Haze is the most common one in outdoor scenes due to the atmosphere conditions. This paper presents a deep learning-based architecture for single image dehazing via image restoration. instead of learning an end-to-end mapping between each pair of hazy image and its corresponding haze-free one adopted by most existing approaches, we propose to transform the problem into the restoration of the image base component. By first decomposing the hazy image into the base and the detail components, haze removal can be achieved by learning a CNN (convolutional neural network) only for mapping between hazy and haze-free base components, while the detail component can be further enhanced. As a result, the final dehazed image is obtained by integrating the haze-removed…

Efficient CTU-based intra frame coding for HEVC based on deep learning

Zheng-Teng Zhang, Chia‐Hung Yeh, Li‐Wei Kang +1 more

Computer Vision and Pattern Recognition · · cited 20× · DOI ↗ · more like this ·

To further improve the compression efficiency of HEVC intra frame coding, in this paper, a deep learning-based framework is proposed. Inspired by recently developed deep learning models for image super-resolution (SR), we propose to train a CNN (convolutional neural network) model to precisely predict the residual information of each CTU (coding tree unit) at the HEVC encoder. As a result, better CTU reconstruction and better prediction for the compression of subsequent CTUs can be achieved. To reduce computational complexity, different from current CNN-based SR works, we propose to skip the non-linear mapping layer, and incorporate the residual learning to obtain better predicted residual for CTU encoding. Experimental results have shown that the proposed method achieves 3.2% bitrate reduction in average BDBR (Bjentegaard delta bit rate) with only 37% encoding complexity increased.

Vision-Based Fall Detection through Shape Features

Chih‐Yang Lin, Shang-Ming Wang, Jiawei Hong +2 more

Computer Vision and Pattern Recognition · · cited 20× · DOI ↗ · more like this ·

A major cause of deaths among the elderly relates to accidental falls. Such falls are of particular medical concern to this population because they often result in severe injuries, since senior citizens usually live alone and cannot ask for help when accidents happen. In this paper, we propose a fall detection system with the help of a Gaussian mixture background model to build the background before motion history image (MHI) is applied to analyze the fall behavior. Finally, two extra features, acceleration and angular acceleration, are proposed to more accurately determine whether a fall event has happened.

Self-learning-based single image super-resolution of a highly compressed image

Li‐Wei Kang, Bo-Chi Chuang, Chih–Chung Hsu +2 more

Computer Vision and Pattern Recognition · · cited 20× · DOI ↗ · more like this ·

Low-quality images are usually not only with low-resolution, but also suffer from compression artifacts (blocking artifact is treated as an example in this paper). Directly performing image super-resolution (SR) to a highly compressed (low-quality) image would also simultaneously magnify the blocking artifacts, resulting in unpleasing visual quality. In this paper, we propose a self-learning-based SR framework to simultaneously achieve single-image SR and compression artifact removal for a highly-compressed image. We argue that individually performing deblocking first, followed by SR to an image, would usually inevitably lose some image details induced by deblocking, which may be useful for SR, resulting in worse SR result. In our method, we propose to self-learn image sparse representation for modeling the relationship between low and high-resolution image patches in terms of the…

Secure SIFT-based sparse representation for image copy detection and recognition

Li‐Wei Kang, Chao-Yung Hsu, Hung‐Wei Chen +1 more

Computer Vision and Pattern Recognition · · cited 20× · DOI ↗ · more like this ·

In this paper, we formulate the problems of image copy detection and image recognition in terms of sparse representation. To achieve robustness, security, and efficient storage of image features, we propose to extract compact local feature descriptors via constructing the basis of the SIFT-based feature vectors extracted from the secure SIFT domain of an image. Image copy detection can be efficiently accomplished based on the sparse representations and reconstruction errors of the features extracted from an image possibly manipulated by signal processing or geometric attacks. For image recognition, we show that the features of a query image can be represented as sparse linear combinations of the features extracted from the training images belonging to the same cluster. Hence, image recognition can also be cast as a sparse representation problem. Then, we formulate our sparse…