arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ling Yu

573 papers · 1971–2026

1971: 11972: 11973: 11974: 11975: 01976: 01977: 11978: 11979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 11989: 01990: 01991: 01992: 11993: 21994: 41995: 01996: 01997: 01998: 31999: 02000: 12001: 52002: 52003: 162004: 182005: 132006: 212007: 122008: 132009: 162010: 252011: 292012: 292013: 242014: 362015: 352016: 112017: 172018: 282019: 322020: 292021: 272022: 232023: 222024: 212025: 282026: 20
1971peak 36 in 20142026

Frequent co-authors

Papers

showing 1–25 of 573 RSS

NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understanding

Jun Liu, Amir Shahroudy, Mauricio Perez +3 more

cs.CV · · cited 1,822× · arXiv ↗ · more like this ·

Research on depth-based human activity analysis achieved outstanding performance and demonstrated the effectiveness of 3D representation for action recognition. The existing depth-based and RGB+D-based action recognition benchmarks have a number of limitations, including the lack of large-scale training samples, realistic number of distinct class categories, diversity in camera views, varied environmental conditions, and variety of human subjects. In this work, we introduce a large-scale dataset for RGB+D human action recognition, which is collected from 106 distinct subjects and contains more than 114 thousand video samples and 8 million frames. This dataset contains 120 different action classes including daily, mutual, and health-related activities. We evaluate the performance of a series of existing 3D activity analysis methods on this dataset, and show the advantage of applying deep…

Global Context-Aware Attention LSTM Networks for 3D Action Recognition

Jun Liu, Gang Wang, Ping Hu +2 more

Computer Vision and Pattern Recognition · Lancaster EPrints (Lancaster University) · · cited 685× · DOI ↗ · more like this ·

Long Short-Term Memory (LSTM) networks have shown superior performance in 3D human action recognition due to their power in modeling the dynamics and dependencies in sequential data. Since not all joints are informative for action analysis and the irrelevant joints often bring a lot of noise, we need to pay more attention to the informative ones. However, original LSTM does not have strong attention capability. Hence we propose a new class of LSTM network, Global Context-Aware Attention LSTM (GCA-LSTM), for 3D action recognition, which is able to selectively focus on the informative joints in the action sequence with the assistance of global contextual information. In order to achieve a reliable attention representation for the action sequence, we further propose a recurrent attention mechanism for our GCA-LSTM network, in which the attention performance is improved iteratively.…

Skeleton-Based Human Action Recognition with Global Context-Aware Attention LSTM Networks

Jun Liu, Gang Wang, Ling-Yu Duan +2 more

cs.CV · · cited 555× · arXiv ↗ · more like this ·

Human action recognition in 3D skeleton sequences has attracted a lot of research attention. Recently, Long Short-Term Memory (LSTM) networks have shown promising performance in this task due to their strengths in modeling the dependencies and dynamics in sequential data. As not all skeletal joints are informative for action recognition, and the irrelevant joints often bring noise which can degrade the performance, we need to pay more attention to the informative ones. However, the original LSTM network does not have explicit attention ability. In this paper, we propose a new class of LSTM network, Global Context-Aware Attention LSTM (GCA-LSTM), for skeleton based action recognition. This network is capable of selectively focusing on the informative joints in each frame of each skeleton sequence by using a global context memory cell. To further improve the attention capability of our…

Fine-tuning Global Model via Data-Free Knowledge Distillation for Non-IID Federated Learning

Lin Zhang, Li Shen, Liang Ding +2 more

cs.LG · · cited 447× · arXiv ↗ · more like this ·

Federated Learning (FL) is an emerging distributed learning paradigm under privacy constraint. Data heterogeneity is one of the main challenges in FL, which results in slow convergence and degraded performance. Most existing approaches only tackle the heterogeneity challenge by restricting the local model update in client, ignoring the performance drop caused by direct global model aggregation. Instead, we propose a data-free knowledge distillation method to fine-tune the global model in the server (FedFTG), which relieves the issue of direct model aggregation. Concretely, FedFTG explores the input space of local models through a generator, and uses it to transfer the knowledge from local models to the global model. Besides, we propose a hard sample mining scheme to achieve effective knowledge distillation throughout the training. In addition, we develop customized label sampling and…

Video Coding for Machines: A Paradigm of Collaborative Compression and Intelligent Analytics

Ling-Yu Duan, Jiaying Liu, Wenhan Yang +2 more

cs.CV · · cited 270× · arXiv ↗ · more like this ·

Video coding, which targets to compress and reconstruct the whole frame, and feature compression, which only preserves and transmits the most critical information, stand at two ends of the scale. That is, one is with compactness and efficiency to serve for machine vision, and the other is with full fidelity, bowing to human perception. The recent endeavors in imminent trends of video compression, e.g. deep learning based coding tools and end-to-end image/video coding, and MPEG-7 compact feature descriptor standards, i.e. Compact Descriptors for Visual Search and Compact Descriptors for Video Analysis, promote the sustainable and fast development in their own directions, respectively. In this paper, thanks to booming AI technology, e.g. prediction and generation models, we carry out exploration in the new area, Video Coding for Machines (VCM), arising from the emerging MPEG…

Group-Sensitive Triplet Embedding for Vehicle Reidentification

Yan Bai, Yihang Lou, Feng Gao +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 270× · DOI ↗ · more like this ·

The widespread use of surveillance cameras toward smart and safe cities poses the critical but challenging problem of vehicle reidentification (Re-ID). The state-of-the-art research work performed vehicle Re-ID relying on deep metric learning with a triplet network. However, most existing methods basically ignore the impact of intraclass variance-incorporated embedding on the performance of vehicle reidentification, in which robust fine-grained features for large-scale vehicle Re-ID have not been fully studied. In this paper, we propose a deep metric learning method, group-sensitive-triplet embedding (GS-TRE), to recognize and retrieve vehicles, in which intraclass variance is elegantly modeled by incorporating an intermediate representation “group” between samples and each individual vehicle in the triplet network learning. To capture the intraclass variance attributes of each…

Uncertainty Modeling for Out-of-Distribution Generalization

Xiaotong Li, Yongxing Dai, Yixiao Ge +3 more

cs.CV · · cited 268× · arXiv ↗ · more like this ·

Though remarkable progress has been achieved in various vision tasks, deep neural networks still suffer obvious performance degradation when tested in out-of-distribution scenarios. We argue that the feature statistics (mean and standard deviation), which carry the domain characteristics of the training data, can be properly manipulated to improve the generalization ability of deep learning models. Common methods often consider the feature statistics as deterministic values measured from the learned features and do not explicitly consider the uncertain statistics discrepancy caused by potential domain shifts during testing. In this paper, we improve the network generalization ability by modeling the uncertainty of domain shifts with synthesized feature statistics during training. Specifically, we hypothesize that the feature statistic, after considering the potential uncertainties…

A unified framework for semantic shot classification in sports video

Ling‐Yu Duan, Min Xu, Qi Tian +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 209× · DOI ↗ · more like this ·

The extensive amount of multimedia information available necessitates content-based video indexing and retrieval methods. Since humans tend to use high-level semantic concepts when querying and browsing multimedia databases, there is an increasing need for semantic video indexing and analysis. For this purpose, we present a unified framework for semantic shot classification in sports video, which has been widely studied due to tremendous commercial potentials. Unlike most existing approaches, which focus on clustering by aggregating shots or key-frames with similar low-level features, the proposed scheme employs supervised learning to perform a top-down video shot classification. Moreover, the supervised learning procedure is constructed on the basis of effective mid-level representations instead of exhaustive low-level features. This framework consists of three main steps: 1) identify…

The analytic network process (ANP) approach to location selection: a shopping mall illustration

Eddie W.L. Cheng, Heng Li, Ling Yu

Transportation · Construction Innovation · · cited 184× · DOI ↗ · more like this ·

This paper presents the employment of the analytic network process (ANP) to select the best site for a shopping mall. ANP is an innovative and robust multicriteria decision‐making (MCDM) method because it can produce a comprehensive analytic framework for solving societal, governmental, and corporate decision problems. Yet, there is a lack of published papers in the construction field demonstrating the method with illustrative examples. In the current paper, it is suggested that ANP is appropriate for shopping mall location selection. An example is therefore demonstrated. In order to explicate the difference between ANP and analytic hierarchy process (AHP), the findings obtained from the two methods are compared. Results of the comparison indicate that ANP is a powerful tool to solve the decision problem if interdependent relationships have substantial impacts in the decision model.

Embedding Adversarial Learning for Vehicle Re-Identification

Yihang Lou, Yan Bai, Jun Liu +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 182× · DOI ↗ · more like this ·

The high similarities of different real-world vehicles and great diversities of the acquisition views pose grand challenges to vehicle re-identification (ReID), which traditionally maps the vehicle images into a high-dimensional embedding space for distance optimization, vehicle discrimination, and identification. To improve the discriminative capability and robustness of the ReID algorithm, we propose a novel end-to-end embedding adversarial learning network (EALN) that is capable of generating samples localized in the embedding space. Instead of selecting abundant hard negatives from the training set, which is extremely difficult if not impossible, with our embedding adversarial learning scheme, the automatically generated hard negative samples in the specified embedding space can greatly improve the capability of the network for discriminating similar vehicles. Moreover, the more…

Benchmarking Single-Image Reflection Removal Algorithms

Renjie Wan, Boxin Shi, Ling‐Yu Duan +2 more

Computer Vision and Pattern Recognition · Institutional Knowledge (InK) - Institutional Knowledge at Singapore Management University (Singapore Management University) · · cited 178× · DOI ↗ · more like this ·

Removing undesired reflections from a photo taken in front of a glass is of great importance for enhancing the efficiency of visual computing systems. Various approaches have been proposed and shown to be visually plausible on small datasets collected by their authors. A quantitative comparison of existing approaches using the same dataset has never been conducted due to the lack of suitable benchmark data with ground truth. This paper presents the first captured Single-image Reflection Removal dataset ‘SIR2’ with 40 controlled and 100 wild scenes, ground truth of background and reflection. For each controlled scene, we further provide ten sets of images under varying aperture settings and glass thicknesses. We perform quantitative and visual quality comparisons for four state-of-the-art single-image reflection removal algorithms using four error metrics. Open problems for improving…

Generalizable Person Re-identification with Relevance-aware Mixture of Experts

Yongxing Dai, Xiaotong Li, Jun Liu +2 more

cs.CV · · cited 173× · arXiv ↗ · more like this ·

Domain generalizable (DG) person re-identification (ReID) is a challenging problem because we cannot access any unseen target domain data during training. Almost all the existing DG ReID methods follow the same pipeline where they use a hybrid dataset from multiple source domains for training, and then directly apply the trained model to the unseen target domains for testing. These methods often neglect individual source domains' discriminative characteristics and their relevances w.r.t. the unseen target domains, though both of which can be leveraged to help the model's generalization. To handle the above two issues, we propose a novel method called the relevance-aware mixture of experts (RaMoE), using an effective voting-based mixture mechanism to dynamically leverage source domains' diverse characteristics to improve the model's generalization. Specifically, we propose a…

A mid-level representation framework for semantic sports video analysis

Ling‐Yu Duan, Min Xu, Tat‐Seng Chua +2 more

Computer Vision and Pattern Recognition · National University of Singapore · · cited 163× · DOI ↗ · more like this ·

Sports video has been widely studied due to its tremendous commercial potentials. Despite encouraging results from various specific sports games, it is almost impossible to extend a system for a new sports game because they usually employ different sets of low-level features appropriate for the specific games and closely coupled with the use of game specific rules to detect events or highlights. There is a lack of internal representation and structure to be generic and applicable for many different sports. In this paper, we present a generic mid-level representation framework for semantic sports video analysis. The mid-level representation layer is introduced between the low-level audiovisual processing and high-level semantic analysis. It allows us to separate sports specific knowledge and rules from the low-level and mid-level feature extraction. This makes sports video analysis more…

IDM: An Intermediate Domain Module for Domain Adaptive Person Re-ID

Yongxing Dai, Jun Liu, Yifan Sun +3 more

cs.CV · · cited 154× · arXiv ↗ · more like this ·

Unsupervised domain adaptive person re-identification (UDA re-ID) aims at transferring the labeled source domain's knowledge to improve the model's discriminability on the unlabeled target domain. From a novel perspective, we argue that the bridging between the source and target domains can be utilized to tackle the UDA re-ID task, and we focus on explicitly modeling appropriate intermediate domains to characterize this bridging. Specifically, we propose an Intermediate Domain Module (IDM) to generate intermediate domains' representations on-the-fly by mixing the source and target domains' hidden representations using two domain factors. Based on the "shortest geodesic path" definition, i.e., the intermediate domains along the shortest geodesic path between the two extreme domains can play a better bridging role, we propose two properties that these intermediate domains should satisfy.…

Skeleton-Based Online Action Prediction Using Scale Selection Network

Jun Liu, Amir Shahroudy, Gang Wang +2 more

cs.CV · · cited 151× · arXiv ↗ · more like this ·

Action prediction is to recognize the class label of an ongoing activity when only a part of it is observed. In this paper, we focus on online action prediction in streaming 3D skeleton sequences. A dilated convolutional network is introduced to model the motion dynamics in temporal dimension via a sliding window over the temporal axis. Since there are significant temporal scale variations in the observed part of the ongoing action at different time steps, a novel window scale selection method is proposed to make our network focus on the performed part of the ongoing action and try to suppress the possible incoming interference from the previous actions at each step. An activation sharing scheme is also proposed to handle the overlapping computations among the adjacent time steps, which enables our framework to run more efficiently. Moreover, to enhance the performance of our framework…

Unified Spatio-Temporal Attention Networks for Action Recognition in Videos

Dong Li, Ting Yao, Ling‐Yu Duan +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 141× · DOI ↗ · more like this ·

Recognizing actions in videos is not a trivial task because video is an information-intensive media and includes multiple modalities. Moreover, on each modality, an action may only appear at some spatial regions, or only part of the temporal video segments may contain the action. A valid question is how to locate the attended spatial areas and selective video segments for action recognition. In this paper, we devise a general attention neural cell, called AttCell, that estimates the attention probability not only at each spatial location but also for each video segment in a temporal sequence. With AttCell, a unified Spatio-Temporal Attention Networks (STAN) is proposed in the context of multiple modalities. Specifically, STAN extracts the feature map of one convolutional layer as the local descriptors on each modality and pools the extracted descriptors with the spatial attention…

Overview of the MPEG CDVS Standard

Ling‐Yu Duan, Tiejun Huang, Wen Gao

Computer Vision and Pattern Recognition · · cited 138× · DOI ↗ · more like this ·

Towards mobile visual search, compact visual descriptors have been well advocated in both academic and industry endeavors. Moving Picture Experts Group (MPEG) initiated the remarkable Compact Descriptors for Visual Search (CDVS) standard activity in Jan. 2010 to push forward the frontiers of compact descriptors in mobile internet industry. In Oct. 2014, MPEG CDVS successfully entered the Final Draft of International Standard. CDVS made a series of significant breakthroughs in high performance and low complexity compact descriptors. In this paper, we give an overview of the MPEG CDVS standard, with emphasis on the development of the core techniques and their technical merits.

Toward Intelligent Sensing: Intermediate Deep Feature Compression

Zhuo Chen, Kui Fan, Shiqi Wang +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 133× · DOI ↗ · more like this ·

The recent advances of hardware technology have made the intelligent analysis equipped at the front-end with deep learning more prevailing and practical. To better enable the intelligent sensing at the front-end, instead of compressing and transmitting visual signals or the ultimately utilized top-layer deep learning features, we propose to compactly represent and convey the intermediate-layer deep learning features with high generalization capability, to facilitate the collaborating approach between front and cloud ends. This strategy enables a good balance among the computational load, transmission load and the generalization ability for cloud servers when deploying the deep neural networks for large scale cloud based visual analysis. Moreover, the presented strategy also makes the standardization of deep feature coding more feasible and promising, as a series of tasks can…

Feature Boosting Network For 3D Pose Estimation

Jun Liu, Henghui Ding, Amir Shahroudy +4 more

cs.CV · · cited 130× · arXiv ↗ · more like this ·

In this paper, a feature boosting network is proposed for estimating 3D hand pose and 3D body pose from a single RGB image. In this method, the features learned by the convolutional layers are boosted with a new long short-term dependence-aware (LSTD) module, which enables the intermediate convolutional feature maps to perceive the graphical long short-term dependency among different hand (or body) parts using the designed Graphical ConvLSTM. Learning a set of features that are reliable and discriminatively representative of the pose of a hand (or body) part is difficult due to the ambiguities, texture and illumination variation, and self-occlusion in the real application of 3D pose estimation. To improve the reliability of the features for representing each body part and enhance the LSTD module, we further introduce a context consistency gate (CCG) in this paper, with which the…

CRRN: Multi-Scale Guided Concurrent Reflection Removal Network

Renjie Wan, Boxin Shi, Ling-Yu Duan +2 more

cs.CV · · cited 126× · arXiv ↗ · more like this ·

Removing the undesired reflections from images taken through the glass is of broad application to various computer vision tasks. Non-learning based methods utilize different handcrafted priors such as the separable sparse gradients caused by different levels of blurs, which often fail due to their limited description capability to the properties of real-world reflections. In this paper, we propose the Concurrent Reflection Removal Network (CRRN) to tackle this problem in a unified framework. Our proposed network integrates image appearance information and multi-scale gradient information with human perception inspired loss function, and is trained on a new dataset with 3250 reflection images taken under diverse real-world scenes. Extensive experiments on a public benchmark dataset show that the proposed method performs favorably against state-of-the-art methods.

Learning to Distribute Vocabulary Indexing for Scalable Visual Search

Rongrong Ji, Ling‐Yu Duan, Jie Chen +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 105× · DOI ↗ · more like this ·

In recent years, there is an ever-increasing research focus on Bag-of-Words based near duplicate visual search paradigm with inverted indexing. One fundamental yet unexploited challenge is how to maintain the large indexing structures within a single server subject to its memory constraint, which is extremely hard to scale up to millions or even billions of images. In this paper, we propose to parallelize the near duplicate visual search architecture to index millions of images over multiple servers, including the distribution of both visual vocabulary and the corresponding indexing structure. We optimize the distribution of vocabulary indexing from a machine learning perspective, which provides a “memory light” search paradigm that leverages the computational power across multiple servers to reduce the search latency. Especially, our solution addresses two essential issues: “What to…

Spectrum Prediction Based on Taguchi Method in Deep Learning With Long Short-Term Memory

Ling Yu, Jin Chen, Guoru Ding +3 more

Signal Processing · IEEE Access · · cited 98× · DOI ↗ · more like this ·

Spectrum prediction is a promising technology in cognitive radio networks, since it can reduce considerable time and energy consumed in spectrum sensing process. Many spectrum prediction algorithms have achieved good performance, but majority of them with shallow architecture cannot capture the inherent correlations of spectrum data very well. Long short-term memory (LSTM) neural network in deep learning has been validated to have strong capability of solving time series problems. In this paper, we develop a spectrum prediction framework with a deep learning approach on two real-world spectrum datasets. For the first dataset to predict channel occupancy states, we firstly employ the taguchi method to determine the best optimized configuration of neural network for certain spectrum point and then analyze the effect of each design hyper-parameter. Next, we build LSTM neural networks with…

CoRRN: Cooperative Reflection Removal Network

Renjie Wan, Boxin Shi, Haoliang Li +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 96× · DOI ↗ · more like this ·

Removing the undesired reflections from images taken through the glass is of broad application to various computer vision tasks. Non-learning based methods utilize different handcrafted priors such as the separable sparse gradients caused by different levels of blurs, which often fail due to their limited description capability to the properties of real-world reflections. In this paper, we propose a network with the feature-sharing strategy to tackle this problem in a cooperative and unified framework, by integrating image context information and the multi-scale gradient information. To remove the strong reflections existed in some local regions, we propose a statistic loss by considering the gradient level statistics between the background and reflections. Our network is trained on a new dataset with 3250 reflection images taken under diverse real-world scenes. Experiments on a public…

CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI

Alex Ling Yu Hung, Haoxin Zheng, Qi Miao +3 more

eess.IV · · cited 89× · arXiv ↗ · more like this ·

Prostate cancer is the second leading cause of cancer death among men in the United States. The diagnosis of prostate MRI often relies on the accurate prostate zonal segmentation. However, state-of-the-art automatic segmentation methods often fail to produce well-contained volumetric segmentation of the prostate zones since certain slices of prostate MRI, such as base and apex slices, are harder to segment than other slices. This difficulty can be overcome by accounting for the cross-slice relationship of adjacent slices, but current methods do not fully learn and exploit such relationships. In this paper, we propose a novel cross-slice attention mechanism, which we use in a Transformer module to systematically learn the cross-slice relationship at different scales. The module can be utilized in any existing learning-based segmentation framework with skip connections. Experiments show…

Market2Dish: Health-aware Food Recommendation

Wenjie Wang, Ling-yu Duan, Hao Jiang +3 more

cs.IR · · cited 89× · arXiv ↗ · more like this ·

With the rising incidence of some diseases, such as obesity and diabetes, a healthy diet is arousing increasing attention. However, most existing food-related research efforts focus on recipe retrieval, user preference-based food recommendation, cooking assistance, or the nutrition and calorie estimation of dishes, ignoring the personalized health-aware food recommendation. Therefore, in this work, we present a personalized health-aware food recommendation scheme, namely Market2Dish, mapping the ingredients displayed in the market to the healthy dishes eaten at home. The proposed scheme comprises three components, namely recipe retrieval, user-health profiling, and health-aware food recommendation. In particular, recipe retrieval aims to acquire the ingredients available to the users, and then retrieve recipe candidates from a large-scale recipe dataset. User health profiling is to…