Author

Xiang Yu

1,077 papers · 1753–2026

1967peak 89 in 20252026

Frequent co-authors

Papers

showing 1–25 of 1,077 RSS

Beyond PASCAL: A benchmark for 3D object detection in the wild

Xiang Yu, Roozbeh Mottaghi, Silvio Savarese

Computer Vision and Pattern Recognition · IEEE Winter Conference on Applications of Computer Vision · March 2014 · cited 799× · DOI ↗ · more like this ·

3D object detection and pose estimation methods have become popular in recent years since they can handle ambiguities in 2D images and also provide a richer description for objects compared to 2D object detectors. However, most of the datasets for 3D recognition are limited to a small amount of images per category or are captured in controlled environments. In this paper, we contribute PASCAL3D+ dataset, which is a novel and challenging dataset for 3D object detection and pose estimation. PASCAL3D+ augments 12 rigid categories of the PASCAL VOC 2012 [4] with 3D annotations. Furthermore, more images are added for each category from ImageNet [3]. PASCAL3D+ images exhibit much more variability compared to the existing 3D datasets, and on average there are more than 3,000 object instances per category. We believe this dataset will provide a rich testbed to study 3D detection and pose…

Learning to Track: Online Multi-object Tracking by Decision Making

Xiang Yu, Alexandre Alahi, Silvio Savarese

Computer Vision and Pattern Recognition · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · December 2015 · cited 716× · DOI ↗ · more like this ·

Online Multi-Object Tracking (MOT) has wide applications in time-critical video analysis scenarios, such as robot navigation and autonomous driving. In tracking-by-detection, a major challenge of online MOT is how to robustly associate noisy object detections on a new video frame with previously tracked objects. In this work, we formulate the online MOT problem as decision making in Markov Decision Processes (MDPs), where the lifetime of an object is modeled with a MDP. Learning a similarity function for data association is equivalent to learning a policy for the MDP, and the policy learning is approached in a reinforcement learning fashion which benefits from both advantages of offline-learning and online-learning for data association. Moreover, our framework can naturally handle the birth/death and appearance/disappearance of targets by treating them as state transitions in the MDP…

Data-driven 3D Voxel Patterns for object category recognition

Xiang Yu, Wongun Choi, Yuanqing Lin +1 more

Computer Vision and Pattern Recognition · June 2015 · cited 352× · DOI ↗ · more like this ·

Despite the great progress achieved in recognizing objects as 2D bounding boxes in images, it is still very challenging to detect occluded objects and estimate the 3D properties of multiple objects from a single image. In this paper, we propose a novel object representation, 3D Voxel Pattern (3DVP), that jointly encodes the key properties of objects including appearance, 3D shape, viewpoint, occlusion and truncation. We discover 3DVPs in a data-driven way, and train a bank of specialized detectors for a dictionary of 3DVPs. The 3DVP detectors are capable of detecting objects with specific visibility patterns and transferring the meta-data from the 3DVPs to the detected objects, such as 2D segmentation mask, 3D pose as well as occlusion or truncation boundaries. The transferred meta-data allows us to infer the occlusion relationship among objects, which in turn provides improved object…

Towards Large-Pose Face Frontalization in the Wild

Xi Yin, Xiang Yu, Kihyuk Sohn +2 more

cs.CV · April 2017 · cited 334× · arXiv ↗ · more like this ·

Despite recent advances in face recognition using deep learning, severe accuracy drops are observed for large pose variations in unconstrained environments. Learning pose-invariant features is one solution, but needs expensively labeled large-scale data and carefully designed feature learning algorithms. In this work, we focus on frontalizing faces in the wild under various head poses, including extreme profile views. We propose a novel deep 3D Morphable Model (3DMM) conditioned Face Frontalization Generative Adversarial Network (GAN), termed as FF-GAN, to generate neutral head pose face images. Our framework differs from both traditional GANs and 3DMM based modeling. Incorporating 3DMM into the GAN structure provides shape and appearance priors for fast convergence with less training data, while also supporting end-to-end training. The 3DMM-conditioned GAN employs not only the…

Selective Structured State-Spaces for Long-Form Video Understanding

Jue Wang, Wentao Zhu, Pichao Wang +4 more

cs.CV · 25 Mar 2023 · cited 197× · arXiv ↗ · more like this ·

Effective modeling of complex spatiotemporal dependencies in long-form videos remains an open problem. The recently proposed Structured State-Space Sequence (S4) model with its linear complexity offers a promising direction in this space. However, we demonstrate that treating all image-tokens equally as done by S4 model can adversely affect its efficiency and accuracy. To address this limitation, we present a novel Selective S4 (i.e., S5) model that employs a lightweight mask generator to adaptively select informative image tokens resulting in more efficient and accurate modeling of long-term spatiotemporal dependencies in videos. Unlike previous mask-based token reduction methods used in transformers, our S5 model avoids the dense self-attention calculation by making use of the guidance of the momentum-updated S4 model. This enables our model to efficiently discard less informative…

Prevalence and Associated Factors of Elder Mistreatment in a Rural Community in People's Republic of China: A Cross-Sectional Study

Li Wu, Hui Chen, Yang Hu +5 more

Demography · PLoS ONE · 20 Mar 2012 · cited 192× · DOI ↗ · more like this ·

BACKGROUND: Current knowledge about elder mistreatment is mainly derived from studies done in Western countries, which indicate that this problem is related to risk factors such as a shared living situation, social isolation, disease burden, and caregiver strain. We know little about prevalence and risk factors for elder mistreatment and mistreatment subtypes in rural China where the elder population is the most vulnerable. METHODS: In 2010, we conducted a cross-sectional survey among older adults aged 60 or older in three rural communities in Macheng, a city in Hubei province, China. Of 2245 people initially identified, 2039 were available for interview and this was completed in 2000. A structured questionnaire was used to collect data regarding mistreatment and covariates. Logistic regression analysis was used to identify factors related to elder mistreatment and subtypes of…

Towards Universal Representation Learning for Deep Face Recognition

Yichun Shi, Xiang Yu, Kihyuk Sohn +2 more

cs.CV · 26 Feb 2020 · cited 170× · arXiv ↗ · more like this ·

Recognizing wild faces is extremely hard as they appear with all kinds of variations. Traditional methods either train with specifically annotated variation data from target domains, or by introducing unlabeled target variation data to adapt from the training data. Instead, we propose a universal representation learning framework that can deal with larger variation unseen in the given training data without leveraging target domain knowledge. We firstly synthesize training data alongside some semantically meaningful variations, such as low resolution, occlusion and head pose. However, directly feeding the augmented data for training will not converge well as the newly introduced samples are mostly hard examples. We propose to split the feature embedding into multiple sub-embeddings, and associate different confidence values for each sub-embedding to smooth the training procedure. The…

PoseRBPF: A Rao–Blackwellized Particle Filter for 6-D Object Pose Tracking

Xinke Deng, Arsalan Mousavian, Xiang Yu +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Robotics · 25 Feb 2021 · cited 167× · DOI ↗ · more like this ·

Tracking 6-D poses of objects from videos provides rich information to a robot in performing different tasks such as manipulation and navigation. In this article, we formulate the 6-D object pose tracking problem in the Rao–Blackwellized particle filtering framework, where the 3-D rotation and the 3-D translation of an object are decoupled. This factorization allows our approach, called PoseRBPF, to efficiently estimate the 3-D translation of an object along with the full distribution over the 3-D rotation. This is achieved by discretizing the rotation space in a fine-grained manner and training an autoencoder network to construct a codebook of feature embeddings for the discretized rotations. As a result, PoseRBPF can track objects with arbitrary symmetries while still maintaining adequate posterior distributions. Our approach achieves state-of-the-art results on two 6-D pose…

Reinforcement Learning with Tree-LSTM for Join Order Selection

Xiang Yu, Guoliang Li, Chengliang Chai +1 more

Information Systems · April 2020 · cited 152× · DOI ↗ · more like this ·

Join order selection (JOS) - the problem of finding the optimal join order for an SQL query - is a primary focus of database query optimizers. The problem is hard due to its large solution space. Exhaustively traversing the solution space is prohibitively expensive, which is often combined with heuristic pruning. Despite decades-long effort, traditional optimizers still suffer from low scalability or low accuracy when handling complicated SQL queries. Recent attempts using deep reinforcement learning (DRL), by encoding join trees with fixed-length handtuned feature vectors, have shed some light on JOS. However, using fixed-length feature vectors cannot capture the structural information of a join tree, which may produce poor join plans. Moreover, it may also cause retraining the neural network when handling schema changes (e.g., adding tables/columns) or multialias table names that are…

Reconstruction-Based Disentanglement for Pose-invariant Face Recognition

Xi Peng, Xiang Yu, Kihyuk Sohn +2 more

cs.CV · February 2017 · cited 142× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) trained on large-scale datasets have recently achieved impressive improvements in face recognition. But a persistent challenge remains to develop methods capable of handling large pose variations that are relatively underrepresented in training data. This paper presents a method for learning a feature representation that is invariant to pose, without requiring extensive pose coverage in training data. We first propose to generate non-frontal views from a single frontal face, in order to increase the diversity of training data while preserving accurate facial details that are critical for identity discrimination. Our next contribution is to seek a rich embedding that encodes identity features, as well as non-identity ones such as pose and landmark locations. Finally, we propose a new feature reconstruction metric learning to explicitly disentangle identity and…

Climate change, water resources and sustainable development in the arid and semi-arid lands of Central Asia in the past 30 years

Yang Yu, Yuanyue Pi, Xiang Yu +7 more

Sociology and Political Science · Journal of Arid Land · 11 Dec 2018 · cited 137× · DOI ↗ · more like this ·

The countries of Central Asia are collectively known as the five ''-stans'': Uzbekistan, Kyrgyzstan, Turkmenistan, Tajikistan and Kazakhstan. In recent times, the Central Asian region has been affected by the shrinkage of the Aral Sea, widespread desertification, soil salinization, biodiversity loss, frequent sand storms, and many other ecological disasters. This paper is a review article based upon the collection, identification and collation of previous studies of environmental changes and regional developments in Central Asia in the past 30 years. Most recent studies have reached a consensus that the temperature rise in Central Asia is occurring faster than the global average. This warming trend will not only result in a higher evaporation in the basin oases, but also to a significant retreat of glaciers in the mountainous areas. Water is the key to sustainable development in the…

Fault-Tolerant Cooperative Control Design of Multiple Wheeled Mobile Robots

Mohamed A. Kamel, Xiang Yu, Youmin Zhang

Computer Networks and Communications · IEEE Transactions on Control Systems Technology · 20 Mar 2017 · cited 132× · DOI ↗ · more like this ·

This brief investigates fault-tolerant cooperative control (FTCC) strategies for multiple differentially driven autonomous wheeled mobile robots (WMRs) in the presence of actuator faults during formation operation. First, for normal/fault-free cases and for preparation to the faults occurrence cases, an integrated approach combining input-output feedback linearization and distributed linear model predictive control techniques is designed and implemented on a team of WMRs to accomplish a formation task. Second, when actuator faults occur in one of the robots of the team, two cases are explicitly considered: 1) if the faulty robot cannot complete its assigned task due to a severe fault, then the faulty robot has to get out from the formation mission, and an FTCC strategy is designed such that the tasks of the WMRs team are reassigned to the remaining healthy robots to complete the mission…

Fault‐tolerant formation control of multiple UAVs in the presence of actuator faults

Xiang Yu, Zhixiang Liu, Youmin Zhang

Computer Networks and Communications · International Journal of Robust and Nonlinear Control · 12 Oct 2015 · cited 130× · DOI ↗ · more like this ·

Summary In order to counteract actuator faults in formation flight of multiple unmanned aerial vehicles (UAVs), this paper presents a fault‐tolerant formation control (FTFC) design methodology, in which the reference generator and the finite‐time convergence of FTFC gains are explicitly considered. Feasible references in response to actuator faults can be generated by considering the health and mission conditions of an overall team of UAVs. Moreover, by applying an auxiliary integrated regressor matrix and vector method, FTFC gains can converge within a finite amount of time to facilitate the fault accommodation process. Thus, the negative effects resulting from failed actuators can be compensated by the healthy/redundant actuators in UAVs. Simulation studies of UAV formation flight are carried out to exemplify the effectiveness of this design approach. Copyright © 2015 John Wiley &amp…

Trajectory Planning and Tracking Strategy Applied to an Unmanned Ground Vehicle in the Presence of Obstacles

Xiaobin Zhou, Xiang Yu, Youmin Zhang +2 more

Computer Vision and Pattern Recognition · IEEE Transactions on Automation Science and Engineering · 4 Aug 2020 · cited 123× · DOI ↗ · more like this ·

In a dynamic environment, moving to the destination safely and effectively is of paramount importance for an unmanned ground vehicle (UGV). This article presents a strategy of trajectory planning and tracking that aims to ensure the UGV’s safety in an uncertain environment. Specifically, based on the initial environment information, a global optimal trajectory connecting the start and the destination is predefined by an artificial fish swarm algorithm (AFSA). In the presence of unforeseen obstacles, a trial-based forward search (TFS) algorithm based on the Markov chain is proposed in the local trajectory planning module, while collision prediction is integrated as heuristic information. The vehicle’s current state is updated accordingly for the sake of avoiding entire state spaces involved in the computation. Therefore, the storage efficiency and convergence rate in local path planning…

Unsupervised Domain Adaptation for Face Recognition in Unlabeled Videos

Kihyuk Sohn, Sifei Liu, Guangyu Zhong +3 more

cs.CV · 7 Aug 2017 · cited 118× · arXiv ↗ · more like this ·

Despite rapid advances in face recognition, there remains a clear gap between the performance of still image-based face recognition and video-based face recognition, due to the vast difference in visual quality between the domains and the difficulty of curating diverse large-scale video datasets. This paper addresses both of those challenges, through an image to video feature-level domain adaptation approach, to learn discriminative video frame representations. The framework utilizes large-scale unlabeled video data to reduce the gap between different domains while transferring discriminative knowledge from large-scale labeled still images. Given a face recognition network that is pretrained in the image domain, the adaptation is achieved by (i) distilling knowledge from the network to a video adaptation network through feature matching, (ii) performing feature restoration through…

Deep Deformation Network for Object Landmark Localization

Xiang Yu, Feng Zhou, Manmohan Chandraker

cs.CV · May 2016 · cited 116× · arXiv ↗ · more like this ·

We propose a novel cascaded framework, namely deep deformation network (DDN), for localizing landmarks in non-rigid objects. The hallmarks of DDN are its incorporation of geometric constraints within a convolutional neural network (CNN) framework, ease and efficiency of training, as well as generality of application. A novel shape basis network (SBN) forms the first stage of the cascade, whereby landmarks are initialized by combining the benefits of CNN features and a learned shape basis to reduce the complexity of the highly nonlinear pose manifold. In the second stage, a point transformer network (PTN) estimates local deformation parameterized as thin-plate spline transformation for a finer refinement. Our framework does not incorporate either handcrafted features or part connectivity, which enables an end-to-end shape prediction pipeline during both training and testing. In contrast…

Estimating the aspect layout of object categories

Xiang Yu, Silvio Savarese

Computer Vision and Pattern Recognition · June 2012 · cited 108× · DOI ↗ · more like this ·

In this work we seek to move away from the traditional paradigm for 2D object recognition whereby objects are identified in the image as 2D bounding boxes. We focus instead on: i) detecting objects; ii) identifying their 3D poses; iii) characterizing the geometrical and topological properties of the objects in terms of their aspect configurations in 3D. We call such characterization an object's aspect layout (see Fig. 1). We propose a new model for solving these problems in a joint fashion from a single image for object categories. Our model is constructed upon a novel framework based on conditional random fields with maximal margin parameter estimation. Extensive experiments are conducted to evaluate our model's performance in determining object pose and layout from images. We achieve superior viewpoint accuracy results on three public datasets and show extensive quantitative analysis…

Rate Distortion Optimization for H.264 Interframe Coding: A General Framework and Algorithms

En‐hui Yang, Xiang Yu

Signal Processing · IEEE Transactions on Image Processing · 20 Jun 2007 · cited 96× · DOI ↗ · more like this ·

Rate distortion (RD) optimization for H.264 interframe coding with complete baseline decoding compatibility is investigated on a frame basis. Using soft decision quantization (SDQ) rather than the standard hard decision quantization, we first establish a general framework in which motion estimation, quantization, and entropy coding (in H.264) for the current frame can be jointly designed to minimize a true RD cost given previously coded reference frames. We then propose three RD optimization algorithms--a graph-based algorithm for near optimal SDQ in H.264 baseline encoding given motion estimation and quantization step sizes, an algorithm for near optimal residual coding in H.264 baseline encoding given motion estimation, and an iterative overall algorithm to optimize H.264 baseline encoding for each individual frame given previously coded reference frames-with them embedded in the…

ResNet-SCDA-50 for Breast Abnormality Classification

Xiang Yu, Cheng Kang, David S. Guttery +3 more

Artificial Intelligence · IEEE/ACM Transactions on Computational Biology and Bioinformatics · 14 Apr 2020 · cited 95× · DOI ↗ · more like this ·

(Aim) Breast cancer is the most common cancer in women and the second most common cancer worldwide. With the rapid advancement of deep learning, the early stages of breast cancer development can be accurately detected by radiologists with the help of artificial intelligence systems. (Method) Based on mammographic imaging, a mainstream clinical breast screening technique, we present a diagnostic system for accurate classification of breast abnormalities based on ResNet-50. To improve the proposed model, we created a new data augmentation framework called SCDA (Scaling and Contrast limited adaptive histogram equalization Data Augmentation). In its procedure, we first conduct the scaling operation to the original training set, followed by applying contrast limited adaptive histogram equalisation (CLAHE) to the scaled training set. By stacking the training set after SCDA with the original…

Deep Supervision with Shape Concepts for Occlusion-Aware 3D Object Parsing

Chi Li, M. Zeeshan Zia, Quoc-Huy Tran +3 more

cs.CV · December 2016 · cited 92× · arXiv ↗ · more like this ·

Monocular 3D object parsing is highly desirable in various scenarios including occlusion reasoning and holistic scene interpretation. We present a deep convolutional neural network (CNN) architecture to localize semantic parts in 2D image and 3D space while inferring their visibility states, given a single RGB image. Our key insight is to exploit domain knowledge to regularize the network by deeply supervising its hidden layers, in order to sequentially infer intermediate concepts associated with the final task. To acquire training data in desired quantities with ground truth 3D shape and relevant concepts, we render 3D object CAD models to generate large-scale synthetic data and simulate challenging occlusion configurations between objects. We train the network only on synthetic data and demonstrate state-of-the-art performances on real image benchmarks including an extended version of…

Learning Cross-modal Contrastive Features for Video Domain Adaptation

Donghyun Kim, Yi-Hsuan Tsai, Bingbing Zhuang +4 more

cs.CV · 26 Aug 2021 · cited 91× · arXiv ↗ · more like this ·

Learning transferable and domain adaptive feature representations from videos is important for video-relevant tasks such as action recognition. Existing video domain adaptation methods mainly rely on adversarial feature alignment, which has been derived from the RGB image space. However, video data is usually associated with multi-modal information, e.g., RGB and optical flow, and thus it remains a challenge to design a better method that considers the cross-modal inputs under the cross-domain adaptation setting. To this end, we propose a unified framework for video domain adaptation, which simultaneously regularizes cross-modal and cross-domain feature representations. Specifically, we treat each modality in a domain as a view and leverage the contrastive learning technique with properly designed sampling strategies. As a result, our objectives regularize feature spaces, which…

Trading capacity for performance in a disk array

Xiang Yu, Benjamin Gum, Yuqun Chen +4 more

Computer Networks and Communications · Operating Systems Design and Implementation · 22 Oct 2000 · cited 89× · DOI ↗ · more like this ·

A variety of performance-enhancing techniques, such as striping, mirroring, and rotational data replication, exist in the disk array literature. Given a fixed budget of disks, one must intelligently choose what combination of these techniques to employ. In this paper, we present a way of designing disk arrays that can flexibly and systematically reduce seek and rotational delay in a balanced manner. We give analytical models that can guide an array designer towards optimal configurations by considering both disk and workload characteristics. We have implemented a prototype disk array that incorporates the configuration models. In the process, we have also developed a robust disk head position prediction mechanism without any hardware support. The resulting prototype demonstrates the e#ectiveness of the configuration models. 1 Introduction In this paper, we set out to answer a simple…

openGauss

Guoliang Li, Xuanhe Zhou, Ji Sun +6 more

Artificial Intelligence · Proceedings of the VLDB Endowment · July 2021 · cited 88× · DOI ↗ · more like this ·

Although learning-based database optimization techniques have been studied from academia in recent years, they have not been widely deployed in commercial database systems. In this work, we build an autonomous database framework and integrate our proposed learning-based database techniques into an open-source database system openGauss. We propose effective learning-based models to build learned optimizers (including learned query rewrite, learned cost/cardinality estimation, learned join order selection and physical operator selection) and learned database advisors (including self-monitoring, self-diagnosis, self-configuration, and self-optimization). We devise an effective validation model to validate the effectiveness of learned models. We build effective training data management and model management platforms to easily deploy learned models. We have evaluated our techniques on…

Deep Supervision with Intermediate Concepts

Chi Li, M. Zeeshan Zia, Quoc-Huy Tran +3 more

cs.CV · January 2018 · cited 87× · arXiv ↗ · more like this ·

Recent data-driven approaches to scene interpretation predominantly pose inference as an end-to-end black-box mapping, commonly performed by a Convolutional Neural Network (CNN). However, decades of work on perceptual organization in both human and machine vision suggests that there are often intermediate representations that are intrinsic to an inference task, and which provide essential structure to improve generalization. In this work, we explore an approach for injecting prior domain structure into neural network training by supervising hidden layers of a CNN with intermediate concepts that normally are not observed in practice. We formulate a probabilistic framework which formalizes these notions and predicts improved generalization via this deep supervision method. One advantage of this approach is that we are able to train only from synthetic CAD renderings of cluttered scenes…

Abnormality Diagnosis in Mammograms by Transfer Learning Based on ResNet18

Xiang Yu, Shuihua Wang‎

Artificial Intelligence · Fundamenta Informaticae · 21 Sep 2019 · cited 73× · DOI ↗ · more like this ·

Breast cancer is one of the common cancers threatening the health of women while the incident rate of it is quite low in men to contribute to a major killer of men. Early syndromes of breast cancer including micro-calcification, mass, and distortion in mammography images can be very helpful for rad iologists to make diagnosis of the cancer at early stage, which means the cancer can be treated or even be cured timely and thus make early diagnosis important. To assist radiologists with diagnosis, we set up a computer-aided diagnosis system to make diagnosis decision of breast cancer in this paper. We acquired regions of interests in mammographic images from public database, and labeled regions containing micro-calcification or mass as abnormality while regions without such abnormalities as normality. By transferring the state-of-the-art networks into our quest, we found that ResNet18…