Author

Yu Pan

619 papers · 1998–2026

1998peak 76 in 20242026

Frequent co-authors

Papers

showing 1–25 of 619 RSS

nuScenes: A multimodal dataset for autonomous driving

Holger Caesar, Varun Bankiti, Alex H. Lang +7 more

cs.LG · March 2019 · cited 9,088× · arXiv ↗ · more like this ·

Robust detection and tracking of objects is crucial for the deployment of autonomous vehicle technology. Image based benchmark datasets have driven development in computer vision tasks such as object detection, tracking and segmentation of agents in the environment. Most autonomous vehicles, however, carry a combination of cameras and range sensors such as lidar and radar. As machine learning based methods for detection and tracking become more prevalent, there is a need to train and evaluate such methods on datasets containing range sensor data along with images. In this work we present nuTonomy scenes (nuScenes), the first dataset to carry the full autonomous vehicle sensor suite: 6 cameras, 5 radars and 1 lidar, all with full 360 degree field of view. nuScenes comprises 1000 scenes, each 20s long and fully annotated with 3D bounding boxes for 23 classes and 8 attributes. It has 7x as…

Fast Random Walk with Restart and Its Applications

Hanghang Tong, Christos Faloutsos, Jia-Yu Pan

Artificial Intelligence · Proceedings · December 2006 · cited 1,209× · DOI ↗ · more like this ·

How closely related are two nodes in a graph? How to compute this score quickly, on huge, disk-resident, real graphs? Random walk with restart (RWR) provides a good relevance score between two nodes in a weighted graph, and it has been successfully used in numerous settings, like automatic captioning of images, generalizations to the "connection subgraphs", personalized PageRank, and many more. However, the straightforward implementations of RWR do not scale for large graphs, requiring either quadratic space and cubic pre-computation time, or slow response time on queries. We propose fast solutions to this problem. The heart of our approach is to exploit two important properties shared by many real graphs: (a) linear correlations and (b) block- wise, community-like structure. We exploit the linearity by using low-rank matrix approximation, and the community structure by graph…

Automatic multimedia cross-modal correlation discovery

Jia-Yu Pan, Hyung-Jeong Yang, Christos Faloutsos +1 more

Computer Vision and Pattern Recognition · Bilkent University Institutional Repository (Bilkent University) · 22 Aug 2004 · cited 488× · DOI ↗ · more like this ·

Given an image (or video clip, or audio song), how do we automatically assign keywords to it? The general problem is to find correlations across the media in a collection of multimedia objects like video clips, with colors, and/or motion, and/or audio, and/or text scripts. We propose a novel, graph-based approach, "MMG", to discover such cross-modal correlations.Our "MMG" method requires no tuning, no clustering, no user-determined constants; it can be applied to any multimedia collection, as long as we have a similarity function for each medium; and it scales linearly with the database size. We report auto-captioning experiments on the "standard" Corel image database of 680 MB, where it outperforms domain specific, fine-tuned methods by up to 10 percentage points in captioning accuracy (50% relative improvement).

Segmenting motion capture data into distinct behaviors

Jernej Barbič, Alla Safonova, Jia-Yu Pan +3 more

Computer Vision and Pattern Recognition · Graphics Interface · 17 May 2004 · cited 397× · OpenAlex ↗ · more like this ·

Much of the motion capture data used in animations, commercials, and video games is carefully segmented into distinct motions either at the time of capture or by hand after the capture session. As we move toward collecting more and longer motion sequences, however, automatic segmentation techniques will become important for processing the results in a reasonable time frame. We have found that straightforward, easy to implement segmentation techniques can be very effective for segmenting motion sequences into distinct behaviors. In this paper, we present three approaches for automatic segmentation. The first two approaches are online, meaning that the algorithm traverses the motion from beginning to end, creating the segmentation as it proceeds. The first assigns a cut when the intrinsic dimensionality of a local model of the motion suddenly increases. The second places a cut when the…

Remix: Rebalanced Mixup

Hsin-Ping Chou, Shih-Chieh Chang, Jia-Yu Pan +2 more

cs.CV · July 2020 · cited 310× · arXiv ↗ · more like this ·

Deep image classifiers often perform poorly when training data are heavily class-imbalanced. In this work, we propose a new regularization technique, Remix, that relaxes Mixup's formulation and enables the mixing factors of features and labels to be disentangled. Specifically, when mixing two samples, while features are mixed in the same fashion as Mixup, Remix assigns the label in favor of the minority class by providing a disproportionately higher weight to the minority class. By doing so, the classifier learns to push the decision boundaries towards the majority classes and balance the generalization error between majority and minority classes. We have studied the state-of-the art regularization techniques such as Mixup, Manifold Mixup and CutMix under class-imbalanced regime, and shown that the proposed Remix significantly outperforms these state-of-the-arts and several re-weighting…

RegNet: Self-Regulated Network for Image Classification

Jing Xu, Yu Pan, Xinglin Pan +3 more

eess.IV · 3 Jan 2021 · cited 220× · arXiv ↗ · more like this ·

The ResNet and its variants have achieved remarkable successes in various computer vision tasks. Despite its success in making gradient flow through building blocks, the simple shortcut connection mechanism limits the ability of re-exploring new potentially complementary features due to the additive function. To address this issue, in this paper, we propose to introduce a regulator module as a memory mechanism to extract complementary features, which are further fed to the ResNet. In particular, the regulator module is composed of convolutional RNNs (e.g., Convolutional LSTMs or Convolutional GRUs), which are shown to be good at extracting Spatio-temporal information. We named the new regulated networks as RegNet. The regulator module can be easily implemented and appended to any ResNet architecture. We also apply the regulator module for improving the Squeeze-and-Excitation ResNet to…

Smart Generation System of Personalized Advertising Copy and Its Application to Advertising Practice and Research

Shasha Deng, Chee‐Wee Tan, Weijun Wang +1 more

Sociology and Political Science · Journal of Advertising · 8 Aug 2019 · cited 128× · DOI ↗ · more like this ·

Artificial intelligence in programmatic advertising constitutes fertile grounds for marketing communication with tremendous opportunities. Yet, despite its touted benefits, contemporary implementations of programmatic advertising do not harness self-generative technologies so much so that different consumers are exposed to identical content. Consequently, we advance a smart generation system of personalized advertising copy (SGS-PAC) that can automatically personalize advertising content to align with the needs of individual consumers. Analytical results from a user experiment involving about 80 subjects underscore that personalized advertising copies generated by SGS-PAC can bolster click rate in online advertising platforms. Findings from this study bear significant implications for the application of artificial intelligence in online advertising.

Behavioral Health Problems, Ex-Offender Reentry Policies, and the “Second Chance Act”

Wendy Pogorzelski, Nancy Wolff, Ko-Yu Pan +1 more

Sociology and Political Science · American Journal of Public Health · 31 Aug 2005 · cited 127× · DOI ↗ · more like this ·

The federal "Second Chance Act of 2005" calls for expanding reentry services for people leaving prison, yet existing policies restrict access to needed services for those with criminal records. We examined the interaction between individual-level characteristics and policy-level restrictions related to criminal conviction, and the likely effects on access to resources upon reentry, using a sample of prisoners with Axis I mental disorders (n=3073). We identified multiple challenges related to convictions, including restricted access to housing, public assistance, and other resources. Invisible punishments embedded within existing policies were inconsistent with the call for second chances. Without modification of federal and state policies, the ability of reentry services to foster behavioral health and community reintegration is limited.

Gender-Specific Behavioral Health and Community Release Patterns Among New Jersey Prison Inmates: Implications for Treatment and Community Reentry

Cynthia L. Blitz, Nancy Wolff, Ko-Yu Pan +1 more

Sociology and Political Science · American Journal of Public Health · 31 Aug 2005 · cited 119× · DOI ↗ · more like this ·

OBJECTIVES: We describe behavioral health diagnoses and community release patterns among adult male and female inmates in New Jersey prisons and assess their implications for correctional health care and community reentry. METHODS: We used clinical and classification data on a census of "special needs" inmates (those with behavioral health disorders) in New Jersey (n=3189) and a census of all special needs inmates released to New Jersey communities over a 12-month period (n=974). RESULTS: Virtually all adult inmates with special needs had at least 1 Axis I mental disorder, and 68% of these had at least 1 additional Axis I mental disorder, a personality disorder, or addiction problem (67% of all male and 75% of all female special needs inmates). Of those special needs inmates released, 25% returned to the most disadvantaged counties in New Jersey (27% of all male and 18% of all female…

GCap: Graph-based Automatic Image Captioning

Jia-Yu Pan, Hyung-Jeong Yang, Christos Faloutsos +1 more

Computer Vision and Pattern Recognition · Bilkent University Institutional Repository (Bilkent University) · April 2005 · cited 118× · DOI ↗ · more like this ·

Given an image, how do we automatically assign keywords to it? In this paper, we propose a novel, graph-based approach (GCap) which outperforms previously reported methods for automatic image captioning. Moreover, it is fast and scales well, with its training and testing time linear to the data set size. We report auto-captioning experiments on the "standard" Corel image database of 680 MBytes, where GCap outperforms recent, successful auto-captioning methods by up to 10 percentage points in captioning accuracy (50% relative improvement).

Compressing Recurrent Neural Networks with Tensor Ring for Action Recognition

Yu Pan, Jing Xu, Maolin Wang +4 more

cs.CV · 19 Nov 2018 · cited 116× · arXiv ↗ · more like this ·

Recurrent Neural Networks (RNNs) and their variants, such as Long-Short Term Memory (LSTM) networks, and Gated Recurrent Unit (GRU) networks, have achieved promising performance in sequential data modeling. The hidden layers in RNNs can be regarded as the memory units, which are helpful in storing information in sequential contexts. However, when dealing with high dimensional input data, such as video and text, the input-to-hidden linear transformation in RNNs brings high memory usage and huge computational cost. This makes the training of RNNs unscalable and difficult. To address this challenge, we propose a novel compact LSTM model, named as TR-LSTM, by utilizing the low-rank tensor ring decomposition (TRD) to reformulate the input-to-hidden transformation. Compared with other tensor decomposition methods, TR-LSTM is more stable. In addition, TR-LSTM can complete an end-to-end…

Automatic image captioning

Jia-Yu Pan, Hyung-Jeong Yang, Pınar Duygulu +1 more

Computer Vision and Pattern Recognition · 21 Mar 2005 · cited 114× · DOI ↗ · more like this ·

We examine the problem of automatic image captioning. Given a training set of captioned images, we want to discover correlations between image features and keywords, so that we can automatically find good keywords for a new image. We experiment thoroughly with multiple design alternatives on large datasets of various content styles, and our proposed methods achieve up to a 45% relative improvement on captioning accuracy over the state of the art.

A Hierarchical Hand Gesture Recognition Framework for Sports Referee Training-Based EMG and Accelerometer Sensors

Tse–Yu Pan, Wan-Lun Tsai, Chen-Yuan Chang +2 more

Human-Computer Interaction · IEEE Transactions on Cybernetics · 10 Aug 2020 · cited 112× · DOI ↗ · more like this ·

To cultivate professional sports referees, we develop a sports referee training system, which can recognize whether a trainee wearing the Myo armband makes correct judging signals while watching a prerecorded professional game. The system has to correctly recognize a set of gestures related to official referee's signals (ORSs) and another set of gestures used to intuitively interact with the system. These two gesture sets involve both large motion and subtle motion gestures, and the existing sensor-based methods using handcrafted features do not work well on recognizing all kinds of these gestures. In this work, deep belief networks (DBNs) are utilized to learn more representative features for hand gesture recognition, and selective handcrafted features are combined with the DBN features to achieve more robust recognition results. Moreover, a hierarchical recognition scheme is designed…

Optimal Decoherence Control in non-Markovian Open, Dissipative Quantum Systems

Wei Cui, Zairong Xi, Yu Pan

quant-ph · 27 Oct 2009 · cited 90× · arXiv ↗ · more like this ·

We investigate the optimal control problem for non-Markovian open, dissipative quantum system. Optimal control using Pontryagin maximum principle is specifically derived. The influences of Ohmic reservoir with Lorentz-Drude regularization are numerically studied in a two-level system under the following three conditions: ω_0\llω_c, ω_0\approxω_c or ω_0\ggω_c, where ω_0 is the characteristic frequency of the quantum system of interest, and ω_c the cut-off frequency of Ohmic reservoir. The optimal control process shows its remarkable influences on the decoherence dynamics. The temperature is a key factor in the decoherence dynamics. We analyze the optimal decoherence control in high temperature, intermediate temperature, and low temperature reservoirs respectively. It implies that designing some engineered reservoirs with the controlled coupling and state of the environment can slow down…

Randomized Comparison of 3 Methods to Screen for Domestic Violence in Family Practice

Ping‐Hung Chen, Sue Rovi, Judy C. Washington +4 more

Health · The Annals of Family Medicine · September 2007 · cited 79× · DOI ↗ · more like this ·

PURPOSE: We undertook a study to compare 3 ways of administering brief domestic violence screening questionnaires: self-administered questionnaire, medical staff interview, and physician interview. METHODS: We conducted a randomized trial of 3 screening protocols for domestic violence in 4 urban family medicine practices with mostly minority patients. We randomly assigned 523 female patients, aged 18 years or older and currently involved with a partner, to 1 of 3 screening protocols. Each included 2 brief screening tools: HITS and WAST-Short. Outcome measures were domestic violence disclosure, patient and clinician comfort with the screening, and time spent screening. RESULTS: Overall prevalence of domestic violence was 14%. Most patients (93.4%) and clinicians (84.5%) were comfortable with the screening questions and method of administering them. Average time spent screening was 4.4…

SigPID: significant permission identification for android malware detection

Lichao Sun, Zhiqiang Li, Qiben Yan +2 more

Signal Processing · October 2016 · cited 68× · DOI ↗ · more like this ·

A recent report indicates that a newly developed malicious app for Android is introduced every 11 seconds. To combat this alarming rate of malware creation, we need a scalable malware detection approach that is effective and efficient. In this paper, we introduce SIGPID, a malware detection system based on permission analysis to cope with the rapid increase in the number of Android malware. Instead of analyzing all 135 Android permissions, our approach applies 3-level pruning by mining the permission data to identify only significant permissions that can be effective in distinguishing benign and malicious apps. SIGPID then utilizes classification algorithms to classify different families of malware and benign apps. Our evaluation finds that only 22 out of 135 permissions are significant. We then compare the performance of our approach, using only 22 permissions, against a baseline…

Heuristic Rank Selection with Progressively Searching Tensor Ring Network

Nannan Li, Yu Pan, Yaran Chen +3 more

cs.CV · September 2020 · cited 67× · arXiv ↗ · more like this ·

Recently, Tensor Ring Networks (TRNs) have been applied in deep networks, achieving remarkable successes in compression ratio and accuracy. Although highly related to the performance of TRNs, rank selection is seldom studied in previous works and usually set to equal in experiments. Meanwhile, there is not any heuristic method to choose the rank, and an enumerating way to find appropriate rank is extremely time-consuming. Interestingly, we discover that part of the rank elements is sensitive and usually aggregate in a narrow region, namely an interest region. Therefore, based on the above phenomenon, we propose a novel progressive genetic algorithm named Progressively Searching Tensor Ring Network Search (PSTRN), which has the ability to find optimal rank precisely and efficiently. Through the evolutionary phase and progressive phase, PSTRN can converge to the interest region quickly…

Feasibility Study on Virtual Reality Based Basketball Tactic Training

Wan-Lun Tsai, Tse–Yu Pan, Min‐Chun Hu

Human-Computer Interaction · IEEE Transactions on Visualization and Computer Graphics · 22 Dec 2020 · cited 64× · DOI ↗ · more like this ·

In this article, a VR-based basketball training system comprising a standalone VR device and a tablet is proposed. The system is intended to improve the ability of players to understand offensive tactics and practice these tactics correctly. We compare the training effectiveness of various degrees of immersion, including a conventional basketball tactic board, a 2D monitor, and virtual reality. A multi-camera-based human tracking system was designed and built around a real-world basketball court to record and analyze the running trajectory of each player during tactical execution. The accuracy of the running path and hesitation time at each tactical step were evaluated for each participant. Furthermore, we assessed several subjective measurements, including simulator sickness, presence, and sport imagery ability, to conduct a more comprehensive exploration of the feasibility of the…

Towards auto-documentary

Pınar Duygulu, Jia-Yu Pan, David Forsyth

Computer Vision and Pattern Recognition · Bilkent University Institutional Repository (Bilkent University) · 10 Oct 2004 · cited 64× · DOI ↗ · more like this ·

News videos constitute an important source of information for tracking and documenting important events. In these videos, news stories are often accompanied by short video shots that tend to be repeated during the course of the event. Automatic detection of such repetitions is essential for creating auto-documentaries, for alleviating the limitation of traditional textual topic detection methods. In this paper, we propose novel methods for detecting and tracking the evolution of news over time. The proposed method exploits both visual cues and textual information to summarize evolving news stories. Experiments are carried on the TREC-VID data set consisting of 120 hours of news videos from two different channels.

Quantum Language Model with Entanglement Embedding for Question Answering

Yiwei Chen, Yu Pan, Daoyi Dong

cs.CL · August 2020 · cited 57× · arXiv ↗ · more like this ·

Quantum Language Models (QLMs) in which words are modelled as quantum superposition of sememes have demonstrated a high level of model transparency and good post-hoc interpretability. Nevertheless, in the current literature word sequences are basically modelled as a classical mixture of word states, which cannot fully exploit the potential of a quantum probabilistic description. A full quantum model is yet to be developed to explicitly capture the non-classical correlations within the word sequences. We propose a neural network model with a novel Entanglement Embedding (EE) module, whose function is to transform the word sequences into entangled pure states of many-body quantum systems. Strong quantum entanglement, which is the central concept of quantum information and an indication of parallelized correlations among the words, is observed within the word sequences. Numerical…

On Model Calibration for Long-Tailed Object Detection and Instance Segmentation

Tai-Yu Pan, Cheng Zhang, Yandong Li +5 more

cs.CV · July 2021 · cited 56× · arXiv ↗ · more like this ·

Vanilla models for object detection and instance segmentation suffer from the heavy bias toward detecting frequent objects in the long-tailed setting. Existing methods address this issue mostly during training, e.g., by re-sampling or re-weighting. In this paper, we investigate a largely overlooked approach -- post-processing calibration of confidence scores. We propose NorCal, Normalized Calibration for long-tailed object detection and instance segmentation, a simple and straightforward recipe that reweighs the predicted scores of each class by its training sample size. We show that separately handling the background class and normalizing the scores over classes for each proposal are keys to achieving superior performance. On the LVIS dataset, NorCal can effectively improve nearly all the baseline models not only on rare classes but also on common and frequent classes. Finally, we…

Complement Objective Training

Hao-Yun Chen, Pei-Hsin Wang, Chun-Hao Liu +5 more

cs.LG · 21 Mar 2019 · cited 53× · arXiv ↗ · more like this ·

Learning with a primary objective, such as softmax cross entropy for classification and sequence generation, has been the norm for training deep neural networks for years. Although being a widely-adopted approach, using cross entropy as the primary objective exploits mostly the information from the ground-truth class for maximizing data likelihood, and largely ignores information from the complement (incorrect) classes. We argue that, in addition to the primary objective, training also using a complement objective that leverages information from the complement classes can be effective in improving model performance. This motivates us to study a new training paradigm that maximizes the likelihood of the groundtruth class while neutralizing the probabilities of the complement classes. We conduct extensive experiments on multiple tasks ranging from computer vision to natural language…

Robust information-theoretic clustering

Christian Böhm, Christos Faloutsos, Jia-Yu Pan +1 more

Artificial Intelligence · 20 Aug 2006 · cited 52× · DOI ↗ · more like this ·

How do we find a natural clustering of a real world point set, which contains an unknown number of clusters with different shapes, and which may be contaminated by noise? Most clustering algorithms were designed with certain assumptions (Gaussianity), they often require the user to give input parameters, and they are sensitive to noise. In this paper, we propose a robust framework for determining a natural clustering of a given data set, based on the minimum description length (MDL) principle. The proposed framework, Robust Information-theoretic Clustering (RIC), is orthogonal to any known clustering algorithm: given a preliminary clustering, RIC purifies these clusters from noise, and adjusts the clusterings such that it simultaneously determines the most natural amount and shape (subspace) of the clusters. Our RIC method can be combined with any clustering technique ranging from…

MosaicOS: A Simple and Effective Use of Object-Centric Images for Long-Tailed Object Detection

Cheng Zhang, Tai-Yu Pan, Yandong Li +5 more

cs.CV · February 2021 · cited 51× · arXiv ↗ · more like this ·

Many objects do not appear frequently enough in complex scenes (e.g., certain handbags in living rooms) for training an accurate object detector, but are often found frequently by themselves (e.g., in product images). Yet, these object-centric images are not effectively leveraged for improving object detection in scene-centric images. In this paper, we propose Mosaic of Object-centric images as Scene-centric images (MosaicOS), a simple and novel framework that is surprisingly effective at tackling the challenges of long-tailed object detection. Keys to our approach are three-fold: (i) pseudo scene-centric image construction from object-centric images for mitigating domain differences, (ii) high-quality bounding box imputation using the object-centric images' class labels, and (iii) a multi-stage training procedure. On LVIS object detection (and instance segmentation), MosaicOS leads to…

Improving Adversarial Robustness via Guided Complement Entropy

Hao-Yun Chen, Jhao-Hong Liang, Shih-Chieh Chang +4 more

cs.LG · March 2019 · cited 51× · arXiv ↗ · more like this ·

Adversarial robustness has emerged as an important topic in deep learning as carefully crafted attack samples can significantly disturb the performance of a model. Many recent methods have proposed to improve adversarial robustness by utilizing adversarial training or model distillation, which adds additional procedures to model training. In this paper, we propose a new training paradigm called Guided Complement Entropy (GCE) that is capable of achieving "adversarial defense for free," which involves no additional procedures in the process of improving adversarial robustness. In addition to maximizing model probabilities on the ground-truth class like cross-entropy, we neutralize its probabilities on the incorrect classes along with a "guided" term to balance between these two terms. We show in the experiments that our method achieves better model robustness with even better performance…