arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Kang

7,991 papers · 1964–2021

1964: 11965: 01966: 01967: 01968: 01969: 01970: 01971: 01972: 01973: 11974: 21975: 41976: 11977: 21978: 11979: 01980: 01981: 21982: 31983: 51984: 61985: 31986: 41987: 51988: 131989: 101990: 131991: 191992: 211993: 241994: 381995: 531996: 621997: 731998: 751999: 1072000: 1032001: 1442002: 3372003: 2832004: 2982005: 3932006: 3432007: 3422008: 3492009: 3942010: 4392011: 4032012: 4312013: 4412014: 5192015: 7342016: 4022017: 4522018: 4992019: 1322020: 32021: 2
1964peak 734 in 20152021

Frequent co-authors

Papers

showing 1–25 of 7,991 RSS

Random Erasing Data Augmentation

Zhun Zhong, Liang Zheng, Guoliang Kang +2 more

cs.CV · · cited 4,331× · arXiv ↗ · more like this ·

In this paper, we introduce Random Erasing, a new data augmentation method for training the convolutional neural network (CNN). In training, Random Erasing randomly selects a rectangle region in an image and erases its pixels with random values. In this process, training images with various levels of occlusion are generated, which reduces the risk of over-fitting and makes the model robust to occlusion. Random Erasing is parameter learning free, easy to implement, and can be integrated with most of the CNN-based recognition models. Albeit simple, Random Erasing is complementary to commonly used data augmentation techniques such as random cropping and flipping, and yields consistent improvement over strong baselines in image classification, object detection and person re-identification. Code is available at: https://github.com/zhunzhong07/Random-Erasing.

Self-Attentive Sequential Recommendation

Wang-Cheng Kang, Julian McAuley

cs.IR · · cited 4,243× · arXiv ↗ · more like this ·

Sequential dynamics are a key feature of many modern recommender systems, which seek to capture the `context' of users' activities on the basis of actions they have performed recently. To capture such patterns, two approaches have proliferated: Markov Chains (MCs) and Recurrent Neural Networks (RNNs). Markov Chains assume that a user's next action can be predicted on the basis of just their last (or last few) actions, while RNNs in principle allow for longer-term semantics to be uncovered. Generally speaking, MC-based methods perform best in extremely sparse datasets, where model parsimony is critical, while RNNs perform better in denser datasets where higher model complexity is affordable. The goal of our work is to balance these two goals, by proposing a self-attention based sequential model (SASRec) that allows us to capture long-term semantics (like an RNN), but, using an attention…

Demystifying Double Robustness: A Comparison of Alternative Strategies for Estimating a Population Mean from Incomplete Data

Joseph D. Y. Kang, Joseph L. Schafer

stat.ME · · cited 1,523× · arXiv ↗ · more like this ·

When outcomes are missing for reasons beyond an investigator's control, there are two different ways to adjust a parameter estimate for covariates that may be related both to the outcome and to missingness. One approach is to model the relationships between the covariates and the outcome and use those relationships to predict the missing values. Another is to model the probabilities of missingness given the covariates and incorporate them into a weighted or stratified estimate. Doubly robust (DR) procedures apply both types of model simultaneously and produce a consistent estimate of the parameter if either of the two models has been correctly specified. In this article, we show that DR estimates can be constructed in many ways. We compare the performance of various DR and non-DR estimates of a population mean in a simulated example where both models are incorrect but neither is grossly…

Fine-Pruning: Defending Against Backdooring Attacks on Deep Neural Networks

Kang Liu, Brendan Dolan-Gavitt, Siddharth Garg

cs.CR · · cited 1,416× · arXiv ↗ · more like this ·

Deep neural networks (DNNs) provide excellent performance across a wide range of classification tasks, but their training requires high computational resources and is often outsourced to third parties. Recent work has shown that outsourced training introduces the risk that a malicious trainer will return a backdoored DNN that behaves normally on most inputs but causes targeted misclassifications or degrades the accuracy of the network when a trigger known only to the attacker is present. In this paper, we provide the first effective defenses against backdoor attacks on DNNs. We implement three backdoor attacks from prior work and use them to investigate two promising defenses, pruning and fine-tuning. We show that neither, by itself, is sufficient to defend against sophisticated attackers. We then evaluate fine-pruning, a combination of pruning and fine-tuning, and show that it…

QTRAN: Learning to Factorize with Transformation for Cooperative Multi-Agent Reinforcement Learning

Kyunghwan Son, Daewoo Kim, Wan Ju Kang +2 more

cs.LG · · cited 1,109× · arXiv ↗ · more like this ·

We explore value-based solutions for multi-agent reinforcement learning (MARL) tasks in the centralized training with decentralized execution (CTDE) regime popularized recently. However, VDN and QMIX are representative examples that use the idea of factorization of the joint action-value function into individual ones for decentralized execution. VDN and QMIX address only a fraction of factorizable MARL tasks due to their structural constraint in factorization such as additivity and monotonicity. In this paper, we propose a new factorization method for MARL, QTRAN, which is free from such structural constraints and takes on a new approach to transforming the original joint action-value function into an easily factorizable one, with the same optimal actions. QTRAN guarantees more general factorization than VDN or QMIX, thus covering a much wider class of MARL tasks than does previous…

Soft Filter Pruning for Accelerating Deep Convolutional Neural Networks

Yang He, Guoliang Kang, Xuanyi Dong +2 more

cs.CV · · cited 1,093× · arXiv ↗ · more like this ·

This paper proposed a Soft Filter Pruning (SFP) method to accelerate the inference procedure of deep Convolutional Neural Networks (CNNs). Specifically, the proposed SFP enables the pruned filters to be updated when training the model after pruning. SFP has two advantages over previous works: (1) Larger model capacity. Updating previously pruned filters provides our approach with larger optimization space than fixing the filters to zero. Therefore, the network trained by our method has a larger model capacity to learn from the training data. (2) Less dependence on the pre-trained model. Large capacity enables SFP to train from scratch and prune the model simultaneously. In contrast, previous filter pruning methods should be conducted on the basis of the pre-trained model to guarantee their performance. Empirically, SFP from scratch outperforms the previous filter pruning methods.…

Contrastive Adaptation Network for Unsupervised Domain Adaptation

Guoliang Kang, Lu Jiang, Yi Yang +1 more

cs.CV · · cited 1,013× · arXiv ↗ · more like this ·

Unsupervised Domain Adaptation (UDA) makes predictions for the target domain data while manual annotations are only available in the source domain. Previous methods minimize the domain discrepancy neglecting the class information, which may lead to misalignment and poor generalization performance. To address this issue, this paper proposes Contrastive Adaptation Network (CAN) optimizing a new metric which explicitly models the intra-class domain discrepancy and the inter-class domain discrepancy. We design an alternating update strategy for training CAN in an end-to-end manner. Experiments on two real-world benchmarks Office-31 and VisDA-2017 demonstrate that CAN performs favorably against the state-of-the-art methods and produces more discriminative features.

Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification

Weijian Deng, Liang Zheng, Qixiang Ye +3 more

cs.CV · · cited 973× · arXiv ↗ · more like this ·

Person re-identification (re-ID) models trained on one domain often fail to generalize well to another. In our attempt, we present a "learning via translation" framework. In the baseline, we translate the labeled images from source to target domain in an unsupervised manner. We then train re-ID models with the translated images by supervised methods. Yet, being an essential part of this framework, unsupervised image-image translation suffers from the information loss of source-domain labels during translation. Our motivation is two-fold. First, for each image, the discriminative cues contained in its ID label should be maintained after translation. Second, given the fact that two domains have entirely different persons, a translated image should be dissimilar to any of the target IDs. To this end, we propose to preserve two types of unsupervised similarities, 1) self-similarity of an…

Feature Learning based Deep Supervised Hashing with Pairwise Labels

Wu-Jun Li, Sheng Wang, Wang-Cheng Kang

cs.LG · · cited 741× · arXiv ↗ · more like this ·

Recent years have witnessed wide application of hashing for large-scale image retrieval. However, most existing hashing methods are based on hand-crafted features which might not be optimally compatible with the hashing procedure. Recently, deep hashing methods have been proposed to perform simultaneous feature learning and hash-code learning with deep neural networks, which have shown better performance than traditional hashing methods with hand-crafted features. Most of these deep hashing methods are supervised whose supervised information is given with triplet labels. For another common application scenario with pairwise labels, there have not existed methods for simultaneous feature learning and hash-code learning. In this paper, we propose a novel deep hashing method, called deep pairwise-supervised hashing(DPSH), to perform simultaneous feature learning and hash-code learning for…

ESE: Efficient Speech Recognition Engine with Sparse LSTM on FPGA

Song Han, Junlong Kang, Huizi Mao +9 more

cs.CL · · cited 671× · arXiv ↗ · more like this ·

Long Short-Term Memory (LSTM) is widely used in speech recognition. In order to achieve higher prediction accuracy, machine learning scientists have built larger and larger models. Such large model is both computation intensive and memory intensive. Deploying such bulky model results in high power consumption and leads to high total cost of ownership (TCO) of a data center. In order to speedup the prediction and make it energy efficient, we first propose a load-balance-aware pruning method that can compress the LSTM model size by 20x (10x from pruning and 2x from quantization) with negligible loss of the prediction accuracy. The pruned model is friendly for parallel processing. Next, we propose scheduler that encodes and partitions the compressed model to each PE for parallelism, and schedule the complicated LSTM data flow. Finally, we design the hardware architecture, named Efficient…

Deep Voice: Real-time Neural Text-to-Speech

Sercan O. Arik, Mike Chrzanowski, Adam Coates +9 more

cs.CL · · cited 670× · arXiv ↗ · more like this ·

We present Deep Voice, a production-quality text-to-speech system constructed entirely from deep neural networks. Deep Voice lays the groundwork for truly end-to-end neural speech synthesis. The system comprises five major building blocks: a segmentation model for locating phoneme boundaries, a grapheme-to-phoneme conversion model, a phoneme duration prediction model, a fundamental frequency prediction model, and an audio synthesis model. For the segmentation model, we propose a novel way of performing phoneme boundary detection with deep neural networks using connectionist temporal classification (CTC) loss. For the audio synthesis model, we implement a variant of WaveNet that requires fewer parameters and trains faster than the original. By using a neural network for each component, our system is simpler and more flexible than traditional text-to-speech systems, where each component…

China rising: peace, power, and order in East Asia

David C. Kang

Cultural Studies · Choice Reviews Online · · cited 554× · DOI ↗ · more like this ·

List of IllustrationsAcknowledgmentsPart I: The Puzzle and the Argument1. The Puzzle and China's Amazing Rise2. Power, Interests, and Identity in East Asian International Relations, 1300 to 19003. Describing East Asia: Alignment Strategies Toward ChinaPart II: East Asia Responds to China4. China: Identity, Sovereignty, and Taiwan5. South Korea: Embracing Interdependence in Search of Security6. Southeast Asia: Accommodating China's Rise7. Japan: A Normal IdentityPart III: East Asia and the United States8. The Role of the United States in East Asia9. Conclusions and ImplicationsNotesSelected BibliographyIndex

Visual Attribute Transfer through Deep Image Analogy

Jing Liao, Yuan Yao, Lu Yuan +2 more

cs.CV · · cited 549× · arXiv ↗ · more like this ·

We propose a new technique for visual attribute transfer across images that may have very different appearance but have perceptually similar semantic structure. By visual attribute transfer, we mean transfer of visual information (such as color, tone, texture, and style) from one image to another. For example, one image could be that of a painting or a sketch while the other is a photo of a real scene, and both depict the same type of scene. Our technique finds semantically-meaningful dense correspondences between two input images. To accomplish this, it adapts the notion of "image analogy" with features extracted from a Deep Convolutional Neutral Network for matching; we call our technique Deep Image Analogy. A coarse-to-fine strategy is used to compute the nearest-neighbor field for generating the results. We validate the effectiveness of our proposed method in a variety of cases…

Multi-Interest Network with Dynamic Routing for Recommendation at Tmall

Chao Li, Zhiyuan Liu, Mengmeng Wu +7 more

cs.IR · · cited 544× · arXiv ↗ · more like this ·

Industrial recommender systems usually consist of the matching stage and the ranking stage, in order to handle the billion-scale of users and items. The matching stage retrieves candidate items relevant to user interests, while the ranking stage sorts candidate items by user interests. Thus, the most critical ability is to model and represent user interests for either stage. Most of the existing deep learning-based models represent one user as a single vector which is insufficient to capture the varying nature of user's interests. In this paper, we approach this problem from a different view, to represent one user with multiple vectors encoding the different aspects of the user's interests. We propose the Multi-Interest Network with Dynamic routing (MIND) for dealing with user's diverse interests in the matching stage. Specifically, we design a multi-interest extractor layer based on…

Towards Secure Blockchain-enabled Internet of Vehicles: Optimizing Consensus Management Using Reputation and Contract Theory

Jiawen Kang, Zehui Xiong, Dusit Niyato +3 more

cs.CR · · cited 534× · arXiv ↗ · more like this ·

In Internet of Vehicles (IoV), data sharing among vehicles is essential to improve driving safety and enhance vehicular services. To ensure data sharing security and traceability, highefficiency Delegated Proof-of-Stake consensus scheme as a hard security solution is utilized to establish blockchain-enabled IoV (BIoV). However, as miners are selected from miner candidates by stake-based voting, it is difficult to defend against voting collusion between the candidates and compromised high-stake vehicles, which introduces serious security challenges to the BIoV. To address such challenges, we propose a soft security enhancement solution including two stages: (i) miner selection and (ii) block verification. In the first stage, a reputation-based voting scheme for the blockchain is proposed to ensure secure miner selection. This scheme evaluates candidates' reputation by using both…

T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos

Kai Kang, Hongsheng Li, Junjie Yan +8 more

cs.CV · · cited 530× · arXiv ↗ · more like this ·

The state-of-the-art performance for object detection has been significantly improved over the past two years. Besides the introduction of powerful deep neural networks such as GoogleNet and VGG, novel object detection frameworks such as R-CNN and its successors, Fast R-CNN and Faster R-CNN, play an essential role in improving the state-of-the-art. Despite their effectiveness on still images, those frameworks are not specifically designed for object detection from videos. Temporal and contextual information of videos are not fully investigated and utilized. In this work, we propose a deep learning framework that incorporates temporal and contextual information from tubelets obtained in videos, which dramatically improves the baseline performance of existing still-image detection frameworks when they are applied to videos. It is called T-CNN, i.e. tubelets with convolutional neueral…

Translation-based Recommendation

Ruining He, Wang-Cheng Kang, Julian McAuley

cs.IR · · cited 486× · arXiv ↗ · more like this ·

Modeling the complex interactions between users and items as well as amongst items themselves is at the core of designing successful recommender systems. One classical setting is predicting users' personalized sequential behavior (or `next-item' recommendation), where the challenges mainly lie in modeling `third-order' interactions between a user, her previously visited item(s), and the next item to consume. Existing methods typically decompose these higher-order interactions into a combination of pairwise relationships, by way of which user preferences (user-item interactions) and sequential patterns (item-item interactions) are captured by separate components. In this paper, we propose a unified method, TransRec, to model such third-order relationships for large-scale sequential prediction. Methodologically, we embed items into a `transition space' where users are modeled as…

Teleportation and Dense Coding with Genuine Multipartite Entanglement

Ye Yeo, Wee Kang Chua

quant-ph · · cited 446× · arXiv ↗ · more like this ·

We present an explicit protocol ${\cal E}_0$ for faithfully teleporting an arbitrary two-qubit state via a genunie four-qubit entangled state. By construction, our four-partite state is not reducible to a pair of Bell states. Its properties are compared and contrasted with those of the four-party GHZ and W states. We also give a dense coding scheme ${\cal D}_0$ involving our state as a shared resource of entanglement. Both ${\cal D}_0$ and ${\cal E}_0$ indicate that our four-qubit state is a likely candidate for the genunine four-partite analogue to a Bell state.

Epitaxial MgB2 superconducting thin films with a transition temperature of 39 Kelvin

W. N. Kang, Hyeong-Jin Kim, Eun-Mi Choi +2 more

cond-mat.supr-con · · cited 435× · arXiv ↗ · more like this ·

We report the growth of high-quality epitaxial MgB2 thin films on (1102) Al2O3 and (001) SrTiO3 substrates by using a pulsed laser deposition technique. The thin films grown on Al2O3 substrates show a Tc of 39 K with a sharp transition width of ~ 0.7 K. The critical current density in zero field is ~ 8 x 10^6 A/cm^2 at 5 K, suggesting that this compound has great potential for industrial applications. Also, Al2O3 is a very promising substrate in terms of superconducting device applications because of its high thermal conductivity and small dielectric constant. For the films deposited on Al2O3, X-ray diffraction patterns indicate a c-axis-oriented crystal structure perpendicular to the substrate surface whereas the films deposited on SrTiO3 show {101} plane as the preferred orientation.

Polisis: Automated Analysis and Presentation of Privacy Policies Using Deep Learning

Hamza Harkous, Kassem Fawaz, Rémi Lebret +3 more

cs.CL · · cited 427× · arXiv ↗ · more like this ·

Privacy policies are the primary channel through which companies inform users about their data collection and sharing practices. These policies are often long and difficult to comprehend. Short notices based on information extracted from privacy policies have been shown to be useful but face a significant scalability hurdle, given the number of policies and their evolution over time. Companies, users, researchers, and regulators still lack usable and scalable tools to cope with the breadth and depth of privacy policies. To address these hurdles, we propose an automated framework for privacy policy analysis (Polisis). It enables scalable, dynamic, and multi-dimensional queries on natural language privacy policies. At the core of Polisis is a privacy-centric language model, built with 130K privacy policies, and a novel hierarchy of neural-network classifiers that accounts for both…

Structure of urban movements: polycentric activity and entangled hierarchical flows

Camille Roth, Soong Moon Kang, Michael Batty +1 more

physics.soc-ph · · cited 412× · arXiv ↗ · more like this ·

The spatial arrangement of urban hubs and centers and how individuals interact with these centers is a crucial problem with many applications ranging from urban planning to epidemiology. We utilize here in an unprecedented manner the large scale, real-time 'Oyster' card database of individual person movements in the London subway to reveal the structure and organization of the city. We show that patterns of intraurban movement are strongly heterogeneous in terms of volume, but not in terms of distance travelled, and that there is a polycentric structure composed of large flows organized around a limited number of activity centers. For smaller flows, the pattern of connections becomes richer and more complex and is not strictly hierarchical since it mixes different levels consisting of different orders of magnitude. This new understanding can shed light on the impact of new urban…

Object Detection from Video Tubelets with Convolutional Neural Networks

Kai Kang, Wanli Ouyang, Hongsheng Li +1 more

cs.CV · · cited 392× · arXiv ↗ · more like this ·

Deep Convolution Neural Networks (CNNs) have shown impressive performance in various vision tasks such as image classification, object detection and semantic segmentation. For object detection, particularly in still images, the performance has been significantly increased last year thanks to powerful deep networks (e.g. GoogleNet) and detection frameworks (e.g. Regions with CNN features (R-CNN)). The lately introduced ImageNet task on object detection from video (VID) brings the object detection task into the video domain, in which objects' locations at each frame are required to be annotated with bounding boxes. In this work, we introduce a complete framework for the VID task based on still-image object detection and general object tracking. Their relations and contributions in the VID task are thoroughly studied and evaluated. In addition, a temporal convolution network is proposed to…

Uncovering patterns of inter-urban trip and spatial interaction from social media check-in data

Yu Liu, Zhengwei Sui, Chaogui Kang +1 more

cs.SI · · cited 383× · arXiv ↗ · more like this ·

The article revisits spatial interaction and distance decay from the perspective of human mobility patterns and spatially-embedded networks based on an empirical data set. We extract nationwide inter-urban movements in China from a check-in data set that covers half million individuals and 370 cities to analyze the underlying patterns of trips and spatial interactions. By fitting the gravity model, we find that the observed spatial interactions are governed by a power law distance decay effect. The obtained gravity model also well reproduces the exponential trip displacement distribution. However, due to the ecological fallacy issue, the movement of an individual may not obey the same distance decay effect. We also construct a spatial network where the edge weights denote the interaction strengths. The communities detected from the network are spatially connected and roughly consistent…

Determinants of Sharing Travel Experiences in Social Media

Myung‐Hwa Kang, Michael A. Schuett

Sociology and Political Science · Journal of Travel & Tourism Marketing · · cited 374× · DOI ↗ · more like this ·

ABSTRACT The advent of Internet-based social media technologies has enabled travelers to quickly and conveniently share their travel experiences. Shared information on social media sites is recognized as an important information source which may influence travel decision making for potential travelers. This study tests a conceptual framework which examines why travelers share their travel experiences on social media based on the social influence theory and its three conceptual foundations—identification, internalization, and compliance. Data were collected using an online survey and the research model was tested with 543 respondents who were social media users. Results showed that identification and internalization are critical determinants that positively increase actual travel-experience sharing on social media as mediated by perceived enjoyment. Our research extends prior literature…

Dark Sectors 2016 Workshop: Community Report

Jim Alexander, Marco Battaglieri, Bertrand Echenard +201 more

hep-ph · · cited 370× · arXiv ↗ · more like this ·

This report, based on the Dark Sectors workshop at SLAC in April 2016, summarizes the scientific importance of searches for dark sector dark matter and forces at masses beneath the weak-scale, the status of this broad international field, the important milestones motivating future exploration, and promising experimental opportunities to reach these milestones over the next 5-10 years.