arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Fang

7,995 papers · 1966–2023

1966: 11967: 01968: 11969: 01970: 11971: 01972: 11973: 21974: 21975: 21976: 41977: 21978: 01979: 41980: 31981: 11982: 31983: 41984: 31985: 21986: 31987: 61988: 61989: 121990: 191991: 141992: 141993: 201994: 301995: 321996: 331997: 451998: 501999: 402000: 532001: 692002: 1612003: 1712004: 1992005: 2422006: 2842007: 2902008: 3272009: 3652010: 5402011: 4942012: 6282013: 6792014: 7632015: 8142016: 4602017: 4552018: 5312019: 1022020: 42021: 02022: 32023: 1
1966peak 814 in 20152023

Frequent co-authors

Papers

showing 1–25 of 7,995 RSS

Dual Attention Network for Scene Segmentation

Jun Fu, Jing Liu, Haijie Tian +4 more

cs.CV · · cited 6,246× · arXiv ↗ · more like this ·

In this paper, we address the scene segmentation task by capturing rich contextual dependencies based on the selfattention mechanism. Unlike previous works that capture contexts by multi-scale features fusion, we propose a Dual Attention Networks (DANet) to adaptively integrate local features with their global dependencies. Specifically, we append two types of attention modules on top of traditional dilated FCN, which model the semantic interdependencies in spatial and channel dimensions respectively. The position attention module selectively aggregates the features at each position by a weighted sum of the features at all positions. Similar features would be related to each other regardless of their distances. Meanwhile, the channel attention module selectively emphasizes interdependent channel maps by integrating associated features among all channel maps. We sum the outputs of the…

Microsoft COCO Captions: Data Collection and Evaluation Server

Xinlei Chen, Hao Fang, Tsung-Yi Lin +4 more

cs.CV · · cited 3,000× · arXiv ↗ · more like this ·

In this paper we describe the Microsoft COCO Caption dataset and evaluation server. When completed, the dataset will contain over one and a half million captions describing over 330,000 images. For the training and validation images, five independent human generated captions will be provided. To ensure consistency in evaluation of automatic caption generation algorithms, an evaluation server is used. The evaluation server receives candidate captions and scores them using several popular metrics, including BLEU, METEOR, ROUGE and CIDEr. Instructions for using the evaluation server are provided.

Image Captioning with Semantic Attention

Quanzeng You, Hailin Jin, Zhaowen Wang +2 more

cs.CV · · cited 1,798× · arXiv ↗ · more like this ·

Automatically generating a natural language description of an image has attracted interests recently both because of its importance in practical applications and because it connects two major artificial intelligence fields: computer vision and natural language processing. Existing approaches are either top-down, which start from a gist of an image and convert it into words, or bottom-up, which come up with words describing various aspects of an image and then combine them. In this paper, we propose a new algorithm that combines both approaches through a model of semantic attention. Our algorithm learns to selectively attend to semantic concept proposals and fuse them into hidden states and outputs of recurrent neural networks. The selection and fusion form a feedback connecting the top-down and bottom-up computation. We evaluate our algorithm on two public benchmarks: Microsoft COCO and…

RMPE: Regional Multi-person Pose Estimation

Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai +1 more

cs.CV · · cited 1,794× · arXiv ↗ · more like this ·

Multi-person pose estimation in the wild is challenging. Although state-of-the-art human detectors have demonstrated good performance, small errors in localization and recognition are inevitable. These errors can cause failures for a single-person pose estimator (SPPE), especially for methods that solely depend on human detection results. In this paper, we propose a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes. Our framework consists of three components: Symmetric Spatial Transformer Network (SSTN), Parametric Pose Non-Maximum-Suppression (NMS), and Pose-Guided Proposals Generator (PGPG). Our method is able to handle inaccurate bounding boxes and redundant detections, allowing it to achieve a 17% increase in mAP over the state-of-the-art methods on the MPII (multi person) dataset.Our model…

MVSNet: Depth Inference for Unstructured Multi-view Stereo

Yao Yao, Zixin Luo, Shiwei Li +2 more

cs.CV · · cited 1,729× · arXiv ↗ · more like this ·

We present an end-to-end deep learning architecture for depth map inference from multi-view images. In the network, we first extract deep visual image features, and then build the 3D cost volume upon the reference camera frustum via the differentiable homography warping. Next, we apply 3D convolutions to regularize and regress the initial depth map, which is then refined with the reference image to generate the final output. Our framework flexibly adapts arbitrary N-view inputs using a variance-based cost metric that maps multiple features into one cost feature. The proposed MVSNet is demonstrated on the large-scale indoor DTU dataset. With simple post-processing, our method not only significantly outperforms previous state-of-the-arts, but also is several times faster in runtime. We also evaluate MVSNet on the complex outdoor Tanks and Temples dataset, where our method ranks first…

Challenges of Big Data Analysis

Jianqing Fan, Fang Han, Han Liu

stat.ML · · cited 1,445× · arXiv ↗ · more like this ·

Big Data bring new opportunities to modern society and challenges to data scientists. On one hand, Big Data hold great promises for discovering subtle population patterns and heterogeneities that are not possible with small-scale data. On the other hand, the massive sample size and high dimensionality of Big Data introduce unique computational and statistical challenges, including scalability and storage bottleneck, noise accumulation, spurious correlation, incidental endogeneity, and measurement errors. These challenges are distinguished and require new computational and statistical paradigm. This article give overviews on the salient features of Big Data and how these features impact on paradigm change on statistical and computational methods as well as computing architectures. We also provide various new perspectives on the Big Data analysis and computation. In particular, we…

From Captions to Visual Concepts and Back

Hao Fang, Saurabh Gupta, Forrest Iandola +9 more

cs.CV · · cited 1,363× · arXiv ↗ · more like this ·

This paper presents a novel approach for automatically generating image descriptions: visual detectors, language models, and multimodal similarity models learnt directly from a dataset of image captions. We use multiple instance learning to train visual detectors for words that commonly occur in captions, including many different parts of speech such as nouns, verbs, and adjectives. The word detector outputs serve as conditional inputs to a maximum-entropy language model. The language model learns from a set of over 400,000 image descriptions to capture the statistics of word usage. We capture global semantics by re-ranking caption candidates using sentence-level features and a deep multimodal similarity model. Our system is state-of-the-art on the official Microsoft COCO benchmark, producing a BLEU-4 score of 29.1%. When human judges compare the system captions to ones written by other…

Social networks that matter: Twitter under the microscope

Bernardo A. Huberman, Daniel M. Romero, Fang Wu

cs.CY · · cited 1,362× · arXiv ↗ · more like this ·

Scholars, advertisers and political activists see massive online social networks as a representation of social interactions that can be used to study the propagation of ideas, social bond dynamics and viral marketing, among others. But the linked structures of social networks do not reveal actual interactions among people. Scarcity of attention and the daily rythms of life and work makes people default to interacting with those few that matter and that reciprocate their attention. A study of social interactions within Twitter reveals that the driver of usage is a sparse and hidden network of connections underlying the declared set of friends and followers.

Universal Style Transfer via Feature Transforms

Yijun Li, Chen Fang, Jimei Yang +3 more

cs.CV · · cited 1,166× · arXiv ↗ · more like this ·

Universal style transfer aims to transfer arbitrary visual styles to content images. Existing feed-forward based methods, while enjoying the inference efficiency, are mainly limited by inability of generalizing to unseen styles or compromised visual quality. In this paper, we present a simple yet effective method that tackles these limitations without training on any pre-defined styles. The key ingredient of our method is a pair of feature transforms, whitening and coloring, that are embedded to an image reconstruction network. The whitening and coloring transforms reflect a direct matching of feature covariance of the content image to a given style image, which shares similar spirits with the optimization of Gram matrix based cost in neural style transfer. We demonstrate the effectiveness of our algorithm by generating high-quality stylized images with comparisons to a number of recent…

Crowdsourcing to smartphones

Dejun Yang, Guoliang Xue, Xi Fang +1 more

Computer Science Applications · · cited 1,006× · DOI ↗ · more like this ·

Mobile phone sensing is a new paradigm which takes advantage of the pervasive smartphones to collect and analyze data beyond the scale of what was previously possible. In a mobile phone sensing system, the platform recruits smartphone users to provide sensing service. Existing mobile phone sensing applications and systems lack good incentive mechanisms that can attract more user participation. To address this issue, we design incentive mechanisms for mobile phone sensing. We consider two system models: the platform-centric model where the platform provides a reward shared by participating users, and the user-centric model where users have more control over the payment they will receive. For the platform-centric model, we design an incentive mechanism using a Stackelberg game, where the platform is the leader while the users are the followers. We show how to compute the unique…

The PDBbind Database:  Methodologies and Updates

Renxiao Wang, Xueliang Fang, Yipin Lu +2 more

Computational Theory and Mathematics · Journal of Medicinal Chemistry · · cited 946× · DOI ↗ · more like this ·

We have developed the PDBbind database to provide a comprehensive collection of binding affinities for the protein-ligand complexes in the Protein Data Bank (PDB). This paper gives a full description of the latest version, i.e., version 2003, which is an update to our recently reported work. Out of 23 790 entries in the PDB release No.107 (January 2004), 5897 entries were identified as protein-ligand complexes that meet our definition. Experimentally determined binding affinities (K(d), K(i), and IC(50)) for 1622 of these were retrieved from the references associated with these complexes. A total of 900 complexes were selected to form a "refined set", which is of particular value as a standard data set for docking and scoring studies. All of the final data, including binding affinity data, reference citations, and processed structural files, have been incorporated into the PDBbind…

Uniform Design: Theory and Application

Kai-Tai Fang, Dennis K. J. Lin, Peter Winker +1 more

Computational Theory and Mathematics · Technometrics · · cited 883× · DOI ↗ · more like this ·

A uniform design (UD) seeks design points that are uniformly scattered on the domain. It has been popular since 1980. A survey of UD is given in the first portion: The fundamental idea and construction method are presented and discussed and examples are given for illustration. It is shown that UD's have many desirable properties for a wide variety of applications. Furthermore, we use the global optimization algorithm, threshold accepting, to generate UD's with low discrepancy. The relationship between uniformity and orthogonality is investigated. It turns out that most UD's obtained here are indeed orthogonal.

Sentiment analysis using product review data

Xing Fang, Justin Zhan

Artificial Intelligence · Journal Of Big Data · · cited 784× · DOI ↗ · more like this ·

Sentiment analysis or opinion mining is one of the major tasks of NLP (Natural Language Processing). Sentiment analysis has gain much attention in recent years. In this paper, we aim to tackle the problem of sentiment polarity categorization, which is one of the fundamental problems of sentiment analysis. A general process for sentiment polarity categorization is proposed with detailed process descriptions. Data used in this study are online product reviews collected from Amazon.com. Experiments for both sentence-level categorization and review-level categorization are performed with promising outcomes. At last, we also give insight into our future work on sentiment analysis.

Functional linear regression analysis for longitudinal data

Fang Yao, Hans-Georg Müller, Jane-Ling Wang

math.ST · · cited 777× · arXiv ↗ · more like this ·

We propose nonparametric methods for functional linear regression which are designed for sparse longitudinal data, where both the predictor and response are functions of a covariate such as time. Predictor and response processes have smooth random trajectories, and the data consist of a small number of noisy repeated measurements made at irregular times for a sample of subjects. In longitudinal studies, the number of repeated measurements per subject is often small and may be modeled as a discrete random number and, accordingly, only a finite and asymptotically nonincreasing number of measurements are available for each subject or experimental unit. We propose a functional regression approach for this situation, using functional principal component analysis, where we estimate the functional principal component scores through conditional expectations. This allows the prediction of an…

A robust and scalable clustering algorithm for mixed type attributes in large database environment

Tom Chiu, Dongping Fang, John Chen +2 more

Artificial Intelligence · · cited 722× · DOI ↗ · more like this ·

Clustering is a widely used technique in data mining applications to discover patterns in the underlying data. Most traditional clustering algorithms are limited to handling datasets that contain either continuous or categorical attributes. However, datasets with mixed types of attributes are common in real life data mining problems. In this paper, we propose a distance measure that enables clustering data with both continuous and categorical attributes. This distance measure is derived from a probabilistic model that the distance between two clusters is equivalent to the decrease in log-likelihood function as a result of merging. Calculation of this measure is memory efficient as it depends only on the merging cluster pair and not on all the other clusters. Zhang et al [8] proposed a clustering method named BIRCH that is especially suitable for very large datasets. We develop a…

Recurrent MVSNet for High-resolution Multi-view Stereo Depth Inference

Yao Yao, Zixin Luo, Shiwei Li +3 more

cs.CV · · cited 721× · arXiv ↗ · more like this ·

Deep learning has recently demonstrated its excellent performance for multi-view stereo (MVS). However, one major limitation of current learned MVS approaches is the scalability: the memory-consuming cost volume regularization makes the learned MVS hard to be applied to high-resolution scenes. In this paper, we introduce a scalable multi-view stereo framework based on the recurrent neural network. Instead of regularizing the entire 3D cost volume in one go, the proposed Recurrent Multi-view Stereo Network (R-MVSNet) sequentially regularizes the 2D cost maps along the depth direction via the gated recurrent unit (GRU). This reduces dramatically the memory consumption and makes high-resolution reconstruction feasible. We first show the state-of-the-art performance achieved by the proposed R-MVSNet on the recent MVS benchmarks. Then, we further demonstrate the scalability of the proposed…

Tetrahedral mesh generation from volumetric binary and grayscale images

Qianqian Fang, David A. Boas

Computer Vision and Pattern Recognition · · cited 720× · DOI ↗ · more like this ·

We report a general purpose mesh generator for creating finite-element surface or volumetric mesh from 31) binary or gray-scale medical images. This toolbox incorporates a number of existing free mesh processing utilities and enables researchers to perform a range of mesh processing tasks for image-based mesh generation, including raw image processing, surface mesh extraction, surface re-sampling, and multi-scale/adaptive tetrahedral mesh generation. We also implemented robust algorithms for meshing open-surfaces and sub-region labeling. Atomic meshing utilities for each processing step can be accessed with simple interfaces, which can be streamlined or executed independently. The toolbox is compatible with Matlab or GNU Octave. We demonstrate the applications of this toolbox for meshing a range of challenging geometries including complex vessel network, human brain and breast.

Spin-orbit gap of graphene: First-principles calculations

Yugui Yao, Fei Ye, Xiao-Liang Qi +2 more

cond-mat.mes-hall · · cited 720× · arXiv ↗ · more like this ·

Even though graphene is a low energy system consisting of the two dimensional honeycomb lattice of carbon atoms, its quasi-particle excitations are fully described by the 2+1 dimensional relativistic Dirac equation. In this paper we show that while the spin-orbit interaction in graphene is of the order of $4 meV$, it opens up a gap of the order of $10^{-3} meV$ at the Dirac points. We present the first principle calculation of the spin-orbit gap, and explain the behavior in terms of a simple tight-binding model. Our result also shows that the recently predicted quantum spin Hall effect in graphene can only occur at unrealistically low temperature.

SPIDER: Near-Optimal Non-Convex Optimization via Stochastic Path Integrated Differential Estimator

Cong Fang, Chris Junchi Li, Zhouchen Lin +1 more

math.OC · · cited 706× · arXiv ↗ · more like this ·

In this paper, we propose a new technique named \textit{Stochastic Path-Integrated Differential EstimatoR} (SPIDER), which can be used to track many deterministic quantities of interest with significantly reduced computational cost. We apply SPIDER to two tasks, namely the stochastic first-order and zeroth-order methods. For stochastic first-order method, combining SPIDER with normalized gradient descent, we propose two new algorithms, namely SPIDER-SFO and SPIDER-SFO\textsuperscript{+}, that solve non-convex stochastic optimization problems using stochastic gradients only. We provide sharp error-bound results on their convergence rates. In special, we prove that the SPIDER-SFO and SPIDER-SFO\textsuperscript{+} algorithms achieve a record-breaking gradient computation cost of $\mathcal{O}\left( \min( n^{1/2} ε^{-2}, ε^{-3} ) \right)$ for finding an $ε$-approximate first-order and…

The impact of urban form on U.S. residential energy use

Reid Ewing, Rong Fang

Transportation · Housing Policy Debate · · cited 703× · DOI ↗ · more like this ·

Abstract While the impact of urban form on transportation energy use has been studied extensively, its impact on residential energy use has not. This article presents a conceptual framework linking urban form to residential energy use via three causal pathways: electric transmission and distribution losses, energy requirements of different housing stocks, and space heating and cooling requirements associated with urban heat islands. Two of the three can be analyzed with available national data. After we control for other influences, residents of sprawling counties are more likely to live in single‐family detached houses than otherwise comparable residents of compact counties and also more likely to live in big houses. Both lead to higher residential energy use. Because of the urban heat island effect, residents of sprawling counties across the nation on average pay a small residential…

Reinforced Cross-Modal Matching and Self-Supervised Imitation Learning for Vision-Language Navigation

Xin Wang, Qiuyuan Huang, Asli Celikyilmaz +5 more

cs.CV · · cited 659× · arXiv ↗ · more like this ·

Vision-language navigation (VLN) is the task of navigating an embodied agent to carry out natural language instructions inside real 3D environments. In this paper, we study how to address three critical challenges for this task: the cross-modal grounding, the ill-posed feedback, and the generalization problems. First, we propose a novel Reinforced Cross-Modal Matching (RCM) approach that enforces cross-modal grounding both locally and globally via reinforcement learning (RL). Particularly, a matching critic is used to provide an intrinsic reward to encourage global matching between instructions and trajectories, and a reasoning navigator is employed to perform cross-modal grounding in the local visual scene. Evaluation on a VLN benchmark dataset shows that our RCM model significantly outperforms previous methods by 10% on SPL and achieves the new state-of-the-art performance. To improve…

CrowdPose: Efficient Crowded Scenes Pose Estimation and A New Benchmark

Jiefeng Li, Can Wang, Hao Zhu +3 more

cs.CV · · cited 649× · arXiv ↗ · more like this ·

Multi-person pose estimation is fundamental to many computer vision tasks and has made significant progress in recent years. However, few previous methods explored the problem of pose estimation in crowded scenes while it remains challenging and inevitable in many scenarios. Moreover, current benchmarks cannot provide an appropriate evaluation for such cases. In this paper, we propose a novel and efficient method to tackle the problem of pose estimation in the crowd and a new dataset to better evaluate algorithms. Our model consists of two key components: joint-candidate single person pose estimation (SPPE) and global maximum joints association. With multi-peak prediction for each joint and global association using graph model, our method is robust to inevitable interference in crowded scenes and very efficient in inference. The proposed method surpasses the state-of-the-art methods on…

Deep learning of binary hash codes for fast image retrieval

Kevin Lin, Huei‐Fang Yang, Jen-Hao Hsiao +1 more

Computer Vision and Pattern Recognition · · cited 642× · DOI ↗ · more like this ·

Approximate nearest neighbor search is an efficient strategy for large-scale image retrieval. Encouraged by the recent advances in convolutional neural networks (CNNs), we propose an effective deep learning framework to generate binary hash codes for fast image retrieval. Our idea is that when the data labels are available, binary codes can be learned by employing a hidden layer for representing the latent concepts that dominate the class labels. The utilization of the CNN also allows for learning image representations. Unlike other supervised methods that require pair-wised inputs for binary code learning, our method learns hash codes and image representations in a point-wised manner, making it suitable for large-scale datasets. Experimental results show that our method outperforms several state-of-the-art hashing algorithms on the CIFAR-10 and MNIST datasets. We further demonstrate…

Deep Semantic Ranking Based Hashing for Multi-Label Image Retrieval

Fang Zhao, Yongzhen Huang, Liang Wang +1 more

cs.CV · · cited 635× · arXiv ↗ · more like this ·

With the rapid growth of web images, hashing has received increasing interests in large scale image retrieval. Research efforts have been devoted to learning compact binary codes that preserve semantic similarity based on labels. However, most of these hashing methods are designed to handle simple binary similarity. The complex multilevel semantic structure of images associated with multiple labels have not yet been well explored. Here we propose a deep semantic ranking based method for learning hash functions that preserve multilevel semantic similarity between multi-label images. In our approach, deep convolutional neural network is incorporated into hash functions to jointly learn feature representations and mappings from them to hash codes, which avoids the limitation of semantic representation power of hand-crafted features. Meanwhile, a ranking list that encodes the multilevel…

TCMID: traditional Chinese medicine integrative database for herb molecular mechanism analysis

Ruichao Xue, Zhao Fang, Meixia Zhang +3 more

Computational Theory and Mathematics · Nucleic Acids Research · · cited 629× · DOI ↗ · more like this ·

As an alternative to modern western medicine, Traditional Chinese Medicine (TCM) is receiving increasingly attention worldwide. Great efforts have been paid to TCM's modernization, which tries to bridge the gap between TCM and modern western medicine. As TCM and modern western medicine share a common aspect at molecular level that the compound(s) perturb human's dysfunction network and restore human normal physiological condition, the relationship between compounds (in herb, refer to ingredients) and their targets (proteins) should be the key factor to connect TCM and modern medicine. Accordingly, we construct this Traditional Chinese Medicine Integrated Database (TCMID, http://www.megabionet.org/tcmid/), which records TCM-related information collected from different resources and through text-mining method. To enlarge the scope of the TCMID, the data have been linked to common drug and…