Author

Xuan Wang

1,219 papers · 1753–2026

1967peak 162 in 20252026

Frequent co-authors

Papers

showing 1–25 of 1,219 RSS

A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network

Stephen Gang Wu, Forrest Sheng Bao, Eric You Xu +3 more

cs.AI · 29 Jul 2007 · cited 985× · arXiv ↗ · more like this ·

In this paper, we employ Probabilistic Neural Network (PNN) with image and data processing techniques to implement a general purpose automated leaf recognition algorithm. 12 leaf features are extracted and orthogonalized into 5 principal variables which consist the input vector of the PNN. The PNN is trained by 1800 leaves to classify 32 kinds of plants with an accuracy greater than 90%. Compared with other approaches, our algorithm is an accurate artificial intelligence approach which is fast in execution and easy in implementation.

Improving sentiment analysis via sentence type classification using BiLSTM-CRF and CNN

Tao Chen, Ruifeng Xu, Yulan He +1 more

Artificial Intelligence · Expert Systems with Applications · 9 Nov 2016 · cited 737× · DOI ↗ · more like this ·

Different types of sentences express sentiment in very different ways. Traditional sentence-level sentiment classification research focuses on one-technique-fits-all solution or only centers on one special type of sentences. In this paper, we propose a divide-and-conquer approach which first classifies sentences into different types, then performs sentiment analysis separately on sentences from each type. Specifically, we find that sentences tend to be more complex if they contain more sentiment targets. Thus, we propose to first apply a neural network based sequence model to classify opinionated sentences into three types according to the number of targets appeared in a sentence. Each group of sentences is then fed into a one-dimensional convolutional neural network separately for sentiment classification. Our approach has been evaluated on four sentiment classification datasets and…

SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

Wenxuan Zhang, Xiaodong Cun, Xuan Wang +5 more

cs.CV · November 2022 · cited 538× · arXiv ↗ · more like this ·

Generating talking head videos through a face image and a piece of speech audio still contains many challenges. ie, unnatural head movement, distorted expression, and identity modification. We argue that these issues are mainly because of learning from the coupled 2D motion fields. On the other hand, explicitly using 3D information also suffers problems of stiff expression and incoherent video. We present SadTalker, which generates 3D motion coefficients (head pose, expression) of the 3DMM from audio and implicitly modulates a novel 3D-aware face render for talking head generation. To learn the realistic motion coefficients, we explicitly model the connections between audio and different types of motion coefficients individually. Precisely, we present ExpNet to learn the accurate facial expression from audio by distilling both coefficients and 3D-rendered faces. As for the head pose, we…

Deblur-NeRF: Neural Radiance Fields from Blurry Images

Li Ma, Xiaoyu Li, Jing Liao +4 more

cs.CV · November 2021 · cited 297× · arXiv ↗ · more like this ·

Neural Radiance Field (NeRF) has gained considerable attention recently for 3D scene reconstruction and novel view synthesis due to its remarkable synthesis quality. However, image blurriness caused by defocus or motion, which often occurs when capturing scenes in the wild, significantly degrades its reconstruction quality. To address this problem, We propose Deblur-NeRF, the first method that can recover a sharp NeRF from blurry input. We adopt an analysis-by-synthesis approach that reconstructs blurry views by simulating the blurring process, thus making NeRF robust to blurry inputs. The core of this simulation is a novel Deformable Sparse Kernel (DSK) module that models spatially-varying blur kernels by deforming a canonical sparse kernel at each spatial location. The ray origin of each kernel point is jointly optimized, inspired by the physical blurring process. This module is…

Examining the key influencing factors on college students’ higher-order thinking skills in the smart classroom environment

Kaili Lu, Harrison Hao Yang, Yinghui Shi +1 more

Education · International Journal of Educational Technology in Higher Education · 8 Jan 2021 · cited 293× · DOI ↗ · more like this ·

Abstract To understand the development of students’ higher-order thinking skills (HOTS) in the smart classroom environment, a structural equation modeling analysis was used to examine the relationships between key factors that influence students’ learning and their HOTS within a smart classroom environment. A sample of 217 first-year Chinese college students, who studied in a smart classroom environment for one semester, completed a survey that measures their smart classroom preferences, learning motivation, learning strategy, peer interaction, and HOTS. The results indicated that peer interaction and learning motivation had a direct impact on students’ HOTS. Furthermore, indirect effects were found between students’ learning strategy and HOTS through the mediator peer interaction, and between smart classroom preferences and HOTS through the following: learning motivation, the…

Cross-type Biomedical Named Entity Recognition with Deep Multi-Task Learning

Xuan Wang, Yu Zhang, Xiang Ren +5 more

cs.IR · January 2018 · cited 271× · arXiv ↗ · more like this ·

Motivation: State-of-the-art biomedical named entity recognition (BioNER) systems often require handcrafted features specific to each entity type, such as genes, chemicals and diseases. Although recent studies explored using neural network models for BioNER to free experts from manual feature engineering, the performance remains limited by the available training data for each entity type. Results: We propose a multi-task learning framework for BioNER to collectively use the training data of different types of entities and improve the performance on each of them. In experiments on 15 benchmark BioNER datasets, our multi-task model achieves substantially better performance compared with state-of-the-art BioNER systems and baseline neural sequence labeling models. Further analysis shows that the large performance gains come from sharing character- and word-level information among relevant…

Hallucinated Neural Radiance Fields in the Wild

Xingyu Chen, Qi Zhang, Xiaoyu Li +4 more

cs.CV · November 2021 · cited 193× · arXiv ↗ · more like this ·

Neural Radiance Fields (NeRF) has recently gained popularity for its impressive novel view synthesis ability. This paper studies the problem of hallucinated NeRF: i.e., recovering a realistic NeRF at a different time of day from a group of tourism images. Existing solutions adopt NeRF with a controllable appearance embedding to render novel views under various conditions, but they cannot render view-consistent images with an unseen appearance. To solve this problem, we present an end-to-end framework for constructing a hallucinated NeRF, dubbed as Ha-NeRF. Specifically, we propose an appearance hallucination module to handle time-varying appearances and transfer them to novel views. Considering the complex occlusions of tourism images, we introduce an anti-occlusion module to decompose the static subjects for visibility accurately. Experimental results on synthetic data and real tourism…

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Kun Cheng, Xiaodong Cun, Yong Zhang +6 more

cs.CV · 27 Nov 2022 · cited 186× · arXiv ↗ · more like this ·

We present VideoReTalking, a new system to edit the faces of a real-world talking head video according to input audio, producing a high-quality and lip-syncing output video even with a different emotion. Our system disentangles this objective into three sequential tasks: (1) face video generation with a canonical expression; (2) audio-driven lip-sync; and (3) face enhancement for improving photo-realism. Given a talking-head video, we first modify the expression of each frame according to the same expression template using the expression editing network, resulting in a video with the canonical expression. This video, together with the given audio, is then fed into the lip-sync network to generate a lip-syncing video. Finally, we improve the photo-realism of the synthesized faces through an identity-aware face enhancement network and post-processing. We use learning-based approaches for…

Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatars

Jingxiang Sun, Xuan Wang, Lizhen Wang +4 more

cs.CV · November 2022 · cited 176× · arXiv ↗ · more like this ·

3D-aware generative adversarial networks (GANs) synthesize high-fidelity and multi-view-consistent facial images using only collections of single-view 2D imagery. Towards fine-grained control over facial attributes, recent efforts incorporate 3D Morphable Face Model (3DMM) to describe deformation in generative radiance fields either explicitly or implicitly. Explicit methods provide fine-grained expression control but cannot handle topological changes caused by hair and accessories, while implicit ones can model varied topologies but have limited generalization caused by the unconstrained deformation fields. We propose a novel 3D GAN framework for unsupervised learning of generative, high-quality and 3D-consistent facial avatars from unstructured 2D images. To achieve both deformation accuracy and topological flexibility, we propose a 3D representation called Generative…

FENeRF: Face Editing in Neural Radiance Fields

Jingxiang Sun, Xuan Wang, Yong Zhang +4 more

cs.CV · November 2021 · cited 174× · arXiv ↗ · more like this ·

Previous portrait image generation methods roughly fall into two categories: 2D GANs and 3D-aware GANs. 2D GANs can generate high fidelity portraits but with low view consistency. 3D-aware GAN methods can maintain view consistency but their generated images are not locally editable. To overcome these limitations, we propose FENeRF, a 3D-aware generator that can produce view-consistent and locally-editable portrait images. Our method uses two decoupled latent codes to generate corresponding facial semantics and texture in a spatial aligned 3D volume with shared geometry. Benefiting from such underlying 3D representation, FENeRF can jointly render the boundary-aligned image and semantic mask and use the semantic mask to edit the 3D volume via GAN inversion. We further show such 3D representation can be learned from widely available monocular image and semantic mask pairs. Moreover, we…

HDR-NeRF: High Dynamic Range Neural Radiance Fields

Xin Huang, Qi Zhang, Ying Feng +3 more

cs.CV · November 2021 · cited 173× · arXiv ↗ · more like this ·

We present High Dynamic Range Neural Radiance Fields (HDR-NeRF) to recover an HDR radiance field from a set of low dynamic range (LDR) views with different exposures. Using the HDR-NeRF, we are able to generate both novel HDR views and novel LDR views under different exposures. The key to our method is to model the physical imaging process, which dictates that the radiance of a scene point transforms to a pixel value in the LDR image with two implicit functions: a radiance field and a tone mapper. The radiance field encodes the scene radiance (values vary from 0 to +infty), which outputs the density and radiance of a ray by giving corresponding ray origin and ray direction. The tone mapper models the mapping process that a ray hitting on the camera sensor becomes a pixel value. The color of the ray is predicted by feeding the radiance and the corresponding exposure time into the tone…

Semi-Supervised Medical Image Segmentation Using Adversarial Consistency Learning and Dynamic Convolution Network

Tao Lei, Dong Zhang, Xiaogang Du +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Medical Imaging · December 2022 · cited 163× · DOI ↗ · more like this ·

Popular semi-supervised medical image segmentation networks often suffer from error supervision from unlabeled data since they usually use consistency learning under different data perturbations to regularize model training. These networks ignore the relationship between labeled and unlabeled data, and only compute single pixel-level consistency leading to uncertain prediction results. Besides, these networks often require a large number of parameters since their backbone networks are designed depending on supervised image segmentation tasks. Moreover, these networks often face a high over-fitting risk since a small number of training samples are popular for semi-supervised image segmentation. To address the above problems, in this paper, we propose a novel adversarial self-ensembling network using dynamic convolution (ASE-Net) for semi-supervised medical image segmentation. First, we…

Joint association of loneliness and traditional risk factor control and incident cardiovascular disease in diabetes patients

Xuan Wang, Hao Ma, Xiang Li +3 more

Health · European Heart Journal · 29 Jun 2023 · cited 150× · DOI ↗ · more like this ·

AIMS: To investigate the prospective associations of the loneliness and social isolation scales with cardiovascular disease (CVD) risk in diabetes patients and compare the relative importance of loneliness and social isolation with traditional risk factors. Also, the interactions of loneliness or isolation with the degree of risk factor control in relation to CVD risk were evaluated. METHODS AND RESULTS: A total of 18 509 participants diagnosed with diabetes from the UK Biobank were included. A two-item scale and a three-item scale were used to assess loneliness and isolation levels, respectively. The degree of risk factor control was defined as numbers of glycated hemoglobin (HbA1c), blood pressure (BP), low-density lipoprotein cholesterol (LDL-C), smoking, and kidney condition controlled within the target range. During a mean follow-up of 10.7 years, 3247 total CVD incidents were…

An Integrated Multi-Task Model for Fake News Detection

Qing Liao, Heyan Chai, Hao Han +4 more

Sociology and Political Science · IEEE Transactions on Knowledge and Data Engineering · 28 Jan 2021 · cited 145× · DOI ↗ · more like this ·

Fake news detection attracts many researchers’ attention due to the negative impacts on the society. Most existing fake news detection approaches mainly focus on semantic analysis of news’ contents. However, the detection performance will dramatically decrease when the content of news is short. In this paper, we propose a novel <italic xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">fake news detection multi-task learning (FDML)</i> model based on the following observations: 1) some certain topics have higher percentages of fake news; and 2) some certain news authors have higher intentions to publish fake news. FDML model investigates the impact of topic labels for the fake news and introduce contextual information of news at the same time to boost the detection performance on the short fake news. Specifically, the FDML model consists of…

COVID-19 Literature Knowledge Graph Construction and Drug Repurposing Report Generation

Qingyun Wang, Manling Li, Xuan Wang +24 more

cs.CL · July 2020 · cited 130× · arXiv ↗ · more like this ·

To combat COVID-19, both clinicians and scientists need to digest vast amounts of relevant biomedical knowledge in scientific literature to understand the disease mechanism and related biological functions. We have developed a novel and comprehensive knowledge discovery framework, COVID-KG to extract fine-grained multimedia knowledge elements (entities and their visual chemical structures, relations, and events) from scientific literature. We then exploit the constructed multimedia knowledge graphs (KGs) for question answering and report generation, using drug repurposing as a case study. Our framework also provides detailed contextual sentences, subfigures, and knowledge subgraphs as evidence.

Learning User and Product Distributed Representations Using a Sequence Model for Sentiment Analysis

Tao Chen, Ruifeng Xu, Yulan He +2 more

Artificial Intelligence · IEEE Computational Intelligence Magazine · 18 Jul 2016 · cited 125× · DOI ↗ · more like this ·

In product reviews, it is observed that the distribution of polarity ratings over reviews written by different users or evaluated based on different products are often skewed in the real world. As such, incorporating user and product information would be helpful for the task of sentiment classification of reviews. However, existing approaches ignored the temporal nature of reviews posted by the same user or evaluated on the same product. We argue that the temporal relations of reviews might be potentially useful for learning user and product embedding and thus propose employing a sequence model to embed these temporal relations into user and product representations so as to improve the performance of document-level sentiment analysis. Specifically, we first learn a distributed representation of each review by a one-dimensional convolutional neural network. Then, taking these…

Video-Based Vehicle Counting Framework

Zhe Dai, Huansheng Song, Xuan Wang +4 more

Computer Vision and Pattern Recognition · IEEE Access · 2019 · cited 120× · DOI ↗ · more like this ·

The continuous development in the construction of transportation infrastructure has brought enormous pressure to traffic control. Accurate and detailed traffic flow information is valuable for an effective traffic control strategy. This paper proposes a video-based vehicle counting framework using a three-component process of object detection, object tracking, and trajectory processing to obtain the traffic flow information. First, a dataset for vehicle object detection (VDD) and a standard dataset for verifying the vehicle counting results (VCD) were established. The object detection was then completed by deep learning with VDD. Using this detection, a matching algorithm was designed to perform multi-object tracking in combination with a traditional tracking method. Trajectories of the moving objects were obtained using this approach. Finally, a trajectory counting algorithm based on…

A NoC Traffic Suite Based on Real Applications

Weichen Liu, Jiang Xu, Xiaowen Wu +5 more

Computer Networks and Communications · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · July 2011 · cited 115× · DOI ↗ · more like this ·

As benchmark programs for microprocessor architectures, network-on-chip (NoC) traffic patterns are essential tools for NoC performance assessments and architecture explorations. The fidelity of NoC traffic patterns has profound influence on NoC studies. For the first time, this paper presents a realistic traffic benchmark suite, called MCSL, and the methodology used to generate it. The publicly released MCSL benchmark suite includes a set of realistic traffic patterns for 8 real applications and covers popular NoC architectures. It captures not only the communication behaviors in NoCs but also the temporal dependencies among them. MCSL benchmark suite can be easily incorporated into existing NoC simulators and significantly improve NoC simulation accuracy. We developed a systematic traffic generation methodology to create MCSL based on real applications. The methodology uses formal…

IDE-3D

Jingxiang Sun, Xuan Wang, Yichun Shi +3 more

Computer Vision and Pattern Recognition · ACM Transactions on Graphics · 30 Nov 2022 · cited 105× · DOI ↗ · more like this ·

Existing 3D-aware facial generation methods face a dilemma in quality versus editability: they either generate editable results in low resolution, or high-quality ones with no editing flexibility. In this work, we propose a new approach that brings the best of both worlds together. Our system consists of three major components: (1) a 3D-semantics-aware generative model that produces view-consistent, disentangled face images and semantic masks; (2) a hybrid GAN inversion approach that initializes the latent codes from the semantic and texture encoder, and further optimizes them for faithful reconstruction; and (3) a canonical editor that enables efficient manipulation of semantic masks in canonical view and produces high-quality editing results. Our approach is competent for many applications, e.g. free-view face drawing, editing and style control. Both quantitative and qualitative…

From Hyper-dimensional Structures to Linear Structures: Maintaining Deduplicated Data’s Locality

Xiangyu Zou, Jingsong Yuan, Philip Shilane +3 more

Information Systems · ACM Transactions on Storage · 2 Jun 2022 · cited 104× · DOI ↗ · more like this ·

Data deduplication is widely used to reduce the size of backup workloads, but it has the known disadvantage of causing poor data locality, also referred to as the fragmentation problem. This results from the gap between the hyper-dimensional structure of deduplicated data and the sequential nature of many storage devices, and this leads to poor restore and garbage collection (GC) performance. Current research has considered writing duplicates to maintain locality (e.g., rewriting) or caching data in memory or SSD, but fragmentation continues to lower restore and GC performance. Investigating the locality issue, we design a method to flatten the hyper-dimensional structured deduplicated data to a one-dimensional format, which is based on classification of each chunk’s lifecycle, and this creates our proposed data layout. Furthermore, we present a novel management-friendly deduplication…

The Design of Fast and Lightweight Resemblance Detection for Efficient Post-Deduplication Delta Compression

Wen Xia, Lifeng Pu, Xiangyu Zou +4 more

Computer Networks and Communications · ACM Transactions on Storage · 16 Feb 2023 · cited 96× · DOI ↗ · more like this ·

Post-deduplication delta compression is a data reduction technique that calculates and stores the differences of very similar but non-duplicate chunks in storage systems, which is able to achieve a very high compression ratio. However, the low throughput of widely used resemblance detection approaches (e.g., N-Transform) usually becomes the bottleneck of delta compression systems due to introducing high computational overhead. Generally, this overhead mainly consists of two parts: ① calculating the rolling hash byte by byte across data chunks and ② applying multiple transforms on all of the calculated rolling hash values. In this article, we propose Odess, a fast and lightweight resemblance detection approach, that greatly reduces the computational overhead for resemblance detection while achieving high detection accuracy and a high compression ratio. Odess first utilizes a novel…

CoDine

Jun Wei, Xuan Wang, Roshan Lalintha Peiris +6 more

Human-Computer Interaction · National University of Singapore · 17 Sep 2011 · cited 96× · DOI ↗ · more like this ·

The pervasiveness of computing has extended into domestic realms, including the dining room. Beyond simply a place to consume food, the dining room is a social hub where family members meet and share experiences. Yet busy lifestyles can make it difficult to spend social time with your family. To provide a new solution for family bonding, this paper presents the CoDine system, a dining table embedded with interactive subsystems that augment and transport the experience of communal family dining to create a sense of coexistence among remote family members. CoDine connects people in different locations through shared dining activities: gesture-based screen interaction, mutual food serving, ambient pictures on an animated tablecloth, and the transportation of edible messages. Rather than focusing on functionality or efficiency, CoDine aims to provide people with an engaging interactive…

Expressive 3D Facial Animation Generation Based on Local-to-Global Latent Diffusion

Wenfeng Song, Xuan Wang, Yiming Jiang +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Visualization and Computer Graphics · 10 Sep 2024 · cited 83× · DOI ↗ · more like this ·

3D Facial animations, crucial to augmented and mixed reality digital media, have evolved from mere aesthetic elements to potent storytelling media. Despite considerable progress in facial animation of neutral emotions, existing methods still struggle to capture the authenticity of emotions. This paper introduces a novel approach to capture fine facial expressions and generate facial animations using audio synchronization. Our method consists of two key components: First, the Local-to-global Latent Diffusion Model (LG-LDM) tailored for authentic facial expressions, which can integrate audio, time step, facial expressions, and other conditions towards possible encoding of emotionally rich yet latent features in response to possibly noisy raw audio signals. The core of LG-LDM is our carefully designed Facial Denoiser Model (FDM) for aligning the local-to-global animation feature with…

Distantly-Supervised Named Entity Recognition with Noise-Robust Learning and Language Model Augmented Self-Training

Yu Meng, Yunyi Zhang, Jiaxin Huang +4 more

cs.CL · 10 Sep 2021 · cited 81× · arXiv ↗ · more like this ·

We study the problem of training named entity recognition (NER) models using only distantly-labeled data, which can be automatically obtained by matching entity mentions in the raw text with entity types in a knowledge base. The biggest challenge of distantly-supervised NER is that the distant supervision may induce incomplete and noisy labels, rendering the straightforward application of supervised learning ineffective. In this paper, we propose (1) a noise-robust learning scheme comprised of a new loss function and a noisy label removal step, for training NER models on distantly-labeled data, and (2) a self-training method that uses contextualized augmentations created by pre-trained language models to improve the generalization ability of the NER model. On three benchmark datasets, our method achieves superior performance, outperforming existing distantly-supervised NER models by…

TalkingStyle: Personalized Speech-Driven 3D Facial Animation With Style Preservation

Wenfeng Song, Xuan Wang, Shi Zheng +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Visualization and Computer Graphics · 11 Jun 2024 · cited 78× · DOI ↗ · more like this ·

It is a challenging task to create realistic 3D avatars that accurately replicate individuals' speech and unique talking styles for speech-driven facial animation. Existing techniques have made remarkable progress but still struggle to achieve lifelike mimicry. This article proposes "TalkingStyle", a novel method to generate personalized talking avatars while retaining the talking style of the person. Our approach uses a set of audio and animation samples from an individual to create new facial animations that closely resemble their specific talking style, synchronized with speech. We disentangle the style codes from the motion patterns, allowing our method to associate a distinct identifier with each person. To manage each aspect effectively, we employ three separate encoders for style, speech, and motion, ensuring the preservation of the original style while maintaining consistent…