Author

Da Li

624 papers · 1991–2026

1991peak 62 in 20232026

Frequent co-authors

Papers

showing 1–25 of 624 RSS

Deeper, Broader and Artier Domain Generalization

Da Li, Yongxin Yang, Yi-Zhe Song +1 more

cs.CV · 9 Oct 2017 · cited 1,827× · arXiv ↗ · more like this ·

The problem of domain generalization is to learn from multiple training domains, and extract a domain-agnostic model that can then be applied to an unseen domain. Domain generalization (DG) has a clear motivation in contexts where there are target domains with distinct characteristics, yet sparse data for training. For example recognition in sketch images, which are distinctly more abstract and rarer than photos. Nevertheless, DG methods have primarily been evaluated on photo-only benchmarks focusing on alleviating the dataset bias where both problems of domain distinctiveness and data sparsity can be minimal. We argue that these benchmarks are overly straightforward, and show that simple deep learning baselines perform surprisingly well on them. In this paper, we make two main contributions: Firstly, we build upon the favorable domain shift-robust properties of deep learning methods…

Learning to Generalize: Meta-Learning for Domain Generalization

Da Li, Yongxin Yang, Yi-Zhe Song +1 more

cs.LG · 10 Oct 2017 · cited 1,806× · arXiv ↗ · more like this ·

Domain shift refers to the well known problem that a model trained in one source domain performs poorly when applied to a target domain with different statistics. {Domain Generalization} (DG) techniques attempt to alleviate this issue by producing models which by design generalize well to novel testing domains. We propose a novel {meta-learning} method for domain generalization. Rather than designing a specific model that is robust to domain shift as in most previous DG work, we propose a model agnostic training procedure for DG. Our algorithm simulates train/test domain shift during training by synthesizing virtual testing domains within each mini-batch. The meta-optimization objective requires that steps to improve training domain performance should also improve testing domain performance. This meta-learning procedure trains models with good generalization ability to novel domains. We…

Episodic Training for Domain Generalization

Da Li, Jianshu Zhang, Yongxin Yang +3 more

cs.CV · February 2019 · cited 504× · arXiv ↗ · more like this ·

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all source domains and training a single deep neural network end-to-end on all the data provides a surprisingly strong baseline that surpasses many prior published methods. In this paper, we build on this strong baseline by designing an episodic training procedure that trains a single deep network in a way that exposes it to the domain shift that characterises a novel domain at runtime. Specifically, we decompose a deep network into feature extractor and classifier components, and then train each component by simulating it interacting with a partner who is badly tuned for the current domain. This makes both components more robust, ultimately leading to our…

Experimental ten-photon entanglement

Xi-Lin Wang, Luo-Kan Chen, Wei Li +16 more

quant-ph · May 2016 · cited 491× · arXiv ↗ · more like this ·

Quantum entanglement among multiple spatially separated particles is of fundamental interest, and can serve as central resources for studies in quantum nonlocality, quantum-to-classical transition, quantum error correction, and quantum simulation. The ability of generating an increasing number of entangled particles is an important benchmark for quantum information processing. The largest entangled states were previously created with fourteen trapped ions, eight photons, and five superconducting qubits. Here, based on spontaneous parametric down-converted two-photon entanglement source with simultaneously a high brightness of ~12 MHz/W, a collection efficiency of ~70% and an indistinguishability of ~91% between independent photons, we demonstrate, for the first time, genuine and distillable entanglement of ten single photons under different pump power. Our work creates a…

Pushing the Limits of Simple Pipelines for Few-Shot Learning: External Data and Fine-Tuning Make a Difference

Shell Xu Hu, Da Li, Jan Stühmer +2 more

cs.CV · 15 Apr 2022 · cited 276× · arXiv ↗ · more like this ·

Few-shot learning (FSL) is an important and topical problem in computer vision that has motivated extensive research into numerous methods spanning from sophisticated meta-learning methods to simple transfer learning baselines. We seek to push the limits of a simple-but-effective pipeline for more realistic and practical settings of few-shot image classification. To this end, we explore few-shot learning from the perspective of neural network architecture, as well as a three stage pipeline of network updates under different data supplies, where unsupervised external data is considered for pre-training, base categories are used to simulate few-shot tasks for meta-training, and the scarcely labelled data of an novel task is taken for fine-tuning. We investigate questions such as: (1) How pre-training on external data benefits FSL? (2) How state-of-the-art transformer architectures can be…

Evaluating the Energy Efficiency of Deep Convolutional Neural Networks on CPUs and GPUs

Da Li, Xinbo Chen, Michela Becchi +1 more

Computer Vision and Pattern Recognition · October 2016 · cited 228× · DOI ↗ · more like this ·

In recent years convolutional neural networks (CNNs) have been successfully applied to various applications that are appropriate for deep learning, from image and video processing to speech recognition. The advancements in both hardware (e.g. more powerful GPUs) and software (e.g. deep learning models, open-source frameworks and supporting libraries) have significantly improved the accuracy and training time of CNNs. However, the high speed and accuracy are at the cost of energy consumption, which has been largely ignored in previous CNN design. With the size of data sets grows exponentially, the energy demand for training such data sets increases rapidly. It is highly desirable to design deep learning frameworks and algorithms that are both accurate and energy efficient. In this paper, we conduct a comprehensive study on the power behavior and energy efficiency of numerous well-known…

Robust Person Re-Identification by Modelling Feature Uncertainty

Tianyuan Yu, Da Li, Yongxin Yang +2 more

Computer Vision and Pattern Recognition · Edinburgh Research Explorer · October 2019 · cited 146× · DOI ↗ · more like this ·

We aim to learn deep person re-identification (ReID) models that are robust against noisy training data. Two types of noise are prevalent in practice: (1) label noise caused by human annotator errors and (2) data outliers caused by person detector errors or occlusion. Both types of noise pose serious problems for training ReID models, yet have been largely ignored so far. In this paper, we propose a novel deep network termed DistributionNet for robust ReID. Instead of representing each person image as a feature vector, DistributionNet models it as a Gaussian distribution with its variance representing the uncertainty of the extracted features. A carefully designed loss is formulated in DistributionNet to unevenly allocate uncertainty across training samples. Consequently, noisy samples are assigned large variance/uncertainty, which effectively alleviates their negative impacts on model…

Performance Evaluation of SUVnet With Real-Time Traffic Data

Hongyu Huang, Pei-En Luo, Jianping Li +4 more

Computer Networks and Communications · IEEE Transactions on Vehicular Technology · November 2007 · cited 144× · DOI ↗ · more like this ·

In this paper, we present the characteristics of a vehicular ad hoc network (VANET), which is the Shanghai urban vehicular network (SUVnet). We construct a mobility model using the GPS data collected from more than 4000 taxis in Shanghai. The model is both realistic and large scale. Based on this model, network topology and connectivity of SUVnet are studied. Because of the sparse distribution and dynamic topology of SUVnet, simply utilizing the conventional mobile ad hoc network routing protocols in SUVnet may not achieve a satisfactory performance. Therefore, we apply the delay-tolerant network model to SUVnet and evaluate the epidemic routing protocols. We propose a new protocol, which is the distance aware epidemic routing (DAER), to improve the bundle delivery ratio. Results show that DAER performs well for a VANET. This paper provides a basis in studying a realistic urban VANET.

Secret sharing of a quantum state

He Lu, Zhen Zhang, Luo-Kan Chen +7 more

quant-ph · 27 Apr 2016 · cited 94× · arXiv ↗ · more like this ·

Secret sharing of a quantum state, or quantum secret sharing, in which a dealer wants to share certain amount of quantum information with a few players, has wide applications in quantum information. The critical criterion in a threshold secret sharing scheme is confidentiality, with less than the designated number of players, no information can be recovered. Furthermore, in a quantum scenario, one additional critical criterion exists, the capability of sharing entangled and unknown quantum information. Here by employing a six-photon entangled state, we demonstrate a quantum threshold scheme, where the shared quantum secrecy can be efficiently reconstructed with a state fidelity as high as 93%. By observing that any one or two parties cannot recover the secrecy, we show that our scheme meets the confidentiality criterion. Meanwhile, we also demonstrate that entangled quantum information…

Real-time moving vehicle detection, tracking, and counting system implemented with OpenCV

Da Li, Bodong Liang, Weigang Zhang

Computer Vision and Pattern Recognition · April 2014 · cited 88× · DOI ↗ · more like this ·

Moving vehicle detection, tracking, and counting are very critical for traffic flow monitoring, planning, and controlling. Video-based solution, comparing to other techniques, does not disturb traffic flow and is easily installed. By analyzing the traffic video sequence recorded from a video camera, this paper presents a video-based solution applied with adaptive subtracted background technology in combination with virtual detector and blob tracking technologies. Experimental results, implemented in Visual C++ code with OpenCV development kits, indicate that the proposed method can detect, track, and count moving vehicles accurately.

The Lao Text Classification Method Based on KNN

Zhuo Chen, Lan Zhou, Xuan Da Li +2 more

Artificial Intelligence · Procedia Computer Science · 2020 · cited 74× · DOI ↗ · more like this ·

Text categorization is a common application scenario in the NLP field, and has many applications in public opinion monitoring and news classification. At present, there are few classifications for Lao text, but classification-oriented methods are widely used in other languages. Faced with the situation, this paper proposes a KNN-based classification method of Lao news text. First of all, preprocessing and feature extraction of Lao news text, then adjusting the parameters through KNN classifier, finally processing in data normalization and data dimensionality reduction, thus improving the classification effect.

Learning Domain Invariant Representations for Generalizable Person Re-Identification

Yi-Fan Zhang, Zhang Zhang, Da Li +3 more

cs.CV · March 2021 · cited 62× · arXiv ↗ · more like this ·

Generalizable person Re-Identification (ReID) has attracted growing attention in recent computer vision community. In this work, we construct a structural causal model among identity labels, identity-specific factors (clothes/shoes color etc), and domain-specific factors (background, viewpoints etc). According to the causal analysis, we propose a novel Domain Invariant Representation Learning for generalizable person Re-Identification (DIR-ReID) framework. Specifically, we first propose to disentangle the identity-specific and domain-specific feature spaces, based on which we propose an effective algorithmic implementation for backdoor adjustment, essentially serving as a causal intervention towards the SCM. Extensive experiments have been conducted, showing that DIR-ReID outperforms state-of-the-art methods on large-scale domain generalization ReID benchmarks.

Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style

Fengyin Lin, Mingkang Li, Da Li +3 more

cs.CV · 25 Mar 2023 · cited 61× · arXiv ↗ · more like this ·

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with just one network (``everything''), and (ii) we would really like to understand how this sketch-photo matching operates (``explainable''). Our key innovation lies with the realization that such a cross-modal matching problem could be reduced to comparisons of groups of key local patches -- akin to the seasoned ``bag-of-words'' paradigm. Just with this change, we are able to achieve both of the aforementioned goals, with the added benefit of no longer requiring external semantic knowledge. Technically, ours is a transformer-based cross-modal network, with three novel components (i) a self-attention module with a learnable tokenizer to produce visual…

Observation of Ten-photon Entanglement Using Thin BiB$_{3}$O$_{6}$ Crystals

Luo-Kan Chen, Zheng-Da Li, Xing-Can Yao +13 more

quant-ph · September 2016 · cited 53× · arXiv ↗ · more like this ·

We report on the experimental realization of a ten-photon Greenberger-Horne-Zeilinger state using thin BiB$_{3}$O$_{6}$ crystals. The observed fidelity is $0.606\pm0.029$, demonstrating a genuine entanglement with a standard deviation of 3.6 $σ$. This result is further verified using $p$-value calculation, obtaining an upper bound of $3.7\times10^{-3}$ under an assumed hypothesis test. Our experiment paves a new way to efficiently engineer BiB$_{3}$O$_{6}$ crystal-based multi-photon entanglement systems, which provides a promising platform for investigating advanced optical quantum information processing tasks such as boson sampling, quantum error correction and quantum-enhanced measurement.

Routing in Large-Scale Buses Ad Hoc Networks

Michel Sede, Xu Li, Da Li +3 more

Computer Networks and Communications · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · March 2008 · cited 51× · DOI ↗ · more like this ·

A disruption-tolerant network (DTN) attempts to route packets between nodes that are temporarily connected. Difficulty in such networks is that nodes have no information about the network status and contact opportunities. The situation is different in public bus networks because the movement of buses exhibits some regularity so that routing in a deterministic way is possible. Many algorithms use a contacts oracle that provides the exact meeting times and durations between all nodes. However, in a real vehicular environment, an oracle is not always accurate, and deterministic routing gives poor results. In this paper, we present BLER, a routing algorithm that achieves effective routing in a buses environment. BLER, compared to other algorithms, performs routing at bus line level instead of bus level; it uses specific bus lines information to achieve good performances. We evaluate BLER on…

Dynamic Instance Domain Adaptation

Zhongying Deng, Kaiyang Zhou, Da Li +3 more

cs.CV · March 2022 · cited 50× · arXiv ↗ · more like this ·

Most existing studies on unsupervised domain adaptation (UDA) assume that each domain's training samples come with domain labels (e.g., painting, photo). Samples from each domain are assumed to follow the same distribution and the domain labels are exploited to learn domain-invariant features via feature alignment. However, such an assumption often does not hold true -- there often exist numerous finer-grained domains (e.g., dozens of modern painting styles have been developed, each differing dramatically from those of the classic styles). Therefore, forcing feature distribution alignment across each artificially-defined and coarse-grained domain can be ineffective. In this paper, we address both single-source and multi-source UDA from a completely different perspective, which is to view each instance as a fine domain. Feature alignment across domains is thus redundant. Instead, we…

Multi-task Pre-training Language Model for Semantic Network Completion

Da Li, Sen Yang, Kele Xu +3 more

cs.CL · January 2022 · cited 50× · arXiv ↗ · more like this ·

Semantic networks, such as the knowledge graph, can represent the knowledge leveraging the graph structure. Although the knowledge graph shows promising values in natural language processing, it suffers from incompleteness. This paper focuses on knowledge graph completion by predicting linkage between entities, which is a fundamental yet critical task. Semantic matching is a potential solution as it can deal with unseen entities, which the translational distance based methods struggle with. However, to achieve competitive performance as translational distance based methods, semantic matching based methods require large-scale datasets for the training purpose, which are typically unavailable in practical settings. Therefore, we employ the language model and introduce a novel knowledge graph architecture named LP-BERT, which contains two main stages: multi-task pre-training and knowledge…

Entanglement Structure: Entanglement Partitioning in Multipartite Systems and Its Experimental Detection Using Optimizable Witnesses

He Lu, Qi Zhao, Zheng-Da Li +11 more

quant-ph · November 2017 · cited 49× · arXiv ↗ · more like this ·

Creating large-scale entanglement lies at the heart of many quantum information processing protocols and the investigation of fundamental physics. For multipartite quantum systems, it is crucial to identify not only the presence of entanglement but also its detailed structure. This is because in a generic experimental situation with sufficiently many subsystems involved, the production of so-called genuine multipartite entanglement remains a formidable challenge. Consequently, focusing exclusively on the identification of this strongest type of entanglement may result in an all or nothing situation where some inherently quantum aspects of the resource are overlooked. On the contrary, even if the system is not genuinely multipartite entangled, there may still be many-body entanglement present in the system. An identification of the entanglement structure may thus provide us with a hint…

NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results

Xin Li, Kun Yuan, Yajing Pei +65 more

eess.IV · 17 Apr 2024 · cited 47× · arXiv ↗ · more like this ·

This paper reviews the NTIRE 2024 Challenge on Shortform UGC Video Quality Assessment (S-UGC VQA), where various excellent solutions are submitted and evaluated on the collected dataset KVQ from popular short-form video platform, i.e., Kuaishou/Kwai Platform. The KVQ database is divided into three parts, including 2926 videos for training, 420 videos for validation, and 854 videos for testing. The purpose is to build new benchmarks and advance the development of S-UGC VQA. The competition had 200 participants and 13 teams submitted valid solutions for the final testing phase. The proposed solutions achieved state-of-the-art performances for S-UGC VQA. The project can be found at https://github.com/lixinustc/KVQChallenge-CVPR-NTIRE2024.

Experimental Quantum Network Coding

He Lu, Zheng-Da Li, Xu-Fei Yin +7 more

quant-ph · 2 Oct 2019 · cited 42× · arXiv ↗ · more like this ·

Distributing quantum state and entanglement between distant nodes is a crucial task in distributed quantum information processing on large-scale quantum networks. Quantum network coding provides an alternative solution for quantum state distribution especially when the bottleneck problems must be considered and high communication speed is required. Here, we report the first experimental realization of quantum network coding on the butterfly network. With the help of prior entanglements shared between senders, two quantum states can be crossly transmitted perfectly through the butterfly network. We demonstrate this protocol by employing eight photons generated via spontaneous parametric down-conversion. We observe cross-transmission of single-photon states with an average fidelity of $0.9685\pm0.0013$, and that of two-photon entanglement with an average fidelity of $0.9611\pm0.0061$…

Deploying Graph Algorithms on GPUs: An Adaptive Solution

Da Li, Michela Becchi

Computer Vision and Pattern Recognition · May 2013 · cited 42× · DOI ↗ · more like this ·

Thanks to their massive computational power and their SIMT computational model, Graphics Processing Units (GPUs) have been successfully used to accelerate a wide variety of regular applications (linear algebra, stencil computations, image processing and bioinformatics algorithms, among others). However, many established and emerging problems are based on irregular data structures, such as graphs. Examples can be drawn from different application domains: networking, social networking, machine learning, electrical circuit modeling, discrete event simulation, compilers, and computational sciences. It has been shown that irregular applications based on large graphs do exhibit runtime parallelism; moreover, the amount of available parallelism tends to increase with the size of the datasets. In this work, we explore an implementation space for deploying a variety of graph algorithms on GPUs.…

Translution-SNet: A Semisupervised Hyperspectral Image Stripe Noise Removal Based on Transformer and CNN

Chengjun Wang, Miaozhong Xu, Yonghua Jiang +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Geoscience and Remote Sensing · 2022 · cited 40× · DOI ↗ · more like this ·

Hyperspectral remote sensing images (HSIs) have been applied in urban planning, environmental monitoring, and other fields. However, they are susceptible to noise interference, such as Gaussian noise, stripe, and mixed noises, from various factors in the imaging process, which greatly limits their applications. Although previous efforts to improve HSI quality have achieved remarkable results, there are still many challenges to be solved. To avoid the poor generalization ability and improve the stripe removal performance of the network in real scenarios. In this paper, we proposed a novel deep learning model (Translution-SNet) for HSI stripe noise removal based on a semi-supervised training strategy that applies a convolution and transformer for feature extraction. Moreover, we used an unbiased estimation method to calculate the loss function of the unsupervised part from noisy data…

Prediction Calibration for Generalized Few-shot Semantic Segmentation

Zhihe Lu, Sen He, Da Li +2 more

cs.CV · 15 Oct 2022 · cited 35× · arXiv ↗ · more like this ·

Generalized Few-shot Semantic Segmentation (GFSS) aims to segment each image pixel into either base classes with abundant training examples or novel classes with only a handful of (e.g., 1-5) training images per class. Compared to the widely studied Few-shot Semantic Segmentation FSS, which is limited to segmenting novel classes only, GFSS is much under-studied despite being more practical. Existing approach to GFSS is based on classifier parameter fusion whereby a newly trained novel class classifier and a pre-trained base class classifier are combined to form a new classifier. As the training data is dominated by base classes, this approach is inevitably biased towards the base classes. In this work, we propose a novel Prediction Calibration Network PCN to address this problem. Instead of fusing the classifier parameters, we fuse the scores produced separately by the base and novel…

Experimental quantum channel simulation

He Lu, Chang Liu, Dong-Sheng Wang +9 more

quant-ph · May 2015 · cited 35× · arXiv ↗ · more like this ·

Quantum simulation is of great importance in quantum information science. Here, we report an experimental quantum channel simulator imbued with an algorithm for imitating the behavior of a general class of quantum systems. The reported quantum channel simulator consists of four single-qubit gates and one controlled-NOT gate. All types of quantum channels can be decomposed by the algorithm and implemented on this device. We deploy our system to simulate various quantum channels, such as quantum-noise channels and weak quantum measurement. Our results advance experimental quantum channel simulation, which is integral to the goal of quantum information processing.

Two-Hierarchy Entanglement Swapping for a Linear Optical Quantum Repeater

Ping Xu, Hai-Lin Yong, Luo-Kan Chen +9 more

Artificial Intelligence · Physical Review Letters · 23 Oct 2017 · cited 33× · DOI ↗ · more like this ·

Quantum repeaters play a significant role in achieving long-distance quantum communication. In the past decades, tremendous effort has been devoted towards constructing a quantum repeater. As one of the crucial elements, entanglement has been created in different memory systems via entanglement swapping. The realization of j-hierarchy entanglement swapping, i.e., connecting quantum memory and further extending the communication distance, is important for implementing a practical quantum repeater. Here, we report the first demonstration of a fault-tolerant two-hierarchy entanglement swapping with linear optics using parametric down-conversion sources. In the experiment, the dominant or most probable noise terms in the one-hierarchy entanglement swapping, which is on the same order of magnitude as the desired state and prevents further entanglement connections, are automatically washed…