Author

Fan Yu

414 papers · 1985–2026

1985peak 38 in 20222026

Frequent co-authors

Papers

showing 1–25 of 414 RSS

WeNet: Production oriented Streaming and Non-streaming End-to-End Speech Recognition Toolkit

Zhuoyuan Yao, Di Wu, Xiong Wang +7 more

cs.SD · February 2021 · cited 338× · arXiv ↗ · more like this ·

In this paper, we propose an open source, production first, and production ready speech recognition toolkit called WeNet in which a new two-pass approach is implemented to unify streaming and non-streaming end-to-end (E2E) speech recognition in a single model. The main motivation of WeNet is to close the gap between the research and the production of E2E speechrecognition models. WeNet provides an efficient way to ship ASR applications in several real-world scenarios, which is the main difference and advantage to other open source E2E speech recognition toolkits. In our toolkit, a new two-pass method is implemented. Our method propose a dynamic chunk-based attention strategy of the the transformer layers to allow arbitrary right context length modifies in hybrid CTC/attention architecture. The inference latency could be easily controlled by only changing the chunk size. The CTC…

M2MeT: The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Challenge

Fan Yu, Shiliang Zhang, Yihui Fu +9 more

cs.SD · October 2021 · cited 216× · arXiv ↗ · more like this ·

Recent development of speech processing, such as speech recognition, speaker diarization, etc., has inspired numerous applications of speech technologies. The meeting scenario is one of the most valuable and, at the same time, most challenging scenarios for the deployment of speech technologies. Specifically, two typical tasks, speaker diarization and multi-speaker automatic speech recognition have attracted much attention recently. However, the lack of large public meeting data has been a major obstacle for the advancement of the field. Therefore, we make available the AliMeeting corpus, which consists of 120 hours of recorded Mandarin meeting data, including far-field data collected by 8-channel microphone array as well as near-field data collected by headset microphone. Each meeting session is composed of 2-4 speakers with different speaker overlap ratio, recorded in rooms with…

EPP-MVSNet: Epipolar-assembling based Depth Prediction for Multi-view Stereo

Xinjun Ma, Yue Gong, Qirui Wang +3 more

Computer Vision and Pattern Recognition · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · October 2021 · cited 140× · DOI ↗ · more like this ·

In this paper, we proposed EPP-MVSNet, a novel deep learning network for 3D reconstruction from multi-view stereo (MVS). EPP-MVSNet can accurately aggregate features at high resolution to a limited cost volume with an optimal depth range, thus, leads to effective and efficient 3D construction. Distinct from existing works which measure feature cost at discrete positions which affects the 3D reconstruction accuracy, EPP-MVSNet introduces an epipolar-assembling-based kernel that operates on adaptive intervals along epipolar lines for making full use of the image resolution. Further, we introduce an entropy-based refining strategy where the cost volume describes the space geometry with the little redundancy. Moreover, we design a light-weighted network with Pseudo-3D convolutions integrated to achieve high accuracy and efficiency. We have conducted extensive experiments on challenging…

KERL

Pengfei Wang, Fan Yu, Long Xia +3 more

Information Systems · 25 Jul 2020 · cited 121× · DOI ↗ · more like this ·

For sequential recommendation, it is essential to capture and predict future or long-term user preference for generating accurate recommendation over time. To improve the predictive capacity, we adopt reinforcement learning (RL) for developing effective sequential recommenders. However, user-item interaction data is likely to be sparse, complicated and time-varying. It is not easy to directly apply RL techniques to improve the performance of sequential recommendation.

The effects of perceived luxury value on customer engagement and purchase intention in live streaming shopping

Fan Yu, Ran Zheng

Sociology and Political Science · Asia Pacific Journal of Marketing and Logistics · 5 Oct 2021 · cited 100× · DOI ↗ · more like this ·

Purpose Nowadays, more and more Chinese consumers purchase luxury goods on live streaming platforms. However, the existing literature rarely focuses on this emerging phenomenon. This article attempts to construct a theoretical model based on the perceived value theory to explain this phenomenon. Design/methodology/approach In total, 354 online questionnaires are collected, and the partial least square structural equation model is used to analyze the model empirically. Findings The results show that consumers' perceived luxury values (financial value, functional value, individual value and social value) have a significant and positive effect on customer engagement, which further leads to purchase intention. Originality/value In view of fact that there is a big difference between luxury goods and nonluxury goods, yet the existing literature rarely distinguishes between luxury goods and…

Unified Streaming and Non-streaming Two-pass End-to-end Model for Speech Recognition

Binbin Zhang, Di Wu, Zhuoyuan Yao +7 more

cs.SD · December 2020 · cited 96× · arXiv ↗ · more like this ·

In this paper, we present a novel two-pass approach to unify streaming and non-streaming end-to-end (E2E) speech recognition in a single model. Our model adopts the hybrid CTC/attention architecture, in which the conformer layers in the encoder are modified. We propose a dynamic chunk-based attention strategy to allow arbitrary right context length. At inference time, the CTC decoder generates n-best hypotheses in a streaming way. The inference latency could be easily controlled by only changing the chunk size. The CTC hypotheses are then rescored by the attention decoder to get the final result. This efficient rescoring process causes very little sentence-level latency. Our experiments on the open 170-hour AISHELL-1 dataset show that, the proposed method can unify the streaming and non-streaming model simply and efficiently. On the AISHELL-1 test set, our unified model achieves 5.60%…

DGCL

Zhenkun Cai, Yan Xiao, Yidi Wu +3 more

Artificial Intelligence · 21 Apr 2021 · cited 95× · DOI ↗ · more like this ·

Graph neural networks (GNNs) have gained increasing popularity in many areas such as e-commerce, social networks and bio-informatics. Distributed GNN training is essential for handling large graphs and reducing the execution time. However, for distributed GNN training, a peer-to-peer communication strategy suffers from high communication overheads. Also, different GPUs require different remote vertex embeddings, which leads to an irregular communication pattern and renders existing communication planning solutions unsuitable. We propose the distributed graph communication library (DGCL) for efficient GNN training on multiple GPUs. At the heart of DGCL is a communication planning algorithm tailored for GNN training, which jointly considers fully utilizing fast links, fusing communication, avoiding contention and balancing loads on different links. DGCL can be easily adopted to extend…

The Accented English Speech Recognition Challenge 2020: Open Datasets, Tracks, Baselines, Results and Methods

Xian Shi, Fan Yu, Yizhou Lu +5 more

cs.SD · 20 Feb 2021 · cited 94× · arXiv ↗ · more like this ·

The variety of accents has posed a big challenge to speech recognition. The Accented English Speech Recognition Challenge (AESRC2020) is designed for providing a common testbed and promoting accent-related research. Two tracks are set in the challenge -- English accent recognition (track 1) and accented English speech recognition (track 2). A set of 160 hours of accented English speech collected from 8 countries is released with labels as the training set. Another 20 hours of speech without labels is later released as the test set, including two unseen accents from another two countries used to test the model generalization ability in track 2. We also provide baseline systems for the participants. This paper first reviews the released dataset, track setups, baselines and then summarizes the challenge results and major techniques used in the submissions.

Progress toward larger molecular simulation on a quantum computer: Simulating a system with up to 28 qubits accelerated by point-group symmetry

Changsu Cao, Jiaqi Hu, Wengang Zhang +7 more

Artificial Intelligence · Physical review. A/Physical review, A · 27 Jun 2022 · cited 71× · DOI ↗ · more like this ·

The exact evaluation of the molecular ground state in quantum chemistry requires an exponentially increasing computational cost. Quantum computation is a promising way to overcome the exponential problem using polynomial-time quantum algorithms. A quantum-classical hybrid optimization scheme known as the variational quantum eigensolver is preferred for noisy intermediate-scale quantum devices. However, the circuit depth becomes one of the bottlenecks of its application to large molecules of more than 20 qubits. In this work, we employ point-group symmetry to reduce the number of operators in constructing ansatz so as to achieve a more compact quantum circuit. We illustrate this methodology with a series of molecules ranging from LiH (12 qubits) to ${\mathrm{C}}_{2}{\mathrm{H}}_{4}$ (28 qubits). A significant reduction of up to 82% of the operator numbers is reached on…

Hierarchical Matching Network for Crime Classification

Pengfei Wang, Fan Yu, Shuzi Niu +3 more

Artificial Intelligence · 18 Jul 2019 · cited 66× · DOI ↗ · more like this ·

Automatic crime classification is a fundamental task in the legal field. Given the fact descriptions, judges first determine the relevant violated laws, and then the articles. As laws and articles are grouped into a tree-shaped hierarchy (i.e., laws as parent labels, articles as children labels), this task can be naturally formalized as a two layers' hierarchical multi-label classification problem. Generally, the label semantics (i.e., definition of articles) and the hierarchical structure are two informative properties for judges to make a correct decision. However, most previous methods usually ignore the label structure and feed all labels into a flat classification framework, or neglect the label semantics and only utilize fact descriptions for crime classification, thus the performance may be limited. In this paper, we formalize crime classification problem into a matching task to…

MindSpore Quantum: A User-Friendly, High-Performance, and AI-Compatible Quantum Computing Framework

Xusheng Xu, Jiangyu Cui, Zidong Cui +36 more

quant-ph · June 2024 · cited 63× · arXiv ↗ · more like this ·

We introduce MindSpore Quantum, a pioneering hybrid quantum-classical framework with a primary focus on the design and implementation of noisy intermediate-scale quantum (NISQ) algorithms. Leveraging the robust support of MindSpore, an advanced open-source deep learning training/inference framework, MindSpore Quantum exhibits exceptional efficiency in the design and training of variational quantum algorithms on both CPU and GPU platforms, delivering remarkable performance. Furthermore, this framework places a strong emphasis on enhancing the operational efficiency of quantum algorithms when executed on real quantum hardware. This encompasses the development of algorithms for quantum circuit compilation and qubit mapping, crucial components for achieving optimal performance on quantum processors. In addition to the core framework, we introduce QuPack, a meticulously crafted quantum…

TensorOpt: Exploring the Tradeoffs in Distributed DNN Training with Auto-Parallelism

Zhenkun Cai, Kaihao Ma, Xiao Yan +5 more

cs.DC · 16 Apr 2020 · cited 58× · arXiv ↗ · more like this ·

A good parallelization strategy can significantly improve the efficiency or reduce the cost for the distributed training of deep neural networks (DNNs). Recently, several methods have been proposed to find efficient parallelization strategies but they all optimize a single objective (e.g., execution time, memory consumption) and produce only one strategy. We propose FT, an efficient algorithm that searches for an optimal set of parallelization strategies to allow the trade-off among different objectives. FT can adapt to different scenarios by minimizing the memory consumption when the number of devices is limited and fully utilize additional resources to reduce the execution time. For popular DNN models (e.g., vision, language), an in-depth analysis is conducted to understand the trade-offs among different objectives and their influence on the parallelization strategies. We also develop…

Merlin HugeCTR: GPU-accelerated Recommender System Training and Inference

Joey Wang, Yingcan Wei, Minseok Lee +9 more

cs.DC · 17 Oct 2022 · cited 54× · arXiv ↗ · more like this ·

In this talk, we introduce Merlin HugeCTR. Merlin HugeCTR is an open source, GPU-accelerated integration framework for click-through rate estimation. It optimizes both training and inference, whilst enabling model training at scale with model-parallel embeddings and data-parallel neural networks. In particular, Merlin HugeCTR combines a high-performance GPU embedding cache with an hierarchical storage architecture, to realize low-latency retrieval of embeddings for online model inference tasks. In the MLPerf v1.0 DLRM model training benchmark, Merlin HugeCTR achieves a speedup of up to 24.6x on a single DGX A100 (8x A100) over PyTorch on 4x4-socket CPU nodes (4x4x28 cores). Merlin HugeCTR can also take advantage of multi-node environments to accelerate training even further. Since late 2021, Merlin HugeCTR additionally features a hierarchical parameter server (HPS) and supports…

Seastar

Yidi Wu, Kaihao Ma, Zhenkun Cai +5 more

Artificial Intelligence · Zenodo (CERN European Organization for Nuclear Research) · 21 Apr 2021 · cited 53× · DOI ↗ · more like this ·

Graph neural networks (GNNs) have achieved breakthrough performance in graph analytics such as node classification, link prediction and graph clustering. Many GNN training frameworks have been developed, but they are usually designed as a set of manually written, GNN-specific operators plugged into existing deep learning systems, which incurs high memory consumption, poor data locality, and large semantic gap between algorithm design and implementation. This paper proposes the Seastar system, which presents a vertex-centric programming model for GNN training on GPU and provides idiomatic python constructs to enable easy development of novel homogeneous and heterogeneous GNN models. We also propose novel optimizations to produce highly efficient fused GPU kernels for forward and backward passes in GNN training. Compared with the state-of-the art GNN systems, DGL and PyG, Seastar achieves…

Summary On The ICASSP 2022 Multi-Channel Multi-Party Meeting Transcription Grand Challenge

Fan Yu, Shiliang Zhang, Pengcheng Guo +13 more

cs.SD · 25 Feb 2022 · cited 44× · arXiv ↗ · more like this ·

The ICASSP 2022 Multi-channel Multi-party Meeting Transcription Grand Challenge (M2MeT) focuses on one of the most valuable and the most challenging scenarios of speech technologies. The M2MeT challenge has particularly set up two tracks, speaker diarization (track 1) and multi-speaker automatic speech recognition (ASR) (track 2). Along with the challenge, we released 120 hours of real-recorded Mandarin meeting speech data with manual annotation, including far-field data collected by 8-channel microphone array as well as near-field data collected by each participants' headset microphone. We briefly describe the released dataset, track setups, baselines and summarize the challenge results and major techniques used in the submissions.

Elastic Deep Learning in Multi-Tenant GPU Clusters

Yidi Wu, Kaihao Ma, Xiao Yan +6 more

Information Systems · IEEE Transactions on Parallel and Distributed Systems · 9 Mar 2021 · cited 44× · DOI ↗ · more like this ·

We study how to support elasticity, that is, the ability to dynamically adjust the parallelism (i.e., the number of GPUs), for deep neural network (DNN) training in a GPU cluster. Elasticity can benefit multi-tenant GPU cluster management in many ways, for example, achieving various scheduling objectives (e.g., job throughput, job completion time, GPU efficiency) according to cluster load variations, utilizing transient idle resources, and supporting performance profiling, job migration, and straggler mitigation. We propose EDL, which enables elastic deep learning with a simple API and can be easily integrated with existing deep learning frameworks such as TensorFlow and PyTorch. EDL also incorporates techniques that are necessary to reduce the overhead of parallelism adjustments, such as stop-free scaling and dynamic data pipeline. We demonstrate with experiments that EDL can indeed…

A Multi-Watermarking Algorithm for Medical Images Using Inception V3燼nd燚CT

Fan Yu, Jingbing Li, Uzair Aslam Bhatti +4 more

Computer Vision and Pattern Recognition · Computers, materials & continua/Computers, materials & continua (Print) · 22 Sep 2022 · cited 35× · DOI ↗ · more like this ·

Medical images are a critical component of the diagnostic process for clinicians. Although the quality of medical photographs is essential to the accuracy of a physician’s diagnosis, they must be encrypted due to the characteristics of digital storage and information leakage associated with medical images. Traditional watermark embedding algorithm embeds the watermark information into the medical image, which reduces the quality of the medical image and affects the physicians’ judgment of patient diagnosis. In addition, watermarks in this method have weak robustness under high-intensity geometric attacks when the medical image is attacked and the watermarks are destroyed. This paper proposes a novel watermarking algorithm using the convolutional neural networks (CNN) Inception V3 and the discrete cosine transform (DCT) to address above mentioned problems. First, the medical image is…

SEFraud: Graph-based Self-Explainable Fraud Detection via Interpretative Mask Learning

Kaidi Li, Tianmeng Yang, Min Zhou +9 more

cs.LG · 17 Jun 2024 · cited 33× · arXiv ↗ · more like this ·

Graph-based fraud detection has widespread application in modern industry scenarios, such as spam review and malicious account detection. While considerable efforts have been devoted to designing adequate fraud detectors, the interpretability of their results has often been overlooked. Previous works have attempted to generate explanations for specific instances using post-hoc explaining methods such as a GNNExplainer. However, post-hoc explanations can not facilitate the model predictions and the computational cost of these methods cannot meet practical requirements, thus limiting their application in real-world scenarios. To address these issues, we propose SEFraud, a novel graph-based self-explainable fraud detection framework that simultaneously tackles fraud detection and result in interpretability. Concretely, SEFraud first leverages customized heterogeneous graph transformer…

A GPU-specialized Inference Parameter Server for Large-Scale Deep Recommendation Models

Yingcan Wei, Matthias Langer, Fan Yu +4 more

cs.IR · 17 Oct 2022 · cited 33× · arXiv ↗ · more like this ·

Recommendation systems are of crucial importance for a variety of modern apps and web services, such as news feeds, social networks, e-commerce, search, etc. To achieve peak prediction accuracy, modern recommendation models combine deep learning with terabyte-scale embedding tables to obtain a fine-grained representation of the underlying data. Traditional inference serving architectures require deploying the whole model to standalone servers, which is infeasible at such massive scale. In this paper, we provide insights into the intriguing and challenging inference domain of online recommendation systems. We propose the HugeCTR Hierarchical Parameter Server (HPS), an industry-leading distributed recommendation inference framework, that combines a high-performance GPU embedding cache with an hierarchical storage architecture, to realize low-latency retrieval of embeddings for online…

SlideSpeech: A Large-Scale Slide-Enriched Audio-Visual Corpus

Haoxu Wang, Fan Yu, Xian Shi +3 more

cs.SD · September 2023 · cited 32× · arXiv ↗ · more like this ·

Multi-Modal automatic speech recognition (ASR) techniques aim to leverage additional modalities to improve the performance of speech recognition systems. While existing approaches primarily focus on video or contextual information, the utilization of extra supplementary textual information has been overlooked. Recognizing the abundance of online conference videos with slides, which provide rich domain-specific information in the form of text and images, we release SlideSpeech, a large-scale audio-visual corpus enriched with slides. The corpus contains 1,705 videos, 1,000+ hours, with 473 hours of high-quality transcribed speech. Moreover, the corpus contains a significant amount of real-time synchronized slides. In this work, we present the pipeline for constructing the corpus and propose baseline methods for utilizing text information in the visual slide context. Through the…

YOLO-PowerLite: A Lightweight YOLO Model for Transmission Line Abnormal Target Detection

Chuanyao Liu, Shuangfeng Wei, Shaobo Zhong +1 more

Computer Vision and Pattern Recognition · IEEE Access · 2024 · cited 31× · DOI ↗ · more like this ·

The secure and stable operation of power transmission lines is essential for electrical systems. Given that abnormal targets such as bird’s nests and defective insulators may lead to transmission failures, timely detection of these targets is imperative. This paper introduces the YOLO-PowerLite model, an advanced lightweight object detection model based on YOLOv8n, designed for efficient, real-time detection on resource-constrained unmanned aerial vehicles (UAVs) equipped with edge computing platforms. In the feature fusion module, YOLO-PowerLite incorporates the innovative C2f_AK module, significantly reducing the number of parameters and enhancing the adaptability and fusion capability of features at different scales. Meanwhile, the adoption of the Bidirectional Feature Pyramid Network (BiFPN) further optimizes the efficiency and effectiveness of feature processing. In addition, the…

Overcoming barriers to health-care access: A qualitative study among African migrants in Guangzhou, China

Lavinia Lin, Katherine B. Brown, Brian J. Hall +9 more

Anthropology · Global Public Health · 23 Sep 2015 · cited 27× · DOI ↗ · more like this ·

Guangzhou is China's third most populous city, and the region's burgeoning manufacturing economy has attracted many young African businessmen and entrepreneurs to the city. The aims of this study were to examine strategies that African migrants in Guangzhou have adopted in response to health-care barriers, and explore their perceptions of how to address their needs. Twenty-five semi-structured interviews and two focus groups were conducted among African migrants residing in Guangzhou, China. Facing multiple barriers to care, African migrants have adopted a number of suboptimal and unsustainable approaches to access health care. These included: using their Chinese friends or partners as interpreters, self-medicating, using personal connections to medical doctors, and travelling to home countries or countries that offer English-speaking doctors for health care. Health-care providers and…

Providing a supportive alternative education environment for at-risk students

John J. McGee, Fan-Yu Lin

Education · Preventing School Failure Alternative Education for Children and Youth · 28 Nov 2016 · cited 24× · DOI ↗ · more like this ·

Many factors cause student disengagement from school that subsequently result in high dropout rates. Alternative education (AE) programs provide a different pathway for at-risk youths who do not meet the goals, standards, and requirements of traditional educational settings. However, educational agencies have vastly different interpretations regarding AE program components and operations. The absence of a consistent national protocol as to what components or criteria define an effective AE program causes confusion among practitioners and stakeholders. In the study being reported, a research-based multidimensional framework was established in the hope of building an operational AE program model.

Hyperlink-induced Pre-training for Passage Retrieval in Open-domain Question Answering

Jiawei Zhou, Xiaoguang Li, Lifeng Shang +10 more

cs.CL · March 2022 · cited 23× · arXiv ↗ · more like this ·

To alleviate the data scarcity problem in training question answering systems, recent works propose additional intermediate pre-training for dense passage retrieval (DPR). However, there still remains a large discrepancy between the provided upstream signals and the downstream question-passage relevance, which leads to less improvement. To bridge this gap, we propose the HyperLink-induced Pre-training (HLP), a method to pre-train the dense retriever with the text relevance induced by hyperlink-based topology within Web documents. We demonstrate that the hyperlink-based structures of dual-link and co-mention can provide effective relevance signals for large-scale pre-training that better facilitate downstream passage retrieval. We investigate the effectiveness of our approach across a wide range of open-domain QA datasets under zero-shot, few-shot, multi-hop, and out-of-domain scenarios.…

A Comparative Study on Speaker-attributed Automatic Speech Recognition in Multi-party Meetings

Fan Yu, Zhihao Du, Shiliang Zhang +2 more

cs.SD · March 2022 · cited 22× · arXiv ↗ · more like this ·

In this paper, we conduct a comparative study on speaker-attributed automatic speech recognition (SA-ASR) in the multi-party meeting scenario, a topic with increasing attention in meeting rich transcription. Specifically, three approaches are evaluated in this study. The first approach, FD-SOT, consists of a frame-level diarization model to identify speakers and a multi-talker ASR to recognize utterances. The speaker-attributed transcriptions are obtained by aligning the diarization results and recognized hypotheses. However, such an alignment strategy may suffer from erroneous timestamps due to the modular independence, severely hindering the model performance. Therefore, we propose the second approach, WD-SOT, to address alignment errors by introducing a word-level diarization model, which can get rid of such timestamp alignment dependency. To further mitigate the alignment issues, we…