arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Edward Lin

41 papers · 1969–2026

1969: 11970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 01978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 12004: 02005: 02006: 32007: 22008: 32009: 22010: 02011: 02012: 22013: 12014: 22015: 12016: 02017: 02018: 22019: 42020: 02021: 32022: 32023: 32024: 02025: 22026: 6
1969peak 6 in 20262026

Frequent co-authors

Papers

showing 1–25 of 41 RSS

Toward Robust Audio Spoofing Detection: A Detailed Comparison of Traditional and Learned Features

B T Balamurali, Kin Wah Edward Lin, Simon Lui +2 more

Signal Processing · IEEE Access · · cited 78× · DOI ↗ · more like this ·

Automatic speaker verification, such as every other biometric system, is vulnerable to spoofing attacks. Using only a few minutes of recorded voice from a genuine client of a speaker verification system, attackers can develop a variety of spoofing attacks that might trick such systems. Detecting these attacks using the audio cues present in the recordings is an important challenge. Most existing spoofing detection systems depend on knowing the used spoofing technique. With this research, we aim at overcoming this limitation, by examining robust audio features, both traditional and those learned through an autoencoder, which is generalizable to different types of replay spoofing. Furthermore, we provide a detailed account of all the steps necessary in setting up the state-of-the-art audio feature detection, preprocessing, and postprocessing, such that the (non-audio expert) machine…

A 1000-word vocabulary, speaker-independent, continuous live-mode speech recognizer implemented in a single FPGA

Edward Lin, Kai Yu, Rob A. Rutenbar +1 more

Artificial Intelligence · National University of Singapore · · cited 58× · DOI ↗ · more like this ·

The Carnegie Mellon In Silico Vox project seeks to move best-quality speech recognition technology from its current software-only form into a range of efficient all-hardware implementations. The central thesis is that, like graphics chips, the application is simply too performance hungry, and too power sensitive, to stay as a large software application. As a first step in this direction, we describe the design and implementation of a fully functional speech-to-text recognizer on a single Xilinx XUP platform. The design recognizes a 1000 word vocabulary, is speaker-independent, recognizes continuous (connected) speech, and is a "live mode" engine, wherein recognition can start as soon as speech input appears. To the best of our knowledge, this is the most complex recognizer architecture ever fully committed to a hardware-only form. The implementation is extraordinarily small, and…

FastCorrect 2: Fast Error Correction on Multiple Candidates for Automatic Speech Recognition

Yichong Leng, Xu Tan, Rui Wang +8 more

cs.CL · · cited 47× · arXiv ↗ · more like this ·

Error correction is widely used in automatic speech recognition (ASR) to post-process the generated sentence, and can further reduce the word error rate (WER). Although multiple candidates are generated by an ASR system through beam search, current error correction approaches can only correct one sentence at a time, failing to leverage the voting effect from multiple candidates to better detect and correct error tokens. In this work, we propose FastCorrect 2, an error correction model that takes multiple ASR candidates as input for better correction accuracy. FastCorrect 2 adopts non-autoregressive generation for fast inference, which consists of an encoder that processes multiple source sentences and a decoder that generates the target sentence in parallel from the adjusted source sentence, where the adjustment is based on the predicted duration of each source token. However, there are…

A multi-fpga 10x-real-time high-speed search engine for a 5000-word vocabulary speech recognizer

Edward Lin, Rob A. Rutenbar

Artificial Intelligence · · cited 30× · DOI ↗ · more like this ·

Today's best quality speech recognition systems are implemented in software. These systems fully occupy the resources of a high-end server to deliver results at real-time speed: each hour of audio requires a significant fraction of an hour of computation for recognition. This is profoundly limiting for applications that require extreme recognition speed, for example, high-volume tasks such as video indexing (e.g., YouTube), or high-speed tasks such as triage of homeland security intelligence. We describe the architecture and implementation of one critical component -- the backend search stage -- of a high-speed, large-vocabulary recognizer. Implemented on a multi-FPGA Berkeley Emulation Engine 2 (BEE2) platform, we handle a standard 5000-word Wall Street Journal speech benchmark. Our backend search engine can decode on average 10 times faster than real-time running at 100 MHz, i.e, 10x…

Predicting Spread Probability of Learning‐Effect Computer Virus

Wei‐Chang Yeh, Edward Lin, Chia-Ling Huang

Computer Networks and Communications · Complexity · · cited 28× · DOI ↗ · more like this ·

With the rapid development of network technology, computer viruses have developed at a fast pace. The threat of computer viruses persists because of the constant demand for computers and networks. When a computer virus infects a facility, the virus seeks to invade other facilities in the network by exploiting the convenience of the network protocol and the high connectivity of the network. Hence, there is an increasing need for accurate calculation of the probability of computer‐virus‐infected areas for developing corresponding strategies, for example, based on the possible virus‐infected areas, to interrupt the relevant connections between the uninfected and infected computers in time. The spread of the computer virus forms a scale‐free network whose node degree follows the power rule. A novel algorithm based on the binary‐addition tree algorithm (BAT) is proposed to effectively…

SoftCorrect: Error Correction with Soft Detection for Automatic Speech Recognition

Yichong Leng, Xu Tan, Wenjie Liu +6 more

cs.CL · · cited 24× · arXiv ↗ · more like this ·

Error correction in automatic speech recognition (ASR) aims to correct those incorrect words in sentences generated by ASR models. Since recent ASR models usually have low word error rate (WER), to avoid affecting originally correct tokens, error correction models should only modify incorrect words, and therefore detecting incorrect words is important for error correction. Previous works on error correction either implicitly detect error words through target-source attention or CTC (connectionist temporal classification) loss, or explicitly locate specific deletion/substitution/insertion errors. However, implicit error detection does not provide clear signal about which tokens are incorrect and explicit error detection suffers from low detection accuracy. In this paper, we propose SoftCorrect with a soft error detection mechanism to avoid the limitations of both explicit and implicit…

Moving speech recognition from software to silicon: the in silico vox project

Edward Lin, Kai Yu, Rob A. Rutenbar +1 more

Artificial Intelligence · · cited 21× · DOI ↗ · more like this ·

To achieve much faster decoding, or much lower power consumption, we need to liberate speech recognition from the artificial constraints of its current software-only form, and move the essential computations directly into silicon. There are vast efficiencies waiting to be unlocked in this application – we need the proper architecture to do so. We report results from a firstgeneration hardware architecture simulated at bit-level, and a complete, working FPGA-based prototype. Simulation results show that rather modest hardware designs, running 10-20X slower than conventional processors, can already decode at 0.6 xRT, running the standard 5K Wall Street Journal benchmark.

Code-Switching Text Generation and Injection in Mandarin-English ASR

Haibin Yu, Yuxuan Hu, Yao Qian +7 more

eess.AS · · cited 19× · arXiv ↗ · more like this ·

Code-switching speech refers to a means of expression by mixing two or more languages within a single utterance. Automatic Speech Recognition (ASR) with End-to-End (E2E) modeling for such speech can be a challenging task due to the lack of data. In this study, we investigate text generation and injection for improving the performance of an industry commonly-used streaming model, Transformer-Transducer (T-T), in Mandarin-English code-switching speech recognition. We first propose a strategy to generate code-switching text data and then investigate injecting generated text into T-T model explicitly by Text-To-Speech (TTS) conversion or implicitly by tying speech and text latent spaces. Experimental results on the T-T model trained with a dataset containing 1,800 hours of real Mandarin-English code-switched speech show that our approaches to inject generated code-switching text…

Joint Singing Pitch Estimation and Voice Separation Based on a Neural Harmonic Structure Renderer

Tomoyasu Nakano, Kazuyoshi Yoshii, Yiming Wu +3 more

Signal Processing · · cited 18× · DOI ↗ · more like this ·

This paper describes a multi-task learning approach to joint extraction (fundamental frequency (F0) estimation) and separation of singing voices from music signals. While deep neural networks have been used successfully for each task, both tasks have not been dealt with simultaneously in the context of deep learning. Since vocal extraction and separation are considered to have a mutually beneficial relationship, we propose a unified network that consists of a deep convolutional neural network for vocal F0 saliency estimation and a U-Net with an encoder shared by two decoders specialized for separating vocal and accompaniment parts, respectively. Between these two networks we introduce a differentiable layer that converts an F0 saliency spectrogram into harmonic masks indicating the locations of harmonic partials of a singing voice. The physical meaning of harmonic structure is thus…

Improving ASR Error Correction Using N-Best Hypotheses

Linchen Zhu, Wenjie Liu, Linquan Liu +1 more

Artificial Intelligence · 2021 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU) · · cited 10× · DOI ↗ · more like this ·

In the field of Automatic Speech Recognition (ASR), Grammatical Error Correction (GEC) can be used to correct errors in recognition results of ASR systems and whereby it further reduces the word error rate (WER). Most conventional GEC approaches make correction merely based on a single recognition hypothesis from the ASR system, i.e., the best path in the decoding lattice. However, with such limited information, it's common that GEC fails to detect errors in a sentence or even makes wrong corrections. In this paper we propose two novel GEC approaches utilizing N-best hypotheses instead, that's, N-best plain approach and N-best alignment approach. In this way, our novel approaches can access more information than conventional approaches with 1-best-only hypothesis, and thus more accurate corrections can be made. Experiments on an industrial-scale internal dataset and the open-source…

Mask the Correct Tokens: An Embarrassingly Simple Approach for Error Correction

Kai Shen, Yichong Leng, Xu Tan +4 more

cs.CL · · cited 8× · arXiv ↗ · more like this ·

Text error correction aims to correct the errors in text sequences such as those typed by humans or generated by speech recognition models. Previous error correction methods usually take the source (incorrect) sentence as encoder input and generate the target (correct) sentence through the decoder. Since the error rate of the incorrect sentence is usually low (e.g., 10\%), the correction model can only learn to correct on limited error tokens but trivially copy on most tokens (correct tokens), which harms the effective training of error correction. In this paper, we argue that the correct tokens should be better utilized to facilitate effective training and then propose a simple yet effective masking strategy to achieve this goal. Specifically, we randomly mask out a part of the correct tokens in the source sentence and let the model learn to not only correct the original error tokens…

Visualising Singing Style under Common Musical Events Using Pitch-Dynamics Trajectories and Modified TRACLUS Clustering

Kin Wah Edward Lin, Hans Anderson, Natalie Agus +2 more

Signal Processing · · cited 6× · DOI ↗ · more like this ·

We present a novel method for visualising the singing style of vocalists. To illustrate our method, we take 26 audio recordings of A cappella solo vocal music from two different professional singers and we visualise the performance style of each vocalist in a two-dimensional space of pitch and dynamics. We use our own novel modification of a trajectory clustering algorithm called TRACLUS to generate four representative paths, called trajectories, in that two dimensional space. Each trajectory represents the characteristic style of a vocalist during one of four common musical events: (1) Crescendo, (2) Diminuendo, (3) Ascending Pitches and (4) Descending Pitches. The unique shapes of these trajectories characterize the singing style of each vocalist with respect to each of these events. We present the details of our modified version of the TRACULUS algorithm and demonstrate graphically…

In silico vox: Towards speech recognition in silicon

Edward Lin, Kai Yu, Rob A. Rutenbar +1 more

Artificial Intelligence · National University of Singapore · · cited 6× · DOI ↗ · more like this ·

This article consists of a collection of slides from the author's conference presentation on Carnegie Mellon University's In Silico Vox speech recognition in silicon Project. Some of the specific topics discussed include: current speech recognition technologies; the special features and voice commuication capabilities of the In Silico Project; graphics engines; next generation speech recognition applications; how speech recognition works; acoustical capabilities; layered speech models; software design and implementation; pipelining facilities; an FPGA demonstration and experimental results.

Building High-accuracy Multilingual ASR with Gated Language Experts and Curriculum Training

Eric Sun, Jinyu Li, Yuxuan Hu +8 more

cs.CL · · cited 4× · arXiv ↗ · more like this ·

We propose gated language experts and curriculum training to enhance multilingual transformer transducer models without requiring language identification (LID) input from users during inference. Our method incorporates a gating mechanism and LID loss, enabling transformer experts to learn language-specific information. By combining gated transformer experts with shared transformer layers, we construct multilingual transformer blocks and utilize linear experts to effectively regularize the joint network. The curriculum training scheme leverages LID to guide the gated experts in improving their respective language performance. Experimental results on a bilingual task involving English and Spanish demonstrate significant improvements, with average relative word error reductions of 12.5% and 7.3% compared to the baseline bilingual and monolingual models, respectively. Notably, our method…

Modelling Mutual Information between Voiceprint and Optimal Number of Mel-Frequency Cepstral Coefficients in Voice Discrimination

Kin Wah Edward Lin, Feng Tian, Natalie Agus +2 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

In this paper, we study the relationship between the voiceprint and the optimal number of Mel-frequency Cepstral Coefficients (MFCCs). The voiceprint is modelled as sub-MFCCs matrix with the first d number of MFCCs. We model the relationship through information theory and formulate it as the mutual information maximization problem subject to the probabilities constraint. The solution of this optimization problem provides the optimal number of MFCCs, D among these d, which yields the highest classification accuracy of the voice discrimination, together with a confidence level. This study is dictated by the need to understand the use of MFCCs, which have proliferated since its invention to discriminate voice. We evaluate our model by comparing the leave-one-out cross validation (LOOCV) results of usual multi-class classifier, the Supervised Learning Gaussian Mixture Model (SLGMM), with a…

Zero-mean Convolutional Network with Data Augmentation for Sound Level Invariant Singing Voice Separation

Kin Wah Edward Lin, Masataka Goto

Signal Processing · · cited 3× · DOI ↗ · more like this ·

We address an issue of separating singing voices from polyphonic music signals regardless of sound level variance of the mixture input. Using a standard separation quality assessment tool BSS Eval 4.0, we found that the separation quality of a singing voice separation (SVS) system based on a dilatable Convolutional Neural Network (CNN) decreases under different sound levels. Even if this SVS system is comparable to state-of-the-art SVS systems, it is vulnerable to the issue of sound level variance. We therefore investigate four methods of making the CNN-based SVS system invariant to different sound levels - two types of data augmentation, frame normalization, and zero-mean convolution. By testing all 15 combinations of the four methods, we found that all combinations can improve the sound level invariance and analyzed the best combinations. To the best of our knowledge, this is the…

A Big Sky Approach to Cadence Diplomacy

Knut Olsen, Marcella Di Criscienzo, R. Lynne Jones +7 more

astro-ph.IM · · cited 3× · arXiv ↗ · more like this ·

The LSST survey was designed to deliver transformative results for four primary objectives: constraining dark energy and dark matter, taking an inventory of the Solar System, exploring the transient optical sky, and mapping the Milky Way. While the LSST Wide-Fast-Deep survey and accompanying Deep Drilling and mini-surveys will be ground-breaking for each of these areas, there remain competing demands on the survey area, depth, and temporal coverage amid a desire to maximize all three. In this white paper, we seek to address a principal source of tension between the different LSST science collaborations, that of the survey area and depth that they each need in the parts of the sky that they care about. We present simple tools which can be used to explore trades between the area surveyed by LSST and the number of visits available per field and then use these tools to propose a change to…

This Text Has the Scent of Starbucks: A Laplacian Structured Sparsity Model for Computational Branding Analytics

William Yang Wang, Edward Lin, John Kominek

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

We propose a Laplacian structured sparsity model to study computational branding analytics.To do this, we collected customer reviews from Starbucks, Dunkin' Donuts, and other coffee shops across 38 major cities in the Midwest and Northeastern regions of USA.We study the brand related language use through these reviews, with focuses on the brand satisfaction and gender factors.In particular, we perform three tasks: automatic brand identification from raw text, joint brand-satisfaction prediction, and joint brandgender-satisfaction prediction.This work extends previous studies in text classification by incorporating the dependency and interaction among local features in the form of structured sparsity in a log-linear model.Our quantitative evaluation shows that our approach which combines the advantages of graphical modeling and sparsity modeling techniques significantly outperforms…

FoundationTTS: Text-to-Speech for ASR Customization with Generative Language Model

Ruiqing Xue, Yanqing Liu, Lei He +4 more

eess.AS · · cited 2× · arXiv ↗ · more like this ·

Neural text-to-speech (TTS) generally consists of cascaded architecture with separately optimized acoustic model and vocoder, or end-to-end architecture with continuous mel-spectrograms or self-extracted speech frames as the intermediate representations to bridge acoustic model and vocoder, which suffers from two limitations: 1) the continuous acoustic frames are hard to predict with phoneme only, and acoustic information like duration or pitch is also needed to solve the one-to-many problem, which is not easy to scale on large scale and noise datasets; 2) to achieve diverse speech output based on continuous speech features, complex VAE or flow-based models are usually required. In this paper, we propose FoundationTTS, a new speech synthesis system with a neural audio codec for discrete speech token extraction and waveform reconstruction and a large language model for discrete token…

Singing Voice Separation Using a Deep Convolutional Neural Network Trained by Ideal Binary Mask and Cross Entropy

Kin Wah Edward Lin, Balamurali B. T., Enyan Koh +2 more

cs.SD · · cited 1× · arXiv ↗ · more like this ·

Separating a singing voice from its music accompaniment remains an important challenge in the field of music information retrieval. We present a unique neural network approach inspired by a technique that has revolutionized the field of vision: pixel-wise image classification, which we combine with cross entropy loss and pretraining of the CNN as an autoencoder on singing voice spectrograms. The pixel-wise classification technique directly estimates the sound source label for each time-frequency (T-F) bin in our spectrogram image, thus eliminating common pre- and postprocessing tasks. The proposed network is trained by using the Ideal Binary Mask (IBM) as the target output label. The IBM identifies the dominant sound source in each T-F bin of the magnitude spectrogram of a mixture signal, by considering each T-F bin as a pixel with a multi-label (for each sound source). Cross entropy is…

A distributed fair MAC flow allocation and scheduling framework for IEEE 802.11 based wireless mesh networks

Kin Wah Edward Lin, Brahim Bensaou

Computer Networks and Communications · Rare & Special e-Zone (The Hong Kong University of Science and Technology) · · cited 1× · DOI ↗ · more like this ·

We present a distributed fair MAC flow allocation and scheduling framework for IEEE 802.11 based wireless mesh networks. The framework consists of (1) a modified wireless ad hoc routing protocol to take into account bandwidth requirement, (2) a link information dissemination protocol to propagate local topology information, (3) a cooperative gradient-based iterative algorithm to allocate fairly MAC flow bandwidth and (4) a distributed fair MAC scheduler to coordinate access to the channel according to the allocated bandwidth. We stress the importance of our framework's practicality, such that it is easily deployable in real IEEE 802.11 based devices, and, most importantly, it is extensible to include other services such as QoS routing and admission control. Before carrying out an expensive on-site performance evaluation, we conduct numerous simulations to evaluate our framework, and the…

Adaptation of Predictive Models to PDA Hand-Held Devices

Edward Lin, Thomas B. Purcell, Rick McPheeters

Computer Vision and Pattern Recognition · eScholarship (California Digital Library) · · cited 1× · OpenAlex ↗ · more like this ·

Prediction models using multiple logistic regression are appearing with increasing frequency in the medical literature. Problems associated with these models include the complexity of computations when applied in their pure form, and lack of availability at the bedside. Personal digital assistant (PDA) hand-held devices equipped with spreadsheet software offer the clinician a readily available and easily applied means of applying predictive models at the bedside. The purposes of this article are to briefly review regression as a means of creating predictive models and to describe a method of choosing and adapting logistic regression models to emergency department (ED) clinical practice.

A high performance custom hardware backend search engine for a speech recognition system

Edward Lin

Artificial Intelligence · · cited 1× · OpenAlex ↗ · more like this ·

Today's best quality speech recognition systems are implemented in software and demand high end processors just to achieve real-time decoding speeds; for many commercial applications, the requirements are too expensive and performance too limiting. Looking to the future, we do not see the problems getting much better with just software optimizations and general purpose processor advancements. Much like the evolution of the graphics chips, we believe speech recognition can significantly benefit moving from software to custom hardware; speech recognizers would yield higher performance, require less hardware resources, and dissipate less power without any sacrifice to word accuracy when compared against software running on a processor. As part of Carnegie Mellon's In Silico Vox project which seeks to use efficient hardware to help alleviate problems plaguing speech recognition, our work…

ModelBlaster: Closing the Performance Gap through Learning-Augmented Agents Across Models, Kernels and Hardware Backends

Shengjun Kris Dong, Dima Nikiforov, Sahil Modi +4 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Optimizing accelerator code across hardware architectures is difficult. ML compilers search predefined spaces of schedules and micro-kernels, while LLM-guided optimization can explore alternative algorithms, operator decompositions, and hardware-specific techniques. However, existing LLM agents typically target a single programming interface, toolchain, or accelerator family, focus on kernel-level optimization without model-level transforms, and offer limited reuse of experience across hardware targets. We present ModelBlaster, a Memory-Augmented In-Context Reinforcement Learning (MAIC-RL) framework for optimizing data-parallel kernels and whole models across heterogeneous SIMD and SIMT accelerators. Its mutable policy is a persistent knowledge base updated at inference time by Actor-Critic Textual Gradient Descent (AC-TGD). The knowledge base maps performance states to actions…

Collisionless jet expanding into vacuum from a circular aperture

Shiying Cai, Chunpei Cai, Edward Lin +2 more

Applied Mathematics · Physics of Fluids · · cited 0× · DOI ↗ · more like this ·

Collisionless flows expanding into a vacuum from a circular slit are investigated using the gaskinetic theory. Both accurate and approximate expressions to the plume fields along a centerline and a constant radius are obtained, including the density, velocity components, and translational temperature. Special non-dimensional parameters such as the exit semi-opening angle, gas speed ratio at the exit, and positions are included in these expressions. Particle simulations with the direct simulation Monte Carlo method are performed to validate the above results. These expressions are complex and may need computers for evaluations; however, the cost is minor when compared to particle simulations. With the assumptions of a high or low exit speed ratio and small exit angle, simple explicit expressions for properties along the centerline and a constant radius are obtained. The investigations…