arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

AiTi Aw

47 papers · 2006–2026

2006: 12007: 12008: 122009: 62010: 32011: 02012: 02013: 02014: 32015: 32016: 12017: 22018: 02019: 12020: 22021: 02022: 12023: 22024: 22025: 62026: 1
2006peak 12 in 20082026

Frequent co-authors

Papers

showing 1–25 of 47 RSS

A phrase-based statistical model for SMS text normalization

AiTi Aw, Min Zhang, Juan Xiao +1 more

Artificial Intelligence · · cited 280× · DOI ↗ · more like this ·

Short Messaging Service (SMS) texts behave quite differently from normal written texts and have some very special phenomena. To translate SMS texts, traditional approaches model such irregularities directly in Machine Translation (MT). However, such approaches suffer from customization problem as tremendous effort is required to adapt the language model of the existing translation system to handle SMS text style. We offer an alternative approach to resolve such irregularities by normalizing SMS texts before MT. In this paper, we view the task of SMS normalization as a translation problem from the SMS language to the English language and we propose to adapt a phrase-based statistical MT model for the task. Evaluation by 5-fold cross validation on a parallel SMS normalized corpus of 5000 sentences shows that our method can achieve 0.80702 in BLEU score against the baseline BLEU score…

AudioBench: A Universal Benchmark for Audio Large Language Models

Bin Wang, Xunlong Zou, Geyu Lin +6 more

cs.SD · · cited 169× · arXiv ↗ · more like this ·

We introduce AudioBench, a universal benchmark designed to evaluate Audio Large Language Models (AudioLLMs). It encompasses 8 distinct tasks and 26 datasets, among which, 7 are newly proposed datasets. The evaluation targets three main aspects: speech understanding, audio scene understanding, and voice understanding (paralinguistic). Despite recent advancements, there lacks a comprehensive benchmark for AudioLLMs on instruction following capabilities conditioned on audio signals. AudioBench addresses this gap by setting up datasets as well as desired evaluation metrics. Besides, we also evaluated the capabilities of five popular models and found that no single model excels consistently across all tasks. We outline the research outlook for AudioLLMs and anticipate that our open-sourced evaluation toolkit, data, and leaderboard will offer a robust testbed for future model developments.

SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

Bin Wang, Zhengyuan Liu, Xin Huang +4 more

cs.CL · · cited 116× · arXiv ↗ · more like this ·

We present SeaEval, a benchmark for multilingual foundation models. In addition to characterizing how these models understand and reason with natural language, we also investigate how well they comprehend cultural practices, nuances, and values. Alongside standard accuracy metrics, we investigate the brittleness of foundation models in the dimensions of semantics and multilinguality. Our analyses span both open-sourced and closed models, leading to empirical results across classic NLP tasks, reasoning, and cultural comprehension. Key findings indicate (1) Most models exhibit varied behavior when given paraphrased instructions. (2) Many models still suffer from exposure bias (e.g., positional bias, majority label bias). (3) For questions rooted in factual, scientific, and commonsense knowledge, consistent responses are expected across multilingual queries that are semantically…

A Tree Sequence Alignment-based Tree-to-Tree Translation Model

Min Zhang, Hongfei Jiang, AiTi Aw +3 more

Artificial Intelligence · National University of Singapore · · cited 113× · OpenAlex ↗ · more like this ·

This paper presents a translation model that is based on tree sequence alignment, where a tree sequence refers to a single sequence of sub-trees that covers a phrase. The model leverages on the strengths of both phrase-based and lin-guistically syntax-based method. It automati-cally learns aligned tree sequence pairs with mapping probabilities from word-aligned bi-parsed parallel texts. Compared with previous models, it not only captures non-syntactic phrases and discontinuous phrases with lin-guistically structured features, but also sup-ports multi-level structure reordering of tree typology with larger span. This gives our model stronger expressive power than other re-ported models. Experimental results on the NIST MT-2005 Chinese-English translation task show that our method statistically signifi-cantly outperforms the baseline systems. 1

Semantic Role Labeling Using a Grammar-Driven Convolution Tree Kernel

Min Zhang, Wanxiang Che, Guodong Zhou +4 more

Artificial Intelligence · IEEE Transactions on Audio Speech and Language Processing · · cited 34× · DOI ↗ · more like this ·

Convolution tree kernel has shown promising results in semantic role labeling (SRL). However, this kernel does not consider much linguistic knowledge in kernel design and only performs hard matching between subtrees. To overcome these constraints, this paper proposes a grammar-driven convolution tree kernel for SRL by introducing more linguistic knowledge. Compared with the standard convolution tree kernel, the proposed grammar-driven kernel has two advantages: 1) grammar-driven approximate substructure matching, and 2) grammar-driven approximate tree node matching. The two approximate matching mechanisms enable the proposed kernel to better explore linguistically motivated structured knowledge. Experiments on the CoNLL-2005 SRL shared task and the PropBank I corpus show that the proposed kernel outperforms the standard convolution tree kernel significantly. Moreover, we present a…

Forest-based tree sequence to string translation model

Hui Zhang, Min Zhang, Haizhou Li +2 more

Artificial Intelligence · National University of Singapore · · cited 31× · DOI ↗ · more like this ·

This paper proposes a forest-based tree sequence to string translation model for syntax-based statistical machine translation, which automatically learns tree sequence to string translation rules from word-aligned source-side-parsed bilingual texts. The proposed model leverages on the strengths of both tree sequence-based and forest-based translation models. Therefore, it can not only utilize forest structure that compactly encodes exponential number of parse trees but also capture nonsyntactic translation equivalences with linguistically structured information through tree sequence. This makes our model potentially more robust to parse errors and structure divergence. Experimental results on the NIST MT-2003 Chinese-English translation task show that our method statistically significantly outperforms the four baseline systems.

A Grammar-driven Convolution Tree Kernel for Semantic Role Classification

Min Zhang, Wanxiang Che, AiTi Aw +4 more

Artificial Intelligence · National University of Singapore · · cited 26× · OpenAlex ↗ · more like this ·

Convolution tree kernel has shown promising results in semantic role classification. However, it only carries out hard matching, which may lead to over-fitting and less accurate similarity measure. To remove the constraint, this paper proposes a grammardriven convolution tree kernel for semantic role classification by introducing more linguistic knowledge into the standard tree kernel. The proposed grammar-driven tree kernel displays two advantages over the previous one: 1) grammar-driven approximate substructure matching and 2) grammardriven approximate tree node matching. The two improvements enable the grammardriven tree kernel explore more linguistically motivated structure features than the previous one. Experiments on the CoNLL-2005 SRL shared task show that the grammardriven tree kernel significantly outperforms the previous non-grammar-driven one in SRL. Moreover, we present a…

A syntax-driven bracketing model for phrase-based translation

Deyi Xiong, Min Zhang, AiTi Aw +1 more

Artificial Intelligence · · cited 23× · DOI ↗ · more like this ·

Syntactic analysis influences the way in which the source sentence is translated. Previous efforts add syntactic constraints to phrase-based translation by directly rewarding/punishing a hypothesis whenever it matches/violates source-side constituents. We present a new model that automatically learns syntactic constraints, including but not limited to constituent matching/violation, from training corpus. The model brackets a source phrase as to whether it satisfies the learnt syntactic constraints. The bracketed phrases are then translated as a whole unit by the decoder. Experimental results and analysis show that the new model outperforms other previous methods and achieves a substantial improvement over the baseline which is not syntactically informed.

Grammar comparison study for translational equivalence modeling and statistical machine translation

Min Zhang, Hongfei Jiang, Haizhou Li +2 more

Artificial Intelligence · · cited 22× · DOI ↗ · more like this ·

This paper presents a general platform, namely synchronous tree sequence substitution grammar (STSSG), for the grammar comparison study in Translational Equivalence Modeling (TEM) and Statistical Machine Translation (SMT). Under the STSSG platform, we compare the expressive abilities of various grammars through synchronous parsing and a real translation platform on a variety of Chinese-English bilingual corpora. Experimental results show that the STSSG is able to better explain the data in parallel corpora than other grammars. Our study further finds that the complexity of structure divergence is much higher than suggested in literature, which imposes a big challenge to syntactic transformation-based SMT.

Twitter corpus creation: The case of a Malay Chat-style-text Corpus (MCC)

Mohammad Arshi Saloot, Norisma Idris, AiTi Aw +1 more

Human-Computer Interaction · Digital Scholarship in the Humanities · · cited 21× · DOI ↗ · more like this ·

In recent years, social networks, microblogs, and short message service have deeply penetrated peoples lives, and thus, chat-style text is a common phenomenon. This chat-style text has many unknown features for linguists, which can be discovered by analyzing a chat-style corpus. The process of constructing a corpus conforms to specific corpus criteria, such as representativeness, sampling, variety, and chronology. Up to now, literature does not provide specific corpus criteria for creating a chat-style-text corpus. In contrast to related work, corpus criteria for creating a chat-style corpus are provided. An exhaustive and reliable Malay chat-style text corpus is still lacking. Thus, the provided criteria are used to demonstrate the process of constructing a Twitter corpus known as the Malay Chat-style Corpus (MCC). The MCC, which has 1 million twitter messages, consists of 14,484,384…

Exploiting N-best hypotheses for SMT self-enhancement

Boxing Chen, M. Zhang, AiTi Aw +1 more

Artificial Intelligence · · cited 19× · DOI ↗ · more like this ·

Word and n-gram posterior probabilities estimated on N-best hypotheses have been used to improve the performance of statistical machine translation (SMT) in a rescoring framework. In this paper, we extend the idea to estimate the posterior probabilities on N-best hypotheses for translation phrase-pairs, target language n-grams, and source word reorderings. The SMT system is self-enhanced with the posterior knowledge learned from N-best hypotheses in a re-decoding framework. Experiments on NIST Chinese-to-English task show performance improvements for all the strategies. Moreover, the combination of the three strategies achieves further improvements and outperforms the baseline by 0.67 BLEU score on NIST-2003 set, and 0.64 on NIST-2005 set, respectively.

EM-based Hybrid Model for Bilingual Terminology Extraction from Comparable Corpora

Lianhau Lee, AiTi Aw, Min Zhang +1 more

Artificial Intelligence · International Conference on Computational Linguistics · · cited 17× · OpenAlex ↗ · more like this ·

In this paper, we present an unsupervised hybrid model which combines statistical, lexical, linguistic, contextual, and temporal features in a generic EMbased framework to harvest bilingual terminology from comparable corpora through comparable document alignment constraint. The model is configurable for any language and is extensible for additional features. In overall, it produces considerable improvement in performance over the baseline method. On top of that, our model has shown promising capability to discover new bilingual terminology with limited usage of dictionaries. 1

Using a Hybrid Convolution Tree Kernel for Semantic Role Labeling

Wanxiang Che, Min Zhang, AiTi Aw +3 more

Artificial Intelligence · ACM Transactions on Asian Language Information Processing · · cited 17× · DOI ↗ · more like this ·

As a kind of Shallow Semantic Parsing, Semantic Role Labeling (SRL) is gaining more attention as it benefits a wide range of natural language processing applications. Given a sentence, the task of SRL is to recognize semantic arguments (roles) for each predicate (target verb or noun). Feature-based methods have achieved much success in SRL and are regarded as the state-of-the-art methods for SRL. However, these methods are less effective in modeling structured features. As an extension of feature-based methods, kernel-based methods are able to capture structured features more efficiently in a much higher dimension. Application of kernel methods to SRL has been achieved by selecting the tree portion of a predicate and one of its arguments as feature space, which is named as predicate-argument feature (PAF) kernel. The PAF kernel captures the syntactic tree structure features using…

The TALP & I2R SMT Systems for IWSLT 2008

Maxim Khalilov, Carlos A. Henr, Adolfo Hern +5 more

Artificial Intelligence · · cited 14× · OpenAlex ↗ · more like this ·

This paper gives a description of the statistical machine translation (SMT) systems developed at the TALP Research Center of the UPC (Universitat Politde Catalunya) for our participation in the IWSLT'08 evaluation campaign. We present N gram-based (TALPtuples) and phrase-based (TALPphrases) SMT systems. The paper explains the 2008 systems' architecture and outlines translation schemes we have used, mainly focusing on the new techniques that are challenged to improve speech-to-speech translation quality. The novelties we have introduced are: improved reorder- ing method, linear combination of translation and reordering models and new technique dealing with punctuation marks insertion for a phrase-based SMT system. This year we focus on the Arabic-English, Chinese- Spanish and pivot Chinese-(English)-Spanish translation tasks.

GCDST: A Graph-based and Copy-augmented Multi-domain Dialogue State Tracking

Peng Wu, Bowei Zou, Ridong Jiang +1 more

Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

As an essential component of task-oriented dialogue systems, Dialogue State Tracking (DST) takes charge of estimating user intentions and requests in dialogue contexts and extracting substantial goals (states) from user utterances to help the downstream modules to determine the next actions of dialogue systems. For practical usages, a major challenge to constructing a robust DST model is to process a conversation with multi-domain states. However, most existing approaches trained DST on a single domain independently, ignoring the information across domains. To tackle the multi-domain DST task, we first construct a dialogue state graph to transfer structured features among related domain-slot pairs across domains. Then, we encode the graph information of dialogue states by graph convolutional networks and utilize a hard copy mechanism to directly copy historical states from the previous…

Toward Tweets Normalization Using Maximum Entropy

Mohammad Arshi Saloot, Norisma Idris, Liyana Shuib +2 more

Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

The use of social network services and microblogs, such as Twitter, has created valuable text resources, which contain extremely noisy text. Twitter messages contain so much noise that it is difficult to use them in natural language processing tasks. This paper presents a new approach using the maximum entropy model for normalizing Tweets. The proposed approach addresses words that are unseen in the training phase. Although the maximum entropy needs a training dataset to adjust its parameters, the proposed approach can normalize unseen data in the training set. The principle of maximum entropy emphasizes incorporating the available features into a uniform model. First, we generate a set of normalized candidates for each out-ofvocabulary word based on lexical, phonemic, and morphophonemic similarities. Then, three different probability scores are calculated for each candidate using…

A comparative study of hypothesis alignment and its improvement for machine translation system combination

Boxing Chen, Min Zhang, Haizhou Li +1 more

Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

Recently confusion network decoding shows the best performance in combining outputs from multiple machine translation (MT) sys-tems. However, overcoming different word orders presented in multiple MT systems dur-ing hypothesis alignment still remains the biggest challenge to confusion network-based MT system combination. In this paper, we compare four commonly used word align-ment methods, namely GIZA++, TER, CLA and IHMM, for hypothesis alignment. Then we propose a method to build the confusion network from intersection word alignment, which utilizes both direct and inverse word alignment between the backbone and hypo-thesis to improve the reliability of hypothesis alignment. Experimental results demonstrate that the intersection word alignment yields consistent performance improvement for all four word alignment methods on both Chi-nese-to-English spoken and written language tasks. 1

Linguistically annotated BTG for statistical machine translation

Deyi Xiong, Min Zhang, AiTi Aw +1 more

Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

Bracketing Transduction Grammar (BTG) is a natural choice for effective integration of desired linguistic knowledge into statistical machine translation (SMT). In this paper, we propose a Linguistically Annotated BTG (LABTG) for SMT. It conveys linguistic knowledge of source-side syntax structures to BTG hierarchical structures through linguistic annotation. From the linguistically annotated data, we learn annotated BTG rules and train linguistically motivated phrase translation model and reordering model. We also present an annotation algorithm that captures syntactic information for BTG nodes. The experiments show that the LABTG approach significantly outperforms a baseline BTG-based system and a state-of-the-art phrase-based system on the NIST MT-05 Chinese-to-English translation task. Moreover, we empirically demonstrate that the proposed method achieves better translation selection…

A linguistically annotated reordering model for BTG-based statistical machine translation

Deyi Xiong, Min Zhang, AiTi Aw +1 more

Artificial Intelligence · · cited 11× · DOI ↗ · more like this ·

In this paper, we propose a linguistically annotated reordering model for BTG-based statistical machine translation. The model incorporates linguistic knowledge to predict orders for both syntactic and non-syntactic phrases. The linguistic knowledge is automatically learned from source-side parse trees through an annotation algorithm. We empirically demonstrate that the proposed model leads to a significant improvement of 1.55% in the BLEU score over the baseline reordering model on the NIST MT-05 Chinese-to-English translation task.

Refinements in BTG-based Statistical Machine Translation

Deyi Xiong, M. Zhang, AiTi Aw +3 more

Artificial Intelligence · International Joint Conference on Natural Language Processing · · cited 11× · OpenAlex ↗ · more like this ·

Bracketing Transduction Grammar (BTG) has been well studied and used in statistical machine translation (SMT) with promising results. However, there are two major issues for BTG-based SMT. First, there is no effec-tive mechanism available for predicting or-ders between neighboring blocks in the orig-inal BTG. Second, the computational cost is high. In this paper, we introduce two re-finements for BTG-based SMT to achieve better reordering and higher-speed decod-ing, which include (1) reordering heuristics to prevent incorrect swapping and reduce search space, and (2) special phrases with tags to indicate sentence beginning and end-ing. The two refinements are integrated into a well-established BTG-based Chinese-to-English SMT system that is trained on large-scale parallel data. Experimental results on the NIST MT-05 task show that the proposed refinements contribute significant…

Leveraging Contrastive Learning and Knowledge Distillation for Incomplete Modality Rumor Detection

Fan Xu, Pinyun Fu, Qi Huang +3 more

Sociology and Political Science · · cited 8× · DOI ↗ · more like this ·

Rumors spread rapidly through online social microblogs at a relatively low cost, causing substantial economic losses and negative consequences in our daily lives. Existing rumor detection models often neglect the underlying semantic coherence between text and image components in multimodal posts, as well as the challenges posed by incomplete modalities in single modal posts, such as missing text or images. This paper presents CLKD-IMRD, a novel framework for Incomplete Modality Rumor Detection. CLKD-IMRD employs Contrastive Learning and Knowledge Distillation to capture the semantic consistency between text and image pairs, while also enhancing model generalization to incomplete modalities within individual posts. Extensive experimental results demonstrate that our CLKD-IMRD outperforms state-of-the-art methods on two English and two Chinese benchmark datasets for rumor detection in…

A Word Labeling Approach to Thai Sentence Boundary Detection and POS Tagging

Nina Zhou, AiTi Aw, Nattadaporn Lertcheva +1 more

Artificial Intelligence · International Conference on Computational Linguistics · · cited 8× · OpenAlex ↗ · more like this ·

Previous studies on Thai Sentence Boundary Detection (SBD) mostly assumed sentence ends at a space disambiguation problem, which classified space either as an indicator for Sentence Boundary (SB) or non-Sentence Boundary (nSB). In this paper, we propose a word labeling approach which treats space as a normal word, and detects SB between any two words. This removes the restriction for SB to be oc-curred only at space and makes our system more robust for modern Thai writing. It is because in modern Thai writing, space is not consistently used to indicate SB. As syntactic information contributes to better SBD, we further propose a joint Part-Of-Speech (POS) tagging and SBD framework based on Factorial Conditional Random Field (FCRF) model. We compare the performance of our proposed ap-proach with reported methods on ORCHID corpus. We also performed experiments of FCRF model on the TaLAPi…

Regenerating hypotheses for statistical machine translation

Boxing Chen, Min Zhang, AiTi Aw +1 more

Artificial Intelligence · · cited 8× · DOI ↗ · more like this ·

This paper studies three techniques that improve the quality of N-best hypotheses through additional regeneration process. Unlike the multi-system consensus approach where multiple translation systems are used, our improvement is achieved through the expansion of the N-best hypotheses from a single system. We explore three different methods to implement the regeneration process: redecoding, n-gram expansion, and confusion network-based regeneration. Experiments on Chinese-to-English NIST and IWSLT tasks show that all three methods obtain consistent improvements. Moreover, the combination of the three strategies achieves further improvements and outperforms the baseline by 0.81 BLEU-score on IWSLT'06, 0.57 on NIST'03, 0.61 on NIST'05 test set respectively.

Noisy Text Normalization Using an Enhanced Language Model

Mohammad Arshi Saloot, Norisma Idris, Aiti Aw

Artificial Intelligence · International Conference on Artificial Intelligence · · cited 7× · DOI ↗ · more like this ·

User generated text in social network sites contains enormous amount and vast variety of out-of-vocabulary words, formed both deliberately and mistakenly by the end-users. It is of essential usefulness to normalize the noisy text before employing NLP tasks. This paper describes an unsupervised normalization system, which encompasses two phases: candidate generation and candidate selection. We generate candidate via six different methods: 1) one-edit distance lexically generation, 2) phonemically generation, 3) blending the previous methods, 4) two-edit distance lexically generation, 5) dictionary translation, and 6) heuristic rules. Although in candidate selection we use a trigram language model, a new method presented to select candidates with respect to all other words in the sentence. Our experiments on a large dataset show promising results.