Author

Yawei Sun

11 papers · 2018–2024

2018peak 4 in 20182024

Frequent co-authors

Papers

showing 1–11 of 11 RSS

SPARQA: Skeleton-based Semantic Parsing for Complex Questions over Knowledge Bases

Yawei Sun, Lingling Zhang, Gong Cheng +1 more

cs.CL · 31 Mar 2020 · cited 152× · arXiv ↗ · more like this ·

Semantic parsing transforms a natural language question into a formal query over a knowledge base. Many existing methods rely on syntactic parsing like dependencies. However, the accuracy of producing such expressive formalisms is not satisfying on long complex questions. In this paper, we propose a novel skeleton grammar to represent the high-level structure of a complex question. This dedicated coarse-grained formalism with a BERT-based parsing algorithm helps to improve the accuracy of the downstream fine-grained semantic parsing. Besides, to align the structure of a question with the structure of a knowledge base, our multi-strategy method combines sentence-level and word-level semantics. Our approach shows promising performance on several datasets.

TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching

Heng Gong, Yawei Sun, Xiaocheng Feng +4 more

Computer Vision and Pattern Recognition · 2020 · cited 66× · DOI ↗ · more like this ·

Although neural table-to-text models have achieved remarkable progress with the help of largescale datasets, they suffer insufficient learning problem with limited training data. Recently, pretrained language models show potential in few-shot learning with linguistic knowledge learnt from pretraining on large-scale corpus. However, benefiting table-to-text generation in few-shot setting with the powerful pretrained language model faces three challenges, including (1) the gap between the task's structured input and the natural language input for pretraining language model. (2) The lack of modeling for table structure and (3) improving text fidelity with less incorrect expressions that are contradicting to the table. To address aforementioned problems, we propose TableGPT for table-to-text generation. At first, we utilize table transformation module with template to rewrite structured…

TSQA: Tabular Scenario Based Question Answering

Xiao Li, Yawei Sun, Gong Cheng

cs.CL · 14 Jan 2021 · cited 40× · arXiv ↗ · more like this ·

Scenario-based question answering (SQA) has attracted an increasing research interest. Compared with the well-studied machine reading comprehension (MRC), SQA is a more challenging task: a scenario may contain not only a textual passage to read but also structured data like tables, i.e., tabular scenario based question answering (TSQA). AI applications of TSQA such as answering multiple-choice questions in high-school exams require synthesizing data in multiple cells and combining tables with texts and domain knowledge to infer answers. To support the study of this task, we construct GeoTSQA. This dataset contains 1k real questions contextualized by tabular scenarios in the geography domain. To solve the task, we extend state-of-the-art MRC methods with TTGen, a novel table-to-text generator. It generates sentences from variously synthesized tabular data and feeds the downstream MRC…

Reading Comprehension with Graph-based Temporal-Casual Reasoning

Yawei Sun, Cheng Gong, Yuzhong Qu

Artificial Intelligence · International Conference on Computational Linguistics · August 2018 · cited 13× · OpenAlex ↗ · more like this ·

Complex questions in reading comprehension tasks require integrating information from multiple sentences. In this work, to answer such questions involving temporal and causal relations, we generate event graphs from text based on dependencies, and rank answers by aligning event graphs. In particular, the alignments are constrained by graph-based reasoning to ensure temporal and causal agreement. Our focused approach self-adaptively complements existing solutions; it is automatically triggered only when applicable. Experiments on RACE and MCTest show that state-of-the-art methods are notably improved by using our approach as an add-on.

Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation

Xiaocheng Feng, Yawei Sun, Bing Qin +5 more

cs.CL · 24 Feb 2020 · cited 4× · arXiv ↗ · more like this ·

In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content. In detail, the input is a set of structured records and a reference text for describing another recordset. The output is a summary that accurately describes the partial content in the source recordset with the same writing style of the reference. The task is unsupervised due to lack of parallel data, and is challenging to select suitable records and style words from bi-aspect inputs respectively and generate a high-fidelity long document. To tackle those problems, we first build a dataset based on a basketball game report corpus as our testbed, and present an unsupervised neural model with interactive attention mechanism, which is used for learning the semantic relationship between records and…

Semantic Augmented Topic Model over Short Text

Lingyun Li, Yawei Sun, Cong Wang

Artificial Intelligence · November 2018 · cited 3× · DOI ↗ · more like this ·

With the rapid development of Internet and mobile devices, a vast number of short texts are produced by users, which also post great challenges to topic modeling because of the severe sparsity in context. The traditional topic model cannot do well in short text because of lacking word co-occurrence patterns. An effective approach bi-term topic model(BTM) has been proposed which models the word co-occurrence at the whole corpus directly and performs better than conventional topic models. However, BTM only consider the frequency of bi-term simply and ignore the latent semantic information between bi-terms which cause the words with similar semantic having a great risk of being grouped under different topic. In this paper, we propose a latent semantic augmented bi-term topic model(LS-BTM) which incorporates semantic information as prior knowledge to infer the topic more reasonable. The…

Research on Improve Topic Representation over Short Text

Lingyun Li, Yawei Sun, Xu Han +1 more

Artificial Intelligence · June 2018 · cited 3× · DOI ↗ · more like this ·

According to the characteristics of sparseness, poor focus and lack of semantic information in short text, the existing studies mainly improved the topic representation from two aspects: Adjusting the structure of the topic model to increase word co-occurrence and incorporating word embedding to enrich the semantic information. In this paper, we review the existing topic representation methods for short text from these two aspects, select DMM, BTM and LF-DMM as targets and compare the quality of topic representations from them. Considering the traditional topic model does not incorporate word embedding, and single short text often lacks context information due to length limitation, we try to combine it with word embedding, we use two real-world datasets to evaluate the quality of topic representation in the classification task: Although the LF-DMM model incorporates word embedding, it…

A New Model for Emotion-Driven Behavior Extraction from Text

Yawei Sun, Saike He, Xu Han +1 more

Artificial Intelligence · Applied Sciences · 27 Jul 2023 · cited 2× · DOI ↗ · more like this ·

Emotion analysis is currently a popular research direction in the field of natural language processing. However, existing research focuses primarily on tasks such as emotion classification, emotion extraction, and emotion cause analysis, while there are few investigations into the relationship between emotions and their impacts. To address these limitations, this paper introduces the emotion-driven behavior extraction (EDBE) task, which addresses these limitations by separately extracting emotions and behaviors to filter emotion-driven behaviors described in text. EDBE comprises three sub-tasks: emotion extraction, behavior extraction, and emotion–behavior pair filtering. To facilitate research in this domain, we have created a new dataset, which is accessible to the research community. To address the EDBE task, we propose a pipeline approach that incorporates the causal relationship…

Interpretability in Sentiment Analysis: A Self-Supervised Approach to Sentiment Cue Extraction

Yawei Sun, Saike He, Xu Han +1 more

Artificial Intelligence · Applied Sciences · 25 Mar 2024 · cited 1× · DOI ↗ · more like this ·

In this paper, we present a novel self-supervised framework for Sentiment Cue Extraction (SCE) aimed at enhancing the interpretability of text sentiment analysis models. Our approach leverages self-supervised learning to identify and highlight key textual elements that significantly influence sentiment classification decisions. Central to our framework is the development of an innovative Mask Sequence Interpretation Score (MSIS), a bespoke metric designed to assess the relevance and coherence of identified sentiment cues within binary text classification tasks. By employing Monte Carlo Sampling techniques optimized for computational efficiency, our framework demonstrates exceptional effectiveness in processing large-scale text data across diverse datasets, including English and Chinese, thus proving its versatility and scalability. The effectiveness of our approach is validated through…

AdaLoGN: Adaptive Logic Graph Network for Reasoning-Based Machine Reading Comprehension

Xiao Li, Gong Cheng, Ziheng Chen +2 more

cs.CL · 16 Mar 2022 · cited 1× · arXiv ↗ · more like this ·

Recent machine reading comprehension datasets such as ReClor and LogiQA require performing logical reasoning over text. Conventional neural models are insufficient for logical reasoning, while symbolic reasoners cannot directly apply to text. To meet the challenge, we present a neural-symbolic approach which, to predict an answer, passes messages over a graph representing logical relations between text units. It incorporates an adaptive logic graph network (AdaLoGN) which adaptively infers logical relations to extend the graph and, essentially, realizes mutual and iterative reinforcement between neural and symbolic reasoning. We also implement a novel subgraph-to-node message passing mechanism to enhance context-option interaction for answering multiple-choice questions. Our approach shows promising results on ReClor and LogiQA.

Transfer Pretrained Sentence Encoder to Sentiment Classification

Man Bai, Xu Han, Haoran Jia +2 more

Artificial Intelligence · June 2018 · cited 0× · DOI ↗ · more like this ·

Deep learning has been demonstrated to be very effective in many difficult tasks of computer vision(CV) and natural language processing(NLP). But this usually depends on a large number of available training samples to learn, and powerful computing resources (like GPU). In the tasks of computer vision, multiple deep layers of the model are initialized with weights pre-trained on the large-scale datasets like ImageNet, which improves the training speed of the network but does not reduce the performance of the network. Inspired by this, in this paper, in order to demonstrate that transfer is also effective in natural language processing(NLP), we transfer the encoder parts of two models trained under different tasks of NLP to sentiment classification. In the result, we can find that even if we use a simple classifier, we still get good accuracy. And we propose a persuasive explanation for…