Author

Dafei Lin

5 papers · 2022–2023

2022peak 3 in 20232023

Frequent co-authors

Papers

showing 1–5 of 5 RSS

External Slot Relationship Memory for Multi-Domain Dialogue State Tracking

Xinlai Xing, Changmeng Yang, Dafei Lin +3 more

Artificial Intelligence · Preprints.org · 17 Jul 2023 · cited 2× · DOI ↗ · more like this ·

Dialogue State Tracking is an essential component in multi-domain dialogue systems, aiming to accurately determine the current dialogue state based on the dialogue history. Existing research has addressed the issue of multiple mappings in dialogues by employing slot self-attention as a data-driven approach. However, learning the relationships between slots from a single sample has limitations and introduces noise. In this paper, we propose an External Slot Relation Memory-based Dialogue State Tracking model (ER-DST). By utilizing an external memory storage, we learn the relationships between slots as a dictionary of multi-domain slot relations. Additionally, we employ a small filter to discard slot information irrelevant to the current dialogue state. Experimental results on the MultiWOZ2.0 and MultiWOZ2.1 benchmarks demonstrate significant improvements while reducing the time…

Coreference Resolution Method Integrating Textual Information and Semantic Assessment

Da Teng, Xiaochuan Zhang, Xinlai Xing +3 more

Artificial Intelligence · 10 Nov 2023 · cited 0× · DOI ↗ · more like this ·

The coreference resolution refers to the task of identifying and clustering different expressions that refer to the same entity. In natural language processing, it is a critical task that provides effective support for other NLP tasks. To address issues such as unclear referential information, weak feature vector correlations due to long distances between pronouns, this paper proposes an end-to-end coreference resolution model that integrates Bi-LSTM and multi-head self-attention mechanisms, combined with text similarity calculation to improve the coreference scoring function. The model was tested on the OntoNotes 5.0 dataset and compared with the c2f-coref+spanBERT model. The results show an Avg.F1 score improvement of 0.3% under the CONLL evaluation standard, with an Avg.F1 score of 79.7%, demonstrating the effectiveness of the proposed algorithm.

The Research on Construction Method of Government Procurement Intention Recognition Dataset

Panpan Chen, Xiaochuan Zhang, Xinlai Xing +3 more

Artificial Intelligence · 10 Nov 2023 · cited 0× · DOI ↗ · more like this ·

Intention detection can effectively extract key information from text, which helps to provide personalized services for government procurement users and improve user experiences. Currently, there is a lack of open datasets in the field of government procurement question-and-answer (Q&A) services. To address this issue, this paper first collected initial data of 2026 pieces and cleaned them. Secondly, to ease the subjectivity brought by manual classification, text clustering algorithms were introduced to group the textual data. Finally, the data in each cluster was checked for rationality and labeled for intention through manual verification. K-Folder cross validation experiments were performed on the obtained dataset using a classification model, and the results showed that the dataset can be used in the practical application of dialogue systems and intention recognition in related…

Semantic Similarity Evaluation Method Based on Text Generation Data Augmentation

Jiangfeng Zhou, Xinlai Xing, Dafei Lin +1 more

Artificial Intelligence · 9 Dec 2022 · cited 0× · DOI ↗ · more like this ·

The similarity evaluation method based on neural network has achieved good results, but it has higher requirements on the scale and quality of the corpus. Based on this problem, this paper proposes a semantic similarity evaluation method based on text generation data augmentation. This method combines Seq2Seq with a masked language model for data augmentation, and uses the expanded data to fine-tune the pre-trained language model. The pre-trained language model and the Siamese network are combined to build a semantic similarity evaluation model. Finally, experiments were carried out on the standard sentence similarity evaluation data set SentEva12012-2016. Compared with the benchmark model, the Spearman correlation coefficient improved by 3.11%. Experiments show that the semantic similarity evaluation method based on data augmentation can effectively solve the problem of low accuracy…

A Model of Spoken Language Understanding Combining with Multi-Head Self-Attention

Dafei Lin, Xinlai Xing, Xiaochuan Zhang +1 more

Artificial Intelligence · 9 Dec 2022 · cited 0× · DOI ↗ · more like this ·

Spoken Language Understanding (SLU) is a very important module in intelligent dialogue systems. It is usually constructed based on a bi-directional long and short-term memory network (BiLSTM). It has some shortcomings, such as relative single representation of feature space and fuzzy semantic features. For this reason, this study constructs a SLU model which combines the temporal characteristics of context and the characteristics of multi-layer representation space. The model combines a bi-directional long and short-term memory network and a multi-head self-attention to extract different feature information of contextual temporal features and multisemantic representation space of the text, respectively; then, the two features are fused using a residual linking method to enhance the features of word dependence at different locations within the text; meanwhile, the gate mechanism is then…