Author

Puning Yu

3 papers · 2021–2021

2021peak 3 in 20212021

Frequent co-authors

Papers

showing 1–3 of 3 RSS

BioCopy: A Plug-And-Play Span Copy Mechanism in Seq2Seq Models

Yi Liu, Guoan Zhang, Puning Yu +2 more

cs.CL · 26 Sep 2021 · cited 5× · arXiv ↗ · more like this ·

Copy mechanisms explicitly obtain unchanged tokens from the source (input) sequence to generate the target (output) sequence under the neural seq2seq framework. However, most of the existing copy mechanisms only consider single word copying from the source sentences, which results in losing essential tokens while copying long spans. In this work, we propose a plug-and-play architecture, namely BioCopy, to alleviate the problem aforementioned. Specifically, in the training stage, we construct a BIO tag for each token and train the original model with BIO tags jointly. In the inference stage, the model will firstly predict the BIO tag at each time step, then conduct different mask strategies based on the predicted BIO label to diminish the scope of the probability distributions over the vocabulary list. Experimental results on two separate generative tasks show that they all outperform…

Roberta-based Encoder-decoder Model for Question Answering System

Puning Yu, Yunyi Liu

Artificial Intelligence · June 2021 · cited 2× · DOI ↗ · more like this ·

Question answering is an essential component of the chatbot where it can facilitate users retrieve tremendous information from online websites. Traditional question answering system are built upon the conventional deep learning sequence models, where they are failed to capture sufficient semantic features due to the complexity of the question answering task. To tackle the above challenges, we propose a novel approach, equipped with a Roberta-based encoder-encoder framework, to extract the underlying semantic features more effectively. The experimental results on a well-studied dataset, i.e., SQUAD, show that our proposed method outperforms the baseline models in term of both EM and F1 evaluation metrics, which proves our model effectiveness.

Point2Token: A Multi-Tagging Answer Retrieval Framework for Question Answering

Yi Liu, Puning Yu

Artificial Intelligence · June 2021 · cited 0× · DOI ↗ · more like this ·

Question answering plays a crucial role in the chatbot systems, in which it retrieves the answer from the given context and return the predicted span as a result to users. Previous work mostly modelled this task as a multi-classification problem. However, the models cannot gain a promising result due to the scarcity of the probability distribution over the whole given context. In this paper, we propose a novel approach to solve the problem mentioned above. We model the question answering task as a multiple binary classification problem and introduce PointerNet in our model decoder to predict whether it belongs to a start or end position in each token within context. The experimental results on a well-studied dataset show that our model outperforms the baseline models, which proves our model effectiveness.