Author

Hugo Hernault

9 papers · 2007–2024

2007peak 3 in 20102024

Frequent co-authors

Papers

showing 1–9 of 9 RSS

HILDA: A Discourse Parser Using Support Vector Machine Classification

Hugo Hernault, Helmut Prendinger, David A. duVerle +1 more

Artificial Intelligence · Dialogue & Discourse · 10 Dec 2010 · cited 212× · DOI ↗ · more like this ·

Discourse structures have a central role in several computational tasks, such as question-answering or dialogue generation. In particular, the framework of the Rhetorical Structure Theory (RST) offers a sound formalism for hierarchical text organization. In this article, we present HILDA, an implemented discourse parser based on RST and Support Vector Machine (SVM) classification. SVM classifiers are trained and applied to discourse segmentation and relation labeling. By combining labeling with a greedy bottom-up tree building approach, we are able to create accurate discourse trees in linear time complexity. Importantly, our parser can parse entire texts, whereas the publicly available parser SPADE (Soricut and Marcu 2003) is limited to sentence level analysis. HILDA outperforms other discourse parsers for tree structure construction and discourse relation labeling. For the discourse…

A Semi-Supervised Approach to Improve Classification of Infrequent Discourse Relations Using Feature Vector Extension

Hugo Hernault, Danushka Bollegala, Mitsuru Ishizuka

Artificial Intelligence · Empirical Methods in Natural Language Processing · 9 Oct 2010 · cited 39× · OpenAlex ↗ · more like this ·

u-tokyo.ac.jp Several recent discourse parsers have employed fully-supervised machine learning approaches. These methods require human annotators to beforehand create an extensive training corpus, which is a time-consuming and costly process. On the other hand, unlabeled data is abundant and cheap to collect. In this paper, we propose a novel semi-supervised method for discourse relation classification based on the analysis of cooccurring features in unlabeled data, which is then taken into account for extending the feature vectors given to a classifier. Our experimental results on the RST Discourse Treebank corpus and Penn Discourse Treebank indicate that the proposed method brings a significant improvement in classification accuracy and macro-average F-score when small training datasets are used. For instance, with training sets of c.a. 1000 labeled instances, the proposed method…

Efficient Text Classification with Echo State Networks

Jérémie Cabessa, Hugo Hernault, Heechang Kim +2 more

Artificial Intelligence · 18 Jul 2021 · cited 11× · DOI ↗ · more like this ·

We consider echo state networks (ESNs) for text classification. More specifically, we investigate the learning capabilities of ESNs with pre-trained word embedding as input features, trained on the IMDb and TREC sentiment and question classification datasets, respectively. First, we introduce a customized training paradigm for the processing of multiple input time series (the inputs texts) associated with categorical targets (their corresponding classes). For sentiment tasks, we use an additional frozen attention mechanism which is based on an external lexicon, and hence requires only negligible computational cost. Within this paradigm, ESNs can be trained in tens of seconds on a GPU. We show that ESNs significantly outperform their Ridge regression baselines provided with the same embedded features. ESNs also compete with classical Bi-LSTM networks while keeping a training time of up…

From rhetorical structures to document structure

Gersende Georg, Hugo Hernault, Marc Cavazza +2 more

Artificial Intelligence · 16 Sep 2009 · cited 10× · DOI ↗ · more like this ·

In this paper, the authors extend previous work on the automatic structuring of medical documents using content analysis. Their long-term objective is to take advantage of specific rhetoric markers encountered in specialized medical documents (clinical guidelines) to automatically structure free text according to its role in the document. This should enable to generate multiple views of the same document depending on the target audience, generate document summaries, as well as facilitating knowledge extraction from text. The authors have established in previous work that the structure of clinical guidelines could be refined through the identification of a limited set of deontic operators. They now propose to extend this approach by analyzing the text delimited by these operators using Rhetorical Structure Theory. The emphasis on causality and time in RST proves a powerful complement to…

Towards Semi-Supervised Classification of Discourse Relations using Feature Correlations

Hugo Hernault, Danushka Bollegala, Mitsuru Ishizuka

Artificial Intelligence · Annual Meeting of the Special Interest Group on Discourse and Dialogue · 24 Sep 2010 · cited 5× · OpenAlex ↗ · more like this ·

Two of the main corpora available for training discourse relation classifiers are the RST Discourse Treebank (RST-DT) and the Penn Discourse Treebank (PDTB), which are both based on the Wall Street Journal corpus. Most recent work using discourse relation classifiers have employed fully-supervised methods on these corpora. However, certain discourse relations have little labeled data, causing low classification performance for their associated classes. In this paper, we attempt to tackle this problem by employing a semi-supervised method for discourse relation classification. The proposed method is based on the analysis of feature cooccurrences in unlabeled data. This information is then used as a basis to extend the feature vectors during training. The proposed method is evaluated on both RST-DT and PDTB, where it significantly outperformed baseline classifiers. We believe that the…

Generating Questions: An Inclusive Characterization and a Dialogue-based Application

Paul Piwek, Helmut Prendinger, Hugo Hernault +1 more

Artificial Intelligence · 2008 · cited 4× · OpenAlex ↗ · more like this ·

In this paper, we make a case for the intrinsic richness of the Question Generation (QG) task. We examine QG in terms of its input, output and the relation between the two. We then describe a specific approach to QG which depends on -abstraction to formalize the relation between questions and answers. This allows us to make fine-grained distinctions between different types of questions. We have applied this approach to the generation of dialogue from monologue, exploiting the coherence relations underlying the monologue.

Evaluating HILDA in the CODA Project: A Case Study in Question Generation Using Automatic Discourse Analysis

Pascal Kuyten, Hugo Hernault, Helmut Prendinger +1 more

Artificial Intelligence · National Conference on Artificial Intelligence · 3 Nov 2011 · cited 3× · OpenAlex ↗ · more like this ·

Recent studies on question generation identify the need for automatic discourse analysers. We evaluated the feasibility of integrating an available discourse analyser called HILDA for a specific question generation system called CODA; introduce an approach by extracting a discourse corpus from the CODA parallel corpus; and identified future work towards automatic discourse analysis in the domain of question generation. Question Generation Question generation is an important and challenging component of systems where knowledge extraction and representation in natural language is desired (Rus et al. 2010). Rus and Graesser defined Question Generation as the task of automatically generating of questions from some form of input. The input could vary from information in a database to a deep semantic representation to raw text (Rus and Graesser 2009). Studies on question generation can be…

In-Context Learning and Fine-Tuning GPT for Argument Mining

Jérémie Cabessa, Hugo Hernault, Umer Mushtaq

cs.CL · 10 Jun 2024 · cited 0× · arXiv ↗ · more like this ·

Large Language Models (LLMs) have become ubiquitous in NLP and deep learning. In-Context Learning (ICL) has been suggested as a bridging paradigm between the training-free and fine-tuning LLMs settings. In ICL, an LLM is conditioned to solve tasks by means of a few solved demonstration examples included as prompt. Argument Mining (AM) aims to extract the complex argumentative structure of a text, and Argument Type Classification (ATC) is an essential sub-task of AM. We introduce an ICL strategy for ATC combining kNN-based examples selection and majority vote ensembling. In the training-free ICL setting, we show that GPT-4 is able to leverage relevant information from only a few demonstration examples and achieve very competitive classification accuracy on ATC. We further set up a fine-tuning strategy incorporating well-crafted structural features given directly in textual form. In this…

M.: T2D: Generating Dialogues Between Virtual Agents Automatically from Text

Paul Piwek, Hugo Hernault, Helmut Prendinger +1 more

Artificial Intelligence · 2007 · cited 0× · OpenAlex ↗ · more like this ·

Abstract. The Text2Dialogue (T2D) system that we are developing allows digital content creators to generate attractive multi-modal dialogues presented by two virtual agents—by simply providing textual information as input. We use Rhetorical Structure Theory (RST) to decompose text into segments and to identify rhetorical discourse relations between them. These are then “acted out ” by two 3D agents using synthetic speech and appropriate conversational gestures. In this paper, we present version 1.0 of the T2D system and focus on the novel technique that it uses for mapping rhetorical relations to question–answer pairs, thus transforming (monological) text into a form that supports dialogues between virtual agents. 1