arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Helmut Prendinger

110 papers · 1995–2025

1995: 11996: 11997: 01998: 11999: 32000: 12001: 22002: 22003: 22004: 02005: 42006: 32007: 152008: 122009: 122010: 102011: 52012: 22013: 12014: 52015: 22016: 62017: 22018: 42019: 42020: 02021: 12022: 22023: 02024: 42025: 3
1995peak 15 in 20072025

Frequent co-authors

Papers

showing 1–25 of 110 RSS

Deep learning for affective computing: text-based emotion recognition in decision support

Bernhard Kratzwald, Suzana Ilic, Mathias Kraus +2 more

cs.CL · · cited 266× · arXiv ↗ · more like this ·

Emotions widely affect human decision-making. This fact is taken into account by affective computing with the goal of tailoring decision support to the emotional states of individuals. However, the accurate recognition of emotions within narrative documents presents a challenging undertaking due to the complexity and ambiguity of language. Performance improvements can be achieved through deep learning; yet, as demonstrated in this paper, the specific nature of this task requires the customization of recurrent neural networks with regard to bidirectional processing, dropout layers as a means of regularization, and weighted loss functions. In addition, we propose sent2affect, a tailored form of transfer learning for affective computing: here the network is pre-trained for a different task (i.e. sentiment analysis), while the output layer is subsequently tuned to the task of emotion…

HILDA: A Discourse Parser Using Support Vector Machine Classification

Hugo Hernault, Helmut Prendinger, David A. duVerle +1 more

Artificial Intelligence · Dialogue & Discourse · · cited 212× · DOI ↗ · more like this ·

Discourse structures have a central role in several computational tasks, such as question-answering or dialogue generation. In particular, the framework of the Rhetorical Structure Theory (RST) offers a sound formalism for hierarchical text organization. In this article, we present HILDA, an implemented discourse parser based on RST and Support Vector Machine (SVM) classification. SVM classifiers are trained and applied to discourse segmentation and relation labeling. By combining labeling with a greedy bottom-up tree building approach, we are able to create accurate discourse trees in linear time complexity. Importantly, our parser can parse entire texts, whereas the publicly available parser SPADE (Soricut and Marcu 2003) is limited to sentence level analysis. HILDA outperforms other discourse parsers for tree structure construction and discourse relation labeling. For the discourse…

Okutama-Action: An Aerial View Video Dataset for Concurrent Human Action Detection

Mohammadamin Barekatain, Miquel Martí, Hsueh-Fu Shih +4 more

cs.CV · · cited 205× · arXiv ↗ · more like this ·

Despite significant progress in the development of human action detection datasets and algorithms, no current dataset is representative of real-world aerial view scenarios. We present Okutama-Action, a new video dataset for aerial view concurrent human action detection. It consists of 43 minute-long fully-annotated sequences with 12 action classes. Okutama-Action features many challenges missing in current datasets, including dynamic transition of actions, significant changes in scale and aspect ratio, abrupt camera movement, as well as multi-labeled actors. As a result, our dataset is more challenging than existing ones, and will help push the field forward to enable real-world applications.

SentiFul: A Lexicon for Sentiment Analysis

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · IEEE Transactions on Affective Computing · · cited 183× · DOI ↗ · more like this ·

In this paper, we describe methods to automatically generate and score a new sentiment lexicon, called SentiFul, and expand it through direct synonymy and antonymy relations, hyponymy relations, derivation, and compounding with known lexical units. We propose to distinguish four types of affixes (used to derive new words) depending on the role they play with regard to sentiment features: propagating, reversing, intensifying, and weakening. Besides derivation, we considered important process of finding new words such as compounding, which is a highly productive process, especially in the case of nouns and adjectives. We elaborated the algorithm for automatic extraction of new sentiment-related compounds from WordNet using words from SentiFul as seeds for sentiment-carrying base components and applying the patterns of compound formations. In the paper, the importance of considering…

Compositionality Principle in Recognition of Fine-Grained Emotions from Text

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · Proceedings of the International AAAI Conference on Web and Social Media · · cited 116× · DOI ↗ · more like this ·

The recognition of personal emotional state or sentiment conveyed through text is the main task we address in our research. The communication of emotions through text messaging and posts of personal blogs poses the ‘informal style of writing’ challenge for researchers expecting grammatically correct input. Our Affect Analysis Model was designed to handle the informal messages written in an abbreviated or expressive manner. While constructing our rule-based approach to affect recognition from text, we followed the compositionality principle. Our method is capable of processing sentences of different complexity, including simple, compound, complex (with complement and relative clauses), and complex-compound sentences. The evaluation of the Affect Analysis Model algorithm showed promising results regarding its capability to accurately recognize affective information in text from an…

Affect Analysis Model: novel rule-based approach to affect sensing from text

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · Natural Language Engineering · · cited 106× · DOI ↗ · more like this ·

Abstract In this paper, we address the tasks of recognition and interpretation of affect communicated through text messaging in online communication environments. Specifically, we focus on Instant Messaging (IM) or blogs, where people use an informal or garbled style of writing. We introduced a novel rule-based linguistic approach for affect recognition from text. Our Affect Analysis Model (AAM) was designed to deal with not only grammatically and syntactically correct textual input, but also informal messages written in an abbreviated or expressive manner. The proposed rule-based approach processes each sentence in stages, including symbolic cue processing, detection and transformation of abbreviations, sentence parsing and word/phrase/sentence-level analyses. Our method is capable of processing sentences of different complexity, including simple, compound, complex (with complement and…

A novel discourse parser based on support vector machine classification

David A. duVerle, Helmut Prendinger

Artificial Intelligence · · cited 101× · DOI ↗ · more like this ·

This paper introduces a new algorithm to parse discourse within the framework of Rhetorical Structure Theory (RST). Our method is based on recent advances in the field of statistical machine learning (multivariate capabilities of Support Vector Machines) and a rich feature space. RST offers a formal framework for hierarchical text organization with strong applications in discourse analysis and text generation. We demonstrate automated annotation of a text with RST hierarchically organised relations, with results comparable to those achieved by specially trained human annotators. Using a rich set of shallow lexical, syntactic and structural features from the input text, our parser achieves, in linear time, 73.9% of professional annotators' human agreement F-score. The parser is 5% to 12% more accurate than current state-of-the-art parsers.

EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · Advances in Human-Computer Interaction · · cited 83× · DOI ↗ · more like this ·

The 3D virtual world of “Second Life” imitates a form of real life by providing a space for rich interactions and social events. Second Life encourages people to establish or strengthen interpersonal relations, to share ideas, to gain new experiences, and to feel genuine emotions accompanying all adventures of virtual reality. Undoubtedly, emotions play a powerful role in communication. However, to trigger visual display of user's affective state in a virtual world, user has to manually assign appropriate facial expression or gesture to own avatar. Affect sensing from text, which enables automatic expression of emotions in the virtual environment, is a method to avoid manual control by the user and to enrich remote communications effortlessly. In this paper, we describe a lexical rule-based approach to recognition of emotions from text and an application of the developed Affect Analysis…

UAV-Based Situational Awareness System Using Deep Learning

Rúben Geraldes, Artur Gonçalves, Tin Lai +6 more

Computer Vision and Pattern Recognition · IEEE Access · · cited 80× · DOI ↗ · more like this ·

Situational awareness by Unmanned Aerial Vehicles (UAVs) is important for many applications such as surveillance, search and rescue, and disaster response. In those applications, detecting and locating people and recognizing their actions in near real-time can play a crucial role for preparing an effective response. However, there are currently three main limitations to perform this task efficiently. First, it is currently often not possible to access the live video feed from a UAV's camera due to limited bandwidth. Second, even if the video feed is available, monitoring and analyzing video over prolonged time is a tedious task for humans. Third, it is typically not possible to locate random people via their cellphones. Therefore, we developed the Person-Action-Locator (PAL), a novel UAV-based situational awareness system. The PAL system addresses the first issue by analyzing the video…

Recognition of Affect, Judgment, and Appreciation in Text

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · International Conference on Computational Linguistics · · cited 79× · OpenAlex ↗ · more like this ·

The main task we address in our research is classification of text using fine-grained attitude labels. The developed @AM system relies on the compositionality principle and a novel approach based on the rules elaborated for semantically distinct verb classes. The evaluation of our method on 1000 sentences, that describe personal experiences, showed promising results: average accuracy on the finegrained level (14 labels) was 62%, on the middle level (7 labels) – 71%, and on the top level (3 labels) – 88%. 1 Introduction and Related Work

SentiFul: Generating a reliable lexicon for sentiment analysis

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · · cited 74× · DOI ↗ · more like this ·

The main drawback of any lexicon-based sentiment analysis system is the lack of scalability. Thus, in this paper, we will describe methods to automatically generate and score a new sentiment lexicon, called SentiFul, and expand it through direct synonymy relations and morphologic modifications with known lexical units. We propose to distinguish four types of affixes (used to derive new words) depending on the role they play with regard to sentiment features: propagating, reversing, intensifying, and weakening.

Deep learning with RGB and thermal images onboard a drone for monitoring operations

Simon Speth, Artur Gonçalves, Bastien Rigault +4 more

Computer Vision and Pattern Recognition · Journal of Field Robotics · · cited 69× · DOI ↗ · more like this ·

Abstract This article describes the artificial intelligence (AI) component of a drone for monitoring and patrolling tasks associated with disaster relief missions in specific restricted disaster scenarios, as specified by the Advanced Robotics Foundation in Japan. The AI component uses deep learning models for environment recognition and object detection. For environment recognition, we use semantic segmentation, or pixel‐wise labeling, based on RGB images. Object detection is key for detecting and locating people in need. Since people are relatively small objects from the drone perspective, we use both RGB and thermal images. To train our models, we created a novel multispectral and publicly available data set of people. We used a geo‐location method to locate people on the ground. The semantic segmentation models were extensively tested using different feature extractors. We created…

Affective haptics in emotional communication

Dzmitry Tsetserukou, Alena Neviarouskaya, Helmut Prendinger +2 more

Sociology and Political Science · · cited 64× · DOI ↗ · more like this ·

In the paper we are proposing a conceptually novel approach to reinforcing (intensifying) own feelings and reproducing (simulating) the emotions felt by the partner during online communication through specially designed system, iFeel_IM!. The core component, Affect Analysis Model, automatically recognizes nine emotions from text. The detected emotion is stimulated by innovative haptic devices integrated into iFeel_IM!. The implemented system can considerably enhance emotionally immersive experience of real-time messaging.

SENTIMENT ASSESSMENT OF TEXT BY ANALYZING LINGUISTIC FEATURES AND CONTEXTUAL VALENCE ASSIGNMENT

Mostafa Al Masum Shaikh, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · Applied Artificial Intelligence · · cited 56× · DOI ↗ · more like this ·

Text is not only an important medium to describe facts and events, but also to effectively communicate information about the writer's positive or negative sentiment underlying an opinion, or to express an affective or emotional state, such as happiness, fearfulness, surpriseness, and so on. We consider sentiment assessment and emotion sensing from text as two different problems, whereby sentiment assessment is the task that we want to solve first. Thus, this article presents an approach to sentiment assessment, i.e., the recognition of negative or positive valence of a sentence. For the purpose of sentiment recognition from text, we perform semantic dependency analysis on the semantic verb frames of each sentence, and then apply a set of rules to each dependency relation to calculate the contextual valence of the whole sentence. By employing a domain-independent, rule-based approach our…

Detecting Human Actions in Drone Images Using YoloV5 and Stochastic Gradient Boosting

Tasweer Ahmad, Marc Cavazza, Yutaka Matsuo +1 more

Computer Vision and Pattern Recognition · Sensors · · cited 43× · DOI ↗ · more like this ·

Human action recognition and detection from unmanned aerial vehicles (UAVs), or drones, has emerged as a popular technical challenge in recent years, since it is related to many use case scenarios from environmental monitoring to search and rescue. It faces a number of difficulties mainly due to image acquisition and contents, and processing constraints. Since drones' flying conditions constrain image acquisition, human subjects may appear in images at variable scales, orientations, and occlusion, which makes action recognition more difficult. We explore low-resource methods for ML (machine learning)-based action recognition using a previously collected real-world dataset (the "Okutama-Action" dataset). This dataset contains representative situations for action recognition, yet is controlled for image acquisition parameters such as camera angle or flight altitude. We investigate a…

Automatic Generation of Multi-Modal Dialogue from Text Based on Discourse Structure Analysis

Helmut Prendinger, Paul Piwek, Mitsuru Ishizuka

Artificial Intelligence · International Conference on Semantic Computing (ICSC 2007) · · cited 34× · DOI ↗ · more like this ·

In this paper, we propose a novel method for generating engaging multi-modal content automatically from text. Rhetorical structure theory (RST) is used to decompose text into discourse units and to identify rhetorical discourse relations between them. Rhetorical relations are then mapped to question-answer pairs in an information preserving way, i.e., the original text and the resulting dialogue convey essentially the same meaning. Finally, the dialogue is "acted out" by two virtual agents. The network of dialogue structures automatically built up during this process, called DialogueNet, can be reused for other purposes, such as personalization or question-answering.

Multi-Agent Path Finding for UAV Traffic Management

Florence Ho, Ana Salta, Rúben Geraldes +3 more

Computer Vision and Pattern Recognition · Adaptive Agents and Multi-Agents Systems · · cited 28× · DOI ↗ · more like this ·

Unmanned aerial vehicles (UAVs) are expected to provide a wide range of services, whereby UAV fleets will be managed by several independent service providers in shared low-altitude airspace. One important element, or redundancy, for safe and efficient UAV operation is pre-flight Conflict Detection and Resolution (CDR) methods that generate conflict-free paths for UAVs before the actual flight. Multi-Agent Path Finding (MAPF) has already been successfully applied to comparable problems with ground robots. However, most MAPF methods were tested with simplifying assumptions which do not reflect important characteristics of many real-world domains, such as delivery by UAVs where heterogeneous agents need to be considered, and new requests for flight operations are received continuously. In this paper, we extend CBS and ECBS to efficiently incorporate heterogeneous agents with computational…

SEMANTICALLY DISTINCT VERB CLASSES INVOLVED IN SENTIMENT ANALYSIS

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · · cited 28× · OpenAlex ↗ · more like this ·

The paper describes a novel rule-based approach to classification of opinion statements on the level of individual sentences. In contrast to existing approaches, the proposed method relies on the rules elaborated for semantically distinct verb classes. To deeply analyse the type, strength, and confidence level of expressed opinion, the system relies on the compositionality principle and lexicon of sentiment-conveying terms, functional words, modifiers, and modal expressions. The method is capable of processing sentences of different complexity, including simple, compound, complex (with complement and relative clauses), and complex-compound sentences.

Eye movements as indices for the utility of life-like interface agents: A pilot study

Helmut Prendinger, Chunling Ma, Mitsuru Ishizuka

Human-Computer Interaction · Interacting with Computers · · cited 26× · DOI ↗ · more like this ·

We motivate an approach to evaluating the utility of life-like interface agents that is based on human eye movements rather than questionnaires. An eye tracker is employed to obtain quantitative evidence of a user’s focus of attention without distracting from the primary task. The salient feature of our evaluation strategy is that it allows us to measure important properties of a user’s interaction experience on a moment-by-moment basis in addition to a cumulative (spatial) analysis of the user’s areas of interest. We describe a pilot study in which we compare attending behavior of subjects watching the presentation of a computer-generated apartment layout and visualization augmented by three types of media: an animated agent, a text box, and speech only. The investigation of eye movements revealed that deictic gestures performed by the agent are more effective in directing the…

Evolving Social Relationships with Animate Characters

Helmut Prendinger, Mitsuru Ishizuka

Sociology and Political Science · · cited 23× · OpenAlex ↗ · more like this ·

In order to come across as life-like or animate, characters must change their attitudes (`evolve') as a consequence of their affective interaction histories with other agents. This paper describes a model of attitude and familiarity change that allows to model simple forms of evolving social relationships. We illustrate our model by means of two web-based interaction scenarios that feature animated characters in the role of comics-style actors.

Improving Sentiment Analysis with Document-Level Semantic Relationships from Rhetoric Discourse Structures

Joscha Märkle-Huß, Stefan Feuerriegel, Helmut Prendinger

Artificial Intelligence · Proceedings of the ... Annual Hawaii International Conference on System Sciences/Proceedings of the Annual Hawaii International Conference on System Sciences · · cited 21× · DOI ↗ · more like this ·

Conventional sentiment analysis usually neglects semantic information between (sub-)clauses, as it merely implements so-called bag-of-words approaches, where the sentiment of individual words is aggregated independently of the document structure. Instead, we advance sentiment analysis by the use of rhetoric structure theory (RST), which provides a hierarchical representation of texts at document level. For this purpose, texts are split into elementary discourse units (EDU). These EDUs span a hierarchical structure in the form of a binary tree, where the branches are labeled according to their semantic discourse. Accordingly, this paper proposes a novel combination of weighting and grid search to aggregate sentiment scores from the RST tree, as well as feature engineering for machine learning. We apply our algorithms to the especially hard task of predicting stock returns subsequent to…

Accurate Household Occupant Behavior Modeling Based on Data Mining Techniques

Márcia L. Baptista, Anjie Fang, Helmut Prendinger +2 more

Transportation · Proceedings of the AAAI Conference on Artificial Intelligence · · cited 21× · DOI ↗ · more like this ·

An important requirement of household energy simulation models is their accuracy in estimating energy demand and its fluctuations. Occupant behavior has a major impact upon energy demand. However, Markov chains, the traditional approach to model occupant behavior, (1) has limitations in accurately capturing the coordinated behavior of occupants and (2) is prone to over-fitting. To address these issues, we propose a novel approach that relies on a combination of data mining techniques. The core idea of our model is to determine the behavior of occupants based on nearest neighbor comparison over a database of sample data. Importantly, the model takes into account features related to the coordination of occupants' activities. We use a customized distance function suited for mixed categorical and numerical data. Further, association rule learning allows us to capture the coordination…

@AM: Textual Attitude Analysis Model

Alena Neviarouskaya, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · North American Chapter of the Association for Computational Linguistics · · cited 20× · OpenAlex ↗ · more like this ·

The automatic analysis and classification of text using fine-grained attitude labels is the main task we address in our research. The developed @AM system relies on compositionality principle and a novel approach based on the rules elaborated for semantically distinct verb classes. The evaluation of our method on 1000 sentences, that describe personal experiences, showed promising results: average accuracy on fine-grained level was 62%, on middle level - 71%, and on top level - 88%.

Emotion Sensitive News Agent: An Approach Towards User Centric Emotion Sensing from the News

Shaikh Mostafa Al Masum, Helmut Prendinger, Mitsuru Ishizuka

Artificial Intelligence · · cited 20× · DOI ↗ · more like this ·

This paper describes a character-based system called "Emotion Sensitive News Agent" (ESNA). ESNA is been developed as a news aggregator to fetch news from different news sources chosen by a user, and to categorize the themes of the news into eight emotion types. A small user study indicates that the system is conceived as intelligent and interesting as an affective interface. ESNA exemplifies a recent research agenda that aims at recognizing affective information conveyed through texts. News is an interesting application domain where user may have marked attitudes to certain events or entities reported about. Different approaches have already been employed to "sense" emotion from text. The novelty of our approach is twofold: affective information conveyed through text is analyzed (1) by considering the cognitive and appraisal structure of emotions, and (2) by taking into account user…