arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mathieu Chollet

32 papers · 2011–2026

2011: 12012: 02013: 32014: 32015: 12016: 12017: 22018: 12019: 22020: 12021: 02022: 02023: 32024: 42025: 82026: 2
2011peak 8 in 20252026

Frequent co-authors

Papers

showing 1–25 of 32 RSS

Affect-LM: A Neural Language Model for Customizable Affective Text Generation

Sayan Ghosh, Mathieu Chollet, Eugene Laksana +2 more

cs.CL · · cited 199× · arXiv ↗ · more like this ·

Human verbal communication includes affective messages which are conveyed through use of emotionally colored words. There has been a lot of research in this direction but the problem of integrating state-of-the-art neural language models with affective information remains an area ripe for exploration. In this paper, we propose an extension to an LSTM (Long Short-Term Memory) language model for generating conversational text, conditioned on affect categories. Our proposed model, Affect-LM enables us to customize the degree of emotional content in generated sentences through an additional design parameter. Perception studies conducted using Amazon Mechanical Turk show that Affect-LM generates naturally looking emotional sentences without sacrificing grammatical correctness. Affect-LM also learns affect-discriminative word representations, and perplexity experiments show that additional…

Multimodal Public Speaking Performance Assessment

Torsten Wörtwein, Mathieu Chollet, Boris Schauerte +3 more

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 77× · DOI ↗ · more like this ·

The ability to speak proficiently in public is essential for many professions and in everyday life. Public speaking skills are difficult to master and require extensive training. Recent developments in technology enable new approaches for public speaking training that allow users to practice in engaging and interactive environments. Here, we focus on the automatic assessment of nonverbal behavior and multimodal modeling of public speaking behavior. We automatically identify audiovisual nonverbal behaviors that are correlated to expert judges' opinions of key performance aspects. These automatic assessments enable a virtual audience to provide feedback that is essential for training during a public speaking performance. We utilize multimodal ensemble tree learners to automatically approximate expert judges' evaluations to provide post-hoc performance assessments to the speakers. Our…

Influence of Individual Differences when Training Public Speaking with Virtual Audiences

Mathieu Chollet, Pranav Ghate, Catherine Neubauer +1 more

Human-Computer Interaction · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 27× · DOI ↗ · more like this ·

Multimodal interaction technologies have enabled new applications for training interpersonal skills such as public speaking. Various training paradigms have been proposed, most of them relying on some form of graphical feedback provided to the trainee in real-time during their training or after training using an after-action review tool. Another paradigm consists of using virtual characters to provide feedback through their behavior during simulated social interactions. Preliminary studies have started to explore the effectiveness of these different training paradigms; however, these have not investigated the impact of individual differences on which interaction paradigm is more efficient or motivating for different populations of users. In this article, we explore the impact of personality, public speaking anxiety, and immersive tendencies on the experiences of users training public…

Investigating the Impact of Multimodal Feedback on User-Perceived Latency and Immersion with LLM-Powered Embodied Conversational Agents in Virtual Reality

Morad Elfleet, Mathieu Chollet

Human-Computer Interaction · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · · cited 14× · DOI ↗ · more like this ·

Our research investigates the impact of latency on presence and immersion in virtual reality (VR) environments, focusing on interactions with LLM-powered Embodied Conversational Agents (ECAs). We explore the effectiveness of multimodal feedback strategies—including filled pauses, nonverbal turn-taking behaviours, and visual feedback—in mitigating perceived latency. Eighteen participants were subjected to both a baseline condition, without feedback interventions, and a feedback-enhanced condition. Our findings indicate that the feedback condition significantly improved the sense of presence and immersion. We also found that perceived response time and users’ impressions of the agents improved, thereby increasing willingness for future interactions. Additionally, chatbot experience positively correlated with agent likeability, whereas VR experience showed no significant correlation. These…

A Methodology for the Automatic Extraction and Generation of Non-Verbal Signals Sequences Conveying Interpersonal Attitudes

Mathieu Chollet, Magalie Ochs, Catherine Pélachaud

Artificial Intelligence · IEEE Transactions on Affective Computing · · cited 12× · DOI ↗ · more like this ·

In many applications, Embodied Conversational Agents (ECAs) must be able to express various affects such as emotions or social attitudes. Non-verbal signals, such as smiles or gestures, contribute to the expression of attitudes. Social attitudes affect the whole behavior of a person: they are “characteristic of an affective style that colors the entire interaction” [1] . Moreover, recent findings have demonstrated that non-verbal signals are not interpreted in isolation but along with surrounding signals. Non-verbal behavior planning models designed to allow ECAs to express attitudes should thus consider complete sequences of non-verbal signals and not only signals independently of one another. However, existing models do not take this into account, or in a limited manner. The contribution of this paper is a methodology for the automatic extraction of sequences of non-verbal signals…

Native vs. non-native language fluency implications on multimodal interaction for interpersonal skills training

Mathieu Chollet, Helmut Prendinger, Stefan Scherer

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 10× · DOI ↗ · more like this ·

New technological developments in the field of multimodal interaction show great promise for the improvement and assessment of public speaking skills. However, it is unclear how the experience of non-native speakers interacting with such technologies differs from native speakers. In particular, non-native speakers could benefit less from training with multimodal systems compared to native speakers. Additionally, machine learning models trained for the automatic assessment of public speaking ability on data of native speakers might not be performing well for assessing the performance of non-native speakers. In this paper, we investigate two aspects related to the performance and evaluation of multimodal interaction technologies designed for the improvement and assessment of public speaking between a population of English native speakers and a population of non-native English speakers.…

Towards Narrative-Driven Atmosphere for Virtual Classrooms

Jean-Luc Lugrin, Anne-Gwenn Bosser, Marc Erich Latoschik +3 more

Human-Computer Interaction · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · · cited 9× · DOI ↗ · more like this ·

In this paper, we propose the integration of audience atmosphere generation techniques into Interactive Storytelling (IS) engines to obtain more realistic and variable Virtual Reality (VR) training systems. We outline a number of advantages of this novel combination compared to current atmosphere generation techniques. The features of recent IS engines can be extended to automatically adapt the atmosphere produced by a group of virtual humans in response to user intervention while staying coherent with the unfolding story of the training scenario. This work is currently being developed in the context of a VR training for teachers, in which they learn to manage a difficult classroom under the guidance of an instructor.

Beyond Mute and Block: Adoption and Effectiveness of Safety Tools in Social VR, from Ubiquitous Harassment to Social Sculpting

Maheshya Weerasinghe, Shaun Macdonald, Cristina Fiani +4 more

Human-Computer Interaction · IEEE Transactions on Visualization and Computer Graphics · · cited 6× · DOI ↗ · more like this ·

Harassment in Social Virtual Reality (SVR) is a growing concern. The current SVR landscape features inconsistent access to non-standardised safety features, with minimal empirical evidence on their real-world effectiveness, usage and impact. We examine the use and effectiveness of safety tools across 12 popular SVR platforms by surveying 100 users about their experiences of different types of harassment and their use of features like muting, blocking, personal spaces and safety gestures. While harassment remained common-including hate speech, virtual stalking, and physical harassment-many find safety features insufficient or inconsistently applied. Reactive tools like muting and blocking are widely used, largely driven by users' familiarity from other platforms. Safety tools are also used to proactively curate individual virtual experiences, protecting users from harassment, but…

A Scalability Benchmark for a Virtual Audience Perception Model in Virtual Reality

Yann Glémarec, Anne-Gwenn Bosser, Cédric Buche +4 more

Human-Computer Interaction · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 5× · DOI ↗ · more like this ·

In this paper, we describe the implementation and performance of a Virtual Audience perception model for Virtual Reality (VR). The model is a VR adaptation of an existing desktop model. The system allows a user in VR to easily build and experience a wide variety of atmospheres with small or large groups of virtual agents.The paper describes results of early evaluations for this model in VR. Our first scalability benchmark results demonstrated the ability to simultaneously handle one hundred virtual agents without significantly affecting there commended frame rate for VR applications.This research is conducted in the context of a classroom simulation software for teachers’ training.

Understanding Social Interactions in Reality Versus Virtuality

Aurélien Léchappé, Ross Johnstone, Aurélien Milliat +3 more

Sociology and Political Science · ENLIGHTEN (Jurnal Bimbingan dan Konseling Islam) · · cited 4× · DOI ↗ · more like this ·

Immersive realities enable social interactions that are radically different from traditional communication technologies, but how we experience immersion together is not yet indistinguishable from face-to-face interactions. Some social signals are not stable across realities, may change in semantics, or are missing all together. Understanding how social signals impact behaviours and experiences of social connection in immersive environments is key to creating experiences that are meaningful, satisfying, and productive. We completed a lab study where 6 groups of 6 participants (N=36) completed co-located social tasks in an instrumented face-to-face environment and its digital twin, creating a rich open dataset of 1.8 million rows across 45 columns. Our quantitative results demonstrate the stability of position as a social signal, measure lower social synchronisation in XR compared to…

Social Presence Mediates Audience Behavior Effects on Social Stress in Virtual Public Speaking

Celia Kessassi, Mathieu Chollet, Cédric Dumas +1 more

Human-Computer Interaction · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 4× · DOI ↗ · more like this ·

Public speaking is a near universally anxiety inducing social situation. Applications recreating social interactions with autonomous agents in virtual reality have been proposed as tools to alleviate public speaking anxiety, recreating exposure therapy methods with virtual audiences. To be efficient, such applications rely on the precise induction of controlled amounts of social stress. We reviewed the literature that studied the effect of virtual audience behaviors on participants’ stress levels, and found contradictory results that we attempt to explain in this article. We examine those studies and propose that social presence is one of the important factors mediating the effect of audience behavior on stress levels, and through social presence we can explain the different effects of audience behavior on stress observed in past studies. We conducted a study to test this theory, and…

EARN Fairness: Explaining, Asking, Reviewing, and Negotiating Artificial Intelligence Fairness Metrics Among Stakeholders

Lin Luo, Yuri Nakao, Mathieu Chollet +2 more

cs.AI · · cited 3× · arXiv ↗ · more like this ·

Numerous fairness metrics have been proposed and employed by artificial intelligence (AI) experts to quantitatively measure bias and define fairness in AI models. Recognizing the need to accommodate stakeholders' diverse fairness understandings, efforts are underway to solicit their input. However, conveying AI fairness metrics to stakeholders without AI expertise, capturing their personal preferences, and seeking a collective consensus remain challenging and underexplored. To bridge this gap, we propose a new framework, EARN Fairness, which facilitates collective metric decisions among stakeholders without requiring AI expertise. The framework features an adaptable interactive system and a stakeholder-centered EARN Fairness process to Explain fairness metrics, Ask stakeholders' personal metric preferences, Review metrics collectively, and Negotiate a consensus on metric selection. To…

Introducing the 3MT_French dataset to investigate the timing of public speaking judgements

Béatrice Biancardi, Mathieu Chollet, Chloé Clavel

Signal Processing · Language Resources and Evaluation · · cited 3× · DOI ↗ · more like this ·

Abstract In most public speaking datasets, judgements are given after watching the entire performance, or on thin slices randomly selected from the presentations, without focusing on the temporal location of these slices. This does not allow to investigate how people’s judgements develop over time during presentations. This contrasts with primacy and recency theories, which suggest that some moments of the speech could be more salient than others and contribute disproportionately to the perception of the speaker’s performance. To provide novel insights on this phenomenon, we present the 3MT_French dataset. It contains a set of public speaking annotations collected on a crowd-sourcing platform through a novel annotation scheme and protocol. Global evaluation, persuasiveness, perceived self-confidence of the speaker and audience engagement were annotated on different time windows (i.e.…

Investigating the Influence of Sound Design for Inducing Anxiety in Virtual Public Speaking

Enora Gabory, Mathieu Chollet

Human-Computer Interaction · Companion Publication of the 2020 International Conference on Multimodal Interaction · · cited 2× · DOI ↗ · more like this ·

Virtual reality has demonstrated successful outcomes for treating social anxiety disorders, or helping to improve social skills. Some studies showed that various factors can impact the level of participants' anxiety during public speaking. However, the influence of sound design on this anxiety has been less investigated, and it is necessary to study the possible impacts that it can have. In this paper, we propose a model relating sound design concepts to presence and anxiety during virtual reality interactions, and present a protocol of a future experimental study aimed at investigating how sound design and in particular sound distractions can influence anxiety during public speaking simulations in virtual environments.

"I think this is fair": Uncovering the Complexities of Stakeholder Decision-Making in AI Fairness Assessment

Lin Luo, Yuri Nakao, Mathieu Chollet +2 more

cs.AI · · cited 1× · arXiv ↗ · more like this ·

Assessing fairness in artificial intelligence (AI) typically involves AI experts who select protected features, fairness metrics, and set fairness thresholds to assess outcome fairness. However, little is known about how stakeholders, particularly those affected by AI outcomes but lacking AI expertise, assess fairness. To address this gap, we conducted a qualitative study with 26 stakeholders without AI expertise, representing potential decision subjects in a credit rating scenario, to examine how they assess fairness when placed in the role of deciding on features with priority, metrics, and thresholds. We reveal that stakeholders' fairness decisions are more complex than typical AI expert practices: they considered features far beyond legally protected features, tailored metrics for specific contexts, set diverse yet stricter fairness thresholds, and even preferred designing…

Probing Experts' Perspectives on AI-Assisted Public Speaking Training

Nesrine Fourati, Alisa Barkar, Marion Dragée +2 more

cs.HC · · cited 0× · arXiv ↗ · more like this ·

Background: Public speaking is a vital professional skill, yet it remains a source of significant anxiety for many individuals. Traditional training relies heavily on expert coaching, but recent advances in AI has led to novel types of commercial automated public speaking feedback tools. However, most research has focused on prototypes rather than commercial applications, and little is known about how public speaking experts perceive these tools. Objectives: This study aims to evaluate expert opinions on the efficacy and design of commercial AI-based public speaking training tools and to propose guidelines for their improvement. Methods: The research involved 16 semi-structured interviews and 2 focus groups with public speaking experts. Participants discussed their views on current commercial tools, their potential integration into traditional coaching, and suggestions for enhancing…

The Anatomy of Speech Persuasion: Linguistic Shifts in LLM-Modified Speeches

Alisa Barkar, Mathieu Chollet, Matthieu Labeau +2 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

This study examines how large language models understand the concept of persuasiveness in public speaking by modifying speech transcripts from PhD candidates in the "Ma These en 180 Secondes" competition, using the 3MT French dataset. Our contributions include a novel methodology and an interpretable textual feature set integrating rhetorical devices and discourse markers. We prompt GPT-4o to enhance or diminish persuasiveness and analyze linguistic shifts between original and generated speech in terms of the new features. Results indicate that GPT-4o applies systematic stylistic modifications rather than optimizing persuasiveness in a human-like manner. Notably, it manipulates emotional lexicon and syntactic structures (such as interrogative and exclamatory clauses) to amplify rhetorical impact.

Robust Understanding of Human-Robot Social Interactions through Multimodal Distillation

Tongfei Bian, Mathieu Chollet, Tanaya Guha

cs.RO · · cited 0× · arXiv ↗ · more like this ·

There is a growing need for social robots and intelligent agents that can effectively interact with and support users. For the interactions to be seamless, the agents need to analyse social scenes and behavioural cues from their (robot's) perspective. Works that model human-agent interactions in social situations are few; and even those existing ones are computationally too intensive to be deployed in real time or perform poorly in real-world scenarios when only limited information is available. We propose a knowledge distillation framework that models social interactions through various multimodal cues, and yet is robust against incomplete and noisy information during inference. We train a teacher model with multimodal input (body, face and hand gestures, gaze, raw images) that transfers knowledge to a student model which relies solely on body pose. Extensive experiments on two…

9th Edition of IEEE VR Workshop: Virtual Humans and Crowds in Immersive Environments (VHCIE)

Andrea Bönsch, Mathieu Chollet, Jordan Martin +2 more

Human-Computer Interaction · · cited 0× · DOI ↗ · more like this ·

The VHCIE workshop aims to explore and advance the creation of believable virtual humans and crowds within immersive virtual environments (IVEs). With the emergence of various tools, algorithms, and systems, it is now possible to design realistic virtual characters - known as virtual agents (VAs) - that can populate expansive environments with thousands of individuals. These sophisticated crowd simulations facilitate dynamic interactions among the VAs themselves and between VAs and virtual reality (VR) users.

Interact with me: Joint Egocentric Forecasting of Intent to Interact, Attitude and Social Actions

Tongfei Bian, Yiming Ma, Mathieu Chollet +2 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

For efficient human-agent interaction, an agent should proactively recognize their target user and prepare for upcoming interactions. We formulate this challenging problem as the novel task of jointly forecasting a person's intent to interact with the agent, their attitude towards the agent and the action they will perform, from the agent's (egocentric) perspective. So we propose \emph{SocialEgoNet} - a graph-based spatiotemporal framework that exploits task dependencies through a hierarchical multitask learning approach. SocialEgoNet uses whole-body skeletons (keypoints from face, hands and body) extracted from only 1 second of video input for high inference speed. For evaluation, we augment an existing egocentric human-agent interaction dataset with new class labels and bounding box annotations. Extensive experiments on this augmented dataset, named JPL-Social, demonstrate…

Insights Into the Importance of Linguistic Textual Features on the Persuasiveness of Public Speaking

Alisa Barkar, Mathieu Chollet, Béatrice Biancardi +1 more

Human-Computer Interaction · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 0× · DOI ↗ · more like this ·

There is a growing need for public speaking skills in both professional and private life. With this background, our research project’s long-term aims are to develop tools that can analyse public speeches and provide helpful feedback. The impact of audio and visual characteristics on the automatic analysis of speech quality has been widely explored in the existing literature. However, only a few studies have focused on textual features. In response to this shortcoming, this paper investigates the importance of textual content for the automatic analysis of public speaking. We created an open-source Python library of textual features and integrated them as inputs of simple machine-learning models for automatic public-speaking analysis, and persuasiveness prediction, in particular. The best result (accuracy of ) is obtained using a logistic regression. We then evaluated the impact of these…

Virtually Stressed: Interaction Between Display System and Virtual Agent Behaviour VR

Celia Kessassi, Mathieu Chollet, Cédric Dumas +1 more

Human-Computer Interaction · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 0× · OpenAlex ↗ · more like this ·

come from teaching and research institutions in France or abroad, or from public or private research centers.L'archive ouverte pluridisciplinaire HAL, est destine au dpt et la diffusion de documents scientifiques de niveau recherche, publis ou non, manant des tablissements d'enseignement et de recherche franais ou trangers, des laboratoires publics ou privs.

Automated Camera Planner for Film Editing Using Key Shots

Christophe Lino, Mathieu Chollet, Marc Christie +9 more

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 0× · OpenAlex ↗ · more like this ·

HAL is a multi-disciplinary open access archive for the deposit and dissemination of sci-entific research documents, whether they are pub-lished or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L’archive ouverte pluridisciplinaire HAL, est destinée au dépôt et a ̀ la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d’enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.