arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Erasmo Purificato

23 papers · 2021–2026

2021: 12022: 42023: 32024: 62025: 42026: 5
2021peak 6 in 20242026

Frequent co-authors

Papers

showing 1–23 of 23 RSS

Can We Trust AI Benchmarks? An Interdisciplinary Review of Current Issues in AI Evaluation

Maria Eriksson, Erasmo Purificato, Arman Noroozian +4 more

cs.AI · · cited 92× · arXiv ↗ · more like this ·

Quantitative Artificial Intelligence (AI) Benchmarks have emerged as fundamental tools for evaluating the performance, capability, and safety of AI models and systems. Currently, they shape the direction of AI development and are playing an increasingly prominent role in regulatory frameworks. As their influence grows, however, so too does concerns about how and with what effects they evaluate highly sensitive topics such as capabilities, including high-impact capabilities, safety and systemic risks. This paper presents an interdisciplinary meta-review of about 100 studies that discuss shortcomings in quantitative benchmarking practices, published in the last 10 years. It brings together many fine-grained issues in the design and application of benchmarks (such as biases in dataset creation, inadequate documentation, data contamination, and failures to distinguish signal from noise)…

User Modeling and User Profiling: A Comprehensive Survey

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

cs.AI · · cited 72× · arXiv ↗ · more like this ·

The integration of artificial intelligence (AI) into daily life, particularly through information retrieval and recommender systems, has necessitated advanced user modeling and profiling techniques to deliver personalized experiences. These techniques aim to construct accurate user representations based on the rich amounts of data generated through interactions with these systems. This paper presents a comprehensive survey of the current state, evolution, and future directions of user modeling and profiling research. We provide a historical overview, tracing the development from early stereotype models to the latest deep learning techniques, and propose a novel taxonomy that encompasses all active topics in this research area, including recent trends. Our survey highlights the paradigm shifts towards more sophisticated user profiling methods, emphasizing implicit data collection…

The Use of Responsible Artificial Intelligence Techniques in the Context of Loan Approval Processes

Erasmo Purificato, Flavio Lorenzo, Francesca Fallucchi +1 more

Artificial Intelligence · International Journal of Human-Computer Interaction · · cited 61× · DOI ↗ · more like this ·

Despite the existing skepticism about the use of automatic systems in contexts where human knowledge and experience are considered indispensable (e.g., the granting of a mortgage, the prediction of stock prices, or the detection of cancers), our work aims to show how the use of explainability and fairness techniques can lead to the growth of a domain expert’s trust and reliance on an artificial intelligence (AI) system. This article presents a system, applied to the context of loan approval processes, focusing on the two aforementioned ethical principles out of the four defined by the High-Level Expert Group on AI in the document “Ethics Guidelines for Trustworthy AI,” published in April 2019, in which the key requirements that AI systems should meet to be considered trustworthy are identified. The presented case study is realized within a proprietary framework composed of several…

Do Graph Neural Networks Build Fair User Models? Assessing Disparate Impact and Mistreatment in Behavioural User Profiling

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

Safety Research · Proceedings of the 31st ACM International Conference on Information & Knowledge Management · · cited 15× · DOI ↗ · more like this ·

Recent approaches to behavioural user profiling employ Graph Neural Networks (GNNs) to turn users' interactions with a platform into actionable knowledge. The effectiveness of an approach is usually assessed with accuracy-based perspectives, where the capability to predict user features (such as gender or age) is evaluated. In this work, we perform a beyond-accuracy analysis of the state-of-the-art approaches to assess the presence of disparate impact and disparate mistreatment, meaning that users characterised by a given sensitive feature are unintentionally, but systematically, classified worse than their counterparts. Our analysis on two real-world datasets shows that different user profiling paradigms can impact fairness results. The source code and the preprocessed datasets are available at: https://github.com/erasmopurif/do_gnns_build_fair_models.

Dynamic Privacy-Preserving Recommendations on Academic Graph Data

Erasmo Purificato, Sabine Wehnert, Ernesto William De Luca

Artificial Intelligence · Computers · · cited 13× · DOI ↗ · more like this ·

In the age of digital information, where the internet and social networks, as well as personalised systems, have become an integral part of everyone’s life, it is often challenging to be aware of the amount of data produced daily and, unfortunately, of the potential risks caused by the indiscriminate sharing of personal data. Recently, attention to privacy has grown thanks to the introduction of specific regulations such as the European GDPR. In some fields, including recommender systems, this has inevitably led to a decrease in the amount of usable data, and, occasionally, to significant degradation in performance mainly due to information no longer being attributable to specific individuals. In this article, we present a dynamic privacy-preserving approach for recommendations in an academic context. We aim to implement a personalised system capable of protecting personal data while at…

FairUP: A Framework for Fairness Analysis of Graph Neural Network-Based User Profiling Models

Mohamed Abdelrazek, Erasmo Purificato, Ludovico Boratto +1 more

Safety Research · UNICA IRIS Institutional Research Information System (University of Cagliari) · · cited 9× · DOI ↗ · more like this ·

Modern user profiling approaches capture different forms of interactions with the data, from user-item to user-user relationships. Graph Neural Networks (GNNs) have become a natural way to model these behaviours and build efficient and effective user profiles. However, each GNN-based user profiling approach has its own way of processing information, thus creating heterogeneity that does not favour the benchmarking of these techniques. To overcome this issue, we present FairUP, a framework that standardises the input needed to run three state-of-the-art GNN-based models for user profiling tasks. Moreover, given the importance that algorithmic fairness is getting in the evaluation of machine learning systems, FairUP includes two additional components to (1) analyse pre-processing and post-processing fairness and (2) mitigate the potential presence of unfairness in the original datasets…

Leveraging Graph Neural Networks for User Profiling: Recent Advances and Open Challenges

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

Artificial Intelligence · UNICA IRIS Institutional Research Information System (University of Cagliari) · · cited 8× · DOI ↗ · more like this ·

The proposed tutorial aims to familiarise the CIKM community with modern user profiling techniques that utilise Graph Neural Networks (GNNs). Initially, we will delve into the foundational principles of user profiling and GNNs, accompanied by an overview of relevant literature. We will subsequently systematically examine cutting-edge GNN architectures specifically developed for user profiling, highlighting the typical data utilised in this context. Furthermore, ethical considerations and beyond-accuracy perspectives, e.g. fairness and explainability, will be discussed regarding the potential applications of GNNs in user profiling. During the hands-on session, participants will gain practical insights into constructing and training recent GNN models for user profiling using open-source tools and publicly available datasets. The audience will actively explore the impact of these models…

Toward a Responsible Fairness Analysis: From Binary to Multiclass and Multigroup Assessment in Graph Neural Network-Based User Modeling Tasks

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

Safety Research · Minds and Machines · · cited 6× · DOI ↗ · more like this ·

Abstract User modeling is a key topic in many applications, mainly social networks and information retrieval systems. To assess the effectiveness of a user modeling approach, its capability to classify personal characteristics (e.g., the gender, age, or consumption grade of the users) is evaluated. Due to the fact that some of the attributes to predict are multiclass (e.g., age usually encompasses multiple ranges), assessing fairness in user modeling becomes a challenge since most of the related metrics work with binary attributes. As a workaround, the original multiclass attributes are usually binarized to meet standard fairness metrics definitions where both the target class and sensitive attribute (such as gender or age) are binary. However, this alters the original conditions, and fairness is evaluated on classes that differ from those used in the classification. In this article, we…

GNNFairViz: Visual Analysis for Graph Neural Network Fairness

Xinwu Ye, Jielin Feng, Erasmo Purificato +4 more

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

Recent advancements in Graph Neural Networks (GNNs) have demonstrated their potential for various applications, such as social networks and financial networks. However, they also exhibit fairness issues, particularly in human-related decision contexts, which may lead to unfair treatment of groups that have historically been subject to discrimination. While several visual analytics studies have explored fairness in machine learning (ML), few have tackled the specific challenges posed by GNNs. We propose a visual analytics framework designed to analyze GNN fairness, offering insights into how attribute and structural biases introduce model bias. Our framework is model-agnostic and tailored for real-world scenarios with multiple and multinary sensitive attributes, utilizing an extended suite of fairness metrics. To operationalize the framework, we develop GNNFairViz, a visual analysis tool…

You Don't Bring Me Flowers: Mitigating Unwanted Recommendations Through Conformal Risk Control

Giovanni De Toni, Erasmo Purificato, Emilia Gómez +3 more

cs.IR · · cited 2× · arXiv ↗ · more like this ·

Recommenders are significantly shaping online information consumption. While effective at personalizing content, these systems increasingly face criticism for propagating irrelevant, unwanted, and even harmful recommendations. Such content degrades user satisfaction and contributes to significant societal issues, including misinformation, radicalization, and erosion of user trust. Although platforms offer mechanisms to mitigate exposure to undesired content, these mechanisms are often insufficiently effective and slow to adapt to users' feedback. This paper introduces an intuitive, model-agnostic, and distribution-free method that uses conformal risk control to provably bound unwanted content in personalized recommendations by leveraging simple binary feedback on items. We also address a limitation of traditional conformal risk control approaches, i.e., the fact that the recommender can…

GNN’s FAME: Fairness-Aware MEssages for Graph Neural Networks

Erasmo Purificato, Hannan Javed Mahadik, Ludovico Boratto +1 more

Safety Research · · cited 2× · DOI ↗ · more like this ·

Graph Neural Networks (GNNs) have shown success in various domains but often inherit societal biases from training data, limiting their real-world applications.Historical data can contain patterns of discrimination related to sensitive attributes like age or gender.GNNs can even amplify these biases due to their topology and message-passing mechanism, where nodes with similar sensitive attributes tend to connect more frequently.While many studies have addressed algorithmic fairness in machine learning through pre-processing and post-processing techniques, few have focused on bias mitigation within the GNN training process.In this paper, we propose FAME (Fairness-Aware MEssages), an in-processing bias mitigation technique that modifies the GNN training's message-passing algorithm to promote fairness.By incorporating a bias correction term, the FAME layer adjusts messages based on the…

Tutorial on User Profiling with Graph Neural Networks and Related Beyond-Accuracy Perspectives

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

Artificial Intelligence · UNICA IRIS Institutional Research Information System (University of Cagliari) · · cited 2× · DOI ↗ · more like this ·

The proposed tutorial aims to introduce the UMAP community to modern user profiling approaches leveraging graph neural networks (GNNs). We will begin by discussing the conceptual foundations of user profiling and GNNs and providing a literature review of the two topics. We will then present a systematic overview of the state-of-the-art GNN architectures designed for user profiling, including the types of data that are typically used for this purpose. We will also discuss ethical considerations and beyond-accuracy perspectives (i.e. fairness and explainability), which can arise within the potential applications of adopting GNNs for user profiling. In the practical session of the tutorial, attendees will have the opportunity to understand concretely how recent GNN models for user profiling are built and trained with open-source tools and publicly available datasets. The audience will also…

First Workshop on Adaptive and Personalized Explainable User Interfaces (APEx-UI 2022)

Erasmo Purificato, Cataldo Musto, Pasquale Lops +1 more

Artificial Intelligence · · cited 2× · DOI ↗ · more like this ·

Adaptation and personalization are crucial aspects of the design and development of successful Artificial Intelligence systems, from search engines and recommender systems to wearable devices. The increased desire for customization inevitably leads to the need for the end-user to understand the rationale behind displaying that specific tailored content. User interfaces play a central role to provide the right explanations to the end-users. While adaptive and personalized user interfaces are well-known and advanced research fields, a common issue we face in terms of explainability is finding intelligent user interfaces following the one-fits-all paradigm without considering the different peculiarities of individuals.

Paradigm Shifts in User Modeling: A Journey from Historical Foundations to Emerging Trends

Erasmo Purificato, Ludovico Boratto, Ernesto William De Luca

Information Systems · UNICA IRIS Institutional Research Information System (University of Cagliari) · · cited 1× · DOI ↗ · more like this ·

The presented tutorial aims to serve as a comprehensive roadmap for the UMAP community into the current user modeling research, focusing on the paradigm shifts that have transformed the research landscape in recent times. We will provide a complete overview of the large, long-standing, and ever-growing research fields of user modeling and user profiling, both from a historical and a technical point of view. We will then examine the definitions associated with each key term in this research domain, aiming to eliminate ambiguity and confusion in their usage. As the core of our tutorial, we present in-depth the paradigm shifts that have occurred in recent years, especially due to technological evolution, as well as the current research directions and novel trends in the field. In particular, we illustrate and discuss the advances in the following topics: implicit and explicit user…

Beyond-Accuracy Perspectives on Graph Neural Network-Based Models for Behavioural User Profiling

Erasmo Purificato

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

The presented doctoral research aims to develop a behavioural user profiling framework focusing simultaneously on three beyond-accuracy perspectives: privacy, to study how to intervene on graph data structures of specific contexts and provide methods to make the data available in a meaningful manner without neither exposing personal user information nor corrupting the profiles creation and system performances; fairness, to provide user representations that are free of any inherited discrimination which could affect a downstream recommender by developing debiasing approaches to be applied on state-of-the-art GNN-based user profiling models; explainability, to produce understandable descriptions of the framework results, both for user profiles and recommendations, mainly in terms of interaction importance, by designing an adaptive and personalised user interface which provides tailored…

Balancing hierarchical representation and quantization: A performance trade-off in text embeddings

Kai Ponel, Marco Polignano, Erasmo Purificato +4 more

cs.CL · · cited 0× · arXiv ↗ · more like this ·

Hierarchical text embedding models offer variable-length representations, while quantization reduces numerical precision; both aim to improve computational efficiency. This work is an empirical benchmark study of how these two orthogonal, already-established techniques interact. We evaluate 38 tasks from the Massive Text Embedding Benchmark (MTEB) using four transformer-based embedding models, covering 1D and 2D hierarchical representations combined with 32-bit, 8-bit, and binary quantization, for 168 configurations per task. We report each efficiency dimension separately: theoretical per-vector storage and end-to-end evaluation time. Under a Friedman test with Nemenyi post-hoc analysis, int8 quantization is statistically indistinguishable from float32 for pair classification and re-ranking and costs at most 1.5 percentage points overall, whereas binary quantization is significantly…

Insurance as AI Risk Infrastructure: A Generative-Agent Simulation of AI Adoption

Yixuan Yuan, Dedai Wei, Chudong Qian +6 more

cs.MA · · cited 0× · arXiv ↗ · more like this ·

The rapid evolution of artificial intelligence (AI) tools has demonstrated immense potential to enhance societal well-being and operational efficiency. However, the inherent unreliability and uncertain operational consequences of modern AI systems, typified by large language models (LLMs), have created a significant barrier to enterprise adoption. Many enterprises remain hesitant to integrate these tools deeply into their workflows due to concerns about unpredictable losses and liability exposure. While existing technical safeguards primarily seek to reduce the likelihood or severity of AI-enabled workflow failures, they do not by themselves provide ex post financial protection when residual pecuniary tail losses materialize. In this paper, we introduce a socio-economic framework that complements these safeguards by transferring and absorbing the residual financial consequences of AI…

Towards Mitigating Unwanted Recommendations with Risk-Controlling Recommender Systems

Giovanni De Toni, Erasmo Purificato, Emília Gómez +3 more

Information Systems · ACM Transactions on Recommender Systems · · cited 0× · DOI ↗ · more like this ·

Recommender systems exert a profound influence on digital information consumption. Although they excel at content personalisation, recommenders are increasingly investigated for disseminating irrelevant, unwanted, or harmful suggestions. Such exposure diminishes user satisfaction and exacerbates broader societal challenges, including the spread of misinformation, radicalisation, and the systemic erosion of trust. While existing platforms provide tools to limit the disclosure of problematic content, these mechanisms often lack efficacy and fail to adapt dynamically to user input. This article presents an intuitive, model-agnostic, and distribution-free framework that employs conformal risk control to provide statistical guarantees regarding unwanted content in personalised feeds. By leveraging simple feedback, our method ensures that the risk of encountering undesirable items is provably…

From Modeling and Profiling to Auditing: the Evolving Role of the User in Recommender System Research

Lorenzo Porcaro, Erasmo Purificato

Information Systems · IRIS Research product catalog (Sapienza University of Rome) · · cited 0× · DOI ↗ · more like this ·

The tutorial offers the UMAP community a structured journey from traditional user modeling to algorithmic auditing of recommender systems, examining how the field’s conceptual foundations have evolved and where its boundaries remain contested. We begin with a retrospective on the established fields of user profiling and modeling, covering both their historical origins and the technical milestones that have shaped how user preferences are captured and exploited by personalized systems. We then analyze the evolving conceptual framework and terminology of the field to resolve ambiguities regarding the interpretation of key notions. As the core of the tutorial, we examine the recent shift from passive profiling toward participatory auditing frameworks, where users actively engage in surfacing biases and systemic harms in recommender systems. Specifically, we discuss advancements in the…

With a Little Help From My Friends: Collective Manipulation in Risk-Controlling Recommender Systems

Giovanni De Toni, Cristian Consonni, Erasmo Purificato +2 more

cs.IR · · cited 0× · arXiv ↗ · more like this ·

Recommendation systems have become central gatekeepers of online information, shaping user behaviour across a wide range of activities. In response, users increasingly organize and coordinate to steer algorithmic outcomes toward diverse goals, such as promoting relevant content or limiting harmful material, relying on platform affordances -- such as likes, reviews, or ratings. While these mechanisms can serve beneficial purposes, they can also be leveraged for adversarial manipulation, particularly in systems where such feedback directly informs safety guarantees. In this paper, we study this vulnerability in recently proposed risk-controlling recommender systems, which use binary user feedback (e.g., "Not Interested") to provably limit exposure to unwanted content via conformal risk control. We empirically demonstrate that their reliance on aggregate feedback signals makes them…

Data Access for Recommender Systems Research: leveraging the EU’s Digital Services Act

João Vinagre, Lorenzo Porcaro, Silvia Merisio +2 more

Sociology and Political Science · IRIS Research product catalog (Sapienza University of Rome) · · cited 0× · DOI ↗ · more like this ·

The European Union (EU) Digital Services Act (DSA) has introduced a novel set of rules for online platforms and search engines, with significant implications for the Recommender Systems community. Through its data access mechanisms, the DSA invites researchers to request both publicly available and private data from Very Large Online Platforms (VLOPs) and Very Large Search Engines (VLOSEs) – those with more than 45 million active recipients in the EU – to investigate systemic risks associated with the dissemination of illegal content, risks to the exercise of fundamental rights, and negative effects on electoral processes, public health, and gender-based violence. This tutorial is aimed at researchers who are interested in submitting such data access requests and will provide them with the knowledge to do so by introducing the relevant definitions and provisions of the DSA, and…

How Fair is Your Diffusion Recommender Model?

Daniele Malitesta, Giacomo Medda, Erasmo Purificato +3 more

cs.IR · · cited 0× · arXiv ↗ · more like this ·

Diffusion-based learning has settled as a rising paradigm in generative recommendation, outperforming traditional approaches built upon variational autoencoders and generative adversarial networks. Despite their effectiveness, concerns have been raised that diffusion models - widely adopted in other machine-learning domains - could potentially lead to unfair outcomes, since they are trained to recover data distributions that often encode inherent biases. Motivated by the related literature, and acknowledging the extensive discussion around bias and fairness aspects in recommendation, we propose, to the best of our knowledge, the first empirical study of fairness for DiffRec, chronologically the pioneer technique in diffusion-based recommendation. Our empirical study involves DiffRec and its variant L-DiffRec, tested against nine recommender systems on two benchmarking datasets to assess…

Report on the 1st International Workshop on Graph-Based Approaches in Information Retrieval (IRonGraphs 2024) at ECIR 2024

Ludovico Boratto, Daniele Malitesta, Mirko Marras +3 more

Artificial Intelligence · ACM SIGIR Forum · · cited 0× · DOI ↗ · more like this ·

The First International Workshop on Graph-Based Approaches in Information Retrieval (IRonGraphs 2024) was held as a physical (in-person) event on March 24, 2024, in conjunction with the 46th European Conference on Information Retrieval (ECIR 2024) in Glasgow (Scotland). The scientific program included paper, spotlight, and poster presentations. Two keynote talks were delivered by Francesco Fabbri (Spotify, Spain) and Ruihong Qiu (University of Queensland, Australia). This report presents an overview of the activities conducted during the workshop and the main topics covered. Date : 24 March 2024. Website : https://irongraphs.github.io/ecir2024/.