arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jan Simson

13 papers · 2012–2026

2012: 12013: 02014: 02015: 02016: 02017: 02018: 02019: 12020: 02021: 02022: 02023: 32024: 22025: 32026: 3
2012peak 3 in 20232026

Frequent co-authors

Papers

showing 1–13 of 13 RSS

Lazy Data Practices Harm Fairness Research

Jan Simson, Alessandro Fabris, Christoph Kern

cs.LG · · cited 23× · arXiv ↗ · more like this ·

Data practices shape research and practice on fairness in machine learning (fair ML). Critical data studies offer important reflections and critiques for the responsible advancement of the field by highlighting shortcomings and proposing recommendations for improvement. In this work, we present a comprehensive analysis of fair ML datasets, demonstrating how unreflective yet common practices hinder the reach and reliability of algorithmic fairness findings. We systematically study protected information encoded in tabular datasets and their usage in 280 experiments across 142 publications. Our analyses identify three main areas of concern: (1) a \textbf{lack of representation for certain protected attributes} in both data and evaluations; (2) the widespread \textbf{exclusion of minorities} during data preprocessing; and (3) \textbf{opaque data processing} threatening the generalization of…

One Model Many Scores: Using Multiverse Analysis to Prevent Fairness Hacking and Evaluate the Influence of Model Design Decisions

Jan Simson, Florian Pfisterer, Christoph Kern

stat.ML · · cited 9× · arXiv ↗ · more like this ·

A vast number of systems across the world use algorithmic decision making (ADM) to (partially) automate decisions that have previously been made by humans. The downstream effects of ADM systems critically depend on the decisions made during a systems' design, implementation, and evaluation, as biases in data can be mitigated or reinforced along the modeling pipeline. Many of these decisions are made implicitly, without knowing exactly how they will influence the final system. To study this issue, we draw on insights from the field of psychology and introduce the method of multiverse analysis for algorithmic fairness. In our proposed method, we turn implicit decisions during design and evaluation into explicit ones and demonstrate their fairness implications. By combining decisions, we create a grid of all possible "universes" of decision combinations. For each of these universes, we…

Bright: an augmented reality assistive platform for visual impairment

Ashish M. Bakshi, Jan Simson, Cesar de Castro +2 more

Human-Computer Interaction · · cited 9× · DOI ↗ · more like this ·

283 million people suffer from moderate to severe vision impairment or blindness; many today rely on lens-based optical aids of limited use. Electronic pass-through zoom headsets are extremely expensive and provide narrow feature sets with compromised comfort and ease-of-use, while mobile app-based aids provide useful functionality but in an inconvenient form factor. The present project explores the development of an aid for the visually impaired, designed as a software solution running on off-the-shelf optical see-through augmented reality head-mounted display devices such as the Microsoft HoloLens, to deliver a broad feature set while reducing cost and optimizing comfort and usability.

Preventing Harmful Data Practices by using Participatory Input to Navigate the Machine Learning Multiverse

Jan Simson, Fiona Draxler, Samuel A. Mehr +1 more

Safety Research · MADOC (University of Mannheim) · · cited 3× · DOI ↗ · more like this ·

In light of inherent trade-offs regarding fairness, privacy, interpretability and performance, as well as normative questions, the machine learning (ML) pipeline needs to be made accessible for public input, critical reflection and engagement of diverse stakeholders.In this work, we introduce a participatory approach to gather input from the general public on the design of an ML pipeline. We show how people’s input can be used to navigate and constrain the multiverse of decisions during both model development and evaluation. We highlight that central design decisions should be democratized rather than “optimized” to acknowledge their critical impact on the system’s output downstream. We describe the iterative development of our approach and its exemplary implementation on a citizen science platform. Our results demonstrate how public participation can inform critical design decisions…

Using Multiverse Analysis to Evaluate the Influence of Model Design Decisions on Algorithmic Fairness

Jan Simson, Florian Pfisterer, Christoph Kern

Safety Research · Frontiers in artificial intelligence and applications · · cited 2× · DOI ↗ · more like this ·

A vast number of systems across the world currently use algorithmic decision making (ADM) to augment human decision making or even automate decisions that have previously been done by humans. When designed well, these systems promise both more accurate and more efficient decisions all the while saving large amounts of resources and freeing up human time. When ADM systems are not designed well, however, they can lead to unfair algorithms which discriminate against societal groups under the guise of objectivity and legitimacy. Whether systems are ultimately fair or not typically depends on the decisions made during the systems’ design. It is therefore important to properly understand the decisions that go into the design of ADM systems and how these decisions affect the fairness of the resulting system. To study this, we introduce the method of multiverse analysis for algorithmic…

Cracking the Code: Evaluating Zero-Shot Prompting Methods for Providing Programming Feedback

Niklas Ippisch, Anna-Carolina Haensch, Jan Simson +3 more

cs.SE · · cited 1× · arXiv ↗ · more like this ·

Despite the growing use of large language models (LLMs) for providing feedback, limited research has explored how to achieve high-quality feedback. This case study introduces an evaluation framework to assess different zero-shot prompt engineering methods. We varied the prompts systematically and analyzed the provided feedback on programming errors in R. The results suggest that prompts suggesting a stepwise procedure increase the precision, while omitting explicit specifications about which provided data to analyze improves error identification.

Pinpointing Pivot Points: The DECIDE Framework for Data Analysis Decision Importances

Zachary T. Rewolinski, Jan Simson, Frauke Kreuter +2 more

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Human judgment calls made throughout the data science life cycle can change the conclusions drawn from data. Independent analysts often make different choices when given the same data, leading to often unacceptable variations in results and contributing to the ongoing reproducibility crisis across scientific disciplines. The rapid adoption of agentic tools threatens to amplify this crisis. Several approaches have been developed to address this variation by following the same strategy: repeating an analysis under different combinations of analytical decisions and inspecting the distribution of outcomes. Examples include multiverse analysis, specification curve analysis, and vibration of effects. More broadly, the Predictability-Computability-Stability (PCS) framework assesses how documented judgment calls across the data science life cycle affect conclusions, with predictability serving…

Bias Begins with Data: The FairGround Corpus for Robust and Reproducible Research on Algorithmic Fairness

Jan Simson, Alessandro Fabris, Cosima Fröhner +2 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

As machine learning (ML) systems are increasingly adopted in high-stakes decision-making domains, ensuring fairness in their outputs has become a central challenge. At the core of fair ML research are the datasets used to investigate bias and develop mitigation strategies. Yet, much of the existing work relies on a narrow selection of datasets--often arbitrarily chosen, inconsistently processed, and lacking in diversity--undermining the generalizability and reproducibility of results. To address these limitations, we present FairGround: a unified framework, data corpus, and Python package aimed at advancing reproducible research and critical data studies in fair ML classification. FairGround currently comprises 44 tabular datasets, each annotated with rich fairness-relevant metadata. Our accompanying Python package standardizes dataset loading, preprocessing, transformation, and…

Decoupling Data and Tooling in Interactive Visualization

Jan Simson

cs.HC · · cited 0× · arXiv ↗ · more like this ·

Interactive data visualization is a major part of modern exploratory data analysis, with web-based technologies enabling a rich ecosystem of both specialized and general tools. However, current visualization tools often lack support for transformation or wrangling of data and are forced to re-implement their own solutions to load and ingest data. This redundancy creates substantial development overhead for tool creators, steeper learning curves for users who must master different data handling interfaces across tools and a degraded user experience as data handling is usually seen as an after-thought. We propose a modular approach that separates data wrangling and loading capabilities from visualization components. This architecture allows visualization tools to concentrate on their core strengths while providing the opportunity to develop a unified, powerful interface for data handling.…

occupationMeasurement: A Comprehensive Toolbox forInteractive Occupation Coding in Surveys

Jan Simson, Olga Kononykhina, Malte Schierholz

Sociology and Political Science · The Journal of Open Source Software · · cited 0× · DOI ↗ · more like this ·

People earn a living a multitude of ways which is why the occupations they pursue are almost as diverse as people themselves.This makes quantitative analyses of free-text occupational responses from surveys hard to impossible, especially since people may refer to the same occupations with different terms.To address this problem, a variety of different classifications have been developed, such as the International Standard Classification of Occupations 2008 (ISCO) (ILO, 2012) and the German Klassifikation der Berufe 2010 (KldB) (Bundesagentur für Arbeit, 2011), narrowing down the amount of occupation categories into more manageable numbers in the mid hundreds to low thousands and introducing a hierarchical ordering of categories.This leads to a different problem, however: Coding occupations into these standardized categories is usually expensive, time-intensive and plagued by issues of…

A Relational Database for Text-Critical Studies

Wojciech Jan Simson

Anthropology · · cited 0× · OpenAlex ↗ · more like this ·

After a brief introduction to the scope of a project digitizing the Confucian Analects and a short explanation of the working principles of relational databases in general the architecture of the actual relational database used in the project is outlined. The database was designed to store, classify, compare and sort textual variants and to handle a considerable number of textual witnesses in such a way that strains of transmission could be compared with one another. Some attention is also paid to the handling of problems typical for manuscripts like illegible or doubtful characters, lacunae and non-standard characters that are not included in the Unicode standard. The database is further enhanced by a tagging system allowing to classify and to analyze different types of variants. Finally an evaluation of the whole system and suggestions for its further development are given.

Evaluating Intellectual Property Guardrails of Generative Image Models: A Technical Report

Austin T. Hoag, Apostolos Modas, Yunhao Ba +9 more

cs.CV · · arXiv ↗ · more like this ·

Generative image models are capable of producing images that bear a strong resemblance to, or replicate, recognizable intellectual property (IP). In this technical report, we present a benchmark and automated evaluation pipeline to test for evidence of IP guardrails in generative image models along with the propensity for these models to generate images with recognizable IP. The IP categories we tested include fictional characters, celebrity likeness, and commercial logos and do not encompass the full range of IP which may be implicated by image generation models. We evaluated fourteen widely used text-to-image models, including three self-hosted open weights models and eleven private models. While all of the private models were observed to refuse generations at some level due to IP guardrails, the frequency of generation refusals varied substantially among models. The refusal rates…

"Taking Stock at FAccT": Using Participatory Design to Co-Create a Vision for the Fairness, Accountability and Transparency Community

Shiran Dudy, Jan Simson, Yanan Long

cs.HC · · arXiv ↗ · more like this ·

As a relatively new forum, ACM FAccT has become a key space for activists and scholars to critically examine emerging AI and ML technologies. It brings together academics, civil society members, and government representatives from diverse fields to explore the broader societal impacts of both deployed and proposed technologies. We report a large-scale participatory design (PD) process for reflexive conference governance, which combined an in-person CRAFT session, an asynchronous Polis poll and the synthesis of a governance-facing report for the FAccT leadership. Participants shaped the substantive agenda by authoring seed statements, adding new statements and making patterns of agreement, disagreement and uncertainty made visible through voting.Our endeavors represent one of the the first instances of applying PD to a venue that critically interrogates the societal impacts of AI…