arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Alexandre Quemy

16 papers · 2018–2026

2018: 22019: 12020: 12021: 22022: 02023: 42024: 02025: 02026: 6
2018peak 6 in 20262026

Frequent co-authors

Papers

showing 1–16 of 16 RSS

Paradiseo: From a Modular Framework for Evolutionary Computation to the Automated Design of Metaheuristics ---22 Years of Paradiseo---

Johann Dreo, Arnaud Liefooghe, Sébastien Verel +5 more

cs.NE · · cited 30× · arXiv ↗ · more like this ·

The success of metaheuristic optimization methods has led to the development of a large variety of algorithm paradigms. However, no algorithm clearly dominates all its competitors on all problems. Instead, the underlying variety of landscapes of optimization problems calls for a variety of algorithms to solve them efficiently. It is thus of prior importance to have access to mature and flexible software frameworks which allow for an efficient exploration of the algorithm design space. Such frameworks should be flexible enough to accommodate any kind of metaheuristics, and open enough to connect with higher-level optimization, monitoring and evaluation softwares. This article summarizes the features of the ParadisEO framework, a comprehensive C++ free software which targets the development of modular metaheuristics. ParadisEO provides a highly modular architecture, a large set of…

Paradiseo: From a Modular Framework for Evolutionary Computation to the Automated Design of Metaheuristics

Johann Dréo, Arnaud Liefooghe, Sebástien Vérel +5 more

Artificial Intelligence · LillOA (Université de Lille (University Of Lille)) · · cited 26× · OpenAlex ↗ · more like this ·

The success of metaheuristic optimization methods has led to the development of a large variety of algorithm paradigms. However, no algorithm clearly dominates all its competitors on all problems. Instead, the underlying variety of landscapes of optimization problems calls for a variety of algorithms to solve them efficiently. It is thus of prior importance to have access to mature and flexible software frameworks which allow for an efficient exploration of the algorithm design space. Such frameworks should be flexible enough to accommodate any kind of metaheuristics, and open enough to connect with higherlevel optimization, monitoring and evaluation softwares. This article summarizes the features of the Paradiseo framework, a comprehensive C++ free software which targets the development of modular metaheuristics. Paradiseo provides a highly modular architecture, a large set of…

Artificial Intelligence and Fair Trial Rights

Helga Molbæk-Steensig, Alexandre Quemy

Artificial Intelligence · Oxford University Press eBooks · · cited 5× · DOI ↗ · more like this ·

Abstract The right to a fair trial is the most frequently violated human right before international human rights bodies, and it is more the rule than the exception that national judicial systems are overburdened and overly slow. This chapter asks whether artificial intelligence (AI) machine learning (ML) applications can help alleviate this problem, or if they are a threat to securing the right to the independent and impartial application of the law. It argues that the answer depends on whether the applications are designed with a clear vision of what courts are for and finds several current AI applications in various courts and public administrations to be missing this fundamental requirement. It identifies three key problems, namely the failure of current systems to differentiate between groups and individuals, the failure to take the fundamentally posterior nature of courts into…

Judicial Independence and Impartiality: Tenure Changes at the European Court of Human Rights

Helga Molbæk-Steensig, Alexandre Quemy

Law · European Journal of International Law · · cited 5× · DOI ↗ · more like this ·

Abstract Judges should be impartial and independent, judging based solely on the law. Current constitutional literature suggests an important factor in securing this may be the length of tenure. The assumption is that judges with non-renewable terms are more independent than judges with renewable terms since they do not have to worry about reappointment, but proving this assumption empirically is not straightforward. Obstacles include difficulties in comparing different courts and the fact that there is often no obvious case outcome that proves independence. This article aims to overcome these obstacles with a mixed-methods study on the European Court of Human Rights during a time when the tenure rules changed. The study goes beyond the counting of votes and analyses the arguments used in separate opinions as indicators of independence. Our main findings are that, after the introduction…

GBEx - towards Graph-Based Explanations

Paweł Mróz, Alexandre Quemy, Mateusz Slanynski +2 more

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

This paper proposes Graph-Based Explanations (GBEx), a approach to explain machine learning models. It presents explanations in the form of a graph, where nodes represent arguments, and edges represent connections. The value of a graph node accounts for the influence of a given argument while the value of a graph edge accounts for the influence of a given connection. Contrarily to LIME, GBEx does not provide local explanations but a global explanations. And contrarily to SHAP, it can automatically explain interactions between variables. We provide an illustration on how GBEx can provide both local and global explanation.

European Court of Human Right Open Data project

Alexandre Quemy

cs.LG · · cited 3× · arXiv ↗ · more like this ·

This paper presents thirteen datasets for binary, multiclass and multilabel classification based on the European Court of Human Rights judgments since its creation. The interest of such datasets is explained through the prism of the researcher, the data scientist, the citizen and the legal practitioner. Contrarily to many datasets, the creation process, from the collection of raw data to the feature transformation, is provided under the form of a collection of fully automated and open-source scripts. It ensures reproducibility and a high level of confidence in the processed data, which is some of the most important issues in data governance nowadays. A first experimental campaign is performed to study some predictability properties and to establish baseline results on popular machine learning algorithms. The results are consistently good across the binary datasets with an accuracy…

Measuring Optimal Transport in Transformer Depth

Alexandre Quemy

cs.CL · · cited 0× · arXiv ↗ · more like this ·

A transformer carries each token's state from layer to layer, and the whole vocabulary carried together forms a cloud that moves with depth. We ask whether a trained network moves this cloud the way optimal transport would: at the cheapest cost, and along the map that pairs each token with its optimal destination. We measure both on Pythia-160m and Pythia-410m, with an exact assignment between consecutive layer clouds, a measured sampling floor, calibration on couplings known to be optimal, and a split of the cost into the common shift of the cloud and the token-specific moves. At the last layer, both models move their tokens where the optimal-transport map sends them, at the optimal cost for Pythia-410m and slightly above it for Pythia-160m. At the first layer they do not. In between, single layers can be judged on cost at only two of ten transitions, and blocks of several layers move…

A Hub of Short Rows Inflates Intrinsic Dimension Estimation of Token Embeddings

Alexandre Quemy

cs.CL · · cited 0× · arXiv ↗ · more like this ·

A token-embedding table holds a hub of short rows near its origin, and we show that this cluster biases what nearest-neighbor intrinsic-dimension (ID) estimators report. Because of the concentration of measure, a token is closer to the central cluster than to any other token, so its first two neighbors are both hub rows at nearly the same distance. As a result, the ID estimators such as TwoNN return a dimension far above the real ID. Measured one token at a time, dimension is a heavy-tailed distribution. Measured on the full vocabulary, it grows with the model's parameter count. However, when we remove the hub, the heavy tail disappears and the measured dimension collapses to a narrow range for eleven models, from GPT-2 to models such as K3 and GLM-4.7. The hub acts as a switch: a few hundred rows are enough to fully inflate the estimate. We reproduced an experiment stating that the…

The Depth Flow of Token Representations Is Nonlinear and Does Not Descend Its Own Density

Alexandre Quemy

cs.CL · · cited 0× · arXiv ↗ · more like this ·

A token's representation is carried through the network layer by layer. The whole vocabulary carried together forms a flow. We fit this flow's equation of motion as a discrete Langevin model over corpus-mean trajectories of Pythia-160M and Pythia-410M, and score the predicted steps on held-out tokens. Linear maps are often used as cheap surrogates for a layer. The flow they summarize is not linear: a quadratic drift beats the linear map at every transition of both models, and the Kramers-Moyal estimator agrees wherever its neighborhoods stay local. At full width, the step of a mean trajectory is nearly affine, 3% non-affine, while the step of an individual state is not, 17%. We then characterize the flow further. First, we show that it does not descend its own log-density, whatever the diffusion matrix. The drift instead descends a potential that is not the density. Second, the…

Function Lives Where Variance Doesn't: Task-Weighted Charts of a Language Model's Computation

Alexandre Quemy

cs.AI · · cited 0× · arXiv ↗ · more like this ·

How many dimensions does a language model's computation actually use? The question is ill-posed until one names a functional. Task-weighted charts make it well-posed: low-dimensional coordinate systems fit against a chosen functional of the representation, under the functional's own metric, turning distillation into plain least squares. Across six models from three families, spanning 70m to 7B parameters, next-token prediction needs 70--90% of the residual stream's width to stay within 5% of intact perplexity, a width consumed by the rare tail of language, and the variance profile predicts none of it: two directions carry 90% of GPT-2's activation variance and almost none of its function. Dimension is per-functional: the model's own uncertainty reads from six coordinates where the full predictive distribution needs hundreds; and it grows with depth. The dissociation is exploitable: when…

MultiZenoTravel: a Tunable Benchmark for Multi-Objective Planning with Known Pareto Front

Alexandre Quemy, Marc Schoenauer, Johann Dreo

cs.AI · · cited 0× · arXiv ↗ · more like this ·

Multi-objective AI planning suffers from a lack of benchmarks exhibiting known Pareto Fronts. In this work, we propose a tunable benchmark generator, together with a dedicated solver that provably computes the true Pareto front of the resulting instances. First, we prove a proposition allowing us to characterize the optimal plans for a constrained version of the problem, and then show how to reduce the general problem to the constrained one. Second, we provide a constructive way to find all the Pareto-optimal plans and discuss the complexity of the algorithm. We provide an implementation that allows the solver to handle realistic instances in a reasonable time. Finally, as a practical demonstration, we used this solver to find all Pareto-optimal plans between the two largest airports in the world, considering the routes between the 50 largest airports, spherical distances between…

Binary Classification in Unstructured Space With Hypergraph Case-Based Reasoning

Alexandre Quemy

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Binary classification is one of the most common problem in machine learning. It consists in predicting whether a given element belongs to a particular class. In this paper, a new algorithm for binary classification is proposed using a hypergraph representation. The method is agnostic to data representation, can work with multiple data sources or in non-metric spaces, and accommodates with missing values. As a result, it drastically reduces the need for data preprocessing or feature engineering. Each element to be classified is partitioned according to its interactions with the training set. For each class, a seminorm over the training set partition is learnt to represent the distribution of evidence supporting this class. Empirical validation demonstrates its high potential on a wide range of well-known datasets and the results are compared to the state-of-the-art. The time complexity…

Riemannian Geometry for Pre-trained Language Model Embeddings

Szczepan Konior, Alexandre Quemy, Przemysław Klocek +2 more

cs.CL · · arXiv ↗ · more like this ·

Understanding the geometric structure of pre-trained language model embeddings matters for interpretability and safety. We ask whether sentence-level classification signal lives in the Riemannian geometry of contextual token embeddings, and probe it by extracting per-token pullback metrics from a learned encoder's analytical Jacobian and aggregating them with the Fréchet mean on the symmetric positive definite (SPD) manifold; we call this procedure Riemannian Mean Pooling (RMP). Across three datasets with non-trivial linguistic structure (CoLA, CREAK, RTE), RMP outperforms Euclidean mean pooling, while on FEVER-Symmetric, a benchmark constructed to remove annotation-driven lexical artifacts, the method correctly stays at chance. Ablations show that a randomly initialised encoder combined with Fréchet aggregation already beats Euclidean pooling on two of the three signal-bearing…

Intrinsic Green's Learning: Supervised Learning on Manifolds via Inverse PDE

Alexandre Quemy

cs.LG · · arXiv ↗ · more like this ·

We introduce Intrinsic Green's Learning (IGL), a framework that models a target function on a manifold as the solution to a linear PDE whose source term is learned from data. Rather than approximating the target directly, IGL learns a source and integrates it against a Green's kernel. An encoder discovers a low-dimensional coordinate chart on the manifold where both the source and the kernel decompose as low-rank tensors, collapsing a high-dimensional integral into independent one-dimensional integrals with cost linear in the intrinsic dimension. A two-stage algorithm separates coordinate discovery from source fitting, a near-convex linear solve, preventing the dimensional collapse of joint training. Learnable gates on each coordinate automatically discover the intrinsic dimension of the manifold. We validate IGL on synthetic manifolds and on MNIST, where it simultaneously achieves…

First steps towards quantum machine learning applied to the classification of event-related potentials

Grégoire Cattan, Alexandre Quemy, Anton Andreev

cs.HC · · arXiv ↗ · more like this ·

Low information transfer rate is a major bottleneck for brain-computer interfaces based on non-invasive electroencephalography (EEG) for clinical applications. This led to the development of more robust and accurate classifiers. In this study, we investigate the performance of quantum-enhanced support vector classifier (QSVC). Training (predicting) balanced accuracy of QSVC was 83.17 (50.25) %. This result shows that the classifier was able to learn from EEG data, but that more research is required to obtain higher predicting accuracy. This could be achieved by a better configuration of the classifier, such as increasing the number of shots.

Two-stage Optimization for Machine Learning Workflow

Alexandre Quemy

cs.LG · · arXiv ↗ · more like this ·

Machines learning techniques plays a preponderant role in dealing with massive amount of data and are employed in almost every possible domain. Building a high quality machine learning model to be deployed in production is a challenging task, from both, the subject matter experts and the machine learning practitioners. For a broader adoption and scalability of machine learning systems, the construction and configuration of machine learning workflow need to gain in automation. In the last few years, several techniques have been developed in this direction, known as autoML. In this paper, we present a two-stage optimization process to build data pipelines and configure machine learning algorithms. First, we study the impact of data pipelines compared to algorithm configuration in order to show the importance of data preprocessing over hyperparameter tuning. The second part presents…