arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mathieu Sinn

37 papers · 2007–2022

2007: 12008: 22009: 12010: 02011: 62012: 42013: 32014: 02015: 12016: 32017: 32018: 52019: 12020: 22021: 42022: 1
2007peak 6 in 20112022

Frequent co-authors

Papers

showing 1–25 of 37 RSS

Adversarial Robustness Toolbox v1.0.0

Maria-Irina Nicolae, Mathieu Sinn, Minh Ngoc Tran +9 more

cs.LG · · cited 585× · arXiv ↗ · more like this ·

Adversarial Robustness Toolbox (ART) is a Python library supporting developers and researchers in defending Machine Learning models (Deep Neural Networks, Gradient Boosted Decision Trees, Support Vector Machines, Random Forests, Logistic Regression, Gaussian Processes, Decision Trees, Scikit-learn Pipelines, etc.) against adversarial threats and helps making AI systems more secure and trustworthy. Machine Learning models are vulnerable to adversarial examples, which are inputs (images, texts, tabular data, etc.) deliberately modified to produce a desired response by the Machine Learning model. ART provides the tools to build and deploy defences and test them with adversarial attacks. Defending Machine Learning models involves certifying and verifying model robustness and model hardening with approaches such as pre-processing inputs, augmenting training data with adversarial samples, and…

IBM Federated Learning: an Enterprise Framework White Paper V0.1

Heiko Ludwig, Nathalie Baracaldo, Gegi Thomas +21 more

cs.LG · · cited 204× · arXiv ↗ · more like this ·

Federated Learning (FL) is an approach to conduct machine learning without centralizing training data in a single place, for reasons of privacy, confidentiality or data volume. However, solving federated machine learning problems raises issues above and beyond those of centralized machine learning. These issues include setting up communication infrastructure between parties, coordinating the learning process, integrating party results, understanding the characteristics of the training data sets of different participating parties, handling data heterogeneity, and operating with the absence of a verification data set. IBM Federated Learning provides infrastructure and coordination for federated learning. Data scientists can design and run federated learning jobs based on existing, centralized machine learning models and can provide high-level instructions on how to run the federation. The…

One button machine for automating feature engineering in relational databases

Hoang Thanh Lam, Johann-Michael Thiebaut, Mathieu Sinn +3 more

cs.DB · · cited 111× · arXiv ↗ · more like this ·

Feature engineering is one of the most important and time consuming tasks in predictive analytics projects. It involves understanding domain knowledge and data exploration to discover relevant hand-crafted features from raw data. In this paper, we introduce a system called One Button Machine, or OneBM for short, which automates feature discovery in relational databases. OneBM automatically performs a key activity of data scientists, namely, joining of database tables and applying advanced data transformations to extract useful features from data. We validated OneBM in Kaggle competitions in which OneBM achieved performance as good as top 16% to 24% data scientists in three Kaggle competitions. More importantly, OneBM outperformed the state-of-the-art system in a Kaggle competition in terms of prediction accuracy and ranking on Kaggle leaderboard. The results show that OneBM can be…

Uncertainty in urban mobility: Predicting waiting times for shared bicycles and parking lots

Bei Chen, Fabio Pinelli, Mathieu Sinn +2 more

Transportation · · cited 39× · DOI ↗ · more like this ·

Building efficient and sustainable transportation systems is a key challenge for accommodating the fast-increasing population living in cities. Lack of efficiency in transportation networks typically arises from uncertainty, e.g., about the availability of resources (such as parking lots or bicycles in bike sharing systems), or the exogenous factors affecting their demand (such as weather or the time of the day). In this paper, we present a class of algorithms which use Generalized Additive Models (GAMs) for demand and availability prediction on various time scales. In contrast to existing methods, exogenous effects can be explicitly factored into the models, resulting in significant gains in terms of prediction accuracy. Another advantage of our approach is that it estimates the distribution of the waiting time for the next available bike/parking lot if the current availability is…

Covariances of Zero Crossings in Gaussian Processes

Mathieu Sinn, Karsten Keller

Statistics and Probability · Theory of Probability and Its Applications · · cited 25× · DOI ↗ · more like this ·

For a zero-mean Gaussian process, the covariances of zero crossings can be expressed as the sum of quadrivariate normal orthant probabilities. In this paper, we demonstrate the evaluation of zero crossing covariances using one-dimensional integrals. Furthermore, we provide asymptotics of zero crossing covariances for large time lags and derive bounds and approximations. Based on these results, we analyze the variance of the empirical zero crossing rate. We illustrate the applications of our results by autoregressive (AR) fractional Gaussian noise and fractionally integrated autoregressive moving average (FARIMA) processes.

Non-parametric estimation of Jensen-Shannon Divergence in Generative Adversarial Network training

Mathieu Sinn, Ambrish Rawat

stat.ML · · cited 24× · arXiv ↗ · more like this ·

Generative Adversarial Networks (GANs) have become a widely popular framework for generative modelling of high-dimensional datasets. However their training is well-known to be difficult. This work presents a rigorous statistical analysis of GANs providing straight-forward explanations for common training pathologies such as vanishing gradients. Furthermore, it proposes a new training objective, Kernel GANs, and demonstrates its practical effectiveness on large-scale real-world data sets. A key element in the analysis is the distinction between training with respect to the (unknown) data distribution, and its empirical counterpart. To overcome issues in GAN training, we pursue the idea of smoothing the Jensen-Shannon Divergence (JSD) by incorporating noise in the input distributions of the discriminator. As we show, this effectively leads to an empirical version of the JSD in which the…

Analytical results on the Beauchemin model of lymphocyte migration

Johannes Textor, Mathieu Sinn, Rob J. de Boer

Modeling and Simulation · BMC Bioinformatics · · cited 10× · DOI ↗ · more like this ·

The Beauchemin model is a simple particle-based description of stochastic lymphocyte migration in tissue, which has been successfully applied to studying immunological questions. In addition to being easy to implement, the model is also to a large extent mathematically tractable. This article provides a comprehensive overview of both existing and new analytical results on the Beauchemin model within a common mathematical framework. Specifically, we derive the motility coefficient, the mean square displacement, and the confinement ratio, and discuss four different methods for simulating biased migration of pre-defined speed. The results provide new insight into published studies and a reference point for future research based on this simple and popular lymphocyte migration model.

Towards an Accountable and Reproducible Federated Learning: A FactSheets Approach

Nathalie Baracaldo, Ali Anwar, Mark Purcell +8 more

cs.AI · · cited 9× · arXiv ↗ · more like this ·

Federated Learning (FL) is a novel paradigm for the shared training of models based on decentralized and private data. With respect to ethical guidelines, FL is promising regarding privacy, but needs to excel vis-à-vis transparency and trustworthiness. In particular, FL has to address the accountability of the parties involved and their adherence to rules, law and principles. We introduce AF^2 Framework, where we instrument FL with accountability by fusing verifiable claims with tamper-evident facts, into reproducible arguments. We build on AI FactSheets for instilling transparency and trustworthiness into the AI lifecycle and expand it to incorporate dynamic and nested facts, as well as complex model compositions in FL. Based on our approach, an auditor can validate, reproduce and certify a FL process. This can be directly applied in practice to address the challenges of AI engineering…

Castor: Contextual IoT Time Series Data and Model Management at Scale

Bei Chen, Bradley Eck, Francesco Fusco +4 more

stat.CO · · cited 8× · arXiv ↗ · more like this ·

We demonstrate Castor, a cloud-based system for contextual IoT time series data and model management at scale. Castor is designed to assist Data Scientists in (a) exploring and retrieving all relevant time series and contextual information that is required for their predictive modelling tasks; (b) seamlessly storing and deploying their predictive models in a cloud production environment; (c) monitoring the performance of all predictive models in production and (semi-)automatically retraining them in case of performance deterioration. The main features of Castor are: (1) an efficient pipeline for ingesting IoT time series data in real time; (2) a scalable, hybrid data management service for both time series and contextual data; (3) a versatile semantic model for contextual information which can be easily adopted to different application domains; (4) an abstract framework for developing…

Automated Image Data Preprocessing with Deep Reinforcement Learning

Tran Ngoc Minh, Mathieu Sinn, Hoang Thanh Lam +1 more

cs.CV · · cited 8× · arXiv ↗ · more like this ·

Data preparation, i.e. the process of transforming raw data into a format that can be used for training effective machine learning models, is a tedious and time-consuming task. For image data, preprocessing typically involves a sequence of basic transformations such as cropping, filtering, rotating or flipping images. Currently, data scientists decide manually based on their experience which transformations to apply in which particular order to a given image data set. Besides constituting a bottleneck in real-world data science projects, manual image data preprocessing may yield suboptimal results as data scientists need to rely on intuition or trial-and-error approaches when exploring the space of possible image transformations and thus might not be able to discover the most effective ones. To mitigate the inefficiency and potential ineffectiveness of manual data preprocessing, this…

Neural Feature Learning From Relational Database

Hoang Thanh Lam, Tran Ngoc Minh, Mathieu Sinn +2 more

cs.AI · · cited 8× · arXiv ↗ · more like this ·

Feature engineering is one of the most important but most tedious tasks in data science. This work studies automation of feature learning from relational database. We first prove theoretically that finding the optimal features from relational data for predictive tasks is NP-hard. We propose an efficient rule-based approach based on heuristics and a deep neural network to automatically learn appropriate features from relational data. We benchmark our approaches in ensembles in past Kaggle competitions. Our new approach wins late medals and beats the state-of-the-art solutions with significant margins. To the best of our knowledge, this is the first time an automated data science system could win medals in Kaggle competitions with complex relational database.

Structured Dimensionality Reduction for Additive Model Regression

Alhussein Fawzi, Jean-Baptiste Fiot, Bei Chen +2 more

Artificial Intelligence · IEEE Transactions on Knowledge and Data Engineering · · cited 6× · DOI ↗ · more like this ·

Additive models are regression methods which model the response variable as the sum of univariate transfer functions of the input variables. Key benefits of additive models are their accuracy and interpretability on many real-world tasks. Additive models are however not adapted to problems involving a large number (e.g., hundreds) of input variables, as they are prone to overfitting in addition to losing interpretability. In this paper, we introduce a novel framework for applying additive models to a large number of input variables. The key idea is to reduce the task dimensionality by deriving a small number of new covariates obtained by linear combinations of the inputs, where the linear weights are estimated with regard to the regression problem at hand. The weights are moreover constrained to prevent overfitting and facilitate the interpretation of the derived covariates. We…

Asymptotic Theory for Linear-Chain Conditional Random Fields

Mathieu Sinn, Pascal Poupart

Artificial Intelligence · International Conference on Artificial Intelligence and Statistics · · cited 6× · OpenAlex ↗ · more like this ·

In this theoretical paper we develop an asymptotic theory for Linear-Chain Condi- tional Random Fields (L-CRFs) and apply it to derive conditions under which the Max- imum Likelihood Estimates (MLEs) of the model weights are strongly consistent. We first define L-CRFs for infinite sequences and analyze some of their basic properties. Then we establish conditions under which ergodic- ity of the observations implies ergodicity of the joint sequence of observations and labels. This result is the key ingredient to derive con- ditions for strong consistency of the MLEs. Interesting findings are that the consistency crucially depends on the limit behavior of the Hessian of the likelihood function and that, asymptotically, the state feature functions do not matter. In this paper, we study asymptotical properties of the Maximum Likelihood Estimates (MLEs) for the model weights. More…

Multitask Additive Models With Shared Transfer Functions Based on Dictionary Learning

Alhussein Fawzi, Mathieu Sinn, Pascal Frossard

Artificial Intelligence · IEEE Transactions on Signal Processing · · cited 5× · DOI ↗ · more like this ·

Additive models form a widely popular class of regression models that represent the relation between covariates and response variables as the sum of low-dimensional transfer functions. Besides flexibility and accuracy, a key benefit of these models is their interpretability: the transfer functions provide visual means for inspecting the models and identifying domain-specific relations between inputs and outputs. However, in large-scale problems involving the prediction of many related tasks, learning independently additive models results in a loss of model interpretability, and can cause overfitting when training data is scarce. We introduce a novel multitask learning approach that provides a corpus of accurate and interpretable additive models for a large number of related forecasting tasks. Our key idea is to share transfer functions across models in order to reduce the model…

A scalable demand and renewable energy forecasting system for distribution grids

Vincent Lonij, Jean-Baptiste Fiot, Bei Chen +7 more

Artificial Intelligence · · cited 5× · DOI ↗ · more like this ·

Managing a reliable, renewable, and affordable power grid is a challenging task because the mix of power generating and consuming devices connected to the network continues to change. Improved forecasts help network operators respond to these changes and make data-driven decisions regarding, e.g., demand response and market operations. A system producing short-term energy forecasts of demand and renewable generation at multiple aggregation levels across the service territory of a distribution utility is presented. The system automates the process of ingesting and curating large amounts of data from multiple sources, such as high-resolution weather forecasts, SCADA (supervisory control and data acquisition) data and, smart meter data. This results in a richer and higher-quality data set which improves accuracy for residual demand forecasts because it enables the use of real-time data and…

Ambulatory Assessment of Lifestyle Factors for Alzheimer's Disease and Related Dementias

James Tung, Jonathan F. L. Semple, Wei X. Woo +4 more

Computer Vision and Pattern Recognition · National Conference on Artificial Intelligence · · cited 5× · OpenAlex ↗ · more like this ·

Considering few treatments are available to slow or stop neurodegenerative disorders, such as Alzheimer’s disease and related dementias (ADRD), modifying lifestyle factors to prevent disease onset are recommended. The Voice, Activity, and Location Monitoring system for Alzheimer’s disease (VALMA) is a novel ambulatory sensor system designed to capture natural behaviours across multiple domains to profile lifestyle risk factors related to ADRD. Objective measures of physical activity and sleep are provided by lower limb accelerometry. Audio and GPS location records provide verbal and mobility activity, respectively. Based on a familiar smartphone package, data collection with the system has proven to be feasible in community-dwelling older adults. Objective assessments of everyday activity will impact diagnosis of disease and design of exercise, sleep, and social interventions to prevent…

Exploring the Hyperparameter Landscape of Adversarial Robustness

Evelyn Duesterwald, Anupama Murthi, Ganesh Venkataraman +2 more

cs.LG · · cited 4× · arXiv ↗ · more like this ·

Adversarial training shows promise as an approach for training models that are robust towards adversarial perturbation. In this paper, we explore some of the practical challenges of adversarial training. We present a sensitivity analysis that illustrates that the effectiveness of adversarial training hinges on the settings of a few salient hyperparameters. We show that the robustness surface that emerges across these salient parameters can be surprisingly complex and that therefore no effective one-size-fits-all parameter settings exist. We then demonstrate that we can use the same salient hyperparameters as tuning knob to navigate the tension that can arise between robustness and accuracy. Based on these findings, we present a practical approach that leverages hyperparameter optimization techniques for tuning adversarial training to maximize robustness while keeping the loss in…

FAT: Federated Adversarial Training

Giulio Zizzo, Ambrish Rawat, Mathieu Sinn +1 more

cs.LG · · cited 3× · arXiv ↗ · more like this ·

Federated learning (FL) is one of the most important paradigms addressing privacy and data governance issues in machine learning (ML). Adversarial training has emerged, so far, as the most promising approach against evasion threats on ML models. In this paper, we take the first known steps towards federated adversarial training (FAT) combining both methods to reduce the threat of evasion during inference while preserving the data privacy during training. We investigate the effectiveness of the FAT protocol for idealised federated settings using MNIST, Fashion-MNIST, and CIFAR10, and provide first insights on stabilising the training on the LEAF benchmark dataset which specifically emulates a federated learning environment. We identify challenges with this natural extension of adversarial training with regards to achieved adversarial robustness and further examine the idealised settings…

Error Bounds for Online Predictions of Linear-Chain Conditional Random Fields: Application to Activity Recognition for Users of Rolling Walkers

Mathieu Sinn, Pascal Poupart

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

Linear-Chain Conditional Random Fields (L-CRFs) are a versatile class of models for the distribution of a sequence of hidden states ("labels") conditional on a sequence of observable variables. In general, the exact conditional marginal distributions of the labels can be computed only after the complete sequence of observations has been obtained, which forbids the prediction of labels in an online fashion. This paper considers approximations of the marginal distributions which only take into account past observations and a small number of observations in the future. Based on these approximations, labels can be predicted close to real-time. We establish rigorous bounds for the marginal distributions which can be used to assess the approximation error at runtime. We apply the results to an L-CRF which recognizes the activity of rolling walker users from a stream of sensor data. It turns…

Smart walkers!: enhancing the mobility of the elderly

Mathieu Sinn, Pascal Poupart

Computer Vision and Pattern Recognition · Adaptive Agents and Multi-Agents Systems · · cited 3× · DOI ↗ · more like this ·

The idea of Smart Walkers is to equip customary rolling walkers with sensors in order to assist users, caregivers and clinicians. The integral part of the Smart Walkers is an autonomous agent which monitors the activity of the user, assesses his physical conditions, and detects potential risks of falls. In this paper, we study methods which enable the agent to recognize the user activity from the sensor measurements. The proposed methods use Conditional Random Fields with features based on discriminant rules. A special case are features which, in order to distinguish between two activities, compare the sensor measurements to thresholds learned by a linear classifier. Experiments with real user data show that the methods achieve a good accuracy; the best results are obtained using smooth thresholds based on sigmoid functions.

Certified Federated Adversarial Training

Giulio Zizzo, Ambrish Rawat, Mathieu Sinn +2 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

In federated learning (FL), robust aggregation schemes have been developed to protect against malicious clients. Many robust aggregation schemes rely on certain numbers of benign clients being present in a quorum of workers. This can be hard to guarantee when clients can join at will, or join based on factors such as idle system status, and connected to power and WiFi. We tackle the scenario of securing FL systems conducting adversarial training when a quorum of workers could be completely malicious. We model an attacker who poisons the model to insert a weakness into the adversarial training such that the model displays apparent adversarial robustness, while the attacker can exploit the inserted weakness to bypass the adversarial training and force the model to misclassify adversarial examples. We use abstract interpretation techniques to detect such stealthy attacks and block the…

Learning Correlation Space for Time Series

Han Qiu, Hoang Thanh Lam, Francesco Fusco +1 more

cs.LG · · cited 2× · arXiv ↗ · more like this ·

We propose an approximation algorithm for efficient correlation search in time series data. In our method, we use Fourier transform and neural network to embed time series into a low-dimensional Euclidean space. The given space is learned such that time series correlation can be effectively approximated from Euclidean distance between corresponding embedded vectors. Therefore, search for correlated time series can be done using an index in the embedding space for efficient nearest neighbor search. Our theoretical analysis illustrates that our method's accuracy can be guaranteed under certain regularity conditions. We further conduct experiments on real-world datasets and the results show that our method indeed outperforms the baseline solution. In particular, for approximation of correlation, our method reduces the approximation loss by a half in most test cases compared to the baseline…

Central Limit Theorems for Conditional Markov Chains

Mathieu Sinn, Bei Chen

Artificial Intelligence · International Conference on Artificial Intelligence and Statistics · · cited 2× · OpenAlex ↗ · more like this ·

This paper studies Central Limit Theorems for real-valued functionals of Conditional Markov Chains. Using a classical result by Dobrushin (1956) for non-stationary Markov chains, a conditional Central Limit Theorem for fixed sequences of observations is estab-lished. The asymptotic variance can be es-timated by resampling the latent states con-ditional on the observations. If the condi-tional means themselves are asymptotically normally distributed, an unconditional Cen-tral Limit Theorem can be obtained. The methodology is used to construct a statistical hypothesis test which is applied to syntheti-cally generated environmental data. 1

Estimation of ordinal pattern probabilities in fractional Brownian motion

Mathieu Sinn, Karsten Keller

math.PR · · cited 2× · arXiv ↗ · more like this ·

For equidistant discretizations of fractional Brownian motion (fBm), the probabilities of ordinal patterns of order d=2 are monotonically related to the Hurst parameter H. By plugging the sample relative frequency of those patterns indicating changes between up and down into the monotonic relation to H, one obtains the Zero Crossing (ZC) estimator of the Hurst parameter which has found considerable attention in mathematical and applied research. In this paper, we generally discuss the estimation of ordinal pattern probabilities in fBm. As it turns out, according to the sufficiency principle, for ordinal patterns of order d=2 any reasonable estimator is an affine functional of the sample relative frequency of changes. We establish strong consistency of the estimators and show them to be asymptotically normal for H<3/4. Further, we derive confidence intervals for the Hurst parameter.…

The Devil is in the GAN: Backdoor Attacks and Defenses in Deep Generative Models

Ambrish Rawat, Killian Levacher, Mathieu Sinn

cs.CR · · cited 1× · arXiv ↗ · more like this ·

Deep Generative Models (DGMs) are a popular class of deep learning models which find widespread use because of their ability to synthesize data from complex, high-dimensional manifolds. However, even with their increasing industrial adoption, they haven't been subject to rigorous security and privacy analysis. In this work we examine one such aspect, namely backdoor attacks on DGMs which can significantly limit the applicability of pre-trained models within a model supply chain and at the very least cause massive reputation damage for companies outsourcing DGMs form third parties. While similar attacks scenarios have been studied in the context of classical prediction models, their manifestation in DGMs hasn't received the same attention. To this end we propose novel training-time attacks which result in corrupted DGMs that synthesize regular data under normal operations and designated…