arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jean-Roch Vlimant

67 papers · 2012–2023

2012: 12013: 02014: 02015: 12016: 12017: 62018: 52019: 102020: 162021: 172022: 62023: 4
2012peak 17 in 20212023

Frequent co-authors

Papers

showing 1–25 of 67 RSS

Graph Neural Networks in Particle Physics

Jonathan Shlomi, Peter Battaglia, Jean-Roch Vlimant

hep-ex · · cited 357× · arXiv ↗ · more like this ·

Particle physics is a branch of science aiming at discovering the fundamental laws of matter and forces. Graph neural networks are trainable functions which operate on graphs---sets of elements and their pairwise relations---and are a central method within the broader field of geometric deep learning. They are very expressive and have demonstrated superior performance to other classical deep learning approaches in a variety of domains. The data in particle physics are often represented by sets and graphs and as such, graph neural networks offer key advantages. Here we review various applications of graph neural networks in particle physics, including different graph constructions, model architectures and learning objectives, as well as key open problems in particle physics for which graph neural networks are promising.

Quantum Machine Learning in High Energy Physics

Wen Guan, Gabriel Perdue, Arthur Pesah +4 more

quant-ph · · cited 155× · arXiv ↗ · more like this ·

Machine learning has been used in high energy physics for a long time, primarily at the analysis level with supervised classification. Quantum computing was postulated in the early 1980s as way to perform computations that would not be tractable with a classical computer. With the advent of noisy intermediate-scale quantum computing devices, more quantum algorithms are being developed with the aim at exploiting the capacity of the hardware for machine learning applications. An interesting question is whether there are ways to apply quantum machine learning to High Energy Physics. This paper reviews the first generation of ideas that use quantum machine learning on problems in high energy physics and provide an outlook on future applications.

Graph Neural Networks for Particle Reconstruction in High Energy Physics detectors

Xiangyang Ju, Steven Farrell, Paolo Calafiura +20 more

physics.ins-det · · cited 127× · arXiv ↗ · more like this ·

Pattern recognition problems in high energy physics are notably different from traditional machine learning applications in computer vision. Reconstruction algorithms identify and measure the kinematic properties of particles produced in high energy collisions and recorded with complex detector systems. Two critical applications are the reconstruction of charged particle trajectories in tracking detectors and the reconstruction of particle showers in calorimeters. These two problems have unique challenges and characteristics, but both have high dimensionality, high degree of sparsity, and complex geometric layouts. Graph Neural Networks (GNNs) are a relatively new class of deep learning architectures which can deal with such data effectively, allowing scientists to incorporate domain knowledge in a graph structure and learn powerful representations leveraging that structure to identify…

Particle Cloud Generation with Message Passing Generative Adversarial Networks

Raghav Kansal, Javier Duarte, Hao Su +6 more

cs.LG · · cited 89× · arXiv ↗ · more like this ·

In high energy physics (HEP), jets are collections of correlated particles produced ubiquitously in particle collisions such as those at the CERN Large Hadron Collider (LHC). Machine learning (ML)-based generative models, such as generative adversarial networks (GANs), have the potential to significantly accelerate LHC jet simulations. However, despite jets having a natural representation as a set of particles in momentum-space, a.k.a. a particle cloud, there exist no generative models applied to such a dataset. In this work, we introduce a new particle cloud dataset (JetNet), and apply to it existing point cloud GANs. Results are evaluated using (1) 1-Wasserstein distances between high- and low-level feature distributions, (2) a newly developed Fréchet ParticleNet Distance, and (3) the coverage and (4) minimum matching distance metrics. Existing GANs are found to be inadequate for…

Hybrid Quantum Classical Graph Neural Networks for Particle Track Reconstruction

Cenk Tüysüz, Carla Rieger, Kristiane Novotny +6 more

quant-ph · · cited 76× · arXiv ↗ · more like this ·

The Large Hadron Collider (LHC) at the European Organisation for Nuclear Research (CERN) will be upgraded to further increase the instantaneous rate of particle collisions (luminosity) and become the High Luminosity LHC (HL-LHC). This increase in luminosity will significantly increase the number of particles interacting with the detector. The interaction of particles with a detector is referred to as "hit". The HL-LHC will yield many more detector hits, which will pose a combinatorial challenge by using reconstruction algorithms to determine particle trajectories from those hits. This work explores the possibility of converting a novel Graph Neural Network model, that can optimally take into account the sparse nature of the tracking detector data and their complex geometry, to a Hybrid Quantum-Classical Graph Neural Network that benefits from using Variational Quantum layers. We show…

Track Seeding and Labelling with Embedded-space Graph Neural Networks

Nicholas Choma, Daniel Murnane, Xiangyang Ju +16 more

physics.ins-det · · cited 35× · arXiv ↗ · more like this ·

To address the unprecedented scale of HL-LHC data, the Exa.TrkX project is investigating a variety of machine learning approaches to particle track reconstruction. The most promising of these solutions, graph neural networks (GNN), process the event as a graph that connects track measurements (detector hits corresponding to nodes) with candidate line segments between the hits (corresponding to edges). Detector information can be associated with nodes and edges, enabling a GNN to propagate the embedded parameters around the graph and predict node-, edge- and graph-level observables. Previously, message-passing GNNs have shown success in predicting doublet likelihood, and we here report updates on the state-of-the-art architectures for this task. In addition, the Exa.TrkX project has investigated innovations in both graph construction, and embedded representations, in an effort to achieve…

Charged particle tracking with quantum annealing-inspired optimization

Alexander Zlokapa, Abhishek Anand, Jean-Roch Vlimant +4 more

quant-ph · · cited 35× · arXiv ↗ · more like this ·

At the High Luminosity Large Hadron Collider (HL-LHC), traditional track reconstruction techniques that are critical for analysis are expected to face challenges due to scaling with track density. Quantum annealing has shown promise in its ability to solve combinatorial optimization problems amidst an ongoing effort to establish evidence of a quantum speedup. As a step towards exploiting such potential speedup, we investigate a track reconstruction approach by adapting the existing geometric Denby-Peterson (Hopfield) network method to the quantum annealing framework and to HL-LHC conditions. Furthermore, we develop additional techniques to embed the problem onto existing and near-term quantum annealing hardware. Results using simulated annealing and quantum annealing with the D-Wave 2X system on the TrackML dataset are presented, demonstrating the successful application of a quantum…

Charged particle tracking with quantum annealing optimization

Alexander Zlokapa, Anand Abhishek, Jean-Roch Vlimant +4 more

Computer Networks and Communications · Quantum Machine Intelligence · · cited 31× · DOI ↗ · more like this ·

Abstract At the High Luminosity Large Hadron Collider (HL-LHC), traditional track reconstruction techniques that are critical for physics analysis will need to be upgraded to scale with track density. Quantum annealing has shown promise in its ability to solve combinatorial optimization problems amidst an ongoing effort to establish evidence of a quantum speedup. As a step towards exploiting such potential speedup, we investigate a track reconstruction approach by adapting the existing geometric Denby-Peterson (Hopfield) network method to the quantum annealing framework for HL-LHC conditions. We develop additional techniques to embed the problem onto existing and near-term quantum annealing hardware. Results using simulated annealing and quantum annealing with the D-Wave 2X system on the TrackML open dataset are presented, demonstrating the successful application of a quantum annealing…

Graph Generative Adversarial Networks for Sparse Data Generation in High Energy Physics

Raghav Kansal, Javier Duarte, Breno Orzari +5 more

physics.data-an · · cited 25× · arXiv ↗ · more like this ·

We develop a graph generative adversarial network to generate sparse data sets like those produced at the CERN Large Hadron Collider (LHC). We demonstrate this approach by training on and generating sparse representations of MNIST handwritten digit images and jets of particles in proton-proton collisions like those at the LHC. We find the model successfully generates sparse MNIST digits and particle jet data. We quantify agreement between real and generated data with a graph-based Fréchet Inception distance, and the particle and jet feature-level 1-Wasserstein distance for the MNIST and jet datasets respectively.

An MPI-Based Python Framework for Distributed Training with Keras

Dustin Anderson, Jean-Roch Vlimant, Maria Spiropulu

cs.DC · · cited 21× · arXiv ↗ · more like this ·

We present a lightweight Python framework for distributed training of neural networks on multiple GPUs or CPUs. The framework is built on the popular Keras machine learning library. The Message Passing Interface (MPI) protocol is used to coordinate the training process, and the system is well suited for job submission at supercomputing sites. We detail the software's features, describe its use, and demonstrate its performance on systems of varying sizes on a benchmark problem drawn from high-energy physics research.

Named Data Networking in Climate Research and HEP Applications

Susmit Shannigrahi, Christos Papadopoulos, Edmund Yeh +8 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 21× · DOI ↗ · more like this ·

The Computing Models of the LHC experiments continue to evolve from the simple hierarchical MONARC[2] model towards more agile models where data is exchanged among many Tier2 and Tier3 sites, relying on both large scale file transfers with strategic data placement, and an increased use of remote access to object collections with caching through CMS's AAA, ATLAS' FAX and ALICE's AliEn projects, for example. The challenges presented by expanding needs for CPU, storage and network capacity as well as rapid handling of large datasets of file and object collections have pointed the way towards future more agile pervasive models that make best use of highly distributed heterogeneous resources. In this paper, we explore the use of Named Data Networking (NDN), a new Internet architecture focusing on content rather than the location of the data collections. As NDN has shown considerable promise…

Anomaly detection using Deep Autoencoders for the assessment of the quality of the data acquired by the CMS experiment

Adrian Alan Pol, Virginia Azzolini, G. Cerminara +5 more

Artificial Intelligence · EPJ Web of Conferences · · cited 20× · DOI ↗ · more like this ·

The certification of the CMS experiment data as usable for physics analysis is a crucial task to ensure the quality of all physics results published by the collaboration. Currently, the certification conducted by human experts is labor intensive and based on the scrutiny of distributions integrated on several hours of data taking. This contribution focuses on the design and prototype of an automated certification system assessing data quality on a per-luminosity section (i.e. 23 seconds of data taking) basis. Anomalies caused by detector malfunctioning or sub-optimal reconstruction are difficult to enumerate a priori and occur rarely, making it difficult to use classical supervised classification methods such as feedforward neural networks. We base our prototype on a semi-supervised approach which employs deep autoencoders. This approach has been qualified successfully on CMS data…

Quantum adiabatic machine learning with zooming

Alexander Zlokapa, Alex Mott, Joshua Job +3 more

quant-ph · · cited 9× · arXiv ↗ · more like this ·

Recent work has shown that quantum annealing for machine learning, referred to as QAML, can perform comparably to state-of-the-art machine learning methods with a specific application to Higgs boson classification. We propose QAML-Z, a novel algorithm that iteratively zooms in on a region of the energy surface by mapping the problem to a continuous space and sequentially applying quantum annealing to an augmented set of weak classifiers. Results on a programmable quantum annealer show that QAML-Z matches classical deep neural network performance at small training set sizes and reduces the performance margin between QAML and classical deep neural networks by almost 50% at large training set sizes, as measured by area under the ROC curve. The significant improvement of quantum annealing algorithms for machine learning and the use of a discrete quantum algorithm on a continuous…

Performance of Particle Tracking Using a Quantum Graph Neural Network

Cenk Tüysüz, Kristiane Novotny, Carla Rieger +7 more

quant-ph · · cited 8× · arXiv ↗ · more like this ·

The Large Hadron Collider (LHC) at the European Organisation for Nuclear Research (CERN) will be upgraded to further increase the instantaneous rate of particle collisions (luminosity) and become the High Luminosity LHC. This increase in luminosity, will yield many more detector hits (occupancy), and thus measurements will pose a challenge to track reconstruction algorithms being responsible to determine particle trajectories from those hits. This work explores the possibility of converting a novel Graph Neural Network model, that proven itself for the track reconstruction task, to a Hybrid Graph Neural Network in order to benefit the exponentially growing Hilbert Space. Several Parametrized Quantum Circuits (PQC) are tested and their performance against the classical approach is compared. We show that the hybrid model can perform similar to the classical approach. We also present a…

New Physics Agnostic Selections For New Physics Searches

K. A. Wozniak, Olmo Cerri, J. Duarte +6 more

Artificial Intelligence · EPJ Web of Conferences · · cited 7× · DOI ↗ · more like this ·

We discuss a model-independent strategy for boosting new physics searches with the help of an unsupervised anomaly detection algorithm. Prior to a search, each input event is preprocessed by the algorithm - a variational autoencoder (VAE). Based on the loss assigned to each event, input data can be split into a background control sample and a signal enriched sample. Following this strategy, one can enhance the sensitivity to new physics with no assumption on the underlying new physics signature. Our results show that a typical BSM search on the signal enriched group is more sensitive than an equivalent search on the original dataset.

Automatic log analysis with NLP for the CMS workflow handling

Lukas Layer, Daniel Robert Abercrombie, H. Bakhshiansohi +5 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 6× · DOI ↗ · more like this ·

The central Monte-Carlo production of the CMS experiment utilizes the WLCG infrastructure and manages daily thousands of tasks, each up to thousands of jobs. The distributed computing system is bound to sustain a certain rate of failures of various types, which are currently handled by computing operators a posteriori. Within the context of computing operations, and operation intelligence, we propose a Machine Learning technique to learn from the operators with a view to reduce the operational workload and delays. This work is in continuation of CMS work on operation intelligence to try and reach accurate predictions with Machine Learning. We present an approach to consider the log files of the workflows as regular text to leverage modern techniques from Natural Language Processing (NLP). In general, log files contain a substantial amount of text that is not human language. Therefore…

Embedding of particle tracking data using hybrid quantum-classical neural networks

Carla Rieger, Cenk Tüysüz, Kristiane Novotny +5 more

Artificial Intelligence · EPJ Web of Conferences · · cited 5× · DOI ↗ · more like this ·

The High Luminosity Large Hadron Collider (HL-LHC) at CERN will involve a significant increase in complexity and sheer size of data with respect to the current LHC experimental complex. Hence, the task of reconstructing the particle trajectories will become more involved due to the number of simultaneous collisions and the resulting increased detector occupancy. Aiming to identify the particle paths, machine learning techniques such as graph neural networks are being explored in the HEP.TrkX project and its successor, the Exa.TrkX project. Both show promising results and reduce the combinatorial nature of the problem. Previous results of our team have demonstrated the successful attempt of applying quantum graph neural networks to reconstruct the particle track based on the hits of the detector. A higher overall accuracy is gained by representing the training data in a meaningful way…

Distributed Training and Optimization Of Neural Networks

Jean-Roch Vlimant, Junqi Yin

cs.LG · · cited 4× · arXiv ↗ · more like this ·

Deep learning models are yielding increasingly better performances thanks to multiple factors. To be successful, model may have large number of parameters or complex architectures and be trained on large dataset. This leads to large requirements on computing resource and turn around time, even more so when hyper-parameter optimization is done (e.g search over model architectures). While this is a challenge that goes beyond particle physics, we review the various ways to do the necessary computations in parallel, and put it in the context of high energy physics.

Next-Generation Exascale Network Integrated Architecture for Global Science [Invited]

H. B. Newman, M. Spiropulu, Justas Balcas +5 more

Computer Networks and Communications · Journal of Optical Communications and Networking · · cited 4× · DOI ↗ · more like this ·

The next-generation exascale network integrated architecture (NGENIA-ES) is a project specifically designed to accomplish new levels of network and computing capabilities in support of global science collaborations through the development of a new class of intelligent, agile networked systems. Its path to success is built upon our ongoing developments in multiple areas, strong ties among our high energy physics, computer and network science, and engineering teams, and our close collaboration with key technology developers and providers deeply engaged in the national strategic computing initiative (NSCI). This paper describes the building of a new class of distributed systems, our work with the leadership computing facilities (LFCs), the use of software-defined networking (SDN) methods, and the use of data-driven methods for the scheduling and optimization of network resources. Sections…

Fast Particle-based Anomaly Detection Algorithm with Variational Autoencoder

Ryan Liu, Abhijith Gandrakota, Jennifer Ngadiuba +2 more

hep-ex · · cited 2× · arXiv ↗ · more like this ·

Model-agnostic anomaly detection is one of the promising approaches in the search for new beyond the standard model physics. In this paper, we present Set-VAE, a particle-based variational autoencoder (VAE) anomaly detection algorithm. We demonstrate a 2x signal efficiency gain compared with traditional subjettiness-based jet selection. Furthermore, with an eye to the future deployment to trigger systems, we propose the CLIP-VAE, which reduces the inference-time cost of anomaly detection by using the KL-divergence loss as the anomaly score, resulting in a 2x acceleration in latency and reducing the caching requirement.

Quantum computing for data analysis in high energy physics

Andrea Delgado, Kathleen E. Hamilton, Prasanna Date +22 more

physics.data-an · · cited 2× · arXiv ↗ · more like this ·

Some of the biggest achievements of the modern era of particle physics, such as the discovery of the Higgs boson, have been made possible by the tremendous effort in building and operating large-scale experiments like the Large Hadron Collider or the Tevatron. In these facilities, the ultimate theory to describe matter at the most fundamental level is constantly probed and verified. These experiments often produce large amounts of data that require storing, processing, and analysis techniques that often push the limits of traditional information processing schemes. Thus, the High-Energy Physics (HEP) field has benefited from advancements in information processing and the development of algorithms and tools for large datasets. More recently, quantum computing applications have been investigated in an effort to understand how the community can benefit from the advantages of quantum…

MonALISA, an agent-based monitoring and control system for the LHC experiments

Justas Balcas, D. Kçira, A. Mughal +3 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 2× · DOI ↗ · more like this ·

MonALISA, which stands for Monitoring Agents using a Large Integrated Services Architecture , has been developed over the last fifteen years by California Insitute of Technology (Caltech) and its partners with the support of the software and computing program of the CMS and ALICE experiments at the Large Hadron Collider (LHC). The framework is based on Dynamic Distributed Service Architecture and is able to provide complete system monitoring, performance metrics of applications, Jobs or services, system control and global optimization services for complex systems. A short overview and status of MonALISA is given in this paper.

The Tracking Machine Learning challenge : Throughput phase

Sabrina Amrouche, Laurent Basara, Paolo Calafiura +18 more

cs.LG · · cited 1× · arXiv ↗ · more like this ·

This paper reports on the second "Throughput" phase of the Tracking Machine Learning (TrackML) challenge on the Codalab platform. As in the first "Accuracy" phase, the participants had to solve a difficult experimental problem linked to tracking accurately the trajectory of particles as e.g. created at the Large Hadron Collider (LHC): given O($10^5$) points, the participants had to connect them into O($10^4$) individual groups that represent the particle trajectories which are approximated helical. While in the first phase only the accuracy mattered, the goal of this second phase was a compromise between the accuracy and the speed of inference. Both were measured on the Codalab platform where the participants had to upload their software. The best three participants had solutions with good accuracy and speed an order of magnitude faster than the state of the art when the challenge was…

Quantum track reconstruction algorithms for non-HEP applications

Kristiane Novotny, Cenk Tüysüz, Carla Rieger +7 more

Artificial Intelligence · Repository for Publications and Research Data (ETH Zurich) · · cited 1× · DOI ↗ · more like this ·

The expected increase in simultaneous collisions creates a challenge for accurate particle track reconstruction in High Luminosity LHC experiments. Similar challenges can be seen in non-HEP trajectory reconstruction use-cases, where tracking and track evaluation algorithms are used. High occupancy, track density, complexity and fast growth therefore exponentially increase the demand of algorithms in terms of time, memory and computing resources. While traditionally Kalman filter (or even simpler algorithms) are used, they are expected to scale worse than quadratic and thus strongly increasing the total processing time. Graph Neural Networks (GNN) are currently explored for HEP, but also non HEP trajectory reconstruction applications. Quantum Computers with their feature of evaluating a very large number of states simultaneously are therefore good candidates for such complex searches in…

SDN-NGenIA, a software defined next generation integrated architecture for HEP and data intensive science

Justas Balcas, T W Hendricks, D. Kçira +4 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

The SDN Next Generation Integrated Architecture (SDN-NGeNIA) project addresses some of the key challenges facing the present and next generations of science programs in HEP, astrophysics, and other fields, whose potential discoveries depend on their ability to distribute, process and analyze globally distributed Petascale to Exascale datasets. The SDN-NGenIA system under development by Caltech and partner HEP and network teams is focused on the coordinated use of network, computing and storage infrastructures, through a set of developments that build on the experience gained in recently completed and previous projects that use dynamic circuits with bandwidth guarantees to support major network flows, as demonstrated across LHC Open Network Environment [1] and in large scale demonstrations over the last three years, and recently integrated with PhEDEx and Asynchronous Stage Out data…