arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Max Fischer

34 papers · 2013–2025

2013: 12014: 22015: 52016: 22017: 12018: 32019: 32020: 52021: 32022: 02023: 22024: 22025: 5
2013peak 5 in 20152025

Frequent co-authors

Papers

showing 1–25 of 34 RSS

Prediction of Synergistic Toxicity of Binary Mixtures to<i>Vibrio fischeri</i>Based on Biomolecular Interaction Networks

Jongwoon Kim, Max Fischer, Volkhard Helms

Computational Theory and Mathematics · Chemical Research in Toxicology · · cited 13× · DOI ↗ · more like this ·

The paradigm of chemical safety assessment is shifting from 'chemical management focusing on single chemicals' to 'product management extending to mixtures and articles'. However, because of the enormous combinatorial complexity, testing the toxicity of all conceivable mixture products is currently not feasible. There exist only few models that allow predicting the synergistic toxicity potentially caused by toxicological interactions among components. In this study, we present a novel approach to qualitatively predict the synergistic toxicity of binary mixtures to Vibrio fischeri. On the basis of information derived from protein-chemical and protein-protein interaction networks, we trained machine learning models for classifying chemical mixtures to have synergistic or nonsynergistic toxicity with accuracies and an area under the receiver operating characteristic (ROC) curve (AUC) up to…

Lightweight dynamic integration of opportunistic resources

Max Fischer, Eileen Kuehn, M. Giffels +3 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 11× · DOI ↗ · more like this ·

To satisfy future computing demands of the Worldwide LHC Computing Grid (WLCG), opportunistic usage of third-party resources is a promising approach. While the means to make such resources compatible with WLCG requirements are largely satisfied by virtual machines and containers technologies, strategies to acquire and disband many resources from many providers are still a focus of current research. Existing meta-schedulers that manage resources in the WLCG are hitting the limits of their design when tasked to manage heterogeneous resources from many diverse resource providers. To provide opportunistic resources to the WLCG as part of a regular WLCG site, we propose a new meta-scheduling approach suitable for opportunistic, heterogeneous resource provisioning. Instead of anticipating future resource requirements, our approach observes resource usage and promotes well-used resources.…

Effective Dynamic Integration and Utilization of Heterogenous Compute Resources

Max Fischer, M. Giffels, A. Heiss +5 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 9× · DOI ↗ · more like this ·

Increased operational effectiveness and the dynamic integration of only temporarily available compute resources (opportunistic resources) becomes more and more important in the next decade, due to the scarcity of resources for future high energy physics experiments as well as the desired integration of cloud and high performance computing resources. This results in a more heterogenous compute environment, which gives rise to huge challenges for the computing operation teams of the experiments. At the Karlsruhe Institute of Technology (KIT) we design solutions to tackle these challenges. In order to ensure an efficient utilization of opportunistic resources and unified access to the entire infrastructure, we developed the Transparent Adaptive Resource Dynamic Integration System (TARDIS). A scalable multi-agent resource manager providing interfaces to provision as well as dynamically and…

Extending the distributed computing infrastructure of the CMS experiment with HPC resources

Jennifer Adelman-McCarthy, T. Boccali, René Caspart +9 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 6× · DOI ↗ · more like this ·

Abstract Particle accelerators are an important tool to study the fundamental properties of elementary particles. Currently the highest energy accelerator is the LHC at CERN, in Geneva, Switzerland. Each of its four major detectors, such as the CMS detector, produces dozens of Petabytes of data per year to be analyzed by a large international collaboration. The processing is carried out on the Worldwide LHC Computing Grid, that spans over more than 170 compute centers around the world and is used by a number of particle physics experiments. Recently the LHC experiments were encouraged to make increasing use of HPC resources. While Grid resources are homogeneous with respect to the used Grid middleware, HPC installations can be very different in their setup. In order to integrate HPC resources into the highly automatized processing setups of the CMS experiment a number of challenges need…

Monitoring Data Streams at Process Level in Scientific Big Data Batch Clusters

Eileen Kuehn, Max Fischer, Christopher Jung +2 more

Computer Networks and Communications · · cited 6× · DOI ↗ · more like this ·

The operation of scientific big data centres requires an overall monitoring and perception of system components. Insights into internal and external network traffic is of high importance for understanding specific data flows regarding storage accesses, firewall configurations, and the scheduling of batch jobs on clusters for computing/analysis of data. However, wide adoptions of federated storage, the handling of numerous job on many-core nodes, or the execution of job pilots inside the batch system complicate current data stream monitoring attempts. Therefore, the rising complexity requires new approaches to extend available solutions. As existing batch system monitoring and related system monitoring tools do not support measurements at batch job level, a new tool has been developed and put into operation at the Grid Ka data and computing centre at KIT for monitoring continuous data…

Transparent Integration of Opportunistic Resources into the WLCG Compute Infrastructure

Michael Böhler, René Caspart, Max Fischer +7 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 5× · DOI ↗ · more like this ·

The inclusion of opportunistic resources, for example from High Performance Computing (HPC) centers or cloud providers, is an important contribution to bridging the gap between existing resources and future needs by the LHC collaborations, especially for the HL-LHC era. However, the integration of these resources poses new challenges and often needs to happen in a highly dynamic manner. To enable an effective and lightweight integration of these resources, the tools COBalD and TARDIS are developed at KIT. In this contribution we report on the infrastructure we use to dynamically offer opportunistic resources to collaborations in the World Wide LHC Computing Grid (WLCG). The core components are COBalD/TARDIS, HTCondor, CVMFS and modern virtualization technology. The challenging task of managing the opportunistic resources is performed by COBalD/TARDIS. We showcase the challenges…

Setup and commissioning of a high-throughput analysis cluster

René Caspart, Max Fischer, M. Giffels +6 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 5× · DOI ↗ · more like this ·

Current and future end-user analyses and workflows in High Energy Physics demand the processing of growing amounts of data. This plays a major role when looking at the demands in the context of the High-Luminosity-LHC. In order to keep the processing time and turn-around cycles as low as possible analysis clusters optimized with respect to these demands can be used. Since hyper converged servers offer a good combination of compute power and local storage, they form the ideal basis for these clusters. In this contribution we report on the setup and commissioning of a dedicated analysis cluster setup at Karlsruhe Institute of Technology. This cluster was designed for use cases demanding high data-throughput. Based on hyper converged servers this cluster offers 500 job slots and 1 PB of local storage. Combined with the 100 Gb network connection between the servers and a 200 Gb uplink to…

Advancing throughput of HEP analysis work-flows using caching concepts

René Caspart, Max Fischer, M. Giffels +6 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 5× · DOI ↗ · more like this ·

High throughput and short turnaround cycles are core requirements for efficient processing of data-intense end-user analyses in High Energy Physics (HEP). Together with the tremendously increasing amount of data to be processed, this leads to enormous challenges for HEP storage systems, networks and the data distribution to computing resources for end-user analyses. Bringing data close to the computing resource is a very promising approach to solve throughput limitations and improve the overall performance. However, achieving data locality by placing multiple conventional caches inside a distributed computing infrastructure leads to redundant data placement and inefficient usage of the limited cache volume. The solution is a coordinated placement of critical data on computing resources, which enables matching each process of an analysis work-flow to its most suitable worker node in…

<b>Dynamic Integration and Management of Opportunistic Resources for HEP</b>

Matthias J. Schnepf, R. F. Von Cube, Max Fischer +7 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 4× · DOI ↗ · more like this ·

Demand for computing resources in high energy physics (HEP) shows a highly dynamic behavior, while the provided resources by the Worldwide LHC Computing Grid (WLCG) remains static. It has become evident that opportunistic resources such as High Performance Computing (HPC) centers and commercial clouds are well suited to cover peak loads. However, the utilization of these resources gives rise to new levels of complexity, e.g. resources need to be managed highly dynamically and HEP applications require a very specific software environment usually not provided at opportunistic resources. Furthermore, aspects to consider are limitations in network bandwidth causing I/O-intensive workflows to run inefficiently. The key component to dynamically run HEP applications on opportunistic resources is the utilization of modern container and virtualization technologies. Based on these technologies…

Tier 3 batch system data locality via managed caches

Max Fischer, M. Giffels, Christopher Jung +2 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 4× · DOI ↗ · more like this ·

Modern data processing increasingly relies on data locality for performance and scalability, whereas the common HEP approaches aim for uniform resource pools with minimal locality, recently even across site boundaries. To combine advantages of both, the High-Performance Data Analysis (HPDA) Tier 3 concept opportunistically establishes data locality via coordinated caches. In accordance with HEP Tier 3 activities, the design incorporates two major assumptions: First, only a fraction of data is accessed regularly and thus the deciding factor for overall throughput. Second, data access may fallback to non-local, making permanent local data availability an ineficient resource usage strategy. Based on this, the HPDA design generically extends available storage hierarchies into the batch system. Using the batch system itself for scheduling file locality, an array of independent caches on the…

Predicting resource usage for enhanced job scheduling for opportunistic resources in HEP

Eileen Kuehn, Max Fischer, Sven Lange +2 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 3× · DOI ↗ · more like this ·

To overcome the computing challenge in High Energy Physics available resources must be utilized as efficiently as possible. This targets algorithmic challenges in the workflows itself but also the scheduling of jobs to compute resources. To enable the best possible scheduling, job schedulers require accurate information about resource consumption of a job before it is even executed. It is the responsibility of the user to provide an accurate resource estimate required for jobs. However, this is quite a challenge for users as they (i) want to ensure their jobs to run correctly, (ii) must manage to deal with heterogeneous compute resources and (iii) face intransparent library dependencies and frequent updates. Users therefore tend to specify resource requests with an ample buffer. This inaccuracy results in inefficient utilisation by either blocking unused resources or exceeding reserved…

Mastering Opportunistic Computing Resources for HEP

Matthias J. Schnepf, Christoph Heidecker, Max Fischer +5 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 3× · DOI ↗ · more like this ·

As results of the excellent LHC performance in 2016, more data than expected has been recorded leading to a higher demand for computing resources. It is already foreseeable that for the current and upcoming run periods a flat computing budget and the expected technology advance will not be sufficient to meet the future requirements. This results in a growing gap between supplied and demanded resources. One option to reduce the emerging lack of computing resources is the utilization of opportunistic resources such as local university clusters, public and commercial cloud providers, HPC centers and volunteer computing. However, to use opportunistic resources additional challenges have to be tackled. At the Karlsruhe Institute of Technology (KIT) an infrastructure to dynamically use opportunistic resources is built up. In this paper tools, experiences, future plans and possible…

MIRAbot: A Rearview Mirror Driving Assistant for Semi-Autonomous Vehicles

Max Fischer, Y. H. Kim, Geumjin Lee +5 more

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

This video introduces MIRAbot, a reimagined rearview mirror designed as a driving assistant for SAE Level 3 semi-autonomous vehicles (see Figure 1). While Level 3 vehicles allow hands-free, eyes-off driving in specific conditions, drivers must remain ready to take control when necessary [3]. Despite their convenience, these vehicles face challenges in earning drivers' trust and achieving widespread adoption. MIRAbot seeks to enhance the semi-autonomous driving experience by making it more trustworthy and accessible to a diverse range of users. MIRAbot seamlessly switches between functioning as a standard rearview mirror and an interactive assistant, supporting manual driving, autonomous driving, and the transitions between them (see Figure 2). Building on prior research into robotic rearview mirror ornaments for handover pre-alerts [1, 2], MIRAbot enriches the in-car experience with…

Adoption of ARC-CE and HTCondor at GridKa Tier 1

Max Fischer, Eileen Kuehn, M. Schnepf +2 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 2× · DOI ↗ · more like this ·

The GridKa Tier 1 data and computing center hosts a significant share of WLCG processing resources. Providing these resources to all major LHC and other VOs requires efficient, scalable and reliable cluster management. To satisfy this, GridKa has recently migrated its batch resources from CREAM-CE and PBS to ARC-CE and HTCondor. This contribution discusses the key highlights of the adoption of this middleware at the scale of a European Tier 1 center: As the largest WLCG Tier 1 using the ARC-CE plus HTCondor stack, GridKa is exemplary for migrating more than 20 000 cores over the time span of only a few weeks. Supporting multiple VOs, we have extensively studied the constraints and possibilities of scheduling jobs of vastly different requirements. We present a robust and maintainable optimization of resource utilization which still respects constraints desired by VOs. Furthermore, we…

Provisioning of data locality for HEP analysis workflows

Christoph Heidecker, Matthias J. Schnepf, Eileen Kuehn +3 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 2× · DOI ↗ · more like this ·

The heavily increasing amount of data produced by current experiments in high energy particle physics challenge both end users and providers of computing resources. The boosted data rates and the complexity of analyses require huge datasets being processed in short turnaround cycles. Usually, data storages and computing farms are deployed by different providers, which leads to data delocalization and a strong influence of the interconnection transfer rates. The CMS collaboration at KIT has developed a prototype enabling data locality for HEP analysis processing via two concepts. A coordinated and distributed caching approach that reduce the limiting factor of data transfers by joining local high performance devices with large background storages were tested. Thereby, a throughput optimization was reached by selecting and allocating critical data within user work-flows. A highly…

High Performance Data Analysis via Coordinated Caches

Max Fischer, C Metzlaff, Eileen Kühn +4 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 2× · DOI ↗ · more like this ·

With the second run period of the LHC, high energy physics collaborations will have to face increasing computing infrastructural needs. Opportunistic resources are expected to absorb many computationally expensive tasks, such as Monte Carlo event simulation. This leaves dedicated HEP infrastructure with an increased load of analysis tasks that in turn will need to process an increased volume of data. In addition to storage capacities, a key factor for future computing infrastructure is therefore input bandwidth available per core. Modern data analysis infrastructure relies on one of two paradigms: data is kept on dedicated storage and accessed via network or distributed over all compute nodes and accessed locally. Dedicated storage allows data volume to grow independently of processing capacities, whereas local access allows processing capacities to scale linearly. However, with the…

AUDITOR

M. Boehler, R. F. Von Cube, Max Fischer +8 more

Computer Networks and Communications · The European Physical Journal C · · cited 1× · DOI ↗ · more like this ·

Abstract Increasing computing demands and concerns about energy efficiency in high-performance and high-throughput computing are driving forces in the search for more efficient ways to use available resources. Sharing resources of an underutilised cluster with a high workload cluster increases the efficiency of the underutilised cluster. The software COBalD/TARDIS can dynamically and transparently integrate and disintegrate such resources. However, sharing resources also requires accounting. AUDITOR ( A cco u nting D ata Handl i ng T oolbox for O pportunistic R esources) is a modular accounting ecosystem that is able to cover a wide range of use cases and infrastructures. Accounting data are gathered via so-called collectors, which are designed to monitor batch systems, COBalD/TARDIS, cloud schedulers, or other sources of information. The data is stored in a database, and access to the…

Improving Noisy Hybrid Quantum Graph Neural Networks for Particle Decay Tree Reconstruction

Melvin Strobl, Eileen Kuehn, Max Fischer +1 more

Artificial Intelligence · EPJ Web of Conferences · · cited 1× · DOI ↗ · more like this ·

With the emergence of the research field of Quantum Machine Learning, interest in finding advantageous real-world applications is growing as well. However, challenges concerning the number of available qubits on Noisy Intermediate Scale Quantum (NISQ) devices and accuracy losses due to hardware imperfections still remain and limit the applicability of such approaches in real-world scenarios. Therefore, for simplification, most studies assume nearly noise-free conditions as they are expected with logical, i.e. error-corrected, qubits instead of real qubits provided by hardware. However, the number of logical qubits is expected to scale slowly as they require a high number of real qubits for error correction. This is our motivation to deal with noise as an unavoidable, non-negligible problem on NISQ devices. As an application, we use the example of particle decay tree reconstruction as a…

Opportunistic transparent extension of a WLCG Tier 2 center using HPC resources

R. F. Von Cube, René Caspart, Max Fischer +4 more

Computer Networks and Communications · EPJ Web of Conferences · · cited 1× · DOI ↗ · more like this ·

Computing resource needs are expected to increase drastically in the future. The HEP experiments ATLAS and CMS foresee an increase of a factor of 5-10 in the volume of recorded data in the upcoming years. The current infrastructure, namely the WLCG, is not sufficient to meet the demands in terms of computing and storage resources. The usage of non HEP specific resources is one way to reduce this shortage. However, using them comes at a cost: First, with multiple of such resources at hand, it gets more and more diffcult for the single user, as each resource normally requires its own authentication and has its own way of accessing it. Second, as they are not specifically designed for HEP workflows, they might lack dedicated software or other necessary services. Allocating the resources at the different providers can be done by COBalD/TARDIS, developed at KIT. The resource manager…

HEP Analyses on Dynamically Allocated Opportunistic Computing Resources

Matthias J. Schnepf, R. F. Von Cube, Christoph Heidecker +7 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

Abstract The current experiments in high energy physics (HEP) have a huge data rate. To convert the measured data, an enormous number of computing resources is needed and will further increase with upgraded and newer experiments. To fulfill the ever-growing demand the allocation of additional, potentially only temporary available non-HEP dedicated resources is important. These so-called opportunistic resources cannot only be used for analyses in general but are also well-suited to cover the typical unpredictable peak demands for computing resources. For both use cases, the temporary availability of the opportunistic resources requires a dynamic allocation, integration, and management, while their heterogeneity requires optimization to maintain high resource utilization by allocating best matching resources. To find the best matching resources which should be allocated is challenging due…

Opportunistic data locality for end user data analysis

Max Fischer, Christoph Heidecker, Eileen Kuehn +5 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

With the increasing data volume of LHC Run2, user analyses are evolving towards increasing data throughput. This evolution translates to higher requirements for efficiency and scalability of the underlying analysis infrastructure. We approach this issue with a new middleware to optimise data access: a layer of coordinated caches transparently provides data locality for high-throughput analyses. We demonstrated the feasibility of this approach with a prototype used for analyses of the CMS working groups at KIT. In this paper, we present our experience both with the approach in general, and our prototype in specific.

Active Job Monitoring in Pilots

Eileen Kuehn, Max Fischer, M. Giffels +2 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

Recent developments in high energy physics (HEP) including multi-core jobs and multi-core pilots require data centres to gain a deep understanding of the system to monitor, design, and upgrade computing clusters. Networking is a critical component. Especially the increased usage of data federations, for example in diskless computing centres or as a fall-back solution, relies on WAN connectivity and availability. The specific demands of different experiments and communities, but also the need for identification of misbehaving batch jobs, requires an active monitoring. Existing monitoring tools are not capable of measuring fine-grained information at batch job level. This complicates network-aware scheduling and optimisations. In addition, pilots add another layer of abstraction. They behave like batch systems themselves by managing and executing payloads of jobs internally. The number of…

Benchmark of a Cubieboard cluster

Matthias J. Schnepf, Diana Gudu, B Rische +3 more

Hardware and Architecture · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

We built a cluster of ARM-based Cubieboards2 which has a SATA interface to connect a harddrive. This cluster was set up as a storage system using Ceph and as a compute cluster for high energy physics analyses. To study the performance in these applications, we ran two benchmarks on this cluster. We also checked the energy efficiency of the cluster using the preseted benchmarks. Performance and energy efficency of our cluster were compared with a network-attached storage (NAS), and with a desktop PC.

Analyzing data flows of WLCG jobs at batch job level

Eileen Kuehn, Max Fischer, M. Giffels +2 more

Computer Networks and Communications · Journal of Physics Conference Series · · cited 1× · DOI ↗ · more like this ·

With the introduction of federated data access to the workows of WLCG, it is becoming increasingly important for data centers to understand specific data ows regarding storage element accesses, firewall configurations, as well as the scheduling of batch jobs themselves. As existing batch system monitoring and related system monitoring tools do not support measurements at batch job level, a new tool has been developed and put into operation at the GridKa Tier 1 center for monitoring continuous data streams and characteristics of WLCG jobs and pilots. Long term measurements and data collection are in progress. These measurements already have been proven to be useful analyzing misbehaviors and various issues. Therefore we aim for an automated, realtime approach for anomaly detection. As a requirement, prototypes for standard workows have to be examined. Based on measurements of several…

Experience with ARM WNs at the WLCG Tier1 GridKa

Armin Alfredo Krull, Matthias J. Schnepf, Max Fischer +1 more

Hardware and Architecture · EPJ Web of Conferences · · cited 0× · DOI ↗ · more like this ·

Computing centers are always looking for new worker nodes (WNs) that can reduce operational costs, especially energy consumption, and provide higher performance. ARM CPUs promise higher power efficiency than x86 CPUs. The WLCG Tier1 center GridKa will therefore partially use WNs with ARM CPUs. It has already conducted various energy consumption and performance benchmarkings for several such ARM WNs based on the benchmark HEPScore23 as well as a CPU frequency scan to determine their best performance and power efficiency. We present the results of these benchmarkings in comparison to those of the x86 WNs currently operated at GridKa and summarize the progress made at GridKa in providing ARM WNs to the HEP community.