Author

Markus Geimer

32 papers · 2005–2026

2005peak 7 in 20102026

Frequent co-authors

Papers

showing 1–25 of 32 RSS

The Scalasca performance toolset architecture

Markus Geimer, Felix Wolf, Brian J. N. Wylie +3 more

Hardware and Architecture · Concurrency and Computation Practice and Experience · 10 Mar 2010 · cited 347× · DOI ↗ · more like this ·

Abstract Scalasca is a performance toolset that has been specifically designed to analyze parallel application execution behavior on large‐scale systems with many thousands of processors. It offers an incremental performance‐analysis procedure that integrates runtime summaries with in‐depth studies of concurrent behavior via event tracing, adopting a strategy of successively refined measurement configurations. Distinctive features are its ability to identify wait states in applications with very large numbers of processes and to combine these with efficiently summarized local measurements. In this article, we review the current toolset architecture, emphasizing its scalable design and the role of the different components in transforming raw measurement data into knowledge of application execution behavior. The scalability and effectiveness of Scalasca are then surveyed from experience…

Open Trace Format 2: The Next Generation of Scalable Trace Formats and Support Libraries

D. Eschweiler, Michael Wagner, Markus Geimer +3 more

Computer Networks and Communications · Advances in parallel computing · 2012 · cited 104× · DOI ↗ · more like this ·

A well designed event trace data format is the basis of all trace-based analysis methods. In this paper, we introduce the Open Trace Format Version 2 (OTF2). It is a major re-design based on the experiences of its predecessor formats, the Open Trace Format (Version 1) and the EPILOG trace format. It comes with a new file encoding, a close integration in the trace recording system Score-P, and a number of improvements for performance and scalability. Besides the actual format, it consists of a read/write support library with a powerful API plus supportive tools, which are distributed as Open Source software. Furthermore, OTF2 will serve as a joint data source for the analysis tools Scalasca and Vampir in the near future.

Scalable Critical-Path Based Performance Analysis

David Böhme, Felix Wolf, Bronis R. de Supinski +2 more

Hardware and Architecture · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · May 2012 · cited 55× · DOI ↗ · more like this ·

The critical path, which describes the longest execution sequence without wait states in a parallel program, identifies the activities that determine the overall program runtime. Combining knowledge of the critical path with traditional parallel profiles, we have defined a set of compact performance indicators that help answer a variety of important performance-analysis questions, such as identifying load imbalance, quantifying the impact of imbalance on runtime, and characterizing resource consumption. By replaying event traces in parallel, we can calculate these performance indicators in a highly scalable way, making them a suitable analysis instrument for massively parallel programs with thousands of processes. Case studies with real-world parallel applications confirm that - in comparison to traditional profiles - our indicators provide enhanced insight into program behavior…

Identifying the Root Causes of Wait States in Large-Scale Parallel Applications

David Böhme, Markus Geimer, Felix Wolf +1 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · September 2010 · cited 48× · DOI ↗ · more like this ·

Driven by growing application requirements and accelerated by current trends in microprocessor design, the number of processor cores on modern supercomputers is increasing from generation to generation. However, load or communication imbalance prevents many codes from taking advantage of the available parallelism, as delays of single processes may spread wait states across the entire machine. Moreover, when employing complex point-to-point communication patterns, wait states may propagate along far-reaching cause-effect chains that are hard to track manually and that complicate an assessment of the actual costs of an imbalance. Building on earlier work by Meira Jr. et al., we present a scalable approach that identifies program wait states and attributes their costs in terms of resource waste to their original cause. By replaying event traces in parallel both in forward and backward…

Modern Scientific Software Management Using EasyBuild and Lmod

Markus Geimer, Kenneth Hoste, Robert McLay

Computer Networks and Communications · Ghent University Academic Bibliography (Ghent University) · November 2014 · cited 44× · DOI ↗ · more like this ·

HPC user support teams invest a lot of time and effort in installing scientific software for their users. A well-established practice is providing environment modules to make it easy for users to set up their working environment. Several problems remain, however: user support teams lack appropriate tools to manage a scientific software stack easily and consistently, and users still struggle to set up their working environment correctly. In this paper, we present a modern approach to installing (scientific) software that provides a solution to these common issues. We show how EasyBuild, a software build and installation framework, can be used to automatically install software and generate environment modules. By using a hierarchical module naming scheme to offer environment modules to users in a more structured way, and providing Lmod, a modern tool for working with environment modules…

Automatic Trace-Based Performance Analysis of Metacomputing Applications

Daniel Becker, Felix Wolf, Wolfgang Frings +3 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · 2007 · cited 39× · DOI ↗ · more like this ·

The processing power and memory capacity of independent and heterogeneous parallel machines can be combined to form a single parallel system that is more powerful than any of its constituents. However, achieving satisfactory application performance on such a metacomputer is hard because the high latency of inter-machine communication as well as differences in hardware of constituent machines may introduce various types of wait states. In our earlier work, we have demonstrated that automatic pattern search in event traces can identify the sources of wait states in parallel applications running on a single computer. In this article, we describe how this approach can be extended to metacomputing environments with special emphasis on performance problems related to inter-machine communication. In addition, we demonstrate the benefits of our solution using a real-world multi-physics…

Direct and Fast Ray Tracing of NURBS Surfaces

Oliver Abert, Markus Geimer, Stefan Müller

Computer Graphics and Computer-Aided Design · JuSER (Forschungszentrum Jülich) · September 2006 · cited 35× · DOI ↗ · more like this ·

Recently it has been shown that Bezier surfaces can be used as a geometric primitive for interactive ray tracing on a single commodity PC. However, the Bezier representation is restricted, as a large number of control points also imply a high polynomial degree, thus reducing the frame rate significantly. In this work we present a fast, efficient and robust algorithm to ray trace trimmed NURBS surfaces of arbitrary degree. Furthermore, our approach is largely independent of the number of control points of a surface with respect to the rendering performance. Additionally the degree and the number of control points of a surface do not influence the numerical stability of the intersection algorithm. The desired high performance is achieved by taking a novel approach of surface evaluation, which requires only minimal preprocessing. We present a method to transform the computationally…

Verifying Causality between Distant Performance Phenomena in Large-Scale MPI Applications

Marc-André Hermanns, Markus Geimer, Felix Wolf +1 more

Computer Networks and Communications · JuSER (Forschungszentrum Jülich) · 2009 · cited 33× · DOI ↗ · more like this ·

In message-passing applications, the temporal or spatial distance between cause and symptom of a performance problem constitutes a major difficulty in deriving helpful conclusions from performance data. Just knowing the locations of wait states in the program is often insufficient to understand the reason for their occurrence. We present a method for verifying hypotheses on causality between temporally or spatially distant performance phenomena in message-passing applications without altering the application itself. The verification is accomplished by modifying MPI event traces and using them to simulate the hypothetical message-passing behavior. By performing a parallel real-time reenactment of the communication to be simulated using the original execution configuration, we can achieve high scalability and good predictive accuracy in relation to the measured behavior. Not relying on a…

Scalable Collation and Presentation of Call-Path Profile Data with CUBE

Markus Geimer, Björn Kuhlmann, Farzona Pulatova +2 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · September 2007 · cited 24× · OpenAlex ↗ · more like this ·

Developing performance-analysis tools for parallel applications running on thousands of processors is extremely challenging due to the vast amount of performance data generated, which may conflict with available processing capacity, memory limitations, and file system performance especially when large numbers of files have to be written simultaneously. In this article, we describe how the scalability of CUBE, a presentation component for call-path profiles in the SCALASCA toolkit, has been improved to more efficiently handle data sets from thousands of processes. First, the speed of writing suitable input data sets has been increased by eliminating the need to create large numbers of temporary files. Second, CUBE’s capacity to hold and display data sets has been raised by shrinking their memory footprint. Third, after introducing a flexible client-server architecture, it is no longer…

Interactive Ray Tracing of Trimmed Bicubic Bézier Surfaces without Triangulation

Markus Geimer, Oliver Abert

Computer Graphics and Computer-Aided Design · Digital Library (University of West Bohemia) · 2005 · cited 24× · OpenAlex ↗ · more like this ·

By carefully exploiting the resources of today's computer hardware, interactive ray tracing recently became\nreality even on a single commodity PC. In most of these implementations triangles are used as the only\ngeometric primitive. However, direct rendering of free-form surfaces would be advantageous for a large number\nof applications, since robust tessellation of complex scenes into triangles is a very time-consuming process.\nAdditionally, scenes consisting of free-form surfaces require less memory and provide a much higher precision\nresulting in less rendering artifacts.\nIn this paper, we present our implementation of an efficient and robust algorithm for rapidly finding\nintersections between rays and trimmed bicubic Bézier surfaces. Using SIMD instructions provided by many of\ntoday's CPUs, we perform the intersection test of a packet of four rays with a single Bézier surface…

LARGE-SCALE PERFORMANCE ANALYSIS OF SWEEP3D WITH THE SCALASCA TOOLSET

Brian J. N. Wylie, Markus Geimer, Bernd Mohr +3 more

Hardware and Architecture · Parallel Processing Letters · December 2010 · cited 21× · DOI ↗ · more like this ·

Cray XT and IBM Blue Gene systems present current alternative approaches to constructing leadership computer systems relying on applications being able to exploit very large configurations of processor cores, and associated analysis tools must also scale commensurately to isolate and quantify performance issues that manifest at the largest scales. In studying the scalability of the Scalasca performance analysis toolset to several hundred thousand MPI processes on XT5 and BG/P systems, we investigated a progressive execution performance deterioration of the well-known ASCI Sweep3D compact application. Scalasca runtime summarization analysis quantified MPI communication time that correlated with computational imbalance, and automated trace analysis confirmed growing amounts of MPI waiting times. Further instrumentation, measurement and analyses pinpointed a conditional section of highly…

Performance Measurement and Analysis of Large-Scale Parallel Applications on Leadership Computing Systems

Brian J. N. Wylie, Markus Geimer, Felix Wolf

Hardware and Architecture · Scientific Programming · 2008 · cited 21× · DOI ↗ · more like this ·

Developers of applications with large-scale computing requirements are currently presented with a variety of high-performance systems optimised for message-passing, however, effectively exploiting the available computing resources remains a major challenge. In addition to fundamental application scalability characteristics, application and system peculiarities often only manifest at extreme scales, requiring highly scalable performance measurement and analysis tools that are convenient to incorporate in application development and tuning activities. We present our experiences with a multigrid solver benchmark and state-of-the-art real-world applications for numerical weather prediction and computational fluid dynamics, on three quite different multi-thousand-processor supercomputer systems – Cray XT3/4, MareNostrum & Blue Gene/L – using the newly-developed SCALASCA toolset to…

Characterizing Load and Communication Imbalance in Large-Scale Parallel Applications

David Böhme, Felix Wolf, Markus Geimer

Hardware and Architecture · Zenodo (CERN European Organization for Nuclear Research) · May 2012 · cited 18× · DOI ↗ · more like this ·

Load or communication imbalance prevents many codes from taking advantage of the parallelism available on modern supercomputers. We present two scalable methods to highlight imbalance in parallel programs: The first method identifies delays that inflict wait states at subsequent synchronization points, and attributes their costs in terms of resource waste to the original cause. The second method combines knowledge of the critical path with traditional parallel profiles to derive a set of compact performance indicators that help answer a variety of important performance-analysis questions, such as identifying load imbalance, quantifying the impact of imbalance on runtime, and characterizing resource consumption. Both methods employ a highly scalable parallel replay of event traces, making them a suitable analysis instrument for massively parallel MPI programs with tens of thousands of…

Profiling Hybrid HMPP Applications with Score-P on Heterogeneous Hardware

Schlütter Marc, Peter Philippen, Laurent Morin +2 more

Hardware and Architecture · Advances in parallel computing · 2014 · cited 12× · DOI ↗ · more like this ·

In heterogeneous environments with multi-core systems and accelerators, programming and optimizing large parallel applications turns into a time-intensive and hardware-dependent challenge. To assist application developers in this process, a number of tools and high-level compilers have been developed. Directive-based programming models such as HMPP and OpenACC provide abstractions over low-level GPU programming models,such as CUDA or OpenCL. The compilers developed by CAPS automatically transform the pragma-annotated application code into low-level code, thereby allowing the parallelization and optimization for a given accelerator hardware. To analyze the performance of parallel applications, multiple partners in Germany and the US jointly develop the community measurement infrastructure Score-P. Score-P gathers performance execution profiles, which can be presented and analyzed within…

Catching Idlers with Ease

Guoyong Mao, David Böhme, Marc-André Hermanns +3 more

Hardware and Architecture · 29 Aug 2014 · cited 5× · DOI ↗ · more like this ·

Load imbalance usually introduces wait states into the execution of parallel programs. Being able to identify and quantify wait states is therefore essential for the diagnosis and remediation of this phenomenon. An established method of detecting wait states is to generate event traces and compare relevant timestamps across process boundaries. However, large trace volumes usually prevent the analysis of longer execution periods. In this paper, we present an extremely lightweight wait-state profiler which does not rely on traces that can be used to estimate wait states in MPI codes with arbitrarily long runtimes. The profiler combines scalability with portability and low overhead.

Large-scale performance analysis of PFLOTRAN with Scalasca

Brian J. N. Wylie, Markus Geimer

Computer Networks and Communications · JuSER (Forschungszentrum Jülich) · 2011 · cited 5× · OpenAlex ↗ · more like this ·

The PFLOTRAN code for multiphase subsurface flow and reactive transport has featured prominently in US De- partment of Energy SciDAC and INCITE programmes, where is has been used to simulate migration of radionucleide contaminants in groundwater. As part of its ongoing development, execution performance with up to 128k processor cores on Cray XT and IBM BG/P systems has been investigated, and a variety of aspects have been identified to inhibit PFLOTRAN performance at larger scales using the open-source Scalasca toolset. Scalability of Scalasca measurements and analyses themselves, previously demon- strated with a range of applications and benchmarks, required re-engineering in key areas to handle the complexities of PFLOTRAN executions employing MPI within PETSc, LAPACK, BLAS and HDF5 libraries at large scale.

Scalable performance analysis of large-scale parallel applications on Cray XT systems with Scalasca

Brian J. N. Wylie, Daniel Becker, David Böhme +6 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · May 2010 · cited 3× · OpenAlex ↗ · more like this ·

ABSTRACT: The open-source Scalasca toolset (available from www.scalasca.org) supports integrated runtime summarization and automated trace analysis on a diverse range of HPC computer systems. An HPC-Europa2 visit to EPCC in 2009 resulted in significantly enhanced support for Cray XT systems, particularly the auxilliary programming environments and hybrid OpenMP/MPI. Combined with its previously demonstrated extreme scalability and portable performance analyses comparison capabilities, Scalasca has been used to analyse and tune numerous key applications (and benchmarks) on Cray XT and other PRACE prototype systems, from which experience with a representative selection is reviewed. KEYWORDS: OpenMP/MPI, parallel/distributed systems, performance measurement and analysis tools, scalability 1

Hands-on Practical Hybrid Parallel Application Performance Engineering

Christian Feld, Brian J. N. Wylie, Bert Wesarg +2 more

Computer Networks and Communications · JuSER (Forschungszentrum Jülich) · 2013 · cited 2× · OpenAlex ↗ · more like this ·

This tutorial presents state-of-the-art performance tools for leading-edge HPC systems founded on the community-developed Score-P instrumentation and measurement infrastructure, demonstrating how they can be used for performance engineering of effective scientific applications based on standard MPI, OpenMP, hybrid combination of both, and increasingly common usage of accelerators. Parallel performance tools from the Virtual Institute – High Productivity Supercomputing (VI-HPS) are introduced and featured in hands-on exercises with Score-P, Scalasca, Vampir, and TAU. We present the complete workflow of performance engineering, including instrumentation, measurement (profiling and tracing, timing and PAPI hardware counters), data storage, analysis, tuning, and visualization. Emphasis is placed on how tools are used in combination for identifying performance problems and investigating…

Scalable detection of MPI-2 remote memory access inefficiency patterns

Marc-André Hermanns, Markus Geimer, Bernd Mohr +1 more

Hardware and Architecture · The International Journal of High Performance Computing Applications · 8 Jun 2011 · cited 2× · DOI ↗ · more like this ·

Wait states in parallel applications can be identified by scanning event traces for characteristic patterns. In our earlier work we defined such inefficiency patterns for MPI-2 one-sided communication, although still based on a serial trace-analysis scheme with limited scalability. In this article we show how wait states in one-sided communications can be detected in a more scalable fashion by taking advantage of a new scalable trace-analysis approach based on a parallel replay, which was originally developed for MPI-1 point-to-point and collective communication. Moreover, we demonstrate the scalability of our method and its usefulness for the optimization cycle with applications running on up to 32,768 cores.

Synchronizing the Timestamps of Concurrent Events in Traces of Hybrid MPI/OpenMP Applications

Daniel Becker, Markus Geimer, Rolf Rabenseifner +1 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · September 2010 · cited 2× · DOI ↗ · more like this ·

Event traces are helpful in understanding the performance behavior of parallel applications since they allow the in-depth analysis of communication and synchronization patterns. However, the absence of synchronized clocks on most cluster systems may render the analysis ineffective because inaccurate relative event timings may misrepresent the logical event order and lead to errors when quantifying the impact of certain behaviors or confuse the users of time-line visualization tools by showing messages flowing backward in time. In our earlier work, we have developed a scalable algorithm that eliminates inconsistent inter-process timings postmortem in traces of pure MPI applications. Since hybrid programming, the combination of MPI and OpenMP in a single application, is becoming more popular on clusters in response to rising numbers of cores per chip and widening shared-memory nodes, we…

A generic attribute extension to OTF and its use for MPI replay

Andreas Knüpfer, Markus Geimer, Johannes Spazier +4 more

Computer Networks and Communications · Procedia Computer Science · May 2010 · cited 2× · DOI ↗ · more like this ·

Data formats are important components for parallel event tracing tools used for debugging and performance analysis. This paper presents a generic extension mechanism for the Open Trace Format (OTF) that allows to add arbitrary data to the existing event data types. This avoids the need to frequently adapt the data format and the library API to accommodate new usage scenarios. The replay of MPI communication is demonstrated as a real-world example that requires an extension. Several other application scenarios that would benefit from additional data about certain event types are mentioned.

Scalable Performance Analysis Methods for the Next Generation of Supercomputers

Felix Wolf, Daniel Becker, Markus Geimer +1 more

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · February 2008 · cited 2× · OpenAlex ↗ · more like this ·

Facing increasing power dissipation and little instruction-level parallelism left to exploit, computer architects are realizing further performance gains by using larger numbers of moderately fast processor cores rather than by further increasing the speed of uni-processors. As a consequence, supercomputing applications are required to harness much higher degrees of parallelism in order to satisfy their growing demand for computing power. However, writing code that runs efficiently on large numbers of processors remains a significant challenge. To address this challenge, the Helmholtz-University Young Investigators Group Performance Analysis of Parallel Programs at the Jülich Supercomputing Centre develops performanceanalysis tools to diagnose inefficiencies in supercomputer applications and works with application developers to analyze and improve the performance of their codes. In this…

An Event Model for Trace-Based Performance Analysis of MPI Partitioned Point-to-Point Communication

Isabel Thärigen, Marc-André Hermanns, Markus Geimer

Hardware and Architecture · JuSER (Forschungszentrum Jülich) · 10 Nov 2023 · cited 1× · DOI ↗ · more like this ·

The MPI 4.0 standard introduced the concept of partitioned point-to-point communication. One facet that may help in encouraging application developers to use this new concept in their programs is the availability of proper tool support in a timely manner. In this paper, we therefore propose nine new events extending the OTF2 event model to accurately represent the runtime behavior of partitioned point-to-point communication. We then demonstrate the suitability of these extensions with three different use cases in the context of performance analysis. In particular, we showcase a prototype implementation of an extended waitstate analysis in the Scalasca trace analyzer, and discuss further potential use cases in the realm of trace visualization and simulation.

Best practice regarding the three P's: profiling, portability andprovenance when running HPC geoscientific applications

Wendy Sharples, Ilya Zhukov, Markus Geimer +7 more

Computer Networks and Communications · 27 Oct 2017 · cited 1× · DOI ↗ · more like this ·

Abstract. Geoscientific modeling is constantly evolving, with next generation geoscientific models and applications placing high demands on high performance computing (HPC) resources. These demands are being met by new developments in HPC architectures, software libraries, and infrastructures. New HPC developments require new programming paradigms leading to substantial investment in model porting, tuning, and refactoring of complicated legacy code in order to use these resources effectively. In addition to the challenge of new massively parallel HPC systems, reproducibility of simulation and analysis results is of great concern, as the next generation geoscientific models are based on complex model implementations and profiling, modeling and data processing workflows. Thus, in order to reduce both the duration and the cost of code migration, aid in the development of new models or…

The Score-P performance tools ecosystem

Christian Feld, Alexandru Calotoiu, Gregor Corbin +9 more

Hardware and Architecture · Frontiers in High Performance Computing · 24 Mar 2026 · cited 0× · DOI ↗ · more like this ·

With the first exascale computing systems in production, tuning and scaling HPC applications to fully utilize the available hardware resources has become more important than ever. Thus, there is a strong need for software tools that assist application developers with this task. The Score-P instrumentation and measurement infrastructure plays a major role in filling this gap. Score-P is a community-driven, highly scalable tool suite for profiling and event tracing of massively parallel HPC application codes, and aimed to be easy to use. It provides measurement data via common data formats and runtime interfaces for a variety of complementary analysis tools developed by multiple institutions and companies, allowing users to gain insights into the communication, synchronization, input/output, and scaling behavior of their applications, pinpointing performance bottlenecks and their causes.…