arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Tim Hotfilter

17 papers · 2019–2024

2019: 12020: 22021: 12022: 32023: 72024: 3
2019peak 7 in 20232024

Frequent co-authors

Papers

showing 1–17 of 17 RSS

FLECSim-SoC: A Flexible End-to-End Co-Design Simulation Framework for System on Chips

Tim Hotfilter, Julian Hoefer, Fabian Kres +2 more

Hardware and Architecture · · cited 8× · DOI ↗ · more like this ·

Hardware accelerators for deep neural networks (DNNs) have established themselves over the past decade. Most developments have worked towards higher efficiency with an individual application in mind. This highlights the strong relationship between co-designing the accelerator together with the requirements of the application. Currently for a structured design flow, however, it lacks a tool to evaluate a DNN accelerator embedded in a System on Chip (SoC) platform.To address this gap in the state of the art, we introduce FLECSim, a tool framework that enables an end-to-end simulation of an SoC with dedicated accelerators, CPUs and memories. FLECSim offers flexible configuration of the system and straightforward integration of new accelerator models in both SystemC and RTL, which allows for early design verification. During the simulation, FLECSim provides metrics of the SoC, which can be…

Towards Reconfigurable Accelerators in HPC: Designing a Multipurpose eFPGA Tile for Heterogeneous SoCs

Tim Hotfilter, Fabian Kreß, Fabian Kempf +7 more

Hardware and Architecture · 2022 Design, Automation & Test in Europe Conference & Exhibition (DATE) · · cited 6× · DOI ↗ · more like this ·

The goal of modern high performance computing platforms is to combine low power consumption and high throughput. Within the European Processor Initiative (EPI), such an SoC platform to meet the novel exascale requirements is built and investigated. As part of this project, we introduce an embedded Field Programmable Gate Array (eFPGA), adding flexibility to accelerate various workloads. In this article, we show our approach to design the eFPGA tile that supports the EPI SoC. While eFPGAs are inherently reconfigurable, their initial design has to be determined for tape-out. The design space of the eFPGA is explored and evaluated with different configurations of two HPC workloads, covering control and dataflow heavy applications. As a result, we present a well-balanced eFPGA design that can host several use cases and potential future ones by allocating 1% of the total EPI SoC area.…

ATLAS: An Approximate Time-Series LSTM Accelerator for Low-Power IoT Applications

Fabian Kreß, Alexey Serdyuk, Micha Hiegle +8 more

Computer Vision and Pattern Recognition · · cited 5× · DOI ↗ · more like this ·

Enabling the use of Deep Neural Networks (DNNs) for time-series-based applications on low-power devices such as wearables opens up a wide range of new features and services. However, inference requires an enormous amount of operations to be performed by the computing platform. In addition, Long Short-Term Memory (LSTM)-based networks require memory to store the internal cell state for future calculations. In this paper, we therefore propose a hardware/software co-design based low-power LSTM hardware accelerator architecture for Internet of Things (IoT) applications called ATLAS. The design is based on approximate computing techniques to reduce the power consumption and inference latency by achieving high accuracy. Exemplary, we investigate the impact of applying our proposed architecture to a DNN for handwriting recognition. Thereby, we can show that the accuracy decreases only slightly…

Hardware-aware Workload Distribution for AI-based Online Handwriting Recognition in a Sensor Pen

Fabian KreB, Alexey Serdyuk, Tim Hotfilter +4 more

Computer Vision and Pattern Recognition · 2022 11th Mediterranean Conference on Embedded Computing (MECO) · · cited 5× · DOI ↗ · more like this ·

Time series-based applications such as recognition of handwriting benefit from using Deep Neural Networks (DNNs) in terms of accuracy and efficiency. Due to strict power and memory limitations of embedded platforms in the Internet-of-Things (IoT), the inference of such DNNs is usually performed on more powerful and less constrained devices. However, inference on mobile devices such as smartphones or tablets leads to high system requirements. In this paper, we present our approach for distributing computational workload between sensor pen and a mobile device for handwriting recognition. This not only results in lower system requirements for mobile devices, but also opens up the possibility of storing compressed sensor data on the pen when remote devices are not available or connected. Therefore, we first quantize weights of the DNN layers to significantly reduce the memory footprint and…

Embedded Image Processing the European Way: A new platform for the future automotive market

Tim Hotfilter, F.J. Kempf, Jürgen Becker +2 more

Computer Vision and Pattern Recognition · Repository KITopen (Karlsruhe Institute of Technology) · · cited 5× · DOI ↗ · more like this ·

Within the European Processor Initiative (EPI) an objective is build an embedded High-Performance processing platform for future automotive applications such as autonomous driving. An embedded Field-Programmable-Gate-Array (eFPGA) enables the platform to be extended for future needs and requirements by various stakeholders. In this paper we give an overview about the project and our contributions to define the architecture of the eFPGA, which is suitable for the automotive market.Therefore, we describe our concept to explore the eFPGA architecture. It is motivated by a sound use case that deals with face recognition based on current neural networks. During the scope of the work we describe how the application is carefully mapped on the different domains of the EPI platform to make it more safe and secure as well as performant. As a result, we will find an apt eFPGA configuration, which…

Hardware-aware Partitioning of Convolutional Neural Network Inference for Embedded AI Applications

Fabian Kres, Julian Hoefer, Tim Hotfilter +4 more

Computer Vision and Pattern Recognition · Repository KITopen (Karlsruhe Institute of Technology) · · cited 4× · DOI ↗ · more like this ·

Embedded image processing applications like multicamera-based object detection or semantic segmentation are often based on Convolutional Neural Networks (CNNs) to provide precise and reliable results. The deployment of CNNs in embedded systems, however, imposes additional constraints such as latency restrictions and limited energy consumption in the sensor platform. These requirements have to be considered during hardware/software co-design of embedded Artifical Intelligence (AI) applications. In addition, the transmission of uncompressed image data from the sensor to a central edge node requires large bandwidth on the link, which must also be taken into account during the design phase.Therefore, we present a simulation toolchain for fast evaluation of hardware-aware CNN partitioning for embedded AI applications. This approach explores an efficient workload distribution between sensor…

QUA³CK - A Machine Learning Development Process

Simon Stock, Jürgen Becker, Daniel Grimm +4 more

Artificial Intelligence · Repository KITopen (Karlsruhe Institute of Technology) · · cited 4× · DOI ↗ · more like this ·

Machine learning and data processing are trending topics at the moment. However, there is still alack of a standard process to support a fast, simple, and effective development of machine learningmodels for academia and industry combined. Processes such as KDD or CRISP-DM are highlyspecialized in data mining and business cases. Therefore, engineers often refer to individualapproaches to solve a machine learning problem. Especially in teaching, the lack of a standardprocess is a challenge. Students typically get a better understanding if a systematic approach tosolve problems is given to them. A challenge when formulating a machine learning developmentprocess is to provide standard actions that work on different use-cases. At the same time, it has tobe simple. Complex processes often lead to the wrong approach.The QUA³CK process was created at the Karlsruhe Institute of Technology to…

Leveraging Mixed-Precision CNN Inference for Increased Robustness and Energy Efficiency

Tim Hotfilter, Julian Hoefer, Philipp Merz +4 more

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Convolutional Neural Networks (CNNs) show tremendous performance in many Computer Vision (CV) tasks like image segmentation crucial to autonomous driving. However, they are computationally demanding and usually not robust to image corruptions like weather influences. In this paper, we introduce our mixed-precision inference method to overcome these two challenges. Therefore, we enable mixed-precision CNN execution on modern embedded system on chips (SoC) that feature a DNN accelerator and a reconfigurable fabric. In case of a weather change, we can quickly adjust the inference precision to maintain model accuracy, while benefitting from fewer off-chip memory accesses compared to full precision. Therefore, we identify optimal quantization schemes for different weather conditions that maximize model accuracy and minimize data offloading. To enable mixed-precision inference, we present our…

An Analytical Model of Configurable Systolic Arrays to find the Best-Fitting Accelerator for a given DNN Workload

Tim Hotfilter, Patrick Schmidt, Julian Höfer +3 more

Hardware and Architecture · Repository KITopen (Karlsruhe Institute of Technology) · · cited 3× · DOI ↗ · more like this ·

Since their breakthrough, complexity of Deep Neural Networks (DNNs) is rising steadily. As a result, accelerators for DNNs are now used in many domains. However, designing and configuring an accelerator that meets the requirements of a given application perfectly is a challenging task. In this paper, we therefore present our approach to support the accelerator design process. With an analytical model of a systolic array we can estimate performance, energy consumption and area for each design option. To determine these metrics, usually a cycle accurate simulation is performed, which is a time-consuming task. Hence, the design space has to be restricted heavily. Analytical modelling, however, allows for fast evaluation of a design using a mathematical abstraction of the accelerator. For DNNs, this works especially well since the dataflow and memory accesses have high regularity. To show…

EFFECT: An End-to-End Framework for Evaluating Strategies for Parallel AI Anomaly Detection

Matthias Stammler, Julian Hoefer, David Kraus +4 more

Artificial Intelligence · Procedia Computer Science · · cited 3× · DOI ↗ · more like this ·

Neural networks achieve high accuracy in tasks like image recognition or segmentation. However, their application in safety-critical domains is limited due to their black-box nature and vulnerability to specific types of attacks. To mitigate this, methods detecting out-of-distribution or adversarial attacks in parallel to the network inference were introduced. These methods are hard to compare because they were developed for different use cases, datasets, and networks. To fill this gap, we introduce EFFECT, an end-to-end framework to evaluate and compare new methods for anomaly detection, without the need for retraining and by using traces of intermediate inference results. The presented workflow works with every preexisting neural network architecture and evaluates the considered anomaly detection methods in terms of accuracy and computational complexity. We demonstrate EFFECT's…

A Hardware-Centric Approach to Increase and Prune Regular Activation Sparsity in CNNs

Tim Hotfilter, Julian Hoefer, Fabian Kreß +4 more

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

A key challenge in computing convolutional neural networks (CNNs) besides the vast number of computations are the associated numerous energy-intensive transactions from main to local memory. In this paper, we present our methodical approach to maximize and prune coarse-grained regular blockwise sparsity in activation feature maps during CNN inference on dedicated dataflow architectures. Regular sparsity that fits the target accelerator, e.g., a systolic array or vector processor, allows simplified and resource inexpensive pruning compared to irregular sparsity, saving memory transactions and computations. Our threshold-based technique allows maximizing the number of regular sparse blocks in each layer. The wide range of threshold combinations that result from the close correlation between the number of sparse blocks and network accuracy can be explored automatically by our exploration…

LOTTA: An FPGA-based Low-Power Temporal Convolutional Network Hardware Accelerator

Fabian Kreß, Alexey Serdyuk, Denis Kobsar +4 more

Hardware and Architecture · · cited 0× · DOI ↗ · more like this ·

Deploying artificial intelligence (AI) in the Internet of Things (IoT) is primarily limited by energy consumption. Optimized hardware architectures are therefore essential to meet the requirements of such applications. In this paper, we present LOTTA, a novel, low-power hardware accelerator for Temporal Convolutional Networks (TCNs) specifically designed for use in IoT applications. LOTTA is designed to efficiently utilize FPGA resources and can be configured at runtime via an SPI interface, providing high flexibility for different workloads. It also provides a QSPI interface to expand the weight memory and thus supports TCN network architectures that exceed the FPGA’s internal memory. In addition, a hardware-aware TCN hyperparameter search is proposed to find a TCN architecture that is well adapted to the hardware. Our evaluations on a low-power Lattice iCE40 UP5K FPGA show that LOTTA…

RVVe: A Minimal RISC-V Vector Processor for Embedded AI Acceleration

Patrick Schmidt, Johannes Pfau, Tim Hotfilter +3 more

Hardware and Architecture · · cited 0× · DOI ↗ · more like this ·

In recent years, Deep Neural Networks (DNNs) have become common in the embedded domain for a wide variety of tasks. However, due to strict area and energy requirements, dedicated accelerators for these networks are necessary. Different architectures to fulfill this role are available, but an accelerator targeting the ultra-low area design point is still missing. In this work, we present an architecture focusing on minimizing resource utilization and energy requirements. We propose a small-scale vector processor that can be integrated into a RISC-V core. Unlike traditional, feature-rich vector instruction sets, we instead determine the most crucial instructions for DNN workloads through hardware-software co-design. To evaluate our implementation, we integrate our vector extension into an open-source RISC-V System-on-Chip, the NeoRV32, and measure the hardware overhead and achieved…

A Low-Stall Methodology for an Interleaved Processor State Replication

Fabian Kempf, Julian Hoefer, Tim Hotfilter +1 more

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

In this paper, we present a novel hardware approach, which allows a simultaneous program execution in parallel to a state transfer. We introduce an interleaved state replication methodology and a corresponding processor architecture. Our interleaved state replication methodology is applicable for fast context switches which are of crucial importance in mixed criticality systems. To enable our novel methodology for interleaved state replication directly on the hardware level we propose an appropriate processor architecture. On this architecture we implement various transfer strategies and investigate them on representative workloads. Our experiments demonstrate a program execution without stalls in the best case, while the complete state is replicated in parallel. The interleaved state transfer achieves an average 84% reduction in stall cycles compared to state of the art.

European Processor Initiative Demonstration of Integrated Semi-Autonomous Driving System

Daniel Hofman, Majda Brcic, Mario Kovač +6 more

Computer Vision and Pattern Recognition · · cited 0× · DOI ↗ · more like this ·

The European Processor Initiative (EPI) is developing a processor for various sectors, including the automotive industry. To benchmark the new processor, EPI uses a test vehicle to demonstrate different use cases, like semi-autonomous driving. In this paper, we focus on object detection and describe the use cases in the perception stage of autonomous driving. Therefore, we introduce four applications that include face recognition, blind spot detection, near-range object detection and far-range spatial perception to cover a wide range of different domains. Each use case runs on a different architecture representing future domains of the EPI processor, allowing for optimal utilization and performance. Our evaluation shows that all use cases can be mapped on the future EPI platform. The performance of the image processing tasks such as blind spot detection meets real-time requirements and…

Evaluation of a high-throughput communication link for future automotive ADAS controllers

Luo Yigui, Sun Youteng, Florian Schade +5 more

Hardware and Architecture · Proceedings of the Institution of Mechanical Engineers Part D Journal of Automobile Engineering · · cited 0× · DOI ↗ · more like this ·

The trend toward further integration of automotive electronic control units functionality into domain control units as well as the rise of computing-intensive driver assistance systems has led to a demand for high-performance automotive computation platforms. These platforms have to fulfill stringent safety requirements. One promising approach is the use of performance computation units in combination with safety controllers in a single control unit. Such systems require adequate communication links between the computation units. While Ethernet is widely used, a high-speed serial link communication protocol supported by an Infineon AURIX safety controller appears to be a promising alternative. In this paper, a high-speed serial link IP core is presented, which enables this type of high-speed serial link communication interface for field-programmable gate array–based computing units. In…

Automated Deep Neural Network Inference Partitioning for Distributed Embedded Systems

Fabian Kreß, El Mahdi El Annabi, Tim Hotfilter +3 more

cs.DC · · arXiv ↗ · more like this ·

Distributed systems can be found in various applications, e.g., in robotics or autonomous driving, to achieve higher flexibility and robustness. Thereby, data flow centric applications such as Deep Neural Network (DNN) inference benefit from partitioning the workload over multiple compute nodes in terms of performance and energy-efficiency. However, mapping large models on distributed embedded systems is a complex task, due to low latency and high throughput requirements combined with strict energy and memory constraints. In this paper, we present a novel approach for hardware-aware layer scheduling of DNN inference in distributed embedded systems. Therefore, our proposed framework uses a graph-based algorithm to automatically find beneficial partitioning points in a given DNN. Each of these is evaluated based on several essential system metrics such as accuracy and memory utilization…