arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Akhil Arunkumar

18 papers · 2007–2025

2007: 12008: 02009: 02010: 02011: 02012: 02013: 02014: 12015: 32016: 12017: 22018: 32019: 22020: 02021: 02022: 02023: 02024: 12025: 4
2007peak 4 in 20252025

Frequent co-authors

Papers

showing 1–18 of 18 RSS

MCM-GPU

Akhil Arunkumar, Evgeny Bolotin, Benjamin Cho +6 more

Hardware and Architecture · · cited 160× · DOI ↗ · more like this ·

Historically, improvements in GPU-based high performance computing have been tightly coupled to transistor scaling. As Moore's law slows down, and the number of transistors per die no longer grows at historical rates, the performance curve of single monolithic GPUs will ultimately plateau. However, the need for higher performing GPUs continues to exist in many domains. To address this need, in this paper we demonstrate that package-level integration of multiple GPU modules to build larger logical GPUs can enable continuous performance scaling beyond Moore's law. Specifically, we propose partitioning GPUs into easily manufacturable basic GPU Modules (GPMs), and integrating them on package using high bandwidth and power efficient signaling technologies. We lay out the details and evaluate the feasibility of a basic Multi-Chip-Module GPU (MCM-GPU) design. We then propose three…

CAWA

Shin-Ying Lee, Akhil Arunkumar, Carole-Jean Wu

Hardware and Architecture · · cited 87× · DOI ↗ · more like this ·

The ubiquity of graphics processing unit (GPU) architectures has made them efficient alternatives to chip-multiprocessors for parallel workloads. GPUs achieve superior performance by making use of massive multi-threading and fast context-switching to hide pipeline stalls and memory access latency. However, recent characterization results have shown that general purpose GPU (GPGPU) applications commonly encounter long stall latencies that cannot be easily hidden with the large number of concurrent threads/warps. This results in varying execution time disparity between different parallel warps, hurting the overall performance of GPUs -- the warp criticality problem.

Beyond the socket

Uglješa Milić, Oreste Villa, Evgeny Bolotin +5 more

Hardware and Architecture · UPCommons institutional repository (Universitat Politècnica de Catalunya) · · cited 64× · DOI ↗ · more like this ·

GPUs achieve high throughput and power efficiency by employing many small single instruction multiple thread (SIMT) cores. To minimize scheduling logic and performance variance they utilize a uniform memory system and leverage strong data parallelism exposed via the programming model. With Moore's law slowing, for GPUs to continue scaling performance (which largely depends on SIMT core count) they are likely to embrace multi-socket designs where transistors are more readily available. However when moving to such designs, maintaining the illusion of a uniform memory system is increasingly difficult. In this work we investigate multi-socket non-uniform memory access (NUMA) GPU designs and show that significant changes are needed to both the GPU interconnect and cache architectures to achieve performance scalability. We show that application phase effects can be exploited allowing GPU…

Understanding the Future of Energy Efficiency in Multi-Module GPUs

Akhil Arunkumar, Evgeny Bolotin, David Nellans +1 more

Hardware and Architecture · · cited 45× · DOI ↗ · more like this ·

As Moore's law slows down, GPUs must pivot towards multi-module designs to continue scaling performance at historical rates. Prior work on multi-module GPUs has focused on performance, while largely ignoring the issue of energy efficiency. In this work, we propose a new metric for GPU efficiency called EDP Scaling Efficiency that quantifies the effects of both strong performance scaling and overall energy efficiency in these designs. To enable this analysis, we develop a novel top-down GPU energy estimation framework that is accurate within 10% of a recent GPU design. Being decoupled from granular GPU microarchitectural details, the framework is appropriate for energy efficiency studies in future GPUs. Using this model in conjunction with performance simulation, we show that the dominating factor influencing the energy efficiency of GPUs over the next decade is GPUmodule (GPM) idle…

Characterization and Throttling-Based Mitigation of Memory Interference for Heterogeneous Smartphones

Davesh Shingari, Akhil Arunkumar, Carole-Jean Wu

Hardware and Architecture · · cited 24× · DOI ↗ · more like this ·

The availability of a wide range of general purpose as well as accelerator cores on modern smart phones means that a significant number of applications can be executed on a smart phone simultaneously, resulting in an ever increasing demand on the memory subsystem. While the increased computation capability is intended for improving user experience, memory requests from each concurrent application exhibit unique memory access patterns as well as specific timing constraints. If not considered, this could lead to significant memory contention and result in lowered user experience. In this paper, we design experiments to analyze the performance degradation caused by the interference at the memory subsystem for a broad range of commonly-used smart phone applications. The characterization studies are performed on a real smart phone device -- Google Nexus5 -- running an Android operating…

LATTE-CC: Latency Tolerance Aware Adaptive Cache Compression Management for Energy Efficient GPUs

Akhil Arunkumar, Shin-Ying Lee, Vignesh Soundararajan +1 more

Hardware and Architecture · · cited 21× · DOI ↗ · more like this ·

General-purpose GPU applications are significantly constrained by the efficiency of the memory subsystem and the availability of data cache capacity on GPUs. Cache compression, while is able to expand the effective cache capacity and improve cache efficiency, comes with the cost of increased hit latency. This has constrained the application of cache compression to mostly lower level caches, leaving it unexplored for L1 caches and for GPUs. Directly applying state-of-the-art high performance cache compression schemes on GPUs results in a wide performance variation from -52% to 48%. To maximize the performance and energy benefits of cache compression for GPUs, we propose a new compression management scheme, called LATTE-CC. LATTE-CC is designed to exploit the dynamically-varying latency tolerance feature of GPUs. LATTE-CC compresses cache lines based on its prediction of the degree of…

ID-cache: instruction and memory divergence based cache management for GPUs

Akhil Arunkumar, Shin-Ying Lee, Carole-Jean Wu

Hardware and Architecture · · cited 17× · DOI ↗ · more like this ·

Modern graphic processing units (GPUs) are not only able to perform graphics rendering, but also perform general purpose parallel computations (GPGPUs). It has been shown that the GPU L1 data cache and the on chip interconnect bandwidth are important sources of performance bottlenecks and inefficiencies in GPGPUs. Through this work, we aim to understand the sources of inefficiencies and possible opportunities for more efficient cache and interconnect bandwidth management on the GPUs. We do so by understanding the predictability of reuse behavior and spatial utilization of cache lines using program level information such as the instruction PC, and runtime behavior such as the extent of memory divergence. Through our characterization results, we demonstrate that a) PC, and memory divergence can be used to efficiently bypass zero reuse cache lines from the cache; b) memory divergence…

E-ECC

Hsing-Min Chen, Akhil Arunkumar, Carole-Jean Wu +2 more

Hardware and Architecture · · cited 10× · DOI ↗ · more like this ·

Most server-grade memory systems provide Chipkill-Correct error protection at the expense of power and/or performance overhead. In this paper we present low overhead schemes for improving the reliability of commodity DRAM systems with better power and IPC performance compared to Chipkill-Correct solutions. Specifically, we propose two erasure and error correction (E-ECC) schemes for x8 memory systems that have 12.5% storage overhead and do not require any change in the existing memory architecture. Both schemes have superior error performance due to the use of a strong ECC code, namely, RS(36,32) over GF(28). Scheme 1 activates 18 chips per access and has stronger reliability compared to Chipkill-Correct solutions. If the location of the faulty chip is known, Scheme 1 can correct an additional random error in a second chip. Scheme 2 trades off reliability for higher energy efficiency by…

ReMAP: Reuse and memory access cost aware eviction policy for last level cache management

Akhil Arunkumar, Carole-Jean Wu

Hardware and Architecture · · cited 7× · DOI ↗ · more like this ·

To mitigate the significant main memory access latency in modern chip multiprocessors, multi-level on-chip caches are used to bridge the gap by retaining frequently used data closer to the processor cores. Such dependence on the last-level cache (LLC) has motivated numerous innovations in cache management schemes. However, most prior works focus their efforts on optimizing cache miss counts experienced by applications, irrespective of the interactions between the LLC and other components in the memory hierarchy such as the main memory. This results in sub-optimal performance improvements, since reducing miss rates does not directly translate to increased IPC performance. In this paper, we show that in addition to the recency information provided by the cache replacement policy, post eviction reuse distance (PERD) and main memory access latency cost are useful to make better-informed…

Keyformer: KV Cache Reduction through Key Tokens Selection for Efficient Generative Inference

Muhammad Adnan, Akhil Arunkumar, Gaurav Jain +3 more

cs.LG · · cited 6× · arXiv ↗ · more like this ·

Transformers have emerged as the underpinning architecture for Large Language Models (LLMs). In generative language models, the inference process involves two primary phases: prompt processing and token generation. Token generation, which constitutes the majority of the computational workload, primarily entails vector-matrix multiplications and interactions with the Key-Value (KV) Cache. This phase is constrained by memory bandwidth due to the overhead of transferring weights and KV cache values from the memory system to the computing units. This memory bottleneck becomes particularly pronounced in applications that require long-context and extensive text generation, both of which are increasingly crucial for LLMs. This paper introduces "Keyformer", an innovative inference-time approach, to mitigate the challenges associated with KV cache size and memory bandwidth utilization. Keyformer…

IoT-based Real-Time Earthquake Disaster Management and Public Safety System with Predictive Analytics and UAV Assessment

K. Kalaivani, S Deepa, Balakrishnan Srinivasan +3 more

Computer Networks and Communications · · cited 1× · DOI ↗ · more like this ·

The increasing frequency and severity of natural disasters, particularly earthquakes, necessitate advanced and efficient disaster management systems. This paper presents an IoT-based framework for Public Safety and Earthquake Disaster Management that leverages the power of real-time sensing, communication, and data analytics to enhance preparedness, response, and recovery. The proposed system integrates a distributed network of seismic and environmental sensors with low-power microcontrollers and wireless communication modules to monitor seismic activity, structural integrity, and environmental conditions. These devices continuously collect data and transmit it to a centralized cloud platform for real-time processing and analysis using machine learning algorithms. In the event of an anomaly or detected seismic event, automated alerts are sent to emergency responders, public authorities…

Corsair: An In-Memory Computing Chiplet Architecture for Inference-Time Compute Acceleration

Satyam Srivastava, Akhil Arunkumar, Nithesh Kurella +9 more

Hardware and Architecture · IEEE Micro · · cited 1× · DOI ↗ · more like this ·

Advances in Generative AI (GenAI) have reinvigorated research into novel computing architectures such as Transformer. Transformer, characterized by low arithmetic intensity during most of the inference time, has become the cornerstone of GenAI underlying Large Language (LLM) and Reasoning Models (RM). Numerous solutions to the intense memory bandwidth problem have been proposed. Corsair is an architecture that targets this need using chiplet design, digital in-memory computing-based matrix engine, efficient die-to-die interconnects, block floating point numerics, and large high-bandwidth on-chip memories. We describe the Corsair chiplet, scaling approaches to compose larger systems, and outline the software stack. We formulate the inference-time requirements of LLM and RM computation, memory bandwidth, memory capacity, and interconnect efficiency for scaling. We also show how Corsair…

ST-QCA based error free and area efficient 4:2 compressor design

Akhil Arunkumar, Avala Eswar, Gummarekula Sattibabu +1 more

Computational Theory and Mathematics · · cited 1× · DOI ↗ · more like this ·

Quantum-dot cellular automata (QCA) stands at the forefront of nanotechnology advancements, representing a highly acclaimed technology compared to complementary metal-oxide-semiconductor (CMOS) technology in building digital logic circuits. Compressors are a significant class of arithmetic circuits. This study presents the design of a new compressor of size 4:2 using stack-type full adders in QCA technology. The proposed module performs well when comparing with the existing methods in terms of cell count, area and delay. The QCADesigner 2.0.3 tool has been used to evaluate the suggested circuits’ performance. Based on the results, the layout of the presented compressor of size 4:2 is more effective than various other designs since it makes use of 1.25 clock phases and with number of cells is 71. This type of compressors has main application in fast arithmetic operations.

Earthquake Early Warning System By Iot Using Wireless Sensor Networks

Akhil Arunkumar, Shyam Joseph A, Manikandan Parasuraman +1 more

Artificial Intelligence · Iconic Research And Engineering Journals · · cited 1× · OpenAlex ↗ · more like this ·

The Wireless device network (WSN) is spatially distributed sensors in associate autonomous manner to observe physical environmental conditions. The Internet of things (IOT) is the network of computed physical objects which enables these things to connect, collect and exchange data. In this paper, we have a tendency to propose Associate in Nursing earthquake early warning system by means that of Associate in Nursing IOT in WSN. The sensors ar placed within the surface of the planet. When associate earthquake happens, each compression P wave and transversal S wave radiates outward the geographical point of the planet. The P wave, that travels quickest, journeys the sensors, placed in the landscape. It causes early alert signals to be transfer ahead, giving humans and automatic electronic system a warning to require precautional actions. So that before the harm begins with the arrival of…

Foresight: Adaptive Layer Reuse for Accelerated and High-Quality Text-to-Video Generation

Muhammad Adnan, Nithesh Kurella, Akhil Arunkumar +1 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Diffusion Transformers (DiTs) achieve state-of-the-art results in text-to-image, text-to-video generation, and editing. However, their large model size and the quadratic cost of spatial-temporal attention over multiple denoising steps make video generation computationally expensive. Static caching mitigates this by reusing features across fixed steps but fails to adapt to generation dynamics, leading to suboptimal trade-offs between speed and quality. We propose Foresight, an adaptive layer-reuse technique that reduces computational redundancy across denoising steps while preserving baseline performance. Foresight dynamically identifies and reuses DiT block outputs for all layers across steps, adapting to generation parameters such as resolution and denoising schedules to optimize efficiency. Applied to OpenSora, Latte, and CogVideoX, Foresight achieves up to \latencyimprv end-to-end…

A Comprehensive Evaluation and Analysis of Routing Algorithms for Wireless Sensor Networks

Akhil Arunkumar, Prema Dr.S

Computer Networks and Communications · IJARCCE · · cited 0× · DOI ↗ · more like this ·

A wireless sensor network is the prominent technology, which seeks lots of attention in the state of the art technology. It has its wide range of utilization aspects in almost all domains. The major challenge of the WSN seems to be the energy utilization and as a consequence the decline of the lifetime of the sensor nodes. This research addresses the problem of the energy drain in the sensor nodes lifetime, which as a result it ends up in the nodes death. This research proposes an algorithm to cope up with the energy utilization of the sensor nodes .Wireless sensor networks are deployed widely in sensitive applications like health care, surveillance and e-commerce domains. Compared with communication protocols, in terms of energy indulgence, ease of formation, and system epoch/quality of the network. Providing such a low-energy, ad hoc, distributed protocol will help pave the way for…

Optimized buffer allocation for video multicasting applications with virtual memory implementation

Akhil Arunkumar, K. Gunaseelan

Computer Vision and Pattern Recognition · Greater South Information System · · cited 0× · DOI ↗ · more like this ·

Memory requirement is a key issue when servicing more number of nodes in a heterogeneous environment. We have to ensure an optimum buffer size in order to reduce the initial latency. In this paper, we propose a novel approach, which involves, augmenting a virtual memory (VM) with the existing physical memory of the video buffer. In addition to the benefits of improved queuing size, it also paves the way for better quantization, ordering of frames, and higher error resiliency. Instead of allocating the virtual memory as a single file, it is fragmented according to the number of nodes in a specific multicast group. This avoids the flushing of an entire buffer to begin a new streaming. Furthermore, this avoids the requirement of proxy servers for each multicast group. Hence, this reduces the burden of the server, when a new user joins the multicast session later, requesting same content.…

VLSI design and implementation of INTEL 8253IC using VHDL

Akhil Arunkumar, P SREEDHARAREDDY

Hardware and Architecture · · cited 0× · DOI ↗ · more like this ·

VLSI technology allows a designer to implement a complex design in software and perform a series of simulation on it, before sending the design for actual fabrication. Hence the time involved in testing the design is reduced. Any error would enable the designer to make changes in the design, rate it on the simulator before sending it for fabrication, thus reducing error. The design is specified to the simulator in various ways. In this paper a popular method is used, a hardware description language VHDL designs technique to implement the entire functionality of the INTEL 8253 programmable interval timer.