arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Runzhou Han

9 papers · 2017–2024

2017: 12018: 02019: 02020: 22021: 12022: 22023: 22024: 1
2017peak 2 in 20202024

Frequent co-authors

Papers

showing 1–9 of 9 RSS

SentiLog

Di Zhang, Dong Dai, Runzhou Han +1 more

Computer Networks and Communications · · cited 23× · DOI ↗ · more like this ·

As core components of High-performance computing (HPC) platforms, parallel file systems (PFSes) grow quickly in scale and complexity, hence are subject to various failures and anomalies. Identifying their anomalies in runtime is critically helpful for HPC operators and administrators. Analyzing the runtime logs to detect the anomalies of large-scale systems has been proven effective in many recent studies. However, applying them to parallel file systems logs faces significant challenges due to the large volume and irregularity of PFSes logs. This study proposes SentiLog, a new approach to analyzing PFSes system logs for detecting anomalies. Unlike existing solutions, SentiLog works by training a general sentimental, natural language model based on the logging-relevant source code collected from a set of PFSes. In this way, SentiLog learns information embedded by developers from the…

A Study of Failure Recovery and Logging of High-Performance Parallel File Systems

Runzhou Han, Om Rameshwar Gatla, Mai Zheng +5 more

Computer Networks and Communications · ACM Transactions on Storage · · cited 16× · DOI ↗ · more like this ·

Large-scale parallel file systems (PFSs) play an essential role in high-performance computing (HPC). However, despite their importance, their reliability is much less studied or understood compared with that of local storage systems or cloud storage systems. Recent failure incidents at real HPC centers have exposed the latent defects in PFS clusters as well as the urgent need for a systematic analysis. To address the challenge, we perform a study of the failure recovery and logging mechanisms of PFSs in this article. First, to trigger the failure recovery and logging operations of the target PFS, we introduce a black-box fault injection tool called PFault , which is transparent to PFSs and easy to deploy in practice. PFault emulates the failure state of individual storage nodes in the PFS based on a set of pre-defined fault models and enables examining the PFS behavior under fault…

Fingerprinting the Checker Policies of Parallel File Systems

Runzhou Han, Duo Zhang, Mai Zheng

Computer Networks and Communications · · cited 12× · DOI ↗ · more like this ·

Parallel file systems (PFSes) play an essential role in high performance computing. To ensure the integrity, many PFSes are designed with a checker component, which serves as the last line of defense to bring a corrupted PFS back to a healthy state. Motivated by real-world incidents of PFS corruptions, we perform a fine-grained study on the capability of PFS checkers in this paper. We apply type-aware fault injection to specific PFS structures, and examine the detection and repair policies of PFS checkers meticulously via a well-defined taxonomy. The study results on two representative PFS checkers show that they are able to handle a wide range of corruptions on important data structures. On the other hand, neither of them is perfect: there are multiple cases where the checkers may behave sub-optimally, leading to kernel panics, wrong repairs, etc. Our work has led to a new patch on…

Revisiting Erasure Codes: A Configuration Perspective

Runzhou Han, Shi Chao, Tabassum Mahmud +7 more

Computer Networks and Communications · · cited 5× · DOI ↗ · more like this ·

Erasure coding (EC) plays a crucial role in the fault tolerance of modern distributed storage systems (DSS). Inspired by recent research on storage configuration, we study the configuration sensitivity of EC in real DSS in this paper. We systematically inject faults to trigger EC recovery under various configurations, and measure the impact on recovery time and storage overhead quantitatively. Our results show that configurations may affect the EC recovery time significantly (e.g., up to 426%). More interestingly, theoretically superior codes may perform worse in DSS under certain configurations. Also, there is a system checking period before EC recovery that accounts for 41% to 58% of the overall system recovery time, which has been largely ignored in previous studies. Finally, in terms of storage overhead, EC may introduce 32.3% to 72.0% more write amplification (WA) than the…

$λ$FS: A Scalable and Elastic Distributed File System Metadata Service using Serverless Functions

Benjamin Carver, Runzhou Han, Jingyaun Zhang +2 more

cs.DC · · cited 4× · arXiv ↗ · more like this ·

The metadata service (MDS) sits on the critical path for distributed file system (DFS) operations, and therefore it is key to the overall performance of a large-scale DFS. Common "serverful" MDS architectures, such as a single server or cluster of servers, have a significant shortcoming: either they are not scalable, or they make it difficult to achieve an optimal balance of performance, resource utilization, and cost. A modern MDS requires a novel architecture that addresses this shortcoming. To this end, we design and implement $λ$FS, an elastic, high-performance metadata service for large-scale DFSes. $λ$FS scales a DFS metadata cache elastically on a FaaS (Function-as-a-Service) platform and synthesizes a series of techniques to overcome the obstacles that are encountered when building large, stateful, and performance-sensitive applications on FaaS platforms. $λ$FS takes full…

On the Reproducibility of Bugs in File-System Aware Storage Applications

Duo Zhang, Tabassum Mahmud, Om Rameshwar Gatla +3 more

Computer Networks and Communications · · cited 0× · DOI ↗ · more like this ·

Many storage applications such as file system checkers, defragmentation tools, etc. require a detailed understanding of file systems. Such file-system aware applications play an essential role today, but unfortunately they are error-prone. To better understand the challenges as well as the opportunities to address the issues, this paper presents an empirical study of real world bugs in file-system aware storage applications. By analyzing 59 bug cases from 4 representative applications in depth, we derive multiple insights in terms of general bug patterns, triggering conditions, and implications for building effective tools to address the issues. We hope that our study and the resulting dataset could contribute to the development of reliability tools for building robust file-system aware storage applications in general.

On Failure Diagnosis of the Storage Stack

Duo Zhang, Om Rameshwar Gatla, Runzhou Han +1 more

cs.OS · · cited 0× · arXiv ↗ · more like this ·

Diagnosing storage system failures is challenging even for professionals. One example is the "When Solid State Drives Are Not That Solid" incident occurred at Algolia data center, where Samsung SSDs were mistakenly blamed for failures caused by a Linux kernel bug. With the system complexity keeps increasing, such obscure failures will likely occur more often. As one step to address the challenge, we present our on-going efforts called X-Ray. Different from traditional methods that focus on either the software or the hardware, X-Ray leverages virtualization to collects events across layers, and correlates them to generate a correlation tree. Moreover, by applying simple rules, X-Ray can highlight critical nodes automatically. Preliminary results based on 5 failure cases shows that X-Ray can effectively narrow down the search space for failures.

PROV-IO+: A Cross-Platform Provenance Framework for Scientific Data on HPC Systems

Runzhou Han, Mai Zheng, Suren Byna +8 more

cs.DC · · arXiv ↗ · more like this ·

Data provenance, or data lineage, describes the life cycle of data. In scientific workflows on HPC systems, scientists often seek diverse provenance (e.g., origins of data products, usage patterns of datasets). Unfortunately, existing provenance solutions cannot address the challenges due to their incompatible provenance models and/or system implementations. In this paper, we analyze four representative scientific workflows in collaboration with the domain scientists to identify concrete provenance needs. Based on the first-hand analysis, we propose a provenance framework called PROV-IO+, which includes an I/O-centric provenance model for describing scientific data and the associated I/O operations and environments precisely. Moreover, we build a prototype of PROV-IO+ to enable end-to-end provenance support on real HPC systems with little manual effort. The PROV-IO+ framework can…

Experimental observation of sound-mediated stable configurations for polystyrene particles

Mudi Wang, Chunyin Qiu, Shenwei Zhang +3 more

cond-mat.soft · · arXiv ↗ · more like this ·

Here we present an experimental observation of the self-organization effect of the polystyrene particles formed by acoustically-induced interaction forces. Two types of stable configurations are observed experimentally: one is mechanically equilibrium and featured by nonzero inter-particle separations, and the other corresponds to a close-packed assembly, which is formed by strong attractions among the aggregated particles. For the former case involving two or three particles, the most probable inter-particle separations (counted for numerous independent initial arrangements) agree well with the theoretical predictions. For the latter case, the number of the final stable configurations grows with the particle number, and the occurrence probability of each configuration is interpreted by a simple geometric model.