arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Da Lu

53 papers · 2002–2026

2002: 32003: 12004: 02005: 12006: 12007: 22008: 32009: 32010: 22011: 22012: 72013: 102014: 82015: 02016: 12017: 12018: 02019: 02020: 12021: 22022: 22023: 02024: 02025: 12026: 2
2002peak 10 in 20132026

Frequent co-authors

Papers

showing 1–25 of 53 RSS

Failure Analysis of Jobs in Compute Clouds: A Google Cluster Case Study

Xin Chen, Charng‐Da Lu, Karthik Pattabiraman

Information Systems · · cited 92× · DOI ↗ · more like this ·

In this paper, we analyze a workload trace from the Google cloud cluster and characterize the observed failures. The goal of our work is to improve the understanding of failures in compute clouds. We present the statistical properties of job and task failures, and attempt to correlate them with key scheduling constraints, node operations, and attributes of users in the cloud. We also explore the potential for early failure prediction, and anomaly detection for the jobs. Based on our results, we speculate that there are many opportunities to enhance the reliability of the applications running in the cloud, such as pro-active maintenance of nodes or limiting job resubmissions. We further find that resource usage patterns of the jobs can be leveraged by failure prediction techniques. Finally, we find that the termination statuses of jobs and tasks can be clustered into six dominant…

Failure Prediction of Jobs in Compute Clouds: A Google Cluster Case Study

Xin Chen, Charng‐Da Lu, Karthik Pattabiraman

Information Systems · · cited 66× · DOI ↗ · more like this ·

Most cloud computing clusters are built from unreliable, commercial off-the-shelf components. The high failure rates in their hardware and software components result in frequent node and application failures. Therefore, it is important to predict application failures before they occur to avoid resource wastage. In this paper, we investigate how to identify application failures based on resource usage measurements from the Google cluster traces. We apply recurrent neural networks to the resource usage measures, and generate features to categorize the input resource usage time series into different classes. Our results show that the model is able to predict failures of batch applications, which are the dominant jobs in the Google cluster. Moreover, we explore early classification to identify failures, and find that the prediction algorithm provides the cloud system enough time to take…

Scalable diskless checkpointing for large parallel systems

Daniel A. Reed, Charng‐Da Lu

Computer Networks and Communications · Journal of clinical and diagnostic research : JCDR · · cited 58× · DOI ↗ · more like this ·

The results of this observational study demonstrated rapid initial virological response of SOF based therapy in "real-life" cohort of Indian patients with chronic HCV infection. However, long-term follow-up data are needed to ensure the sustained antiviral efficacy of SOF based therapy.

Using XDMoD to facilitate XSEDE operations, planning and analysis

Thomas R. Furlani, Barry L. Schneider, Matthew D. Jones +9 more

Computer Networks and Communications · · cited 31× · DOI ↗ · more like this ·

The XDMoD auditing tool provides, for the first time, a comprehensive tool to measure both utilization and performance of high-end cyberinfrastructure (CI), with initial focus on XSEDE. Here, we demonstrate, through several case studies, its utility for providing important metrics regarding resource utilization and performance of TeraGrid/XSEDE that can be used for detailed analysis and planning as well as improving operational efficiency and performance.

Performance metrics and auditing framework using application kernels for high‐performance computer systems

Thomas R. Furlani, Matthew D. Jones, Steven M. Gallo +9 more

Information Systems · Concurrency and Computation Practice and Experience · · cited 31× · DOI ↗ · more like this ·

SUMMARY This paper describes XSEDE Metrics on Demand, a comprehensive auditing framework for use by high‐performance computing centers, which provides metrics regarding resource utilization, resource performance, and impact on scholarship and research. This role‐based framework is designed to meet the following objectives: (1) provide the user community with a tool to manage their allocations and optimize their resource utilization; (2) provide operational staff with the ability to monitor and tune resource performance; (3) provide management with a tool to monitor utilization, user base, and performance of resources; and (4) provide metrics to help measure scientific impact. Although initially focused on the XSEDE program, XSEDE Metrics on Demand can be adapted to any high‐performance computing environment. The framework includes a computationally lightweight application kernel…

Predicting job completion times using system logs in supercomputing clusters

Xin Chen, Charng‐Da Lu, Karthik Pattabiraman

Computer Networks and Communications · · cited 30× · DOI ↗ · more like this ·

Most large systems such as HPC/cloud computing clusters and data centers are built from commercial off-the-shelf components. System logs are usually the main source of choice to gain insights into the system issues. Therefore, mining logs to diagnose anomalies has been an active research area. Due to the lack of organization and semantic consistency in commodity PC clusters' logs, what constitutes a fault or an error is subjective and thus building an automatic failure prediction model from log messages is hard. In this paper we sidestep the difficulty by asking a different question: Given the concomitant system log messages of a running job, can we predict the job's remaining time? We adopt Hidden Markov Model (HMM) coupled with frequency analysis to achieve this. Our HMM approach can predict 75% of jobs' remaining times with an error of less than 200 seconds.

Compact Application Signatures for Parallel and Distributed Scientific Codes

Charng‐Da Lu, Daniel A. Reed

Computer Networks and Communications · Conference on High Performance Computing (Supercomputing) · · cited 25× · DOI ↗ · more like this ·

Understanding the dynamic behavior of parallel programs is key to developing efficient system software and runtime environments; this is even more true on emerging computational Grids where resource availability and performance can change in unpredictable ways. Event tracing provides details on behavioral dynamics, albeit often at great cost. We describe an intermediate approach, based on curve fitting, that retains many of the advantages of event tracing but with lower overhead. These compact "application signatures" summarize the time-varying resource needs of scientific codes from historical trace data. We also developed a comparison scheme that measures similarity between two signatures, both across executions and across execution environments.

Enabling comprehensive data-driven system management for large computational facilities

James C. Browne, Robert L. DeLeon, Charng‐Da Lu +8 more

Information Systems · · cited 18× · DOI ↗ · more like this ·

This paper presents a tool chain, based on the open source tool TACC_Stats, for systematic and comprehensive job level resource use measurement for large cluster computers, and its incorporation into XDMoD, a reporting and analytics framework for resource management that targets meeting the information needs of users, application developers, systems administrators, systems management and funding managers. Accounting, scheduler and event logs are integrated with system performance data from TACC_Stats. TACC_Stats periodically records resource use including many hardware counters for each job running on each node. Furthermore, system level metrics are obtained through aggregation of the node (job) level data. Analysis of this data generates many types of standard and custom reports and even a limited predictive capability that has not previously been available for open-source, Linux-based…

Failure Data Analysis of HPC Systems

Charng-Da Lu

cs.DC · · cited 17× · arXiv ↗ · more like this ·

Continuous availability of HPC systems built from commodity components have become a primary concern as system size grows to thousands of processors. In this paper, we present the analysis of 8-24 months of real failure data collected from three HPC systems at the National Center for Supercomputing Applications (NCSA) during 2001-2004. The results show that the availability is 98.7-99.8% and most outages are due to software halts. On the other hand, the downtime are mostly contributed by hardware halts or scheduled maintenance. We also used failure clustering analysis to identify several correlated failures.

Comprehensive job level resource usage measurement and analysis for XSEDE HPC systems

Charng‐Da Lu, James C. Browne, Robert L. DeLeon +6 more

Computer Networks and Communications · · cited 13× · DOI ↗ · more like this ·

This paper presents a methodology for comprehensive job level resource use measurement and analysis and applications of the analyses to planning for HPC systems and a case study application of the methodology to the XSEDE Ranger and Lonestar4 systems at the University of Texas. The steps in the methodology are: System-wide collection of resource use and performance statistics at the job and node levels, mapping and storage of the resultant job-wise data to a relational database which eases further implementation and transformation of data to the formats required by specific statistical and analytical algorithms. Analyses can be carried out at different levels of granularity: job, user, or system-wide basis. Measurements are based on a novel lightweight job-centric measurement tool "TACC_Stats" [1], which gathers a comprehensive set of metrics on all compute nodes. The data mapping and…

HPC Benchmark Assessment with Statistical Analysis

Fei Xing, Haihang You, Charng‐Da Lu

Hardware and Architecture · Procedia Computer Science · · cited 9× · DOI ↗ · more like this ·

High-performance computing (HPC) benchmarks are widely used to evaluate and rank system performance. This paper introduces a benchmark assessment tool equipped with a rigorous statistical method to evaluate HPC benchmarks against a set of scientific applications. The method is based on the combination of Variable Clustering (VarCluster) and Principal Component Analysis (PCA). We built the tool upon HPC Challenge (HPCC) benchmark suite and six popular scientific applications of Kraken, a petaflop supercomputer. Experimental results show that HPCC's Fast Fourier Transform (FFT) kernel, rather than the High-Performance Linpack (HPL) on which Top500 is based, is more representative of the HPC workloads on Kraken.

Closed-Form Hybrid Cramer-Rao Bound for DOA Estimation by an Acoustic Vector Sensor Under Orientation Deviation

Da Lu, Rui Duan, Kunde Yang

Signal Processing · IEEE Signal Processing Letters · · cited 8× · DOI ↗ · more like this ·

Acoustic vector sensors have been widely used for direction-of-arrival (DOA) estimation in hydroacoustics and aeroacoustics. The orientation of the acoustic vector sensor must be measured, e.g., by an attitude sensor, before its application to DOA estimation. However, the measured orientation generally deviates slightly from its actual orientation because of imperfect attitude measurements. This paper investigates how random deviations in the orientation degrade the performance of DOA estimation. We derive a closed-form approximation of the hybrid Cramer-Rao bound for DOA estimation by modeling the deviations as zero-mean Gaussian variables with small variances. A relationship based on a determinant-differential formula is introduced to avoid a complicated brute-force solution, yielding a sufficiently simple expression with quantitative observations. Numerical results illustrate the…

An Improved Pure Pursuit Algorithm for Four-Wheel-Steering Autonomous Driving Vehicle

Miao Miao Quan, Yong Zhai, Yan Jiang +3 more

Computer Vision and Pattern Recognition · Applied Mechanics and Materials · · cited 5× · DOI ↗ · more like this ·

An improved pure pursuit path tracking algorithm is presented for a four-wheel steering (4WS) carrier vehicle to follow a desired path automatically. A bicycle vehicle model considering the 4WS carrier vehicles structural and steering features is applied in the method. Real vehicle tests in an open large outdoor warehouse showed that the lateral tracking error was less than 0.56m at 20km/h. And we can conclude that the enhanced method for 4WS vehicle has good tracking ability on flat road.

Risk Analysis of Smart Terminals in Mobile Application of Power System and the Protection Solution Design

Zhi Peng Shao, Shi Da Lu, Mu Chen

Signal Processing · Applied Mechanics and Materials · · cited 5× · DOI ↗ · more like this ·

Introduce the status of mobile internet application in electric power corporations and current security protection methods. An in-depth analysis is made to demonstrate the possible hidden risks in the electric power smart terminals. Propose a set of electric power smart terminals protect solution and the implementation based on android operating system.

Automatically Mining Program Build Information via Signature Matching

Charng-Da Lu

cs.SE · · cited 4× · arXiv ↗ · more like this ·

Program build information, such as compilers and libraries used, is vitally important in an auditing and benchmarking framework for HPC systems. We have developed a tool to automatically extract this information using signature-based detection, a common strategy employed by anti-virus software to search for known patterns of data within the program binaries. We formulate the patterns from various "features" embedded in the program binaries, and the experiment shows that our tool can successfully identify many different compilers, libraries, and their versions.

Comparative Study of Beamformers for a Single Acoustic Vector Sensor

Da Lu, Hui Li, Kunde Yang +1 more

Signal Processing · Global Oceans 2020: Singapore – U.S. Gulf Coast · · cited 2× · DOI ↗ · more like this ·

The acoustic vector sensor is a complete acoustic field measurement device and is widely used in underwater direction-of-arrival (DOA) estimation. The maximum likelihood (ML) estimator is optimal for two-dimensional DOA estimation. However, it requires prior knowledge of noise variances, which is not always available. Sometimes we pay more attention to DOA on the horizontal plane in applications such as remote localization, cases where vertical interference is present. To investigate the performance of ML estimator in such a one-dimensional DOA estimation problem, we make a comparison between ML estimator and several DOA estimation techniques under a framework of weighted beamforming. Performances of these estimators are evaluated by the approximate mean square error. Simulation results show that there is no significant performance difference between the CBF beamformer and the ML…

An Improved Path Tracking Algorithm for Intelligent Vehicle in Automatic Parking Conditions

Da Lu Xu, Jian Gong, Yan Jiang +3 more

Computer Vision and Pattern Recognition · Applied Mechanics and Materials · · cited 2× · DOI ↗ · more like this ·

A feedforward and feedback path tracking algorithm appropriate for automatic parking is proposed in this paper. This algorithm is composed of feedforward control and feedback control. In the path tracking, vehicle position and reference path information are used to calculate the lateral and heading error of the vehicle as well as the curvature of reference path, and put these three as the system inputs, the steering angel of the vehicle as the output. The system parameters are settled by multiple tests. Experiments show that, this method has a high performance in path tracking and meets the requirements of vehicle parking in both low speed situation and narrow spaces.

Optimizing utilization across XSEDE platforms

Haihang You, Charng‐Da Lu, Ziliang Zhao +1 more

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

HPC resources provided by XSEDE give researchers unique opportunities to carry out scientific studies. As of 2013 XSEDE consists of 16 systems with varied architectural designs and capabilities. The hardware heterogeneity and software diversity make efficient utilization of such a federation of computing resources very challenging. For example, users are constantly faced with a myriad of possibilities to build and run an application: compilers, numerical libraries, and runtime parameters. In this paper we report performance data of several popular scientific applications built with different compilers and numerical libraries available on two XSEDE systems: Kraken and Gordon, and suggest the best way to compile applications for optimal performance. By comparison, we validate SU conversion factors between the aforementioned XSEDE systems from application's viewpoint.

Performance metrics and auditing framework for high performance computer systems

Thomas R. Furlani, Matthew D. Jones, Steven M. Gallo +9 more

Computer Networks and Communications · · cited 2× · DOI ↗ · more like this ·

This paper describes a comprehensive auditing framework, XDMoD, for use by high performance computing centers to readily provide metrics regarding resource utilization (CPU hours, job size, wait time, etc), resource performance, and the center's impact in terms of scholarship and research. This role-based auditing framework is designed to meet the following objectives: (1) provide the user community with an easy to use tool to oversee their allocations and optimize their use of resources, (2) provide staff with easy access to performance metrics and diagnostics to monitor and tune resource performance for the benefit of the users, (3) provide senior management with a tool to easily monitor utilization, user base, and performance of resources, and (4) help ensure that the resources are effectively enabling research and scholarship. XDMoD is initially focused on the NSF TeraGrid (TG) and…

Carbon sequestration and environmental impact assessment of jujube cultivation in the Yellow River Jiziwan Basin using life cycle and GIS approaches

Yang Liu, Feihong Liang, Rui Chang +7 more

Education · Ecological Indicators · · cited 1× · DOI ↗ · more like this ·

This study assessed the carbon sequestration potential and environmental impacts of jujube cultivation systems in the Yellow River Jiziwan Basin using an integrated life cycle assessment (LCA) and GIS approach. Field surveys, farmer interviews, and laboratory measurements were conducted to construct a comprehensive life cycle inventory and spatial environmental dataset. Results showed that jujube orchards achieved a net carbon sequestration of 1381.67 × 10 7 t-C in 2023, equivalent to offsetting the annual CO 2 emissions of a 9,265,000 MW thermal power plant. However, significant environmental pressures were identified, particularly aquatic toxicity linked to excessive pesticide use, and nutrient losses resulting in acidification and eutrophication. Sensitivity analysis revealed that northern and eastern regions, benefiting from superior natural conditions, exhibited higher ecological…

THE DYNAMIC CHARACTERISTIC AND CHANGING TENDENCY OF GROUNDWATER LEVEL OF REGION IN THE SHIYANGHE RIVER BASIN

XU Da-lu

Artificial Intelligence · Gansu Geology · · cited 1× · OpenAlex ↗ · more like this ·

Based on the groundwater level of observed data from 64 observation point of region in the Shiyanghe River Basin in 30 years,by quantitative analysing annual regime characteristic and perennial regime variation regular and distributed region of groundwater,the annual regime division for four typies,the runoff,exploitation,irrigation-exploitation and evaporates.perennial regime division for three tupies,fast descend,slow descend and basic stable.Using the Grey Theory to establish residual error series GM(1,1) prediction model of ground water level of all observation point.The forecast to 2010,the middle and lower reaches of Shiyang River Basin the groundwater lever was still in descend,comparing with the descending rate of 1978~2007,it have slow down,the partial region groundwater lever tends to be stable possibly.The forecast resule will have positive influence to the improvement of…

An Approach to Handwritten Chinese Character Preclassification Based on Fuzzy Logic and Similarity Measure

Da Lu, Huigang Xu, Qiwei Chen +1 more

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

This paper presents a fuzz logic approach and similarity measure to efficiently perform handwritten Chinese character preclassification. After extracting stroke density features and using fuzzy rules to create some preclassification groups, we transform the characters in each group into fuzzy prototypes based on a nonlinear weighted similarity function by fuzzy logic approach, then we use matching algorithm and hierarchy classification of fuzzy prototypes of similarity measurement for character preclassification. Experiment shows that our method is effective, and the characters of the testing set can be distributed into correct preclassification classes and a preclassification rate of 98.17% is achieved

Zero-Shot Low-Light Image Enhancement via Diffusion with Joint Frequency and Spatial Guidance

Jinghui Chu, Xiaoyi Yu, Wei Da Lu

Computer Vision and Pattern Recognition · Applied Sciences · · cited 0× · DOI ↗ · more like this ·

Existing zero-shot low-light image enhancement methods often underutilize image priors, leading to noise amplification and color distortion. To address these issues, we propose a zero-shot framework for low-light image enhancement. The framework first performs illumination-aware self-supervised denoising to generate a cleaner reference image, which is then used to guide diffusion-based enhancement with a pre-trained backbone. Specifically, the denoising module uses pairwise downsampling together with the proposed illumination prior to suppress noise in dark regions. We then guide the reverse sampling of the pre-trained diffusion model with a refinement strategy operating in both the frequency and spatial domains, so that illumination enhancement and local detail refinement can be jointly achieved during sampling. At each step, Fourier-based reconstruction contributes to illumination…

Jus Sanguinis – The Basic Principle in Citizenship Law, Comparative Analysis of First Citizenship Law between Visegrad Four and China

Da Lu

Political Science and International Relations · Journal on European history of law · · cited 0× · DOI ↗ · more like this ·

Citizenship defines the relationship between the individuals and the government in the modern society. The citizenship law had a long history in the world, in central Europe, Hungary published its first citizenship law in 1879. After the independent, Czechoslovakia and Poland had their own citizenship in 1920s. In China, Qing Dynasty also had its own nationality law in 1909. Although, these citizenship laws or nationality laws have some differences because of the different conditions in these countries, i.e. culture, economic condition. However, there are still have lots of similarity in these laws, the first and the most important principle similarity is jus sanguinis. Therefore, in this article the author will examine the first citizenship law in Hungary Kingdom, Czechoslovakia and Poland, the first nationality law in Qing Dynasty as well, and make comparison between these…

Kinematic and biomechanical responses of the spine to distraction surgery in children with early onset scoliosis: A 3-D finite element analysis

Baoqing Pei, Da Lu, Xueqing Wu +3 more

Sociology and Political Science · Greater South Information System · · cited 0× · DOI ↗ · more like this ·

Periodical and consecutive distraction is an effective treatment for severe early onset scoliosis (EOS), which enables the spinal coronal and sagittal plane deformity correction. However, the rate of rod fractures and postoperative complications was still high mainly related to the distraction process. Previous studies have primarily investigated the maximum safe distraction force without a rod broken, neglecting the spinal re-imbalance and distraction energy consumption, which is equally vital to evaluate the operative value. This study aimed to reveal the kinematic and biomechanical responses occurring after spinal distraction surgery, which were affected by traditional bilateral fixation. The spinal models (C6-S1) before four distractions were reconstructed based on CT images and the growing rods were applied with the upward displacement load of 0-25 mm at an interval of 5 mm.…