arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Benjamin Berg

28 papers · 1950–2026

1967: 01968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 01978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 11997: 01998: 01999: 02000: 02001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 12009: 02010: 02011: 12012: 02013: 22014: 02015: 02016: 22017: 12018: 22019: 32020: 22021: 32022: 12023: 02024: 32025: 22026: 3
1967peak 3 in 20192026

Frequent co-authors

Papers

showing 1–25 of 28 RSS

Kangaroo

Sara McAllister, Benjamin Berg, Julian Tutuncu-Macias +6 more

Computer Networks and Communications · · cited 38× · DOI ↗ · more like this ·

Many social-media and IoT services have very large working sets consisting of billions of tiny (≈100 B) objects. Large, flash-based caches are important to serving these working sets at acceptable monetary cost. However, caching tiny objects on flash is challenging for two reasons: (i) SSDs can read/write data only in multi-KB "pages" that are much larger than a single object, stressing the limited number of times flash can be written; and (ii) very few bits per cached object can be kept in DRAM without losing flash's cost advantage. Unfortunately, existing flash-cache designs fall short of addressing these challenges: write-optimized designs require too much DRAM, and DRAM-optimized designs require too many flash writes.

RobinHood: tail latency-aware caching—dynamically reallocating from cache-rich to cache-poor

Daniel S. Berger, Benjamin Berg, Timothy Zhu +2 more

Computer Networks and Communications · Operating Systems Design and Implementation · · cited 28× · DOI ↗ · more like this ·

Tail latency is of great importance in user-facing web services. However, maintaining low tail latency is challenging, because a single request to a web application server results in multiple queries to complex, diverse backend services (databases, recommender systems, ad systems, etc.). A request is not complete until all of its queries have completed. We analyze a Microsoft production system and find that backend query latencies vary by more than two orders of magnitude across backends and over time, resulting in high request tail latencies.We propose a novel solution for maintaining low request tail latency: repurpose existing caches to mitigate the effects of backend latency variability, rather than just caching popular data. Our solution, RobinHood, dynamically reallocates cache resources from the cache-rich (backends which don't affect request tail latency) to the cache-poor…

Towards Optimality in Parallel Scheduling

Benjamin Berg, Jan-Pieter Dorsman, Mor Harchol-Balter

cs.PF · · cited 27× · arXiv ↗ · more like this ·

To keep pace with Moore's law, chip designers have focused on increasing the number of cores per chip rather than single core performance. In turn, modern jobs are often designed to run on any number of cores. However, to effectively leverage these multi-core chips, one must address the question of how many cores to assign to each job. Given that jobs receive sublinear speedups from additional cores, there is an obvious tradeoff: allocating more cores to an individual job reduces the job's runtime, but in turn decreases the efficiency of the overall system. We ask how the system should schedule jobs across cores so as to minimize the mean response time over a stream of incoming jobs. To answer this question, we develop an analytical model of jobs running on a multi-core machine. We prove that EQUI, a policy which continuously divides cores evenly across jobs, is optimal when all jobs…

Towards Optimality in Parallel Job Scheduling

Benjamin Berg, Jan-Pieter Dorsman, Mor Harchol‐Balter

Hardware and Architecture · UvA-DARE (University of Amsterdam) · · cited 20× · DOI ↗ · more like this ·

To keep pace with Moore's law, chip designers have focused on increasing the number of cores per chip. To effectively leverage these multi-core chips, one must decide how many cores to assign to each job. Given that jobs receive sublinear speedups from additional cores, there is a tradeoff: allocating more cores to an individual job reduces the job's runtime, but decreases the efficiency of the overall system. We ask how the system should assign cores to jobs so as to minimize the mean response time over a stream of incoming jobs. To answer this question, we develop an analytical model of jobs running on a multi-core machine. We prove that EQUI, a policy which continuously divides cores evenly across jobs, is optimal when all jobs follow a single speedup curve and have exponentially distributed sizes. We also consider a class of "fixed-width" policies, which choose a single level of…

heSRPT: Parallel Scheduling to Minimize Mean Slowdown

Benjamin Berg, Rein Vesilo, Mor Harchol-Balter

cs.DC · · cited 7× · arXiv ↗ · more like this ·

Modern data centers serve workloads which are capable of exploiting parallelism. When a job parallelizes across multiple servers it will complete more quickly, but jobs receive diminishing returns from being allocated additional servers. Because allocating multiple servers to a single job is inefficient, it is unclear how best to allocate a fixed number of servers between many parallelizable jobs. This paper provides the first optimal allocation policy for minimizing the mean slowdown of parallelizable jobs of known size when all jobs are present at time 0. Our policy provides a simple closed form formula for the optimal allocations at every moment in time. Minimizing mean slowdown usually requires favoring short jobs over long ones (as in the SRPT policy). However, because parallelizable jobs have sublinear speedup functions, system efficiency is also an issue. System efficiency is…

Maximizing Page-Level Cache Hit Ratios in LargeWeb Services

Justin Wang, Benjamin Berg, Daniel S. Berger +1 more

Computer Networks and Communications · ACM SIGMETRICS Performance Evaluation Review · · cited 7× · DOI ↗ · more like this ·

Large web services typically serve pages consisting of many individual objects. To improve the response times of page-requests, these services store a small set of popular objects in a fast caching layer. A page-request is not considered complete until all of its objects have either been found in the cache or retrieved from a backend system. Hence, caching only speeds up a page request if all of its objects are found in the cache. We seek caching policies that maximize the page-level hit ratio-the fraction of requests that find all of their objects in the cache. This work analyzes page requests served by a Microsoft production system.We find that in practice there is potential for improving the page-level hit ratio over existing caching strategies, but that analytically maximizing the page-level hit ratio is NP-hard.

FairyWREN: A Sustainable Cache for Emerging Write-Read-Erase Flash Interfaces

Sara McAllister, Y. Wang, Benjamin Berg +4 more

Computer Networks and Communications · ACM Transactions on Storage · · cited 4× · DOI ↗ · more like this ·

Datacenters need to reduce embodied carbon emissions, particularly for flash, which accounts for 40% of embodied carbon in servers. However, decreasing flash’s embodied emissions is challenging due to flash’s limited write endurance, which more than halves with each generation of denser flash. Reducing embodied emissions requires extending flash lifetime, stressing its limited write endurance even further. The legacy Logical Block-Addressable Device (LBAD) interface exacerbates the problem by forcing devices to perform garbage collection, leading to even more writes. Flash-based caches in particular write frequently, limiting the lifetimes and densities of the devices they use. These flash caches illustrate the need to break away from LBAD and switch to the new Write-Read-Erase iNterfaces (WREN) now coming to market. WREN affords applications control over data placement and garbage…

Kangaroo: Theory and Practice of Caching Billions of Tiny Objects on Flash

Sara McAllister, Benjamin Berg, Julian Tutuncu-Macias +6 more

Computer Networks and Communications · ACM Transactions on Storage · · cited 4× · DOI ↗ · more like this ·

Many social-media and IoT services have very large working sets consisting of billions of tiny (≈100 B) objects. Large, flash-based caches are important to serving these working sets at acceptable monetary cost. However, caching tiny objects on flash is challenging for two reasons: (i) SSDs can read/write data only in multi-KB “pages” that are much larger than a single object, stressing the limited number of times flash can be written; and (ii) very few bits per cached object can be kept in DRAM without losing flash’s cost advantage. Unfortunately, existing flash-cache designs fall short of addressing these challenges: write-optimized designs require too much DRAM, and DRAM-optimized designs require too many flash writes. We present Kangaroo , a new flash-cache design that optimizes both DRAM usage and flash writes to maximize cache performance while minimizing cost. Kangaroo combines a…

Optimal Scheduling of Parallel Jobs With Unknown Service Requirements

Benjamin Berg, Mor Harchol‐Balter

Computer Networks and Communications · Advances in systems analysis, software engineering, and high performance computing book series · · cited 3× · DOI ↗ · more like this ·

Large data centers composed of many servers provide the opportunity to improve performance by parallelizing jobs. However, effectively exploiting parallelism is non-trivial. For each arriving job, one must decide the number of servers on which the job is run. The goal is to determine the optimal allocation of servers to jobs that minimizes the mean response time across jobs – the average time from when a job arrives until it completes. Parallelizing a job across multiple servers reduces the response time of that individual job. However, jobs receive diminishing returns from being allocated additional servers, so allocating too many servers to a single job leads to low system efficiency. The authors consider the case where the remaining sizes of jobs are unknown to the system at every moment in time. They prove that, if all jobs follow the same speedup function, the optimal policy is…

heSRPT

Benjamin Berg, Rein Vesilo, Mor Harchol‐Balter

Hardware and Architecture · ACM SIGMETRICS Performance Evaluation Review · · cited 3× · DOI ↗ · more like this ·

Nearly all modern data centers serve workloads which are capable of exploiting parallelism. When a job parallelizes across multiple servers it will complete more quickly, but jobs receive diminishing returns from being allocated additional servers. Because allocating multiple servers to a single job is inefficient, it is unclear how best to share a fixed number of servers between many parallelizable jobs. In this paper, we provide the first closed form expression for the optimal allocation of servers to jobs. Specifically, we specify the number of servers that should be allocated to each job at every moment in time. Our solution is a combination of favoring small jobs (as in SRPT scheduling) while still ensuring high system efficiency. We call our scheduling policy high-efficiency SRPT (heSRPT).

Fast geometry acquisition for mixed reality applications using motion tracking

A. Sherstyuk, Anton Treskunov, Benjamin W. Berg

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Mixing real and virtual elements into one environment often involves creating geometry models of physical objects. Traditional approaches include manual modeling by 3D artists or use of dedicated devices. Both approaches require special skills or special hardware and may be costly. We propose a new method for fast semi-automatic 3D geometry acquisition, based upon unconventional use of motion tracking equipment. The proposed method is intended for quick surface prototyping for virtual, augmented and mixed reality applications where quality of visualization of objects is not required or is of low priority.

The case for phase-aware scheduling of parallelizable jobs

Benjamin Berg, Justin Whitehouse, Benjamin Moseley +2 more

Computer Networks and Communications · Performance Evaluation · · cited 2× · DOI ↗ · more like this ·

Parallelizable jobs typically consist of multiple phases of computation, where the job is more parallelizable in some phases and less parallelizable in others. For example, in a database, a query may consist of a highly parallelizable table scan, followed by a less parallelizable table join. In the past, this phase-varying parallelizability was summarized by a single sub-linear speedup curve that measures a job’s average parallelizability over its entire lifetime. Today, however, modern systems have fine-grained knowledge of the exact phase each job is in at every moment in time. Unfortunately, these systems do not fully leverage this real-time feedback when scheduling parallelizable jobs. Theory has failed to produce practical phase-aware scheduling policies, and thus scheduling in current systems is largely heuristic. A phase-aware scheduling policy must decide, given its knowledge of…

Model of mobility demands for future short distance public transport systems

Alexander Sandau, Jorge Marx Gómez, Daniel Stamer +2 more

Transportation · Multilingual Matters (Channel View Publications) · · cited 2× · OpenAlex ↗ · more like this ·

Short distance public transport faces huge challenges, although it is very important within a sustainable transport system to reduce traffic emissions. Revenues and subsidization are decreasing and especially in rural regions the offer is constantly diminishing. New approaches for public transport systems are strongly needed to avoid traffic infarcts in urban and rural areas to grant a basic offer of mobility services for everyone. In the proposed work a demand centered approach of dynamic public transport planning is introduced which relies on regional traffic data. The approach is based on a demand model which is represented as a dynamic undirected attributed graph. The demands are logged through traffic sensors and sustainability focused traveler information systems.

Incentive Scheme within a Sustainability CRM for Mobility

Benjamin Berg, Rolf Norrenbrock, Jorge Marx Gómez

Sociology and Political Science · EnviroInfo · · cited 1× · OpenAlex ↗ · more like this ·

The ecological dimension of sustainability in the m eaning of consumption of natural resources is one i mportant topic of our times. The transportation of goods and perso ns has a major impact on resource consumption and emissions. Electric vehicles are not solving these problems bu t they are offering a chance for a change of the mo bility behaviour towards an eco-friendly mobility. This change of be haviour needs new transportation offers, new busine ss models and new information systems. Intermodal transportat ion and the switch from individual mobility with co mbustion engine cars to public transport is here a key facto r. Also new offers like car-sharing and car-pooling are playing an important role. Mobility management and mobility marketing addressing this switch of mobility on a mun icipal and on a company level. New and existing mobility provider like Deutsche Bahn sustainable…

Non-preemptive Datacenter Scheduling via Scaling Cycles

Zhongrui Chen, Heyuan Yao, Izzy Grosof +1 more

Information Systems · ACM SIGMETRICS Performance Evaluation Review · · cited 0× · DOI ↗ · more like this ·

Modern data center servers process multiple jobs in parallel to improve performance. However, each job demands some subset of a server's resources (e.g., CPUs, memory, storage), and a set of jobs can run in parallel only if there are sufficient computational resources to meet each job's needs. Given a stream of arriving jobs, a scheduling policy must choose a set of jobs to run in parallel at every moment in time. While prior work has studied the stability and mean response time of various scheduling policies in this setting, the vast majority of this work assumes that jobs can be preempted at any time with no overhead. In practice, however, datacenter jobs accumulate significant state as they run, making preemption costly or even impossible. In these limited preemption scenarios, little is known about the optimal way to schedule jobs and avoid excessive preemption overhead. We consider…

Improving Nonpreemptive Multiserver Job Scheduling with Quickswap

Zhongrui Chen, Adityo Anggraito, Diletta Olliaro +4 more

cs.PF · · cited 0× · arXiv ↗ · more like this ·

Modern data center workloads are composed of multiserver jobs, computational jobs that require multiple servers in order to run. A data center server can run many multiserver jobs in parallel, as long as it has sufficient resources to meet their demands. However, multiserver jobs are generally stateful, meaning that job preemptions incur significant overhead from saving and reloading the state associated with running jobs. Hence, most systems try to avoid these costly job preemptions altogether. Given these constraints, a scheduling policy must determine what set of jobs to run in parallel at each moment in time to minimize the mean response time across a stream of arriving jobs. Unfortunately, simple non-preemptive policies such as FCFS may leave many servers idle, resulting in high mean response times or even system instability. Our goal is to design and analyze non-preemptive…

Improving Multiresource Job Scheduling with Markovian Service Rate Policies

Zhongrui Chen, Isaac Grosof, Benjamin Berg

cs.PF · · cited 0× · arXiv ↗ · more like this ·

Modern cloud computing workloads are composed of multiresource jobs that require a variety of computational resources in order to run, such as CPU cores, memory, disk space, or hardware accelerators. A single cloud server can typically run many multiresource jobs in parallel, but only if the server has sufficient resources to satisfy the demands of every job. A scheduling policy must therefore select sets of multiresource jobs to run in parallel in order to minimize the mean response time across jobs -- the average time from when a job arrives to the system until it is completed. Unfortunately, achieving low response times by selecting sets of jobs that fully utilize the available server resources has proven to be a difficult problem. In this paper, we develop and analyze a new class of policies for scheduling multiresource jobs, called Markovian Service Rate (MSR) policies. While prior…

How to Rent GPUs on a Budget

Zhouzi Li, Benjamin Berg, Arpan Mukhopadhyay +1 more

cs.DC · · cited 0× · arXiv ↗ · more like this ·

The explosion in Machine Learning (ML) over the past ten years has led to a dramatic increase in demand for GPUs to train ML models. Because it is prohibitively expensive for most users to build and maintain a large GPU cluster, large cloud providers (Microsoft Azure, Amazon AWS, Google Cloud) have seen explosive growth in demand for renting cloud-based GPUs. In this cloud-computing paradigm, a user must specify their demand for GPUs at every moment in time, and will pay for every GPU-hour they use. ML training jobs are known to be parallelizable to different degrees. Given a stream of ML training jobs, a user typically wants to minimize the mean response time across all jobs. Here, the response time of a job denotes the time from when a job arrives until it is complete. Additionally, the user is constrained by some operating budget. Specifically, in this paper the user is constrained…

Asymptotically Optimal Scheduling of Multiple Parallelizable Job Classes

Benjamin Berg, Benjamin Moseley, Weina Wang +1 more

cs.PF · · cited 0× · arXiv ↗ · more like this ·

Modern computing workloads are often composed of parallelizable jobs. A parallelizable job can be completed more quickly when run on additional servers. However, each job can only use a limited number of servers, known as its parallelizability level, which is determined by the type of computation the job performs and how it is implemented. Workloads generally consist of multiple job classes, where jobs from different classes have different parallelizability levels and follow different job size (service requirement) distributions. This paper considers scheduling parallelizable jobs belonging to an arbitrary number of job classes. Given a limited number of servers, we must allocate servers across a stream of arriving jobs to minimize mean response time -- the average time from when a job arrives to the system until it completes. We find that in lighter-load scaling regimes (i.e.…

Optimal Resource Allocation for Elastic and Inelastic Jobs

Benjamin Berg, Mor Harchol-Balter, Benjamin Moseley +2 more

cs.PF · · cited 0× · arXiv ↗ · more like this ·

Modern data centers are tasked with processing heterogeneous workloads consisting of various classes of jobs. These classes differ in their arrival rates, size distributions, and job parallelizability. With respect to paralellizability, some jobs are elastic, meaning they can parallelize linearly across many servers. Other jobs are inelastic, meaning they can only run on a single server. Although job classes can differ drastically, they are typically forced to share a single cluster. When sharing a cluster among heterogeneous jobs, one must decide how to allocate servers to each job at every moment in time. In this paper, we design and analyze allocation policies which aim to minimize the mean response time across jobs, where a job's response time is the time from when it arrives until it completes. We model this problem in a stochastic setting where each job may be elastic or…

heSRPT: Optimal Parallel Scheduling of Jobs With Known Sizes

Benjamin Berg, Rein Vesilo, Mor Harchol-Balter

cs.PF · · cited 0× · arXiv ↗ · more like this ·

When parallelizing a set of jobs across many servers, one must balance a trade-off between granting priority to short jobs and maintaining the overall efficiency of the system. When the goal is to minimize the mean flow time of a set of jobs, it is usually the case that one wants to complete short jobs before long jobs. However, since jobs usually cannot be parallelized with perfect efficiency, granting strict priority to the short jobs can result in very low system efficiency which in turn hurts the mean flow time across jobs. In this paper, we derive the optimal policy for allocating servers to jobs at every moment in time in order to minimize mean flow time across jobs. We assume that jobs follow a sublinear, concave speedup function, and hence jobs experience diminishing returns from being allocated additional servers. We show that the optimal policy, heSRPT, will complete jobs…

Teaching in-memory computing and big data related skills at university

Viktor Dmitriyev, Benjamin Berg, Daniel Stamer +4 more

Information Systems · Carl von Ossiezky University of Oldenburg · · cited 0× · OpenAlex ↗ · more like this ·

Adapting particular novice topics for university’s curricula is a challenging task. Especially, when domains to be adopted are evolving rapidly and there are not much available materials, which explicitly dedicated to teaching. Beside availability of materials, overall management and law eligibility can be a really big obstacle in establishing a novice curricula. However, it’s very important to keep teaching programs close to appearing new topics in academia and industry in order to provide students with relevant knowledge and empowering them with advantage on labor market. Current work describes concrete ways how to address teaching to students such phenomena as big data and in-memory computing. Work shows how to build into teaching program novice trends, which are trending both in academia and industry, and at the same time to void hidden pitfalls and overcome obstacles. Work…

Board 500- Technology Innovations Abstract Clinical Map as a Design Tool for Simulation Scenarios

Yasuhiko Ajimi, Hiroshi Okudera, Tetsuya Sakamoto +1 more

Artificial Intelligence · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · · cited 0× · DOI ↗ · more like this ·

Introduction/Background We reported Scenario Maker as a novel tool for making a training scenario at IMSH 2012. Scenario Maker has a structure of a clinical map (CM) with changeable elements. New scenarios can be produced by selecting elements from pull-down menus in cells of Scenario Maker. We have developed Scenario Maker to adapt to more complicated scenarios. In this paper, we report how to design training scenarios for ACEC (Advanced Coma Evaluation and Care) as half a day course for training initial managements for impaired consciousness caused by various pathologies. Methods A CM has a tabular form, representing a clinical pathway, consisting of a frame and elements. The horizontal axis of the frame shows the steps of an algorithm, and the vertical axis shows a medical situation in which various medical practices are performed such as physical and physiological examinations…

International Journal of Image and Graphics c ○ World Scientific Publishing Company SEMI-AUTOMATIC SURFACE SCANNER FOR MEDICAL TANGIBLE USER INTERFACES

Andrei Sherstyuk, Anton Treskunov, Benjamin Berg

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Mixing real and virtual components into one consistent environment often involves creating geometry models of physical objects. Traditional approaches include manual modeling by 3D artists or use of dedicated devices. Both approaches require special skills or special hardware and may be costly. We propose a new method for fast semi-automatic 3D geometry acquisition, based upon unconventional use of motion tracking equipment. The proposed method is intended for quick surface prototyping for Virtual, Augmented and Mixed reality applications (VR/AR/MR), where quality of visualization of scanned objects is not required or is of low priority.

Dateline: Boualapha, Laos

Benjamin W. Berg

Political Science and International Relations · eVols (University of Hawaii) · · cited 0× · OpenAlex ↗ · more like this ·

staff cardiolog ist at Tripler Regional Medical Center was deployed to provided medical care for a team of U.S. personne l during a 26 day mission to Laos in October, 1996.The team was on a regularly schedule d mission to search for and recover the remains of servicem en who remain missing, or were killed in action, during the Vietnam Conflict.This team is part of a standing Hawaii based joint task force which has conducte d the ongoing recovery mission for the past 18 years.Dr Chu was accompa nied by 4 trained medics, from the Army, Navy, and Air Force.His report of this experien ce follows.During the month of October, at the end of the rainy season, the weather was very hot but dry, with a few days of high humidity and heavy rain.Mosquit os, large centiped es and snakes were regular visitors to the Boualaph a base camp site, as this is normally a prairie for the town water buffaloes…