arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

William B. Haskell

54 papers · 2001–2026

2001: 12002: 02003: 02004: 02005: 02006: 02007: 22008: 02009: 02010: 12011: 12012: 32013: 22014: 42015: 02016: 62017: 82018: 72019: 72020: 62021: 02022: 22023: 02024: 12025: 12026: 2
2001peak 8 in 20172026

Frequent co-authors

Papers

showing 1–25 of 54 RSS

Real-Time Recognition of Physical Activities and Their Intensities Using Wireless Accelerometers and a Heart Rate Monitor

Emmanuel Munguia Tapia, Stephen Intille, William L. Haskell +4 more

Computer Vision and Pattern Recognition · · cited 454× · DOI ↗ · more like this ·

In this paper, we present a real-time algorithm for automatic recognition of not only physical activities, but also, in some cases, their intensities, using five triaxial wireless accelerometers and a wireless heart rate monitor. The algorithm has been evaluated using datasets consisting of 30 physical gymnasium activities collected from a total of 21 people at two different labs. On these activities, we have obtained a recognition accuracy performance of 94.6% using subject-dependent training and 56.3% using subject-independent training. The addition of heart rate data improves subject-dependent recognition accuracy only by 1.2% and subject-independent recognition only by 2.1%. When recognizing activity type without differentiating intensity levels, we obtain a subject-independent performance of 80.6%. We discuss why heart rate data has such little discriminatory power.

Activity Recognition Using a Single Accelerometer Placed at the Wrist or Ankle

Andrea Mannini, Stephen Intille, Mary E. Rosenberger +2 more

Computer Vision and Pattern Recognition · Medicine & Science in Sports & Exercise · · cited 380× · DOI ↗ · more like this ·

PURPOSE: Large physical activity surveillance projects such as the UK Biobank and NHANES are using wrist-worn accelerometer-based activity monitors that collect raw data. The goal is to increase wear time by asking subjects to wear the monitors on the wrist instead of the hip, and then to use information in the raw signal to improve activity type and intensity estimation. The purposes of this work was to obtain an algorithm to process wrist and ankle raw data and to classify behavior into four broad activity classes: ambulation, cycling, sedentary, and other activities. METHODS: Participants (N = 33) wearing accelerometers on the wrist and ankle performed 26 daily activities. The accelerometer data were collected, cleaned, and preprocessed to extract features that characterize 2-, 4-, and 12.8-s data windows. Feature vectors encoding information about frequency and intensity of motion…

Activity Recognition in Youth Using Single Accelerometer Placed at Wrist or Ankle

Andrea Mannini, Mary E. Rosenberger, William L. Haskell +2 more

Computer Vision and Pattern Recognition · Medicine & Science in Sports & Exercise · · cited 74× · DOI ↗ · more like this ·

PURPOSE: State-of-the-art methods for recognizing human activity using raw data from body-worn accelerometers have primarily been validated with data collected from adults. This study applies a previously available method for activity classification using wrist or ankle accelerometer to data sets collected from both adults and youth. METHODS: An algorithm for detecting activity from wrist-worn accelerometers, originally developed using data from 33 adults, is tested on a data set of 20 youth (age, 13 ± 1.3 yr). The algorithm is also extended by adding new features required to improve performance on the youth data set. Subsequent tests on both the adult and youth data were performed using crossed tests (training on one group and testing on the other) and leave-one-subject-out cross-validation. RESULTS: The new feature set improved overall recognition using wrist data by 2.3% for adults…

Empirical Dynamic Programming

William B. Haskell, Rahul Jain, Dileep Kalathil

math.OC · · cited 70× · arXiv ↗ · more like this ·

We propose empirical dynamic programming algorithms for Markov decision processes (MDPs). In these algorithms, the exact expectation in the Bellman operator in classical value iteration is replaced by an empirical estimate to get `empirical value iteration' (EVI). Policy evaluation and policy improvement in classical policy iteration are also replaced by simulation to get `empirical policy iteration' (EPI). Thus, these empirical dynamic programming algorithms involve iteration of a random operator, the empirical Bellman operator. We introduce notions of probabilistic fixed points for such random monotone operators. We develop a stochastic dominance framework for convergence analysis of such operators. We then use this to give sample complexity bounds for both EVI and EPI. We then provide various variations and extensions to asynchronous empirical dynamic programming, the minimax…

Design of a wearable physical activity monitoring system using mobile phones and accelerometers

Stephen Intille, Fahd Albinali, Salvador Postigo Mota +3 more

Computer Vision and Pattern Recognition · PubMed · · cited 39× · DOI ↗ · more like this ·

This paper describes the motivation for, and overarching design of, an open-source hardware and software system to enable population-scale, longitudinal measurement of physical activity and sedentary behavior using common mobile phones. The "Wockets" data collection system permits researchers to collect raw motion data from participants who wear multiple small, comfortable sensors for 24 hours per day, including during sleep, and monitor data collection remotely.

Stochastic L-BFGS: Improved Convergence Rates and Practical Acceleration Strategies

Renbo Zhao, William B. Haskell, Vincent Y. F. Tan

math.OC · · cited 36× · arXiv ↗ · more like this ·

We revisit the stochastic limited-memory BFGS (L-BFGS) algorithm. By proposing a new framework for the convergence analysis, we prove improved convergence rates and computational complexities of the stochastic L-BFGS algorithms compared to previous works. In addition, we propose several practical acceleration strategies to speed up the empirical performance of such algorithms. We also provide theoretical analyses for most of the strategies. Experiments on large-scale logistic and ridge regression problems demonstrate that our proposed strategies yield significant improvements vis-à-vis competing state-of-the-art algorithms.

Online planning for optimal protector strategies in resource conservation games

Yundi Qian, William B. Haskell, Albert Xin Jiang +1 more

Artificial Intelligence · Adaptive Agents and Multi-Agents Systems · · cited 20× · DOI ↗ · more like this ·

Protecting our environment and natural resources is a major global challenge. “Protectors ” (law enforcement agencies) try to protect these natural resources, while “extractors ” (criminals) seek to ex-ploit them. In many domains, such as illegal fishing, the extractors know more about the distribution and richness of the resources than the protectors, making it extremely difficult for the protectors to op-timally allocate their assets for patrol and interdiction. Fortunately, extractors carry out frequent illegal extractions, so protectors can learn about the richness of resources by observing the extractor’s behavior. This paper presents an approach for allocating protector assets based on learning from extractors. We make the following four specific contributions: (i) we model resource conservation as a repeated game; (ii) we transform this repeated game into a POMDP by adopting a…

A Universal Empirical Dynamic Programming Algorithm for Continuous State MDPs

William B. Haskell, Rahul Jain, Hiteshi Sharma +1 more

Artificial Intelligence · IEEE Transactions on Automatic Control · · cited 16× · DOI ↗ · more like this ·

We propose universal randomized function approximation-based empirical value learning (EVL) algorithms for Markov decision processes. The “empirical” nature comes from each iteration being done empirically from samples available from simulations of the next state. This makes the Bellman operator a random operator. A parametric and a nonparametric method for function approximation using a parametric function space and a reproducing kernel Hilbert space respectively are then combined with EVL. Both function spaces have the universal function approximation property. Basis functions are picked randomly. Convergence analysis is performed using a random operator framework with techniques from the theory of stochastic dominance. Finite time sample complexity bounds are derived for both universal approximate dynamic programming algorithms. Numerical experiments support the versatility and…

An Inexact Primal-Dual Smoothing Framework for Large-Scale Non-Bilinear Saddle Point Problems

Le Thi Khanh Hien, Renbo Zhao, William B. Haskell

math.OC · · cited 13× · arXiv ↗ · more like this ·

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the primal oracle complexity, while it has competitive dual oracle complexity. In addition, we consider the situation where the primal-dual coupling term has a large number of component functions. To efficiently handle this situation, we develop a randomized version of our smoothing framework, which allows the primal and dual sub-problems in each iteration to be inexactly solved by randomized algorithms in expectation. The convergence of this framework is analyzed both in expectation and with high probability. In terms of the primal and dual oracle complexities, this framework significantly improves over its deterministic counterpart. As an important…

Randomized function fitting-based empirical value iteration

William B. Haskell, P. L. Yu, Hiteshi Sharma +1 more

Artificial Intelligence · · cited 8× · DOI ↗ · more like this ·

Randomization is notable for being much less computationally expensive than optimization but often yielding comparable numerical performance. In this paper, we consider randomized function fitting combined with empirical value iteration for approximate dynamic programming on continuous state spaces. The method we propose is universal (i.e., not problem-dependent) and yields good approximations with high probability. A random operator theoretic framework is introduced for convergence analysis which uses a novel stochastic dominance argument. A non-asymptotic rate of convergence is obtained as a byproduct of the analysis. Numerical experiments confirm good performance of the algorithm proposed.

An Empirical Dynamic Programming Algorithm for Continuous MDPs

William B. Haskell, Rahul Jain, Hiteshi Sharma +1 more

math.OC · · cited 4× · arXiv ↗ · more like this ·

We propose universal randomized function approximation-based empirical value iteration (EVI) algorithms for Markov decision processes. The `empirical' nature comes from each iteration being done empirically from samples available from simulations of the next state. This makes the Bellman operator a random operator. A parametric and a non-parametric method for function approximation using a parametric function space and the Reproducing Kernel Hilbert Space (RKHS) respectively are then combined with EVI. Both function spaces have the universal function approximation property. Basis functions are picked randomly. Convergence analysis is done using a random operator framework with techniques from the theory of stochastic dominance. Finite time sample complexity bounds are derived for both universal approximate dynamic programming algorithms. Numerical experiments support the versatility and…

Dominance-constrained Markov decision processes

William B. Haskell, Rahul Jain

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

We are interested in risk constraints for discrete time Markov decision processes (MDPs). Starting with the average reward case, we argue that stochastic dominance constraints are natural risk constraints for MDPs. Specifically, we constrain the empirical distribution of reward to dominate a benchmark distribution in the increasing concave stochastic order. We argue that the optimal policy for the dominance-constrained MDP is a stationary randomized policy. Further, the optimal policy can be computed from a linear program in the space of occupation measures, where the dominance constraint is represented by linear inequalities. The dual of this linear program is computed and is shown to be close to the usual linear programming form of the average dynamic programming optimality equations. In our case, a pricing term appears in the dual corresponding to the dominance constraints. We carry…

An Optimal Algorithm for Stochastic Three-Composite Optimization

Renbo Zhao, William B. Haskell, Vincent Y. F. Tan

Artificial Intelligence · · cited 3× · OpenAlex ↗ · more like this ·

We develop an optimal primal-dual first-order algorithm for a class of stochastic three-composite convex minimization problems. The convergence rate of our method not only improves upon the existing methods, but also matches a lower bound derived for all first-order methods that solve this problem. We extend our proposed algorithm to solve a composite stochastic program with any finite number of nonsmooth functions. In addition, we generalize an optimal stochastic alternating direction method of multipliers (SADMM) algorithm proposed for the two-composite case to solve this problem, and establish its connection to our optimal primal-dual algorithm. We perform extensive numerical experiments on a variety of machine learning applications to demonstrate the superiority of our method via-a-vis the state-of-the-art.

A random monotone operator framework for strongly convex stochastic optimization

William B. Haskell, Rahul Jain

Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·

Analysis of every algorithm for stochastic optimization seems to require a different convergence proof. It would be desirable to have a unified mathematical framework within which with minimal extra effort, proof of convergence and its rate could be obtained. We present a random monotone operator-based unified convergence analysis framework for iterative algorithms for strongly convex stochastic optimization. The framework offers both versatility and simplicity, and allows for clean and straightforward analysis of many algorithms for stochatic convex minimization, saddle-point problems and variational inequalities. We show convergence of the random operator to a probabilistic fixed point, and obtain non-asymptotic rates of convergence. The analysis technique relies on a novel stochastic dominance argument.

A Unifying Framework for Variance Reduction Algorithms for Finding Zeroes of Monotone Operators

Xun Zhang, William B. Haskell, Zhisheng Ye

stat.ML · · cited 2× · arXiv ↗ · more like this ·

It is common to encounter large-scale monotone inclusion problems where the objective has a finite sum structure. We develop a general framework for variance-reduced forward-backward splitting algorithms for this problem. This framework includes a number of existing deterministic and variance-reduced algorithms for function minimization as special cases, and it is also applicable to more general problems such as saddle-point problems and variational inequalities. With a carefully constructed Lyapunov function, we show that the algorithms covered by our framework enjoy a linear convergence rate in expectation under mild assumptions. We further consider Catalyst acceleration and asynchronous implementation to reduce the algorithmic complexity and computation time. We apply our proposed framework to a policy evaluation problem and a strongly monotone two-player game, both of which fall…

Empirical Value Iteration for approximate dynamic programming

William B. Haskell, Rahul Jain, Dileep Kalathil

Statistics and Probability · · cited 2× · DOI ↗ · more like this ·

We propose a simulation based algorithm, Empirical Value Iteration (EVI) algorithm, for finding the optimal value function of an MDP with infinite horizon discounted cost criteria when the transition probability kernels are unknown. Unlike simulation based algorithms using stochastic approximation techniques which give only asymptotic convergence results, we give provable, non-asymptotic performance guarantees in terms of sample complexity results: given ε > 0 and δ > 0, we specify the minimum number of simulation samples n(ε; δ) needed in each iteration and the minimum number of iterations t(ε; δ) that are sufficient for the EVI to yield, with a probability at least 1 − δ, an approximate value function that is at least ε close to the optimal value function.

Empirical Algorithms for General Stochastic Systems with Continuous States and Actions

Hiteshi Sharma, Rahul Jain, William B. Haskell

Artificial Intelligence · · cited 1× · DOI ↗ · more like this ·

In this paper, we present Randomized Empirical Value Learning (RAEVL) algorithm for MDPs with continuous state and action spaces. This algorithm combines the ideas of random search over action space with randomized function approximation method to generalize the value functions over state space . Our theoretical analysis is done under a random operator framework combined with stochastic dominance argument. This provides finite-time analysis of the proposed algorithm as well as give the sample complexity.

Robust Data-Driven Quasi-Concave Optimization

Jian Wu, William B. Haskell, Wenjie Huang +1 more

Artificial Intelligence · INFORMS journal on computing · · cited 0× · DOI ↗ · more like this ·

We investigate a data-driven quasi-concave maximization problem where information about the objective function is limited to a finite sample of data points. We begin by defining an ambiguity set for admissible objective functions based on available partial information about the objective. This ambiguity set consists of those quasi-concave functions that majorize a given data sample and that satisfy additional functional properties (monotonicity, Lipschitz continuity, and permutation invariance). We then formulate a robust optimization (RO) problem that maximizes the worst-case objective function over this ambiguity set. Based on the quasi-concave structure in this problem, we explicitly construct the upper-level sets of the worst-case objective at all levels. We can then solve the resulting RO problem efficiently by doing binary search over the upper-level sets and solving a logarithmic…

Robust Data-Driven Quasiconcave Optimization

Jian Wu, William B. Haskell, Wenjie Huang +1 more

math.OC · · cited 0× · arXiv ↗ · more like this ·

We investigate a data-driven quasiconcave maximization problem where information about the objective function is limited to a finite sample of data points. We begin by defining an ambiguity set for admissible objective functions based on available partial information about the objective. This ambiguity set consists of those quasiconcave functions that majorize a given data sample, and that satisfy additional functional properties (monotonicity, Lipschitz continuity, and permutation invariance). We then formulate a robust optimization (RO) problem which maximizes the worst-case objective function over this ambiguity set. Based on the quasiconcave structure in this problem, we explicitly construct the upper level sets of the worst-case objective at all levels. We can then solve the resulting RO problem efficiently by doing binary search over the upper level sets and solving a logarithmic…

Convergence of Recursive Stochastic Algorithms using Wasserstein Divergence

Abhishek Gupta, William B. Haskell

cs.LG · · cited 0× · arXiv ↗ · more like this ·

This paper develops a unified framework, based on iterated random operator theory, to analyze the convergence of constant stepsize recursive stochastic algorithms (RSAs). RSAs use randomization to efficiently compute expectations, and so their iterates form a stochastic process. The key idea of our analysis is to lift the RSA into an appropriate higher-dimensional space and then express it as an equivalent Markov chain. Instead of determining the convergence of this Markov chain (which may not converge under constant stepsize), we study the convergence of the distribution of this Markov chain. To study this, we define a new notion of Wasserstein divergence. We show that if the distribution of the iterates in the Markov chain satisfy a contraction property with respect to the Wasserstein divergence, then the Markov chain admits an invariant distribution. We show that convergence of a…

Model and Reinforcement Learning for Markov Games with Risk Preferences

Wenjie Huang, Pham Viet Hai, William B. Haskell

cs.GT · · cited 0× · arXiv ↗ · more like this ·

We motivate and propose a new model for non-cooperative Markov game which considers the interactions of risk-aware players. This model characterizes the time-consistent dynamic "risk" from both stochastic state transitions (inherent to the game) and randomized mixed strategies (due to all other players). An appropriate risk-aware equilibrium concept is proposed and the existence of such equilibria is demonstrated in stationary strategies by an application of Kakutani's fixed point theorem. We further propose a simulation-based Q-learning type algorithm for risk-aware equilibrium computation. This algorithm works with a special form of minimax risk measures which can naturally be written as saddle-point stochastic optimization problems, and covers many widely investigated risk measures. Finally, the almost sure convergence of this simulation-based algorithm to an equilibrium is…

Corporative Stochastic Approximation with Random Constraint Sampling for Semi-Infinite Programming

Bo Wei, William B. Haskell, Sixiang Zhao

math.OC · · cited 0× · arXiv ↗ · more like this ·

We developed a corporative stochastic approximation (CSA) type algorithm for semi-infinite programming (SIP), where the cut generation problem is solved inexactly. First, we provide general error bounds for inexact CSA. Then, we propose two specific random constraint sampling schemes to approximately solve the cut generation problem. When the objective and constraint functions are generally convex, we show that our randomized CSA algorithms achieve an $\mathcal{O}(1/\sqrt{N})$ rate of convergence in expectation (in terms of optimality gap as well as SIP constraint violation). When the objective and constraint functions are all strongly convex, this rate can be improved to $\mathcal{O}(1/N)$.

An Inexact Primal-Dual Algorithm for Semi-Infinite Programming

Bo Wei, William B. Haskell, Sixiang Zhao

math.OC · · cited 0× · arXiv ↗ · more like this ·

This paper considers an inexact primal-dual algorithm for semi-infinite programming (SIP) for which it provides general error bounds. To implement the dual variable update, we create a new prox function for nonnegative measures which turns out to be a generalization of the Kullback-Leibler divergence for probability distributions. We show that under suitable conditions on the error, this algorithm achieves an $\mathcal{O}(1/\sqrt{K})$ rate of convergence in terms of the optimality gap and constraint violation. We then use our general error bounds to analyze the convergence and sample complexity of a specific primal-dual SIP algorithm based on Monte Carlo integration. Finally, we provide numerical experiments to demonstrate the performance of our algorithm.

Inexact iteration of averaged operators for non-strongly convex stochastic optimization

William B. Haskell, Rahul Jain

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

We focus on inexact iteration of averaged operators with stochastic errors, and we give conditions for a sublinear O (1 /K) convergence rate for this class of iteration. Then, we show that our general development gives convergence rate analysis for sampling-based algorithms for non-strongly convex stochastic optimization including minimization, saddle-point problems, and constrained optimization.

A dynamical systems framework for stochastic iterative optimization

William B. Haskell, Rahul Jain, Hiteshi Sharma

Artificial Intelligence · · cited 0× · DOI ↗ · more like this ·

Stochastic optimization typically are solved via stochastic iterative algorithms. Examples are stochastic gradient descent, and other first-order methods for stochastic optimization. In such algorithms, exact computation of the gradient of the objective function is generally not possible. Hence, empirical estimates are used instead. We view such algorithms as a linear dynamical system but with noisy non-linear feedback. We give a general framework for probabilistic stability analysis of such dynamical systems. This is done via a novel stochastic dominance argument that was developed for convergence analysis of iterated random operators. We are also able to give a non-asymptotic rate of convergence within this framework.