an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org
Author
57 papers · 1949–2026
showing 1–25 of 57 RSS
Michael Kölling, Bruce Quig, Andrew Patterson +1 more
Many teachers experience serious problems when teaching object orientation to beginners or professionals. Many of these problems could be overcome or reduced through the use \nof more appropriate tools. In this paper, we introduce BlueJ, an integrated development environment designed for teaching object orientation, and discuss how the use of this tool can change the approach to teaching.
Lei Le, Andrew Patterson, Martha White
Generalization performance is a central goal in machine learning, particularly when learning representations with large neural networks. A common strategy to improve generalization has been through the use of regularizers, typically as a norm constraining the parameters. Regularizing hidden layers in a neural network architecture, however, is not straightforward. There have been a few effective layer-wise suggestions, but without theoretical guarantees for improved performance. In this work, we theoretically and empirically analyze one such model, called a supervised auto-encoder: a neural network that predicts both inputs (reconstruction error) and targets jointly. We provide a novel generalization result for linear auto-encoders, proving uniform stability based on the inclusion of the reconstruction error---particularly as an improvement on simplistic regularization such as norms or…
Yangchen Pan, Muhammad Zaheer, Adam White +2 more
Model-based strategies for control are critical to obtain sample efficient learning. Dyna is a planning paradigm that naturally interleaves learning and planning, by simulating one-step experience to update the action-value function. This elegant planning strategy has been mostly explored in the tabular setting. The aim of this paper is to revisit sample-based planning, in stochastic and continuous domains with learned models. We first highlight the flexibility afforded by a model over Experience Replay (ER). Replay-based methods can be seen as stochastic planning methods that repeatedly sample from a buffer of recent agent-environment interactions and perform updates to improve data efficiency. We show that a model, as opposed to a replay buffer, is particularly useful for specifying which states to sample from during planning, such as predecessor states that propagate information in…
Andrew Patterson, Michael Kölling, John Rosenberg
The teaching of testing has never been easy. The introduction of object orientation into first year courses has made it even more difficult, since more and smaller units need to be tested more often. In professional contexts this is addressed by the use of testing support software. Unfortunately, no adequate software to support testing for introductory students is widely available, leaving teachers and students of first year courses struggling.In this paper we describe an attempt to address this problem by combining two existing systems that partly address our needs. We describe an integration of JUnit into BlueJ, which creates a testing tool that exhibits the flexibility and ease-of-use of the BlueJ system combined with the structured unit test approach provided by JUnit.
Gerry Veenstra, Andrew C. Patterson
Inspired by Bourdieu's theories on various forms of capital, conversions among them, and the fields (social spaces) delineated by possession of them, the authors investigate distinct and interconnected effects of cultural, economic, and social capitals on risk of mortality. Using 35 years of longitudinal data from the Alameda County Study (n = 6,157), they created discrete-time hazard models to predict all-cause mortality from educational attainment (institutionalized cultural capital), household income (economic capital), and different forms of personal ties (social capital). The results show that education, income, having three or more close friends, regularity of church attendance, and participation in social/recreational groups were all negatively and significantly associated with risk of mortality. Income mediated a significant portion of the education effect. None of the personal…
Gerry Veenstra, Andrew C. Patterson
OBJECTIVES: We apply intersectionality theory to health inequalities in Canada by investigating whether South Asian-White health inequalities are conditioned by gender and immigrant status in a synergistic way. DESIGN: Our dataset comprised 10 cycles (2001-2013) of the Canadian Community Health Survey. Using binary logistic regression modeling, we examined South Asian-White inequalities in self-rated health, diabetes, hypertension and asthma before and after controlling for potentially explanatory factors. Models were calculated separately in subsamples of native-born women, native-born men, immigrant women and immigrant men. RESULTS: South Asian immigrants had higher odds of fair/poor self-rated health, diabetes and hypertension than White immigrants. Native-born South Asian men had higher odds of fair/poor self-rated health than native-born White men and native-born South Asian women…
Andrew Patterson, Hongxiang Chen, Leonard Wossnig +3 more
Near-term quantum computers are noisy, and therefore must run algorithms with a low circuit depth and qubit count. Here we investigate how noise affects a quantum neural network (QNN) for state discrimination, applicable on near-term quantum devices as it fulfils the above criteria. We find that when simulating gradient calculation on a noisy device, a large number of parameters is disadvantageous. By introducing a new smaller circuit ansatz we overcome this limitation, and find that the QNN performs well at noise levels of current quantum hardware. We also show that networks trained at higher noise levels can still converge to useful parameters. Our findings show that noisy quantum computers can be used in applications for state discrimination and for classifiers of the output of quantum generative adversarial networks.
Matthew Schlegel, Andrew Jacobsen, Zaheer Abbas +3 more
State construction is important for learning in partially observable environments. A general purpose strategy for state construction is to learn the state update using a Recurrent Neural Network (RNN), which updates the internal state using the current internal state and the most recent observation. This internal state provides a summary of the observed sequence, to facilitate accurate predictions and decision-making. At the same time, specifying and training RNNs is notoriously tricky, particularly as the common strategy to approximate gradients back in time, called truncated Back-prop Through Time (BPTT), can be sensitive to the truncation window. Further, domain-expertise--which can usually help constrain the function class and so improve trainability--can be difficult to incorporate into complex recurrent units used within RNNs. In this work, we explore how to use multi-step…
Andrew Patterson, Victor Liao, Martha White
Most value function learning algorithms in reinforcement learning are based on the mean squared (projected) Bellman error. However, squared errors are known to be sensitive to outliers, both skewing the solution of the objective and resulting in high-magnitude and high-variance gradients. To control these high-magnitude updates, typical strategies in RL involve clipping gradients, clipping rewards, rescaling rewards, or clipping errors. While these strategies appear to be related to robust losses -- like the Huber loss -- they are built on semi-gradient update rules which do not minimize a known loss. In this work, we build on recent insights reformulating squared Bellman errors as a saddlepoint optimization problem and propose a saddlepoint reformulation for a Huber Bellman error and Absolute Bellman error. We start from a formalization of robust losses, then derive sound…
This study considers whether socioeconomic status influences the impact of social isolation on mortality risk. Using data from the Alameda County Study, Cox proportional hazard models indicate that having a high income worsens the mortality risk of social isolation. Education may offset risk, however, and the specific pattern that emerges depends on which measures for socioeconomic status and social isolation are included. Additionally, lonely people who earn high incomes suffer especially high risk of accidents and suicides as well as cancer. Further research is needed that contextualizes the health risks of social isolation within the broader social environment.
Patrick J. Forde, Andrew Patterson
The study reported in this paper was conducted with the support of the Paedophile Investigation Team within the Western Australia Police Service. The study found that paedophiles were using World Wide Web pages to proclaim their lifestyles, to disseminate information and to facilitate communication. It also found evidence of international paedophile organisation where Internet anonymity techniques are used to conceal identities. The authors offer suggestions in how to counter this activity.
Gerry Veenstra, Andrew C. Patterson
In an article previously published in Canadian Ethnic Studies , Lebrun and LaVeist (2013) analyzed pooled data from four cycles of the Canadian Community Health Survey (CCHS) to find that native-born Black Canadians tend to report comparable or better health outcomes than native-born White Canadians. We suggest that several problematical modelling decisions led to a misrepresentation of Black-White health inequalities among native-born Canadians. Attending to these issues in an expanded dataset comprised of eight cycles of the CCHS, we find that, in comparison with native-born White Canadians, native-born Black Canadians are less likely to report being a current or former smoker but more likely to be overweight or obese and to report fair or poor self-rated health, hypertension and diabetes. We do not find statistically significant differences between native-born Black and White…
Sina Ghiassian, Andrew Patterson, Shivam Garg +3 more
It is still common to use Q-learning and temporal difference (TD) learning-even though they have divergence issues and sound Gradient TD alternatives exist-because divergence seems rare and they typically perform well. However, recent work with large neural network learning systems reveals that instability is more common than previously thought. Practitioners face a difficult dilemma: choose an easy to use and performant TD method, or a more complex algorithm that is more sound but harder to tune and all but unexplored with non-linear function approximation or control. In this paper, we introduce a new method called TD with Regularized Corrections (TDRC), that attempts to balance ease of use, soundness, and performance. It behaves as well as TD, when TD performs well, but is sound in cases where TD diverges. We empirically investigate TDRC across a range of problems, for both prediction…
Andrew Patterson, Samuel Neumann, Martha White +1 more
Empirical design in reinforcement learning is no small task. Running good experiments requires attention to detail and at times significant computational resources. While compute resources available per dollar have continued to grow rapidly, so have the scale of typical experiments in reinforcement learning. It is now common to benchmark agents with millions of parameters against dozens of tasks, each using the equivalent of 30 days of experience. The scale of these experiments often conflict with the need for proper statistical evidence, especially when comparing algorithms. Recent studies have highlighted how popular algorithms are sensitive to hyper-parameter settings and implementation details, and that common empirical practice leads to weak statistical evidence (Machado et al., 2018; Henderson et al., 2018). Here we take this one step further. This manuscript represents both a…
Dmitri Roussinov, Andrew Conkie, Andrew Patterson +1 more
Identifying which patients are at higher risks of dying or being re-admitted often happens to be resource- and life- saving, thus is a very important and challenging task for healthcare text analytics. While many successful approaches exist to predict such clinical events based on categorical and numerical variables, a large amount of health records exists in the format of raw text such as clinical notes or discharge summaries. However, the text-analytics models applied to free-form natural language found in those notes are lagging behind the break-throughs happening in the other domains and remain to be primarily based on older bag-of-words technologies. As a result, they rarely reach the accuracy level acceptable for the clinicians. In spite of their success in other domains, the superiority of deep neural approaches over classical bags of words for this task has not yet been…
Matthew D. Houghton, Michael J. Acheson, Andrew Patterson +2 more
View Video Presentation: https://doi.org/10.2514/6.2023-2544.vid This paper presents an integration of differential dynamic programming (DDP) with the optimal reciprocal collision avoidance (ORCA) algorithm as the basis for a new algorithm, titled combined Bernstein polynomial optimal reciprocal collision avoidance DDP (COBRA DDP), for trajectory replanning and collision avoidance for urban air mobility (UAM) vehicles. State constrained variants of DDP provide the ability to plan trajectories while avoiding obstacles, but these methods require a large increase in computational time per iteration which hinders the overall speed of the algorithm. ORCA utilizes simplified dynamics to recognize potential collisions along a trajectory and provides an optimal velocity for the avoidance of multiple vehicles and obstacles. These velocity commands, however, may not result in a dynamically…
Jianhua Zhang, Zhongzhao Teng, Qiu Guan +6 more
Segmentation of lumen (LB) and outer wall boundaries (OB) of carotid artery in magnetic resonance (MR) images is essential for carotid atherosclerotic disease diagnosis. However, the limited image signal‐to‐noise ratio, flow artefact, and varied lumen and outer wall become significant obstacles for automatic segmentation. A fully automatic framework is proposed for LB and OB segmentation in MR images. First, the lumen is identified by the support vector machine using a special strategy and LB is segmented by the geodesic star‐shape‐constrained graph cut. Then a novel global optimisation is developed to segment OB based on the graph cut, which consists of shape priors and appearance priors. The shape priors are learned from labelled shapes on LB and OB, while the appearance priors are modelled by Gaussian mixture models. A novel shape constraint is also designed as the constraint term.…
Matthew D. Houghton, Michael J. Acheson, Andrew Patterson +2 more
This paper presents a receding horizon model predictive control variation of the combined Bernstein polynomial optimal reciprocal collision avoidance (ORCA) differential dynamic programming (COBRA-DDP) algorithm for advanced air mobility (AAM) vehicles. Collision avoidance, in combination with effective trajectory replanning, are expected to be core components of AAM vehicles operating within a crowded airspace. This environment necessitates the use of real-time trajectory planning algorithms that are capable of planning around large numbers of stationary and moving obstacles. Previous work on COBRA-DDP demonstrated the capability of the algorithm to produce dynamically feasible trajectories for AAM vehicles and general collision avoidance. This paper improves upon the previous work by increasing the number of stationary and moving obstacles, while implementing a variation of COBRA-DDP…
Arun Lakshmanan, Andrew Patterson, Venanzio Cichella +1 more
In motion planning problems for autonomous robots, such as self-driving cars, the robot must ensure that its planned path is not in close proximity to obstacles in the environment. However, the problem of evaluating the proximity is generally non-convex and serves as a significant computational bottleneck for motion planning algorithms. In this paper, we present methods for a general class of absolutely continuous parametric curves to compute: (i) the minimum separating distance, (ii) tolerance verification, and (iii) collision detection. Our methods efficiently compute bounds on obstacle proximity by bounding the curve in a convex region. This bound is based on an upper bound on the curve arc length that can be expressed in closed form for a useful class of parametric curves including curves with trigonometric or polynomial bases. We demonstrate the computational efficiency and…
RS Ratner, Andrew Woolford, Andrew C. Patterson
In contemporary human rights politics, much international effort is invested in securing reparative settlements in the aftermath of genocide and mass atrocities. This article details a broad comparative research project in which we seek to map the respective paths of 47 post-genocide and mass atrocity reparations claims. Based on the findings of this study, using a mixed-methods approach, we highlight some potential obstacles within claims processes and demonstrate the importance of resource mobilization for reparative success. In particular, this article advances sociological understanding of the importance of momentum in resource mobilization as a means of carrying a reparations movement toward successful transitional justice outcomes.
Laura Caune, Luka Skoric, Nick S. Blunt +22 more
Quantum error correction (QEC) will be essential to achieve the accuracy needed for quantum computers to realise their full potential. The field has seen promising progress with demonstrations of early QEC and real-time decoded experiments. As quantum computers advance towards demonstrating a universal fault-tolerant logical gate set, implementing scalable and low-latency real-time decoding will be crucial to prevent the backlog problem, avoiding an exponential slowdown and maintaining a fast logical clock rate. Here, we demonstrate low-latency feedback with a scalable FPGA decoder integrated into the control system of a superconducting quantum processor. We perform an 8-qubit stability experiment with up to $25$ decoding rounds and a mean decoding time per round below $1$ $μs$, showing that we avoid the backlog problem even on superconducting hardware with the strictest speed…
Leanne Stevens, William J. Schultz, Andrew Patterson
Research paints discretion as a tool correctional officers (COs) use to navigate their work. Discretion helps COs gain compliance and resolve conflicts amicably, and officers sometimes use it to improve relationships with incarcerated people. However, research also suggest that COs' reliance on discretionary power may produce harmful complications, undermining institutional regulations and creating conditions for serious rule violations. Little quantitative analysis exists on how CO discretion impacts prison operations, making the broader impact of discretion unclear. To address this gap, we use open-access data collected between 2017 and 2018 ( Griffin & Hepburn, 2020 ). We then test whether a CO's attitude toward discretion may correspond with attempts from incarcerated people to encourage boundary violations. Results show that COs with more liberal attitudes toward discretion…
Andrew Arrasmith, Andrew Patterson, Alice Boughton +1 more
The approximate state estimation and the closely related classical shadows methods allow for the estimation of complicated observables with relatively few shots. As these methods make use of random measurements that can symmetrise the effect of readout errors, they have been shown to permit simplified approaches to readout error mitigation which require only a number of samples that scales as $\mathcal{O}(1)$ with increasing numbers of qubits. However, these techniques require executing a different circuit at each shot, adding a typically prohibitive amount of latency that prohibits their practical application. In this manuscript we consider the approximate state estimation of readout-mitigated expectation values, and how to best implement that procedure on the Rigetti quantum computing hardware. We discuss the theoretical aspects involved, providing an explicit computation of the…
Andrew Patterson, Arun Lakshmanan, Naira Hovakimyan
Collision prediction in a dynamic and unknown environment relies on knowledge of how the environment is changing. Many collision prediction methods rely on deterministic knowledge of how obstacles are moving in the environment. However, complete deterministic knowledge of the obstacles' motion is often unavailable. This work proposes a Gaussian process based prediction method that replaces the assumption of deterministic knowledge of each obstacle's future behavior with probabilistic knowledge, to allow a larger class of obstacles to be considered. The method solely relies on position and velocity measurements to predict collisions with dynamic obstacles. We show that the uncertainty region for obstacle positions can be expressed in terms of a combination of polynomials generated with Gaussian process regression. To control the growth of uncertainty over arbitrary time horizons, a…
Andrew Patterson, Adam White, Martha White
Many reinforcement learning algorithms rely on value estimation, however, the most widely used algorithms -- namely temporal difference algorithms -- can diverge under both off-policy sampling and nonlinear function approximation. Many algorithms have been developed for off-policy value estimation based on the linear mean squared projected Bellman error (MSPBE) and are sound under linear function approximation. Extending these methods to the nonlinear case has been largely unsuccessful. Recently, several methods have been introduced that approximate a different objective -- the mean-squared Bellman error (MSBE) -- which naturally facilitate nonlinear approximation. In this work, we build on these insights and introduce a new generalized MSPBE that extends the linear MSPBE to the nonlinear setting. We show how this generalized objective unifies previous work and obtain new bounds for the…