arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Harrison Edwards

13 papers · 1968–2021

1968: 11969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 01978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 01997: 01998: 01999: 02000: 02001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 02015: 12016: 22017: 12018: 62019: 02020: 02021: 2
1968peak 6 in 20182021

Frequent co-authors

Papers

showing 1–13 of 13 RSS

Exploration by Random Network Distillation

Yuri Burda, Harrison Edwards, Amos Storkey +1 more

cs.LG · · cited 1,771× · arXiv ↗ · more like this ·

We introduce an exploration bonus for deep reinforcement learning methods that is easy to implement and adds minimal overhead to the computation performed. The bonus is the error of a neural network predicting features of the observations given by a fixed randomly initialized neural network. We also introduce a method to flexibly combine intrinsic and extrinsic rewards. We find that the random network distillation (RND) bonus combined with this increased flexibility enables significant progress on several hard exploration Atari games. In particular we establish state of the art performance on Montezuma's Revenge, a game famously difficult for deep reinforcement learning methods. To the best of our knowledge, this is the first method that achieves better than average human performance on this game without using demonstrations or having access to the underlying state of the game, and…

Data Augmentation Generative Adversarial Networks

Antreas Antoniou, Amos Storkey, Harrison Edwards

stat.ML · · cited 1,188× · arXiv ↗ · more like this ·

Effective training of neural networks requires much data. In the low-data regime, parameters are underdetermined, and learnt networks generalise poorly. Data Augmentation alleviates this by using existing data more effectively. However standard data augmentation produces only limited plausible alternative data. Given there is potential to generate a much broader set of augmentations, we design and train a generative model to do data augmentation. The model, based on image conditional Generative Adversarial Networks, takes data from a source domain and learns to take any data item and generalise it to generate other within-class data items. As this generative process does not depend on the classes themselves, it can be applied to novel unseen classes of data. We show that a Data Augmentation Generative Adversarial Network (DAGAN) augments standard vanilla classifiers well. We also show a…

How to train your MAML

Antreas Antoniou, Harrison Edwards, Amos Storkey

cs.LG · · cited 900× · arXiv ↗ · more like this ·

The field of few-shot learning has recently seen substantial advancements. Most of these advancements came from casting few-shot learning as a meta-learning problem. Model Agnostic Meta Learning or MAML is currently one of the best approaches for few-shot learning via meta-learning. MAML is simple, elegant and very powerful, however, it has a variety of issues, such as being very sensitive to neural network architectures, often leading to instability during training, requiring arduous hyperparameter searches to stabilize training and achieve high generalization and being very computationally expensive at both training and inference times. In this paper, we propose various modifications to MAML that not only stabilize the system, but also substantially improve the generalization performance, convergence speed and computational overhead of MAML, which we call MAML++.

Censoring Representations with an Adversary

Harrison Edwards, Amos Storkey

cs.LG · · cited 562× · arXiv ↗ · more like this ·

In practice, there are often explicit constraints on what representations or decisions are acceptable in an application of machine learning. For example it may be a legal requirement that a decision must not favour a particular group. Alternatively it can be that that representation of data must not have identifying information. We address these two related issues by learning flexible representations that minimize the capability of an adversarial critic. This adversary is trying to predict the relevant sensitive variable from the representation, and so minimizing the performance of the adversary ensures there is little or no information in the representation about the sensitive variable. We demonstrate this adversarial approach on two problems: making decisions free from discrimination and removing private information from images. We formulate the adversarial model as a minimax problem…

Towards a Neural Statistician

Harrison Edwards, Amos Storkey

stat.ML · · cited 445× · arXiv ↗ · more like this ·

An efficient learner is one who reuses what they already know to tackle a new problem. For a machine learner, this means understanding the similarities amongst datasets. In order to do this, one must take seriously the idea of working with datasets, rather than datapoints, as the key objects to model. Towards this goal, we demonstrate an extension of a variational autoencoder that can learn a method for computing representations, or statistics, of datasets in an unsupervised fashion. The network is trained to produce statistics that encapsulate a generative model for each dataset. Hence the network enables efficient learning from new datasets for both unsupervised and supervised tasks. We show that we are able to learn statistics that can be used for: clustering datasets, transferring generative models to new datasets, selecting representative samples of datasets and classifying…

Variational Option Discovery Algorithms

Joshua Achiam, Harrison Edwards, Dario Amodei +1 more

cs.AI · · cited 210× · arXiv ↗ · more like this ·

We explore methods for option discovery based on variational inference and make two algorithmic contributions. First: we highlight a tight connection between variational option discovery methods and variational autoencoders, and introduce Variational Autoencoding Learning of Options by Reinforcement (VALOR), a new method derived from the connection. In VALOR, the policy encodes contexts from a noise distribution into trajectories, and the decoder recovers the contexts from the complete trajectories. Second: we propose a curriculum learning approach where the number of contexts seen by the agent increases whenever the agent's performance is strong enough (as measured by the decoder) on the current set of contexts. We show that this simple trick stabilizes training for VALOR and prior variational option discovery methods, allowing a single agent to learn many more modes of behavior than…

Learning Policy Representations in Multiagent Systems

Aditya Grover, Maruan Al-Shedivat, Jayesh K. Gupta +2 more

cs.MA · · cited 139× · arXiv ↗ · more like this ·

Modeling agent behavior is central to understanding the emergence of complex phenomena in multiagent systems. Prior work in agent modeling has largely been task-specific and driven by hand-engineering domain-specific prior knowledge. We propose a general learning framework for modeling agent behavior in any multiagent system using only a handful of interaction data. Our framework casts agent modeling as a representation learning problem. Consequently, we construct a novel objective inspired by imitation learning and agent identification and design an algorithm for unsupervised learning of representations of agent policies. We demonstrate empirically the utility of the proposed framework in (i) a challenging high-dimensional competitive environment for continuous control and (ii) a cooperative environment for communication, on supervised predictive tasks, unsupervised clustering, and…

Unsupervised Neural Machine Translation with Generative Language Models Only

Jesse Michael Han, Igor Babuschkin, Harrison Edwards +8 more

cs.CL · · cited 43× · arXiv ↗ · more like this ·

We show how to derive state-of-the-art unsupervised neural machine translation systems from generatively pre-trained language models. Our method consists of three steps: few-shot amplification, distillation, and backtranslation. We first use the zero-shot translation ability of large pre-trained language models to generate translations for a small set of unlabeled sentences. We then amplify these zero-shot translations by using them as few-shot demonstrations for sampling a larger synthetic dataset. This dataset is distilled by discarding the few-shot demonstrations and then fine-tuning. During backtranslation, we repeatedly generate translations for a set of inputs and then fine-tune a single language model on both directions of the translation task at once, ensuring cycle-consistency by swapping the roles of gold monotext and generated translations when fine-tuning. By using our…

Evaluating Generalization in Multiagent Systems using Agent-Interaction Graphs

Aditya Grover, Maruan Al-Shedivat, Jayesh K. Gupta +2 more

Artificial Intelligence · Adaptive Agents and Multi-Agents Systems · · cited 9× · DOI ↗ · more like this ·

Learning from interactions between agents is a key component for inference in multiagent systems. Depending on the downstream task, there could be multiple criteria for evaluating the generalization performance of learning. In this work, we propose a novel framework for evaluating generalization in multiagent systems based on agent-interaction graphs. An agent-interaction graph models agents as nodes and interactions as hyper-edges between participating agents. Using this abstract data structure, we define three notions of generalization for principled evaluation of learning in multiagent systems.

The Context-Aware Learner

Conor Durkan, Amos Storkey, Harrison Edwards

Artificial Intelligence · · cited 1× · OpenAlex ↗ · more like this ·

One important aspect of generalization in machine learning involves reasoning about previously seen data in new settings. Such reasoning requires learning disentangled representations of data which are interpretable in isolation, but can also be combined in a new, unseen scenario. To this end, we introduce the context-aware learner, a model based on the variational autoencoding framework, which can learn such representations across data sets exhibiting a number of distinct contexts. Moreover, it is successfully able to combine these representations to generate data not seen at training time. The model enjoys an exponential increase in representational ability for a linear increase in context count. We demonstrate that the theory readily extends to a meta-learning setting such as this, and describe a fully unsupervised model in complete generality. Finally, we validate our approach using…

SOME FACTORS AFFECTING MERGING TRAFFIC ON THE OUTER RAMPS OF HIGHWAY INTERCHANGES

Harrison Edwards, J L Vardon

Transportation · · cited 1× · OpenAlex ↗ · more like this ·

The primary purpose of this research project was to examine vehicle operating characteristics at the outer merging ramp of grade-separated interchanges and to examine factors relating to merging capacity. Data from two interchanges on Highway 401 in the Toronto area have been examined and analyzed and various relationships have been developed. Considerable variability in gap acceptance by the merging driver has been shown to occur. However, it has been possible to establish limiting curves which indicate acceptable and non-acceptable gaps as a function of speed difference between the merging and through vehicle. The principle of critical lags as proposed by Raff has been examined and it appeared that when the merging vehicle travels at a speed equal to or less than the through vehicle the major merging conflict was with the trailing through vehicle. Analysis of the critical lag related…

RESEARCH ARTICLE The Rotary Zone Thermal Cycler: A Low- Power System Enabling Automated Rapid PCR

Michael S. Bartsch, Harrison S. Edwards☯¤a, Caroline E. Moseley☯¤c +7 more

Sociology and Political Science · · cited 0× · OpenAlex ↗ · more like this ·

Advances in molecular biology, microfluidics, and laboratory automation continue to expand the accessibility and applicability of these methods beyond the confines of conventional, centralized laboratory facilities and into point of use roles in clinical, military, forensic, and field-deployed applications. As a result, there is a growing need to adapt the unit operations of molecular biology (e.g., aliquoting, centrifuging, mixing, and thermal cycling) to compact, portable, low-power, and automation-ready formats. Here we present one such adaptation, the rotary zone thermal cycler (RZTC), a novel wheel-based device capable of cycling up to four different fixed-temperature blocks into contact with a stationary 4-microliter capillary-bound sample to realize 1-3 second transitions with steady state heater power of less than 10W. We demonstrate the utility of the RZTC for DNA amplification…

Autonomous object harvesting using synchronized optoelectronic microrobots

Christopher Bendkowski, Laurent Mennillo, Tao Xu +9 more

cs.RO · · arXiv ↗ · more like this ·

Optoelectronic tweezer-driven microrobots (OETdMs) are a versatile micromanipulation technology based on the use of light induced dielectrophoresis to move small dielectric structures (microrobots) across a photoconductive substrate. The microrobots in turn can be used to exert forces on secondary objects and carry out a wide range of micromanipulation operations, including collecting, transporting and depositing microscopic cargos. In contrast to alternative (direct) micromanipulation techniques, OETdMs are relatively gentle, making them particularly well suited to interacting with sensitive objects such as biological cells. However, at present such systems are used exclusively under manual control by a human operator. This limits the capacity for simultaneous control of multiple microrobots, reducing both experimental throughput and the possibility of cooperative multi-robot…