arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Zeming Lin

16 papers · 2008–2019

2008: 12009: 02010: 02011: 02012: 12013: 02014: 02015: 12016: 42017: 52018: 22019: 2
2008peak 5 in 20172019

Frequent co-authors

Papers

showing 1–16 of 16 RSS

PyTorch: An Imperative Style, High-Performance Deep Learning Library

Adam Paszke, Sam Gross, Francisco Massa +18 more

cs.LG · · cited 55,920× · arXiv ↗ · more like this ·

Deep learning frameworks have often focused on either usability or speed, but not both. PyTorch is a machine learning library that shows that these two goals are in fact compatible: it provides an imperative and Pythonic programming style that supports code as a model, makes debugging easy and is consistent with other popular scientific computing libraries, while remaining efficient and supporting hardware accelerators such as GPUs. In this paper, we detail the principles that drove the implementation of PyTorch and how they are reflected in its architecture. We emphasize that every aspect of PyTorch is a regular Python program under the full control of its user. We also explain how the careful and pragmatic implementation of the key components of its runtime enables them to work together to achieve compelling performance. We demonstrate the efficiency of individual subsystems, as well…

Intrinsic Motivation and Automatic Curricula via Asymmetric Self-Play

Sainbayar Sukhbaatar, Zeming Lin, Ilya Kostrikov +3 more

cs.LG · · cited 382× · arXiv ↗ · more like this ·

We describe a simple scheme that allows an agent to learn about its environment in an unsupervised manner. Our scheme pits two versions of the same agent, Alice and Bob, against one another. Alice proposes a task for Bob to complete; and then Bob attempts to complete the task. In this work we will focus on two kinds of environments: (nearly) reversible environments and environments that can be reset. Alice will "propose" the task by doing a sequence of actions and then Bob must undo or repeat them, respectively. Via an appropriate reward structure, Alice and Bob automatically generate a curriculum of exploration, enabling unsupervised training of the agent. When Bob is deployed on an RL task within the environment, this unsupervised training reduces the number of supervised episodes needed to learn, and in some cases converges to a higher reward.

Episodic Exploration for Deep Deterministic Policies: An Application to StarCraft Micromanagement Tasks

Nicolas Usunier, Gabriel Synnaeve, Zeming Lin +1 more

cs.AI · · cited 143× · arXiv ↗ · more like this ·

We consider scenarios from the real-time strategy game StarCraft as new benchmarks for reinforcement learning algorithms. We propose micromanagement tasks, which present the problem of the short-term, low-level control of army members during a battle. From a reinforcement learning point of view, these scenarios are challenging because the state-action space is very large, and because there is no obvious feature representation for the state-action evaluation function. We describe our approach to tackle the micromanagement scenarios with deep neural network controllers from raw state features given by the game engine. In addition, we present a heuristic reinforcement learning algorithm which combines direct exploration in the policy space and backpropagation. This algorithm allows for the collection of traces for learning using deterministic policies, which appears much more efficient…

TorchCraft: a Library for Machine Learning Research on Real-Time Strategy Games

Gabriel Synnaeve, Nantas Nardelli, Alex Auvolat +5 more

cs.LG · · cited 112× · arXiv ↗ · more like this ·

We present TorchCraft, a library that enables deep learning research on Real-Time Strategy (RTS) games such as StarCraft: Brood War, by making it easier to control these games from a machine learning framework, here Torch. This white paper argues for using RTS games as a benchmark for AI research, and describes the design and components of TorchCraft.

DeepCloak: Masking Deep Neural Network Models for Robustness Against Adversarial Samples

Ji Gao, Beilun Wang, Zeming Lin +2 more

cs.LG · · cited 95× · arXiv ↗ · more like this ·

Recent studies have shown that deep neural networks (DNN) are vulnerable to adversarial samples: maliciously-perturbed samples crafted to yield incorrect model outputs. Such attacks can severely undermine DNN systems, particularly in security-sensitive settings. It was observed that an adversary could easily generate adversarial samples by making a small perturbation on irrelevant feature dimensions that are unnecessary for the current classification task. To overcome this problem, we introduce a defensive mechanism called DeepCloak. By identifying and removing unnecessary features in a DNN model, DeepCloak limits the capacity an attacker can use generating adversarial samples and therefore increase the robustness against such inputs. Comparing with other defensive approaches, DeepCloak is easy to implement and computationally efficient. Experimental results show that DeepCloak can…

STARDATA: A StarCraft AI Research Dataset

Zeming Lin, Jonas Gehring, Vasil Khalidov +1 more

cs.AI · · cited 43× · arXiv ↗ · more like this ·

We release a dataset of 65646 StarCraft replays that contains 1535 million frames and 496 million player actions. We provide full game state data along with the original replays that can be viewed in StarCraft. The game state data was recorded every 3 frames which ensures suitability for a wide variety of machine learning tasks such as strategy classification, inverse reinforcement learning, imitation learning, forward modeling, partial information extraction, and others. We use TorchCraft to extract and store the data, which standardizes the data format for both reading from replays and reading directly from the game. Furthermore, the data can be used on different operating systems and platforms. The dataset contains valid, non-corrupted replays only and its quality and diversity was ensured by a number of heuristics. We illustrate the diversity of the data with various statistics and…

Value Propagation Networks

Nantas Nardelli, Gabriel Synnaeve, Zeming Lin +3 more

cs.AI · · cited 28× · arXiv ↗ · more like this ·

We present Value Propagation (VProp), a set of parameter-efficient differentiable planning modules built on Value Iteration which can successfully be trained using reinforcement learning to solve unseen tasks, has the capability to generalize to larger map sizes, and can learn to navigate in dynamic environments. We show that the modules enable learning to plan when the environment also includes stochastic elements, providing a cost-efficient learning system to build low-level size-invariant planners for a variety of interactive navigation problems. We evaluate on static and dynamic configurations of MazeBase grid-worlds, with randomly generated environments of several different sizes, and on a StarCraft navigation scenario, with more complex dynamics, and pixels as input.

Forward Modeling for Partial Observation Strategy Games - A StarCraft Defogger

Gabriel Synnaeve, Zeming Lin, Jonas Gehring +5 more

cs.LG · · cited 27× · arXiv ↗ · more like this ·

We formulate the problem of defogging as state estimation and future state prediction from previous, partial observations in the context of real-time strategy games. We propose to employ encoder-decoder neural networks for this task, and introduce proxy tasks and baselines for evaluation to assess their ability of capturing basic game rules and high-level dynamics. By combining convolutional neural networks and recurrent networks, we exploit spatial and sequential correlations and train well-performing models on a large dataset of human games of StarCraft: Brood War. Finally, we demonstrate the relevance of our models to downstream tasks by applying them for enemy unit prediction in a state-of-the-art, rule-based StarCraft bot. We observe improvements in win rates against several strong community bots.

An Analysis of Model-Based Heuristic Search Techniques for StarCraft Combat Scenarios

David G. Churchill, Zeming Lin, Gabriel Synnaeve

Artificial Intelligence · Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · · cited 10× · DOI ↗ · more like this ·

Real-Time Strategy games have become a popular test-bed for modern AI system due to their real-time computational constraints, complex multi-unit control problems, and imperfect information. One of the most important aspects of any RTS AI system is the efficient control of units in complex combat scenarios, also known as micromanagement. Recently, a model-based heuristic search technique called Portfolio Greedy Search (PGS) has shown promisingpaper we present the first integration of PGS into the StarCraft game engine, and compare its performance to the current state-of-the-art deep reinforcement learning method in several benchmark combat scenarios. We then perform theperformance for providing real-time decision making in RTS combat scenarios, but has so far only been tested in SparCraft: an RTS combat simulator. In this same experiments within the SparCraft simulator in order to…

Episodic Exploration for Deep Deterministic Policies for StarCraft Micromanagement

Nicolas Usunier, Gabriel Synnaeve, Zeming Lin +1 more

Artificial Intelligence · International Conference on Learning Representations · · cited 7× · OpenAlex ↗ · more like this ·

We consider scenarios from the real-time strategy game StarCraft as benchmarks for reinforcement learning algorithms. We focus on micromanagement, that is, the short-term, low-level control of team members during a battle. We propose several scenarios that are challenging for reinforcement learning algorithms because the state- action space is very large, and there is no obvious feature representation for the value functions. We describe our approach to tackle the micromanagement scenarios with deep neural network controllers from raw state features given by the game engine. We also present a heuristic reinforcement learning algorithm which combines direct exploration in the policy space and backpropagation. This algorithm collects traces for learning using deterministic policies, which appears much more efficient than, e.g., e-greedy exploration. Experiments show that this algorithm…

Growing Action Spaces

Gregory Farquhar, Laura Gustafson, Zeming Lin +3 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to accelerate learning. We assume the environment is out of our control, but that the agent may set an internal curriculum by initially restricting its action space. Our approach uses off-policy reinforcement learning to estimate optimal value functions for multiple action spaces simultaneously and efficiently transfers data, value estimates, and state representations from restricted action spaces to the full task. We show the efficacy of our approach in proof-of-concept control tasks and on challenging large-scale StarCraft micromanagement tasks with large, multi-agent action spaces.

A High Visual Quality Embedding Method in Edges Based on Pixel Pair Difference

Yuanbo Ma, Quansi Wen, Wien Hong +2 more

Computer Vision and Pattern Recognition · DOAJ (DOAJ: Directory of Open Access Journals) · · cited 0× · DOI ↗ · more like this ·

In this paper, we proposed a new data hiding method based on diamond encoding (DE) and pixel pair difference (PPD). DE proposes a pixel-wise algorithm which flexibly embeds different base digits to maximize payload and image visual quality. During DE embedding, digits embed in sequence without separ

A reflection upon the joint acquisition of digital resources among the libraries of colleges and universities in Anhui Province

Zeming Lin

Information Systems · Journal of Academic Library and Information Science · · cited 0× · OpenAlex ↗ · more like this ·

The joint construction and share of document resource is regarded as the key in the construction and development of libraries.The author of this article makes an analysis of the major tasks,operation mechanism of the joint construction and share of the electronic resources among the libraries of colleges and universities in Anhui Province,presents the train of thinking and some concrete operating modes of the joint acquisition of electronic resources,and makes some comments on the work of joint acquisition of digital resources in Anhui Province.

Analysis of the characteristics,discount and quality-control in book purchase of libraries

Zeming Lin

Information Systems · Journal of Academic Library and Information Science · · cited 0× · OpenAlex ↗ · more like this ·

Book purchase is a basic work in a library.Combining with the working practice and some existing problems in book purchase,this article makes a penetrating analysis of the characteristics of book purchase and of the relationship between the discount and the quality control in book purchase,and presents some ideas of reasonable discount rate and purchase tactics.

MUST-CNN: A Multilayer Shift-and-Stitch Deep Convolutional Architecture for Sequence-based Protein Structure Prediction

Zeming Lin, Jack Lanchantin, Yanjun Qi

cs.LG · · arXiv ↗ · more like this ·

Predicting protein properties such as solvent accessibility and secondary structure from its primary amino acid sequence is an important task in bioinformatics. Recently, a few deep learning models have surpassed the traditional window based multilayer perceptron. Taking inspiration from the image classification domain we propose a deep convolutional neural network architecture, MUST-CNN, to predict protein properties. This architecture uses a novel multilayer shift-and-stitch (MUST) technique to generate fully dense per-position predictions on protein sequences. Our model is significantly simpler than the state-of-the-art, yet achieves better results. By combining MUST and the efficient convolution operation, we can consider far more parameters while retaining very fast prediction speeds. We beat the state-of-the-art performance on two large protein property prediction datasets.

Deep Motif: Visualizing Genomic Sequence Classifications

Jack Lanchantin, Ritambhara Singh, Zeming Lin +1 more

cs.LG · · arXiv ↗ · more like this ·

This paper applies a deep convolutional/highway MLP framework to classify genomic sequences on the transcription factor binding site task. To make the model understandable, we propose an optimization driven strategy to extract "motifs", or symbolic patterns which visualize the positive class learned by the network. We show that our system, Deep Motif (DeMo), extracts motifs that are similar to, and in some cases outperform the current well known motifs. In addition, we find that a deeper model consisting of multiple convolutional and highway layers can outperform a single convolutional and fully connected layer in the previous state-of-the-art.