arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Forrest Sheldon

14 papers · 2016–2024

2016: 12017: 22018: 22019: 12020: 42021: 22022: 02023: 12024: 1
2016peak 4 in 20202024

Frequent co-authors

Papers

showing 1–14 of 14 RSS

Evidence of an exponential speed-up in the solution of hard optimization problems

Fabio L. Traversa, Pietro Cicotti, Forrest Sheldon +1 more

cs.AI · · cited 41× · arXiv ↗ · more like this ·

Optimization problems pervade essentially every scientific discipline and industry. Many such problems require finding a solution that maximizes the number of constraints satisfied. Often, these problems are particularly difficult to solve because they belong to the NP-hard class, namely algorithms that always find a solution in polynomial time are not known. Over the past decades, research has focused on developing heuristic approaches that attempt to find an approximation to the solution. However, despite numerous research efforts, in many cases even approximations to the optimal solution are hard to find, as the computational time for further refining a candidate solution grows exponentially with input size. Here, we show a non-combinatorial approach to hard optimization problems that achieves an exponential speed-up and finds better approximations than the current state-of-the-art.…

Taming a non-convex landscape with dynamical long-range order: memcomputing Ising benchmarks

Forrest Sheldon, Fabio L. Traversa, Massimiliano Di Ventra

cond-mat.dis-nn · · cited 26× · arXiv ↗ · more like this ·

Recent work on quantum annealing has emphasized the role of collective behavior in solving optimization problems. By enabling transitions of clusters of variables, such solvers are able to navigate their state space and locate solutions more efficiently despite having only local connections between elements. However, collective behavior is not exclusive to quantum annealers, and classical solvers that display collective dynamics should also possess an advantage in navigating a non-convex landscape. Here, we give evidence that a benchmark derived from quantum annealing studies is solvable in polynomial time using digital memcomputing machines, which utilize a collection of dynamical components with memory to represent the structure of the underlying optimization problem. To illustrate the role of memory and clarify the structure of these solvers we propose a simple model of these…

Stress-testing memcomputing on hard combinatorial optimization problems

Forrest Sheldon, Pietro Cicotti, Fabio L. Traversa +1 more

cs.ET · · cited 15× · arXiv ↗ · more like this ·

Memcomputing is a novel paradigm of computation that utilizes dynamical elements with memory to both store and process information on the same physical location. Its building blocks can be fabricated in hardware with standard electronic circuits, thus offering a path to its practical realization. In addition, since memcomputing is based on non-quantum elements, the equations of motion describing these machines can be simulated efficiently on standard computers. In fact, it was recently realized that memcomputing, and in particular its digital (hence scalable) version, when simulated on a classical machine provides a significant speed-up over state-of-the-art algorithms on a variety of non-convex problems. Here, we stress-test the capabilities of this approach on finding approximate solutions to hard combinatorial optimization problems. These fall into a class which is known to require…

Critical branching processes in digital memcomputing machines

Sean R. B. Bearden, Forrest C. Sheldon, Massimiliano Di Ventra

cond-mat.stat-mech · · cited 7× · arXiv ↗ · more like this ·

Memcomputing is a novel computing paradigm that employs time non-locality (memory) to solve combinatorial optimization problems. It can be realized in practice by means of non-linear dynamical systems whose point attractors represent the solutions of the original problem. It has been previously shown that during the solution search digital memcomputing machines go through a transient phase of avalanches (instantons) that promote dynamical long-range order. By employing mean-field arguments we predict that the distribution of the avalanche sizes follows a Borel distribution typical of critical branching processes with exponent $τ= 3/2$. We corroborate this analysis by solving various random 3-SAT instances of the Boolean satisfiability problem. The numerical results indicate a power-law distribution with exponent $τ= 1.51 \pm 0.02$, in very good agreement with the mean-field analysis.…

The Computational Capacity of Mem-LRC Reservoirs

Forrest Sheldon, Francesco Caravelli

Artificial Intelligence · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · · cited 3× · DOI ↗ · more like this ·

Reservoir computing has a emerged as a powerful tool in data-driven time series analysis. The possibility of utilizing hardware reservoirs as specialized co-processors has generated interest in the properties of electronic reservoirs, especially those based on memristors as the nonlinearity of these devices should translate to an improved nonlinear computational capacity of the reservoir. However, designing these reservoirs requires a detailed understanding of how memristive networks process information which has thus far been lacking. In this work, we derive an equation for general memristor-inductor-resistor-capacitor (MEM-LRC) reservoirs that includes all network and dynamical constraints explicitly. Utilizing this we undertake a study of the computational capacity of these reservoirs. We demonstrate that hardware reservoirs may be constructed with extensive memory capacity and that…

The Computational Capacity of LRC, Memristive and Hybrid Reservoirs

Forrest C. Sheldon, Artemy Kolchinsky, Francesco Caravelli

cs.NE · · cited 1× · arXiv ↗ · more like this ·

Reservoir computing is a machine learning paradigm that uses a high-dimensional dynamical system, or \emph{reservoir}, to approximate and predict time series data. The scale, speed and power usage of reservoir computers could be enhanced by constructing reservoirs out of electronic circuits, and several experimental studies have demonstrated promise in this direction. However, designing quality reservoirs requires a precise understanding of how such circuits process and store information. We analyze the feasibility and optimal design of electronic reservoirs that include both linear elements (resistors, inductors, and capacitors) and nonlinear memory elements called memristors. We provide analytic results regarding the feasibility of these reservoirs, and give a systematic characterization of their computational properties by examining the types of input-output relationships that they…

Network analysis of memristive device circuits: dynamics, stability and correlations

Frank Barrows, Forrest C. Sheldon, Francesco Caravelli

cond-mat.dis-nn · · arXiv ↗ · more like this ·

Networks with memristive devices are a potential basis for the next generation of computing devices. They are also an important model system for basic science, from modeling nanoscale conductivity to providing insight into the information-processing of neurons. The resistance in a memristive device depends on the history of the applied bias and thus displays a type of memory. The interplay of this memory with the dynamic properties of the network can give rise to new behavior, offering many fascinating theoretical challenges. But methods to analyze general memristive circuits are not well described in the literature. In this paper we develop a general circuit analysis for networks that combine memristive devices alongside resistors, capacitors and inductors and under various types of control. We derive equations of motion for the memory parameters of these circuits and describe the…

Characterizing contaminant noise in barcoded perturbation experiments

Forrest Sheldon

q-bio.QM · · arXiv ↗ · more like this ·

Bursting cells lead to ambient RNA that contaminates sequencing data. This process is especially problematic in perturbation experiments where transcription factors are implanted into cells to determine their effects. The presence of contaminants makes it difficult to determine whether a factor is truly expressed in the cell. This paper studies the properties of contaminant noise from an analytical perspective, showing that the cell bursting process constrains the form of the noise distribution across factors. These constraints can be leveraged to improve decontamination by removing counts that are more likely the result of noise than expression. In two biological replicates of a perturbation experiment, run across two sequencing protocols, decontaminated counts agree with bulk genomic measurements of the transduction rate and are automatically corrected for differences in sequencing.

The Backpropagation Algorithm Implemented on Spiking Neuromorphic Hardware

Alpha Renner, Forrest Sheldon, Anatoly Zlotnik +2 more

cs.NE · · arXiv ↗ · more like this ·

The capabilities of natural neural systems have inspired new generations of machine learning algorithms as well as neuromorphic very large-scale integrated (VLSI) circuits capable of fast, low-power information processing. However, it has been argued that most modern machine learning algorithms are not neurophysiologically plausible. In particular, the workhorse of modern deep learning, the backpropagation algorithm, has proven difficult to translate to neuromorphic hardware. In this study, we present a neuromorphic, spiking backpropagation algorithm based on synfire-gated dynamical information coordination and processing, implemented on Intel's Loihi neuromorphic research processor. We demonstrate a proof-of-principle three-layer circuit that learns to classify digits from the MNIST dataset. To our knowledge, this is the first work to show a Spiking Neural Network (SNN) implementation…

Global minimization via classical tunneling assisted by collective force field formation

Francesco Caravelli, Forrest C. Sheldon, Fabio L. Traversa

cond-mat.mes-hall · · arXiv ↗ · more like this ·

Simple dynamical models can produce intricate behaviors in large networks. These behaviors can often be observed in a wide variety of physical systems captured by the network of interactions. Here we describe a phenomenon where the increase of dimensions self-consistently generates a force field due to dynamical instabilities. This can be understood as an unstable ("rumbling") tunneling mechanism between minima in an effective potential. We dub this collective and nonperturbative effect a "Lyapunov force" which steers the system towards the global minimum of the potential function, even if the full system has a constellation of equilibrium points growing exponentially with the system size. The system we study has a simple mapping to a flow network, equivalent to current-driven memristors. The mechanism is appealing for its physical relevance in nanoscale physics, and to possible…

Phases of memristive circuits via an interacting disorder approach

Francesco Caravelli, Forrest C. Sheldon

cond-mat.stat-mech · · arXiv ↗ · more like this ·

We study the phase diagram of memristive circuit models in the replica-symmetric case using a novel Lyapunov function for the dynamics of these devices. Effectively, the model we propose is an Ising model with interacting quenched disorder, which we study at the first order in a control parameter. Notwithstanding these limitations, we find a complex phase diagram and a glass-ferromagnetic transition in the parameter space which generalizes earlier mean-field theory results for a simpler model. Our results suggest a non-trivial landscape of asymptotic states for memristive circuits.

Fully analog memristive circuits for optimization tasks: a comparison

Forrest C. Sheldon, Francesco Caravelli, Carleton Coffrin

nlin.AO · · arXiv ↗ · more like this ·

We introduce a Lyapunov function for the dynamics of memristive circuits, and compare the effectiveness of memristors in minimizing the function to widely used optimization software. We study in particular three classes of problems which can be directly embedded in a circuit topology, and show that memristors effectively attempt at (quickly) extremizing these functionals.

Phase-dependent noise in Josephson junctions

Forrest Sheldon, Sebastiano Peotta, Massimiliano Di Ventra

cond-mat.mes-hall · · arXiv ↗ · more like this ·

In addition to the usual superconducting current, Josephson junctions (JJs) support a phase-dependent conductance related to the retardation effect of tunneling quasi-particles. This introduces a dissipative current with a memory-resistive (memristive) character and thus should also affect the current noise. By means of the microscopic theory of tunnel junctions we compute the complete current autocorrelation function of a Josephson tunnel junction and show that this memristive component gives rise to a non-stationary, phase-dependent noise. As a consequence, dynamic and thermal noise necessarily show a phase dependence otherwise absent in nondissipative JJ models. This phase dependence may be realized experimentally as a hysteresis effect if the unavoidable time averaging of the experimental probe is shorter than the period of the Josephson phase.

Phase Transitions and Duality in Adiabatic Memristive Networks

Forrest C. Sheldon, Massimiliano Di Ventra

cond-mat.stat-mech · · arXiv ↗ · more like this ·

The development of neuromorphic systems based on memristive elements - resistors with memory - requires a fundamental understanding of their collective dynamics when organized in networks. Here, we study an experimentally inspired model of two-dimensional disordered memristive networks subject to a slowly ramped voltage and show that they undergo a first-order phase transition in the conductivity for sufficiently high values of memory, as quantified by the memristive ON/OFF ratio. We investigate the consequences of this transition for the memristive current-voltage characteristics both through simulation and theory, and uncover a duality between forward and reverse switching processes that has also been observed in several experimental systems of this sort. Our work sheds considerable light on the statistical properties of memristive networks that are presently studied both for…