Author

Aaron Ray

14 papers · 1979–2025

1979peak 4 in 20222025

Frequent co-authors

Papers

showing 1–14 of 14 RSS

Closed-form continuous-time neural networks

Ramin Hasani, Mathias Lechner, Alexander Amini +5 more

Artificial Intelligence · Nature Machine Intelligence · 15 Nov 2022 · cited 164× · DOI ↗ · more like this ·

Abstract Continuous-time neural networks are a class of machine learning systems that can tackle representation learning on spatiotemporal decision-making tasks. These models are typically represented by continuous differential equations. However, their expressive power when they are deployed on computers is bottlenecked by numerical differential equation solvers. This limitation has notably slowed down the scaling and understanding of numerous natural physical phenomena such as the dynamics of nervous systems. Ideally, we would circumvent this bottleneck by solving the given dynamical system in closed form. This is known to be intractable in general. Here, we show that it is possible to closely approximate the interaction between neurons and synapses—the building blocks of natural and artificial neural networks—constructed by liquid time-constant networks efficiently in closed form. To…

Robust flight navigation out of distribution with liquid neural networks

Makram Chahine, Ramin Hasani, Patrick Kao +5 more

Artificial Intelligence · Science Robotics · 19 Apr 2023 · cited 82× · DOI ↗ · more like this ·

Autonomous robots can learn to perform visual navigation tasks from offline human demonstrations and generalize well to online and unseen scenarios within the same environment they have been trained on. It is challenging for these agents to take a step further and robustly generalize to new environments with drastic scenery changes that they have never encountered. Here, we present a method to create robust flight navigation agents that successfully perform vision-based fly-to-target tasks beyond their training environment under drastic distribution shifts. To this end, we designed an imitation learning framework using liquid neural networks, a brain-inspired class of continuous-time neural models that are causal and adapt to changing conditions. We observed that liquid agents learn to distill the task they are given from visual inputs and drop irrelevant features. Thus, their learned…

Multi-robot Task Assignment for Aerial Tracking with Viewpoint Constraints

Aaron Ray, Alyssa Pierson, Hai Zhu +2 more

cs.RO · 31 May 2022 · cited 6× · arXiv ↗ · more like this ·

We address the problem of assigning a team of drones to autonomously capture a set desired shots of a dynamic target in the presence of obstacles. We present a two-stage planning pipeline that generates offline an assignment of drone to shots and locally optimizes online the viewpoint. Given desired shot parameters, the high-level planner uses a visibility heuristic to predict good times for capturing each shot and uses an Integer Linear Program to compute drone assignments. An online Model Predictive Control algorithm uses the assignments as reference to capture the shots. The algorithm is validated in hardware with a pair of drones and a remote controlled car.

The politics of climate change adaptation / by Aaron D. Ray.

Aaron Ray

Political Science and International Relations · Figshare · 8 Oct 2021 · cited 6× · DOI ↗ · more like this ·

<p>According to Stefan Wray, a local activist from Austin, Texas: “Climate adaptation strategies largely leave partisan politics to one side of the discussion… people recognize that something is changing.” I test this assertion about the role of partisanship in climate change adaptation policy adoption and public opinion. I use data from the 2014 Cooperative Congressional Election Study to assess public support for climate adaptation policies and test the effect of framing environmental policies as responses to climate change. I find that a majority of survey respondents support climate change adaptation policies. I also find that support for environmental policies is reduced by the framing of these policies as responses to climate change and that these framing effects are conditional on party identification. Using panel data, I test the comparative influence of political factors…

Publisher Correction: Closed-form continuous-time neural networks

Ramin Hasani, Mathias Lechner, Alexander Amini +5 more

Artificial Intelligence · Nature Machine Intelligence · 29 Nov 2022 · cited 3× · DOI ↗ · more like this ·

In the version of this article initially published, Lemma 1 appeared at the end of the article rather than within the “Analytical LTC approximation for general inputs” subsection. In that subsection, the text now reading, in part, “Inspired by equations (7) and (8),” mention of equation (8) was missing in the original version. Also, equation (9) in Lemma 1 was incorrectly labeled as “(10)” and has been renumbered. Further, the Acknowledgements section was an incorrect version. All changes have been made to HTML and PDF versions of the article.

Language-Grounded Hierarchical Planning and Execution with Multi-Robot 3D Scene Graphs

Jared Strader, Aaron Ray, Jacob Arkin +11 more

cs.RO · June 2025 · cited 0× · arXiv ↗ · more like this ·

In this paper, we introduce a multi-robot system that integrates mapping, localization, and task and motion planning (TAMP) enabled by 3D scene graphs to execute complex instructions expressed in natural language. Our system builds a shared 3D scene graph incorporating an open-set object-based map, which is leveraged for multi-robot 3D scene graph fusion. This representation supports real-time, view-invariant relocalization (via the object-based map) and planning (via the 3D scene graph), allowing a team of robots to reason about their surroundings and execute complex tasks. Additionally, we introduce a planning approach that translates operator intent into Planning Domain Definition Language (PDDL) goals using a Large Language Model (LLM) by leveraging context from the shared 3D scene graph and robot capabilities. We provide an experimental assessment of the performance of our system…

Three Agency Politicization and the Implementation of Executive Order

Aaron Ray

Political Science and International Relations · 30 Oct 2015 · cited 0× · OpenAlex ↗ · more like this ·

Federal agencies are responsible for implementing policies created by the United States Congress and the president. However, a tension exists between an agency’s independence and its responsiveness to the preferences of elected officials. Berry and Gersen (2010) argue that the more political appointees there are in control of an agency, the more influence political principals have over that agency. The implementation of a presidential requirement that agencies engage in climate change adaptation planning allows for a test of this hypothesis. This paper uses the variation in implementation of this requirement across agencies to test factors which may explain that variation. Results of this analysis indicate that the degree of agency politicization is a significant predictor of responsiveness to the president’s preferences.

Security kernel design for a microprocessor-based, multilevel, archival storage system

Aaron Ray Coleman

Computer Networks and Communications · Calhoun: The Naval Postgraduate School Institutional Archive (Naval Postgraduate School) · December 1979 · cited 0× · OpenAlex ↗ · more like this ·

This thesis is a detailed design of a security kernel for an archival file storage system. Microprocessor technology is used to address a major part of the problem of information security in a distributed computer system. Utilizing multiprogramming techniques for processor efficiency, segmentation for controlled sharing, and a loop-free structures for avoiding intermodule dependencies, the Archival Storage is designed for implementation on the Zilog Z8001 microprocessor with a memory management unit. The concepts of a process structure and a distributed kernel are used in providing management of the shared hardware resources of the system. The security kernel primitives create a virtual machine environment and provide information security in accordance with a non-discretionary security policy. (Author)

Structured Interfaces for Automated Reasoning with 3D Scene Graphs

Aaron Ray, Jacob Arkin, Harel Biggie +3 more

cs.CV · 18 Oct 2025 · arXiv ↗ · more like this ·

In order to provide a robot with the ability to understand and react to a user's natural language inputs, the natural language must be connected to the robot's underlying representations of the world. Recently, large language models (LLMs) and 3D scene graphs (3DSGs) have become a popular choice for grounding natural language and representing the world. In this work, we address the challenge of using LLMs with 3DSGs to ground natural language. Existing methods encode the scene graph as serialized text within the LLM's context window, but this encoding does not scale to large or rich 3DSGs. Instead, we propose to use a form of Retrieval Augmented Generation to select a subset of the 3DSG relevant to the task. We encode a 3DSG in a graph database and provide a query language interface (Cypher) as a tool to the LLM with which it can retrieve relevant data for language grounding. We…

Task and Motion Planning in Hierarchical 3D Scene Graphs

Aaron Ray, Christopher Bradley, Luca Carlone +1 more

cs.RO · March 2024 · arXiv ↗ · more like this ·

Recent work in the construction of 3D scene graphs has enabled mobile robots to build large-scale metric-semantic hierarchical representations of the world. These detailed models contain information that is useful for planning, however an open question is how to derive a planning domain from a 3D scene graph that enables efficient computation of executable plans. In this work, we present a novel approach for defining and solving Task and Motion Planning problems in large-scale environments using hierarchical 3D scene graphs. We describe a method for building sparse problem instances which enables scaling planning to large scenes, and we propose a technique for incrementally adding objects to that domain during planning time that minimizes computation on irrelevant elements of the scene graph. We evaluate our approach in two real scene graphs built from perception, including one…

Aggressive Aerial Grasping using a Soft Drone with Onboard Perception

Samuel Ubellacker, Aaron Ray, James Bern +2 more

cs.RO · 11 Aug 2023 · arXiv ↗ · more like this ·

Contrary to the stunning feats observed in birds of prey, aerial manipulation and grasping with flying robots still lack versatility and agility. Conventional approaches using rigid manipulators require precise positioning and are subject to large reaction forces at grasp, which limit performance at high speeds. The few reported examples of aggressive aerial grasping rely on motion capture systems, or fail to generalize across environments and grasp targets. We describe the first example of a soft aerial manipulator equipped with a fully onboard perception pipeline, capable of robustly localizing and grasping visually and morphologically varied objects. The proposed system features a novel passively closing tendon-actuated soft gripper that enables fast closure at grasp, while compensating for position errors, complying to the target-object morphology, and dampening reaction forces. The…

Hydra-Multi: Collaborative Online Construction of 3D Scene Graphs with Multi-Robot Teams

Yun Chang, Nathan Hughes, Aaron Ray +1 more

cs.RO · 26 Apr 2023 · arXiv ↗ · more like this ·

3D scene graphs have recently emerged as an expressive high-level map representation that describes a 3D environment as a layered graph where nodes represent spatial concepts at multiple levels of abstraction (e.g., objects, rooms, buildings) and edges represent relations between concepts (e.g., inclusion, adjacency). This paper describes Hydra-Multi, the first multi-robot spatial perception system capable of constructing a multi-robot 3D scene graph online from sensor data collected by robots in a team. In particular, we develop a centralized system capable of constructing a joint 3D scene graph by taking incremental inputs from multiple robots, effectively finding the relative transforms between the robots' frames, and incorporating loop closure detections to correctly reconcile the scene graph nodes from different robots. We evaluate Hydra-Multi on simulated and real scenarios and…

Free-Space Ellipsoid Graphs for Multi-Agent Target Monitoring

Aaron Ray, Alyssa Pierson, Daniela Rus

cs.RO · 31 May 2022 · arXiv ↗ · more like this ·

We apply a novel framework for decomposing and reasoning about free space in an environment to a multi-agent persistent monitoring problem. Our decomposition method represents free space as a collection of ellipsoids associated with a weighted connectivity graph. The same ellipsoids used for reasoning about connectivity and distance during high level planning can be used as state constraints in a Model Predictive Control algorithm to enforce collision-free motion. This structure allows for streamlined implementation in distributed multi-agent tasks in 2D and 3D environments. We illustrate its effectiveness for a team of tracking agents tasked with monitoring a group of target agents. Our algorithm uses the ellipsoid decomposition as a primitive for the coordination, path planning, and control of the tracking agents. Simulations with four tracking agents monitoring fifteen dynamic…

Closed-form Continuous-time Neural Models

Ramin Hasani, Mathias Lechner, Alexander Amini +5 more

cs.LG · June 2021 · arXiv ↗ · more like this ·

Continuous-time neural processes are performant sequential decision-makers that are built by differential equations (DE). However, their expressive power when they are deployed on computers is bottlenecked by numerical DE solvers. This limitation has significantly slowed down the scaling and understanding of numerous natural physical phenomena such as the dynamics of nervous systems. Ideally, we would circumvent this bottleneck by solving the given dynamical system in closed form. This is known to be intractable in general. Here, we show it is possible to closely approximate the interaction between neurons and synapses -- the building blocks of natural and artificial neural networks -- constructed by liquid time-constant networks (LTCs) efficiently in closed-form. To this end, we compute a tightly-bounded approximation of the solution of an integral appearing in LTCs' dynamics, that has…