Author

Jonathan Kelly

151 papers · 2001–2026

2001peak 20 in 20232026

Frequent co-authors

Papers

showing 1–25 of 151 RSS

Autism Occurrence by MMR Vaccine Status Among US Children With Older Siblings With and Without Autism

Anjali Jain, Jaclyn Marshall, Ami Buikema +3 more

Health · JAMA · 21 Apr 2015 · cited 203× · DOI ↗ · more like this ·

IMPORTANCE: Despite research showing no link between the measles-mumps-rubella (MMR) vaccine and autism spectrum disorders (ASD), beliefs that the vaccine causes autism persist, leading to lower vaccination levels. Parents who already have a child with ASD may be especially wary of vaccinations. OBJECTIVE: To report ASD occurrence by MMR vaccine status in a large sample of US children who have older siblings with and without ASD. DESIGN, SETTING, AND PARTICIPANTS: A retrospective cohort study using an administrative claims database associated with a large commercial health plan. Participants included children continuously enrolled in the health plan from birth to at least 5 years of age during 2001-2012 who also had an older sibling continuously enrolled for at least 6 months between 1997 and 2012. EXPOSURES: MMR vaccine receipt (0, 1, 2 doses) between birth and 5 years of age. MAIN…

SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fields

Ashkan Mirzaei, Tristan Aumentado-Armstrong, Konstantinos G. Derpanis +4 more

cs.CV · November 2022 · cited 202× · arXiv ↗ · more like this ·

Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel view synthesis. While NeRFs are quickly being adapted for a wider set of applications, intuitively editing NeRF scenes is still an open challenge. One important editing task is the removal of unwanted objects from a 3D scene, such that the replaced region is visually plausible and consistent with its context. We refer to this task as 3D inpainting. In 3D, solutions must be both consistent across multiple views and geometrically valid. In this paper, we propose a novel 3D inpainting method that addresses these challenges. Given a small set of posed images and sparse annotations in a single input image, our framework first rapidly obtains a 3D segmentation mask for a target object. Using the mask, a perceptual optimizationbased approach is then introduced that leverages learned 2D image inpainters, distilling…

Perceived Space in the HTC Vive

Jonathan W. Kelly, Lucia A. Cherep, Zachary D. Siegel

Human-Computer Interaction · ACM Transactions on Applied Perception · 27 Jul 2017 · cited 135× · DOI ↗ · more like this ·

Underperception of egocentric distance in virtual reality has been a persistent concern for almost 20 years. Modern head-mounted displays (HMDs) appear to have begun to ameliorate underperception. The current study examined several aspects of perceived space in the HTC Vive. Blind-walking distance judgments, verbal distance judgments, and size judgments were measured in two distinct virtual environments (VEs)—a high-quality replica of a real classroom and an empty grass field—as well as the real classroom upon which the classroom VE was modeled. A brief walking interaction was also examined as an intervention for improving anticipated underperception in the VEs. Results from the Vive were compared to existing data using two older HMDs (nVisor SX111 and ST50). Blind-walking judgments were more accurate in the Vive compared to the older displays, and did not differ substantially from the…

Approach to Machine Learning for Extraction of Real-World Data Variables from Electronic Health Records

Blythe Adamson, Michael Waskom, Auriane Blarre +9 more

Artificial Intelligence · medRxiv · 6 Mar 2023 · cited 83× · DOI ↗ · more like this ·

ABSTRACT Background As artificial intelligence (AI) continues to advance with breakthroughs in natural language processing (NLP) and machine learning (ML), such as the development of models like OpenAI’s ChatGPT, new opportunities are emerging for efficient curation of electronic health records (EHR) into real-world data (RWD) for evidence generation in oncology. Our objective is to describe the research and development of industry methods to promote transparency and explainability. Methods We applied NLP with ML techniques to train, validate, and test the extraction of information from unstructured documents (eg, clinician notes, radiology reports, lab reports, etc.) to output a set of structured variables required for RWD analysis. This research used a nationwide electronic health record (EHR)-derived database. Models were selected based on performance. Variables curated with an…

The impact of task workload on cybersickness

Nathan C. Sepich, Angelica Jasper, Stephen J. Fieffer +3 more

Human-Computer Interaction · Frontiers in Virtual Reality · 19 Aug 2022 · cited 63× · DOI ↗ · more like this ·

This study explored the impact of task workload on virtual reality (VR) cybersickness. Cybersickness is a negative side effect of using VR to which many users are susceptible. Previous research on the impact on task workload on cybersickness has yielded no consistent relationships, but given that task workload requires attentional resources, it is worth further investigation of how a demand on attention might increase or decrease cybersickness. In this study, mental workload of participants ( N = 151) was modified in three different task groups within the same virtual environment (VE). The Cybersickness Corn Maze VR testbed contained cybersickness-inducing stimuli and tasks with varying workload. The 0-Back group used a controller to select an object as a visual attention task. The 2-Back group performed the 2-Back memory detection task, using a controller to collect objects that…

The Right View from the Wrong Location: Depth Perception in Stereoscopic Multi-User Virtual Environments

B. Pollock, Melissa Burton, Jonathan W. Kelly +2 more

Human-Computer Interaction · IEEE Transactions on Visualization and Computer Graphics · 13 Mar 2012 · cited 57× · DOI ↗ · more like this ·

Stereoscopic depth cues improve depth perception and increase immersion within virtual environments (VEs). However, improper display of these cues can distort perceived distances and directions. Consider a multi-user VE, where all users view identical stereoscopic images regardless of physical location. In this scenario, cues are typically customized for one "leader" equipped with a head-tracking device. This user stands at the center of projection (CoP) and all other users ("followers") view the scene from other locations and receive improper depth cues. This paper examines perceived depth distortion when viewing stereoscopic VEs from follower perspectives and the impact of these distortions on collaborative spatial judgments. Pairs of participants made collaborative depth judgments of virtual shapes viewed from the CoP or after displacement forward or backward. Forward and backward…

DPC-Net: Deep Pose Correction for Visual Localization

Valentin Peretroukhin, Jonathan Kelly

cs.CV · September 2017 · cited 52× · arXiv ↗ · more like this ·

We present a novel method to fuse the power of deep networks with the computational efficiency of geometric and probabilistic localization algorithms. In contrast to other methods that completely replace a classical visual estimator with a deep network, we propose an approach that uses a convolutional neural network to learn difficult-to-model corrections to the estimator from ground-truth training data. To this end, we derive a novel loss function for learning SE(3) corrections based on a matrix Lie groups approach, with a natural formulation for balancing translation and rotation errors. We use this loss to train a Deep Pose Correction network (DPC-Net) that predicts corrections for a particular estimator, sensor and environment. Using the KITTI odometry dataset, we demonstrate significant improvements to the accuracy of a computationally-efficient sparse stereo visual odometry…

Reference-guided Controllable Inpainting of Neural Radiance Fields

Ashkan Mirzaei, Tristan Aumentado-Armstrong, Marcus A. Brubaker +4 more

cs.CV · 20 Apr 2023 · cited 50× · arXiv ↗ · more like this ·

The popularity of Neural Radiance Fields (NeRFs) for view synthesis has led to a desire for NeRF editing tools. Here, we focus on inpainting regions in a view-consistent and controllable manner. In addition to the typical NeRF inputs and masks delineating the unwanted region in each view, we require only a single inpainted view of the scene, i.e., a reference view. We use monocular depth estimators to back-project the inpainted view to the correct 3D positions. Then, via a novel rendering technique, a bilateral solver can construct view-dependent effects in non-reference views, making the inpainted region appear consistent from any view. For non-reference disoccluded regions, which cannot be supervised by the single reference view, we devise a method based on image inpainters to guide both the geometry and appearance. Our approach shows superior performance to NeRF inpainting baselines…

Who Are Virtual Reality Headset Owners? A Survey and Comparison of Headset Owners and Non-Owners

Jonathan W. Kelly, Lucia A. Cherep, Alex Lim +2 more

Human-Computer Interaction · Iowa State University Digital Repository (Iowa State University) · March 2021 · cited 50× · DOI ↗ · more like this ·

The number of people who own a virtual reality (VR) head-mounted display (HMD) has reached a point where researchers can readily recruit HMD owners to participate remotely using their own equipment. However, HMD owners recruited online may differ from the university community members who typically participate in VR research. HMD owners (n=220) and non-owners (n=282) were recruited through two online work sites-Amazon's Mechanical Turk and Prolific-and an undergraduate participant pool. Participants completed a survey in which they provided demographic information and completed measures of HMD use, video game use, spatial ability, and motion sickness susceptibility. In the context of the populations sampled, the results provide 1) a characterization of HMD owners, 2) a snapshot of the most commonly owned HMDs, 3) a comparison between HMD owners and non-owners, and 4) a comparison among…

Comparison of Two Methods for Improving Distance Perception in Virtual Reality

Jonathan W. Kelly, Lucia A. Cherep, Brenna Klesel +2 more

Human-Computer Interaction · ACM Transactions on Applied Perception · 6 Mar 2018 · cited 50× · DOI ↗ · more like this ·

Distance is commonly underperceived in virtual environments (VEs) compared to real environments. Past work suggests that displaying a replica VE based on the real surrounding environment leads to more accurate judgments of distance, but that work has lacked the necessary control conditions to firmly make this conclusion. Other research indicates that walking through a VE with visual feedback improves judgments of distance and size. This study evaluated and compared those two methods for improving perceived distance in VEs. All participants experienced a replica VE based on the real lab. In one condition, participants visually previewed the real lab prior to experiencing the replica VE, and in another condition they did not. Participants performed blind-walking judgments of distance and also judgments of size in the replica VE before and after walking interaction. Distance judgments were…

On domain knowledge and novelty to improve program synthesis performance with grammatical evolution

Erik Hemberg, Jonathan Kelly, Una-May O’Reilly

Artificial Intelligence · Proceedings of the Genetic and Evolutionary Computation Conference · 3 Jul 2019 · cited 42× · DOI ↗ · more like this ·

Programmers solve coding problems with the support of both programming and problem specific knowledge. They integrate this domain knowledge to reason by computational abstraction. Correct and readable code arises from sound abstractions and problem solving. We attempt to transfer insights from such human expertise to genetic programming (GP) for solving automatic program synthesis. We draw upon manual and non-GP Artificial Intelligence methods to extract knowledge from synthesis problem definitions to guide the construction of the grammar that Grammatical Evolution uses and to supplement its fitness function. We examine the impact of using such knowledge on 21 problems from the GP program synthesis benchmark suite. Additionally, we investigate the compounding impact of this knowledge and novelty search. The resulting approaches exhibit improvements in accuracy on a majority of problems…

Distance Perception in the Oculus Quest and Oculus Quest 2

Jonathan W. Kelly, Taylor Doty, Morgan Ambourn +1 more

Human-Computer Interaction · PsyArXiv (OSF Preprints) · 7 Jan 2022 · cited 40× · DOI ↗ · more like this ·

Distances in virtual environments (VEs) viewed on a head-mounted display (HMD) are typically underperceived relative to the intended distance. This paper presents an experiment comparing perceived egocentric distance in a real environment with that in a matched VE presented in the Oculus Quest and Oculus Quest 2. Participants made verbal judgments and blind walking judgments to an object on the ground. Both the Quest and Quest 2 produced underperception. Verbal judgments in the VE were 82% and 75% of the object distance, in contrast with real world judgments that were 94% of the object distance. Blind walking judgments were 68% and 70% of object distance in the Quest and Quest 2, respectively, compared to 88% in the real world. This project shows that significant underperception of distance persists even in modern HMDs.

Adversarial Genetic Programming for Cyber Security: A Rising Application Domain Where GP Matters

Una-May O'Reilly, Jamal Toutouh, Marcos Pertierra +5 more

cs.CR · 7 Apr 2020 · cited 37× · arXiv ↗ · more like this ·

Cyber security adversaries and engagements are ubiquitous and ceaseless. We delineate Adversarial Genetic Programming for Cyber Security, a research topic that, by means of genetic programming (GP), replicates and studies the behavior of cyber adversaries and the dynamics of their engagements. Adversarial Genetic Programming for Cyber Security encompasses extant and immediate research efforts in a vital problem domain, arguably occupying a position at the frontier where GP matters. Additionally, it prompts research questions around evolving complex behavior by expressing different abstractions with GP and opportunities to reconnect to the Machine Learning, Artificial Life, Agent-Based Modeling and Cyber Security communities. We present a framework called RIVALS which supports the study of network security arms races. Its goal is to elucidate the dynamics of cyber networks under attack…

The effect of water immersion on vection in virtual reality

Géraldine Fauville, Anna Carolina Muller Queiroz, Erika Woolsey +2 more

Human-Computer Interaction · Scientific Reports · 13 Jan 2021 · cited 35× · DOI ↗ · more like this ·

Research about vection (illusory self-motion) has investigated a wide range of sensory cues and employed various methods and equipment, including use of virtual reality (VR). However, there is currently no research in the field of vection on the impact of floating in water while experiencing VR. Aquatic immersion presents a new and interesting method to potentially enhance vection by reducing conflicting sensory information that is usually experienced when standing or sitting on a stable surface. This study compares vection, visually induced motion sickness, and presence among participants experiencing VR while standing on the ground or floating in water. Results show that vection was significantly enhanced for the participants in the Water condition, whose judgments of self-displacement were larger than those of participants in the Ground condition. No differences in visually induced…

Self-Supervised Scale Recovery for Monocular Depth and Egomotion Estimation

Brandon Wagstaff, Jonathan Kelly

cs.RO · September 2020 · cited 35× · arXiv ↗ · more like this ·

The self-supervised loss formulation for jointly training depth and egomotion neural networks with monocular images is well studied and has demonstrated state-of-the-art accuracy. One of the main limitations of this approach, however, is that the depth and egomotion estimates are only determined up to an unknown scale. In this paper, we present a novel scale recovery loss that enforces consistency between a known camera height and the estimated camera height, generating metric (scaled) depth and egomotion predictions. We show that our proposed method is competitive with other scale recovery techniques that require more information. Further, we demonstrate that our method facilitates network retraining within new environments, whereas other scale-resolving approaches are incapable of doing so. Notably, our egomotion network is able to produce more accurate estimates than a similar method…

Determining the Time Delay Between Inertial and Visual Sensor Measurements

Jonathan Kelly, Nicholas Roy, Gaurav S. Sukhatme

Computer Vision and Pattern Recognition · IEEE Transactions on Robotics · 20 Aug 2014 · cited 34× · DOI ↗ · more like this ·

We examine the problem of determining the relative time delay between IMU and camera data streams. The primary difficulty is that the correspondences between measurements from the sensors are not initially known, and hence, the time delay cannot be computed directly. We instead formulate time delay calibration as a registration problem, and introduce a calibration algorithm that operates by aligning curves in a three-dimensional orientation space. Results from simulation studies and from experiments with real hardware demonstrate that the delay can be accurately calibrated.

Gender differences in cybersickness: Clarifying confusion and identifying paths forward

Jonathan W. Kelly, Stephen B. Gilbert, Michael C. Dorneich +1 more

Sociology and Political Science · PsyArXiv (OSF Preprints) · 25 Jan 2023 · cited 31× · DOI ↗ · more like this ·

Cybersickness is a barrier to widespread adoption of virtual reality (VR). We summarize the literature and conclude that women experience more cybersickness than do men, but that the size of the gender effect is modest. We present a mediation and moderation framework for organizing existing research and proposing new questions about gender and cybersickness. A mediator causally connects gender and cybersickness, and a moderator changes the magnitude of the gender difference in cybersickness.

CELLO: A fast algorithm for Covariance Estimation

William Vega-Brown, Abraham Bachrach, Adam Bry +2 more

Artificial Intelligence · DSpace@MIT (Massachusetts Institute of Technology) · May 2013 · cited 26× · DOI ↗ · more like this ·

We present CELLO (Covariance Estimation and Learning through Likelihood Optimization), an algorithm for predicting the covariances of measurements based on any available informative features. This algorithm is intended to improve the accuracy and reliability of on-line state estimation by providing a principled way to extend the conventional fixed-covariance Gaussian measurement model. We show that in experiments, CELLO learns to predict measurement covariances that agree with empirical covariances obtained by manually annotating sensor regimes. We also show that using the learned covariances during filtering provides substantial quantitative improvement to the overall state estimate.

Certifiably Optimal Monocular Hand-Eye Calibration

Emmett Wise, Matthew Giamou, Soroush Khoubyarian +2 more

cs.RO · May 2020 · cited 25× · arXiv ↗ · more like this ·

Correct fusion of data from two sensors is not possible without an accurate estimate of their relative pose, which can be determined through the process of extrinsic calibration. When two or more sensors are capable of producing their own egomotion estimates (i.e., measurements of their trajectories through an environment), the 'hand-eye' formulation of extrinsic calibration can be employed. In this paper, we extend our recent work on a convex optimization approach for hand-eye calibration to the case where one of the sensors cannot observe the scale of its translational motion (e.g., a monocular camera observing an unmapped environment). We prove that our technique is able to provide a certifiably globally optimal solution to both the known- and unknown-scale variants of hand-eye calibration, provided that the measurement noise is bounded. Herein, we focus on the theoretical aspects of…

Cheap or Robust? The Practical Realization of Self-Driving Wheelchair Technology

Maya Burhanpurkar, Mathieu Labbé, Xinyi Gong +3 more

cs.RO · July 2017 · cited 18× · arXiv ↗ · more like this ·

To date, self-driving experimental wheelchair technologies have been either inexpensive or robust, but not both. Yet, in order to achieve real-world acceptance, both qualities are fundamentally essential. We present a unique approach to achieve inexpensive and robust autonomous and semi-autonomous assistive navigation for existing fielded wheelchairs, of which there are approximately 5 million units in Canada and United States alone. Our prototype wheelchair platform is capable of localization and mapping, as well as robust obstacle avoidance, using only a commodity RGB-D sensor and wheel odometry. As a specific example of the navigation capabilities, we focus on the single most common navigation problem: the traversal of narrow doorways in arbitrary environments. The software we have developed is generalizable to corridor following, desk docking, and other navigation tasks that are…

Rescaling of perceived space transfers across virtual environments.

Zachary D. Siegel, Jonathan W. Kelly, Lucia A. Cherep

Human-Computer Interaction · Journal of Experimental Psychology Human Perception & Performance · October 2017 · cited 17× · DOI ↗ · more like this ·

Research over the past 20 years has consistently shown that egocentric distance is underperceived in virtual environments (VEs) compared with real environments. In 2 experiments, judgments of object distance (Experiment 1) and object size (Experiment 2) improved after a brief period of walking through the VE with continuous visual feedback. Whereas improvement of blind-walking distance judgments could be attributable to recalibration of walking, improvement in perceived size is considered evidence for rescaling of perceived space, whereby perceived size and distance increased after walking interaction. Furthermore, improvements in judged distance and size transferred to a new VE. Distance judgments, but not size judgments, continued to improve after additional walking interaction in the new VE. These results have theoretical implications regarding the effects of walking interaction on…

Visual Stabilization of Balance in Virtual Reality Using the HTC Vive

Jonathan W. Kelly, Brenna Klesel, Lucia A. Cherep

Human-Computer Interaction · ACM Transactions on Applied Perception · 3 Apr 2019 · cited 16× · DOI ↗ · more like this ·

Vision in real environments stabilizes balance compared to an eyes-closed condition. For virtual reality to be safe and fully effective in applications such as physical rehabilitation, vision in virtual reality should stabilize balance as much as vision in the real world. Older virtual reality technology was previously found to stabilize balance but by less than half as much as real-world vision. Recent advancements in display technology might allow for vision in virtual reality to be as stabilizing as vision in the real world. This study evaluated whether viewing a virtual environment through the HTC Vive—a new consumer-grade head-mounted display—stabilizes balance, and whether visual stabilization is similar to that provided by real-world vision. Participants viewed the real laboratory or a virtual replica of the laboratory and attempted to maintain an unstable stance with eyes open…

Linking Threat Tactics, Techniques, and Patterns with Defensive Weaknesses, Vulnerabilities and Affected Platform Configurations for Cyber Hunting

Erik Hemberg, Jonathan Kelly, Michal Shlapentokh-Rothman +4 more

cs.CR · October 2020 · cited 14× · arXiv ↗ · more like this ·

Many public sources of cyber threat and vulnerability information exist to help defend cyber systems. This paper links MITRE's ATT&CK MATRIX of Tactics and Techniques, NIST's Common Weakness Enumerations (CWE), Common Vulnerabilities and Exposures (CVE), and Common Attack Pattern Enumeration and Classification list (CAPEC), to gain further insight from alerts, threats and vulnerabilities. We preserve all entries and relations of the sources, while enabling bi-directional, relational path tracing within an aggregate data graph called BRON. In one example, we use BRON to enhance the information derived from a list of the top 10 most frequently exploited CVEs. We identify attack patterns, tactics, and techniques that exploit these CVEs and also uncover a disparity in how much linked information exists for each of these CVEs. This prompts us to further inventory BRON's collection of sources…

The cognitive implications of semi-natural virtual locomotion

William E. Marsh, Marisa M. Putnam, Jonathan W. Kelly +2 more

Human-Computer Interaction · March 2012 · cited 14× · DOI ↗ · more like this ·

This study incorporated a dual-task paradigm, in which participants were asked to perform basic locomotion tasks with one of three interfaces while remembering a sequence of either spatial or verbal items. Interfaces varied in similarity to natural body movements. Stopping performance was compromised when concurrently remembering a spatial, but not verbal, sequence. Also users exhibited lower performance on spatial memory tasks while using more unnatural locomotion interfaces. These results confirm that semi-natural locomotion interfaces require spatial working memory resources and thus locomotion interfaces compete with ongoing spatial tasks, as opposed to those requiring verbal resources or general attention resources.

Cybersickness Abatement from Repeated Exposure to VR with Reduced Discomfort

Taylor Doty, Jonathan W. Kelly, Stephen B. Gilbert +1 more

Human-Computer Interaction · PsyArXiv (OSF Preprints) · 24 Jun 2024 · cited 13× · DOI ↗ · more like this ·

Cybersickness, or sickness induced by virtual reality (VR), negatively impacts the enjoyment and adoption of the technology. One method that has been used to reduce sickness is repeated exposure to VR, herein Cybersickness Abatement from Repeated Exposure (CARE). However, high sickness levels during repeated exposure may discourage some users from returning. Field of view (FOV) restriction reduces cybersickness by minimizing visual motion in the periphery, but also negatively affects the user’s visual experience. This study explored whether CARE that occurs with FOV restriction generalizes to a full FOV experience. Participants played a VR game for up to 20 minutes. Those in the Repeated Exposure Condition played the same VR game on four separate days, experiencing FOV restriction during the first three days and no FOV restriction on the fourth day. Results indicated significant CARE…