Many recent technological advances have helped to pave the way forward for fully autonomous vehicles. This special issue explores three aspects of the self-driving car revolution: a historical perspective with a focus on perception for autonomous vehicles, how government policy will impact self-driving cars technically and commercially, and how cloud-based infrastructure plays a role in the future.
Computer Vision and Pattern Recognition · · cited 131× · DOI ↗ · more like this ·
A description is given of the first cross-country map and sensor-based autonomous operation of a robotic vehicle. Experiments on the autonomous land vehicle (ALV) in natural terrain were performed. An overview of the software architecture is provided, and details of the perception and planning techniques are presented. Two key experiments in which the vehicle avoided known and unknown obstacles in its path are described.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
One of the unique applications of Mixed and Augmented Reality (MR/AR) systems is that hidden and occluded objects can be readily visualized. We call this specialized use of MR/AR, Obscured Information Visualization (0I D. In this paper, we describe the beginning of a research program designed to develop such visualizations through the use of principles derived from perceptual psychology and cognitive science. In this paper we surveyed the cognitive science literature as it applies to such visualization tasks, described experimental questions derived from these cognitive principles, and generated general guidelines that can be used in designing future OIV systems (as well improving AR displays more generally). Here we also report the results from an experiment that utilized a functioning AR-OIV system: we found that in a relative depth judgment, subjects reported rendered objects as…
Computer Vision and Pattern Recognition · · cited 59× · DOI ↗ · more like this ·
Human interaction with large numbers of robots or distributed sensors presents a number of difficult challenges including supervisory management, monitoring of individual and collective state, and apprehending situation awareness. A rich source of information about the environment can be provided even with robots that have no explicit representations or maps of their locale. To do this, we transform a robot swarm into a distributed interface embedded within the environment. Visually, each robot acts like a pixel within a much larger visual display space so that any robot need only communicate a small amount of information from its current location. Our approach uses augmented reality techniques for communicating information to humans from large numbers of small-scale robots to enable situation awareness, monitoring, and control for surveillance, reconnaissance, hazard detection, and…
In large distributed corporations, distributed design review offers the potential for cost savings, reduced time to market, and improved efficiency. It also has the potential to improve the design process by enabling wider expertise to be incorporated in design reviews. This paper describes the integration of several components to enable distributed virtual design review in mixed multi-party, heterogeneous multi-site 2D and immersive 3D environments. The system provides higher layers of support for collaboration including avatars, high fidelity audio, and shared artifact manipulation. The system functions across several interface environments ranging from CAVEs to Walls to desktop workstations. At the center of the software architecture is the Human Integrating Virtual Environment (HIVE) [6], a collaboration infrastructure and toolset to support research and development of multi-user…
Artificial Intelligence · Photogrammetric Engineering & Remote Sensing · · cited 35× · OpenAlex ↗ · more like this ·
Dual polarization L-band (lambda = 25 cm) radar imagery and Landsat multispectral scanner (MSS) data from central Death Valley have been computer processed and combined digitally in order to utilize the complementary information contained in multisensor data sets. Physically, like-polarized radar data gives roughness information on a scale proportional to radar wavelength. Cross-polarized data adds information on the overall roughness, particle shape, and packing density. Visible and near IR reflectivities pertain to surface chemistry. Surficial geologic units in Death Valley are defined on the basis of compositional and textural differences: optical and microwave scattering properties encoded in the multisensor image are sufficient to discriminate most of the units. This synergistic effect is most pronounced for the alluvial fans. Using radar scattering data and measured sun angle…
Computer Vision and Pattern Recognition · · cited 26× · DOI ↗ · more like this ·
We describe and evaluate a new tracking concept for outdoor Augmented Reality. A few mobile beacons added to the environment correct errors in head-worn inertial and GPS sensors. We evaluate the accuracy through detailed simulation of many error sources. The most important parameters are the errors in measuring the beacon and user's head positions, and the geometric configuration of the beacons around the point to augment. Using Monte Carlo simulations, we identify combinations of beacon configurations and error parameters that meet a specified goal of 1 m net error at 100 m range.
Signal Processing · IEEE Computer Graphics and Applications · · cited 21× · DOI ↗ · more like this ·
Free Flight lets pilots modify their routes in real time. It requires new conflict detection, resolution, and visualization decision support tools. We describe a testbed for building and evaluating such tools.
This paper describes a 2D videoconferencing system with eye gaze correction. Tracking the eyes and warping the eyes appropriately each frame appears to create natural eye contact between users. The geometry of the eyes as well as the displacement of the camera with the remote user's image determines the warp. We implement this system within software, not requiring any specialized hardware.
Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·
"Free Flight" will change today's air traffic control system by giving pilots increased flexibility to choose and modify their routes in real time, reducing costs and increasing system capacity. This increased flexibility comes at the price of increased complexity. If Free Flight is to become a reality, future air traffic controllers, pilots, and airline managers will require new conflict detection, resolution and visualization decision support tools. The paper describes a testbed system for building and evaluating such tools, including its current capabilities, lessons we learned and feedback received from expert users. The visualization system provides an overall plan view supplemented with a detailed perspective view, allowing a user to examine highlighted conflicts and select from a list of proposed solutions, as the scenario runs in real time. Future steps needed to improve this…
Computer Vision and Pattern Recognition · Computer · · cited 10× · DOI ↗ · more like this ·
Computing technologies have rapidly transformed our world and, perhaps unsurprisingly, have a profound capacity for transforming us. Given our inherent human vulnerabilities and limitations, these technological advances do more than just pick up the slack. The articles in this special issue exemplify novel ways of augmenting human communications, sensing capacity, neurological fortitude, and more.
Computer Networks and Communications · IEEE Journal on Selected Areas in Communications · · cited 10× · DOI ↗ · more like this ·
We discuss gigabit network applications enabled by "Mission to Planet Earth", an international effort to monitor the Earth as a system. We describe the design of a network architecture to support applications developed as part of this program; introduce a new component, public access resource centers (PARCs); and discuss how PARCs would facilitate access by users outside the traditional research community. We also describe how a particular class of users, agriculture users, might benefit from access to data collected as part of the Mission to Planet Earth program and delivered in a value-added form to them by a so-called AgPARC. The suggested architecture requires the deployment of high-bandwidth networks.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">></ETX>
One of the primary hurdles to effectively evaluating adaptive software is that its very use alters the system from one moment to the next. Here, we developed and implemented an empirical-evaluation methodology that was successfully tested on an adaptive, Web-based collaboration tool. Subjects participated in an "open-book" exam, spending limited amounts of time on the Web researching a generic, non-technical topic, such as jazz or baseball, and were later tested on the information they had found. We employed objective, user-centered metrics to quantify subjects' ability to make enhanced Web searches when using the tool. Test results from 8 subjects showed that our approach could reliably measure differences in a user's performance for different collaboration algorithms. Our protocol demonstrated that history-dependent tools can be evaluated without large subject pools and without…
Artificial Intelligence · International Conference on Artificial Intelligence · · cited 3× · DOI ↗ · more like this ·
Radiotherapy-resistant glioblastoma (rrGBM) remains a significant clinical challenge because of high infiltrative growth characterized by activation of antiapoptotic signal transduction. Herein, we describe an efficiently biodegradable selenium-engineered mesoporous silica nanocapsule, initiated by high-energy X-ray irradiation and employed for at-site RNA interference (RNAi) to inhibit rrGBM invasion and achieve maximum therapeutic benefit. Our radiation-triggered RNAi nanocapsule showed high physiological stability, good blood-brain barrier transcytosis, and potent rrGBM accumulation. An intratumoral RNAi nanocapsule permitted low-dose X-ray radiation-triggered dissociation for cofilin-1 knockdown, inhibiting rrGBM infiltration. More importantly, tumor suppression was further amplified by electron-affinity aminoimidazole products converted from metronidazole polymers under X-ray…
Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 2× · DOI ↗ · more like this ·
In this paper, we describe COGNIVA, a closed-loop Cognitive-Neural method and system for image and video analysis that combines recent technological breakthroughs in bio-vision cognitive algorithms and neural signatures of human visual processing. COGNIVA is an "operational neuroscience" framework for intelligent and rapid search and categorization of Items Of Interest (IOI) in imagery and video. The IOI could be a single object, group of objects, specific image regions, specific spatio-temporal pattern/sequence or even the category that the image itself belongs to (e.g., vehicle or non-vehicle). There are two main types of approach for rapid search and categorization of IOI in imagery and video. The first approach uses conventional machine vision or bio-inspired cognitive algorithms. These usually need a predefined set of IOI and suffer from high false alarm rates. The second class of…
Renewed interest in cognitive information processing has identified the need for novel computing architectures that can efficiently and dynamically support reasoning and learning with emphasis on memory structures. A large number of cognitive processing methods have been implemented in software on conventional computing architectures. This paper describes detailed execution profiling of a particular cognitive method for analogical reasoning called SAGEtrade. SAGEtrade is a symbolic-connectionist, performance oriented analogical reasoner. The primary contribution of the work is to identify the deficiencies and bottlenecks of SAGEtrade to inform the development of improved architectures for cognitive information processing, and especially for analogical reasoning.
Computer Vision and Pattern Recognition · IEEE Visualization · · cited 2× · DOI ↗ · more like this ·
“Free Flight” will change today's air traffic control system by giving pilots increased flexibility to choose and modify their routes in real time, reducing costs and increasing system capacity. This increased flexibility comes at the price of increased complexity. If Free Flight is to become a reality, future air traffic controllers, pilots, and airline managers will require new conflict detection, resolution and visualization decision support tools. This paper describes a testbed system for building and evaluating such tools, including its current capabilities, lessons we learned, and feedback received from expert users. The visualization system provides an overall plan view supplemented with a detailed perspective view, allowing a user to examine highlighted conflicts and select from a list of proposed solutions, as the scenario runs in real time. Future steps needed to improve this…
Emerging technology now in use in the military enables air vehicles, dismounted soldiers, persistent sensors, and higher headquarters to share multimedia information in the form of alerts that will increase the awareness of a dismounted soldier conducting urban operations. The challenge is to manage the complexity of such a tactical alerting system so that soldiers are not overwhelmed or distracted by new technology. There is a large number of ways to present soldiers with any specific information in the form of an alert, including the choice not to present the information. An effective tactical alert management system must accurately learn the preferences of the soldier as well as policy from higher-level command from a small number of examples in a small amount of time with a simple interface. This paper presents the development of an information management engine that accomplishes…
One of the primary hurdles to effectively evaluating adaptive software is that its very use alters the system from one moment to the next. Here, we developed and implemented an empirical-evaluation methodology that was successfully tested on an adaptive, web-based collaboration tool. Subjects participated in an &amp;quot;open-book &amp;quot; exam, spending limited amounts of time on the web researching a generic, nontechnical topic, such as jazz or baseball, and were later tested on the information they had found. We employed objective, user-centered metrics to quantify subjects ’ ability to make enhanced web searches when using the tool. Test results from 8 subjects showed that our approach could reliably measure differences in a user’s performance for different collaboration algorithms. Our protocol demonstrated that history-dependent tools can be evaluated without large…
Computer Networks and Communications · International Conference on Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·
Emerging technology now in use in the military enables air vehicles, dismounted soldiers, persistent sensors, and higher headquarters to share multimedia information in the form of alerts that will increase the awareness of a dismounted soldier conducting urban operations. The challenge is to manage the complexity of such a tactical alerting system so that soldiers are not overwhelmed or distracted by new technology. There is a large number of ways to present soldiers with any specific information in the form of an alert, including the choice not to present the information. An effective tactical alert management system must accurately learn the preferences of the soldier as well as policy from higher-level command from a small number of examples in a small amount of time with a simple interface. This paper presents the development of an information management engine that accomplishes…
Computer Networks and Communications · NASA Technical Reports Server (NASA) · · cited 0× · OpenAlex ↗ · more like this ·
Competitive pressures in the oil and gas industry are requiring a much tighter integration of technical data into E and P business processes. The development of new systems to accommodate this business need must comprehend the significant numbers of large, complex data objects which the industry generates. The life cycle of the data objects is a four phase progression from data acquisition, to data processing, through data interpretation, and ending finally with data archival. In order to implement a cost effect system which provides an efficient conversion from data to information and allows effective use of this information, an organization must consider the technical data management requirements in all four phases. A set of technical issues which may differ in each phase must be addressed to insure an overall successful development strategy. The technical issues include standardized…