arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Ronald Azuma

30 papers · 1990–2023

1990: 21991: 01992: 01993: 01994: 11995: 21996: 01997: 11998: 01999: 42000: 12001: 22002: 22003: 32004: 12005: 12006: 22007: 02008: 12009: 02010: 12011: 02012: 12013: 02014: 02015: 22016: 12017: 12018: 02019: 02020: 02021: 02022: 02023: 1
1990peak 4 in 19992023

Frequent co-authors

Papers

showing 1–25 of 30 RSS

A Survey of Augmented Reality

Ronald Azuma

Computer Vision and Pattern Recognition · PRESENCE Virtual and Augmented Reality · · cited 9,652× · DOI ↗ · more like this ·

This paper surveys the field of augmented reality (AR), in which 3D virtual objects are integrated into a 3D real environment in real time. It describes the medical, manufacturing, visualization, path planning, entertainment, and military applications that have been explored. This paper describes the characteristics of augmented reality systems, including a detailed discussion of the tradeoffs between optical and video blending approaches. Registration and sensing errors are two of the biggest problems in building effective augmented reality systems, so this paper summarizes current efforts to overcome these problems. Future directions and areas requiring further research are discussed. This survey provides a starting point for anyone interested in researching or using augmented reality.

Recent advances in augmented reality

Ronald Azuma, Yohan Baillot, Reinhold Behringer +3 more

Computer Vision and Pattern Recognition · IEEE Computer Graphics and Applications · · cited 4,121× · DOI ↗ · more like this ·

In 1997, Azuma published a survey on augmented reality (AR). Our goal is to complement, rather than replace, the original survey by presenting representative examples of the new advances. We refer one to the original survey for descriptions of potential applications (such as medical visualization, maintenance and repair of complex equipment, annotation, and path planning); summaries of AR system characteristics (such as the advantages and disadvantages of optical and video approaches to blending virtual and real, problems in display focus and contrast, and system portability); and an introduction to the crucial problem of registration, including sources of registration error and error-reduction strategies.

Improving static and dynamic registration in an optical see-through HMD

Ronald Azuma, Gary Bishop

Computer Vision and Pattern Recognition · · cited 389× · DOI ↗ · more like this ·

In Augmented Reality, see-through HMDs superimpose virtual 3D objects on the real world. This technology has the potential to enhance a user's perception and interaction with the real world. However, many Augmented Reality applications will not be accepted until we can accurately register virtual objects with their real counterparts. In previous systems, such registration was achieved only from a limited range of viewpoints, when the user kept his head still. This paper offers improved registration in two areas. First, our system demonstrates accurate static registration across a wide variety of viewing angles and positions. An optoelectronic tracker provides the required range and accuracy. Three calibration steps determine the viewing parameters. Second, dynamic errors that occur when the user moves his head are reduced by predicting future head locations. Inertial sensors mounted on…

Hybrid inertial and vision tracking for augmented reality registration

Suya You, Ulrich Neumann, Ronald Azuma

Computer Vision and Pattern Recognition · · cited 221× · DOI ↗ · more like this ·

The biggest single obstacle to building effective augmented reality (AR) systems is the lack of accurate wide-area sensors for trackers that report the locations and orientations of objects in an environment. Active (sensor-emitter) tracking technologies require powered-device installation. Limiting their use to prepared areas that are relatively free of natural or man-made interference sources. Vision-based systems can use passive landmarks, but they are more computationally demanding and often exhibit erroneous behavior due to occlusion or numerical instability. Inertial sensors are completely passive, requiring no external devices or targets, however, the drift rates in portable strapdown configurations are too great for practical use. In this paper, we present a hybrid approach to AR tracking that integrates inertial and vision-based technologies. We exploit the complementary nature…

Orientation tracking for outdoor augmented reality registration

Shuai You, Ulrich Neumann, Ronald Azuma

Computer Vision and Pattern Recognition · IEEE Computer Graphics and Applications · · cited 135× · DOI ↗ · more like this ·

Our work stems from a program focused on developing tracking technologies for wide-area augmented realities in unprepared outdoor environments. Other participants in the Defense Advanced Research Projects Agency (Darpa) funded Geospatial Registration of Information for Dismounted Soldiers (Grids) program included University of North Carolina at Chapel Hill and Raytheon. We describe a hybrid orientation tracking system combining inertial sensors and computer vision. We exploit the complementary nature of these two sensing technologies to compensate for their respective weaknesses. Our multiple-sensor fusion is novel in augmented reality tracking systems, and the results demonstrate its utility.

Evaluating label placement for augmented reality view management

Ronald Azuma, Chris Furmanski

Computer Vision and Pattern Recognition · International Symposium on Mixed and Augmented Reality · · cited 132× · DOI ↗ · more like this ·

View management, a relatively new area of research in Augmented Reality (AR) applications, is about the spatial layout of 2D virtual annotations in the view plane. This paper represents the first study in an actual AR application of a specific view management task: evaluating the placement of 2D virtual labels that identify information about real counterparts. Here, we objectively evaluated four different placement algorithms, including a novel algorithm for placement based on identifying existing clusters. The evaluation included both a statistical analysis of traditional metrics (e.g. counting overlaps) and an empirical user study guided by principles from human cognition. The numerical analysis of the three real-time algorithms revealed that our new cluster-based method recorded the best average placement accuracy while requiring only relatively moderate computation time. Measures of…

A motion-stabilized outdoor augmented reality system

Ronald Azuma, Bruce Hoff, H. Neely +1 more

Computer Vision and Pattern Recognition · · cited 127× · DOI ↗ · more like this ·

Almost all previous Augmented Reality (AR) systems work indoors. Outdoor AR systems offer the potential for new application areas. However, building an outdoor AR system is difficult due to portability constraints, the inability to modify the environment, and the greater range of operating conditions. We demonstrate a hybrid tracker that stabilizes an outdoor AR display with respect to user motion, achieving more accurate registration than previously shown in an outdoor AR system. The hybrid tracker combines rate gyros with a compass and tilt orientation sensor in a near real-time system. Sensor distortions and delays required compensation to achieve good results. The measurements from the two sensors are fused together to compensate for each other's limitations. From static locations with moderate head rotation rates, peak registration errors are /spl sim/2 degrees, with typical errors…

Augmented-reality visualizations guided by cognition: Perceptual heuristics for combining visible and obscured information

Chris Furmanski, Ronald Azuma, Mike Daily

Computer Vision and Pattern Recognition · · cited 122× · OpenAlex ↗ · more like this ·

One of the unique applications of Mixed and Augmented Reality (MR/AR) systems is that hidden and occluded objects can be readily visualized. We call this specialized use of MR/AR, Obscured Information Visualization (0I D. In this paper, we describe the beginning of a research program designed to develop such visualizations through the use of principles derived from perceptual psychology and cognitive science. In this paper we surveyed the cognitive science literature as it applies to such visualization tasks, described experimental questions derived from these cognitive principles, and generated general guidelines that can be used in designing future OIV systems (as well improving AR displays more generally). Here we also report the results from an experiment that utilized a functioning AR-OIV system: we found that in a relative depth judgment, subjects reported rendered objects as…

Predictive tracking for augmented reality

Ronald Azuma

Computer Vision and Pattern Recognition · · cited 113× · OpenAlex ↗ · more like this ·

Ronald Tadao Azuma. Predictive Tracking for Augmented Reality (Under the direction of T. Gary Bishop.) In Augmented Reality systems, see-through Head-Mounted Displays (HMDs) superimpose virtual three-dimensional objects on the real world. This technology has the potential to enhance a user's perception of and interaction with the real world. However, many Augmented Reality applications will not be accepted unless virtual objects are accurately registered with their real counterparts. Good registration is difficult, because of the high resolution of the human visual system and its sensitivity to small differences. Registration errors fall into two categories: static errors, which occur even when the user remains still, and dynamic errors caused by system delays when the user moves. Dynamic errors are usually the largest errors. This dissertation demonstrates that predicting…

The Most Important Challenge Facing Augmented Reality

Ronald Azuma

Computer Vision and Pattern Recognition · PRESENCE Virtual and Augmented Reality · · cited 99× · DOI ↗ · more like this ·

December 01 2016 The Most Important Challenge Facing Augmented Reality Ronald T. Azuma Ronald T. Azuma Principal Engineer and Research Manager Intel Labs Santa Clara, CA 95054 ronald.t.azuma@intel.com Search for other works by this author on: This Site Google Scholar Author and Article Information Ronald T. Azuma Principal Engineer and Research Manager Intel Labs Santa Clara, CA 95054 ronald.t.azuma@intel.com © 2016 by the Massachusetts Institute of Technology2016 Presence: Teleoperators and Virtual Environments (2016) 25 (3): 234–238. https://doi.org/10.1162/PRES_a_00264 Cite Icon Cite Permissions Share Icon Share Facebook Twitter LinkedIn MailTo Views Icon Views Article contents Figures & tables Video Audio Supplementary Data Peer Review Search Site Citation Ronald T. Azuma; The Most Important Challenge Facing Augmented Reality. Presence: Teleoperators and Virtual Environments 2016…

Making Augmented Reality a Reality

Ronald Azuma

Computer Vision and Pattern Recognition · · cited 90× · DOI ↗ · more like this ·

Augmented Reality has attracted interest for its potential as a platform for new compelling usages. This paper provides an overview of technical challenges in imaging and optics encountered in near-eye optical see-through AR display systems.

Overview of augmented reality

Ronald Azuma

Computer Vision and Pattern Recognition · · cited 66× · DOI ↗ · more like this ·

Article Share on Overview of augmented reality Author: Ronald Azuma Senior Research Staff Computer Scientist, Malibu, CA Senior Research Staff Computer Scientist, Malibu, CAView Profile Authors Info & Claims SIGGRAPH '04: ACM SIGGRAPH 2004 Course NotesAugust 2004 Pages 26–eshttps://doi.org/10.1145/1103900.1103926Online:08 August 2004Publication History 18citation5,873DownloadsMetricsTotal Citations18Total Downloads5,873Last 12 Months297Last 6 weeks22 Get Citation AlertsNew Citation Alert added!This alert has been successfully added and will be sent to:You will be notified whenever a record that you have chosen has been cited.To manage your alert preferences, click on the button below.Manage my AlertsNew Citation Alert!Please log in to your account Save to BinderSave to BinderCreate a New BinderNameCancelCreateExport CitationPublisher SiteGet Access

The Westwood Experience: Connecting story to locations via Mixed Reality

Jason Wither, Rebecca Allen, Vids Samanta +6 more

Computer Vision and Pattern Recognition · · cited 51× · DOI ↗ · more like this ·

The Westwood Experience is a location-based narrative using Mixed Reality effects to connect participants to unique and evocative real locations, bridging the gap between the real and story worlds. This paper describes the experience and a detailed evaluation of it. The experience itself centers around a narrative told by the “mayor” of Westwood. He tells a love story from his youth when he first came to Westwood, and intermixes the story with historical information. Most of this story is told on a mobile computer, using Mixed Reality and video for illustration. We evaluate the experience both quantitatively and qualitatively to find lessons learned about the experience itself and general guidelines for this type of experience. The analysis and guidelines from our evaluation are grouped into three categories: narration in mobile environments, social dynamics, and Mixed Reality effects.

Autocalibration of an electronic compass in an outdoor augmented reality system

Bruce Hoff, Ronald Azuma

Computer Vision and Pattern Recognition · · cited 45× · DOI ↗ · more like this ·

Accurate registration in an augmented reality system requires accurate trackers. An electronic compass can be a valuable sensor in an outdoor augmented reality system because it provides absolute heading estimates. However, compasses are vulnerable to distortion caused by environmental disturbances to Earth's magnetic field. These disturbances vary with geographic location and are not trivial to model. Static calibration methods exist but these require an explicit initial calibration step and do not adapt to changing distortion patterns. This paper describes in detail an autocalibration method that compensates for changing compass distortions. With minimal user input, it automatically measures and adjusts the calibration table used to correct the compass output. Autocalibration uses redundant heading information computed from rate gyroscopes. We demonstrate that autocalibration…

Augmented Reality: Approaches and Technical Challenges

Ronald T. Azuma

Computer Vision and Pattern Recognition · · cited 45× · DOI ↗ · more like this ·

Building an effective AR system is a difficult task and is an active area of research. This chapter describes, at a high level, the approaches that have been taken so far and the major challenges that system designers face. Section 2 surveys the characteristics of AR systems and the various possible configurations, along with the relative advantages and disadvantages of each. Currently, two of the biggest problems are in registration and sensing: the subjects of Sections 3 and 4. Finally, Section 5 suggests some topics for further work and research.

Making Augmented Reality Work Outdoors Requires Hybrid Tracking

Ronald T. Azuma, Bruce R. Hoff, Howard E. Neely Iii +9 more

Computer Vision and Pattern Recognition · · cited 35× · DOI ↗ · more like this ·

Developing Augmented Reality systems that work outdoors, rather than indoors in constrained environments, will open new application areas and motivate the construction of new, more general tracking approaches. Accurate tracking outdoors is difficult because we have little control over the environment and fewer resources available compared to an indoor application. This position paper examines the individual tracking technologies available and concludes that for the near term, a hybrid solution is the only viable approach. The distortion measured from an electronic compass and tilt sensor is discussed. 1.0 Motivation Several prototype Augmented Reality (AR) systems have demonstrated adequate performance to meet the needs of indoor applications, ranging from 2 medical visualization [State96] to aircraft manufacturing [Nash97] and even entertainment [Ohshima98]. However, few have attempted…

<title>Tracking a head-mounted display in a room-sized environment with head-mounted cameras</title>

Jih-fang Wang, Ronald Azuma, Gary Bishop +3 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 32× · DOI ↗ · more like this ·

This paper presents our efforts to accurately track a Head-Mounted Display (HMD) in a large environment. We review our current benchtop prototype (introduced in {WCF9O]), then describe our plans for building the full-scale system. Both systems use an inside-oui optical tracking scheme, where lateraleffect photodiodes mounted on the user's helmet view flashing infrared beacons placed in the environment. Church's method uses the measured 2D image positions and the known 3D beacon locations to recover the 3D position and orientation of the helmet in real-time. We discuss the implementation and performance of the benchtop prototype. The full-scale system design includes ceiling panels that hold the infrared beacons and a new sensor arrangement of two photodiodes with holographic lenses. In the full-scale system, the user can walk almost anywhere under the grid of ceiling panels, making the…

Performance analysis of an outdoor augmented reality tracking system that relies upon a few mobile beacons

Ronald Azuma, H. Neely, Mike Daily +1 more

Computer Vision and Pattern Recognition · · cited 26× · DOI ↗ · more like this ·

We describe and evaluate a new tracking concept for outdoor Augmented Reality. A few mobile beacons added to the environment correct errors in head-worn inertial and GPS sensors. We evaluate the accuracy through detailed simulation of many error sources. The most important parameters are the errors in measuring the beacon and user's head positions, and the geometric configuration of the beacons around the point to augment. Using Monte Carlo simulations, we identify combinations of beacon configurations and error parameters that meet a specified goal of 1 m net error at 100 m range.

Real-time Guidance Camera Interface to Enhance Photo Aesthetic Quality

Yan Xu, Joshua Ratcliff, James Scovell +2 more

Computer Vision and Pattern Recognition · · cited 21× · DOI ↗ · more like this ·

This paper explores whether it is effective to use real-time on-screen guidance to help users take better photos with mobile devices. Using a three-camera array, we developed a photo-taking interface that provides real-time feedback on how to position the subject-of-interest according to a photography composition rule: rule-of-thirds. We conduct a user study to compare the aesthetic quality of photos taken with our real-time guidance interface against a static gridline interface common to existing digital cameras. Expert photographers and Mechanical Turk workers rate the aesthetic quality of these pairs of photos. Results indicate the photos taken with our real-time guidance interface have significantly higher aesthetics scores. This study shows the potential in using camera array, computational photography, and real-time guidance interface to help non-expert users take better photos.

Visualization of conflicts and resolutions in a "Free Flight" scenario

Ronald Azuma, H. Neely, Mike Daily +1 more

Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·

"Free Flight" will change today's air traffic control system by giving pilots increased flexibility to choose and modify their routes in real time, reducing costs and increasing system capacity. This increased flexibility comes at the price of increased complexity. If Free Flight is to become a reality, future air traffic controllers, pilots, and airline managers will require new conflict detection, resolution and visualization decision support tools. The paper describes a testbed system for building and evaluating such tools, including its current capabilities, lessons we learned and feedback received from expert users. The visualization system provides an overall plan view supplemented with a detailed perspective view, allowing a user to examine highlighted conflicts and select from a list of proposed solutions, as the scenario runs in real time. Future steps needed to improve this…

The renaissance of VR

Carolina Cruz‐Neira, Margaret Dolinsky, Jaron Lanier +3 more

Human-Computer Interaction · · cited 4× · DOI ↗ · more like this ·

After being dormant in the public eye for more than 10 years, VR is now back to the front pages re-discovered as the portal to push the limits of our imagination towards compelling immersive experiences that can also blend with the physical world. Well-established companies and strongly backed new companies are committing serious investments into VR and its applications. This second VR wave is coming strong and fast in making VR accessible for the general public, not as the specialized technology for a few elite research labs of the 90s and early 2000s.

Visualization of conflicts and resolutions in a “free flight” scenario (case study)

Ronald Azuma, H. Neely, Mike Daily +1 more

Computer Vision and Pattern Recognition · IEEE Visualization · · cited 2× · DOI ↗ · more like this ·

“Free Flight” will change today's air traffic control system by giving pilots increased flexibility to choose and modify their routes in real time, reducing costs and increasing system capacity. This increased flexibility comes at the price of increased complexity. If Free Flight is to become a reality, future air traffic controllers, pilots, and airline managers will require new conflict detection, resolution and visualization decision support tools. This paper describes a testbed system for building and evaluating such tools, including its current capabilities, lessons we learned, and feedback received from expert users. The visualization system provides an overall plan view supplemented with a detailed perspective view, allowing a user to examine highlighted conflicts and select from a list of proposed solutions, as the scenario runs in real time. Future steps needed to improve this…

INV: Towards Streaming Incremental Neural Videos

Shengze Wang, Alexey Supikov, Joshua Ratcliff +2 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Recent works in spatiotemporal radiance fields can produce photorealistic free-viewpoint videos. However, they are inherently unsuitable for interactive streaming scenarios (e.g. video conferencing, telepresence) because have an inevitable lag even if the training is instantaneous. This is because these approaches consume videos and thus have to buffer chunks of frames (often seconds) before processing. In this work, we take a step towards interactive streaming via a frame-by-frame approach naturally free of lag. Conventional wisdom believes that per-frame NeRFs are impractical due to prohibitive training costs and storage. We break this belief by introducing Incremental Neural Videos (INV), a per-frame NeRF that is efficiently trained and streamable. We designed INV based on two insights: (1) Our main finding is that MLPs naturally partition themselves into Structure and Color Layers…

Chamber of Mirrors: A Socially Activated Game Exploits Pervasive Technology

Mathew Laibowitz, Vids Samanta, Syed Mubarak Ali +1 more

Human-Computer Interaction · IEEE Pervasive Computing · · cited 1× · DOI ↗ · more like this ·

Chamber of Mirrors offers a socially activated gaming experience built on a custom platform of interactive pervasive technologies. The authors review user tests and present techniques for overcoming the challenges of designing interactive applications for pervasive platforms.