arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Billinghurst

568 papers · 1961–2026

1967: 01968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 11978: 01979: 01980: 01981: 01982: 01983: 01984: 01985: 01986: 01987: 01988: 01989: 01990: 01991: 01992: 01993: 01994: 01995: 01996: 51997: 51998: 51999: 32000: 42001: 122002: 202003: 132004: 72005: 212006: 232007: 182008: 332009: 102010: 112011: 92012: 162013: 292014: 212015: 222016: 252017: 342018: 282019: 362020: 252021: 282022: 322023: 302024: 192025: 122026: 9
1967peak 36 in 20192026

Frequent co-authors

Papers

showing 1–25 of 568 RSS

Marker tracking and HMD calibration for a video-based augmented reality conferencing system

Hirokazu Kato, Mark Billinghurst

Computer Vision and Pattern Recognition · · cited 2,201× · DOI ↗ · more like this ·

We describe an augmented reality conferencing system which uses the overlay of virtual images on the real world. Remote collaborators are represented on virtual monitors which can be freely positioned about a user in space. Users can collaboratively view and interact with virtual objects using a shared virtual whiteboard. This is possible through precise virtual image registration using fast and accurate computer vision techniques and head mounted display (HMD) calibration. We propose a method for tracking fiducial markers and a calibration method for optical see-through HMD based on the marker tracking.

A Survey of Augmented Reality

Mark Billinghurst, Adrian Clark, Gun Lee

Computer Vision and Pattern Recognition · Foundations and Trends® in Human–Computer Interaction · · cited 1,107× · DOI ↗ · more like this ·

This survey summarizes almost 50 years of research and development in the field of Augmented Reality (AR). From early research in the 1960’s until widespread availability by the 2010’s there has been steady progress towards the goal of being able to seamlessly combine real and virtual worlds. We provide an overview of the common definitions of AR, and show how AR fits into taxonomies of other related technologies. A history of important milestones in Augmented Reality is followed by sections on the key enabling technologies of tracking, display and input devices. We also review design guidelines and provide some examples of successful AR applications. Finally, we conclude with a summary of directions for future work and a review of some of the areas that are currently being researched.

Augmented Reality in the Classroom

Mark Billinghurst, Andreas Duenser

Computer Vision and Pattern Recognition · Computer · · cited 693× · DOI ↗ · more like this ·

Evaluations of AR experiences in an educational setting provide insights into how this technology can enhance traditional learning models and what obstacles stand in the way of its broader use. A related video can be seen here: http://youtu.be/ndUjLwcBIOw. It shows examples of augmented reality experiences in an educational setting.

Virtual object manipulation on a table-top AR environment

Hirokazu Kato, Mark Billinghurst, Ivan Poupyrev +2 more

Human-Computer Interaction · · cited 579× · DOI ↗ · more like this ·

We address the problems of virtual object interaction and user tracking in a table-top augmented reality (AR) interface. In this setting there is a need for very accurate tracking and registration techniques and an intuitive and useful interface. This is especially true in AR interfaces for supporting face to face collaboration where users need to be able to easily cooperate with each other. We describe an accurate vision-based tracking method for table-top AR environments and tangible user interface (TUI) techniques based on this method that allow users to manipulate virtual objects in a natural and intuitive manner. Our approach is robust, allowing users to cover some of the tracking markers while still returning camera viewpoint information, overcoming one of the limitations of traditional computer vision based systems. After describing this technique we describe its use in prototype…

Embodiment in conversational interfaces

Justine Cassell, Timothy Bickmore, Mark Billinghurst +4 more

Artificial Intelligence · · cited 561× · DOI ↗ · more like this ·

In this paper, we argue for embodied corrversational characters as the logical extension of the metaphor of human - computer interaction as a conversation. We argue that the only way to fully model the richness of human I&+ to-face communication is to rely on conversational analysis that describes sets of conversational behaviors as fi~lfilling conversational functions, both interactional and propositional. We demonstrate how to implement this approach in Rea, an embodied conversational agent that is capable of both multimodal input understanding and output generation in a limited application domain. Rea supports both social and task-oriented dialogue. We discuss issues that need to be addressed in creating embodied conversational agents, and describe the architecture of the Rea interface.

Mini-Me

Thammathip Piumsomboon, Gun Lee, Jonathon Derek Hart +4 more

Computer Vision and Pattern Recognition · · cited 350× · DOI ↗ · more like this ·

We present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures while it transforms in size and orientation to stay within the AR user's field of view. A user study was conducted to evaluate Mini-Me in two collaborative scenarios: an asymmetric remote expert in VR assisting a local worker in AR, and a symmetric collaboration in urban planning. We found that the presence of the Mini-Me significantly improved Social Presence and the overall experience of MR collaboration.

Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques

Ivan Poupyrev, T. Ichikawa, Suzanne Weghorst +1 more

Human-Computer Interaction · Computer Graphics Forum · · cited 341× · DOI ↗ · more like this ·

The acceptance of virtual environment (VE) technology requires scrupulous optimization of the most basic interactions in order to maximize user performance and provide efficient and enjoyable virtual interfaces. Motivated by insufficient understanding of the human factors design implications of interaction techniques and tools for virtual interfaces, this paper presents results of a formal study that compared two basic interaction metaphors for egocentric direct manipulation in VEs, virtual hand and virtual pointer, in object selection and positioning experiments. The goals of the study were to explore immersive direct manipulation interfaces, compare performance characteristics of interaction techniques based on the metaphors of interest, understand their relative strengths and weaknesses, and derive design guidelines for practical development of VE applications.

Pinpointing

Mikko Kytö, Barrett Ens, Thammathip Piumsomboon +2 more

Human-Computer Interaction · · cited 286× · DOI ↗ · more like this ·

Head and eye movement can be leveraged to improve the user's interaction repertoire for wearable displays. Head movements are deliberate and accurate, and provide the current state-of-the-art pointing technique. Eye gaze can potentially be faster and more ergonomic, but suffers from low accuracy due to calibration errors and drift of wearable eye-tracking sensors. This work investigates precise, multimodal selection techniques using head motion and eye gaze. A comparison of speed and pointing accuracy reveals the relative merits of each method, including the achievable target size for robust selection. We demonstrate and discuss example applications for augmented reality, including compact menus with deep structure, and a proof-of-concept method for on-line correction of calibration drift.

FingARtips

Volkert Buchmann, Stephen Violich, Mark Billinghurst +1 more

Computer Vision and Pattern Recognition · · cited 253× · DOI ↗ · more like this ·

This paper presents a technique for natural, fingertip-based interaction with virtual objects in Augmented Reality (AR) environments. We use image processing software and finger- and hand-based fiducial markers to track gestures from the user, stencil buffering to enable the user to see their fingers at all times, and fingertip-based haptic feedback devices to enable the user to feel virtual objects. Unlike previous AR interfaces, this approach allows users to interact with virtual content using natural hand gestures. The paper describes how these techniques were applied in an urban planning interface, and also presents preliminary informal usability results.

Face to face collaborative AR on mobile phones

Anders Henrysson, Mark Billinghurst, Mark Ollila

Computer Vision and Pattern Recognition · University of Canterbury Research Repository (University of Canterbury) · · cited 252× · DOI ↗ · more like this ·

Mobile phones are an ideal platform for augmented reality. We describe how they also can be used to support face to face collaborative AR applications. We have created a custom port of the ARToolKit library to the Symbian mobile phone operating system and then developed a sample collaborative AR game based on this. We describe the game in detail and user feedback from people who have played it. We also provide general design guidelines that could be useful for others who are developing mobile phone collaborative AR applications.

Wearable devices: new ways to manage information

Mark Billinghurst, Thad Starner

Computer Vision and Pattern Recognition · Computer · · cited 248× · DOI ↗ · more like this ·

Although the Information Age has many upsides, one of its major downsides is information overload. Indeed, the amount of information easily pushes the limit of what people can manage. This conflict drives research to seek a solution to humanity's information woes. As computers have shrunk from room size to palm size, so they have also moved from being passive accessories, such as laptops and personal digital assistants, to wearable appliances that form an integral part of our personal space. Wearable computers are always on and accessible. As the computer moves from desktop to coat pocket to the human body, its ability to help manage, sort, and filter information will become more intimately connected to our daily lives. The paper discusses the principles of wearable computers.

User-defined gestures for augmented reality

Thammathip Piumsomboon, Adrian Clark, Mark Billinghurst +1 more

Computer Vision and Pattern Recognition · University of Canterbury Research Repository (University of Canterbury) · · cited 232× · DOI ↗ · more like this ·

Recently there has been an increase in research of hand gestures for interaction in the area of Augmented Reality (AR). However this research has focused on developer designed gestures, and little is known about user preference and behavior for gestures in AR. In this paper, we present the results of a guessability study focused on hand gestures in AR. A total of 800 gestures have been elicited for 40 selected tasks from 20 partic-ipants. Using the agreement found among gestures, a user-defined gesture set was created to guide design-ers to achieve consistent user-centered gestures in AR.

A survey of evaluation techniques used in augmented reality studies

Andreas Dünser, Raphaël Grasset, Mark Billinghurst

Computer Vision and Pattern Recognition · · cited 230× · DOI ↗ · more like this ·

ABSTRACT In this paper we report on an initial survey of user evaluation techniques used in Augmented Reality (AR) research. To identify all papers which include AR evaluations we reviewed research publications between the years 1993 and 2007 from online databases of selected scientific publishers. Starting with a total of 6071 publications we filtered the articles in several steps which resulted in 165 AR related publications with user evaluations. These publications were classified in two different ways: according to the evaluation type used following an earlier literature survey classification scheme; and according to the evaluation methods or approach used. We present the results of out literature survey, provide a comprehensive list of references of the selected publications, and discuss some possible research opportunities for future work. Keywords: Augmented Reality, user…

A User Study on Mixed Reality Remote Collaboration with Eye Gaze and Hand Gesture Sharing

Huidong Bai, Prasanth Sasikumar, Jing Yang +1 more

Computer Vision and Pattern Recognition · · cited 207× · DOI ↗ · more like this ·

Supporting natural communication cues is critical for people to work together remotely and face-to-face. In this paper we present a Mixed Reality (MR) remote collaboration system that enables a local worker to share a live 3D panorama of his/her surroundings with a remote expert. The remote expert can also share task instructions back to the local worker using visual cues in addition to verbal communication. We conducted a user study to investigate how sharing augmented gaze and gesture cues from the remote expert to the local worker could affect the overall collaboration performance and user experience. We found that by combing gaze and gesture cues, our remote collaboration system could provide a significantly stronger sense of co-presence for both the local and remote users than using the gaze cue alone. The combined cues were also rated significantly higher than the gaze in terms of…

Exploring natural eye-gaze-based interaction for immersive virtual reality

Thammathip Piumsomboon, Gun Lee, Robert W. Lindeman +1 more

Human-Computer Interaction · UniSA Research Outputs Repository (University of South Australia) · · cited 206× · DOI ↗ · more like this ·

Eye tracking technology in a head-mounted display has undergone rapid advancement in recent years, making it possible for researchers to explore new interaction techniques using natural eye movements. This paper explores three novel eye-gaze-based interaction techniques: (1) Duo-Reticles, eye-gaze selection based on eye-gaze and inertial reticles, (2) Radial Pursuit, cluttered-object selection that takes advantage of smooth pursuit, and (3) Nod and Roll, head-gesture-based interaction based on the vestibulo-ocular reflex. In an initial user study, we compare each technique against a baseline condition in a scenario that demonstrates its strengths and weaknesses.

Immersive Authoring of Tangible Augmented Reality Applications

Gun Lee, Claudia Nelles, Mark Billinghurst +1 more

Computer Vision and Pattern Recognition · University of Canterbury Research Repository (University of Canterbury) · · cited 196× · DOI ↗ · more like this ·

In this paper, we suggest a new approach for authoring tangible augmented reality applications, called 'immersive authoring.' The approach allows the user to carry out the authoring tasks within the AR application being built, so that the development and testing of the application can be done concurrently throughout the development process. We describe the functionalities and the interaction design for the proposed authoring system that are specifically targeted for intuitive specification of scenes and various object behaviors. Several cases of applications developed using the authoring system are presented. A small pilot user study was conducted to compare the proposed method to a non-immersive approach, and the results have shown that the users generally found it easier and faster to carry out authoring tasks in the immersive environment.

The Effect of Avatar Appearance on Social Presence in an Augmented Reality Remote Collaboration

Boram Yoon, Hyung-il Kim, Gun Lee +2 more

Human-Computer Interaction · · cited 192× · DOI ↗ · more like this ·

This paper investigates the effect of avatar appearance on Social Presence and users' perception in an Augmented Reality (AR) telep-resence system. Despite the development of various commercial 3D telepresence systems, there has been little evaluation and discussions about the appearance of the collaborator's avatars. We conducted two user studies comparing the effect of avatar appearances with three levels of body part visibility (head & hands, upper body, and whole body) and two different character styles (realistic and cartoon-like) on Social Presence while performing two different remote collaboration tasks. We found that a realistic whole body avatar was perceived as being the best for remote collaboration, but an upper body or cartoon style could be considered as a substitute depending on the collaboration context. We discuss these results and suggest guidelines for designing…

The Effects of Sharing Awareness Cues in Collaborative Mixed Reality

Thammathip Piumsomboon, Arindam Dey, Barrett Ens +2 more

Human-Computer Interaction · Frontiers in Robotics and AI · · cited 189× · DOI ↗ · more like this ·

Augmented and Virtual Reality provide unique capabilities for Mixed Reality collaboration. This paper explores how different combinations of virtual awareness cues can provide users with valuable information about their collaborator’s attention and actions. In a user study (n=32, 16 pairs), we compared different combinations of three cues: Field-of-View (FoV) frustum, Eye-gaze ray, and Head-gaze ray against a baseline condition showing only virtual representations of each collaborator’s head and hands. Through a collaborative object finding and placing task, the results showed that awareness cues significantly improved user performance, usability, and subjective preferences, with the combination of the FoV frustum and the Head-gaze ray being best. This work establishes the feasibility of room-scale MR collaboration and the utility of providing virtual awareness cues.

Mixed Reality Remote Collaboration Combining 360 Video and 3D Reconstruction

Theophilus Teo, Louise Lawrence, Gun Lee +2 more

Human-Computer Interaction · · cited 185× · DOI ↗ · more like this ·

Remote Collaboration using Virtual Reality (VR) and Augmented Reality (AR) has recently become a popular way for people from different places to work together. Local workers can collaborate with remote helpers by sharing 360-degree live video or 3D virtual reconstruction of their surroundings. However, each of these techniques has benefits and drawbacks. In this paper we explore mixing 360 video and 3D reconstruction together for remote collaboration, by preserving benefits of both systems while reducing drawbacks of each. We developed a hybrid prototype and conducted user study to compare benefits and problems of using 360 or 3D alone to clarify the needs for mixing the two, and also to evaluate the prototype system. We found participants performed significantly better on collaborative search tasks in 360 and felt higher social presence, yet 3D also showed potential to complement.…

Do You See What I See? The Effect of Gaze Tracking on Task Space Remote Collaboration

Kunal Gupta, Gun Lee, Mark Billinghurst

Human-Computer Interaction · IEEE Transactions on Visualization and Computer Graphics · · cited 174× · DOI ↗ · more like this ·

We present results from research exploring the effect of sharing virtual gaze and pointing cues in a wearable interface for remote collaboration. A local worker wears a Head-mounted Camera, Eye-tracking camera and a Head-Mounted Display and shares video and virtual gaze information with a remote helper. The remote helper can provide feedback using a virtual pointer on the live video view. The prototype system was evaluated with a formal user study. Comparing four conditions, (1) NONE (no cue), (2) POINTER, (3) EYE-TRACKER and (4) BOTH (both pointer and eye-tracker cues), we observed that the task completion performance was best in the BOTH condition with a significant difference of POINTER and EYETRACKER individually. The use of eye-tracking and a pointer also significantly improved the co-presence felt between the users. We discuss the implications of this research and the limitations…

A framework and testbed for studying manipulation techniques for immersive VR

Ivan Poupyrev, Suzanne Weghorst, Mark Billinghurst +1 more

Human-Computer Interaction · · cited 171× · DOI ↗ · more like this ·

Developing virtual reality (VR) applications which enable actual work over a period of time requires optimization of the most basic interactions, such as object manipulation, so that the immersed participant can concentrate on higher-level tasks rather than on lowlevel motor activities. This paper presents a framework and experimental testbed for studies of VR object manipulation techniques. The framework provides a systematic task analysis of immersive manipulation and suggests a user-specific non-Euclidean system for the measurement of VR spatial relationships. The Virtual Reality Manipulation Assessment Testbed (VRMAT) is a practical implementation of the framework and is a flexible tool allowing in-depth experimental studies of immersive manipulation. Pilot studies have been conducted to evaluate this framework and testbed and to establish a baseline for further development.…

Augmenting the science centre and museum experience

Eric Woods, Mark Billinghurst, Julian Looser +4 more

Computer Vision and Pattern Recognition · University of Canterbury Research Repository (University of Canterbury) · · cited 158× · DOI ↗ · more like this ·

Recent advances in computer graphics and interactive techniques have increased the visual quality and flexibility of Augmented Reality (AR) applications. This, in turn has increased the viability of applying AR to educational exhibits for use in Science Centres, Museums, Libraries and other education centres. This article outlines a selection of five projects developed at the Human Interface Technology Laboratory in New Zealand (HIT Lab NZ) that have explored different techniques for applying AR to educational exhibits.These exhibits have received very positive feedback and appear to have educational benefits involving spatial, temporal and contextual conceptualisation and provide kinaesthetic, explorative and knowledge-challenging stimulus. The controls available to a user of turning a page, moving an AR marker, moving their head and moving a slider provide sufficient freedom to create…