arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Henry Fuchs

200 papers · 1948–2026

1967: 01968: 01969: 01970: 01971: 01972: 01973: 01974: 01975: 01976: 01977: 21978: 11979: 41980: 11981: 01982: 01983: 21984: 11985: 51986: 61987: 21988: 11989: 71990: 41991: 11992: 51993: 11994: 91995: 41996: 61997: 51998: 51999: 42000: 32001: 22002: 162003: 22004: 22005: 72006: 32007: 82008: 122009: 52010: 12011: 42012: 52013: 62014: 52015: 12016: 22017: 62018: 12019: 42020: 42021: 42022: 62023: 52024: 52025: 32026: 1
1967peak 16 in 20022026

Frequent co-authors

Papers

showing 1–25 of 200 RSS

The office of the future

Ramesh Raskar, Greg Welch, Matt Cutts +3 more

Computer Graphics and Computer-Aided Design · · cited 833× · DOI ↗ · more like this ·

We introduce ideas, proposed technologies, and initial results for an office of the future that is based on a unified application of computer vision and computer graphics in a system that combines and builds upon the notions of the CAVE, tiled display systems, and image-based modeling . The basic idea is to use real-time computer vision techniques to dynamically extract per-pixel depth and reflectance information for the visible surfaces in the office including walls, furniture, objects, and people, and then to either project images on the surfaces, render images of the surfaces , or interpret changes in the surfaces. In the first case, one could designate every-day (potentially irregular) real surfaces in the office to be used as spatially immersive display surfaces, and then project high-resolution graphics and text onto those surfaces. In the second case, one could transmit the…

Optimal surface reconstruction from planar contours

Henry Fuchs, Zvi M. Kedem, Samuel P. Uselton

Computer Vision and Pattern Recognition · Communications of the ACM · · cited 795× · DOI ↗ · more like this ·

In many scientific and technical endeavors, a three-dimensional solid must be reconstructed from serial sections, either to aid in the comprehension of the object's structure or to facilitate its automatic manipulation and analysis. This paper presents a general solution to the problem of constructing a surface over a set of cross-sectional contours. This surface, to be composed of triangular tiles, is constructed by separately determining an optimal surface between each pair of consecutive contours. Determining such a surface is reduced to the problem of finding certain minimum cost cycles in a directed toroidal graph. A new fast algorithm for finding such cycles is utilized. Also developed is a closed-form expression, in terms of the number of contour points, for an upper bound on the number of operations required to execute the algorithm. An illustrated example which involves the…

On visible surface generation by a priori tree structures

Henry Fuchs, Zvi M. Kedem, Bruce Naylor

Computer Graphics and Computer-Aided Design · · cited 698× · DOI ↗ · more like this ·

This paper describes a new algorithm for solving the hidden surface (or line) problem, to more rapidly generate realistic images of 3-D scenes composed of polygons, and presents the development of theoretical foundations in the area as well as additional related algorithms. As in many applications the environment to be displayed consists of polygons many of whose relative geometric relations are static, we attempt to capitalize on this by preprocessing the environment's database so as to decrease the run-time computations required to generate a scene. This preprocessing is based on generating a “binary space partitioning” tree whose in order traversal of visibility priority at run-time will produce a linear order, dependent upon the viewing position, on (parts of) the polygons, which can then be used to easily solve the hidden surface problem. In the application where the entire…

A sorting classification of parallel rendering

Stephen Molnar, Michael Cox, David Ellsworth +1 more

Computer Graphics and Computer-Aided Design · IEEE Computer Graphics and Applications · · cited 549× · DOI ↗ · more like this ·

We describe a classification scheme that we believe provides a more structured framework for reasoning about parallel rendering. The scheme is based on where the sort from object coordinates to screen coordinates occurs, which we believe is fundamental whenever both geometry processing and rasterization are performed in parallel. This classification scheme supports the analysis of computational and communication costs, and encompasses the bulk of current and proposed highly parallel renderers - both hardware and software. We begin by reviewing the standard feed-forward rendering pipeline, showing how different ways of parallelizing it lead to three classes of rendering algorithms. Next, we consider each of these classes in detail, analyzing their aggregate processing and communication costs, possible variations, and constraints they may impose on rendering applications. Finally, we use…

Merging virtual objects with the real world

Michael Bajura, Henry Fuchs, Ryutarou Ohbuchi

Computer Graphics and Computer-Aided Design · · cited 518× · DOI ↗ · more like this ·

article Free Access Share on Merging virtual objects with the real world: seeing ultrasound imagery within the patient Authors: Michael Bajura Department of Computer Science, University of North Carolina, Chapel Hill, NC Department of Computer Science, University of North Carolina, Chapel Hill, NCView Profile , Henry Fuchs Department of Computer Science, University of North Carolina, Chapel Hill, NC Department of Computer Science, University of North Carolina, Chapel Hill, NCView Profile , Ryutarou Ohbuchi Department of Computer Science, University of North Carolina, Chapel Hill, NC Department of Computer Science, University of North Carolina, Chapel Hill, NCView Profile Authors Info & Claims ACM SIGGRAPH Computer GraphicsVolume 26Issue 2July 1992 pp 203–210https://doi.org/10.1145/142920.134061Online:01 July 1992Publication History 373citation3,162DownloadsMetricsTotal Citations373Total…

Optical Versus Video See-Through Head-Mounted Displays in Medical Visualization

Jannick P. Rolland, Henry Fuchs

Human-Computer Interaction · PRESENCE Virtual and Augmented Reality · · cited 337× · DOI ↗ · more like this ·

We compare two technological approaches to augmented reality for 3-D medical visualization: optical and video see-through devices. We provide a context to discuss the technology by reviewing several medical applications of augmented-reality re search efforts driven by real needs in the medical field, both in the United States and in Europe. We then discuss the issues for each approach, optical versus video, from both a technology and human-factor point of view. Finally, we point to potentially promising future developments of such devices including eye tracking and multifocus planes capabilities, as well as hybrid optical/video technology.

Pixel-planes 5: a heterogeneous multiprocessor graphics system using processor-enhanced memories

Henry Fuchs, John W. Poulton, John Eyles +7 more

Computer Graphics and Computer-Aided Design · · cited 321× · DOI ↗ · more like this ·

This paper introduces the architecture and initial algorithms for Pixel-Planes 5, a heterogeneous multi-computer designed both for high-speed polygon and sphere rendering (1M Phong-shaded triangles/second) and for supporting algorithm and application research in interactive 3D graphics. Techniques are described for volume rendering at multiple frames per second, font generation directly from conic spline descriptions, and rapid calculation of radiosity form-factors. The hardware consists of up to 32 math-oriented processors, up to 16 rendering units, and a conventional 1280 × 1024-pixel frame buffer, interconnected by a 5 gigabit ring network. Each rendering unit consists of a 128 × 128-pixel array of processors-with-memory with parallel quadratic expression evaluation for every pixel. Implemented on 1.6 micron CMOS chips designed to run at 40MHz, this array has 208…

Multi-Projector Displays Using Camera-Based Registration

Ramesh Raskar, Michael Brown, Ruigang Yang +6 more

Human-Computer Interaction · · cited 258× · OpenAlex ↗ · more like this ·

Conventional projector-based display systems are typically designed around precise and regular configurations of projectors and display surfaces. While this results in rendering simplicity and speed, it also means painstaking construction and ongoing maintenance. In previously published work, we introduced a vision of projector-based displays constructed from a collection of casually-arranged projectors and display surfaces. In this paper, we present flexible yet practical methods for realizing this vision, enabling low-cost mega-pixel display systems with large physical dimensions, higher resolution, or both. The techniques a#ord new opportunities to build personal 3D visualization systems in o#ces, conference rooms, theaters, or even your living room. As a demonstration of the simplicity and e#ectiveness of the methods that we continue to perfect, we show in the included video that a…

Technologies for augmented reality systems

Andrei State, Mark Livingston, William F. Garrett +4 more

Computer Vision and Pattern Recognition · · cited 246× · DOI ↗ · more like this ·

We present a real-time stereoscopic video-see-through augmented reality (AR) system applied to the medical procedure known as ultrasound-guided needle biopsy of the breast. The AR system was used by a physician during procedures on breast models and during non-invasive examinations of human subjects. The system merges rendered live ultrasound data and geometric elements with stereo images of the patient acquired through head-mounted video cameras and presents these merged images to the physician in a head-mounted display. The physician sees a volume visualization of the ultrasound data directly under the ultrasound probe, properly registered within the patient and with the biopsy needle. Using this system, a physician successfully guided a needle into an artificial tumor within a training phantom of a human breast.

Neural Human Performer: Learning Generalizable Radiance Fields for Human Performance Rendering

Youngjoong Kwon, Dahun Kim, Duygu Ceylan +1 more

cs.CV · · cited 224× · arXiv ↗ · more like this ·

In this paper, we aim at synthesizing a free-viewpoint video of an arbitrary human performance using sparse multi-view cameras. Recently, several works have addressed this problem by learning person-specific neural radiance fields (NeRF) to capture the appearance of a particular human. In parallel, some work proposed to use pixel-aligned features to generalize radiance fields to arbitrary new scenes and objects. Adopting such generalization approaches to humans, however, is highly challenging due to the heavy occlusions and dynamic articulations of body parts. To tackle this, we propose Neural Human Performer, a novel approach that learns generalizable neural radiance fields based on a parametric human body model for robust performance capture. Specifically, we first introduce a temporal transformer that aggregates tracked visual features based on the skeletal body motion over time.…

Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras

Andrew Maimone, Henry Fuchs

Computer Vision and Pattern Recognition · · cited 201× · DOI ↗ · more like this ·

This paper introduces a proof-of-concept telepresence system that offers fully dynamic, real-time 3D scene capture and continuous-viewpoint, head-tracked stereo 3D display without requiring the user to wear any tracking or viewing apparatus. We present a complete software and hardware framework for implementing the system, which is based on an array of commodity Microsoft Kinect™color-plus-depth cameras. Novel contributions include an algorithm for merging data between multiple depth cameras and techniques for automatic color calibration and preserving stereo quality even with low rendering rates. Also presented is a solution to the problem of interference that occurs between Kinect cameras with overlapping views. Emphasis is placed on a fully GPU-accelerated data processing and rendering pipeline that can apply hole filling, smoothing, data merger, surface generation, and color…

Fast spheres, shadows, textures, transparencies, and imgage enhancements in pixel-planes

Henry Fuchs, Jack Goldfeather, Jeff P. Hultquist +5 more

Computer Vision and Pattern Recognition · ACM SIGGRAPH Computer Graphics · · cited 194× · DOI ↗ · more like this ·

Pixel-planes is a logic-enhanced memory system for raster graphics and imaging. Although each pixel-memory is enhanced with a one-bit ALU, the system's real power comes from a tree of one-bit adders that can evaluate linear expressions Ax+By+C for every pixel (x,y) simultaneously, as fast as the ALUs and the memory circuits can accept the results. We and others have begun to develop a variety of algorithms that exploit this fast linear expression evaluation capability. In this paper we report some of those results. Illustrated in this paper is a sample image from a small working prototype of the Pixel-planes hardware and a variety of images from simulations of a full-scale system. Timing estimates indicate that 30,000 smooth shaded triangles can be generated per second, or 21,000 smooth-shaded and shadowed triangles can be generated per second, or over 25,000 shaded spheres can be…

Dynamic shader lamps : painting on movable objects

Deepak Bandyopadhyay, Ramesh Raskar, Henry Fuchs

Computer Vision and Pattern Recognition · · cited 183× · DOI ↗ · more like this ·

The authors present a Dynamic Spatially Augmented Reality system for augmenting movable 3D objects in an indoor environment using multiple projectors. We describe a real-time system for applying virtual paint and textures to real objects simply by direct physical manipulation of the object and a "paint brush" stylus. We track the objects and the "paint brush", and illuminate the objects with images that remain registered as they move, to create the illusion of material properties. The system is simple to use and we hope it may herald new applications in diverse fields such as visualization, tele-immersion, art and architecture. The system currently works with tracked objects whose geometry was pre-acquired and models created manually, but it is possible to extend it by adding cameras to the environment, to acquire object geometry automatically and use vision-based tracking for the…

Conveying the 3D shape of smoothly curving transparent surfaces via texture

Victoria Interrante, Henry Fuchs, Stephen M. Pizer

Computer Graphics and Computer-Aided Design · IEEE Transactions on Visualization and Computer Graphics · · cited 159× · DOI ↗ · more like this ·

Transparency can be a useful device for depicting multiple overlapping surfaces in a single image. The challenge is to render the transparent surfaces in such a way that their 3D shape can be readily understood and their depth distance from underlying structures clearly perceived. This paper describes our investigations into the use of sparsely-distributed discrete, opaque texture as an artistic device for more explicitly indicating the relative depth of a transparent surface and for communicating the essential features of its 3D shape in an intuitively meaningful and minimally occluding way. The driving application for this work is the visualization of layered surfaces in radiation therapy treatment planning data, and the technique is illustrated on transparent isointensity surfaces of radiation dose. We describe the perceptual motivation and artistic inspiration for defining a stroke…

Evaluation of Reorientation Techniques and Distractors for Walking in Large Virtual Environments

T.C. Peck, Henry Fuchs, M.C. Whitton

Human-Computer Interaction · IEEE Transactions on Visualization and Computer Graphics · · cited 150× · DOI ↗ · more like this ·

Virtual Environments (VEs) that use a real-walking locomotion interface have typically been restricted in size to the area of the tracked lab space. Techniques proposed to lift this size constraint, enabling real walking in VEs that are larger than the tracked lab space, all require reorientation techniques (ROTs) in the worst-case situation-when a user is close to walking out of the tracked space. We propose a new ROT using visual and audial distractors-objects in the VE that the user focuses on while the VE rotates-and compare our method to current ROTs through three user studies. ROTs using distractors were preferred and ranked more natural by users. Our findings also suggest that improving visual realism and adding sound increased a user's feeling of presence. Users were also less aware of the rotating VE when ROTs with distractors were used. Our findings also suggest that improving…

<title>Comparison of optical and video see-through, head-mounted displays</title>

Jannick P. Rolland, Richard L. Holloway, Henry Fuchs

Human-Computer Interaction · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 143× · DOI ↗ · more like this ·

One of the most promising and challenging future uses of head-mounted displays (HMDs) is in applications where virtual environments enhance rather than replace real environments. To obtain an enhanced view of the real environment, the user wears a see-through HMD to see 3D computer-generated objects superimposed on his/her real-world view. This see-through capability can be accomplished using either an optical or a video see-through HMD. We discuss the tradeoffs between optical and video see-through HMDs with respect to technological, perceptual, and human factors issues, and discuss our experience designing, building, using, and testing these HMDs.

Near real-time shaded display of rigid objects

Henry Fuchs, Gregory Abram, Eric Grant

Computer Graphics and Computer-Aided Design · · cited 132× · DOI ↗ · more like this ·

Described is a visible surface algorithm and an implementation that generates shaded display of objects with hundreds of polygons rapidly enough for interactive use — several images per second. The basic algorithm, introduced in [Fuchs, Kedem and Naylor, 1980], is designed to handle rigid objects and scenes by preprocessing the object data base to minimize visibility computation cost. The speed of the algorithm is further enhanced by its simplicity, which allows it to be implemented within the internal graphics processor of a general purpose raster system.

Combining passive haptics with redirected walking

Luv Kohli, Eric Burns, Dorian Miller +1 more

Human-Computer Interaction · · cited 122× · DOI ↗ · more like this ·

Two large problems faced by virtual environment designers are lack of haptic feedback and constraints imposed by limited tracker space. Passive haptic feedback has been used effectively to provide a sense of touch to users (Insko, et al., 2001). Redirected walking is a promising solution to the problem of limited tracker space (Razzaque, et al., 2001). However, these solutions to these two problems are typically mutually exclusive because their requirements conflict with one another. We introduce a method by which they can be combined to address both problems simultaneously.

Enhancing transparent skin surfaces with ridge and valley lines

Victoria Interrante, Henry Fuchs, Stephen M. Pizer

Computer Graphics and Computer-Aided Design · IEEE Visualization · · cited 121× · DOI ↗ · more like this ·

There are many applications that can benefit from the simultaneous display of multiple layers of data. The objective in these cases is to render the layered surfaces in such a way that the outer structures can be seen and seen through at the same time. This paper focuses on the particular application of radiation therapy treatment planning, in which physicians need to understand the three-dimensional distribution of radiation dose in the context of patient anatomy. We describe a promising technique for communicating the shape and position of the transparent skin surface while at the same time minimally occluding underlying isointensity dose surfaces and anatomical objects: adding a sparse, opaque texture comprised of a small set of carefully-chosen lines. We explain the perceptual motivation for explicitly drawing ridge and valley curves on a transparent surface, describe…

StereoDRNet: Dilated Residual Stereo Net

Rohan Chabra, Julian Straub, Chris Sweeney +2 more

cs.CV · · cited 120× · arXiv ↗ · more like this ·

We propose a system that uses a convolution neural network (CNN) to estimate depth from a stereo pair followed by volumetric fusion of the predicted depth maps to produce a 3D reconstruction of a scene. Our proposed depth refinement architecture, predicts view-consistent disparity and occlusion maps that helps the fusion system to produce geometrically consistent reconstructions. We utilize 3D dilated convolutions in our proposed cost filtering network that yields better filtering while almost halving the computational cost in comparison to state of the art cost filtering architectures.For feature extraction we use the Vortex Pooling architecture. The proposed method achieves state of the art results in KITTI 2012, KITTI 2015 and ETH 3D stereo benchmarks. Finally, we demonstrate that our system is able to produce high fidelity 3D scene reconstructions that outperforms the state of the…

Image rendering by adaptive refinement

Larry Bergman, Henry Fuchs, Eric Grant +1 more

Computer Graphics and Computer-Aided Design · ACM SIGGRAPH Computer Graphics · · cited 115× · DOI ↗ · more like this ·

This paper describes techniques for improving the performance of image rendering on personal workstations by using CPU cycles going idle while the user is examining a static image on the screen. In that spirit, we believe that a renderer's work is never done . Our goal is to convey the most information to the user as early as possible, with image quality constantly improving with time. We do this by first generating a crude image rapidly and then adaptively refining it where necessary as long as the user does not change viewing parameters. The renderer operates in a succession of phases, first displaying only vertices of polygons, next polygon edges, then flat shading polygons, then shadowing polygons, then Gouraud shading polygons, then Phong shading polygons, and finally anti-aliasing. Performance is enhanced by each phase using results from previous phases and trimming the amount of…

An evaluation of navigational ability comparing Redirected Free Exploration with Distractors to Walking-in-Place and joystick locomotio interfaces

Tabitha C. Peck, Henry Fuchs, Mary C. Whitton

Human-Computer Interaction · PubMed · · cited 113× · DOI ↗ · more like this ·

We report on a user study evaluating Redirected Free Exploration with Distractors (RFED), a large-scale, real-walking, locomotion interface, by comparing it to Walking-in-Place (WIP) and Joystick (JS), two common locomotion interfaces. The between-subjects study compared navigation ability in RFED, WIP, and JS interfaces in VEs that are more than two times the dimensions of the tracked space. The interfaces were evaluated based on navigation and wayfinding metrics and results suggest that participants using RFED were significantly better at navigating and wayfinding through virtual mazes than participants using walking-in-place and joystick interfaces. Participants traveled shorter distances, made fewer wrong turns, pointed to hidden targets more accurately and more quickly, and were able to place and label targets on maps more accurately. Moreover, RFED participants were able to more…

Interactive visualization of 3D medical data

Henry Fuchs, Marc Levoy, Stephen M. Pizer

Computer Graphics and Computer-Aided Design · Computer · · cited 109× · DOI ↗ · more like this ·

Techniques for rendering 3-D medical data are described. They consist of (1) surface-based techniques, which apply a surface detector to the sample array, then fit geometric primitives to the detected surfaces, and finally render the resulting geometric representation; (2) binary voxel techniques, which begin by thresholding the volume data to produce a three-dimensional binary array; the cuberille algorithm then renders this array by treating 1's as opaque cubes having six polygonal faces; and (3) volume-rendering techniques, a variant of the binary voxel techniques in which a color and a partial opacity are assigned to each voxel; images are formed from the resulting colored, semitransparent volume by blending together voxels projecting to the same pixel on the picture plane. Specialized display devices (stereo viewers, varifocal mirrors, cine sequences, real-time image-generation…

Reducing interference between multiple structured light depth sensors using motion

Andrew Maimone, Henry Fuchs

Computer Vision and Pattern Recognition · · cited 108× · DOI ↗ · more like this ·

We present a method for reducing interference between multiple structured light-based depth sensors operating in the same spectrum with rigidly attached projectors and cameras. A small amount of motion is applied to a subset of the sensors so that each unit sees its own projected pattern sharply, but sees a blurred version of the patterns of other units. If high spacial frequency patterns are used, each sensor sees its own pattern with higher contrast than the patterns of other units, resulting in simplified pattern disambiguation. An analysis of this method is presented for a group of commodity Microsoft Kinect color-plus-depth sensors with overlapping views. We demonstrate that applying a small vibration with a simple motor to a subset of the Kinect sensors results in reduced interference, as manifested as holes and noise in the depth maps. Using an array of six Kinects, our system…

Frameless rendering

Gary Bishop, Henry Fuchs, Leonard McMillan +1 more

Computer Graphics and Computer-Aided Design · · cited 106× · DOI ↗ · more like this ·

The use of double-buffered displays, in which the previous image is displayed until the next image is complete, can impair the interactivity of systems that require tight coupling between the human user and the computer. We are experimenting with an alternate rendering strategy that computes each pixel based on the most recent input (i.e., view and object positions) and immediately updates the pixel on the display. We avoid the image tearing normally associated with single-buffered displays by randomizing the order in which pixels are updated. The resulting image sequences give the impression of moving continuously, with a rough approximation of motion blur, rather than jerking between discrete positions.