arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Martin Herman

44 papers · 1980–2023

1980: 21981: 01982: 01983: 01984: 21985: 01986: 31987: 01988: 11989: 11990: 21991: 31992: 21993: 11994: 11995: 21996: 31997: 21998: 01999: 02000: 02001: 02002: 82003: 42004: 12005: 12006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 12014: 02015: 02016: 02017: 02018: 02019: 12020: 02021: 22022: 02023: 1
1980peak 8 in 20022023

Frequent co-authors

Papers

showing 1–25 of 44 RSS

Fast, three-dimensional, collision-free motion planning

Martin Herman

Computer Vision and Pattern Recognition · · cited 104× · DOI ↗ · more like this ·

Issues dealing with fast, 3-D, collision-free motion planning are discussed, and a fast path planning system under development at NBS is described. The components of a general motion planner are outlined, and some of their computational aspects are discussed. It is argued that an octree representation of the obstacles in the world leads to fast path planning algorithms. The system we are developing uses such an octree representation. The robot and its swept-volume paths are approximated by primitive shapes so as to result in fast collision detection algorithms. The search for a path is performed in the octree space, and combines hypothesize and test, hill climbing, and A.

Real-time obstacle avoidance using central flow divergence and peripheral flow

D. Coombs, Martin Herman, Tsai Hong Hong +1 more

Computer Vision and Pattern Recognition · · cited 103× · DOI ↗ · more like this ·

The lure of using motion vision as a fundamental element in the perception of space drives this effort to use flow features as the sole cues for robot mobility. Real-time estimates of image flow and flow divergence provide the robot's sense of space. The robot steers down a conceptual corridor comparing left and right peripheral flows. Large central flow divergence warns the robot of impending collisions at "dead ends." When this occurs, the robot turns around and resumes wandering. Behavior is generated by directly using flow-based information in the 2D image sequence; no 3D reconstruction is attempted. Active mechanical gate stabilization simplifies the visual interpretation problems by reducing camera rotation. By combining corridor following and dead-end deflection, the robot has wandered around the lab at 30 cm/s for as long as 20 minutes without collision. The ability to support…

Real-time single-workstation obstacle avoidance using only wide-field flow divergence

Ted Camus, David Coombs, Martin Herman +1 more

Computer Vision and Pattern Recognition · Zenodo (CERN European Organization for Nuclear Research) · · cited 74× · DOI ↗ · more like this ·

A real-time robot vision system is described which uses only the divergence of the optical flow field for both steering control and collision detection. The robot has wandered about the lab at 20 cm/s for as long as 26 minutes without collision. The entire system is implemented on a single ordinary UNIX workstation without the benefit of real-time operating system support. Dense optical flow data are calculated in real-time across the entire wide-angle image. The divergence of this optical flow field is calculated everywhere and used to control steering and collision behavior. Divergence alone has proven sufficient for steering past objects and detecting imminent collision. The major contribution is the demonstration of a simple, robust, minimal system that uses flow-derived measures to control steering and speed to avoid collision in real time for extended periods. Such a system can be…

Incremental Acquisition of a Three-Dimensional Scene Model from Images

Martin Herman, Takeo Kanade, Shigeru Kuroe

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 43× · DOI ↗ · more like this ·

We describe the current state of the 3-D Mosaic project, whose goal is to incrementally acquire a 3-D model of a complex urban scene from images. The notion of incremental acquisition arises from the observations that 1) single images contain only parfial information about a scene, 2) complex images are difficult to fully interpret, and 3) different features of a given scene tend to be easier to extract in different images because of differences in viewpoint and lighting conditions. In our approach, multiple images of the scene are sequentially analyzed so as to incrementaly construct the model. Each new image provides information which refines the model. We describe some experiments toward this end. Our method of extracting 3-D shape information from the images is stereo analysis. Because we are dealing with urban scenes, a junction-based matching technique proves very useful. This…

A new approach to vision and control for road following

Daniel Raviv, Martin Herman

Computer Vision and Pattern Recognition · · cited 37× · DOI ↗ · more like this ·

The paper deals with a new, quantitative, vision-based approach to road following. It is based on the theoretical framework of the recently developed optical flow-based visual field theory. By building on this theory, the authors suggest that motion commands can be generated from a visual feature, or cue, consisting of the projection into the image of the tangent point on the edge of the road, along with the optical flow of this point. Using this cue, they suggest several different vision-based control approaches. There are several advantages to using this visual cue: (1) it is extracted directly from the image, i.e. there is no need to reconstruct the scene, (2) it can be used in a tight perception-action loop to directly generate action commands, (3) for many road following situations this visual cue is sufficient, (4) it has a scientific basis, and (5) the related computations are…

Obstacle detection for a vehicle using optical flow

Gin-Shu Young, Tao Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 26× · DOI ↗ · more like this ·

A novel approach to obstacle detection using optical flow without recovering range information has been developed. This method can be used for ground vehicles to navigate through man-made roadways or natural outdoor terrain or for air vehicles to land on known or unknown terrain. A linear relationship, plotted as a line and called a reference flow line, has been found. This reference flow line can be used to detect discrete obstacles above or below the reference terrain. Slopes of surface regions are also computed. The approach is simple, fast, and robust because: (1) the only required information is one component of the optical flow, (2) each image line can be processed in parallel, and (3) the error sources involved are reduced to a minimum. An initial experiment using noisy synthetic data is also included to demonstrate the applicability and robustness of the method.< <ETX…

A unified approach to camera fixation and vision-based road following

Daniel Raviv, Martin Herman

Computer Vision and Pattern Recognition · IEEE Transactions on Systems Man and Cybernetics · · cited 26× · DOI ↗ · more like this ·

Both camera fixation and vision-based road following are problems that involve tracking or fixating on 3-D points and features. This paper presents a unified theoretical approach to analyzing camera fixation and vision-based road following. The approach is based on the concept of equal flow circles (EFCs) and zero flow circles (ZFCs). Using EFCs it is possible to locate points in space relative to the fixation point, and predict the behavior. The camera's instantaneous direction of translation and the fixation point determine the plane on which the EFCs can be found. We show that points on an EFC inside the ZFC produce optical flow that is opposite in sign to that produced by points outside the ZFC. When a point in space crosses a ZFC it produces zero flow. For explanation purposes we analyzed a special case of motion. However, a similar approach can be taken for a more general motion…

Towards an understanding of camera fixation

Daniel Raviv, Martin Herman

Computer Vision and Pattern Recognition · · cited 18× · DOI ↗ · more like this ·

A fixation point is a point in 3-D space that projects to zero optical flow in an image over some period of time while the camera is moving. Quantitative aspects of fixation for a static scene are treated. For the case where the rotation axis of the camera is perpendicular to the instantaneous translation vector, it is shown that there is an infinite number of points that produce zero instantaneous optical flow. These points lie on a circle (called the zero flow circle, or ZFC) and a line. The ZFC changes its location and radius as a function of time, and the intersection of all the ZFCs is a fixation point. Points inside the ZFC produce optical flow that is opposite in sign to those that are outside the ZFC. This fact explains in a more quantitative way phenomena due to fixation. In particular, points in the neighborhood of the fixation point may change the sign of their optical flow…

A generalized motion model for estimating optical flow using 3-D Hermite polynomials

Hongche Liu, Tsai-Hong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·

Classic optical flow algorithms assume local image translational motion and apply some primitive image smoothing. Recent studies have taken two separate approaches toward improving accuracy: the application of spatio-temporal filtering schemes and the use of generalized motion models such as the affine model. Each has achieved improvement in its specialized situations. We analyze the interdependency between them and propose a unified theory. The generalized motion we adopt models arbitrary 3D steady motion. Under perspective projection, we derive an image motion equation that describes the spatio-temporal relation in an image sequence, thus making 3D spatio-temporal filtering possible. Hence we establish a theory of Hermite polynomial differentiation filters, whose orthogonality and Gaussian derivative properties ensure numerical stability. The use of higher order motion constraint…

Comparing footwear impressions that are close non‐matches using correlation‐based approaches

Gautham Venkatasubramanian, Vighnesh Hegde, Sarala Padi +2 more

Computer Vision and Pattern Recognition · Journal of Forensic Sciences · · cited 14× · DOI ↗ · more like this ·

Forensic activities related to footwear evidence may be broadly classified into the following two categories: (1) intelligence gathering and (2) evidential value assessment. Intelligence gathering provides additional leads for investigators. Assessment of evidential value, as practiced in the United States, involves a trained footwear examiner evaluating the degree of similarity between a known shoe of interest (together with its test impressions) and footwear impressions obtained from a crime scene, by performing side-by-side visual comparisons. However, the need for developing quantitative approaches for expressing similarities during such comparisons is being increasingly recognized by the forensic science community. In this paper, we explore the ability of similarity metrics to discriminate between impressions made by a shoe of interest and impressions made by close non-matching…

Kinematic calibration of an active camera system

Gin-Shu Young, Tao Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

A technique for the calibration of an active camera system is presented. The calibration of manipulator, camera-to-manipulator, camera, and base-to-world is treated in a unified and elegant way. In this approach, the camera frames and manipulator link frames are all related to the world frame, therefore the camera-to-manipulator and base-to-world calibration is very straightforward. The approach is simple, since it uses the form of one equation solving one parameter. Two experiments that verify the accuracy of the technique are reported.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

New visual invariants for obstacle detection using optical flow induced from general motion

Gin-Shu Young, Tao Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

To operate autonomous vehicles safely, obstacles must be detected before any path planning and obstacle avoidance activity is undertaken. In the paper, a novel approach to obstacle detection is developed. New visual linear invariants based on optical flow have been developed. Employing the linear invariance property, obstacles an be directly detected by using a reference flow line obtained from measured optical flow. This method can be used for ground vehicles to navigate through man-made roadways or natural outdoor terrain or for air vehicles to land on known or unknown terrain.< <ETX xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">&gt;</ETX>

Quantitative evaluation of footwear evidence: Initial workflow for an end‐to‐end system

Gautham Venkatasubramanian, Vighnesh Hegde, Steven P. Lund +2 more

Artificial Intelligence · Journal of Forensic Sciences · · cited 8× · DOI ↗ · more like this ·

In the United States, footwear examiners make decisions about the sources of crime scene shoe impressions using subjective criteria. This has raised questions about the accuracy, repeatability, reproducibility, and scientific validity of footwear examinations. Currently, most footwear examiners follow a workflow that compares a questioned and test impression with regard to outsole design, size, wear, and randomly acquired characteristics (RACs). We augment this workflow with computer algorithms and statistical analysis so as to improve in the following areas: (1) quantifying the degree of correspondence between the questioned and test impressions with respect to design, size, wear, and RACs, (2) reducing the potential for cognitive bias, and (3) providing an empirical basis for examiner conclusions by developing a reference database of case-relevant pairs of impressions containing known…

Visual Servoing Using Relevant 2-D Image Cues

Daniel Raviv, Martin Herman

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

In this paper, the authors demonstrate how some visual servoing behaviors can be achieved using direct 2-D image cues (both spatial and temporal). These cues serve as inputs to the motion control algorithms. In such cases, an explicit reconstruction of the scene is not required. The advantages of this 2-D based approach are that it is simple, fast and robust. There is no need for 3-D reconstruction. It results in a tight perception-action loop to directly generate action commands from image cues.

Motion-model-based boundary extraction

Hongche Liu, Tsai-Hong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

Motion boundary extraction and optical flow computation are two subproblems of the motion recovery problem that cannot be solved independently of one another. We present a local, non-iterative algorithm that extracts motion boundaries and computes optical flow simultaneously. This is achieved by modeling a 3-D image intensity block with a general motion model that presumes locally coherent motion. Local motion coherence, which is measured by the fitness of the motion model, is the criterion we use to determine whether motion should be estimated. If not, then motion boundaries should be located. The motion boundary extraction algorithm is evaluated quantitatively and qualitatively against other existing algorithms in a scheme originally developed for edge detection.

&lt;title&gt;Safe navigation for autonomous vehicles: a purposive and direct solution&lt;/title&gt;

Gin-Shu Young, Tsai Hong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 7× · DOI ↗ · more like this ·

It is a challenge to develop autonomous vehicles capable of operating in complicated, unpredictable, and hazardous environments. To navigate autonomous vehicles safely, obstacles such as protrusions, depressions, and steep terrains must be discriminated from terrain before any path planning and obstacle avoidance activity is undertaken. A purposive and direct solution to obstacle detection for safe navigation has been developed. The method finds obstacles in a 2-D image-based space, as opposed to a 3-D reconstructed space, using optical flow. The theory derives from new visual linear invariants based on optical flow. Employing the linear invariance property, obstacles can be directly detected by using a reference flow line obtained from measured optical flow. The main features of this approach are that (1) 2-D visual information (i.e., optical flow) is directly used to detect obstacles…

Nonreconstruction approach for road following

Daniel Raviv, Martin Herman

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 7× · DOI ↗ · more like this ·

This paper presents a new approach for vision-based autonomous road following. By building on a recently developed optical-flow-based theory, we suggest that motion commands can be generated directly from a visual feature, or cue, consisting of the projection into the image of the tangent point on the edge of the road, along with the optical flow of this point. Using this visual cue, there is no need to reconstruct the 3-D scene, and the related computations are relatively simple. We suggest some vision-based partial control algorithms for both circular and non-circular roads.

Low data rate remote vehicle driving

Martin Herman, Karen Chaconas, Marilyn Nashman +1 more

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

Several algorithms that have been implemented as possible candidates for a hybrid video compression system to be used for remote driving of a ground vehicle are described. The algorithms have been implemented on the pipelined image processing engine (PIPE) real-time image processing machine. The PIPE has been integrated with a remote control vehicle system, and the algorithms were evaluated by means of real-world remote driving experiments. These experiments have shown that remote vehicle driving is difficult enough without degrading the imagery through compression algorithms. The degraded imagery makes driving even more difficult. The following difficulties were found in driving in cross country terrain using either the full video or the compressed video: global relative vehicle location is very difficult for the driver to obtain; the orientation of the local ground surface is very…

Spatio-temporal filters for transparent motion segmentation

Hongche Liu, Tsai-Hong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · Proceedings - International Conference on Image Processing · · cited 6× · DOI ↗ · more like this ·

An image is ideally a projection of the 3-D scene. However the imaging process is always imperfect and constrained by the physical environment, for example, viewing through a window with reflections. This paper is concerned with image sequences acquired in such situations, the so-called transparency. When it occurs, the image sequence contains undesirable transparent motion, for example, of the window reflections. This complicates the already difficult motion estimation problem. We present an algorithm to segment transparent motion based on a spatio-temporal filtering technique-3-D Hermite polynomial differentiation filters. With motion segmentation accomplished, we can then focus on the scene analysis. The implementation of our algorithm is fast and accurate.

RSTA on the Move: Detection and Tracking of Moving Objects from an Autonomous Mobile Platform.

Larry S. Davis, Carlos H. Morimoto, Martin Herman +2 more

Computer Vision and Pattern Recognition · · cited 6× · OpenAlex ↗ · more like this ·

This report describes progress made during the past year on the UGV RSTA project being conducted by a consortium led by the University of Maryland and including the University of Pennsylvania, the University of Rochester, and the National Institute of Standards and Technology. We first review work done on the design, implementation and integration of real time vision algorithms for image stabilization, detection of moving objects from a moving platform and camera control. We then present brief descriptions of a number of supporting basic research projects being conducted by the members of the consortium. 1 Introduction Our RSTA on the Move project is a program combining ffl development and integration activities ultimately leading to an experimental, real time active vision system for locating and tracking moving targets from a mobile platform, and ffl basic research on fundamental…

Image gradient evolution-a visual cue for collision avoidance

Hongche Liu, Tsai-Wong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · · cited 6× · DOI ↗ · more like this ·

This paper is concerned with the task of visual motion-based navigation. A critical requirement of the task is the ability to estimate 3D depth and motion from visual information. Recent studies have demonstrated that the relevant cues are contained in motion parallax or optical flow from which flow field divergence and hence time-to-contact can be extracted. We present a new concept called image gradient evolution, which utilizes the change of image spatial gradients over time as a threat cue; an approaching object induces 2D expanding motion and causes the image spatial structure to stretch so the image gradients decrease. Based on this idea, other method offers a one-step solution directly from image gradients, instead of optical flow and its derived properties. We use a technique that is local and linear so the implementation can be very fast. The threat map is expectedly noisy but…

Video Compression For Remote Vehicle Driving

Martin Herman, Karen Chaconas, Marily Nashman +1 more

Hardware and Architecture · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 6× · DOI ↗ · more like this ·

In order to effectively drive a remote ground vehicle using video images, the operator must be provided with a natural, real-time video sequence and the imagery must be accurate and detailed enough so that the operator can make mobility and survivability decisions. Unfortunately, high data rate communication channels are often not feasible for this task. To accomplish remote driving using a low data rate channel, video compression techniques must be incorporated. This paper discusses the remote vehicle driving problem and describes several video compression algorithms that have been implemented on PIPE, a real-time pipelined image processing machine. The paper then discusses how these algorithms are evaluated on real-world remote driving tests. Finally, advanced techniques for video compression are proposed.

&lt;title&gt;Real-time differential range estimation based on time-space imagery using PIPE&lt;/title&gt;

Ramesh M. Rangachar, Tsai Hong Hong, Martin Herman +2 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 5× · DOI ↗ · more like this ·

Image flow, the apparent motion of brightness patterns on the image plane, can provide important visual information such as distance, shape, surface orientation, and boundaries. It can be determined by either feature tracking or spatio-temporal analysis. We consider spatio-temporal methods, and show how differential range can be estimated from time-space imagery. We generate a time-space image by considering only one scan line of the image obtained from a camera moving in the horizontal direction at each time interval. At the next instant of time, we shift the previous line up by one pixel, and obtain another line from the image. We continue the procedure to obtain a time-space image, where each horizontal line represents the spatial relationship of the pixels, and each vertical line the temporal relationship. Each feature along the horizontal scan line generates an edge in the…

Application Of The PIPE Image Processing Machine To Scanning Microscopy

Martin Herman

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 5× · DOI ↗ · more like this ·

PIPE is a pipelined image processing device that was designed for real-time robot vision applications. It accepts images from a video camera 60 times per second, and contains hardware for digitizing, displaying, and performing operations on these images at video rates. Each stage of the pipeline contains arithmetic and logic units, convolvers, image buffers, and look-up tables. The purpose of this paper is to introduce PIPE and some of its applications to the scanning microscopy community. Three kinds of applications are described. The first is stereo analysis, whose purpose is to automatically extract range from two cameras mounted side by side. The second application is motion analysis and tracking. This application involves detecting motion, measuring its velocity, using it to obtain three-dimensional information, and tracking it through time. The final application is inspection of…

&lt;title&gt;Analysis of optical flow estimation using epipolar plane images&lt;/title&gt;

Ramesh M. Rangachar, Tsai Hong Hong, Martin Herman +1 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 4× · DOI ↗ · more like this ·

Image flow the apparent motion of brightness patterns on the image plane can provide important visual information such as distance shape surface orientation and boundaries. It can be determined by either feature tracking or spatio-temporal analysis. We consider spatio-temporal methods and show how differential range can be estimated from time-space imagery. We generate a time-space image by considering only one scan line of the image obtained from a camera moving in the horizontal direction at each time interval. At the next instant of time we shift the previous line up by one pixel and obtain another line from the image. We continue the procedure to obtain a time-space image where each horizontal line represents the spatial relationship of the pixels and each vertical line the temporal relationship. Each feature along the horizontal scan line generates an edge in the time-space image…