arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Sebastian Handrich

14 papers · 2009–2021

2009: 12010: 12011: 02012: 12013: 22014: 02015: 02016: 12017: 42018: 12019: 22020: 02021: 1
2009peak 4 in 20172021

Frequent co-authors

Papers

showing 1–14 of 14 RSS

Face Attribute Detection with MobileNetV2 and NasNet-Mobile

Frerk Saxen, Philipp Werner, Sebastian Handrich +3 more

Computer Vision and Pattern Recognition · · cited 98× · DOI ↗ · more like this ·

In this paper, we propose two simple yet effective methods to estimate facial attributes in unconstrained images. We use a straight forward and fast face alignment technique for preprocessing and estimate the face attributes using MobileNetV2 and Nasnet-Mobile, two lightweight CNN (Convolutional Neural Network) architectures. Both architectures perform similarly well in terms of accuracy and speed. A comparison with state-of-the-art methods with respect to processing time and accuracy shows that our proposed approach perform faster than the best state-of-the-art model and better than the fastest state-of-the-art model. Moreover, our approach is easy to use and capable of being deployed on mobile devices.

A Baseline for Cross-Database 3D Human Pose Estimation

Michał Rapczyński, Philipp Werner, Sebastian Handrich +1 more

Computer Vision and Pattern Recognition · Sensors · · cited 23× · DOI ↗ · more like this ·

Vision-based 3D human pose estimation approaches are typically evaluated on datasets that are limited in diversity regarding many factors, e.g., subjects, poses, cameras, and lighting. However, for real-life applications, it would be desirable to create systems that work under arbitrary conditions ("in-the-wild"). To advance towards this goal, we investigated the commonly used datasets HumanEva-I, Human3.6M, and Panoptic Studio, discussed their biases (that is, their limitations in diversity), and illustrated them in cross-database experiments (for which we used a surrogate for roughly estimating in-the-wild performance). For this purpose, we first harmonized the differing skeleton joint definitions of the datasets, reducing the biases and systematic test errors in cross-database experiments. We further proposed a scale normalization method that significantly improved generalization…

A Robust Method for Human Pose Estimation Based on Geodesic Distance Features

Sebastian Handrich, Ayoub Al-Hamadi

Computer Vision and Pattern Recognition · · cited 13× · DOI ↗ · more like this ·

In this work, we propose a real-time capable and robust method for human pose estimation based on geodesic distance features from depth images. Although a lot of work has been done in the field of the human pose estimation, it remains a challenging task - especially because of the high variability of human poses and self occlusions. The pose estimation focuses on the upper body, as it is the relevant part for a subsequent gesture and posture recognition and therefore the basis for a real human-machine-interaction. A graph-based representation of the 3D point cloud data is determined which allows for the measurement of pose-independent geodesic distances on the surface of the body. Based on these distances we determine feature points that are used for the adaptation of a kinematic skeleton model of the human upper body. The method does not need any pre-trained pose classifiers and can…

Multi stereo camera data fusion for fingertip detection in gesture recognition systems

Jörg Appenrodt, Sebastian Handrich, Ayoub Al-Hamadi +1 more

Human-Computer Interaction · · cited 12× · DOI ↗ · more like this ·

In this paper we present our results of fingertip detection to realize an automatic gesture recognition system by using a multi stereo camera setup. The online framework detects automatically the hands and the face of the user based on depth and color information. To estimate the spatial position and the joints of fingers a 3D hand model was generated. We used the Iterative Closest Point (ICP) algorithm to calculate the distance error between the model and 3D input data. In addition a separation and evaluation of hand and fingertip movements was implemented. To solve the general problem of self-occlusion we developed a multi stereo camera system to increase the information density. The required calibration is presented by using ICP algorithm and Genetic Algorithm.

Facial action unit intensity estimation and feature relevance visualization with random regression forests

Philipp Werner, Sebastian Handrich, Ayoub Al-Hamadi

Computer Vision and Pattern Recognition · · cited 11× · DOI ↗ · more like this ·

Automatic facial action unit intensity estimation can be useful for various applications in affective computing. In this paper, we apply random regression forests for this task and propose modifications that improve predictive performance compared to the original random forest. Further, we introduce a way to estimate and visualize the relevance of the features for an individual prediction and the forest in general. We conduct experiments on the FERA 2017 challenge dataset (which outperform the FERA baseline results), show the performance gain by the modifications, and illustrate feature relevance.

Detecting Arbitrarily Rotated Faces for Face Analysis

Frerk Saxen, Sebastian Handrich, Philipp Werner +2 more

Computer Vision and Pattern Recognition · · cited 7× · DOI ↗ · more like this ·

Current face detection concentrates on detecting tiny faces and severely occluded faces. Face analysis methods, however, require a good localization and would benefit greatly from some rotation information. We propose to predict a face direction vector (FDV), which provides the face size and orientation and can be learned by a common object detection architecture better than the traditional bounding box. It provides a more consistent definition of face location and size. Using the FDV is promising for all succeeding face analysis methods. As an example, we show that facial landmark detection can highly benefit from pre-aligned faces.

Advancement in the head pose estimation via depth-based face spotting

Anwar Saeed, Ayoub Al-Hamadi, Sebastian Handrich

Computer Vision and Pattern Recognition · · cited 5× · DOI ↗ · more like this ·

Head pose estimation is not only a crucial preprocessing task in applications such as facial expression and face recognition, but also the core task for many others, e.g. gaze; driver focus of attention; head gesture recognitions. In real scenarios, the fine location and scale of a processed face patch should be consistently and automatically obtained. To this end, we propose a depth-based face spotting technique in which the face is cropped with respect to its depth data, and is modeled by its appearance features. By employing this technique, the localization rate was gained. additionally, by building a head pose estimator on top of it, we achieved more accurate pose estimates and better generalization capability. To estimate the head pose, we exploit Support Vector (SV) regressors to map Histogram of oriented Gradient (HoG) features extracted from the spotted face patches in both…

Multi hypotheses based object tracking in HCI environments

Sebastian Handrich, Ayoub Al-Hamadi

Human-Computer Interaction · · cited 5× · DOI ↗ · more like this ·

Gesture recogntion plays an important role in Human Computer Interaction (HCI). However, in most HCI systems the user is limited to use only one hand or two hands under optimal conditions. Challenges are for instance non-homogeneous backgrounds, hand-hand or hand-face overlapping or brightness modifications which will be met in real HCI scenarios. In this work, we propose a novel method that solves the ambiguities due to the hand overlap robustly based on multi-hypotheses object association. The results of tracking build the basis for further feature extraction and gesture recognition.

3D Human Pose Estimation Using Stochastic Optimization in Real Time

Sebastian Handrich, Philipp Waxweiler, Philipp Werner +1 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

Random Tree Walkers (RTW) are a well-established method for human pose estimation, because they deliver state-of-the-art performance at low computational cost. As the forests capabilities for generalization are limited, the algorithm fails to estimate unlearned poses very quickly. The proposed method pushes this limitation by combining the RTW with optimization methods such as iterative closest point (ICP) and a stochastic search. The RTW is being used to initialize various hypotheses in different ways which are then passed to the optimization stage of the proposed method. The quality of each hypothesis is assessed by a cost function measuring the discrepancy between the data and a human body model generated for each hypothesis. Experimental results show a greater number of correctly estimated poses over a single RTW result.

Localizing body joints from single depth images using geodetic distances and random tree walk

Sebastian Handrich, Ayoub Al-Hamadi

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

We address the problem of human pose estimation from single depth images. We extend a previously proposed approach made by Jung and learn the direction toward skeleton joints from both depth and geodetic features. Experimental evaluation shows that our approach achieves a higher precision or a similar precision, but with much smaller regression trees.

Low cost calibration of stereo line scan camera systems

Erik Lilienblum, Sebastian Handrich, Ayoub Al-Hamadi

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

We present a new calibration method for 3d measurement systems consisting of two co-planar aligned line scan cameras. As appliance we use a calibration target whose geometric 2d and 3d parameters are only approximately known. As our input data we take from that target a sufficient number of single captured image lies in different geometric positions. Then we calculate 2d points within the joint viewing plane of the cameras both by triangulation of corresponding image points and by intersection with the lines on the target surface. The distances between the triangulation points and the related intersection points are minimized by linearizing and least squares adjustment. In the result we obtain all relevant parameters of the inner and outer orientation as well as the 2d and 3d geometry parameters of the calibration target with high accuracy.

Multi-objective parameter estimation of biologically plausible neural networks in different behavior stages

Andreas Herzog, Sebastian Handrich, Christoph S. Herrmann

Artificial Intelligence · · cited 4× · DOI ↗ · more like this ·

An essential behaviour of biological neural networks is the switching between different dynamical stages i.e. during development, learning, attention or memory formation. This seems to be a key element in understanding the balance of stability and flexibility of biological information systems and should also be implemented in biologic plausible artificial neural networks. The parameter estimation of such artificial networks to fit it to the biological behavior in the different stages is a multi-objective problem. We show a multi-population genetic algorithm to get useful parameter combinations with an adapted cross population estimation of fitness and recombination of genes. The algorithm is tested on parameter fitting of a working memory model and further application of dopamine modulated learning is discussed.

Human bodypart classification using geodesic descriptors and random forests

Sebastian Handrich, Ayoub Al-Hamadi, Erik Lilienblum +1 more

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

A new approach to classify human body parts in depth images is proposed. The approach is based on geodesic descriptors. Such a descriptor randomly samples the local geodesic neighborhood of each depth pixel. During a training phase, a random forest classifier learns the correct body part from these descriptors. The experimental evaluation shows that we can robustly classify 19 body parts for several different poses and body proportions. We further compare our approach and the classification based on geodesic distance features to those that were used in previous works.

www.informatik2011.de Real-Time Implementation of a Random Finite Set Particle Filter

Stephan Reuter, Klaus Dietmayer, Sebastian Handrich

Artificial Intelligence · · cited 0× · OpenAlex ↗ · more like this ·

Abstract: In scenarios characterized by a high object density, data association is a demanding task due to several ambiguities. Especially the assumption that all objects move independent from each other may lead to physically impossible predicted states, in which two objects are closer to each other than feasible. Thus, avoiding such impossible states may simplify the data association. Within the random finite set statistics it is possible to easily incorporate constraints concerning object states and to integrate them into a multi-target Bayes filter. A drawback of the random finite set statistics is its computational complexity, especially in the corrector step. In this contribution, a fast approximation for the calculation of the multi-target likelihood function is proposed. This approximation is used to implement a real-time random finite set particle filter on a graphical…