arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Pascal Colling

9 papers · 2018–2025

2018: 12019: 02020: 12021: 12022: 22023: 12024: 12025: 2
2018peak 2 in 20222025

Frequent co-authors

Papers

showing 1–9 of 9 RSS

Prediction Error Meta Classification in Semantic Segmentation: Detection via Aggregated Dispersion Measures of Softmax Probabilities

Matthias Rottmann, Pascal Colling, Thomas-Paul Hack +4 more

cs.CV · · cited 5× · arXiv ↗ · more like this ·

We present a method that "meta" classifies whether seg-ments predicted by a semantic segmentation neural networkintersect with the ground truth. For this purpose, we employ measures of dispersion for predicted pixel-wise class probability distributions, like classification entropy, that yield heat maps of the input scene's size. We aggregate these dispersion measures segment-wise and derive metrics that are well-correlated with the segment-wise IoU of prediction and ground truth. This procedure yields an almost plug and play post-processing tool to rate the prediction quality of semantic segmentation networks on segment level. This is especially relevant for monitoring neural networks in online applications like automated driving or medical imaging where reliability is of utmost importance. In our tests, we use publicly available state-of-the-art networks trained on the Cityscapes…

HD Lane Map Generation Based on Trail Map Aggregation

Pascal Colling, Dennis Müller, Matthias Rottmann

Computer Vision and Pattern Recognition · 2022 IEEE Intelligent Vehicles Symposium (IV) · · cited 3× · DOI ↗ · more like this ·

We present a procedure to create high definition maps of lanes based on detected and tracked vehicles from perception sensor data as well as the ego vehicle using multiple observations of the same location. The procedure consists of two parts. First, an aggregation part in which the detected and tracked road users as well as the driving path of the ego vehicle are aggregated into a map representation. Second, lanes are extracted from those maps as lane center lines in a structured data format. The final lane centers are represented in a directed graph representation including the driving direction. They are accurate up to a few centimeters. Our procedure is not restricted to any environment and does not rely on any prior map information. In our experiments with real world data and available ground truth, we study the performance of different map aggregations e.g., based on the ego…

A Preprocessing and Postprocessing Voxel-based Method for LiDAR Semantic Segmentation Improvement in Long Distance

Andrea Matteazzi, Pascal Colling, Michael Arnold +1 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

In recent years considerable research in LiDAR semantic segmentation was conducted, introducing several new state of the art models. However, most research focuses on single-scan point clouds, limiting performance especially in long distance outdoor scenarios, by omitting time-sequential information. Moreover, varying-density and occlusions constitute significant challenges in single-scan approaches. In this paper we propose a LiDAR point cloud preprocessing and postprocessing method. This multi-stage approach, in conjunction with state of the art models in a multi-scan setting, aims to solve those challenges. We demonstrate the benefits of our method through quantitative evaluation with the given models in single-scan settings. In particular, we achieve significant improvements in mIoU performance of over 5 percentage point in medium range and over 10 percentage point in far range.…

MetaBox+: A new Region Based Active Learning Method for Semantic Segmentation using Priority Maps

Pascal Colling, Lutz Roese-Koerner, Hanno Gottschalk +1 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

We present a novel region based active learning method for semantic image segmentation, called MetaBox+. For acquisition, we train a meta regression model to estimate the segment-wise Intersection over Union (IoU) of each predicted segment of unlabeled images. This can be understood as an estimation of segment-wise prediction quality. Queried regions are supposed to minimize to competing targets, i.e., low predicted IoU values / segmentation quality and low estimated annotation costs. For estimating the latter we propose a simple but practical method for annotation cost estimation. We compare our method to entropy based methods, where we consider the entropy as uncertainty of the prediction. The comparison and analysis of the results provide insights into annotation costs as well as robustness and variance of the methods. Numerical experiments conducted with two different networks on…

Inferring Driving Maps by Deep Learning-based Trail Map Extraction

Michael Hubbertz, Pascal Colling, Qi Han +1 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

High-definition (HD) maps offer extensive and accurate environmental information about the driving scene, making them a crucial and essential element for planning within autonomous driving systems. To avoid extensive efforts from manual labeling, methods for automating the map creation have emerged. Recent trends have moved from offline mapping to online mapping, ensuring availability and actuality of the utilized maps. While the performance has increased in recent years, online mapping still faces challenges regarding temporal consistency, sensor occlusion, runtime, and generalization. We propose a novel offline mapping approach that integrates trails - informal routes used by drivers - into the map creation process. Our method aggregates trail data from the ego vehicle and other traffic participants to construct a comprehensive global map using transformer-based deep learning models.…

Adverse Weather Conditions Augmentation of LiDAR Scenes with Latent Diffusion Models

Andrea Matteazzi, Pascal Colling, Michael Arnold +1 more

cs.CV · · arXiv ↗ · more like this ·

LiDAR scenes constitute a fundamental source for several autonomous driving applications. Despite the existence of several datasets, scenes from adverse weather conditions are rarely available. This limits the robustness of downstream machine learning models, and restrains the reliability of autonomous driving systems in particular locations and seasons. Collecting feature-diverse scenes under adverse weather conditions is challenging due to seasonal limitations. Generative models are therefore essentials, especially for generating adverse weather conditions for specific driving scenarios. In our work, we propose a latent diffusion process constituted by autoencoder and latent diffusion models. Moreover, we leverage the clear condition LiDAR scenes with a postprocessing step to improve the realism of the generated adverse weather condition scenes.

LMD: Light-weight Prediction Quality Estimation for Object Detection in Lidar Point Clouds

Tobias Riedlinger, Marius Schubert, Sarina Penquitt +7 more

cs.CV · · arXiv ↗ · more like this ·

Object detection on Lidar point cloud data is a promising technology for autonomous driving and robotics which has seen a significant rise in performance and accuracy during recent years. Particularly uncertainty estimation is a crucial component for down-stream tasks and deep neural networks remain error-prone even for predictions with high confidence. Previously proposed methods for quantifying prediction uncertainty tend to alter the training scheme of the detector or rely on prediction sampling which results in vastly increased inference time. In order to address these two issues, we propose LidarMetaDetect (LMD), a light-weight post-processing scheme for prediction quality estimation. Our method can easily be added to any pre-trained Lidar object detector without altering anything about the base model and is purely based on post-processing, therefore, only leading to a negligible…

Fake it, Mix it, Segment it: Bridging the Domain Gap Between Lidar Sensors

Frederik Hasecke, Pascal Colling, Anton Kummert

cs.CV · · arXiv ↗ · more like this ·

Segmentation of lidar data is a task that provides rich, point-wise information about the environment of robots or autonomous vehicles. Currently best performing neural networks for lidar segmentation are fine-tuned to specific datasets. Switching the lidar sensor without retraining on a big set of annotated data from the new sensor creates a domain shift, which causes the network performance to drop drastically. In this work we propose a new method for lidar domain adaption, in which we use annotated panoptic lidar datasets and recreate the recorded scenes in the structure of a different lidar sensor. We narrow the domain gap to the target data by recreating panoptic data from one domain in another and mixing the generated data with parts of (pseudo) labeled target domain data. Our method improves the nuScenes to SemanticKITTI unsupervised domain adaptation performance by 15.2 mean…

False Positive Detection and Prediction Quality Estimation for LiDAR Point Cloud Segmentation

Pascal Colling, Matthias Rottmann, Lutz Roese-Koerner +1 more

cs.CV · · arXiv ↗ · more like this ·

We present a novel post-processing tool for semantic segmentation of LiDAR point cloud data, called LidarMetaSeg, which estimates the prediction quality segmentwise. For this purpose we compute dispersion measures based on network probability outputs as well as feature measures based on point cloud input features and aggregate them on segment level. These aggregated measures are used to train a meta classification model to predict whether a predicted segment is a false positive or not and a meta regression model to predict the segmentwise intersection over union. Both models can then be applied to semantic segmentation inferences without knowing the ground truth. In our experiments we use different LiDAR segmentation models and datasets and analyze the power of our method. We show that our results outperform other standard approaches.