arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Pascal Peter

36 papers · 1996–2025

1996: 11997: 11998: 01999: 02000: 12001: 02002: 02003: 02004: 02005: 02006: 02007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 12015: 22016: 32017: 32018: 02019: 22020: 52021: 62022: 22023: 52024: 22025: 2
1996peak 6 in 20212025

Frequent co-authors

Papers

showing 1–25 of 36 RSS

Turning Diffusion-Based Image Colorization Into Efficient Color Compression

Pascal Peter, Lilli Kaufhold, Joachim Weickert

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 43× · DOI ↗ · more like this ·

The work of Levin et al. (2004) popularized stroke-based methods that add color to gray value images according to a small amount of user-specified color samples. Even though such reconstructions from sparse data suggest a possible use in compression, only few attempts were made so far in this direction. Diffusion-based compression methods pursue a similar idea: they store only few image pixels and inpaint the missing regions. Despite this close relation and a lack of diffusion-based color codecs, colorization ideas were so far only integrated into transform-based approaches such as JPEG. We address this missing link with two contributions. First, we show the relation between the discrete colorization of Levin et al. and continuous diffusion-based inpainting in the YCbCr color space. It decomposes the image into a luma (brightness) channel and two chroma (color) channels. Our luma-guided…

Diffusion-Based Inpainting for Coding Remote-Sensing Data

Naoufal Amrani, Joan Serra-Sagristà, Pascal Peter +1 more

Computer Vision and Pattern Recognition · IEEE Geoscience and Remote Sensing Letters · · cited 25× · DOI ↗ · more like this ·

Inpainting techniques based on partial differential equations (PDEs), such as diffusion processes, are gaining growing importance as a novel family of image compression methods. Nevertheless, the application of inpainting in the field of hyperspectral imagery has been mainly focused on filling in missing information or dead pixels due to sensor failures. In this letter, we propose a novel PDE-based inpainting algorithm to compress hyperspectral images. The method inpaints separately the known data in the spatial and spectral dimensions. Then, it applies a prediction model to the final inpainting solution to obtain a representation much closer to the original image. Experimental results over a set of hyperspectral images indicate that the proposed algorithm can perform better than a recent proposed extension to prediction-based standard CCSDS-123.0 at low bit rate, better than JPEG 2000…

A proof-of-concept framework for PDE-based video compression

Sarah Andris, Pascal Peter, Joachim Weickert

Computer Vision and Pattern Recognition · · cited 23× · DOI ↗ · more like this ·

In image compression, codecs that rely on interpolation with partial differential equations (PDEs) are becoming increasingly popular. However, there have not been many attempts to transfer this concept to video compression. Since real-time performance is challenging for PDE-based reconstruction, first efficient approaches work on a frame-by-frame basis and focus on parallel implementations without considering coding quality. So far, there is no fully PDE-based video codec that exploits temporal redundancies. As a remedy, we propose a modular framework that combines PDE-based compression with motion compensation: Intra frames are predicted with PDE-based inpainting and inter frames with dense optic flow fields. We use this framework to develop a proof-of-concept codec that combines homogeneous diffusion inpainting with the variational optic flow model of Brox et al. (2004). Even without…

Colour image compression with anisotropic diffusion

Pascal Peter, Joachim Weickert

Computer Vision and Pattern Recognition · · cited 18× · DOI ↗ · more like this ·

Schmaltz et al. (2009) have shown that for reasonably high compression rates, diffusion-based codecs can exceed the quality of transformation-based methods such as JPEG 2000. They store only data at a few optimised pixel locations and in-paint missing data with edge-enhancing anisotropic diffusion (EED). However, research on compression with diffusion methods has mainly focussed on grey-value images, and colour images have been compressed in a straightforward way using anisotropic diffusion in RGB space. So far, there is no sophisticated diffusion-based counterpart to the colour mode of JPEG 2000. To address this shortcoming we introduce an advanced colour compression codec that exploits properties of the human visual system in YCbCr space. Since details in the luma channel Y are perceptually relevant, we invest a large fraction of our bit budget in its encoding with high fidelity. For…

Fast Inpainting-Based Compression: Combining Shepard Interpolation with Joint Inpainting and Prediction

Pascal Peter

Computer Vision and Pattern Recognition · · cited 10× · DOI ↗ · more like this ·

Inpainting-based compression has been suggested as a qualitative competitor to the JPEG family of transform-based codecs, specifically for high compression ratios. However, it also requires sophisticated interpolation, data optimisation and encoding tasks that are both slow and hard to implement. We propose a fast and simple alternative that combines Shepard interpolation with a novel joint inpainting and prediction approach. It represents the image by a fraction of its pixel values on a sparse regular subgrid that are selected by an efficient optimisation strategy. Experiments show that our codec is up to five orders of magnitude faster than traditional inpainting-based approaches. Qualitatively, it can surpass transform-based codecs, in particular for high compression ratios and cartoon-like images.

Impediments to Providing Scientific Literacy to Students in Introductory Survey Courses

Pascal Peter de Caprariis

Education · Journal of Geoscience Education · · cited 8× · DOI ↗ · more like this ·

The high-enrollment survey courses in which many college students receive their introduction to science tend to be impersonal because of their size and the manner in which they are taught. Presentation of factual material, a lack of hands-on activities, and assessment with multiple-choice tests convince many students that science consists of lists of facts to be memorized. There are significant cultural differences between these courses and those offered for science majors, differences which make it unlikely that the average student will develop any degree of scientific literacy. The ability to take material one has learned and extend it in some way cannot be expected of the majority of those taking the survey courses because little high-level cognitive activity is stimulated in these courses. Careful analysis of what we actually do in survey courses is the first step to finding ways to…

Deep Spatial and Tonal Data Optimisation for Homogeneous Diffusion Inpainting

Pascal Peter, Karl Schrader, Tobias Alt +1 more

eess.IV · · cited 6× · arXiv ↗ · more like this ·

Diffusion-based inpainting can reconstruct missing image areas with high quality from sparse data, provided that their location and their values are well optimised. This is particularly useful for applications such as image compression, where the original image is known. Selecting the known data constitutes a challenging optimisation problem, that has so far been only investigated with model-based approaches. So far, these methods require a choice between either high quality or high speed since qualitatively convincing algorithms rely on many time-consuming inpaintings. We propose the first neural network architecture that allows fast optimisation of pixel positions and pixel values for homogeneous diffusion inpainting. During training, we combine two optimisation networks with a neural network-based surrogate solver for diffusion inpainting. This novel concept allows us to perform…

Creating or Adapting Courses for On-Line Presentation

Pascal Peter de Caprariis

Education · Journal of Geoscience Education · · cited 4× · DOI ↗ · more like this ·

The new information technologies provide a great variety of interesting opportunities for instructors wishing to reach new audiences for their courses or to provide instruction to traditional students in new ways. Teaching a course entirely on the Internet requires serious consideration of the characteristics of that medium. Standard instructional design considerations are easily applied to on-line courses, but instructors must recognize that the manner in which things are done in traditional classrooms may have to be modified considerably to provide the same values in an on-line course. It is important that instructors find ways to incorporate feedback, two-way communication, and active learning into on-line “presentations.” Different instructors will find different ways to incorporate these components, so it is not possible to say that there is a correct way to teach an on-line…

Compressing Colour Images with Joint Inpainting and Prediction

Rahul Mohideen Kaja Mohideen, Pascal Peter, Tobias Alt +2 more

eess.IV · · cited 3× · arXiv ↗ · more like this ·

Inpainting-based codecs store sparse, quantised pixel data directly and decode by interpolating the discarded image parts. This interpolation can be used simultaneously for efficient coding by predicting pixel data to be stored. Such joint inpainting and prediction approaches yield good results with simple components such as regular grids and Shepard interpolation on grey value images, but they lack a dedicated mode for colour images. Therefore, we evaluate different approaches for inpainting-based colour compression. Inpainting operators are able to reconstruct a large range of colours from a small colour palette of the known pixels. We exploit this with a luma preference mode which uses higher sparsity in YCbCr colour channels than in the brightness channel. Furthermore, we propose the first full vector quantisation mode for an inpainting-based codec that stores only a small codebook…

A Comparison of Writing Skills and Test-Taking Skills in an Environmental-Geology Course

Pascal Peter de Caprariis

Education · Journal of Geoscience Education · · cited 2× · DOI ↗ · more like this ·

A set of five writing exercises, assigned in a survey course in environmental geology in which multiple-choice tests have traditionally been the only means of assessment, showed that many students who test poorly can nevertheless express themselves clearly on scientific concepts. The students wrote about material from books, journals, and newspapers on topics relevant to the course, and they were graded on both organization and grammar. Many students who “tested poorly” managed to write well enough that their final grades were raised by a complete letter grade. As would be expected, the data from the exercises indicate that no statistically significant relationship exists between (standardized) test-taking skills and expository skills. In addition, the bulk of the students who benefited from the exercises were in the lower half of the grade distribution on standardized tests.

Compressing Piecewise Smooth Images with the Mumford-Shah Cartoon Model

Ferdinand Jost, Pascal Peter, Joachim Weickert

eess.IV · · cited 1× · arXiv ↗ · more like this ·

Compressing piecewise smooth images is important for many data types such as depth maps in 3D videos or optic flow fields for motion compensation. Specialised codecs that rely on explicitly stored segmentations excel in this task since they preserve discontinuities between smooth regions. However, current approaches rely on ad hoc segmentations that lack a clean interpretation in terms of energy minimisation. As a remedy, we derive a generic region merging algorithm from the Mumford-Shah cartoon model. It adapts the segmentation to arbitrary reconstruction operators for the segment content. In spite of its conceptual simplicity, our framework can outperform previous segment-based compression methods as well as BPG by up to 3 dB.

Space-Filling Curve Indices as Acceleration Structure for Exemplar-Based Inpainting

Tim Dahmen, Patrick Trampert, Pascal Peter +3 more

cs.CV · · cited 1× · arXiv ↗ · more like this ·

Exemplar-based inpainting is the process of reconstructing missing parts of an image by searching the remaining data for patches that fit seamlessly. The image is completed to a plausible-looking solution by repeatedly inserting the patch that is the best match according to some cost function. We present an acceleration structure that uses a multi-index scheme to accelerate this search procedure drastically, particularly in the case of very large datasets. The index scheme uses ideas such as dimensionality reduction and k-nearest neighbor search on space-filling curves that are well known in the field of multimedia databases. Our method has a theoretic runtime of O(log2 n) per iteration and reaches a speedup factor of up to 660 over the original method. The approach has the advantage of being agnostic to most modelbased parts of exemplar-based inpainting such as the order in which…

Skeleton Sparsification and Densification Scale-Spaces

Julia Gierke, Pascal Peter

cs.CV · · cited 0× · arXiv ↗ · more like this ·

The Hamilton-Jacobi skeleton, also known as the medial axis, is a powerful shape descriptor that represents binary objects in terms of the centres of maximal inscribed discs. Despite its broad applicability, the medial axis suffers from sensitivity to noise: Minor boundary variations can lead to disproportionately large and undesirable expansions of the skeleton. Classical pruning methods mitigate this shortcoming by systematically removing extraneous skeletal branches. This sequential simplification of skeletons resembles the principle of sparsification scale-spaces that embed images into a family of reconstructions from increasingly sparse pixel representations. We combine both worlds by introducing skeletonisation scale-spaces: They leverage sparsification of the medial axis to achieve hierarchical simplification of shapes. Unlike conventional pruning, our framework inherently…

Skeletonisation Scale-Spaces

Julia Gierke, Pascal Peter

eess.IV · · cited 0× · arXiv ↗ · more like this ·

The medial axis transform is a well-known tool for shape recognition. Instead of the object contour, it equivalently describes a binary object in terms of a skeleton containing all centres of maximal inscribed discs. While this shape descriptor is useful for many applications, it is also sensitive to noise: Small boundary perturbations can result in large unwanted expansions of the skeleton. Pruning offers a remedy by removing unwanted skeleton parts. In our contribution, we generalise this principle to skeleton sparsification: We show that subsequently removing parts of the skeleton simplifies the associated shape in a hierarchical manner that obeys scale-space properties. To this end, we provide both a continuous and discrete theory that incorporates architectural and simplification statements as well as invariances. We illustrate how our skeletonisation scale-spaces can be employed…

Neuroexplicit Diffusion Models for Inpainting of Optical Flow Fields

Tom Fischer, Pascal Peter, Joachim Weickert +1 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Deep learning has revolutionized the field of computer vision by introducing large scale neural networks with millions of parameters. Training these networks requires massive datasets and leads to intransparent models that can fail to generalize. At the other extreme, models designed from partial differential equations (PDEs) embed specialized domain knowledge into mathematical equations and usually rely on few manually chosen hyperparameters. This makes them transparent by construction and if designed and calibrated carefully, they can generalize well to unseen scenarios. In this paper, we show how to bring model- and data-driven approaches together by combining the explicit PDE-based approaches with convolutional neural networks to obtain the best of both worlds. We illustrate a joint architecture for the task of inpainting optical flow fields and show that the combination of model-…

Generalised Diffusion Probabilistic Scale-Spaces

Pascal Peter

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results in a tractable probability distribution. A corresponding learned reverse process generates images and can be conditioned on side information, which leads to a wide variety of practical applications. Most of the research focus currently lies on practice-oriented extensions. In contrast, the theoretical background remains largely unexplored, in particular the relations to drift-diffusion. In order to shed light on these connections to classical image filtering, we propose a generalised scale-space theory for diffusion probabilistic models. Moreover, we show conceptual and empirical connections to diffusion and osmosis filters.

Connecting Image Inpainting with Denoising in the Homogeneous Diffusion Setting

Daniel Gaa, Vassillen Chizhov, Pascal Peter +2 more

eess.IV · · cited 0× · arXiv ↗ · more like this ·

While local methods for image denoising and inpainting may use similar concepts, their connections have hardly been investigated so far. The goal of this work is to establish links between the two by focusing on the most foundational scenario on both sides: the homogeneous diffusion setting. To this end, we study a denoising by inpainting (DbI) framework: It averages multiple inpainting results from different noisy subsets. We derive equivalence results between DbI on shifted regular grids and homogeneous diffusion filtering in 1D via an explicit relation between the density and the diffusion time. We also provide an empirical extension to the 2-D case. We present experiments that confirm our theory and suggest that it can also be generalized to diffusions with non-homogeneous data or non-homogeneous diffusivities. More generally, our work demonstrates that the hardly explored idea of…

Image Blending with Osmosis

Paul Bungert, Pascal Peter, Joachim Weickert

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Image blending is an integral part of many multi-image applications such as panorama stitching or remote image acquisition processes. In such scenarios, multiple images are connected at predefined boundaries to form a larger image. A convincing transition between these boundaries may be challenging, since each image might have been acquired under different conditions or even by different devices. We propose the first blending approach based on osmosis filters. These drift-diffusion processes define an image evolution with a non-trivial steady state. For our blending purposes, we explore several ways to compose drift vector fields based on the derivatives of our input images. These vector fields guide the evolution such that the steady state yields a convincing blended result. Our method benefits from the well-founded theoretical results for osmosis, which include useful invariances…

Efficient Neural Generation of 4K Masks for Homogeneous Diffusion Inpainting

Karl Schrader, Pascal Peter, Niklas Kämper +1 more

eess.IV · · cited 0× · arXiv ↗ · more like this ·

With well-selected data, homogeneous diffusion inpainting can reconstruct images from sparse data with high quality. While 4K colour images of size 3840 x 2160 can already be inpainted in real time, optimising the known data for applications like image compression remains challenging: Widely used stochastic strategies can take days for a single 4K image. Recently, a first neural approach for this so-called mask optimisation problem offered high speed and good quality for small images. It trains a mask generation network with the help of a neural inpainting surrogate. However, these mask networks can only output masks for the resolution and mask density they were trained for. We solve these problems and enable mask optimisation for high-resolution images through a neuroexplicit coarse-to-fine strategy. Additionally, we improve the training and interpretability of mask networks by…

Generalised Scale-Space Properties for Probabilistic Diffusion Models

Pascal Peter

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Probabilistic diffusion models enjoy increasing popularity in the deep learning community. They generate convincing samples from a learned distribution of input images with a wide field of practical applications. Originally, these approaches were motivated from drift-diffusion processes, but these origins find less attention in recent, practice-oriented publications. We investigate probabilistic diffusion models from the viewpoint of scale-space research and show that they fulfil generalised scale-space properties on evolving probability distributions. Moreover, we discuss similarities and differences between interpretations of the physical core concept of drift-diffusion in the deep learning and model-based world. To this end, we examine relations of probabilistic diffusion to osmosis filters.

A Wasserstein GAN for Joint Learning of Inpainting and Spatial Optimisation

Pascal Peter

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Image inpainting is a restoration method that reconstructs missing image parts. However, a carefully selected mask of known pixels that yield a high quality inpainting can also act as a sparse image representation. This challenging spatial optimisation problem is essential for practical applications such as compression. So far, it has been almost exclusively adressed by model-based approaches. First attempts with neural networks seem promising, but are tailored towards specific inpainting operators or require postprocessing. To address this issue, we propose the first generative adversarial network (GAN) for spatial inpainting data optimisation. In contrast to previous approaches, it allows joint training of an inpainting generator and a corresponding mask optimisation network. With a Wasserstein distance, we ensure that our inpainting results accurately reflect the statistics of…

Learning Sparse Masks for Diffusion-based Image Inpainting

Tobias Alt, Pascal Peter, Joachim Weickert

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Diffusion-based inpainting is a powerful tool for the reconstruction of images from sparse data. Its quality strongly depends on the choice of known data. Optimising their spatial location -- the inpainting mask -- is challenging. A commonly used tool for this task are stochastic optimisation strategies. However, they are slow as they compute multiple inpainting results. We provide a remedy in terms of a learned mask generation model. By emulating the complete inpainting pipeline with two networks for mask generation and neural surrogate inpainting, we obtain a model for highly efficient adaptive mask generation. Experiments indicate that our model can achieve competitive quality with an acceleration by as much as four orders of magnitude. Our findings serve as a basis for making diffusion-based inpainting more attractive for applications such as image compression, where fast encoding…

JPEG Meets PDE-based Image Compression

Sarah Andris, Joachim Weickert, Tobias Alt +1 more

eess.IV · · cited 0× · arXiv ↗ · more like this ·

Inpainting-based image compression is emerging as a promising competitor to transform-based compression techniques. Its key idea is to reconstruct image information from only few known regions through inpainting. Specific partial differential equations (PDEs) such as edge-enhancing diffusion (EED) give high quality reconstructions of image structures with low or medium texture. Even though the strengths of PDE- and transform-based compression are complementary, they have rarely been combined within a hybrid codec. We propose to sparsify blocks of a JPEG compressed image and reconstruct them with EED inpainting. Our codec consistently outperforms JPEG and gives useful indications for successfully developing hybrid codecs further. Furthermore, our method is the first to choose regions rather than pixels as known data for PDE-based compression. It also gives novel insights into the…

Compressing Flow Fields with Edge-aware Homogeneous Diffusion Inpainting

Ferdinand Jost, Pascal Peter, Joachim Weickert

eess.IV · · cited 0× · arXiv ↗ · more like this ·

In spite of the fact that efficient compression methods for dense two-dimensional flow fields would be very useful for modern video codecs, hardly any research has been performed in this area so far. Our paper addresses this problem by proposing the first lossy diffusion-based codec for this purpose. It keeps only a few flow vectors on a coarse grid. Additionally stored edge locations ensure the accurate representation of discontinuities. In the decoding step, the missing information is recovered by homogeneous diffusion inpainting that incorporates the stored edges as reflecting boundary conditions. In spite of the simple nature of this codec, our experiments show that it achieves remarkable quality for compression ratios up to 800 : 1.

Clustering-Based Quantisation for PDE-Based Image Compression

Laurent Hoeltgen, Pascal Peter, Michael Breuß

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Finding optimal data for inpainting is a key problem in the context of partial differential equation based image compression. The data that yields the most accurate reconstruction is real-valued. Thus, quantisation models are mandatory to allow an efficient encoding. These can also be understood as challenging data clustering problems. Although clustering approaches are well suited for this kind of compression codecs, very few works actually consider them. Each pixel has a global impact on the reconstruction and optimal data locations are strongly correlated with their corresponding colour values. These facts make it hard to predict which feature works best. In this paper we discuss quantisation strategies based on popular methods such as k-means. We are lead to the central question which kind of feature vectors are best suited for image compression. To this end we consider choices such…