arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Luc Brun

75 papers · 1996–2024

1996: 11997: 21998: 01999: 12000: 12001: 02002: 22003: 12004: 12005: 22006: 22007: 22008: 32009: 42010: 42011: 22012: 42013: 62014: 92015: 32016: 52017: 02018: 32019: 52020: 12021: 52022: 22023: 22024: 2
1996peak 9 in 20142024

Frequent co-authors

Papers

showing 1–25 of 75 RSS

A neural network based on SPD manifold learning for skeleton-based hand gesture recognition

Xuan Son Nguyen, Luc Brun, Olivier Lézoray +1 more

cs.CV · · cited 147× · arXiv ↗ · more like this ·

This paper proposes a new neural network based on SPD manifold learning for skeleton-based hand gesture recognition. Given the stream of hand's joint positions, our approach combines two aggregation processes on respectively spatial and temporal domains. The pipeline of our network architecture consists in three main stages. The first stage is based on a convolutional layer to increase the discriminative power of learned features. The second stage relies on different architectures for spatial and temporal Gaussian aggregation of joint features. The third stage learns a final SPD matrix from skeletal data. A new type of layer is proposed for the third stage, based on a variant of stochastic gradient descent on Stiefel manifolds. The proposed network is validated on two challenging datasets and shows state-of-the-art accuracies on both datasets.

Comparison and optimization of methods of color image quantization

Jean-Pierre Braquelaire, Luc Brun

Computer Vision and Pattern Recognition · IEEE Transactions on Image Processing · · cited 89× · DOI ↗ · more like this ·

Color image quantization, the process of reducing the number of colors in a digital color image, has been widely studied for the last fifteen years. The different steps of clustering methods are studied. The methods are compared step by step and some optimizations of the algorithms and data structures are given. A new color space called H1H2H3 is introduced, which improves the quantization heuristics. A low-cost quantization scheme is proposed.

Dynamic Scene Understanding for Behavior Analysis Based on String Kernels

Luc Brun, Alessia Saggese, Mario Vento

Computer Vision and Pattern Recognition · IEEE Transactions on Circuits and Systems for Video Technology · · cited 59× · DOI ↗ · more like this ·

This paper aims at dynamically understanding the properties of a scene from the analysis of moving object trajectories. Two different applications are proposed: the former is devoted to identify abnormal behaviors, while the latter allows to extract the k, most of the similar trajectories to the one hand-drawn by an human operator. A set of normal trajectories' models is extracted using a novel unsupervised learning technique: the scene is adaptively partitioned into zones using the distribution of the training set and each trajectory is represented as a sequence of symbols by considering positional information (the zones crossed in the scene), speed, and shape. The main novelty is the use of a kernel-based approach for evaluating the similarity between the trajectories. Furthermore, we define a novel and efficient kernel-based clustering algorithm, aimed at obtaining groups of normal…

Contains and Inside relationships within combinatorial Pyramids

Luc Brun, Walter G. Kropatsch

cs.CV · · cited 36× · arXiv ↗ · more like this ·

Irregular pyramids are made of a stack of successively reduced graphs embedded in the plane. Such pyramids are used within the segmentation framework to encode a hierarchy of partitions. The different graph models used within the irregular pyramid framework encode different types of relationships between regions. This paper compares different graph models used within the irregular pyramid framework according to a set of relationships between regions. We also define a new algorithm based on a pyramid of combinatorial maps which allows to determine if one region contains the other using only local calculus.

Approximate Graph Edit Distance by Several Local Searches in Parallel

Évariste Daller, Sébastien Bougleux, Benoît Gaüzère +1 more

Computer Vision and Pattern Recognition · · cited 28× · DOI ↗ · more like this ·

Solving or approximating the linear sum assignment problem (LSAP) is an important step of several constructive and local search strategies developed to approximate the graph edit distance (GED) of two attributed graphs, or more generally the solution to quadratic assignment problems. Constructive strategies find a first estimation of the GED by solving an LSAP. This estimation is then refined by a local search strategy. While these search strategies depend strongly on the initial assignment, several solutions to the linear problem usually exist. They are not taken into account to get better estimations. All the estimations of the GED based on an LSAP select randomly one solution. This paper explores the insights provided by the use of several solutions to an LSAP, refined in parallel by a local search strategy based on the relaxation of the search space, and conditional gradient…

Non-local image smoothing by applying anisotropic diffusion PDE's in the space of patches

David Tschumperlé, Luc Brun

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 25× · DOI ↗ · more like this ·

We design a family of non-local image smoothing algorithms which approximate the application of diffusion PDE's on a specific Euclidean space of image patches. We first map a noisy image onto this high-dimensional space and estimate its geometric structure thanks to a straightforward extension of the structure tensor field. The tensors spectral elements allows us to design an oriented high-dimensional smoothing process by the means of anisotropic regularization PDE's which have both local and non-local properties and whose solutions are estimated by locally oriented high-dimensional convolutions. We show that the Bilateral Filtering and Non-Local Means methods are the isotropic cases of our denoising framework.

Graph edit distance as a quadratic program

Sébastien Bougleux, Benoît Gaüzère, Luc Brun

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 23× · DOI ↗ · more like this ·

The graph edit distance (GED) measures the amount of distortion needed to transform a graph into another graph. Such a distance, developed in the context of error-tolerant graph matching, is one of the most flexible tool used in structural pattern recognition. However, the computation of the exact GED is NP-complete. Hence several suboptimal solutions, such as the ones based on bipartite assignments with edition, have been proposed. In this paper we propose a binary quadratic programming problem whose global minimum corresponds to the exact GED. This problem is interpreted as a quadratic assignment problem (QAP) where some constraints have been relaxed. This allows to adapt the integer projected fixed point algorithm, initially designed for the QAP, to efficiently compute an approximate GED by finding an interesting local minimum. Experiments show that our method remains quite close to…

Combinatorial pyramids

Luc Brun, Walter G. Kropatsch

Computer Vision and Pattern Recognition · · cited 22× · DOI ↗ · more like this ·

An irregular pyramid consists of a stack of successively reduced graphs. Each smaller graph is deduced from the preceding one by the contraction or the removal of a set of edges. Using a fixed decimation ratio we need approximately O(log(image size)) graphs to encode the whole pyramid. A combinatorial map encodes a planar graph thanks to two permutations encoding the edges and their orientation around the vertices. We present in this article an encoding of a combinatorial pyramid which allows to fold the whole pyramid in the base level layer and provides at the same time a measure of the relevance of every pixel. This encoding is used to retrieve any reduced combinatorial map of the pyramid from its base and to compute the borders of the partition encoded by the combinatorial maps.

Wavelet Scattering Transform and CNN for Closed Set Speaker Identification

Wajdi Ghezaiel, Luc Brun, Olivier Lézoray

Artificial Intelligence · · cited 21× · DOI ↗ · more like this ·

In real world applications, the performances of speaker identification systems degrade due to the reduction of both the amount and the quality of speech utterance. For that particular purpose, we propose a speaker identification system where short utterances with few training examples are used for person identification. Therefore, only a very small amount of data involving a sentence of 2-4 seconds is used. To achieve this, we propose a novel raw waveform end-to-end convolutional neural network (CNN) for text-independent speaker identification. We use wavelet scattering transform as a fixed initialization of the first layers of a CNN network, and learn the remaining layers in a supervised manner. The conducted experiments show that our hybrid architecture combining wavelet scattering transform and CNN can successfully perform efficient feature extraction for a speaker identification…

A Quadratic Assignment Formulation of the Graph Edit Distance

Sébastien Bougleux, Luc Brun, Vincenzo Carletti +3 more

cs.DS · · cited 18× · arXiv ↗ · more like this ·

Computing efficiently a robust measure of similarity or dissimilarity between graphs is a major challenge in Pattern Recognition. The Graph Edit Distance (GED) is a flexible measure of dissimilarity between graphs which arises in error-tolerant graph matching. It is defined from an optimal sequence of edit operations (edit path) transforming one graph into an other. Unfortunately, the exact computation of this measure is NP-hard. In the last decade, several approaches have been proposed to approximate the GED in polynomial time, mainly by solving linear programming problems. Among them, the bipartite GED has received much attention. It is deduced from a linear sum assignment of the nodes of the two graphs, which can be efficiently computed by Hungarian-type algorithms. However, edit operations on nodes and edges are not handled simultaneously, which limits the accuracy of the…

Hybrid Network For End-To-End Text-Independent Speaker Identification

Wajdi Ghezaiel, Luc Brun, Olivier Lézoray

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 17× · DOI ↗ · more like this ·

Deep learning has recently improved the performance of Speaker Identification (SI) systems. Promising results have been obtained with Convolutional Neural Networks (CNNs). This success is mostly driven by the advent of large datasets. However in the context of decentralized commercial applications, collection of large amount of training data is not always possible. In addition, robustness of a SI system is adversely effected by short utterances. Therefore, in this paper, we propose a novel text-independent speaker identification system able to identify speakers by learning from only few training short utterances examples. To achieve this, we combine a two-layer wavelet scattering network coupled with a CNN. The proposed architecture takes variable length speech segments. To evaluate the effectiveness of the proposed approach, Timit and Librispeech datasets are used in the experiments.…

Linear Sum Assignment with Edition

Sébastien Bougleux, Luc Brun

cs.DS · · cited 17× · arXiv ↗ · more like this ·

We consider the problem of transforming a set of elements into another by a sequence of elementary edit operations, namely substitutions, removals and insertions of elements. Each possible edit operation is penalized by a non-negative cost and the cost of a transformation is measured by summing the costs of its operations. A solution to this problem consists in defining a transformation having a minimal cost, among all possible transformations. To compute such a solution, the classical approach consists in representing removal and insertion operations by augmenting the two sets so that they get the same size. This allows to express the problem as a linear sum assignment problem (LSAP), which thus finds an optimal bijection (or permutation, perfect matching) between the two augmented sets. While the LSAP is known to be efficiently solvable in polynomial time complexity, for instance with…

Symbolic Learning vs. Graph Kernels: An Experimental Comparison in a Chemical Application.

Luc Brun, Donatello Conte, Pasquale Foggia +2 more

Computer Vision and Pattern Recognition · · cited 16× · OpenAlex ↗ · more like this ·

In this paper we present a quantitative comparison between two approaches, Graph Kernels and Symbolic Learning, within a classification scheme. The experimental case-study is the predictive toxicology evaluation, that is the inference of the toxic characteristics of chemical compounds from their structure. The results demonstrate that both approaches are comparable in terms of accuracy, but present pros and cons that are discussed in the last part of the paper.

Similarity-based matching for face authentication

Christophe Rosenberger, Luc Brun

Computer Vision and Pattern Recognition · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · · cited 16× · DOI ↗ · more like this ·

We propose in this paper a face authentication method based on a similarity measure. The SIFT descriptor is used to define some interest keypoints characterized by an invariant parameter. A graph is then built where nodes correspond to these keypoints. We model the authentication problem as a graph matching process. Experimental results on the AR database show an EER equals to 12% with only one image used for the enrollment and with images simulating real conditions.

A robust audio fingerprint extraction algorithm

Jérôme Lebossé, Luc Brun

Signal Processing · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 15× · OpenAlex ↗ · more like this ·

An Audio fingerprint is a small digest of an audio file computed from its main perceptual properties. Like human fingerprints, Audio fingerprints allow to identify an audio file among a set of candidates but does not allow to retrieve any other characteristics of the files. Applications of Audio fingerprint include audio monitoring on broadcast channels, filtering peer to peer networks, meta data restoration in large audio library and the protection of author's copyrights within a Digital Right Management(DRM) system. We propose in this paper a new fingerprint extraction algorithm which combines a segmentation method with a new fingerprint construction scheme. The proposed method is robust against compression and time shifting alterations of the audio files.

HAck: A system for the recognition of human actions by kernels of visual strings

Luc Brun, Gennaro Percannella, Alessia Saggese +1 more

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 12× · DOI ↗ · more like this ·

In this paper we propose HAcK, a novel method for recognizing Human Actions by string Kernel; the main idea is to represent each action through a sequence of visual characters, namely a string, able to model the temporal evolution of the events. Visual characters are extracted by analyzing global descriptors of the scene and by taking advantage on the depth information provided by a Kinect sensor. The similarity between actions is evaluated with a fast global alignment kernel, which allows to deal with actions of different length as well as with the noise introduced during the features extraction step. HAcK has been evaluated over two standard datasets and the obtained results, compared with state of the art approaches, confirm its effectiveness and its applicability in real environments.

Hierarchical Image Partitioning using Combinatorial Maps

Yll Haxhimusa, Adrian Ion, Walter G. Kropatsch +1 more

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 12× · OpenAlex ↗ · more like this ·

We present a hierarchical partitioning of images using a pairwise similarity function on a combinatorial map based representation. We used the idea of minimal spanning tree to find region borders quickly in a bottom-up way, based on local differences. The result is a hierarchy of image partitions with multiple resolutions suitable for further goal driven analysis. The algorithm can handle large variation and gradient intensity in images. Dual graph representations lack an explicit encoding of the orientation of planes, existing in combinatorial maps.

A Clustering Algorithm of Trajectories for Behaviour Understanding Based on String Kernels

Luc Brun, Alessia Saggese, M. Vento

Signal Processing · · cited 9× · DOI ↗ · more like this ·

This work aims to identify abnormal behaviors from the analysis of humans or vehicles' trajectories. A set of normal trajectories' prototypes is extracted by means of a novel unsupervised learning technique: the scene is adaptively partitioned into zones by using the distribution of the training set and each trajectory is represented as a sequence of symbols by taking into account positional information (the zones crossed in the scene), speed and shape. The main novelties of this work are the following: first, the similarity between trajectories is evaluated by means of a kernel-based approach. Furthermore, we define a novel and efficient kernel-based clustering algorithm, aimed at obtaining groups of normal trajectories. The proposed approach has been compared with state-of-the-art methods and it clearly outperforms all the other considered techniques.

Relationships between Graph Edit Distance and Maximal Common Unlabeled Subgraph

Luc Brun, Benoît Gaüzère, Sébastien Fourey

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 9× · OpenAlex ↗ · more like this ·

Graph edit distance measures the distance between two graphs as the number of elementary operations (vertex/edge insertion, deletion, substitution) required to transform the first graph into the second one. Such a distance allows to define a metric between graphs and has many applications in the structural pattern recognition framework. However, the complexity of the computation of this distance is exponential in the size of both graphs to be compared. In this technical report, we focus our attention on applications where families of graphs to be considered have a finite set of structures. We then investigate under which relationships between the costs of the different elementary operations, such a priori knowledge may be used to pre compute most of the optimal edit path between any two graphs.

Scalable generalized median graph estimation and its manifold use in bioinformatics, clustering, classification, and indexing

David B. Blumenthal, Nicolas Boria, Sébastien Bougleux +3 more

Signal Processing · Information Systems · · cited 8× · DOI ↗ · more like this ·

In this paper, we present GMG-BCU — a local search algorithm based on block coordinate update for estimating a generalized median graph for a given collection of labeled or unlabeled input graphs. Unlike all competitors, GMG-BCU is designed for both discrete and continuous label spaces and can be configured to run in linear time w. r. t. the size of the graph collection whenever median node and edge labels are computable in linear time. These properties make GMG-BCU usable for applications such as differential microbiome data analysis, graph classification, clustering, and indexing. We also prove theoretical properties of generalized median graphs, namely, that they exist under reasonable assumptions which are met in almost all application scenarios, that they are in general non-unique, that they are NP-hard to compute and APX-hard to approximate, and that no polynomial α-approximation…

Skeleton-Based Hand Gesture Recognition by Learning SPD Matrices with Neural Networks

Xuan Nguyen, Luc Brun, Olivier Lezoray +1 more

cs.CV · · cited 8× · arXiv ↗ · more like this ·

In this paper, we propose a new hand gesture recognition method based on skeletal data by learning SPD matrices with neural networks. We model the hand skeleton as a graph and introduce a neural network for SPD matrix learning, taking as input the 3D coordinates of hand joints. The proposed network is based on two newly designed layers that transform a set of SPD matrices into a SPD matrix. For gesture recognition, we train a linear SVM classifier using features extracted from our network. Experimental results on a challenging dataset (Dynamic Hand Gesture dataset from the SHREC 2017 3D Shape Retrieval Contest) show that the proposed method outperforms state-of-the-art methods.

Quasimetric Graph Edit Distance as a Compact Quadratic Assignment Problem

David B. Blumenthal, Évariste Daller, Sébastien Bougleux +2 more

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 8× · DOI ↗ · more like this ·

The graph edit distance (GED) is a widely used distance measure for attributed graphs. It has recently been shown that the problem of computing GED, which is a NP-hard optimization problem, can be formulated as a quadratic assignment problem (QAP). This formulation is useful, since it allows to derive well performing approximative heuristics for GED from existing techniques for QAP. In this paper, we focus on the case where the edit costs that underlie GED are quasimetric. This is the case in many applications of GED. We show that, for quasimetric edit costs, it is possible to reduce the size of the corresponding QAP formulation. An empirical evaluation shows that this reduction significantly speeds up the QAP-based approximative heuristics for GED.

Detection of anomalous driving behaviors by unsupervised learning of graphs

Luc Brun, Benito Cappellania, Alessia Saggese +1 more

Artificial Intelligence · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 8× · DOI ↗ · more like this ·

In this paper we propose a graph based approach for detecting abnormal behaviors starting from the analysis of vehicles' trajectories. The scene is partitioned into zones and is dynamically represented as a graph by evaluating the distribution of trajectories belonging to the training set. Furthermore, four different strategies are proposed in order to verify if a test trajectory belongs to the scene and then can be considered normal by evaluating the probability that this trajectory belongs to the graph. Our algorithms have been tested on the standard MIT Trajectories dataset and the obtained results confirm the effectiveness of the proposed approach.

Tiled top–down combinatorial pyramids for large images representation

Romain Goffe, Luc Brun, Guillaume Damiand

Computer Vision and Pattern Recognition · International Journal of Imaging Systems and Technology · · cited 8× · DOI ↗ · more like this ·

Abstract The uprising number of applications that involve very large images with resolutions greater than 30,000 × 30,000 raises major memory management issues. Firstly, the amount of data usually prevents such images from being processed globally and therefore, designing a global image partition raises several issues. Secondly, a multiresolution approach is necessary since an analysis only based on the highest resolution may miss global features revealed at lower resolutions. This article introduces the tiled top–down pyramidal framework which addresses these two main constraints. Our model provides a full representation of multiresolution images with both geometrical and topological relationships. The advantage of a top–down construction scheme is twofold: the focus of attention only refines regions of interest which results in a reduction of the amount of required memory and in a…

Learning Recurrent High-order Statistics for Skeleton-based Hand Gesture Recognition

Xuan Son Nguyen, Luc Brun, Olivier Lézoray +1 more

Human-Computer Interaction · · cited 7× · DOI ↗ · more like this ·

High-order statistics have been proven useful in the framework of Convolutional Neural Networks (CNN) for a variety of computer vision tasks. In this paper, we propose to exploit high-order statistics in the framework of Recurrent Neural Networks (RNN) for skeleton-based hand gesture recognition. Our method is based on the Statistical Recurrent Units (SRU), an un-gated architecture that has been introduced as an alternative model for Long-Short Term Memory (LSTM) and Gate Recurrent Unit (GRU). The SRU captures sequential information by generating recurrent statistics that depend on a context of previously seen data and by computing moving averages at different scales. The integration of high-order statistics in the SRU significantly improves the performance of the original one, resulting in a model that is competitive to state-of-the-art methods on the Dynamic Hand Gesture (DHG)…