arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Jonathan Warrell

54 papers · 2008–2026

2008: 32009: 42010: 52011: 32012: 42013: 72014: 32015: 22016: 32017: 02018: 12019: 12020: 22021: 22022: 32023: 22024: 22025: 22026: 5
2008peak 7 in 20132026

Frequent co-authors

Papers

showing 1–25 of 54 RSS

Efficient Salient Region Detection with Soft Image Abstraction

Ming‐Ming Cheng, Jonathan Warrell, Wen-Yan Lin +3 more

Computer Vision and Pattern Recognition · Institutional Knowledge (InK) - Institutional Knowledge at Singapore Management University (Singapore Management University) · · cited 576× · DOI ↗ · more like this ·

Detecting visually salient regions in images is one of the fundamental problems in computer vision. We propose a novel method to decompose an image into large scale perceptually homogeneous elements for efficient salient region detection, using a soft image abstraction representation. By considering both appearance similarity and spatial distribution of image pixels, the proposed representation abstracts out unnecessary image details, allowing the assignment of comparable saliency values across similar regions, and producing perceptually accurate salient region detection. We evaluate our salient region detection approach on the largest publicly available dataset with pixel accurate annotations. The experimental results show that the proposed method outperforms 18 alternate methods, reducing the mean absolute error by 25.2% compared to the previous best result, while being…

Superpixel lattices

Alastair Moore, Simon J. D. Prince, Jonathan Warrell +2 more

Computer Vision and Pattern Recognition · UCL Discovery (University College London) · · cited 378× · DOI ↗ · more like this ·

Unsupervised over-segmentation of an image into superpixels is a common preprocessing step for image parsing algorithms. Ideally, every pixel within each superpixel region will belong to the same real-world object. Existing algorithms generate superpixels that forfeit many useful properties of the regular topology of the original pixels: for example, the nth superpixel has no consistent position or relationship with its neighbors. We propose a novel algorithm that produces superpixels that are forced to conform to a grid (a regular superpixel lattice). Despite this added topological constraint, our algorithm is comparable in terms of speed and accuracy to alternative segmentation approaches. To demonstrate this, we use evaluation metrics based on (i) image reconstruction (ii) comparison to human-segmented images and (iii) stability of segmentation over subsequent frames of video…

Tied Factor Analysis for Face Recognition across Large Pose Differences

Simon J. D. Prince, Jonathan Warrell, James H. Elder +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 196× · DOI ↗ · more like this ·

Face recognition algorithms perform very unreliably when the pose of the probe face is different from the gallery face: typical feature vectors vary more with pose than with identity. We propose a generative model that creates a one-to-many mapping from an idealized "identity" space to the observed data space. In identity space, the representation for each individual does not vary with pose. We model the measured feature vector as being generated by a pose-contingent linear transformation of the identity variable in the presence of Gaussian noise. We term this model "tied" factor analysis. The choice of linear transformation (factors) depends on the pose, but the loadings are constant (tied) for a given individual. We use the EM algorithm to estimate the linear transformations and the noise parameters from training data. We propose a probabilistic distance metric which allows a full…

Proposal generation for object detection using cascaded ranking SVMs

Ziming Zhang, Jonathan Warrell, Philip H. S. Torr

Computer Vision and Pattern Recognition · Oxford University Research Archive (ORA) (University of Oxford) · · cited 99× · DOI ↗ · more like this ·

Object recognition has made great strides recently. However, the best methods, such as those based on kernel-SVMs are highly computationally intensive. The problem of how to accelerate the evaluation process without decreasing accuracy is thus of current interest. In this paper, we deal with this problem by using the idea of ranking. We propose a cascaded architecture which using the ranking SVM generates an ordered set of proposals for windows containing object instances. The top ranking windows may then be fed to a more complex detector. Our experiments demonstrate that our approach is robust, achieving higher overlap-recall values using fewer output proposals than the state-of-the-art. Our use of simple gradient features and linear convolution indicates that our method is also faster than the state-of-the-art.

“Lattice Cut” - Constructing superpixels using layer constraints

Alastair Moore, Simon J. D. Prince, Jonathan Warrell

Computer Vision and Pattern Recognition · · cited 71× · DOI ↗ · more like this ·

Unsupervised over-segmentation of an image into super-pixels is a common preprocessing step for image parsing algorithms. Superpixels are used as both regions of support for feature vectors and as a starting point for the final segmentation. Recent algorithms that construct superpixels that conform to a regular grid (or superpixel lattice) have used greedy solutions. In this paper we show that we can construct a globally optimal solution in either the horizontal or vertical direction using a single graph cut. The solution takes into account both edges in the image, and the coherence of the resulting superpixel regions. We show that our method outperforms existing algorithms for computing superpixel lattices. Additionally, we show that performance can be comparable or better than other contemporary segmentation algorithms which are not constrained to produce a lattice.

Dense Semantic Image Segmentation with Objects and Attributes

Shuai Zheng, Ming‐Ming Cheng, Jonathan Warrell +4 more

Computer Vision and Pattern Recognition · Oxford University Research Archive (ORA) (University of Oxford) · · cited 69× · DOI ↗ · more like this ·

The concepts of objects and attributes are both important for describing images precisely, since verbal descriptions often contain both adjectives and nouns (e.g. 'I see a shiny red chair'). In this paper, we formulate the problem of joint visual attribute and object class image segmentation as a dense multi-labelling problem, where each pixel in an image can be associated with both an object-class and a set of visual attributes labels. In order to learn the label correlations, we adopt a boosting-based piecewise training approach with respect to the visual appearance and co-occurrence cues. We use a filtering-based mean-field approximation approach for efficient joint inference. Further, we develop a hierarchical model to incorporate region-level object and attribute information. Experiments on the aPASCAL, CORE and attribute augmented NYU indoor scenes datasets show that the proposed…

Insights from Incorporating Quantum Computing into Drug Design Workflows

Bayo Lau, Prashant S. Emani, Jackson Chapman +6 more

Artificial Intelligence · bioRxiv (Cold Spring Harbor Laboratory) · · cited 47× · DOI ↗ · more like this ·

Abstract While many quantum computing (QC) methods promise theoretical advantages over classical counterparts, quantum hardware remains limited. Exploiting near-term QC in computer-aided drug design (CADD) thus requires judicious partitioning between classical and quantum calculations. We present HypaCADD, a hybrid classical-quantum workflow for finding ligands binding to proteins, while accounting for genetic mutations. We explicitly identify modules of our drug design workflow currently amenable to replacement by QC: non-intuitively, we identify the mutation-impact predictor as the best candidate. HypaCADD thus combines classical docking and molecular dynamics with quantum machine learning (QML) to infer the impact of mutations. We present a case study with the SARS-CoV-2 protease and associated mutants. We map a classical machine-learning module onto QC, using a neural network…

ImageSpirit: Verbal Guided Image Parsing

Ming-Ming Cheng, Shuai Zheng, Wen-Yan Lin +6 more

cs.GR · · cited 45× · arXiv ↗ · more like this ·

Humans describe images in terms of nouns and adjectives while algorithms operate on images represented as sets of pixels. Bridging this gap between how humans would like to access images versus their typical representation is the goal of image parsing, which involves assigning object and attribute labels to pixel. In this paper we propose treating nouns as object labels and adjectives as visual attribute labels. This allows us to formulate the image parsing problem as one of jointly estimating per-pixel object and attribute labels from a set of training images. We propose an efficient (interactive time) solution. Using the extracted labels as handles, our system empowers a user to verbally refine the results. This enables hands-free parsing of an image into pixel-wise object/attribute labels that correspond to human semantics. Verbally selecting objects of interests enables a novel and…

Labelfaces: Parsing facial features by multiclass labeling with an epitome prior

Jonathan Warrell, Simon J. D. Prince

Computer Vision and Pattern Recognition · UCL Discovery (University College London) · · cited 42× · DOI ↗ · more like this ·

We consider the problem of parsing facial features from an image labeling perspective. We learn a per-pixel unary classifier, and a prior over expected label configurations, allowing us to estimate a dense labeling of facial images by part (e.g. hair, mouth, moustache, hat). This approach deals naturally with large variations in shape and appearance characteristic of unconstrained facial images, and also the problem of detecting classes that may be present or absent. We use an Adaboost-based unary classifier, and develop a family of priors based on `epitomes' which are shown to be particularly effective in capturing the non-stationary aspects of face label distributions.

Human Instance Segmentation from Video using Detector-based Conditional Random Fields

Vibhav Vineet, Jonathan Warrell, Ľubor Ladický +1 more

Computer Vision and Pattern Recognition · Oxford University Research Archive (ORA) (University of Oxford) · · cited 30× · DOI ↗ · more like this ·

In this work, we propose a method for instance based human segmentation in images and videos, extending the recent detector-based conditional random field model of Ladicky et.al. Instance based human segmentation involves pixel level labeling of an image, partitioning it into distinct human instances and background. To achieve our goal, we add three new components to their framework. First, we include human parts-based detection potentials to take advantage of the structure present in human instances. Further, in order to generate a consistent segmentation from different human parts, we incorporate shape prior information, which biases the segmentation to characteristic overall human shapes. Also, we enhance the representative power of the energy function by adopting exemplar instance based matching terms, which helps our method to adapt easily to different human sizes and poses.…

Scene shape priors for superpixel segmentation

Alastair Moore, Simon J. D. Prince, Jonathan Warrell +2 more

Computer Vision and Pattern Recognition · UCL Discovery (University College London) · · cited 25× · DOI ↗ · more like this ·

Unsupervised over-segmentation of an image into super-pixels is a common preprocessing step for image parsing algorithms. Superpixels are used as both regions of support for feature vectors and as a starting point for the final segmentation. In this paper we investigate incorporating a priori information into superpixel segmentations. We learn a probabilistic model that describes the spatial density of the object boundaries in the image. We then describe an over-segmentation algorithm that partitions this density roughly equally between superpixels whilst still attempting to capture local object boundaries. We demonstrate this approach using road scenes where objects in the center of the image tend to be more distant and smaller than those at the edge. We show that our algorithm successfully learns this foveated spatial distribution and can exploit this knowledge to improve the…

CUDA Implementation of Deformable Pattern Recognition and its Application to MNIST Handwritten Digit Database

Yoshiki Mizukami, Katsumi Tadamura, Jonathan Warrell +2 more

Computer Vision and Pattern Recognition · · cited 15× · DOI ↗ · more like this ·

In this study we propose a deformable pattern recognition method with CUDA implementation. In order to achieve the proper correspondence between foreground pixels of input and prototype images, a pair of distance maps are generated from input and prototype images, whose pixel values are given based on the distance to the nearest foreground pixel. Then a regularization technique computes the horizontal and vertical displacements based on these distance maps. The dissimilarity is measured based on the eight-directional derivative of input and prototype images in order to leverage characteristic information on the curvature of line segments that might be lost after the deformation. The prototype-parallel displacement computation on CUDA and the gradual prototype elimination technique are employed for reducing the computational time without sacrificing the accuracy. A simulation shows that…

Improved Initialization and Gaussian Mixture Pairwise Terms for Dense Random Fields with Mean-field Inference

Vibhav Vineet, Jonathan Warrell, Paul Sturgess +1 more

Computer Vision and Pattern Recognition · Oxford University Research Archive (ORA) (University of Oxford) · · cited 10× · DOI ↗ · more like this ·

Recently, Krahenbuhl and Koltun proposed an efficient inference method for densely connected pairwise random fields using the mean-field approximation for a Conditional Random Field (CRF). However, they restrict their pairwise weights to take the form of a weighted combination of Gaussian kernels where each Gaussian component is allowed to take only zero mean, and can only be rescaled by a single value for each label pair. Further, their method is sensitive to initialization. In this paper, we propose methods to alleviate these issues. First, we propose a hierarchical mean-field approach where labelling from the coarser level is propagated to the finer level for better initialisation. Further, we use SIFT-flow based label transfer to provide a good initial condition at the coarsest level. Second, we allow our approach to take general Gaussian pairwise weights, where we learn the mean…

Quantum variational autoencoder utilizing regularized mixed-state latent representations

Gaoyuan Wang, Jonathan Warrell, Prashant S. Emani +1 more

Artificial Intelligence · Physical review. A/Physical review, A · · cited 9× · DOI ↗ · more like this ·

A major challenge in near-term quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves finding low-dimensional representations that preserve essential information for downstream analysis. In classical machine learning, variational autoencoders (VAEs) facilitate efficient data compression, representation learning for subsequent tasks, and novel data generation. However, no quantum model has been proposed that exactly captures all of these features for direct application to quantum data on quantum computers. Some existing quantum models for data compression lack regularization of latent representations, thus preventing direct use for generation and control of generalization. Others are hybrid models with only some internal quantum components, impeding direct…

Simultaneous Human Segmentation, Depth and Pose Estimation via Dual Decomposition

Glenn Sheasby, Jonathan Warrell, Yuhang Zhang +2 more

Computer Vision and Pattern Recognition · ANU Open Research (Australian National University) · · cited 9× · OpenAlex ↗ · more like this ·

The tasks of stereo matching, segmentation, and human pose estimation have been popular in computer vision in recent years, but attempts to combine the three tasks have so far resulted in compromises: either using infra-red cameras, or a greatly simplified body model. We propose a framework for estimating a detailed human skeleton in 3D from a stereo pair of images. Within this framework, we define an energy function that incorporates the relationship between the segmentation results, the pose estimation results, and the disparity space image. Specifically, we codify the assertions that foreground pixels should relate to some body part, should correspond to a continuous surface in the disparityspace image, and should be closer to the camera than the surrounding background pixels. Our energy function is NP-hard, however we show how to efficiently optimize a relaxation of it using dual…

Active object recognition using vocabulary trees

Natasha Govender, Jonathan Claassens, Fred Nicolls +1 more

Computer Vision and Pattern Recognition · · cited 8× · DOI ↗ · more like this ·

For mobile robots to perform certain tasks in human environments, fast and accurate object classification is essential. Actively exploring objects by changing viewpoints promises an increase in the accuracy of object classification. This paper presents an efficient feature-based active vision system for the recognition and verification of objects that are occluded, appear in cluttered scenes and may be visually similar to other objects present. This system is designed using a selector-observer framework where the selector is responsible for the automatic selection of the next best viewpoint and a Bayesian `observer' updates the belief hypothesis and provides feedback. A new method for automatically selecting the `next best viewpoint' is presented using vocabulary trees. It is used to calculate a weighting for each feature based on its perceived uniqueness, allowing the system to select…

A tiered move-making algorithm for general pairwise MRFs

Vibhav Vineet, Jonathan Warrell, Philip H. S. Torr

Computer Vision and Pattern Recognition · Oxford University Research Archive (ORA) (University of Oxford) · · cited 7× · DOI ↗ · more like this ·

A large number of problems in computer vision can be modeled as energy minimization problems in a markov random field (MRF) framework. Many methods have been developed over the years for efficient inference, especially in pairwise MRFs. In general there is a trade-off between the complexity/efficiency of the algorithm and its convergence properties, with certain problems requiring more complex inference to handle general pairwise potentials. Graphcuts based α-expansion performs well on certain classes of energies, and sequential tree reweighted message passing (TRWS) and loopy belief propagation (LBP) can be used for non-submodular cases. These methods though suffer from poor convergence and often oscillate between solutions. In this paper, we propose a tiered move making algorithm which is an iterative method. Each move to the next configuration is based on the current labeling and an…

A Probabilistic Dependent Type System based on Non-Deterministic Beta Reduction

Jonathan H. Warrell

cs.LO · · cited 4× · arXiv ↗ · more like this ·

We introduce Probabilistic Dependent Type Systems (PDTS) via a functional language based on a subsystem of intuitionistic type theory including dependent sums and products, which is expanded to include stochastic functions. We provide a sampling-based semantics for the language based on non-deterministic beta reduction. Further, we derive a probabilistic logic from the PDTS introduced as a direct result of the Curry-Howard isomorphism. The probabilistic logic derived is shown to provide a universal representation for finite discrete distributions.

Generalized Statistical Tests for mRNA and Protein Subcellular Spatial Patterning against Complete Spatial Randomness

Jonathan H. Warrell, Anca F. Savulescu, Robyn Brackin +1 more

stat.ML · · cited 4× · arXiv ↗ · more like this ·

We derive generalized estimators for a number of spatial statistics that have been used in the analysis of spatially resolved omics data, such as Ripley's K, H and L functions, clustering index, and degree of clustering, which allow these statistics to be calculated on data modelled by arbitrary random measures (RMs). Our estimators generalize those typically used to calculate these statistics on point process data, allowing them to be calculated on RMs which assign continuous values to spatial regions, for instance to model protein intensity. The clustering index (H*) compares Ripley's H function calculated empirically to its distribution under complete spatial randomness (CSR), leading us to consider CSR null hypotheses for RMs which are not point-processes when generalizing this statistic. We thus consider restricted classes of completely random measures which can be simulated…

Context-based additive logistic model for facial keypoint localization

Peng Li, Jonathan Warrell, Jania Aghajanian +1 more

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Facial keypoint localization is an important step for face recognition. The “Average of Synthetic Exact Filter (ASEF)” approach [2] finds a correlation filter for each training image and averages them together. The resulting classifier is efficient as the filtering can be implemented in the Fourier domain and performance is good for frontal images. However, it cannot cope with a range of poses. In this paper, we generalize this approach to find keypoints using a technique that (i) combines together information from training images in a more principled way than averaging, (ii) can be extended to form non-linear combinations of filters and (iii) can adapt based on context (e.g. pose). These innovations are presented within a greedy boosting-style probabilistic framework. We demonstrate state of the art performance of these algorithms using a challenging data set.

StyP-Boost: A Bilinear Boosting Algorithm for Learning Style-Parameterized Classifiers

Jonathan Warrell, Philip H. S. Torr, Simon Prince

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

We introduce a novel bilinear boosting algorithm, which extends the multi-class boosting framework of JointBoost to optimize a bilinear objective function. This allows style parameters to be introduced to aid classification, where style is any factor which the classes vary with systematically, modeled by a vector quantity. The algorithm allows learning to take place across different styles. We apply this Style Parameterized Boosting framework (StyP-Boost) to two object class segmentation tasks: road surface segmentation and general scene parsing. In the former the style parameters represent global surface appearance, and in the latter the probability of belonging to a scene-class. We show how our framework improves on 1) learning without style, and 2) learning independent classifiers within each style. Further, we achieve state-of-the-art results on the Corel database for scene parsing.

Epitomized priors for multi-labeling problems

Jonathan Warrell, Simon J. D. Prince, Alastair Moore

Computer Vision and Pattern Recognition · 2009 IEEE Conference on Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

Image parsing remains difficult due to the need to combine local and contextual information when labeling a scene. We approach this problem by using the epitome as a prior over label configurations. Several properties make it suited to this task. First, it allows a condensed patch-based representation. Second, efficient E-M based learning and inference algorithms can be used. Third, non-stationarity is easily incorporated. We consider three existing priors, and show how each can be extended using the epitome. The simplest prior assumes patches of labels are drawn independently from either a mixture model or an epitome. Next we investigate a `conditional epitome' model, which substitutes an epitome for a conditional mixture model. Finally, we develop an `epitome tree' model, which combines the epitome with a tree structured belief network prior. Each model is combined with a per-pixel…

Efficient privacy-preserving training of quantum neural networks through ensemble encoding of quantum states

Gaoyuan Wang, Jonathan Warrell, Mark Gerstein

Artificial Intelligence · Physical Review A · · cited 1× · DOI ↗ · more like this ·

Quantum computing is gaining popularity due to its potential to detect complex patterns in data by leveraging unique quantum phenomena. It is particularly promising for complex data applications, such as those in biomedicine. However, in these contexts, it is often necessary to share and then aggregate data from multiple participants to achieve sufficient statistical power. Sharing data, especially sensitive information such as personal medical records, raises significant privacy concerns. To address these challenges, we propose a quantum-native method for encoding entire data cohorts directly into special quantum states, which we refer to as composite states. These quantum states provide a generic encoding suitable for a wide variety of downstream computations while preventing the inference of individual-level information. Quantum computations can be performed directly on composite…

$ζ$-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations

Gaoyuan Wang, Jonathan Warrell, Prashant S. Emani +1 more

quant-ph · · cited 1× · arXiv ↗ · more like this ·

A major challenge in quantum computing is its application to large real-world datasets due to scarce quantum hardware resources. One approach to enabling tractable quantum models for such datasets involves finding low-dimensional representations that preserve essential information for downstream analysis. In classical machine learning, variational autoencoders (VAEs) facilitate efficient data compression, representation learning for subsequent tasks, and novel data generation. However, no quantum model has been proposed that captures these features for direct application to quantum data on quantum computers. Some existing quantum models for data compression lack regularization of latent representations. Others are hybrid models with only some internal quantum components, impeding direct training on quantum data. To address this, we present a fully quantum framework, $ζ$-QVAE, which…

Compression-based Network Interpretability Schemes

Jonathan Warrell, Hussein Mohsen, Mark Gerstein

Artificial Intelligence · bioRxiv (Cold Spring Harbor Laboratory) · · cited 1× · DOI ↗ · more like this ·

Abstract Deep learning methods have achieved state-of-the-art performance in many domains of artificial intelligence, but are typically hard to interpret. Network interpretation is important for multiple reasons, including knowledge discovery, hypothesis generation, fairness and establishing trust. Model transformations provide a general approach to interpreting a trained network post-hoc: the network is approximated by a model, which is typically compressed, whose structure can be more easily interpreted in some way (we call such approaches interpretability schemes ). However, the relationship between compression and interpretation has not been fully explored: How much should a network be compressed for optimal extraction of interpretable information? Should compression be combined with other criteria when selecting model transformations? We investigate these issues using two different…