arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Stuart Perry

35 papers · 1995–2026

1995: 11996: 21997: 01998: 01999: 02000: 12001: 02002: 62003: 12004: 12005: 02006: 02007: 02008: 02009: 12010: 12011: 02012: 02013: 02014: 02015: 02016: 02017: 12018: 02019: 22020: 42021: 12022: 12023: 32024: 42025: 42026: 1
1995peak 6 in 20022026

Frequent co-authors

Papers

showing 1–25 of 35 RSS

Weight assignment for adaptive image restoration by neural networks

Stuart Perry, Ling Guan

Computer Vision and Pattern Recognition · IEEE Transactions on Neural Networks · · cited 58× · DOI ↗ · more like this ·

This paper presents a scheme for adaptively training the weights, in terms of varying the regularization parameter, in a neural network for the restoration of digital images. The flexibility of neural-network-based image restoration algorithms easily allow the variation of restoration parameters such as blur statistics and regularization value spatially and temporally within the image. This paper focuses on spatial variation of the regularization parameter.We first show that the previously proposed neural-network method based on gradient descent can only find suboptimal solutions, and then introduce a regional processing approach based on local statistics. A method is presented to vary the regularization parameter spatially. This method is applied to a number of images degraded by various levels of noise, and the results are examined. The method is also applied to an image degraded by…

Recall What You See Continually Using GridLSTM in Image Captioning

Lingxiang Wu, Min Xu, Jinqiao Wang +1 more

Computer Vision and Pattern Recognition · IEEE Transactions on Multimedia · · cited 47× · DOI ↗ · more like this ·

The goal of image captioning is to automatically describe an image with a sentence, and the task has attracted research attention from both the computer vision and natural-language processing research communities. The existing encoder-decoder model and its variants, which are the most popular models for image captioning, use the image features in three ways: first, they inject the encoded image features into the decoder only once at the initial step, which does not enable the rich image content to be explored sufficiently while gradually generating a text caption; second, they concatenate the encoded image features with text as extra inputs at every step, which introduces unnecessary noise; and, third, they using an attention mechanism, which increases the computational complexity due to the introduction of extra neural nets to identify the attention regions. Different from the existing…

Aircraft flight parameter estimation using acoustical Lloyd's mirror effect

K.W. Lo, Stuart Perry, B.G. Ferguson

Signal Processing · IEEE Transactions on Aerospace and Electronic Systems · · cited 37× · DOI ↗ · more like this ·

A model is developed for the acoustical Lloyd's mirror effect observed in the output time-frequency distribution of a microphone located near the ground during the transit of a jet aircraft. The feasibility of using this effect for flight parameter estimation is assessed by a simple Cramer-Rao lower bound analysis. The nonlinear least-squares method and the generalized Hough transform method are formulated for flight parameter estimation. The performances of both methods are evaluated and compared using real acoustic data.

QUALINET White Paper on Definitions of Immersive Media Experience (IMEx)

Andrew Perkis, Christian Timmerer, Sabina Baraković +41 more

cs.MM · · cited 21× · arXiv ↗ · more like this ·

With the coming of age of virtual/augmented reality and interactive media, numerous definitions, frameworks, and models of immersion have emerged across different fields ranging from computer graphics to literary works. Immersion is oftentimes used interchangeably with presence as both concepts are closely related. However, there are noticeable interdisciplinary differences regarding definitions, scope, and constituents that are required to be addressed so that a coherent understanding of the concepts can be achieved. Such consensus is vital for paving the directionality of the future of immersive media experiences (IMEx) and all related matters. The aim of this white paper is to provide a survey of definitions of immersion and presence which leads to a definition of immersive media experience (IMEx). The Quality of Experience (QoE) for immersive media is described by establishing a…

Objective Quality Assessment Metrics for Light Field Image Based on Textural Features

Huy Phi Cong, Stuart Perry, Eva Cheng +1 more

Computer Vision and Pattern Recognition · Electronics · · cited 11× · DOI ↗ · more like this ·

Light Field (LF) imaging is a plenoptic data collection method enabling a wide variety of image post-processing such as 3D extraction, viewpoint change and digital refocusing. Moreover, LF provides the capability to capture rich information about a scene, e.g., texture, geometric information, etc. Therefore, a quality assessment model for LF images is needed and poses significant challenges. Many LF Image Quality Assessment (LF-IQA) metrics have been recently presented based on the unique characteristics of LF images. The state-of-the-art objective assessment metrics have taken into account the image content and human visual system such as SSIM and IW-SSIM. However, most of these metrics are designed for images and video with natural content. Additionally, other models based on the LF characteristics (e.g., depth information, angle information) trade high performance for high…

Comparison of Remote Subjective Assessment Strategies in the Context of the JPEG Pleno Point Cloud Activity

Stuart Perry, Luís A. da Silva Cruz, Emil Dumić +3 more

Computer Vision and Pattern Recognition · Infoscience (Ecole Polytechnique Fédérale de Lausanne) · · cited 10× · DOI ↗ · more like this ·

In this work we compare two different options to perform on-line subjective quality assessment experiments in the context of the Call for Evidence on JPEG Pleno Point Cloud Coding. A deep-learning based point cloud codec submitted to the Call was tested against current MPEG point cloud compression methods. The first option is based on participants downloading the entire set of stimuli and running a set of scripts in MATLAB to perform the experiment. The second option involves the participants accessing a server on the web and viewing and judging the stimuli using a web browser. Quality scores compiled using both methods were compared showing strong correlation. A second analysis compared the quality scores with those obtained in a prior laboratory-based study using higher resolution screens. The entire study also brought to light each option’s unique advantages and disadvantages that…

Perception based adaptive image restoration

Stuart Perry, Ling Guan

Computer Vision and Pattern Recognition · · cited 9× · DOI ↗ · more like this ·

This paper presents an image restoration technique which uses a cost function based on a novel image error measure. The cost function presented here takes into account local statistical information of the image when performing restoration. It is shown that this technique compares favourably with other techniques, especially when applied to colour images.

Neural vision system and applications in image processing and analysis

Ling Guan, Stuart Perry, Raniero Romagnoli +2 more

Artificial Intelligence · · cited 6× · DOI ↗ · more like this ·

We present a computer vision system based on an integrated neural network architecture. In the low level vision subsystem, a network of networks-a biologically inspired network is used to recursively perform filtering, segmentation and edge detection; in the intermediate level and the high level, hierarchically structured arrays of self-organizing tree maps-extension of the popular self-organizing map are utilized to carry out image/feature analysis. The system has been applied to solve a number of real world problems. Some interesting and encouraging results are reported.

3D point cloud reconstruction from a single 4D light field image

Helia Farhood, Stuart Perry, Eva Cheng +1 more

Computer Vision and Pattern Recognition · UTS ePRESS (University of Technology Sydney) · · cited 5× · DOI ↗ · more like this ·

Obtaining accurate and noise-free three-dimensional (3D) reconstructions from real world scenes has grown in importance in recent decades. In this paper, we propose a novel strategy for the reconstruction of a 3D point cloud of an object from a single 4D light field (LF) image based on the transformation of point-plane correspondences. Considering a 4D LF image as an input, we first estimate the depth map using point correspondences between sub-aperture images. We then apply histogram equalization and histogram stretching to enhance the separation between depth planes. The main aim of this step is to increase the distance between adjacent depth layers and to enhance the depth map. We then detect edge contours of the original image using fast canny edge detection, and combine linearly the result with that of the previous steps. Following this combination, by transforming the point-plane…

An image processing approach for aircraft flight parameter estimation using the acoustical Lloyd's mirror effect

K.W. Lo, Stuart Perry, B.G. Ferguson

Computer Vision and Pattern Recognition · · cited 5× · DOI ↗ · more like this ·

A time-frequency analysis of the output of an acoustic sensor located above the ground during the transit of an aircraft shows an interference (or fringe) pattern on the time-frequency plane. This interference pattern, referred to as the Lloyd's mirror effect, is caused by the temporal variations of the constructive/destructive interference frequencies of the direct and ground-reflected aircraft sound fields at the sensor. A model has been developed to describe the temporal variations of the destructive-interference frequencies for an aircraft in level flight over a hard ground. This paper describes two methods to estimate the aircraft flight parameters based on this model. In both methods, the time-frequency distribution of the sensor output is treated as an image. This image is pre-processed to enhance the destructive-interference pattern and then the flight parameters are extracted…

ReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather Conditions

Wenfeng Huang, Guoan Xu, Wenjing Jia +2 more

cs.CV · · cited 4× · arXiv ↗ · more like this ·

Images captured in challenging environments--such as nighttime, smoke, rainy weather, and underwater--often suffer from significant degradation, resulting in a substantial loss of visual quality. The effective restoration of these degraded images is critical for the subsequent vision tasks. While many existing approaches have successfully incorporated specific priors for individual tasks, these tailored solutions limit their applicability to other degradations. In this work, we propose a universal network architecture, dubbed ``ReviveDiff'', which can address various degradations and bring images back to life by enhancing and restoring their quality. Our approach is inspired by the observation that, unlike degradation caused by movement or electronic issues, quality degradation under adverse conditions primarily stems from natural media (such as fog, water, and low luminance), which…

JPEG Pleno Call for Proposals Responses Quality Assessment

João Prazeres, Zhe Luo, António Pinheiro +2 more

Computer Vision and Pattern Recognition · · cited 4× · DOI ↗ · more like this ·

In this paper, the quality evaluation of the responses to the Call for Proposals (CfP) of JPEG Pleno Point Cloud Coding is presented. Three responses to the CfP were evaluated together with the state of the art anchor codecs G-PCC and VPCC from MPEG. The JPEG committee selected a set of eight point clouds that were encoded at different pre-established bitrates. For the subjective evaluation of the responses to the CfP, a set of video sequences were created where the reference and distorted decoded point clouds were rotated about their axes side by side. Furthermore, the objective quality metrics PCQM, PSNR D1, PSNR D2, PSNR Y and PSNR YUV were computed, and compared with the subjective evaluation results. This study revealed that the deep learning solutions outperformed G-PCC but were still below the performance of V-PCC regarding color representation. PCQM showed the best performance…

A low complexity Wyner-Ziv coding solution for Light Field image transmission and storage

Huy Phi Cong, Stuart Perry, Xiem HoangVan

Computer Vision and Pattern Recognition · UTS ePRESS (University of Technology Sydney) · · cited 3× · DOI ↗ · more like this ·

Compressing Light Field (LF) imaging data is a challenging but very important task for both LF image transmission and storage applications. In this paper, we propose a novel coding solution for LF images using the well-known Wyner-Ziv (WZ) information theorem. First, the LF image is decomposed into a fourth-dimensional LF(4D-LF) data format. Using a spiral scanning procedure, a pseudo-sequence of 4D-LF is generated. This sequence is then compressed in a distributed coding manner as specified in the WZ theorem. Secondly, a novel adaptive frame skipping algorithm is introduced to further explore the high correlation between 4D-LF pseudo- sequences. Experimental results show that the proposed LF image compression solution is able to achieve a significant performance improvement with respect to the standard, notably around 54% bitrate saving when compared with the standard High Efficiency…

Restoration of images degraded by space-variant distortion using a neural network

Stuart Perry, Ling Guan

Computer Vision and Pattern Recognition · · cited 3× · DOI ↗ · more like this ·

This paper introduces a neural network algorithm to the restoration of images suffering a known form of space-variant distortion. Using multiple weighting matrices to represent space-variance, the algorithm provides high quality restorations. The algorithm will also be shown to be very computationally inexpensive due to the ability to minimise the neural network's energy in the most efficient manner.

Adaptive Content Frame Skipping for Wyner–Ziv-Based Light Field Image Compression

Huy Phi Cong, Stuart Perry, Xiem HoangVan

Computer Vision and Pattern Recognition · Electronics · · cited 2× · DOI ↗ · more like this ·

Light field (LF) imaging introduces attractive possibilities for digital imaging, such as digital focusing, post-capture changing of the focal plane or view point, and scene depth estimation, by capturing both spatial and angular information of incident light rays. However, LF image compression is still a great challenge, not only due to light field imagery requiring a large amount of storage space and a large transmission bandwidth, but also due to the complexity requirements of various applications. In this paper, we propose a novel LF adaptive content frame skipping compression solution by following a Wyner–Ziv (WZ) coding approach. In the proposed coding approach, the LF image is firstly converted into a four-dimensional LF (4D-LF) data format. To achieve good compression performance, we select an efficient scanning mechanism to generate a 4D-LF pseudo-sequence by analyzing the…

Joint exploration model based light field image coding: A comparative study

Huy Phi Cong, Stuart Perry, Trinh Anh Vu +1 more

Computer Vision and Pattern Recognition · UTS ePRESS (University of Technology Sydney) · · cited 2× · DOI ↗ · more like this ·

The recent light field imaging technology has been attracting a lot of interests due to its potential applications in a large number of areas including Virtual Reality, Augmented Reality (VR/AR), Teleconferencing, and E-learning. Light Field (LF) data is able to provide rich visual information such as scene rendering with changes in depth of field, viewpoint, and focal length. However, Light Field data usually associates to a critical problem — the massive data. Therefore, compressing LF data is one of the main challenges in LF research. In this context, we present in this paper a comparative study for compressing LF data with not only the widely used image/video coding standards, such as JPEG-2000, H.264/AVC, HEVC and Google/VP9 but also with the most recent image/video coding solution, the Joint Exploration Model. In addition, this paper also proposes a LF image coding flow, which can…

Adaptive motion-compensated temporal filtering of sector scan sonar image sequences

Bin Shen, Stuart Perry, Donald Fraser

Computer Vision and Pattern Recognition · OCEANS'10 IEEE SYDNEY · · cited 2× · DOI ↗ · more like this ·

We present an adaptive weighted temporal averaging filter with implicit motion-compensation for effective object enhancement in sector scan sonar image sequences. Visual blurring artifacts introduced by the temporal filtering process due to motion of the sonar platform are minimized by accurate motion estimation and compensation. An algorithm is proposed to perform object boundary extraction for better motion estimation. Motion estimation is performed directly on polar image sequences using cross-correlation followed by a Minimum Mean Square Error (MMSE) method. Each pixel of the filtered image is computed as the weighted average of the image pixel values over successive frames after motion compensation. The performance of the proposed filter is tested using real sector scan sonar image sequences and the results are compared with those obtained using the temporal averaging and motion…

Paper Fingerprinting Using alpha-Masked Image Matching

Tuan Q. Pham, Stuart Perry, Peter A. Fletcher

Computer Vision and Pattern Recognition · UTS ePRESS (University of Technology Sydney) · · cited 2× · DOI ↗ · more like this ·

In this paper, we examine the problem of authenticating paper media using the unique fiber structure of each piece of paper (the so-called "paper fingerprint"). In particular, we look at methods to authenticate paper media when text has been printed over the authentication zone. We show how alpha-masked correlation can be applied to this problem and develop a modification to alpha-masked correlation that is more closely matched to the requirements of this problem and produces an improvement in performance. We also investigate two methods of pixel inpainting to remove printed text or marks from the authentication zone and allow ordinary correlation to be performed. We show that these methods can perform as well as alpha-masked correlation. Finally two methods of improving the robustness to forgery are investigated.

Adaptive image restoration using a perception based error measurement

Stuart Perry, Pedram Varjavandi, Ling Guan

Computer Vision and Pattern Recognition · · cited 2× · DOI ↗ · more like this ·

This paper deals with image restoration; we have developed a novel, perceptually inspired image restoration method which takes human perception knowledge into consideration to reverse the effects of blur. Instead of using a conventional greyscale based error measurement such as the MSE, we compare local statistical information about regions in two images using a new error measure. The new method provides a better appraisal of image quality in terms of human vision. We extended the popular constrained least square error cost function by incorporating this novel image error measure. Using the well known Karush-Kuhn-Tucker theorem, we have mathematically verified that there exists an optimal solution to this nonlinear constrained optimization problem in terms of the Hopfield neural network. We show that the new restoration algorithm visually restores images as well as the previously…

Efficiency–Accuracy Trade-Off in Light Field Estimation with Cost Volume Construction and Aggregation

Bo Xiao, Stuart Perry, Xiujing Gao +1 more

Computer Vision and Pattern Recognition · Sensors · · cited 1× · DOI ↗ · more like this ·

The Rich spatial and angular information in light field images enables accurate depth estimation, which is a crucial aspect of environmental perception. However, the abundance of light field information also leads to high computational costs and memory pressure. Typically, selectively pruning some light field information can significantly improve computational efficiency but at the expense of reduced depth estimation accuracy in the pruned model, especially in low-texture regions and occluded areas where angular diversity is reduced. In this study, we propose a lightweight disparity estimation model that balances speed and accuracy and enhances depth estimation accuracy in textureless regions. We combined cost matching methods based on absolute difference and correlation to construct cost volumes, improving both accuracy and robustness. Additionally, we developed a multi-scale disparity…

A statistics-based weight assignment in a Hopfield neural network for adaptive image restoration

Stuart Perry, Ling Guan

Computer Vision and Pattern Recognition · · cited 1× · DOI ↗ · more like this ·

This paper investigates the assignment of weights to a Hopfield-based neural network in adaptive image restoration. The network is given a range of possible weights which are functions of a constraint factor to suppress noise in the restored image. Two methods for choosing the optimal weights are investigated. The first method is the traditional gradient descent method based on choosing the constraint value which best minimizes the neural network energy function for each pixel during each iteration of the algorithm. It is shown that, contrary to our intuition, this method does not produce optimal results. We then propose a second method which is based on selecting each neurons constraint value by considering local image statistics before restoration is commenced. It is shown that this method compares favourably with other neural network image restoration techniques.

DET-GS: Depth- and Edge-Aware Regularization for High-Fidelity 3D Gaussian Splatting

Zexu Huang, Min Xu, Stuart Perry

cs.CV · · cited 0× · arXiv ↗ · more like this ·

3D Gaussian Splatting (3DGS) represents a significant advancement in the field of efficient and high-fidelity novel view synthesis. Despite recent progress, achieving accurate geometric reconstruction under sparse-view conditions remains a fundamental challenge. Existing methods often rely on non-local depth regularization, which fails to capture fine-grained structures and is highly sensitive to depth estimation noise. Furthermore, traditional smoothing methods neglect semantic boundaries and indiscriminately degrade essential edges and textures, consequently limiting the overall quality of reconstruction. In this work, we propose DET-GS, a unified depth and edge-aware regularization framework for 3D Gaussian Splatting. DET-GS introduces a hierarchical geometric depth supervision framework that adaptively enforces multi-level geometric consistency, significantly enhancing structural…

JPEG Status and Progress Report 2024

Siegfried Föessel, Elena Alshina, Marc Antonini +9 more

Computer Vision and Pattern Recognition · SMPTE Motion Imaging Journal · · cited 0× · DOI ↗ · more like this ·

This is an updated report of the work of the Joint Technical Committee of the International Standardization Committee and the International Organization for Standardization (ISO/IEC JTC1 SC29/WG1), better known as the JPEG (Joint Photographic Experts Group) Committee. A detailed introduction to JPEG's work has already been presented.1, 2 In this report, the focus is on the new work items since 2022. Maintenance work is also carried out but won't be described here. An overview of all JPEG work items is provided in the timetable presented in Fig. 1.

MacFormer: Semantic Segmentation with Fine Object Boundaries

Guoan Xu, Wenfeng Huang, Tao Wu +5 more

cs.CV · · cited 0× · arXiv ↗ · more like this ·

Semantic segmentation involves assigning a specific category to each pixel in an image. While Vision Transformer-based models have made significant progress, current semantic segmentation methods often struggle with precise predictions in localized areas like object boundaries. To tackle this challenge, we introduce a new semantic segmentation architecture, ``MacFormer'', which features two key components. Firstly, using learnable agent tokens, a Mutual Agent Cross-Attention (MACA) mechanism effectively facilitates the bidirectional integration of features across encoder and decoder layers. This enables better preservation of low-level features, such as elementary edges, during decoding. Secondly, a Frequency Enhancement Module (FEM) in the decoder leverages high-frequency and low-frequency components to boost features in the frequency domain, benefiting object boundaries with minimal…