arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Andrew Gilbert

153 papers · 1990–2026

1990: 11991: 01992: 01993: 01994: 01995: 11996: 11997: 11998: 01999: 02000: 12001: 02002: 32003: 02004: 12005: 12006: 12007: 02008: 42009: 52010: 32011: 92012: 52013: 32014: 22015: 72016: 82017: 52018: 82019: 72020: 112021: 52022: 112023: 152024: 122025: 132026: 9
1990peak 15 in 20232026

Frequent co-authors

Papers

showing 1–25 of 153 RSS

Total Capture: 3D Human Pose Estimation Fusing Video and Inertial Sensors

Matthew Trumble, Andrew Gilbert, Charles Malleson +2 more

Computer Vision and Pattern Recognition · View · · cited 307× · DOI ↗ · more like this ·

We present an algorithm for fusing multi-viewpoint video (MVV) with inertial measurement
\nunit (IMU) sensor data to accurately estimate 3D human pose. A 3-D convolutional
\nneural network is used to learn a pose embedding from volumetric probabilistic
\nvisual hull data (PVH) derived from the MVV frames. We incorporate this model within
\na dual stream network integrating pose embeddings derived from MVV and a forward
\nkinematic solve of the IMU data. A temporal model (LSTM) is incorporated within
\nboth streams prior to their fusion. Hybrid pose inference using these two complementary
\ndata sources is shown to resolve ambiguities within each sensor modality, yielding improved
\naccuracy over prior methods. A further contribution of this work is a new hybrid
\nMVV dataset (TotalCapture) comprising video, IMU and a skeletal joint ground…

Action Recognition Using Mined Hierarchical Compound Features

Andrew Gilbert, J. Illingworth, Richard Bowden

Computer Vision and Pattern Recognition · IEEE Transactions on Pattern Analysis and Machine Intelligence · · cited 166× · DOI ↗ · more like this ·

The field of Action Recognition has seen a large increase in activity in recent years. Much of the progress has been through incorporating ideas from single-frame object recognition and adapting them for temporal-based action recognition. Inspired by the success of interest points in the 2D spatial domain, their 3D (space-time) counterparts typically form the basic components used to describe actions, and in action recognition the features used are often engineered to fire sparsely. This is to ensure that the problem is tractable; however, this can sacrifice recognition accuracy as it cannot be assumed that the optimum features in terms of class discrimination are obtained from this approach. In contrast, we propose to initially use an overcomplete set of simple 2D corners in both space and time. These are grouped spatially and temporally using a hierarchical process, with an increasing…

Fast realistic multi-action recognition using mined dense spatio-temporal features

Andrew Gilbert, J. Illingworth, Richard Bowden

Computer Vision and Pattern Recognition · Surrey Research Insight Open Access (The University of Surrey) · · cited 160× · DOI ↗ · more like this ·

Within the field of action recognition, features and descriptors are often engineered to be sparse and invariant to transformation. While sparsity makes the problem tractable, it is not necessarily optimal in terms of class separability and classification. This paper proposes a novel approach that uses very dense corner features that are spatially and temporally grouped in a hierarchical process to produce an overcomplete compound feature set. Frequently reoccurring patterns of features are then found through data mining, designed for use with large data sets. The novel use of the hierarchical classifier allows real time operation while the approach is demonstrated to handle camera motion, scale, human appearance variations, occlusions and background clutter. The performance of classification, outperforms other state-of-the-art action recognition algorithms on the three datasets; KTH…

Real-Time Full-Body Motion Capture from Video and IMUs

Charles Malleson, Andrew Gilbert, Matthew Trumble +3 more

Computer Vision and Pattern Recognition · View · · cited 107× · DOI ↗ · more like this ·

A real-time full-body motion capture system is presented which uses input from a sparse set of inertial measurement units (IMUs) along with images from two or more standard video cameras and requires no optical markers or specialized infra-red cameras. A real-time optimization-based framework is proposed which incorporates constraints from the IMUs, cameras and a prior pose model. The combination of video and IMU data allows the full 6-DOF motion to be recovered including axial rotation of limbs and drift-free global position. The approach was tested using both indoor and outdoor captured data. The results demonstrate the effectiveness of the approach for tracking a wide range of human motion in real time in unconstrained indoor/outdoor scenes.

ChatGPT and the future of legal education and practice

Marjan Ajevski, Kim Barker, Andrew Gilbert +2 more

Political Science and International Relations · The Law Teacher · · cited 83× · DOI ↗ · more like this ·

The launch of ChatGPT, a natural language open-source AI platform, in November 2022 has taken the world by storm and artificial intelligence appears to be at a watershed moment in technological advancement. This article explores the emergence of ChatGPT and considers the implications for legal education and practice. It will examine how law schools can develop strategies for assessments to make them more challenging for generative AI while educating students on its potential in the workplace. All legal educators are now on a journey to navigate the complexities of open-source AI technology and comprehend its implications. We should not ignore or underestimate the potential impact on both legal education and legal practice, and we must consider new methods to incorporate AI technology into our teaching.

Generating Synthetic Labeled Data From Existing Anatomical Models: An Example With Echocardiography Segmentation

Andrew Gilbert, M Marciniak, Cristóbal Rodero +3 more

Computer Vision and Pattern Recognition · IEEE Transactions on Medical Imaging · · cited 81× · DOI ↗ · more like this ·

Deep learning can bring time savings and increased reproducibility to medical image analysis. However, acquiring training data is challenging due to the time-intensive nature of labeling and high inter-observer variability in annotations. Rather than labeling images, in this work we propose an alternative pipeline where images are generated from existing high-quality annotations using generative adversarial networks (GANs). Annotations are derived automatically from previously built anatomical models and are transformed into realistic synthetic ultrasound images with paired labels using a CycleGAN. We demonstrate the pipeline by generating synthetic 2D echocardiography images to compare with existing deep learning ultrasound segmentation datasets. A convolutional neural network is trained to segment the left ventricle and left atrium using only synthetic images. Networks trained with…

Fusing Visual and Inertial Sensors with Semantics for 3D Human Pose Estimation

Andrew Gilbert, Matthew Trumble, Charles Malleson +2 more

Computer Vision and Pattern Recognition · International Journal of Computer Vision · · cited 80× · DOI ↗ · more like this ·

We propose an approach to accurately estimate 3D human pose by fusing multi-viewpoint video (MVV) with inertial measurement unit (IMU) sensor data, without optical markers, a complex hardware setup or a full body model. Uniquely we use a multi-channel 3D convolutional neural network to learn a pose embedding from visual occupancy and semantic 2D pose estimates from the MVV in a discretised volumetric probabilistic visual hull. The learnt pose stream is concurrently processed with a forward kinematic solve of the IMU data and a temporal model (LSTM) exploits the rich spatial and temporal long range dependencies among the solved joints, the two streams are then fused in a final fully connected layer. The two complementary data sources allow for ambiguities to be resolved within each sensor modality, yielding improved accuracy over prior methods. Extensive evaluation is performed with…

Reflexivity in the Practice of Social Action: From Self-to Inter-Relational Reflexivity

Andrew Gilbert, Yvonne Sliep

Public Administration · South African Journal of Psychology · · cited 58× · DOI ↗ · more like this ·

We explore the nature of reflexivity in the context of social action and community work. In using the term social action, we are referring to collective action which seeks to transform the nature of local and societal conditions. We characterise such action as the creation of a social space in which stakeholders, representing different interests, come together to engage in joint activities to address issues of inequality and power. In such contexts, reflexivity is something more than the ‘self-reflexivity’ of the individual stakeholder, as social action requires a joint deconstruction of power in the voices and relationships operating between the stakeholders within a performative space. We name this form of reflexivity ‘inter-relational reflexivity’ and explore what such reflexivity may look like. We will suggest that inter-relational reflexivity goes beyond self-reflexivity and occurs…

Wonder as a tool to engage preservice elementary teachers in science learning and teaching

Andrew Gilbert, Christie C. Byers

Education · Science Education · · cited 50× · DOI ↗ · more like this ·

Abstract This exploratory project considers the use of wonder as a pedagogical tool with preservice elementary teachers (PSETs). An ongoing vexation facing science teacher educators is helping future elementary teachers overcome anxiety and negative associations with science due to their own school science experiences, while simultaneously encouraging innovative and ambitious teaching practice. Utilizing wonder as a pedagogical tool for emotional and aesthetic engagement with science holds promise as an entry point to connect future teachers with meaningful science content and practice. The link between wonder and science is well‐articulated by successful scientists throughout history, and yet is rarely employed explicitly within elementary or teacher education science learning contexts. Forging a pedagogy of wonder demands connection to the emotive embodiment of science as a uniquely…

ALADIN: All Layer Adaptive Instance Normalization for Fine-grained Style Similarity

Dan Ruta, Saeid Motiian, Baldo Faieta +5 more

cs.CV · · cited 46× · arXiv ↗ · more like this ·

We present ALADIN (All Layer AdaIN); a novel architecture for searching images based on the similarity of their artistic style. Representation learning is critical to visual search, where distance in the learned search embedding reflects image similarity. Learning an embedding that discriminates fine-grained variations in style is hard, due to the difficulty of defining and labelling style. ALADIN takes a weakly supervised approach to learning a representation for fine-grained style similarity of digital artworks, leveraging BAM-FG, a novel large-scale dataset of user generated content groupings gathered from the web. ALADIN sets a new state of the art accuracy for style-based visual search over both coarse labelled style data (BAM) and BAM-FG; a new 2.62 million image dataset of 310,000 fine-grained style groupings also contributed by this work.

Performance Comparison of Deep Learning Techniques for Recognizing Birds in Aerial Images

Yang Liu, Peng Sun, Max Highsmith +8 more

Computer Vision and Pattern Recognition · · cited 38× · DOI ↗ · more like this ·

In computer vision, significant advances have been made in recent years on object recognition and detection with the rapid development of deep learning, especially deep convolutional neural networks (CNN). The majority of deep learning methods for object detection have been developed for large objects and their performances on small-object detection are not very good. This paper contributes to research in low-resolution small-object detection by evaluating the performances of leading deep learning methods for object detection using a common dataset, which is a new dataset for bird detection, called Little Birds in Aerial Imagery (LBAI), created from real-life aerial imagery data. LBAI contains birds with sizes ranging from 10px to 40px. In our experiments, some of the best deep learning architectures were implemented and applied to LBAI, which include object detection techniques such as…

Successful Online Learning: What Does Learner Interaction with Peers, Instructors and Parents Look Like?

Whitney G. Keaton, Andrew Gilbert

Education · Journal of Online Learning Research · · cited 36× · DOI ↗ · more like this ·

The student perspective in research done in online and STEM education is largely absent but is important for understanding how both of these areas can come together to best serve students. This study uses teacher ratings, school data and student interviews to investigate the perceptions students in online STEM courses have of their past and current educational experiences. Also, using an adaptation of Moore’s Framework of Interactions (Moore, 1989), the academic and extracurricular behaviors of these students are examined in relation to their interactions others, specifically instructors, parents and peers. It was found that the interactions that students have with these stakeholders are different in this setting as compared to a traditional learning environment. Teachers in online schools serve the role of a facilitator that students felt was important to their success, but was not…

Combining discriminative and model based approaches for hand pose estimation

Philip Krejov, Andrew Gilbert, Richard Bowden

Human-Computer Interaction · View · · cited 32× · DOI ↗ · more like this ·

In this paper we present an approach to hand pose estimation that combines both discriminative and modelbased methods to overcome the limitations of each technique in isolation. A Randomised Decision Forests (RDF) is used to provide an initial estimate of the regions of the hand. This initial segmentation provides constraints to which a 3D model is fitted using Rigid Body Dynamics. Model fitting is guided using point to surface constraints which bind a kinematic model of the hand to the depth cloud using the segmentation of the discriminative approach. This combines the advantages of both techniques, reducing the training requirements for discriminative classification and simplifying the optimization process involved in model fitting by incorporating physical constraints from the segmentation. Our experiments on two challenging sequences show that this combined method outperforms the…

EKILA: Synthetic Media Provenance and Attribution for Generative Art

Kar Balan, Shruti Agarwal, Simon Jenni +3 more

cs.CV · · cited 30× · arXiv ↗ · more like this ·

We present EKILA; a decentralized framework that enables creatives to receive recognition and reward for their contributions to generative AI (GenAI). EKILA proposes a robust visual attribution technique and combines this with an emerging content provenance standard (C2PA) to address the problem of synthetic image provenance -- determining the generative model and training data responsible for an AI-generated image. Furthermore, EKILA extends the non-fungible token (NFT) ecosystem to introduce a tokenized representation for rights, enabling a triangular relationship between the asset's Ownership, Rights, and Attribution (ORA). Leveraging the ORA relationship enables creators to express agency over training consent and, through our attribution model, to receive apportioned credit, including royalty payments for the use of their assets in GenAI.

Small voices against the wind: Local knowledge and social transformation.

Andrew Gilbert

Human Factors and Ergonomics · Peace and Conflict Journal of Peace Psychology · · cited 29× · DOI ↗ · more like this ·

In all settings, people have interpretive frameworks and knowledge borne out of engaging in everyday activities. This local knowledge is tacit and contains the prior assumptions and recipes for life in the local setting. In times of rapid social change, this local knowledge is under threat, especially when change agents introduce systems of knowledge exogenous to the local milieu. This clash between the old and the new, at a cognitive level, can be a constructive force for change but it also has the potential to destroy self-esteem and the capacity to understand and manage change. Drawing on examples arising out of work in rural communities in South Africa, the dynamics of the conflict between local and exogenous knowledge during a period of social transformation are examined. Dislocations occur when people become obliged to engage in new activities whose origins lie outside the local…

A Data Augmentation Pipeline to Generate Synthetic Labeled Datasets of 3D Echocardiography Images using a GAN

Cristiana Tiago, Andrew Gilbert, Ahmed S. Beela +3 more

eess.IV · · cited 28× · arXiv ↗ · more like this ·

Due to privacy issues and limited amount of publicly available labeled datasets in the domain of medical imaging, we propose an image generation pipeline to synthesize 3D echocardiographic images with corresponding ground truth labels, to alleviate the need for data collection and for laborious and error-prone human labeling of images for subsequent Deep Learning (DL) tasks. The proposed method utilizes detailed anatomical segmentations of the heart as ground truth label sources. This initial dataset is combined with a second dataset made up of real 3D echocardiographic images to train a Generative Adversarial Network (GAN) to synthesize realistic 3D cardiovascular Ultrasound images paired with ground truth labels. To generate the synthetic 3D dataset, the trained GAN uses high resolution anatomical models from Computed Tomography (CT) as input. A qualitative analysis of the synthesized…

Overview of the ImageCLEF 2015 Scalable Image Annotation, Localization and Sentence Generation task

Andrew Gilbert, Luca Piras, Josiah Wang +5 more

Computer Vision and Pattern Recognition · HAL (Le Centre pour la Communication Scientifique Directe) · · cited 28× · OpenAlex ↗ · more like this ·

The ImageCLEF 2015 Scalable Image Annotation, Localization and Sentence Generation task was the fourth edition of a challenge aimed at developing more scalable image annotation systems. In particular this year the focus of the three subtasks available to participants had the goal to develop techniques to allow computers to reliably describe images, localize the different concepts depicted in the images and generate a description of the scene. All three tasks use a single mixed modality data source of 500,000 web page items which included raw images, textual features obtained from the web pages on which the images appeared, as well as various visual features extracted from the images themselves. Unlike previous years the test set was also the training set and in this edition of the task hand-labelled data has been allowed. The images were obtained from the Web by querying popular image…

Dayton at twenty: towards new politics in Bosnia-Herzegovina

Andrew Gilbert, Jasmin Mujanović

Cultural Studies · Journal of Southeast European and Black Sea Studies · · cited 27× · DOI ↗ · more like this ·

The Dayton Agreement continues to be mentioned as a potential model by Western politicians and pundits for various conflicts and sectarian violence around the globe, most recently for Syria, Ukraine and Iraq. Indeed, the Dayton Agreement is rightly associated by Bosnians and foreigners alike with the end of war and the absence of renewed armed conflict. However, for most people in BiH it is also associated with ushering in a political-economic order of inequality and dispossession, not only of the means of dignified livelihood, but of a future and the agentive capacities to shape that future. For this reason, most long-time observers caution against seeing BiH as a ‘success story,’ or at least recognizing it as one with a morbid after-life. The articles in this collection make clear that negotiations for peace between warring parties may not be the best conditions under which to design…

UPGPT: Universal Diffusion Model for Person Image Generation, Editing and Pose Transfer

Soon Yau Cheong, Armin Mustafa, Andrew Gilbert

cs.CV · · cited 26× · arXiv ↗ · more like this ·

Text-to-image models (T2I) such as StableDiffusion have been used to generate high quality images of people. However, due to the random nature of the generation process, the person has a different appearance e.g. pose, face, and clothing, despite using the same text prompt. The appearance inconsistency makes T2I unsuitable for pose transfer. We address this by proposing a multimodal diffusion model that accepts text, pose, and visual prompting. Our model is the first unified method to perform all person image tasks - generation, pose transfer, and mask-less edit. We also pioneer using small dimensional 3D body model parameters directly to demonstrate new capability - simultaneous pose and camera view interpolation while maintaining the person's appearance.

Constraining the discourse community: How science discourse perpetuates marginalization of underrepresented students

Randy Yerrick, Andrew Gilbert

Education · Journal of Multicultural Discourses · · cited 25× · DOI ↗ · more like this ·

Abstract This ethnographic study examines how lower-track rural African American students make sense of their position in school and what role school science discourse plays in their micro-cultural identity formation. The objectives of the study are to determine the science discourse's role in (1) determining access to knowledge, (2) affecting lower-track students' perceptions of school, and (3) perpetuating lower-track science students' identity. The constraints identified with lower-track science classroom discourse are strong hegemonic factors in determining students' behaviors, beliefs, and social and academic positions in the school hierarchy. Other school discourse practices involving disciplinary measures and counselor recommended tracking round out a strong arsenal to maintain students' perceived place in school. Implications for rethinking science classroom discourse are…

Deep Convolutional Networks for Marker-less Human Pose Estimation from Multiple Views

Matthew Trumble, Andrew Gilbert, Adrian Hilton +1 more

Computer Vision and Pattern Recognition · Surrey Research Insight Open Access (The University of Surrey) · · cited 22× · DOI ↗ · more like this ·

We propose a human performance capture system employing convolutional neural networks (CNN) to estimate human pose from a volumetric representation of a performer derived from multiple view-point video (MVV).We compare direct CNN pose regression to the performance of an affine invariant pose descriptor learned by a CNN through a classification task. A non-linear manifold embedding is learned between the descriptor and articulated pose spaces, enabling regression of pose from the source MVV. The results are evaluated against ground truth pose data captured using a Vicon marker-based system and demonstrate good generalisation over a range of human poses, providing a system that requires no special suit to be worn by the performer.

Eroding dipoles and vorticity growth for Euler flows in $ \scriptstyle{\mathbb{R}}^3$ I. Axisymmetric flow without swirl

Stephen Childress, Andrew D. Gilbert, Paul Valiant

physics.flu-dyn · · cited 22× · arXiv ↗ · more like this ·

A review of analyses based upon anti-parallel vortex structures suggests that structurally stable vortex structures with eroding circulation may offer a path to the study of rapid vorticity growth in solutions of Euler's equations in $ \scriptstyle{\mathbb{R}}^3$. We examine here the possible formation of such a structure in axisymmetric flow without swirl, leading to maximal growth of vorticity as $t^{4/3}$. Our study suggests that the optimizing flow giving the $t^{4/3}$ growth mimics an exact solution of Euler's equations representing an eroding toroidal vortex dipole which locally conserves kinetic energy. The dipole cross-section is a perturbation of the classical Sadovskii dipole having piecewise constant vorticity, which breaks the symmetry of closed streamlines. The structure of this perturbed Sadovskii dipole is analyzed asymptotically at large times, and its predicted…

There and Back Again: Exploring Teacher Attrition and Mobility with Two Transitioning Science Teachers

Andrew Gilbert

Education · Journal of Science Teacher Education · · cited 20× · DOI ↗ · more like this ·

This study chronicled the professional journeys of two beginning science teachers. The focus of the research effort documents what brought them to science teaching and investigated their resulting career paths. Data artifacts for this instrumental case study approach included: interviews, written survey responses, personal communications and member checks. All data was transcribed and coded into emergent categories using a constant comparative analysis approach. The findings indicated that their decisions to enter and leave teaching were a complex mélange of issues that included career disposition, notions of isolation, overarching culture of the school, and future possibilities. However, most striking was their re-entry into teaching on a temporary basis after considerable time away from the classroom, which suggests that teachers develop a sense of agency regarding their career…

Capturing the relative distribution of features for action recognition

Olusegun Oshin, Andrew Gilbert, Richard Bowden

Computer Vision and Pattern Recognition · View · · cited 20× · DOI ↗ · more like this ·

This paper presents an approach to the categorisation of spatio-temporal activity in video, which is based solely on the relative distribution of feature points. Introducing a Relative Motion Descriptor for actions in video, we show that the spatio-temporal distribution of features alone (without explicit appearance information) effectively describes actions, and demonstrate performance consistent with state-of-the-art. Furthermore, we propose that for actions where noisy examples exist, it is not optimal to group all action examples as a single class. Therefore, rather than engineering features that attempt to generalise over noisy examples, our method follows a different approach: We make use of Random Sampling Consensus (RANSAC) to automatically discover and reject outlier examples within classes. We evaluate the Relative Motion Descriptor and outlier rejection approaches on four…

StyleBabel: Artistic Style Tagging and Captioning

Dan Ruta, Andrew Gilbert, Pranav Aggarwal +9 more

cs.CV · · cited 19× · arXiv ↗ · more like this ·

We present StyleBabel, a unique open access dataset of natural language captions and free-form tags describing the artistic style of over 135K digital artworks, collected via a novel participatory method from experts studying at specialist art and design schools. StyleBabel was collected via an iterative method, inspired by `Grounded Theory': a qualitative approach that enables annotation while co-evolving a shared language for fine-grained artistic style attribute description. We demonstrate several downstream tasks for StyleBabel, adapting the recent ALADIN architecture for fine-grained style similarity, to train cross-modal embeddings for: 1) free-form tag generation; 2) natural language description of artistic style; 3) fine-grained text search of style. To do so, we extend ALADIN with recent advances in Visual Transformer (ViT) and cross-modal representation learning, achieving a…