arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Marc Modat

84 papers · 2010–2026

2010: 32011: 42012: 72013: 42014: 52015: 32016: 22017: 32018: 62019: 122020: 72021: 102022: 72023: 22024: 52025: 32026: 1
2010peak 12 in 20192026

Frequent co-authors

Papers

showing 1–25 of 84 RSS

NiftyNet: a deep-learning platform for medical imaging

Eli Gibson, Wenqi Li, Carole Sudre +14 more

cs.CV · · cited 572× · arXiv ↗ · more like this ·

Medical image analysis and computer-assisted intervention problems are increasingly being addressed with deep-learning-based solutions. Established deep-learning platforms are flexible but do not provide specific functionality for medical image analysis and adapting them for this application requires substantial implementation effort. Thus, there has been substantial duplication of effort and incompatible infrastructure developed across many research groups. This work presents the open-source NiftyNet platform for deep learning in medical imaging. The ambition of NiftyNet is to accelerate and simplify the development of these solutions, and to provide a common mechanism for disseminating research outputs for the community to use, adapt and build upon. NiftyNet provides a modular deep-learning pipeline for a range of medical imaging applications including segmentation, regression, image…

Weakly-Supervised Convolutional Neural Networks for Multimodal Image Registration

Yipeng Hu, Marc Modat, Eli Gibson +11 more

cs.CV · · cited 450× · arXiv ↗ · more like this ·

One of the fundamental challenges in supervised learning for multimodal image registration is the lack of ground-truth for voxel-level spatial correspondence. This work describes a method to infer voxel-level transformation from higher-level correspondence information contained in anatomical labels. We argue that such labels are more reliable and practical to obtain for reference sets of image pairs than voxel-level correspondence. Typical anatomical labels of interest may include solid organs, vessels, ducts, structure boundaries and other subject-specific ad hoc landmarks. The proposed end-to-end convolutional neural network approach aims to predict displacement fields to align multiple labelled corresponding structures for individual image pairs during the training, while only unlabelled image pairs are used as the network input for inference. We highlight the versatility of the…

Global image registration using a symmetric block-matching approach

Marc Modat, David M. Cash, Pankaj Daga +3 more

Computer Vision and Pattern Recognition · Journal of Medical Imaging · · cited 388× · DOI ↗ · more like this ·

Most medical image registration algorithms suffer from a directionality bias that has been shown to largely impact subsequent analyses. Several approaches have been proposed in the literature to address this bias in the context of nonlinear registration, but little work has been done for global registration. We propose a symmetric approach based on a block-matching technique and least-trimmed square regression. The proposed method is suitable for multimodal registration and is robust to outliers in the input images. The symmetric framework is compared with the original asymmetric block-matching technique and is shown to outperform it in terms of accuracy and robustness. The methodology presented in this article has been made available to the community as part of the NiftyReg open-source package.

Geodesic Information Flows: Spatially-Variant Graphs and Their Application to Segmentation and Fusion

M. Jorge Cardoso, Marc Modat, Robin Wolz +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Medical Imaging · · cited 360× · DOI ↗ · more like this ·

Clinical annotations, such as voxel-wise binary or probabilistic tissue segmentations, structural parcellations, pathological regions-of-interest and anatomical landmarks are key to many clinical studies. However, due to the time consuming nature of manually generating these annotations, they tend to be scarce and limited to small subsets of data. This work explores a novel framework to propagate voxel-wise annotations between morphologically dissimilar images by diffusing and mapping the available examples through intermediate steps. A spatially-variant graph structure connecting morphologically similar subjects is introduced over a database of images, enabling the gradual diffusion of information to all the subjects, even in the presence of large-scale morphological variability. We illustrate the utility of the proposed framework on two example applications: brain parcellation using…

Accurate multimodal probabilistic prediction of conversion to Alzheimer's disease in patients with mild cognitive impairment

Jonathan Young, Marc Modat, Manuel J. Cardoso +3 more

Artificial Intelligence · NeuroImage Clinical · · cited 254× · DOI ↗ · more like this ·

Accurately identifying the patients that have mild cognitive impairment (MCI) who will go on to develop Alzheimer's disease (AD) will become essential as new treatments will require identification of AD patients at earlier stages in the disease process. Most previous work in this area has centred around the same automated techniques used to diagnose AD patients from healthy controls, by coupling high dimensional brain image data or other relevant biomarker data to modern machine learning techniques. Such studies can now distinguish between AD patients and controls as accurately as an experienced clinician. Models trained on patients with AD and control subjects can also distinguish between MCI patients that will convert to AD within a given timeframe (MCI-c) and those that remain stable (MCI-s), although differences between these groups are smaller and thus, the corresponding accuracy…

STEPS: Similarity and Truth Estimation for Propagated Segmentations and its application to hippocampal segmentation and brain parcelation

M. Jorge Cardoso, Kelvin K. Leung, Marc Modat +5 more

Computer Vision and Pattern Recognition · Medical Image Analysis · · cited 250× · DOI ↗ · more like this ·

Anatomical segmentation of structures of interest is critical to quantitative analysis in medical imaging. Several automated multi-atlas based segmentation propagation methods that utilise manual delineations from multiple templates appear promising. However, high levels of accuracy and reliability are needed for use in diagnosis or in clinical trials. We propose a new local ranking strategy for template selection based on the locally normalised cross correlation (LNCC) and an extension to the classical STAPLE algorithm by Warfield et al. (2004), which we refer to as STEPS for Similarity and Truth Estimation for Propagated Segmentations. It addresses the well-known problems of local vs. global image matching and the bias introduced in the performance estimation due to structure size. We assessed the method on hippocampal segmentation using a leave-one-out cross validation with optimised…

Symptom clusters in COVID-19: A potential clinical prediction tool from the COVID Symptom Study app

Carole H. Sudre, Karla A. Lee, Mary Ní Lochlainn +9 more

Artificial Intelligence · Science Advances · · cited 180× · DOI ↗ · more like this ·

As no one symptom can predict disease severity or the need for dedicated medical support in coronavirus disease 2019 (COVID-19), we asked whether documenting symptom time series over the first few days informs outcome. Unsupervised time series clustering over symptom presentation was performed on data collected from a training dataset of completed cases enlisted early from the COVID Symptom Study Smartphone application, yielding six distinct symptom presentations. Clustering was validated on an independent replication dataset between 1 and 28 May 2020. Using the first 5 days of symptom logging, the ROC-AUC (receiver operating characteristic - area under the curve) of need for respiratory support was 78.8%, substantially outperforming personal characteristics alone (ROC-AUC 69.5%). Such an approach could be used to monitor at-risk patients and predict medical resource requirements days…

Evaluation of Six Registration Methods for the Human Abdomen on Clinically Acquired CT

Zhoubing Xu, Christopher P. Lee, Mattias P. Heinrich‬ +5 more

Computer Vision and Pattern Recognition · IEEE Transactions on Biomedical Engineering · · cited 179× · DOI ↗ · more like this ·

OBJECTIVE: This work evaluates current 3-D image registration tools on clinically acquired abdominal computed tomography (CT) scans. METHODS: Thirteen abdominal organs were manually labeled on a set of 100 CT images, and the 100 labeled images (i.e., atlases) were pairwise registered based on intensity information with six registration tools (FSL, ANTS-CC, ANTS-QUICK-MI, IRTK, NIFTYREG, and DEEDS). The Dice similarity coefficient (DSC), mean surface distance, and Hausdorff distance were calculated on the registered organs individually. Permutation tests and indifference-zone ranking were performed to examine the statistical and practical significance, respectively. RESULTS: The results suggest that DEEDS yielded the best registration performance. However, due to the overall low DSC values, and substantial portion of low-performing outliers, great care must be taken when image…

Label-driven weakly-supervised learning for multimodal deformable image registration

Yipeng Hu, Marc Modat, Eli Gibson +7 more

cs.CV · · cited 164× · arXiv ↗ · more like this ·

Spatially aligning medical images from different modalities remains a challenging task, especially for intraoperative applications that require fast and robust algorithms. We propose a weakly-supervised, label-driven formulation for learning 3D voxel correspondence from higher-level label correspondence, thereby bypassing classical intensity-based image similarity measures. During training, a convolutional neural network is optimised by outputting a dense displacement field (DDF) that warps a set of available anatomical labels from the moving image to match their corresponding counterparts in the fixed image. These label pairs, including solid organs, ducts, vessels, point landmarks and other ad hoc structures, are only required at training time and can be spatially aligned by minimising a cross-entropy function of the warped moving label and the fixed label. During inference, the…

Generative AI for Medical Imaging: extending the MONAI Framework

Walter H. L. Pinaya, Mark S. Graham, Eric Kerfoot +21 more

eess.IV · · cited 133× · arXiv ↗ · more like this ·

Recent advances in generative AI have brought incredible breakthroughs in several areas, including medical imaging. These generative models have tremendous potential not only to help safely share medical data via synthetic datasets but also to perform an array of diverse applications, such as anomaly detection, image-to-image translation, denoising, and MRI reconstruction. However, due to the complexity of these models, their implementation and reproducibility can be difficult. This complexity can hinder progress, act as a use barrier, and dissuade the comparison of new methods with existing works. In this study, we present MONAI Generative Models, a freely available open-source platform that allows researchers and developers to easily train, evaluate, and deploy generative models and related applications. Our platform reproduces state-of-art studies in a standardised way involving…

Detecting COVID-19 infection hotspots in England using large-scale self-reported data from a mobile application: a prospective, observational study

Thomas Varsavsky, Mark S. Graham, Liane S. Canas +9 more

Modeling and Simulation · The Lancet Public Health · · cited 95× · DOI ↗ · more like this ·

BACKGROUND: As many countries seek to slow the spread of COVID-19 without reimposing national restrictions, it has become important to track the disease at a local level to identify areas in need of targeted intervention. METHODS: In this prospective, observational study, we did modelling using longitudinal, self-reported data from users of the COVID Symptom Study app in England between March 24, and Sept 29, 2020. Beginning on April 28, in England, the Department of Health and Social Care allocated RT-PCR tests for COVID-19 to app users who logged themselves as healthy at least once in 9 days and then reported any symptom. We calculated incidence of COVID-19 using the invited swab (RT-PCR) tests reported in the app, and we estimated prevalence using a symptom-based method (using logistic regression) and a method based on both symptoms and swab test results. We used incidence rates to…

Automatic Structural Parcellation of Mouse Brain MRI Using Multi-Atlas Label Fusion

Da Ma, Manuel J. Cardoso, Marc Modat +8 more

Computer Vision and Pattern Recognition · PLoS ONE · · cited 82× · DOI ↗ · more like this ·

Multi-atlas segmentation propagation has evolved quickly in recent years, becoming a state-of-the-art methodology for automatic parcellation of structural images. However, few studies have applied these methods to preclinical research. In this study, we present a fully automatic framework for mouse brain MRI structural parcellation using multi-atlas segmentation propagation. The framework adopts the similarity and truth estimation for propagated segmentations (STEPS) algorithm, which utilises a locally normalised cross correlation similarity metric for atlas selection and an extended simultaneous truth and performance level estimation (STAPLE) framework for multi-label fusion. The segmentation accuracy of the multi-atlas framework was evaluated using publicly available mouse brain atlas databases with pre-segmented manually labelled anatomical structures as the gold standard, and…

A Nonlinear Biomechanical Model Based Registration Method for Aligning Prone and Supine MR Breast Images

Lianghao Han, John H. Hipwell, Björn Eiben +4 more

Computer Vision and Pattern Recognition · IEEE Transactions on Medical Imaging · · cited 75× · DOI ↗ · more like this ·

Preoperative diagnostic magnetic resonance (MR) breast images can provide good contrast between different tissues and 3-D information about suspicious tissues. Aligning preoperative diagnostic MR images with a patient in the theatre during breast conserving surgery could assist surgeons in achieving the complete excision of cancer with sufficient margins. Typically, preoperative diagnostic MR breast images of a patient are obtained in the prone position, while surgery is performed in the supine position. The significant shape change of breasts between these two positions due to gravity loading, external forces and related constraints makes the alignment task extremely difficult. Our previous studies have shown that either nonrigid intensity-based image registration or biomechanical modelling alone are limited in their ability to capture such a large deformation. To tackle this problem…

Parametric non-rigid registration using a stationary velocity field

Marc Modat, Pankaj Daga, M. Jorge Cardoso +3 more

Computer Vision and Pattern Recognition · Research Portal (King's College London) · · cited 47× · DOI ↗ · more like this ·

The Free-Form Deformation (FFD) algorithm is a widely-used approach for non-rigid registration. Modifications have previously been proposed to ensure topology preservation and invertibility within this framework. However, in practice, none of these yield the inverse transformation itself, and one loses the parsimonious B-spline parameterisation. We present a novel log-Euclidean FFD approach, in which a spline model of a stationary velocity field is exponentiated to yield a diffeomorphism, using an efficient scaling-and-squaring algorithm. The log-Euclidean framework allows easy computation of a consistent inverse transformation, and offers advantages in group-wise atlas building and statistical analysis. We optimise the Normalised Mutual Information plus a regularisation term based on the Jacobian determinant of the velocity field. The proposed method has been assessed against the…

Improving 3D medical image registration CUDA software with genetic programming

William B. Langdon, Marc Modat, Justyna Petke +1 more

Artificial Intelligence · Research Portal (King's College London) · · cited 45× · DOI ↗ · more like this ·

Genetic Improvement (GI) is shown to optimise, in some cases by more than 35percent, a critical component of healthcare industry software across a diverse range of six nVidia graphics processing units (GPUs). GP and other search based software engineering techniques can automatically optimise the current rate limiting CUDA parallel function in the NiftyReg open source C++ project used to align or register high resolution nuclear magnetic resonance NMRI and other diagnostic NIfTI images. Future Neurosurgery techniques will require hardware acceleration, such as GPGPU, to enable real time comparison of three dimensional in theatre images with earlier patient images and reference data. With millimetre resolution brain scan measurements comprising more than ten million voxels the modified kernel can process in excess of 3 billion active voxels per second.

Probabilistic non-linear registration with spatially adaptive regularisation

Ivor Simpson, M. Jorge Cardoso, Marc Modat +5 more

Computer Vision and Pattern Recognition · Medical Image Analysis · · cited 44× · DOI ↗ · more like this ·

This paper introduces a novel method for inferring spatially varying regularisation in non-linear registration. This is achieved through full Bayesian inference on a probabilistic registration model, where the prior on the transformation parameters is parameterised as a weighted mixture of spatially localised components. Such an approach has the advantage of allowing the registration to be more flexibly driven by the data than a traditional globally defined regularisation penalty, such as bending energy. The proposed method adaptively determines the influence of the prior in a local region. The strength of the prior may be reduced in areas where the data better support deformations, or can enforce a stronger constraint in less informative areas. Consequently, the use of such a spatially adaptive prior may reduce unwanted impacts of regularisation on the inferred transformation. This is…

Using Manifold Learning for Atlas Selection in Multi-Atlas Segmentation

Albert K. Hoang Duc, Marc Modat, Kelvin K. Leung +5 more

Computer Vision and Pattern Recognition · PLoS ONE · · cited 44× · DOI ↗ · more like this ·

Multi-atlas segmentation has been widely used to segment various anatomical structures. The success of this technique partly relies on the selection of atlases that are best mapped to a new target image after registration. Recently, manifold learning has been proposed as a method for atlas selection. Each manifold learning technique seeks to optimize a unique objective function. Therefore, different techniques produce different embeddings even when applied to the same data set. Previous studies used a single technique in their method and gave no reason for the choice of the manifold learning technique employed nor the theoretical grounds for the choice of the manifold parameters. In this study, we compare side-by-side the results given by 3 manifold learning techniques (Isomap, Laplacian Eigenmaps and Locally Linear Embedding) on the same data set. We assess the ability of those 3…

Diffeomorphic demons using normalized mutual information, evaluation on multimodal brain MR images

Marc Modat, Tom Vercauteren, Gerard R. Ridgway +3 more

Computer Vision and Pattern Recognition · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · · cited 32× · DOI ↗ · more like this ·

The demons algorithm is a fast non-parametric non-rigid registration method. In recent years great efforts have been made to improve the approach; the state of the art version yields symmetric inverse-consistent largedeformation diffeomorphisms. However, only limited work has explored inter-modal similarity metrics, with no practical evaluation on multi-modality data. We present a diffeomorphic demons implementation using the analytical gradient of Normalised Mutual Information (NMI) in a conjugate gradient optimiser. We report the first qualitative and quantitative assessment of the demons for inter-modal registration. Experiments to spatially normalise real MR images, and to recover simulated deformation fields, demonstrate (i) similar accuracy from NMI-demons and classical demons when the latter may be used, and (ii) similar accuracy for NMI-demons on T1w-T1w and T1w-T2w…

Joint registration and synthesis using a probabilistic model for alignment of MRI and histological sections

Juan Eugenio Iglesias, Marc Modat, Loic Peter +6 more

cs.CV · · cited 30× · arXiv ↗ · more like this ·

Nonlinear registration of 2D histological sections with corresponding slices of MRI data is a critical step of 3D histology reconstruction. This task is difficult due to the large differences in image contrast and resolution, as well as the complex nonrigid distortions produced when sectioning the sample and mounting it on the glass slide. It has been shown in brain MRI registration that better spatial alignment across modalities can be obtained by synthesizing one modality from the other and then using intra-modality registration metrics, rather than by using mutual information (MI) as metric. However, such an approach typically requires a database of aligned images from the two modalities, which is very difficult to obtain for histology/MRI. Here, we overcome this limitation with a probabilistic method that simultaneously solves for registration and synthesis directly on the target…

Robust training of recurrent neural networks to handle missing data for disease progression modeling

Mostafa Mehdipour Ghazi, Mads Nielsen, Akshay Pai +4 more

cs.CV · · cited 27× · arXiv ↗ · more like this ·

Disease progression modeling (DPM) using longitudinal data is a challenging task in machine learning for healthcare that can provide clinicians with better tools for diagnosis and monitoring of disease. Existing DPM algorithms neglect temporal dependencies among measurements and make parametric assumptions about biomarker trajectories. In addition, they do not model multiple biomarkers jointly and need to align subjects' trajectories. In this paper, recurrent neural networks (RNNs) are utilized to address these issues. However, in many cases, longitudinal cohorts contain incomplete data, which hinders the application of standard RNNs and requires a pre-processing step such as imputation of the missing values. We, therefore, propose a generalized training rule for the most widely used RNN architecture, long short-term memory (LSTM) networks, that can handle missing values in both target…

Multi-STEPS: Multi-label similarity and truth estimation for propagated segmentations

M. Jorge Cardoso, Marc Modat, Sébastien Ourselin +2 more

Computer Vision and Pattern Recognition · UCL Discovery (University College London) · · cited 25× · DOI ↗ · more like this ·

Quantitative analysis in medical imaging often relies on anatomical segmentation of MR or CT images. Several multi-atlas based segmentation propagation methods have recently been published due to the accurate structural segmentations produced by propagating and combining manual delineations from multiple templates in a database. We propose a new multi-label local ranking strategy for template selection based on the locally normalised cross correlation (LNCC) and an extension to the classical STAPLE algorithm by Warfield et al. [15]. It addresses the known problem of local vs. global image matching and the bias introduced in the performance estimation due to structure size. Results show a significant improvement in terms of segmentation accuracy for key brain areas when compared to state-of-the-art brain parcelation algorithms and reduced discontinuity and fragmentation between…

Robust joint registration of multiple stains and MRI for multimodal 3D histology reconstruction: Application to the Allen human brain atlas

Adrià Casamitjana, Marco Lorenzi, Sebastiano Ferraris +6 more

eess.IV · · cited 23× · arXiv ↗ · more like this ·

Joint registration of a stack of 2D histological sections to recover 3D structure (``3D histology reconstruction'') finds application in areas such as atlas building and validation of \emph{in vivo} imaging. Straightforward pairwise registration of neighbouring sections yields smooth reconstructions but has well-known problems such as ``banana effect'' (straightening of curved structures) and ``z-shift'' (drift). While these problems can be alleviated with an external, linearly aligned reference (e.g., Magnetic Resonance (MR) images), registration is often inaccurate due to contrast differences and the strong nonlinear distortion of the tissue, including artefacts such as folds and tears. In this paper, we present a probabilistic model of spatial deformation that yields reconstructions for multiple histological stains that that are jointly smooth, robust to outliers, and follow the…

Simultaneous synthesis of FLAIR and segmentation of white matter hypointensities from T1 MRIs

Mauricio Orbes-Arteaga, M. Jorge Cardoso, Lauge Sørensen +4 more

cs.CV · · cited 17× · arXiv ↗ · more like this ·

Segmenting vascular pathologies such as white matter lesions in Brain magnetic resonance images (MRIs) require acquisition of multiple sequences such as T1-weighted (T1-w) --on which lesions appear hypointense-- and fluid attenuated inversion recovery (FLAIR) sequence --where lesions appear hyperintense--. However, most of the existing retrospective datasets do not consist of FLAIR sequences. Existing missing modality imputation methods separate the process of imputation, and the process of segmentation. In this paper, we propose a method to link both modality imputation and segmentation using convolutional neural networks. We show that by jointly optimizing the imputation network and the segmentation network, the method not only produces more realistic synthetic FLAIR images from T1-w images, but also improves the segmentation of WMH from T1-w images only.

A Multi-Channel Uncertainty-Aware Multi-Resolution Network for MR to CT Synthesis

Kerstin Kläser, Pedro Borges, Richard Shaw +9 more

Computer Vision and Pattern Recognition · Applied Sciences · · cited 14× · DOI ↗ · more like this ·

Synthesising computed tomography (CT) images from magnetic resonance images (MRI) plays an important role in the field of medical image analysis, both for quantification and diagnostic purposes. Convolutional neural networks (CNNs) have achieved state-of-the-art results in image-to-image translation for brain applications. However, synthesising whole-body images remains largely uncharted territory, involving many challenges, including large image size and limited field of view, complex spatial context, and anatomical differences between images acquired at different times. We propose the use of an uncertainty-aware multi-channel multi-resolution 3D cascade network specifically aiming for whole-body MR to CT synthesis. The Mean Absolute Error on the synthetic CT generated with the MultiResunc network (73.90 HU) is compared to multiple baseline CNNs like 3D U-Net (92.89 HU), HighRes3DNet…

A multi-path approach to histology volume reconstruction

Jonas Pichat, Marc Modat, Tarek Yousry +1 more

Artificial Intelligence · UCL Discovery (University College London) · · cited 12× · DOI ↗ · more like this ·

This paper presents a method for correcting erratic pairwise registrations when reconstructing a volume from 2D histology slices. Due to complex and unpredictable alterations of the content of histology images, a pairwise rigid registration between two adjacent slices may fail systematically. Conversely, a neighbouring registration, which potentially involves one of these two slices, will work. This grounds our approach: using correct spatial correspondences established through neighbouring registrations to account for direct failures. We propose to search the best alignment of every couple of adjacent slices from a finite set of transformations that involve neighbouring slices in a transitive fashion. Using the proposed method, we obtained reconstructed volumes with increased coherence compared to the classical pairwise approach, both in synthetic and real data.