arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Simon Graham

68 papers · 2004–2026

2004: 12005: 02006: 02007: 12008: 02009: 02010: 02011: 02012: 12013: 12014: 02015: 02016: 02017: 12018: 92019: 32020: 52021: 92022: 82023: 142024: 42025: 52026: 6
2004peak 14 in 20232026

Frequent co-authors

Papers

showing 1–25 of 68 RSS

Methods for Segmentation and Classification of Digital Microscopy Tissue Images

Quoc Dang Vu, Simon Graham, Minh Nguyen Nhat To +11 more

cs.CV · · cited 352× · arXiv ↗ · more like this ·

High-resolution microscopy images of tissue specimens provide detailed information about the morphology of normal and diseased tissue. Image analysis of tissue morphology can help cancer researchers develop a better understanding of cancer biology. Segmentation of nuclei and classification of tissue images are two common tasks in tissue image analysis. Development of accurate and efficient algorithms for these tasks is a challenging problem because of the complexity of tissue morphology and tumor heterogeneity. In this paper we present two computer algorithms; one designed for segmentation of nuclei and the other for classification of whole slide tissue images. The segmentation algorithm implements a multiscale deep residual aggregation network to accurately segment nuclear material and then separate clumped nuclei into individual nuclei. The classification algorithm initially carries…

PanNuke Dataset Extension, Insights and Baselines

Jevgenij Gamper, Navid Alemi Koohbanani, Ksenija Benes +6 more

eess.IV · · cited 278× · arXiv ↗ · more like this ·

The emerging area of computational pathology (CPath) is ripe ground for the application of deep learning (DL) methods to healthcare due to the sheer volume of raw pixel data in whole-slide images (WSIs) of cancerous tissue slides. However, it is imperative for the DL algorithms relying on nuclei-level details to be able to cope with data from `the clinical wild', which tends to be quite challenging. We study, and extend recently released PanNuke dataset consisting of ~200,000 nuclei categorized into 5 clinically important classes for the challenging tasks of segmenting and classifying nuclei in WSIs. Previous pan-cancer datasets consisted of only up to 9 different tissues and up to 21,000 unlabeled nuclei and just over 24,000 labeled nuclei with segmentation masks. PanNuke consists of 19 different tissue types that have been semi-automatically annotated and quality controlled by…

Development and validation of a weakly supervised deep learning framework to predict the status of molecular pathways and key mutations in colorectal cancer from routine histology images: a retrospective study

Mohsin Bilal, Shan E Ahmed Raza, Ayesha Azam +6 more

Artificial Intelligence · The Lancet Digital Health · · cited 277× · DOI ↗ · more like this ·

BACKGROUND: Determining the status of molecular pathways and key mutations in colorectal cancer is crucial for optimal therapeutic decision making. We therefore aimed to develop a novel deep learning pipeline to predict the status of key molecular pathways and mutations from whole-slide images of haematoxylin and eosin-stained colorectal cancer slides as an alternative to current tests. METHODS: ). These scores were used to identify the top-ranked titles from each slide, and model 3 (HoVer-Net) segmented and classified the different types of cell nuclei in these tiles. We calculated the area under the convex hull of the receiver operating characteristic curve (AUROC) as a model performance measure and compared our results with those of previously published methods. FINDINGS: that was similar to previously reported methods (0·60 [SD 0·04] vs 0·60). Mean AUROC for predicting CIMP-high…

CGC-Net: Cell Graph Convolutional Network for Grading of Colorectal Cancer Histology Images

Yanning Zhou, Simon Graham, Navid Alemi Koohbanani +3 more

eess.IV · · cited 221× · arXiv ↗ · more like this ·

Colorectal cancer (CRC) grading is typically carried out by assessing the degree of gland formation within histology images. To do this, it is important to consider the overall tissue micro-environment by assessing the cell-level information along with the morphology of the gland. However, current automated methods for CRC grading typically utilise small image patches and therefore fail to incorporate the entire tissue micro-architecture for grading purposes. To overcome the challenges of CRC grading, we present a novel cell-graph convolutional neural network (CGC-Net) that converts each large histology image into a graph, where each node is represented by a nucleus within the original image and cellular interactions are denoted as edges between these nodes according to node similarity. The CGC-Net utilises nuclear appearance features in addition to the spatial location of nodes to…

MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge

Ruchika Verma, Neeraj Kumar, Abhijeet Patil +9 more

Artificial Intelligence · IEEE Transactions on Medical Imaging · · cited 200× · DOI ↗ · more like this ·

Detecting various types of cells in and around the tumor matrix holds a special significance in characterizing the tumor micro-environment for cancer prognostication and research. Automating the tasks of detecting, segmenting, and classifying nuclei can free up the pathologists' time for higher value tasks and reduce errors due to fatigue and subjectivity. To encourage the computer vision research community to develop and test algorithms for these tasks, we prepared a large and diverse dataset of nucleus boundary annotations and class labels. The dataset has over 46,000 nuclei from 37 hospitals, 71 patients, four organs, and four nucleus types. We also organized a challenge around this dataset as a satellite event at the International Symposium on Biomedical Imaging (ISBI) in April 2020. The challenge saw a wide participation from across the world, and the top methods were able to match…

One Model is All You Need: Multi-Task Learning Enables Simultaneous Histology Image Segmentation and Classification

Simon Graham, Quoc Dang Vu, Mostafa Jahanifar +4 more

eess.IV · · cited 153× · arXiv ↗ · more like this ·

The recent surge in performance for image analysis of digitised pathology slides can largely be attributed to the advances in deep learning. Deep models can be used to initially localise various structures in the tissue and hence facilitate the extraction of interpretable features for biomarker discovery. However, these models are typically trained for a single task and therefore scale poorly as we wish to adapt the model for an increasing number of different tasks. Also, supervised deep learning models are very data hungry and therefore rely on large amounts of training data to perform well. In this paper, we present a multi-task learning approach for segmentation and classification of nuclei, glands, lumina and different tissue regions that leverages data from multiple independent data sources. While ensuring that our tasks are aligned by the same tissue type and resolution, we enable…

Fast ScanNet: Fast and Dense Analysis of Multi-Gigapixel Whole-Slide Images for Cancer Metastasis Detection

Huangjing Lin, Hao Chen, Simon Graham +3 more

Artificial Intelligence · IEEE Transactions on Medical Imaging · · cited 126× · DOI ↗ · more like this ·

Lymph node metastasis is one of the most important indicators in breast cancer diagnosis, that is traditionally observed under the microscope by pathologists. In recent years, with the dramatic advance of high-throughput scanning and deep learning technology, automatic analysis of histology from whole-slide images has received a wealth of interest in the field of medical image computing, which aims to alleviate pathologists' workload and simultaneously reduce misdiagnosis rate. However, the automatic detection of lymph node metastases from whole-slide images remains a key challenge because such images are typically very large, where they can often be multiple gigabytes in size. Also, the presence of hard mimics may result in a large number of false positives. In this paper, we propose a novel method with anchor layers for model conversion, which not only leverages the efficiency of…

TIAToolbox as an end-to-end library for advanced tissue image analytics

Johnathan Pocock, Simon Graham, Quoc Dang Vu +9 more

Artificial Intelligence · Communications Medicine · · cited 114× · DOI ↗ · more like this ·

Background: Computational pathology has seen rapid growth in recent years, driven by advanced deep-learning algorithms. Due to the sheer size and complexity of multi-gigapixel whole-slide images, to the best of our knowledge, there is no open-source software library providing a generic end-to-end API for pathology image analysis using best practices. Most researchers have designed custom pipelines from the bottom up, restricting the development of advanced algorithms to specialist users. To help overcome this bottleneck, we present TIAToolbox, a Python toolbox designed to make computational pathology accessible to computational, biomedical, and clinical researchers. Methods: By creating modular and configurable components, we enable the implementation of computational pathology algorithms in a way that is easy to use, flexible and extensible. We consider common sub-tasks including…

CoNIC Challenge: Pushing the Frontiers of Nuclear Detection, Segmentation, Classification and Counting

Simon Graham, Quoc Dang Vu, Mostafa Jahanifar +86 more

cs.CV · · cited 75× · arXiv ↗ · more like this ·

Nuclear detection, segmentation and morphometric profiling are essential in helping us further understand the relationship between histology and patient outcome. To drive innovation in this area, we setup a community-wide challenge using the largest available dataset of its kind to assess nuclear segmentation and cellular composition. Our challenge, named CoNIC, stimulated the development of reproducible algorithms for cellular recognition with real-time result inspection on public leaderboards. We conducted an extensive post-challenge analysis based on the top-performing models using 1,658 whole-slide images of colon tissue. With around 700 million detected nuclei per model, associated features were used for dysplasia grading and survival analysis, where we demonstrated that the challenge's improvement over the previous state-of-the-art led to significant boosts in downstream…

SAMS-NET: Stain-aware multi-scale network for instance-based nuclei segmentation in histology images

Simon Graham, Nasir Rajpoot

Artificial Intelligence · · cited 64× · DOI ↗ · more like this ·

Segmentation of nuclear material in histology slides is an important step in the digital pathology work-flow, due to the ability for nuclei to act as key diagnostic markers. Manual segmentation can be a laborious task, where pathologists are often required to analyse many nuclei within a whole slide image (WSI). The rise in digital pathology has been matched with an increase in interest for automated nuclei segmentation in Hematoxylin & Eosin (H&E) stained histology images, yet this remains a challenge due to the heterogeneous appearance of different types of nuclei. This heterogeneity can lead to nuclei having a variable Hematoxylin intensity, which often has detrimental effects on the success of current methods. We propose a deep multi-scale neural network, with a novel loss function that is sensitive to the Hematoxylin intensity, for precise object-level nuclei segmentation. We show…

Semantic annotation for computational pathology: Multidisciplinary experience and best practice recommendations

Noorul Wahab, Islam M Miligy, Katherine Dodd +24 more

eess.IV · · cited 63× · arXiv ↗ · more like this ·

Recent advances in whole slide imaging (WSI) technology have led to the development of a myriad of computer vision and artificial intelligence (AI) based diagnostic, prognostic, and predictive algorithms. Computational Pathology (CPath) offers an integrated solution to utilize information embedded in pathology WSIs beyond what we obtain through visual assessment. For automated analysis of WSIs and validation of machine learning (ML) models, annotations at the slide, tissue and cellular levels are required. The annotation of important visual constructs in pathology images is an important component of CPath projects. Improper annotations can result in algorithms which are hard to interpret and can potentially produce inaccurate and inconsistent results. Despite the crucial role of annotations in CPath projects, there are no well-defined guidelines or best practices on how annotations…

Capturing Cellular Topology in Multi-Gigapixel Pathology Images

Wenqi Lu, Simon Graham, Mohsin Bilal +2 more

Artificial Intelligence · · cited 55× · DOI ↗ · more like this ·

In computational pathology, multi-gigapixel whole slide images (WSIs) are typically divided into small patches because of their extremely large size and memory requirements. However, following this strategy, one risks losing visual context which is very important in the development of machine learning models aimed at diagnostic and prognostic assessment of WSIs. In this paper, we propose a novel graph convolutional neural network based model (called Slide Graph) which overcomes these limitations by building a graph representation of the cellular architecture in an entire WSI in a bottom-up manner. We evaluate Slide Graph for prediction of the status of human epidermal growth factor receptor 2 (HER2) and progesterone receptor (PR) expression from WSIs of H&E stained tissue slides of breast cancer. We demonstrate that the proposed model outperforms previous state-of-the-art methods and is…

The urban–remote divide for Indigenous perinatal outcomes

Simon Graham, Lisa Jackson Pulver, Yueping Alex Wang +4 more

Health · The Medical Journal of Australia · · cited 49× · DOI ↗ · more like this ·

OBJECTIVE: To determine whether remoteness category of residence of Indigenous women affects the perinatal outcomes of their newborn infants. DESIGN AND PARTICIPANTS: A population-based study of 35 240 mothers identified as Indigenous and their 35 658 babies included in the National Perinatal Data Collection in 2001-2004. MAIN OUTCOME MEASURES: Australian Standard Geographical Classification remoteness category, birthweight, Apgar score at 5 minutes, stillbirth, gestational age and a constructed measure of perinatal outcomes of babies called "healthy baby" (live birth, singleton, 37-41 completed weeks' gestation, 2500-4499 g birthweight, and an Apgar score at 5 minutes >or= 7). RESULTS: The proportion of healthy babies in remote, regional and city areas was 74.9%, 77.7% and 77.6%, respectively. After adjusting for age, parity, smoking and diabetes or hypertension, babies born to mothers…

The brain basis of handwriting deficits in Chinese children with developmental dyslexia

Yang Yang, Zhentao Zuo, Fred Tam +8 more

Education · Developmental Science · · cited 47× · DOI ↗ · more like this ·

Abundant behavioral studies have demonstrated high comorbidity of reading and handwriting difficulties in developmental dyslexia (DD), a neurological condition characterized by unexpectedly low reading ability despite adequate nonverbal intelligence and typical schooling. The neural correlates of handwriting deficits remain largely unknown; however, as well as the extent that handwriting deficits share common neural bases with reading deficits in DD. The present work used functional magnetic resonance imaging to examine brain activity during handwriting and reading tasks in Chinese dyslexic children (n = 18) and age-matched controls (n = 23). Compared to controls, dyslexic children exhibited reduced activation during handwriting tasks in brain regions supporting sensory-motor processing (including supplementary motor area and postcentral gyrus) and visual-orthography processing…

Mitosis Detection, Fast and Slow: Robust and Efficient Detection of Mitotic Figures

Mostafa Jahanifar, Adam Shephard, Neda Zamanitajeddin +4 more

cs.CV · · cited 44× · arXiv ↗ · more like this ·

Counting of mitotic figures is a fundamental step in grading and prognostication of several cancers. However, manual mitosis counting is tedious and time-consuming. In addition, variation in the appearance of mitotic figures causes a high degree of discordance among pathologists. With advances in deep learning models, several automatic mitosis detection algorithms have been proposed but they are sensitive to {\em domain shift} often seen in histology images. We propose a robust and efficient two-stage mitosis detection framework, which comprises mitosis candidate segmentation ({\em Detecting Fast}) and candidate refinement ({\em Detecting Slow}) stages. The proposed candidate segmentation model, termed \textit{EUNet}, is fast and accurate due to its architectural design. EUNet can precisely segment candidates at a lower resolution to considerably speed up candidate detection. Candidates…

Evaluation of tumour infiltrating lymphocytes in luminal breast cancer using artificial intelligence

Shorouk Makhlouf, Noorul Wahab, Michael S. Toss +9 more

Artificial Intelligence · British Journal of Cancer · · cited 43× · DOI ↗ · more like this ·

BACKGROUND: Tumour infiltrating lymphocytes (TILs) are a prognostic parameter in triple-negative and human epidermal growth factor receptor 2 (HER2)-positive breast cancer (BC). However, their role in luminal (oestrogen receptor positive and HER2 negative (ER + /HER2-)) BC remains unclear. In this study, we used artificial intelligence (AI) to assess the prognostic significance of TILs in a large well-characterised cohort of luminal BC. METHODS: Supervised deep learning model analysis of Haematoxylin and Eosin (H&E)-stained whole slide images (WSI) was applied to a cohort of 2231 luminal early-stage BC patients with long-term follow-up. Stromal TILs (sTILs) and intratumoural TILs (tTILs) were quantified and their spatial distribution within tumour tissue, as well as the proportion of stroma involved by sTILs were assessed. The association of TILs with clinicopathological parameters and…

Aboriginal peoples’ perspectives about COVID-19 vaccines and motivations to seek vaccination: a qualitative study

Simon Graham, Megan Blaxland, Reuben Bolt +9 more

Health · BMJ Global Health · · cited 41× · DOI ↗ · more like this ·

INTRODUCTION: Aboriginal and Torres Strait Islander (Aboriginal) people compared with non-Aboriginal people in Australia have higher rates of chronic conditions. These conditions increase the risk of poorer health outcomes if infected with COVID-19, highlighting the importance of COVID-19 vaccination. This study examined what Aboriginal people think about COVID-19 vaccines, reasons why they were vaccinated or not vaccinated and factors involved in receiving COVID-19 vaccination. METHODS: We used a participatory peer researcher method to interview 35 Aboriginal people aged 15-80 years living in Western Sydney, Australia. Local Aboriginal people who had ties with the community conducted the interviews. The questions and analyses were framed using the WHO's Behavioural and Social Drivers of COVID-19 model. Interviews occurred between February 2021 and March 2021. Peer researchers were paid…

Men and women differ in the neural basis of handwriting

Yang Yang, Fred Tam, Simon J. Graham +7 more

Education · Human Brain Mapping · · cited 40× · DOI ↗ · more like this ·

There is an ongoing debate about whether, and to what extent, males differ from females in their language skills. In the case of handwriting, a composite language skill involving language and motor processes, behavioral observations consistently show robust sex differences but the mechanisms underlying the effect are unclear. Using functional magnetic resonance imaging (fMRI) in a copying task, the present study examined the neural basis of sex differences in handwriting in 53 healthy adults (ages 19-28, 27 males). Compared to females, males showed increased activation in the left posterior middle frontal gyrus (Exner's area), a region thought to support the conversion between orthographic and graphomotor codes. Functional connectivity between Exner's area and the right cerebellum was greater in males than in females. Furthermore, sex differences in brain activity related to handwriting…

Classification of lung cancer histology images using patch-level summary statistics

Syed Ali Khurram, Simon Graham, Muhammad Shaban +2 more

Artificial Intelligence · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · · cited 34× · DOI ↗ · more like this ·

There are two main types of lung cancer: small cell lung cancer (SCLC) and non-small cell lung cancer (NSCLC), which are grouped accordingly due to similarity in behaviour and response to treatment. The main types of NSCLC are lung adenocarcinoma (LUAD), which accounts for about 40% of all lung cancers and lung squamous cell carcinoma (LUSC), which accounts for about 25-30% of all lung cancers. Due to their differences, automated classification of these two main subtypes of NSCLC is a critical step in developing a computer aided diagnostic system. We present an automated method for NSCLC classification, that consists of a two-part approach. Firstly, we implement a deep learning framework to classify input patches as LUAD, LUSC or non-diagnostic (ND). Next, we extract a collection of statistical and morphological measurements from the labeled whole-slide image (WSI) and use a random…

Novel deep learning algorithm predicts the status of molecular pathways and key mutations in colorectal cancer from routine histology images

Mohsin Bilal, Shan E Ahmed Raza, Ayesha Azam +6 more

Artificial Intelligence · medRxiv · · cited 30× · DOI ↗ · more like this ·

Summary Background Determining molecular pathways involved in the development of colorectal cancer (CRC) and knowing the status of key mutations are crucial for deciding optimal target therapy. The goal of this study is to explore machine learning to predict the status of the three main CRC molecular pathways – microsatellite instability (MSI), chromosomal instability (CIN), CpG island methylator phenotype (CIMP) – and to detect BRAF and TP53 mutations as well as to predict hypermutated (HM) CRC tumors from whole-slide images (WSIs) of colorectal cancer (CRC) slides stained with Hematoxylin and Eosin (H&E). Methods We propose a novel iterative draw-and-rank sampling (IDaRS) algorithm to select representative sub-images or tiles from a WSI given a single WSI-level label, without needing any detailed annotations at the cell or region levels. IDaRS is used to train a deep convolutional…

Artificial Intelligence-Based Mitosis Scoring in Breast Cancer: Clinical Application

Asmaa Ibrahim, Mostafa Jahanifar, Noorul Wahab +9 more

Artificial Intelligence · Modern Pathology · · cited 26× · DOI ↗ · more like this ·

In recent years, artificial intelligence (AI) has demonstrated exceptional performance in mitosis identification and quantification. However, the implementation of AI in clinical practice needs to be evaluated against the existing methods. This study is aimed at assessing the optimal method of using AI-based mitotic figure scoring in breast cancer (BC). We utilized whole slide images (WSIs) from a large cohort of BC with extended follow-up comprising a discovery (n=1715) and a validation (n=859) set (Nottingham cohort). The TCGA-BRCA cohort (n=757) was used as an external test set. Employing automated mitosis detection, the mitotic count was assessed using three different methods, the mitotic count per tumor area (MCT; calculated by dividing the number of mitotic figures by the total tumor area), the mitotic index (MI; defined as the average number of mitotic figures per 1000 malignant…

Development and validation of artificial intelligence-based prescreening of large-bowel biopsies taken in the UK and Portugal: a retrospective cohort study

Mohsin Bilal, Yee Wah Tsang, Mahmoud Ali +9 more

Artificial Intelligence · The Lancet Digital Health · · cited 26× · DOI ↗ · more like this ·

BACKGROUND: Histopathological examination is a crucial step in the diagnosis and treatment of many major diseases. Aiming to facilitate diagnostic decision making and improve the workload of pathologists, we developed an artificial intelligence (AI)-based prescreening tool that analyses whole-slide images (WSIs) of large-bowel biopsies to identify typical, non-neoplastic, and neoplastic biopsies. METHODS: This retrospective cohort study was conducted with an internal development cohort of slides acquired from a hospital in the UK and three external validation cohorts of WSIs acquired from two hospitals in the UK and one clinical laboratory in Portugal. To learn the differential histological patterns from digitised WSIs of large-bowel biopsy slides, our proposed weakly supervised deep-learning model (Colorectal AI Model for Abnormality Detection [CAIMAN]) used slide-level diagnostic…

AI-enabled routine H&E image based prognostic marker for early-stage luminal breast cancer

Noorul Wahab, Michael S. Toss, Islam M. Miligy +9 more

Artificial Intelligence · npj Precision Oncology · · cited 19× · DOI ↗ · more like this ·

Breast cancer (BC) grade is a well-established subjective prognostic indicator of tumour aggressiveness. Tumour heterogeneity and subjective assessment result in high degree of variability among observers in BC grading. Here we propose an objective Haematoxylin & Eosin (H&E) image-based prognostic marker for early-stage luminal/Her2-negative BReAst CancEr that we term as the BRACE marker. The proposed BRACE marker is derived from AI based assessment of heterogeneity in BC at a detailed level using the power of deep learning. The prognostic ability of the marker is validated in two well-annotated cohorts (Cohort-A/Nottingham: n = 2122 and Cohort-B/Coventry: n = 311) on early-stage luminal/HER2-negative BC patients treated with endocrine therapy and with long-term follow-up. The BRACE marker is able to stratify patients for both distant metastasis free survival (p = 0.001, C-index: 0.73)…

AI based pre-screening of large bowel cancer via weakly supervised learning of colorectal biopsy histology images

Mohsin Bilal, Yee Wah Tsang, Mahmoud Ali +9 more

Artificial Intelligence · medRxiv · · cited 18× · DOI ↗ · more like this ·

Abstract Histopathological examination is a pivotal step in the diagnosis and treatment planning of many major diseases. To facilitate the diagnostic decision-making and reduce the workload of pathologists, we present an AI-based pre-screening tool capable of identifying normal and neoplastic colon biopsies. To learn the differential histological patterns from whole slides images (WSIs) stained with hematoxylin and eosin (H&E), our proposed weakly supervised deep learning method requires only slide-level labels and no detailed cell or region-level annotations. The proposed method was developed and validated on an internal cohort of biopsy slides (n=4 292) from two hospitals labeled with corresponding diagnostic categories assigned by pathologists after reviewing case reports. Performance of the proposed colon cancer pre-screening tool was evaluated in a cross-validation setting…

Deciphering the Morphology of Tumor-Stromal Features in Invasive Breast Cancer Using Artificial Intelligence

Nehal Atallah, Noorul Wahab, Michael S. Toss +9 more

Artificial Intelligence · Modern Pathology · · cited 15× · DOI ↗ · more like this ·

Tumor-associated stroma in breast cancer (BC) is complex and exhibits a high degree of heterogeneity. To date, no standardized assessment method has been established. Artificial intelligence (AI) could provide an objective morphologic assessment of tumors and stroma, with the potential to identify new features not discernible by visual microscopy. In this study, we used AI to assess the clinical significance of (1) stroma-to-tumor ratio (S:TR) and (2) the spatial arrangement of stromal cells, tumor cell density, and tumor burden in BC. Whole-slide images of a large cohort (n = 1968) of well-characterized luminal BC cases were examined. Region and cell-level annotation was performed, and supervised deep learning models were applied for automated quantification of tumor and stromal features. S:TR was calculated in terms of surface area and cell count ratio, and the S:TR heterogeneity and…