arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam Casson

13 papers · 2021–2026

2021: 32022: 12023: 12024: 42025: 12026: 3
2021peak 4 in 20242026

Frequent co-authors

Papers

showing 1–13 of 13 RSS

A foundation model for clinical-grade computational pathology and rare cancers detection

Eugene Vorontsov, Alican Bozkurt, Adam Casson +9 more

Artificial Intelligence · Nature Medicine · · cited 390× · DOI ↗ · more like this ·

The analysis of histopathology images with artificial intelligence aims to enable clinical decision support systems and precision medicine. The success of such applications depends on the ability to model the diverse patterns observed in pathology images. To this end, we present Virchow, the largest foundation model for computational pathology to date. In addition to the evaluation of biomarker prediction and cell identification, we demonstrate that a large foundation model enables pan-cancer detection, achieving 0.95 specimen-level area under the (receiver operating characteristic) curve across nine common and seven rare cancers. Furthermore, we show that with less training data, the pan-cancer detector built on Virchow can achieve similar performance to tissue-specific clinical-grade models in production and outperform them on some rare variants of cancer. Virchow's performance gains…

Independent real‐world application of a clinical‐grade automated prostate cancer detection system

Leonard Da Silva, Emílio Marcelo Pereira, Paulo G. O. Salles +9 more

Artificial Intelligence · The Journal of Pathology · · cited 166× · DOI ↗ · more like this ·

Artificial intelligence (AI)-based systems applied to histopathology whole-slide images have the potential to improve patient care through mitigation of challenges posed by diagnostic variability, histopathology caseload, and shortage of pathologists. We sought to define the performance of an AI-based automated prostate cancer detection system, Paige Prostate, when applied to independent real-world data. The algorithm was employed to classify slides into two categories: benign (no further review needed) or suspicious (additional histologic and/or immunohistochemical analysis required). We assessed the sensitivity, specificity, positive predictive values (PPVs), and negative predictive values (NPVs) of a local pathologist, two central pathologists, and Paige Prostate in the diagnosis of 600 transrectal ultrasound-guided prostate needle core biopsy regions ('part-specimens') from 100…

Virchow: A Million-Slide Digital Pathology Foundation Model

Eugene Vorontsov, Alican Bozkurt, Adam Casson +28 more

eess.IV · · cited 159× · arXiv ↗ · more like this ·

The use of artificial intelligence to enable precision medicine and decision support systems through the analysis of pathology images has the potential to revolutionize the diagnosis and treatment of cancer. Such applications will depend on models' abilities to capture the diverse patterns observed in pathology images. To address this challenge, we present Virchow, a foundation model for computational pathology. Using self-supervised learning empowered by the DINOv2 algorithm, Virchow is a vision transformer model with 632 million parameters trained on 1.5 million hematoxylin and eosin stained whole slide images from diverse tissue and specimen types, which is orders of magnitude more data than previous works. The Virchow model enables the development of a pan-cancer detection system with 0.949 overall specimen-level AUC across 17 different cancer types, while also achieving 0.937 AUC…

PRISM: A Multi-Modal Generative Foundation Model for Slide-Level Histopathology

George Shaikovski, Adam Casson, Kristen Severson +19 more

eess.IV · · cited 129× · arXiv ↗ · more like this ·

Foundation models in computational pathology promise to unlock the development of new clinical decision support systems and models for precision medicine. However, there is a mismatch between most clinical analysis, which is defined at the level of one or more whole slide images, and foundation models to date, which process the thousands of image tiles contained in a whole slide image separately. The requirement to train a network to aggregate information across a large number of tiles in multiple whole slide images limits these models' impact. In this work, we present a slide-level foundation model for H&E-stained histopathology, PRISM, that builds on Virchow tile embeddings and leverages clinical report text for pre-training. Using the tile embeddings, PRISM produces slide-level embeddings with the ability to generate clinical reports, resulting in several modes of use. Using text…

Clinical Validation of Artificial Intelligence–Augmented Pathology Diagnosis Demonstrates Significant Gains in Diagnostic Accuracy in Prostate Cancer Detection

Patricia Raciti, Jillian Sue, Juan Antonio Retámero +9 more

Artificial Intelligence · Archives of Pathology & Laboratory Medicine · · cited 105× · DOI ↗ · more like this ·

CONTEXT.—: Prostate cancer diagnosis rests on accurate assessment of tissue by a pathologist. The application of artificial intelligence (AI) to digitized whole slide images (WSIs) can aid pathologists in cancer diagnosis, but robust, diverse evidence in a simulated clinical setting is lacking. OBJECTIVE.—: To compare the diagnostic accuracy of pathologists reading WSIs of prostatic biopsy specimens with and without AI assistance. DESIGN.—: Eighteen pathologists, 2 of whom were genitourinary subspecialists, evaluated 610 prostate needle core biopsy WSIs prepared at 218 institutions, with the option for deferral. Two evaluations were performed sequentially for each WSI: initially without assistance, and immediately thereafter aided by Paige Prostate (PaPr), a deep learning-based system that provides a WSI-level binary classification of suspicious for cancer or benign and pinpoints the…

Adapting Self-Supervised Learning for Computational Pathology

Eric Zimmermann, Neil Tenenholtz, James Hall +8 more

cs.CV · · cited 2× · arXiv ↗ · more like this ·

Self-supervised learning (SSL) has emerged as a key technique for training networks that can generalize well to diverse tasks without task-specific supervision. This property makes SSL desirable for computational pathology, the study of digitized images of tissues, as there are many target applications and often limited labeled training samples. However, SSL algorithms and models have been primarily developed in the field of natural images and whether their performance can be improved by adaptation to particular domains remains an open question. In this work, we present an investigation of modifications to SSL for pathology data, specifically focusing on the DINOv2 algorithm. We propose alternative augmentations, regularization functions, and position encodings motivated by the characteristics of pathology images. We evaluate the impact of these changes on several benchmarks to…

End-to-end multimodal pathology foundation model with clinical dialogue

Eugene Vorontsov, George Shaikovski, Adam Casson +9 more

Artificial Intelligence · Nature Medicine · · cited 1× · DOI ↗ · more like this ·

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches toward whole-slide understanding, but their clinical utility remains limited. Here we present PRISM2, a multimodal slide-level foundation model trained on 2.3 million whole-slide images and 14 million question-answer pairs derived from 700,000 pathology reports. Through clinical dialogue supervision, PRISM2 aligns histomorphology with diagnostic reasoning, yielding representations that support both prompt-based inference and transferable embeddings for downstream tasks. With prompt-based inference, PRISM2 achieves or exceeds (P < 0.05) the balanced accuracy of clinical-grade products calibrated for cancer detection in the prostate, breast and breast lymph node. Additionally, across comprehensive diagnostic, biomarker and…

Abstract PD6-03: Clinical-grade detection of breast cancer in biopsies and excisions using machine learning

Matthew G. Hanna, Patricia Raciti, Ran Godrich +9 more

Artificial Intelligence · Cancer Research · · cited 1× · DOI ↗ · more like this ·

Abstract Background: Pathologists reviewing breast tissue slides must identify the presence of many salient features within each slide, including invasive and in situ breast cancer as well as various forms of atypia. In breast pathology particularly, the large volume of slides poses significant challenges for workload management and pathologist productivity (Johnson et al. 2019). The shift to a digital workflow in pathology, augmented by machine learning algorithms, has the potential to increase the efficiency, and productivity of pathologists by identifying cancer and pre-cancerous lesions in digitized slides. While there has been extensive work using machine learning algorithms to detect breast cancer metastasis in lymph nodes (Liu et al. 2018; Steiner et al. 2018), almost no research has been done on using such systems to detect breast cancer in biopsies and excisions. Methods: We…

A Multimodal Foundation Model for Longitudinal Patient Representation and Scalable Insight Generation in Oncology

Eugene Vorontsov, Yi Kan Wang, Alican Bozkurt +13 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Precision oncology necessitates a longitudinal model of patient state that captures cancer evolution and treatment over time, integrating multimodal observations. We introduce the oFM, a foundation model developed on a real-world oncology cohort of 1.67 million cancer patients that integrates clinical trajectories with DNA, RNA, and H&E pathology. Patient-level partitions were reserved for training, validation, and testing, with over one million patients used for training. The oFM encodes daily clinical and molecular episodes and, along with pathology images, integrates them over time to produce a patient state embedding. We evaluate frozen oFM embeddings against expert-curated clinical and molecular baseline features. In prognostic benchmarks, the oFM improved AUC for treatment response, progression-free survival, and overall survival (0.774 vs. 0.563 for overall survival). Across 11…

Abstract PD6-02: Digital MammaPrint and BluePrint using machine learning and whole slide imaging

Annuska M. Glas, Jorge S. Reis‐Filho, Diederik Wehkamp +9 more

Artificial Intelligence · Cancer Research · · cited 0× · DOI ↗ · more like this ·

Abstract Background: The rise of whole slide imaging systems has enabled pathologists to remotely view cases in high resolution to diagnose cancer, and efficiently archive images . The advent of machine learning techniques and their application in digital pathology have facilitated the identification of histological patterns for effective diagnosis of disease. Deep learning-based solutions have been developed to detect and recognize cancer types, and automatically grade and stage tumors through evaluation of pathological features and patterns. However, no image-based solutions have been able to replicate a multivariate test, such as a risk -of recurrence assay for early stage breast cancer. Traditionally, subtle differences in gene expression have been measured by microarray or NGS, however these changes may also be recognized phenotypically from hematoxylin and eosin stained (H&amp;E)…

Mixed Magnification Aggregation for Generalizable Region-Level Representations in Computational Pathology

Eric Zimmermann, Julian Viret, Michal Zelechowski +7 more

cs.CV · · arXiv ↗ · more like this ·

In recent years, a standard computational pathology workflow has emerged where whole slide images are cropped into tiles, these tiles are processed using a foundation model, and task-specific models are built using the resulting representations. At least 15 different foundation models have been proposed, and the vast majority are trained exclusively with tiles using the 20$\times$ magnification. However, it is well known that certain histologic features can only be discerned with larger context windows and requires a pathologist to zoom in and out when analyzing a whole slide image. Furthermore, creating 224$\times$224 pixel crops at 20$\times$ leads to a large number of tiles per slide, which can be gigapixel in size. To more accurately capture multi-resolution features and investigate the possibility of reducing the number of representations per slide, we propose a region-level mixing…

PRISM2: Unlocking Multi-Modal General Pathology AI with Clinical Dialogue

Eugene Vorontsov, George Shaikovski, Adam Casson +16 more

cs.CV · · arXiv ↗ · more like this ·

Recent rapid progress in the field of computational pathology has been enabled by foundation models. These models are beginning to move beyond encoding image patches towards whole-slide understanding but their clinical utility remains limited. In this work, we present PRISM2, a multimodal slide-level foundation model trained on data from 700,000 diagnostic specimen-report pairs, the largest vision (2.3 million whole slide images) and language (14M question-answer pairs) histopathology dataset to date. By learning through clinical-dialogue supervision, PRISM2 aligns histomorphologic features with the language of diagnostic reasoning, producing slide-level representations that support both direct diagnostic question-answering and transferable embeddings for downstream tasks. Without additional training, PRISM2 matches or exceeds the cancer-detection performance of clinical-grade products.…

Virchow2: Scaling Self-Supervised Mixed Magnification Models in Pathology

Eric Zimmermann, Eugene Vorontsov, Julian Viret +11 more

cs.CV · · arXiv ↗ · more like this ·

Foundation models are rapidly being developed for computational pathology applications. However, it remains an open question which factors are most important for downstream performance with data scale and diversity, model size, and training algorithm all playing a role. In this work, we propose algorithmic modifications, tailored for pathology, and we present the result of scaling both data and model size, surpassing previous studies in both dimensions. We introduce three new models: Virchow2, a 632 million parameter vision transformer, Virchow2G, a 1.9 billion parameter vision transformer, and Virchow2G Mini, a 22 million parameter distillation of Virchow2G, each trained with 3.1 million histopathology whole slide images, with diverse tissues, originating institutions, and stains. We achieve state of the art performance on 12 tile-level tasks, as compared to the top performing…