arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Mark Sendak

17 papers · 2016–2026

2016: 22017: 22018: 22019: 22020: 02021: 12022: 22023: 22024: 02025: 22026: 2
2016peak 2 in 20162026

Frequent co-authors

Papers

showing 1–17 of 17 RSS

Development and validation of machine learning models to identify high-risk surgical patients using automatically curated electronic health record data (Pythia): A retrospective, single-site study

Kristin Corey, Sehj Kashyap, Elizabeth Lorenzi +8 more

Artificial Intelligence · PLoS Medicine · · cited 213× · DOI ↗ · more like this ·

BACKGROUND: Pythia is an automated, clinically curated surgical data pipeline and repository housing all surgical patient electronic health record (EHR) data from a large, quaternary, multisite health institute for data science initiatives. In an effort to better identify high-risk surgical patients from complex data, a machine learning project trained on Pythia was built to predict postoperative complication risk. METHODS AND FINDINGS: A curated data repository of surgical outcomes was created using automated SQL and R code that extracted and processed patient clinical and surgical data across 37 million clinical encounters from the EHRs. A total of 194 clinical features including patient demographics (e.g., age, sex, race), smoking status, medications, comorbidities, procedure information, and proxies for surgical complexity were constructed and aggregated. A cohort of 66,370 patients…

Barriers to Achieving Economies of Scale in Analysis of EHR Data

Mark Sendak, Suresh Balu, Kevin A. Schulman

Artificial Intelligence · Applied Clinical Informatics · · cited 47× · DOI ↗ · more like this ·

Signed in 2009, the Health Information Technology for Economic and Clinical Health Act infused $28 billion of federal funds to accelerate adoption of electronic health records (EHRs). Yet, EHRs have produced mixed results and have even raised concern that the current technology ecosystem stifles innovation. We describe the development process and report initial outcomes of a chronic kidney disease analytics application that identifies high-risk patients for nephrology referral. The cost to validate and integrate the analytics application into clinical workflow was $217,138. Despite the success of the program, redundant development and validation efforts will require $38.8 million to scale the application across all multihospital systems in the nation. We address the shortcomings of current technology investments and distill insights from the technology industry. To yield a return on…

A framework for understanding label leakage in machine learning for health care

Sharon E. Davis, Michael E. Matheny, Suresh Balu +1 more

Artificial Intelligence · Journal of the American Medical Informatics Association · · cited 21× · DOI ↗ · more like this ·

INTRODUCTION: The pitfalls of label leakage, contamination of model input features with outcome information, are well established. Unfortunately, avoiding label leakage in clinical prediction models requires more nuance than the common advice of applying "no time machine rule." FRAMEWORK: We provide a framework for contemplating whether and when model features pose leakage concerns by considering the cadence, perspective, and applicability of predictions. To ground these concepts, we use real-world clinical models to highlight examples of appropriate and inappropriate label leakage in practice. RECOMMENDATIONS: Finally, we provide recommendations to support clinical and technical stakeholders as they evaluate the leakage tradeoffs associated with model design, development, and implementation decisions. By providing common language and dimensions to consider when designing models, we…

Scalable joint modeling of longitudinal and point process data for disease trajectory prediction and improving Management of Chronic Kidney Disease

Joseph Futoma, Mark Sendak, C. Blake Cameron +1 more

Artificial Intelligence · Uncertainty in Artificial Intelligence · · cited 13× · OpenAlex ↗ · more like this ·

A major goal in personalized medicine is the ability to provide individualized predictions about the future trajectory of a disease. Moreover, for many complex chronic diseases, patients simultaneously have additional comorbid conditions. Accurate determination of the risk of developing serious complications associated with a disease or its comorbidities may be more clinically useful than prediction of future disease trajectory in such cases. We propose a novel probabilistic generative model that can provide individualized predictions of future disease progression while jointly modeling the pattern of related recurrent adverse events. We fit our model using a scalable variational inference algorithm and apply our method to a large dataset of longitudinal electronic patient health records. Our model gives superior performance in terms of both prediction of future disease trajectories and…

Learning to Treat Sepsis with Multi-Output Gaussian Process Deep Recurrent Q-Networks

Joseph Futoma, Anthony Lin, Mark Sendak +4 more

Artificial Intelligence · · cited 11× · OpenAlex ↗ · more like this ·

Sepsis is a life-threatening complication from infection and a leading cause of mortality in hospitals. While early detection of sepsis improves patient outcomes, there is little consensus on exact treatment guidelines, and treating septic patients remains an open problem. In this work we present a new deep reinforcement learning method that we use to learn optimal personalized treatment policies for septic patients. We model patient continuous-valued physiological time series using multi-output Gaussian processes, a probabilistic model that easily handles missing values and irregularly spaced observation times while maintaining estimates of uncertainty. The Gaussian process is directly tied to a deep recurrent Q-network that learns clinically interpretable treatment policies, and both models are learned together end-to-end. We evaluate our approach on a heterogeneous dataset of septic…

Electronic Health Record Integration of Predictive Analytics to Select High-Risk Stable Patients With Non–ST-Segment–Elevation Myocardial Infarction for Intensive Care Unit Admission

Aman Kansal, Cynthia L. Green, Eric D. Peterson +6 more

Artificial Intelligence · Circulation Cardiovascular Quality and Outcomes · · cited 10× · DOI ↗ · more like this ·

In the United States, ≈40% of patients with non-ST-segment-elevation myocardial infarction (NSTEMI) who initially present without cardiogenic shock or cardiac arrest are admitted to the intensive care unit (ICU). 1,2Importantly, ICU utilization for these initially stable NSTEMI patients varies substantially between hospitals, and severity of illness on presentation is similar for NSTEMI patients treated and not treated in the ICU, suggesting that ICU admission decisions are largely based on hospital policies and local clinician preferences. 1isk-based ICU utilization-admitting those at the highest risk of developing complications requiring ICU care to the ICU and admitting those at lower risk to a non-ICU setting-has the potential to better align resource use with patient needs.For patients with initially stable NSTEMI, the Acute Coronary Treatment and Intervention Outcomes Network…

Assessment of Practices Affecting Racial and Ethnic COVID-19 Vaccination Equity in 10 Large US Cities

Christopher Cole Honeycutt, Jacqueline Contento, Joanne Kim +3 more

Health · Journal of Public Health Management and Practice · · cited 1× · DOI ↗ · more like this ·

CONTEXT: In the United States, COVID-19 vaccines have been unequally distributed between different racial and ethnic groups. Public reporting of race and ethnicity data for COVID-19 vaccination has the potential to help guide public health responses aimed at promoting vaccination equity. However, there is evidence that such data are not readily available. OBJECTIVES: This study sought to assess gaps and discrepancies in COVID-19 vaccination reporting in 10 large US cities in July 2021. DESIGN, SETTING, AND PARTICIPANTS: For the 10 cities selected, we collected COVID-19 vaccination and population data using publicly available resources, such as state health department Web sites and the US Census Bureau American Community Survey. We examined vaccination plans and news sources to identify initial proposals and evidence of implementation of COVID-19 vaccination best practices. MAIN OUTCOME…

Prospective and External Evaluation of a Machine Learning Model to Predict In-Hospital Mortality

Nathan Brajer, Brian Cozzi, Michael Gao +8 more

Artificial Intelligence · medRxiv · · cited 1× · DOI ↗ · more like this ·

Abstract The ability to accurately predict in-hospital mortality for patients at the time of admission could improve clinical and operational decision-making and outcomes. Few machine learning models have been developed to predict in-hospital death that are both broadly applicable to all adult patients across a health system and readily implementable, and, to the best of our knowledge, none have been implemented, evaluated prospectively, or externally validated. The primary objective of this study was to prospectively and externally validate a machine learning model that predicts in-hospital mortality for all adult patients at the time of hospital admission. Model performance was quantified using the area under the receiver operating characteristic curve (AUROC) and area under the precision recall curve (AUPRC). Secondary objectives were to design the model using commonly available EHR…

Scalable Modeling of Multivariate Longitudinal Data for Prediction of Chronic Kidney Disease Progression

Joseph Futoma, Mark Sendak, C. Blake Cameron +1 more

stat.ML · · cited 1× · arXiv ↗ · more like this ·

Prediction of the future trajectory of a disease is an important challenge for personalized medicine and population health management. However, many complex chronic diseases exhibit large degrees of heterogeneity, and furthermore there is not always a single readily available biomarker to quantify disease severity. Even when such a clinical variable exists, there are often additional related biomarkers routinely measured for patients that may better inform the predictions of their future disease state. To this end, we propose a novel probabilistic generative model for multivariate longitudinal data that captures dependencies between multivariate trajectories. We use a Gaussian process based regression model for each individual trajectory, and build off ideas from latent class models to induce dependence between their mean functions. We fit our method using a scalable variational…

Implementation of Duke Machine Learning Data Quality Assurance Framework in a Pakistani Healthcare Institution

Zarmeen Nasim, Nida Saddaf Khan, Mark Sendak +9 more

Artificial Intelligence · Health Informatics Journal · · cited 0× · DOI ↗ · more like this ·

Purpose High-quality data are critical for developing healthcare machine learning (ML) models yet remain a major challenge in low- and middle-income countries (LMICs). This study evaluated the applicability of the Duke Institute for Health Innovation’s (DIHI) Machine Learning Data Quality Assurance (ML-DQA) framework in an LMIC setting using two ML projects at a tertiary care hospital in Pakistan. Methods We applied the ML-DQA framework to two ML projects, Sepsis Watch (SW) and In-hospital Mortality Prediction (IMP). The framework comprises four phases: pre-DQA, data element pre-processing, ML-DQA checks, and ML-DQA adjudication, and was used to evaluate data quality and usability for both models. Results In the pre-DQA phase, required data elements were identified through consultation with clinicians and project teams. During data element pre-processing, transformations and…

Development, Validation, and Silent Trial of a Predictive Model for Acute Care Use in Cancer Patients on Immunotherapy

Noah Prizant, Kira Niederhoffer, Will Knechtle +8 more

Artificial Intelligence · AI in Precision Oncology · · cited 0× · DOI ↗ · more like this ·

Background: Immune checkpoint inhibitors (ICIs) are effective for treating melanoma, small-cell lung cancer, and other cancers. However, 54–76% of patients on ICIs experience immune-related adverse events (irAEs), which can lead to increased emergency department (ED) visits and hospital admissions. Proactively addressing these irAEs could reduce costly admissions and improve patient outcomes. The objective of this study was to develop, validate, and test via a silent trial a machine learning model for predicting ED and hospital admissions in patients receiving ICIs. Methods: The retrospective cohort study for model development and validation included 3962 adult patients from Duke University Health System who received ICIs between April 1, 2016, and July 1, 2021. The outcome of the model was ED or hospital admission within 3 weeks of ICI infusion. Performance measures included the area…

Bridging Prediction and Intervention Problems in Social Systems

Lydia T. Liu, Inioluwa Deborah Raji, Angela Zhou +32 more

cs.LG · · cited 0× · arXiv ↗ · more like this ·

Many automated decision systems (ADS) are designed to solve prediction problems -- where the goal is to learn patterns from a sample of the population and apply them to individuals from the same population. In reality, these prediction systems operationalize holistic policy interventions in deployment. Once deployed, ADS can shape impacted population outcomes through an effective policy change in how decision-makers operate, while also being defined by past and present interactions between stakeholders and the limitations of existing organizational, as well as societal, infrastructure and context. In this work, we consider the ways in which we must shift from a prediction-focused paradigm to an intervention-oriented paradigm when considering the impact of ADS within social systems. We argue this requires a new default problem setup for ADS beyond prediction, to instead consider…

Bridging Predictions and Interventions: An Integrated Framework for Automated Decision-Systems

Inioluwa Deborah Raji, Lydia T. Liu, Angela Zhou +27 more

cs.CY · · arXiv ↗ · more like this ·

Automated decision systems (ADS) leverage predictions about individual future outcomes to inform consequential decision-making in organizational settings. Across various settings - including criminal pretrial release, clinical triage, student support, and more - it is often assumed that improved predictive accuracy is the priority consideration in determining better downstream outcomes upon the deployment of ADS. In practice, real-world case studies reveal that this is far from the case: introducing individual predictions into decision-making modifies organizational workflows, assessment, and decision-making processes in ways that require a complete re-consideration of our approach to the design, evaluation, and deployment of ADS. As a result, this Perspective develops an integrated framework for studying ADS in social systems, shifting current priorities from a purely prediction-based…

Organizational Governance of Emerging Technologies: AI Adoption in Healthcare

Jee Young Kim, William Boag, Freya Gulamali +13 more

cs.AI · · arXiv ↗ · more like this ·

Private and public sector structures and norms refine how emerging technology is used in practice. In healthcare, despite a proliferation of AI adoption, the organizational governance surrounding its use and integration is often poorly understood. What the Health AI Partnership (HAIP) aims to do in this research is to better define the requirements for adequate organizational governance of AI systems in healthcare settings and support health system leaders to make more informed decisions around AI adoption. To work towards this understanding, we first identify how the standards for the AI adoption in healthcare may be designed to be used easily and efficiently. Then, we map out the precise decision points involved in the practical institutional adoption of AI technology within specific health systems. Practically, we achieve this through a multi-organizational collaboration with leaders…

Development and Validation of ML-DQA -- a Machine Learning Data Quality Assurance Framework for Healthcare

Mark Sendak, Gaurav Sirdeshmukh, Timothy Ochoa +20 more

stat.ML · · arXiv ↗ · more like this ·

The approaches by which the machine learning and clinical research communities utilize real world data (RWD), including data captured in the electronic health record (EHR), vary dramatically. While clinical researchers cautiously use RWD for clinical investigations, ML for healthcare teams consume public datasets with minimal scrutiny to develop new algorithms. This study bridges this gap by developing and validating ML-DQA, a data quality assurance framework grounded in RWD best practices. The ML-DQA framework is applied to five ML projects across two geographies, different medical conditions, and different cohorts. A total of 2,999 quality checks and 24 quality reports were generated on RWD gathered on 247,536 patients across the five projects. Five generalizable practices emerge: all projects used a similar method to group redundant data element representations; all projects used…

"The Human Body is a Black Box": Supporting Clinical Decision-Making with Deep Learning

Mark Sendak, Madeleine Elish, Michael Gao +6 more

cs.CY · · arXiv ↗ · more like this ·

Machine learning technologies are increasingly developed for use in healthcare. While research communities have focused on creating state-of-the-art models, there has been less focus on real world implementation and the associated challenges to accuracy, fairness, accountability, and transparency that come from actual, situated use. Serious questions remain under examined regarding how to ethically build models, interpret and explain model output, recognize and account for biases, and minimize disruptions to professional expertise and work cultures. We address this gap in the literature and provide a detailed case study covering the development, implementation, and evaluation of Sepsis Watch, a machine learning-driven tool that assists hospital clinicians in the early diagnosis and treatment of sepsis. We, the team that developed and evaluated the tool, discuss our conceptualization of…

An Improved Multi-Output Gaussian Process RNN with Real-Time Validation for Early Sepsis Detection

Joseph Futoma, Sanjay Hariharan, Mark Sendak +5 more

stat.ML · · arXiv ↗ · more like this ·

Sepsis is a poorly understood and potentially life-threatening complication that can occur as a result of infection. Early detection and treatment improves patient outcomes, and as such it poses an important challenge in medicine. In this work, we develop a flexible classifier that leverages streaming lab results, vitals, and medications to predict sepsis before it occurs. We model patient clinical time series with multi-output Gaussian processes, maintaining uncertainty about the physiological state of a patient while also imputing missing values. The mean function takes into account the effects of medications administered on the trajectories of the physiological variables. Latent function values from the Gaussian process are then fed into a deep recurrent neural network to classify patient encounters as septic or not, and the overall model is trained end-to-end using back-propagation.…