arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Nicholson Collier

25 papers · 2006–2026

2006: 22007: 02008: 02009: 02010: 02011: 02012: 02013: 02014: 12015: 12016: 12017: 22018: 22019: 22020: 12021: 32022: 02023: 42024: 22025: 32026: 1
2006peak 4 in 20232026

Frequent co-authors

Papers

showing 1–25 of 25 RSS

Experiences creating three implementations of the repast agent modeling toolkit

Michael North, Nicholson Collier, J. R. Vos

Artificial Intelligence · ACM Transactions on Modeling and Computer Simulation · · cited 681× · DOI ↗ · more like this ·

Many agent-based modeling and simulation researchers and practitioners have called for varying levels of simulation interoperability ranging from shared software architectures to common agent communications languages. These calls have been at least partially answered by several specifications and technologies. In fact, Tanenbaum [1988] has remarked that the “nice thing about standards is that there are so many to choose from.” Tanenbaum goes on to say that “if you do not like any of them, you can just wait for next year's model.” This article does not seek to introduce next year's model. Rather, the goal is to contribute to the larger simulation community the authors' accumulated experiences from developing several implementations of an agent-based simulation toolkit. As such, this article focuses on the implementation of simulation architectures rather than agent communications…

High-throughput cancer hypothesis testing with an integrated PhysiCell-EMEWS workflow

Jonathan Ozik, Nicholson Collier, Justin M. Wozniak +7 more

Modeling and Simulation · bioRxiv (Cold Spring Harbor Laboratory) · · cited 67× · DOI ↗ · more like this ·

Abstract Background Cancer is a complex, multiscale dynamical system, with interactions between tumor cells and non-cancerous host systems. Therapies act on this combined cancer-host system, sometimes with unexpected results. Systematic investigation of mechanistic computational models can augment traditional laboratory and clinical studies, helping identify the factors driving a treatment’s success or failure. However, given the uncertainties regarding the underlying biology, these multiscale computational models can take many potential forms, in addition to encompassing high-dimensional parameter spaces. Therefore, the exploration of these models is computationally challenging. We propose that integrating two existing technologies—one to aid the construction of multiscale agent-based models, the other developed to enhance model exploration and optimization—can provide a computational…

A population data-driven workflow for COVID-19 modeling and learning

Jonathan Ozik, Justin M. Wozniak, Nicholson Collier +2 more

Modeling and Simulation · The International Journal of High Performance Computing Applications · · cited 60× · DOI ↗ · more like this ·

CityCOVID is a detailed agent-based model that represents the behaviors and social interactions of 2.7 million residents of Chicago as they move between and colocate in 1.2 million distinct places, including households, schools, workplaces, and hospitals, as determined by individual hourly activity schedules and dynamic behaviors such as isolating because of symptom onset. Disease progression dynamics incorporated within each agent track transitions between possible COVID-19 disease states, based on heterogeneous agent attributes, exposure through colocation, and effects of protective behaviors of individuals on viral transmissibility. Throughout the COVID-19 epidemic, CityCOVID model outputs have been provided to city, county, and state stakeholders in response to evolving decision-making priorities, while incorporating emerging information on SARS-CoV-2 epidemiology. Here we…

CHISIM: AN AGENT-BASED SIMULATION MODEL OF SOCIAL INTERACTIONS IN A LARGE URBAN AREA

Charles M. Macal, Nicholson Collier, Jonathan Ozik +2 more

Transportation · 2018 Winter Simulation Conference (WSC) · · cited 31× · DOI ↗ · more like this ·

Cities are complex, dynamic, evolving adaptive systems comprised of people as well as interconnected physical infrastructure. Simulation modeling can help us understand and shape the evolution of our cities. In this paper, we describe an agent-based simulation modeling framework applied to Chicago, called chiSIM (for the Chicago Social Interaction Model). Each person residing in Chicago is represented as an agent in chiSIM; all places where people can be located in Chicago also are represented. The model simulates the movements of people between locations on an hourly basis during the course of a typical day. Co-located agents engage in various kinds of social interactions, such as exchanging information, engaging in business transactions, or simply sharing physical proximity. We discuss technical approaches to large-scale urban modeling including development of synthetic populations…

An introduction to repast simphony modeling using a simple predator-prey example.

Eric Tatara, Michael North, T. R. Howe +4 more

Sociology and Political Science · OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information) · · cited 17× · OpenAlex ↗ · more like this ·

Repast is a widely used, free, and open-source, agent-based modeling and simulation toolkit. Three Repast platforms are currently available, each of which has the same core features but a different environment for these features. Repast Simphony (Repast S) extends the Repast portfolio by offering a new approach to simulation development and execution. This paper presents a model of wolf-sheep predation as an introductory tutorial and illustration of the modeling capabilities of Repast S. We use a model of wolf-sheep predation to demonstrate the capabilities of the Repast S toolkit and as an introductory tutorial. While the example is not intended to model real phenomenon, the model's complexity is high enough to illustrate how the user may develop multi-agent models. Spatial and temporal patterns emerge in the model consisting of potentially hundreds of instances of three agent types.…

PSI/J: A Portable Interface for Submitting, Monitoring, and Managing Jobs

Mihael Hategan-Marandiuc, Andre Merzky, Nicholson Collier +10 more

cs.DC · · cited 16× · arXiv ↗ · more like this ·

It is generally desirable for high-performance computing (HPC) applications to be portable between HPC systems, for example to make use of more performant hardware, make effective use of allocations, and to co-locate compute jobs with large datasets. Unfortunately, moving scientific applications between HPC systems is challenging for various reasons, most notably that HPC systems have different HPC schedulers. We introduce PSI/J, a job management abstraction API intended to simplify the construction of software components and applications that are portable over various HPC scheduler implementations. We argue that such a system is both necessary and that no viable alternative currently exists. We analyze similar notable APIs and attempt to determine the factors that influenced their evolution and adoption by the HPC community. We base the design of PSI/J on that analysis. We describe how…

Reopening California : Seeking Robust, Non-Dominated COVID-19 Exit Strategies

Pedro Nascimento de Lima, Robert J. Lempert, Raffaele Vardavas +5 more

Modeling and Simulation · medRxiv · · cited 15× · DOI ↗ · more like this ·

Amid global scarcity of COVID-19 vaccines and the threat of new variant strains, California and other jurisdictions face the question of when and how to implement and relax COVID-19 Nonpharmaceutical Interventions (NPIs). While policymakers have attempted to balance the health and economic impacts of the pandemic, decentralized decision-making, deep uncertainty, and the lack of widespread use of comprehensive decision support methods can lead to the choice of fragile or inefficient strategies. This paper uses simulation models and the Robust Decision Making (RDM) approach to stress-test California's reopening strategy and other alternatives over a wide range of futures. We find that plans which respond aggressively to initial outbreaks are required to robustly control the pandemic. Further, the best plans adapt to changing circumstances, lowering their stringent requirements to reopen…

Water Relationships in the U.S. Southwest: Characterizing Water Management Networks Using Natural Language Processing

John T. Murphy, Jonathan Ozik, Nicholson Collier +6 more

Artificial Intelligence · Water · · cited 14× · DOI ↗ · more like this ·

Natural language processing (NLP) and named entity recognition (NER) techniques are applied to collections of newspaper articles from four cities in the U.S. Southwest. The results are used to generate a network of water management institutions that reflect public perceptions of water management and the structure of water management in these areas. This structure can be highly centralized or fragmented; in the latter case, multiple peer institutions exist that may cooperate or be in conflict. This is reflected in the public discourse of the water consumers in these areas and can, we contend, impact the potential responses of management agencies to challenges of water supply and quality and, in some cases, limit their effectiveness. Flagstaff, AZ, Tucson, AZ, Las Vegas, NV, and the Grand Valley, CO, are examined, including more than 110,000 articles from 2004–2012. Documents are scored…

Trajectory-oriented optimization of stochastic epidemiological models

Arindam Fadikar, Mickael Binois, Nicholson Collier +3 more

stat.AP · · cited 10× · arXiv ↗ · more like this ·

Epidemiological models must be calibrated to ground truth for downstream tasks such as producing forward projections or running what-if scenarios. The meaning of calibration changes in case of a stochastic model since output from such a model is generally described via an ensemble or a distribution. Each member of the ensemble is usually mapped to a random number seed (explicitly or implicitly). With the goal of finding not only the input parameter settings but also the random seeds that are consistent with the ground truth, we propose a class of Gaussian process (GP) surrogates along with an optimization strategy based on Thompson sampling. This Trajectory Oriented Optimization (TOO) approach produces actual trajectories close to the empirical observations instead of a set of parameter settings where only the mean simulation behavior matches with the ground truth.

High-bypass Learning: Automated Detection of Tumor Cells That Significantly Impact Drug Response

Justin M. Wozniak, Hyunseung Yoo, Jamaludin Mohd-Yusof +5 more

Artificial Intelligence · · cited 10× · DOI ↗ · more like this ·

Machine learning in biomedicine is reliant on the availability of large, high-quality data sets. These corpora are used for training statistical or deep learning-based models that can be validated against other data sets and ultimately used to guide decisions. The quality of these data sets is an essential component of the quality of the models and their decisions. Thus, identifying and inspecting outlier data is critical for evaluating, curating, and using biomedical data sets. Many techniques are available to look for outlier data, but it is not clear how to evaluate the impact on highly complex deep learning methods. In this paper, we use deep learning ensembles and workflows to construct a system for automatically identifying data subsets that have a large impact on the trained models. These effects can be quantified and presented to the user for further inspection, which could…

Repast Simphony Statecharts

Jonathan Ozik, Nicholson Collier, Todd Combs +2 more

Artificial Intelligence · Journal of Artificial Societies and Social Simulation · · cited 10× · DOI ↗ · more like this ·

Agent states and transitions between states are important abstractions in agent-based social simulation (ABSS). Although it is common to develop ad hoc implementations of state-based and transition-based agent behaviors, 'best practice' software engineering processes provide transparent and formally grounded design notations that translate directly into working implementations. Statecharts are a software engineering design methodology and an explicit visual and logical representation of the states of system components and the transitions between those states. Used in ABSS, they can clarify a model's logic and allow for efficient software engineering of complex state-based models. In addition to agent state and behavioral logic representation, visual statecharts can also be useful for monitoring agent status during a simulation, quickly conveying the underlying dynamics of complex models…

Impact of post-incarceration care engagement interventions on HIV transmission among young Black men who have sex with men and their sexual partners: an agent-based network modeling study

Anna Hotton, Francis Lee, Daniel Sheeler +9 more

Sociology and Political Science · The Lancet Regional Health - Americas · · cited 6× · DOI ↗ · more like this ·

Background: Understanding the impact of incarceration on HIV transmission among Black men who have sex with men is important given their disproportionate representation among people experiencing incarceration and the potential impact of incarceration on social and sexual networks, employment, housing, and medical care. We developed an agent-based network model (ABNM) of 10,000 agents representing young Black men who have sex with men in the city of Chicago to examine the impact of varying degrees of post-incarceration care disruption and care engagement interventions following release from jail on HIV incidence. Methods: Exponential random graph models were used to model network formation and dissolution dynamics, and network dynamics and HIV care continuum engagement were varied according to incarceration status. Hypothetical interventions to improve post-release engagement in HIV care…

Towards Improved Uncertainty Quantification of Stochastic Epidemic Models Using Sequential Monte Carlo

Arindam Fadikar, Abby Stevens, Nicholson Collier +6 more

stat.AP · · cited 5× · arXiv ↗ · more like this ·

Sequential Monte Carlo (SMC) algorithms represent a suite of robust computational methodologies utilized for state estimation and parameter inference within dynamical systems, particularly in real-time or online environments where data arrives sequentially over time. In this research endeavor, we propose an integrated framework that combines a stochastic epidemic simulator with a sequential importance sampling (SIS) scheme to dynamically infer model parameters, which evolve due to social as well as biological processes throughout the progression of an epidemic outbreak and are also influenced by evolving data measurement bias. Through iterative updates of a set of weighted simulated trajectories based on observed data, this framework enables the estimation of posterior distributions for these parameters, thereby capturing their temporal variability and associated uncertainties. Through…

A portfolio approach to massively parallel Bayesian optimization

Mickael Binois, Nicholson Collier, Jonathan Ozik

math.OC · · cited 3× · arXiv ↗ · more like this ·

One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayesian optimization have been proposed. They work by building a surrogate model of the black-box to simultaneously select multiple designs via an infill criterion. Still, despite the increased availability of computing resources that enable large-scale parallelism, the strategies that work for selecting a few tens of parallel designs for evaluations become limiting due to the complexity of selecting more designs. It is even more crucial when the black-box is noisy, necessitating more evaluations as well as repeating experiments. Here we propose a scalable strategy that can keep up with massive batching natively, focused on the exploration/exploitation trade-off and a portfolio allocation. We compare…

Endogenous Social Networks from Large-Scale Agent-Based Models

Eric Tatara, Nicholson Collier, Jonathan Ozik +1 more

Transportation · · cited 3× · DOI ↗ · more like this ·

We present a parallel computational method for generating endogenous social networks from large-scale simulation data from the Chicago Social Interaction Model (chiSIM). The model scope aims to simulate the population of the entire city of Chicago which includes approximately 2.9 million discrete individuals. Generated person collocation networks contain more than 106 person nodes and more than 109 collocation edges. Analysis of such network structure can be challenging when applied to urban scale population data due to their size. A parallel logging implementation is described that records person activity data via an agent-based model. The social network generation method is demonstrated on a distributed compute cluster. The person collocation network analysis and visualization obtained via the parallel methodology provides previously unreported characterizations of simulated…

Learning-accelerated Discovery of Immune-Tumour Interactions

Jonathan Ozik, Nicholson Collier, Randy Heiland +2 more

Modeling and Simulation · bioRxiv (Cold Spring Harbor Laboratory) · · cited 2× · DOI ↗ · more like this ·

We present an integrated framework for enabling dynamic exploration of design spaces for cancer immunotherapies with detailed dynamical simulation models on high-performance computing resources. Our framework combines PhysiCell, an open source agent-based simulation platform for cancer and other multicellular systems, and EMEWS, an open source platform for extreme-scale model exploration. We build an agent-based model of immunosurveillance against heterogeneous tumours, which includes spatial dynamics of stochastic tumour-immune contact interactions. We implement active learning and genetic algorithms using high-performance computing workflows to adaptively sample the model parameter space and iteratively discover optimal cancer regression regions within biological and clinical constraints.

AGENT BASED MODELING FOR SMARTER BUILDING ENERGY SIMULATION AND ENERGY EFFICIENCY TECHNOLOGY EVALUATION

Joshua Bergerson, Ralph T. Muehleisen, Eric Tatara +2 more

Transportation · Proceedings of SimBuild · · cited 2× · OpenAlex ↗ · more like this ·

Agent based modeling (ABM) is a method of modeling complex systems that allows for detailed, endogenous actors interacting with one another and with their environment based on predefined agent rules and goals. ABMs allow modeling at a desired aggregation level that is most conducive to producing realistic market trends at the aggregation level desired. As ABMs obtain market trends based on individualistic goals of agents, they are an ideal tool for short term and long term market trend analyses. Argonne National Laboratory has developed and recently validated the Commercial Building Agent Model (CoBAM), an ABM with both a commercial and residential building stock. An example showing the power of CoBAM in evaluating the energy savings due to adoption of energy efficiency measures is included.

Staying on Track: Efficient Trajectory Discovery with Adaptive Batch Sampling

Arindam Fadikar, Abby Stevens, Mickael Binois +3 more

stat.ME · · cited 0× · arXiv ↗ · more like this ·

Bayesian optimization (BO) is a powerful framework for estimating parameters of expensive simulation models, particularly in settings where the likelihood is intractable and evaluations are costly. In stochastic models every simulation is run with a specific parameter set and an implicit or explicit random seed, where each parameter set and random seed combination generates an individual realization, or trajectory, sampled from an underlying random process. Existing BO approaches typically rely on summary statistics over the realizations, such as means, medians, or quantiles, potentially limiting their effectiveness when trajectory-level information is desired. We propose a trajectory-oriented BO method that incorporates a Gaussian process surrogate using both input parameters and random seeds as inputs, enabling direct inference at the trajectory level. Using a common random number…

Advancing calibration for stochastic agent-based models in epidemiology with Stein variational inference and Gaussian process surrogates

Connor Robertson, Cosmin Safta, Nicholson Collier +2 more

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Accurate calibration of stochastic agent-based models (ABMs) in epidemiology is crucial to make them useful in public health policy decisions and interventions. Traditional calibration methods, e.g., Markov Chain Monte Carlo (MCMC), that yield a probability density function for the parameters being calibrated, are often computationally expensive. When applied to ABMs which are highly parametrized, the calibration process becomes computationally infeasible. This paper investigates the utility of Stein Variational Inference (SVI) as an alternative calibration technique for stochastic epidemiological ABMs approximated by Gaussian process (GP) surrogates. SVI leverages gradient information to iteratively update a set of particles in the space of parameters being calibrated, offering potential advantages in scalability and efficiency for high-dimensional ABMs. The ensemble of particles…

Bayesian calibration of stochastic agent based model via random forest

Connor Robertson, Cosmin Safta, Nicholson Collier +2 more

stat.ML · · cited 0× · arXiv ↗ · more like this ·

Agent-based models (ABM) provide an excellent framework for modeling outbreaks and interventions in epidemiology by explicitly accounting for diverse individual interactions and environments. However, these models are usually stochastic and highly parametrized, requiring precise calibration for predictive performance. When considering realistic numbers of agents and properly accounting for stochasticity, this high dimensional calibration can be computationally prohibitive. This paper presents a random forest based surrogate modeling technique to accelerate the evaluation of ABMs and demonstrates its use to calibrate an epidemiological ABM named CityCOVID via Markov chain Monte Carlo (MCMC). The technique is first outlined in the context of CityCOVID's quantities of interest, namely hospitalizations and deaths, by exploring dimensionality reduction via temporal decomposition with…

Trajectory-Oriented Optimization Via Adaptive Thompson Sampling And Grid Refinement: A Tutorial With The ADAPTIVE\_TS Package

David O'Gara, Arindam Fadikar, Mickaël Binois +2 more

stat.CO · · arXiv ↗ · more like this ·

Stochastic simulators are increasingly used to expand the frontier of scientific knowledge and inform decision-making across real-world contexts. Simulator calibration, a process by which internal model inputs are tuned to match some external criteria, usually in the form of observed data, is a key step in model design and validation. Epidemiological simulators present an especially compelling use case, as evidenced by the recent COVID-19 pandemic. Among several calibration paradigms, trajectory-oriented optimization is an emerging approach that does not require assumptions on the stochastic behavior of the simulator replicates and is particularly effective at identifying trajectories through the lens of errors between the simulator and observed data, especially when combined with Bayesian optimization. We present a tutorial on trajectory-oriented optimization with…

AERO: An autonomous platform for continuous research

Valérie Hayot-Sasson, Abby Stevens, Nicholson Collier +10 more

cs.CE · · arXiv ↗ · more like this ·

The COVID-19 pandemic highlighted the need for new data infrastructure, as epidemiologists and public health workers raced to harness rapidly evolving data, analytics, and infrastructure in support of cross-sector investigations. To meet this need, we developed AERO, an automated research and data sharing platform for continuous, distributed, and multi-disciplinary collaboration. In this paper, we describe the AERO design and how it supports the automatic ingestion, validation, and transformation of monitored data into a form suitable for analysis; the automated execution of analyses on this data; and the sharing of data among different entities. We also describe how our AERO implementation leverages capabilities provided by the Globus platform and GitHub for automation, distributed execution, data sharing, and authentication. We present results obtained with an instance of AERO running…

Developing Distributed High-performance Computing Capabilities of an Open Science Platform for Robust Epidemic Analysis

Nicholson Collier, Justin M. Wozniak, Abby Stevens +6 more

cs.DC · · arXiv ↗ · more like this ·

COVID-19 had an unprecedented impact on scientific collaboration. The pandemic and its broad response from the scientific community has forged new relationships among domain experts, mathematical modelers, and scientific computing specialists. Computationally, however, it also revealed critical gaps in the ability of researchers to exploit advanced computing systems. These challenging areas include gaining access to scalable computing systems, porting models and workflows to new systems, sharing data of varying sizes, and producing results that can be reproduced and validated by others. Informed by our team's work in supporting public health decision makers during the COVID-19 pandemic and by the identified capability gaps in applying high-performance computing (HPC) to the modeling of complex social systems, we present the goals, requirements, and initial implementation of OSPREY, an…

Characterization and valuation of uncertainty of calibrated parameters in stochastic decision models

Fernando Alarid-Escudero, Amy B. Knudsen, Jonathan Ozik +2 more

stat.AP · · arXiv ↗ · more like this ·

We evaluated the implications of different approaches to characterize uncertainty of calibrated parameters of stochastic decision models (DMs) in the quantified value of such uncertainty in decision making. We used a microsimulation DM of colorectal cancer (CRC) screening to conduct a cost-effectiveness analysis (CEA) of a 10-year colonoscopy screening. We calibrated the natural history model of CRC to epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of uncertainty of the calibrated parameters and estimated the value of uncertainty of the different characterizations with a value of information analysis. All analyses were conducted using high performance computing resources…

Microsimulation Model Calibration using Incremental Mixture Approximate Bayesian Computation

Carolyn Rutter, Jonathan Ozik, Maria DeYoreo +1 more

stat.ME · · arXiv ↗ · more like this ·

Microsimulation models (MSMs) are used to predict population-level effects of health care policies by simulating individual-level outcomes. Simulated outcomes are governed by unknown parameters that are chosen so that the model accurately predicts specific targets, a process referred to as model calibration. Calibration targets can come from randomized controlled trials, observational studies, and expert opinion, and are typically summary statistics. A well calibrated model can reproduce a wide range of targets. MSM calibration generally involves searching a high dimensional parameter space and predicting many targets through model simulation. This requires efficient methods for exploring the parameter space and sufficient computational resources. We develop Incremental Mixture Approximate Bayesian Computation (IMABC) as a method for MSM calibration and implement it via a…