arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Author

Adam Thomas-Mitchell

2 papers · 2023–2023

2023: 2
2023peak 2 in 20232023

Frequent co-authors

Papers

showing 1–2 of 2 RSS

Calibration of uncertainty in the active learning of machine learning force fields

Adam Thomas-Mitchell, Glenn Hawe, Paul L. A. Popelier

Artificial Intelligence · Machine Learning Science and Technology · · cited 4× · DOI ↗ · more like this ·

Abstract FFLUX is a machine learning force field that uses the maximum expected prediction error (MEPE) active learning algorithm to improve the efficiency of model training. MEPE uses the predictive uncertainty of a Gaussian process (GP) to balance exploration and exploitation when selecting the next training sample. However, the predictive uncertainty of a GP is unlikely to be accurate or precise immediately after training. We hypothesize that calibrating the uncertainty quantification within MEPE will improve active learning performance. We develop and test two methods to improve uncertainty estimates: post-hoc calibration of predictive uncertainty using the CRUDE algorithm, and replacing the GP with a student- t process. We investigate the impact of these methods on MEPE for single sample and batch sample active learning. Our findings suggest that post-hoc calibration does not…

A Comparative Study of Deterministic and Stochastic Policies for Q-learning

Yaxin Bi, Adam Thomas-Mitchell, Wei Zhai +1 more

Artificial Intelligence · Ulster University Research Portal (Ulster University) · · cited 2× · DOI ↗ · more like this ·

Q-learning is a form of reinforcement learning that employs agents to perform actions in an environment under a policy to reach ultimate goals. Q-learning is also thought as a goal-directed learning to maximize the expected value of the cumulative rewards via optimizing policies. Deterministic and scholastic policies are commonly used in reinforcement learning. However, they perform quite different in Markov decision processes. In this study, we conduct a comparative study on these two policies in the context of a grid world problem with Q-learning and provide an insight into the superiority of the deterministic policy over the scholastic one.