Computer Science · Computational Theory and Mathematics
Large-Scale Pretraining\nImproves Sample Efficiency\nof Active Learning-Based Virtual Screening
Zhonglin Cao (7553861), Simone Sciabola (1822039), Ye Wang (41998)
See on the mapAbstract
Virtual screening of large compound libraries to identify\npotential\nhit candidates is one of the earliest steps in drug discovery. As\nthe size of commercially available compound collections grows exponentially\nto the scale of billions, active learning and Bayesian optimization\nhave recently been proven as effective methods of narrowing down the\nsearch space. An essential component of those methods is a surrogate\nmachine learning model that predicts the desired properties of compounds.\nAn accurate model can achieve high sample efficiency by finding hits\nwith only a fraction of the entire library being virtually screened.\nIn this study, we examined the performance of a pretrained transformer-based\nlanguage model and graph neural network in a Bayesian optimization\nactive learning framework. The best pretrained model identifies 58.97%\nof the top-50,000 compounds after screening only 0.6% of an ultralarge\nlibrary containing 99.5 million compounds, improving 8% over the previous\nstate-of-the-art baseline. Through extensive benchmarks, we show that\nthe superior performance of pretrained models persists in both structure-based\nand ligand-based drug discovery. Pretrained models can serve as a\nboost to the accuracy and sample efficiency of active learning-based\nvirtual screening.