arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Artificial Intelligence

Deep Learning with Uncertainty Quantification for Emitter Classification

Lassi Meronen

· Aaltodoc (Aalto University)

See on the map

Abstract

Emitter classification is a crucial method of target recognition in electronic warfare. The recent popularity and success of deep learning models have made them an appealing method to be applied to emitter classification. However, the lack of reliable uncertainty estimates for deep learning models risks making overconfident incorrect decisions with irreversible consequences. The goal of this thesis is to compare different uncertainty estimation methods for deep learning models, applied to emitter classification tasks. The compared methods are Monte Carlo dropout, deep ensembles, Bayesian neural networks and noise contrastive priors. The neural network structure for all models is a convolutional residual neural network and the emitter classification data is generated through simulations. The results show that uncertainty estimates of Monte Carlo dropout, deep ensembles and Bayesian neural networks mainly differ from each other near decision boundaries and all these methods provide overconfident predictions outside of the training distribution. Changing the activation function of the last layer before the classification layer in the neural network, from a rectifier to a pulsed activation function, significantly helps to improve uncertainty estimates for samples outside of the training data distribution. Using noise contrastive priors further helps to increase the uncertainty estimates near the border of the training distribution, especially when used together with the pulsed activation function. The best overall uncertainty estimates were achieved using deep ensembles with the pulsed activation function and added noise contrastive priors. These methods are not limited to emitter classification and similar results can be expected in other applications.

More like this