arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Information Systems

Exploring the Limits of Deep Learning: A Study on Overfitting and Regularization Techniques

Neelesh Mungoli

· Zenodo (CERN European Organization for Nuclear Research)

See on the map

Abstract

This paper aims to investigate the limits of deep learning by exploring the issue of overfitting in deep neural networks and the various regularization techniques used to mitigate it. Overfitting in deep learning occurs when a model is too complex and learns the training data too well, resulting in poor generalization performance on unseen data. To address this issue, regularization techniques such as L1 and L2 regularization, dropout, and early stopping are discussed and compared. The effectiveness of each technique is evaluated through experiments on standard benchmark datasets. Additionally, the use of ensemble methods for deep learning regularization is explored. The results of this study provide insights into the limitations of deep learning and the various approaches that can be used to improve its generalization performance.

More like this