Estimating Artificial Neural Networks with Generalized Method Moments

Abstract

In this article, we present a general framework for estimation of Artificial Neural Networks (ANN) parameters using the Generalized Method of Moments (GMM), as an alternative to the conventional Quasi Maximum Likelihood (QML). We used a simple generalization for nonlinear models of the usual orthogonality conditions from linear regression in addition to the moment conditions that replicate the QML estimation. Consequently the resultant models are overidentified. Monte Carlo simulations suggested that GMM can outperform QML in cases with small samples or elevated noise.