Transfer Learning for An Transformer-Enhanced ResNet34 Model

Abstract

Image classification is a well-studied field in the computer vision area. The mile-stone works include VGGNet, AlexNet, ResNet and so on. Meanwhile, the transformer model has been proven the great effectiveness in the computer science domain. In this paper, we focus on the methods incorporated transformer layers which can enhance the model's capability by integrating different strategies upon the state-of-the-art baseline models. Concretely, we propose a novel method that can improve the performance grounded on ResNet34 in a public dataset. The experimental results indicate our model can achieve a higher F1 score compared to other baselines models under the identical settings, which proves the effectiveness of our proposed method.