arXiv.itsnick.co

an independent field guide to 23 million papers from arXiv & OpenAlex — not affiliated with arXiv.org

Computer Science · Signal Processing

Audio-Based Piano Performance Evaluation for Beginners With Convolutional Neural Network and Attention Mechanism

Weiqing Wang, Jin Xiao Pan, Yi Hua, Zhanmei Song, Ming Li

· IEEE/ACM Transactions on Audio Speech and Language Processing

See on the map

Abstract

In this paper, we propose two different audio-based piano performance evaluation systems for beginners. The first is a sequential and modularized system, including three steps: Convolutional Neural Network (CNN)-based acoustic feature extraction, matching via dynamic time warping (DTW), and performance score regression. The second system is an end-to-end system with CNNs and the attention mechanism. It takes two acoustic feature sequences as input and directly predicts a performance score. We evaluate two proposed methods with our new open-access Yingcai Piano Performance Evaluation Phase III Dataset (YCU-PPE-III) that contains more than 2000 piano audio pieces recorded in multiple real test sessions. Experimental results show that the modularized system achieves a mean absolute error (MAE) of 3.79 in a 0-100-point range. Another end-to-end system also achieves an MAE of 4.40, which shows that it is possible to train a robust end-to-end piano performance evaluation system with only two thousand audio pieces.

Cited by 2

2 papers in the index cite this.

The cited-by list is still filling in while reference lists are collected.

More like this