Computer Science · Computer Vision and Pattern Recognition
P.I.A.N.O.: Faster Piano Learning with Interactive Projection
Katja Rogers, Matthias Weing, Jan Gugenheimer, Melina Klepsch, Florian Schaub, Enrico Rukzio, Tina Seufert, Michael Weber
See on the mapAbstract
Figure 1. In P.I.A.N.O., (a) music notation is projected onto the piano to facilitate direct mapping of notes to respective piano keys. Correct fingering is supported with color highlights. (b) The basic piano roll notation is extended to support articulations (legato, staccato) and note ornaments (trill, grace notes). (c) The learning process is supported by three learning modes (listen, practice, play). (d) After practicing a song, the play mode provides detailed feedback on the achieved skill level. Learning to play the piano is a prolonged challenge for novices. It requires them to learn sheet music notation and its mapping to respective piano keys, together with articulation details. Smooth playing further requires correct finger postures. The result is a slow learning progress, often causing frustration and strain. To overcome these issues, we propose P.I.A.N.O., a piano learning system with interactive projection that facilitates a fast learning process. Note information in form of an enhanced piano roll nota-tion is directly projected onto the instrument and allows mapping of notes to piano keys without prior sight-reading skills. Three learning modes support the natural learning process with live feed-back and performance evaluation. We report the results of two user studies, which show that P.I.A.N.O. supports faster learning, requires significantly less cognitive load, provides better user ex-perience, and increases perceived musical quality compared to sheet music notation and non-projected piano roll notation. Author Keywords Piano; music; instrument learning; interactive