ARpeggio

This project is the result of the practical part of the lecture TUM Lecture Augmented Reality. It is a group work of @miruna20, @B1RO, @tobihanl, and me.

The aim of this project is to display instructions to play notes on top of a piano using AR. It is a proof of concept, using a sample video. We used C++, OpenCV and OpenGL.

I mainly worked on the music part. There are two modes to run this application in.

In the first mode, a MIDI file is parsed and the melody is shown on top of the keyboard in real time.

In the second mode, microphone input is used to show the note currently being played on top of the keyboard. This allows users to find the note that they are singing, or playing together with other musicians easily.

While the application works in simple cases, it should be seen as a proof of concept, not an actual piano learning tool.

Check it out: ARpeggio