CosmoNote's expressive music features

CosmoNote presents users with visualizations of the acoustic properties of the music. These representations are intended to help the listener to recognize prosodic cues while marking annotations.

Waveform

The waveform represents sound intensity variations as vertical pale-green lines. The horizontal axis depicts time, the vertical axis the amplitude of sounds.

00_Waveform.png

MIDI: pitch and duration

The  piano roll visualization shows a MIDI (Musical Instrument Digital Interface) representation of the recorded performance.

01_Pianoroll.png

The horizontal axis depicts time, and the vertical axis the pitch (frequency) of the notes. The darkness of the note color denotes its loudness. So a dark colored horizontal line segment is a loud and long note.

Pedals

On a piano, the pedals can change the sound produced by the instrument. This visualization shows how deep the performer pushed the sustain pedal over time.

02_Pedals.png

There are three pedals on a piano:

Loudness

This is used to represent the perceived intensity of a sound. Loudness can be calculated from an audio recording using psycho-acoustical models that approximate how the average human would perceive the input signal.

03_Loudness.png

Tempo