Piano Music Transcription Systems.ppt

Piano Music Transcription Systems Presented by: Greg Eustace Overview Introduction to polyphonic transcription systems including pioneering work, basic architecture, piano transcription systems and current problems. Discussion of Marolt’s paper “A Connectionist Approach to Automatic Transcription of Piano Music”, including adaptive oscillator networks, Neural Networks and the SONIC system for piano transcription. Polyphonic transcription Transcription: The extraction of symbolic (notational) information from music, including pitches, dynamic levels, onset times and durations of notes. For automatic transcription systems the input is an audio file and the output could be a MIDI or score file. Polyphonic transcription systems have been in use since the early 1970’s beginning with the work of Moorer whose system assumed only two voices, separated in frequency range, having different timbres and restricted intervallic relationships. Basic architecture of transcription systems: Front end processing The audio signal is converted to a time-frequency representation such as provided by the short time Fourier transform (STFT). Partials present in a frame are identified and their frequency and amplitude information is extracted. Peak picking is commonly achieved by setting an amplitude threshold. ‘Partial tracks’ are formed by connecting partials across frames based on their amplitude and frequency relationships. Basic architecture: Blackboard systems for note identification So called blackboard systems use various criteria to group partials together in order to identify notes. Each criterion is represented by a ‘knowledge source’. These could include information from physics, psychoacoustics or music theory. Blackboard system often unify ‘top-down’ and ‘bottom-up approaches. Basic architecture: Machine learning for note Identification Other systems use machine learning for pattern recognition, such as Hidden Markov Models and Neural networks. This necessarily in