音乐资讯检索的现况与未来.ppt

Singing Voice Separation Characteristics Easier on karaoke stereo songs Harder for monaural polyphonic songs Important step for a number of MIR applications Demo clips /site/unvoicedsoundseparation/ On-going Research at AIST, Japan Systems for listening to singing voices LyricSynchronizer: Automatic sync. of lyrics with polyphonic music recordings Singer ID: Singer identification MiruSinger: Singing skill visualization/training Hyperlinking Lyrics: Creating hyperlinks between phrases in song lyrics Breath Detection: Automatic detection of breath sounds in unaccompanied singing voice On-going Research at AIST, Japan (II) Systems for music information retrieval based on singing voices VocalFinder: Music information retrieval based on singing voice timbre Voice Drummer: Music notation of drums using vocal percussion input Systems for singing synthesis SingBySpeaking: Speech-to-singing synthesis VocaListener: Singing-to-singing synthesis The Grand Challenges of MIR Polyphonic audio music transcription Analogy to the problem of image understanding over semitranslucent overlayed images 困難度如同觀察水波而得知烏龜或青蛙游過 Conclusions MIR research is on the rise! MIR research over audio music (which account for 86% of MIREX tasks from 2005~2008) High-level feature identification Applications to genre/mood/tag classification/retrieval Preexisting approaches shed lights on MIR. Speech recognition/synthesis Text information retrieval Music theory References J. S. Downie, D. Bryd, T. Crawford, “Ten Years of ISMIR: Reflections on Challenges and Opportunities”, Keynote talk, Kobe, ISMIR 2010. M. A. Casey, R. Veltkamp, M. Goto, M. Leman, C. Rhodes, and M. Slaney, “Content-Based Music Information Retrieval: Current Directions and Future Challenges”, Proceedings of IEEE, Vol. 96, No. 4, April 2008. J.-S. R. Jang and H.-R. Lee, A General Framework of Progressive Filtering and Its Application to Query by Singing/Humming, IEEE Transactions on Audio, Speech, and Language Processing, No. 2, Vol. 16, P