Four commonly used audio features Volume四种常用的音频特征量.pptVIP

* * * * * * Basic Features of Audio Signals(音訊的基本特徵) Jyh-Shing Roger Jang (張智星) .tw/~jang MIR Lab, CS Dept, Tsing Hua Univ. Hsinchu, Taiwan Audio Features Four commonly used audio features Volume Pitch Zero crossing rate Timber Our goal These features can be perceived subjectively. But we need to compute them quantitatively for further processing and recognition. Audio Features in Time Domain Audio features presented in the time domain Intensity Fundamental period Timbre: Waveform within an FP Audio Features in Frequency Domain Volume: Magnitude of spectrum Pitch: Distance between harmonics Timber: Smoothed spectrum Second formant F2 First formant F1 Pitch freq Intensity Demo: Real-time Spectrogram Try “dspstfft_audio” under MATLAB: Spectrogram: Spectrum: Steps for Audio Feature Extraction Frame blocking Frame duration of 20 ms or so Feature extraction Volume, zero-crossing rate, pitch, MFCC, etc Endpoint detection Usually based on volume zero-crossing rate Frame Blocking Sample rate = 11025 Hz Frame size = 256 samples Overlap = 84 samples (Hop size = 256-84) Frame rate = 11025/(256-84)=64 frames/sec Zoom in Overlap Frame Intensity (I) Intensity Visual cue: Amplitude of vibration Computation: Volume: Log energy (in decibel): Characteristics Influenced by microphone types Microphone setups Perceived volume is influenced by frequency and timbre Intensity (II) To avoid DC drifting DC drifting: The vibration is not around zero Computation: Volume: Log energy (in decibel): Theoretical background (How to prove?) Intensity (III) Examples Please refer to the online tutorial Pitch Definition Pitch is known as fundamental frequency, which is equal to the no. of fundamental period within a second. The unit used here is Hertz (Hz). More commonly, pitch is in terms of semitone, which can be converted from pitch in Hertz: Pitch Computation (I) Pitch of tuning forks Pitch Computation (II) Pitch of speech Statistics of Mandarin Chinese 5401 characters, each c