Basic Features of Audio Signals（音讯的基本特徵）.ppt

* * * * * * * * * * * * * * Basic Features of Audio Signals(音訊的基本特徵) Jyh-Shing Roger Jang (張智星) /jang MIR Lab, CSIE Dept National Taiwan Univ., Taiwan Audio Features Four commonly used audio features Volume, pitch, timbre, zero crossing rate Our goal These features can be perceived (more or less) subjectively. Our goal is to compute them quantitatively (and objectively) for further processing and recognition. General Steps for Audio Analysis Frame blocking Frame duration of 20~40 ms or so Frame-based feature extraction Volume, zero-crossing rate, pitch, MFCC, etc Frame-based Analysis Pitch vector for QBSH comparison MFCC for HMM evaluation … Frame Blocking Sample rate = 16 kHz Frame size = 512 samples Frame duration = 512/16000 = 0.032 s = 32 ms Overlap = 192 samples Hop size = frame size – overlap = 512-192 = 320 samples Frame rate = 16000/320 = 50 frames/sec Zoom in Overlap Frame Quiz candidate! Audio Features in Time Domain 3 of the most prominent time-domain audio features in a frame (also known as analysis window) Intensity Fundamental period Timbre: Waveform within an FP Quiz candidate! Audio Features in Frequency Domain Frequency-domain audio features in a frame Energy: Sum of power spectrum Pitch: Distance between harmonics Timbre: Smoothed spectrum Second formant F2 First formant F1 Pitch freq Energy Frame-based Manipulation For simplicity, we usually pack frames into a matrix for easy manipulation in MATLAB: [y, fs] = audioread(‘file.wav’); frameMat = enframe(y, frameSize, overlap); Frame 1 Frame 2 Frame n … frameMat = Introduction to Volume Loudness of audio signals Visual cue: Amplitude of vibration Also known as energy or intensity Two major ways of computing volume: Volume: Log energy (in decibel): Quiz candidate! Volume: Perceived and Computed Perceived volume is influenced by Frequency (example shown later) Timbre (example shown later) Computed volume is influenced by Microphone types Microphone setups Volume Computation To avoid D