The Speech ChainDenes Pinson, 1993 语音链Denes amp平森1993.pptVIP

Tasko SPPA 6010 Advanced Speech Science The Speech Chain (Denes Pinson, 1993) What information is embedded within the speech acoustic signal? Phonetic information Affective information Personal information Transmittal information Diagnostic Information Branches of science employed to understand speech communication Physics Acoustics Aerodynamics Kinematics Dynamics Biology Anatomy Gross anatomy Microscopic anatomy Molecular biology Neuroimaging Physiology Electrophysiology Physical Quantities Basic vs. Derived Scalar vs. Vector Area Volume Displacement Velocity Acceleration Force Pressure Work Power Intensity Resistance Ohm’s Law (V=IR) Speech anatomy as “tubes” and “valves” Source-Filter Theory of Speech Production The sounds we hear as speech is the product of a sound source that has undergone filtering by the vocal tract source and the filter may be considered to be independent of each other Source-Filter Theory Source-Filter Theory Sound: Acoustics review What is sound? Graphic representation of sound Classifying sounds Filters Resonance The decibel What is sound? It may be defined as the propagation of a pressure wave in space and time. propagates through a medium What is sound? Mass-spring model Wave action of molecular motion Amplitude waveform Amplitude waveform Model of air molecule vibration Simple Harmonic Motion: Sine Wave Features Amplitude Period Frequency Hz octave Phase Graphic representation of sound Time domain Called a waveform Amplitude v. time Frequency domain Called a spectrum Amplitude spectrum amplitude vs. frequency Phase spectrum phase vs. frequency May be measured using a variety of “window” sizes Spectrogram frequency v. amplitude v. time Same sound, different graphs Are all sound waves simply sinusoids? NO! Waves can be summed Simple waves can combine to produce complex waves Fourier: French Mathematician: Any complex waveform may be formed by summing sinusoids of various frequency, amplitude and phase Fourier Analysis Provi