2016年微软Build大会资料B876_Spatial_Audio.pptxVIP

Spatial Audio in UWP apps and games;;With Penrose, we’ve exposed Microsoft’s HoloLens audio technology to UWP apps and games on HoloLens, Desktop, Phone, and Xbox One. This audio technology uses HRTFs and is optimized for headphones to experience spatial audio. Developers can now enable spatial audio through the AudioGraph API or Unity.;?;What are HRTF’s?;With 2 ears, we locate sounds in 3 dimensions Direction (left/right, front/back) Elevation (above/below) Distance ;Accuracy of sound localization is improved when listeners head movement is tracked and listener orientation is updated. Reduces front-back confusion Improves elevation perception Subconscious head movements ensure that spatial information is conveyed with high accuracy. HRTF-based audio rendering with headphones greatly improves when headphones can track head orientation.;The AudioGraph API;AudioGraph in Windows 10;We are adding Emitters and Listeners;AudioGraph in Windows 10 RS;Demo – Hello Spatial Audio;;Hello Spatial Audio;Hello Spatial Audio;// Create the Emitter AudioNodeEmitter audioNodeEmitter = new AudioNodeEmitter(AudioNodeEmitterShape.CreateOmnidirectional(), AudioNodeEmitterDecayModels.CreateDefault(), AudioNodeEmitterSettings.None); //X(-Left,+Right) Y(+Above,-Below), Z(-Front,+Back) //in a right-hand coordinate system audioNodeEmitter.Position = new Vector3(-225f, -0.5f, -225f); // Create the input node, all InputNodes with emitters need to be Mono, 48KHZ StorageFile file = await GetAudioFile(); CreateAudioFileInputNodeResult result = await audioGraph.CreateFileInputNodeAsync(file, audioNodeEmitter); if (result.Status == AudioFileNodeCreationStatus.Success) { AudioFileInputNode fileInputNode = result.FileInputNode; fileInputNode.AddOutgoingConnection(submix); fileInputNode.AddOutgoingConnection(outputNode); } ;Head Tracking and AudioGraph Listener Position;;Updating Listener Orientation;Applications of the Spatial Audio;Augmented and Virtual Reality A must to have for realistic pe