IntroductionJiangchuanLiuSpring2015.pptVIP

Recall: Challenges in Multimedia Communications Real-time communications Delay 0.4 sec in video conference Sequencing within the media Synchronization (e.g., between video audio) Robustness to transmission error Can we achieve these requirements through the Internet? Internet Packet-switched network Network resources are shared Each packet is handled by a series of routers before being received Packets can be discarded if the buffer of a router is full All packets are treated the same way in congestion A B C Internet Protocol Stack IP: Internet Protocol Best effort (unreliable)! TCP: Transmission Control Protocol Provides reliable (but slow) service UDP: User Datagram Protocol Provides unreliable (but fast) service Suitable for real-time application RTP: Real-time Transport Protocol packet format for multimedia streams RTCP: RTP control protocol Monitor/report service quality RTSP: Real-time streaming protocol “Internet VCR remote control” application RTP TCP/UDP IP Data link physical transport Quality of Service (QoS) Parameters End-to-end Delay time required for the end-to-end transmission of a single data element Jitter variation in delay Packet loss rate the proportion of data elements that are dropped Bandwidth: bits / second (bps) rate of flow of multimedia data QoS Control Algorithms to improve the QoS of Multimedia applications Policing Control the input rate to network (leak bucket model) Scheduling Divide buffers into logic queue Decide which queue to service next Error Resilience Improve the decoded quality in the presence of lost data - often occurs in wireless networks (and also Internet) Add redundancy at encoder: Error correction code Layered coding Multiple description coding Post-processing at decoder to hide the error Error concealment Outline Course information What is multimedia? A brief introduction Concepts Representation Compression Communication Popular multimedia tools Summary Popular Multimedia Software Tools The categor