Overview of The Multimedia Networks
Hamid R. Rabiee Mostafa Salehi, Fatemeh Dabiran, Hoda Ayatollahi Spring 2011
Outlines
Course Introduction (Syllabus) Course Outline Why Multimedia Networking?
Digital Media Lab - Sharif University of Technology
Multimedia Networking
Instructors: Hamid R. Rabiee, PhD (rabiee@[Link])
Office: CE department #804 or #803 (DML)
TAs:
Mostafa Salehi (mostafa_salehi@[Link]) Office: CE department #803 (DML lab)
Hoda Ayatollahi ([Link]@[Link])
Office: CE department #803 (DML lab)
Fatemeh Dabiran (dabiran@[Link])
Office: CE department #803 (DML lab)
Hours:
Class hours: Exercise hours:
Course web page: [Link]
Digital Media Lab - Sharif University of Technology
Course Introduction
The course goal:
This course is primarily concerned with the problems that arise when carrying audio/video contents over the modern communication networks
The course will :
Present an overview of current/future multimedia applications and architectures Discuss deployment problems Discuss Multimedia Network Design and study solutions Examine emerging technologies and open research problems related to multimedia networking
Digital Media Lab - Sharif University of Technology
Course Introduction
Prerequisites:
Signal and Systems, Multimedia Systems, Computer Networks Background in Computer Systems Performance Evaluation (e.g., Simulation, Experimental, or Analytical approaches) Experience with Matlab and GNU/Linux.
Simulation Tool: OpNet Style:
Both slides and whiteboard
Reading List:
Recommended books and papers Slides Handouts
Digital Media Lab - Sharif University of Technology
Course Introduction
Evaluation:
Home works About 7 series of home works 30% of the final grade Quiz About 11 prearranged 10% of the final grade Midterm written exam 25% of the final grade Final written exam 25% of the final grade Critical Reading & Presentation 10% of the final grade Projects (+) 10% of the final grade
Digital Media Lab - Sharif University of Technology
Course Outline
Introduction Fundamentals of Multimedia
Background Information similar to the ones covered in the Multimedia Systems
Fundamentals of Next Generation Networks Quality of Service
Principles (e.g. Admission Control and Shaping/Policing) QoS Architecture (Integrated services; Differentiated services) Traffic engineering (Fair Scheduling) Flow and congestion control (Buffer Management) Error Correction & concealment
Digital Media Lab - Sharif University of Technology
Course Outline
Multimedia over IP (IP multicast) Multimedia over Overlay networks Multimedia Applications Multimedia Protocols
Signaling Protocols (SIP, H.323), Streaming (Real-time) Protocols (RTP, RTCP)
IP Multimedia Subsystem (IMS) Multimedia over Wireless/ sensor network Multimedia Networking Applications
Digital TV, Voice Over IP, IPTV, Audio/video Conferencing, Interactive Multiplier Games, Application-Level Framing, Video Servers
Digital Media Lab - Sharif University of Technology
Course Outline
Multimedia Network Security
Encryption, digital signatures, authentication, IP security Digital watermarking security features in multimedia compression standards, secure media streaming
Content Networks Convergence Networks Hot Research Topics
Digital Media Lab - Sharif University of Technology
Why Multimedia Networking?
The use of IP-based Internet is growing , both in business & home usage
Growth of networked multimedia applications on the Internet A balance of digital broadcasting with multimedia streaming over IP networks
IP network, especially Internet, is becoming a very attractive channel for multimedia communications.
Dedicated networks and ATM are not widely available to bulk of users There are many applications for Internet multimedia: Internet telephone, Internet TV, video conferencing, network games, remote corroboration, media rich social networks,
IP uses packet switching
Suitable for unexpected burst of data without establishing an explicit connection Bandwidth is shared and so data can be sent at any time
10
Digital Media Lab - Sharif University of Technology
Networked Multimedia Applications
VoIP
The Internet cloud
Video Conference
Wireless Browsing
Video Clip Attachment
E-mail
Music Streaming
Movies Streaming
Information Search
Finance, Brokerage
Digital Photos
11
Digital Media Lab - Sharif University of Technology
Networked Multimedia Applications
Multimedia Extended Email World Wide Web Video Distribution Services Video Conferencing Interactive Distributed Games Virtual Reality E-Learning Instant Messaging Sometimes there may be only one media, but similar requirements:
Image Distribution, Telephony, Radio, Jukebox Services, Document Archives
12
Digital Media Lab - Sharif University of Technology
Classes of Internet Multimedia Apps
Streaming stored media
Stored on server Examples: pre-recorded songs, famous lectures, video-on-demand
Streaming live media
Captured from live camera, radio, T.V. 1-way communication, maybe multicast Examples: concerts, radio broadcasts, lectures
Real-time interactive media
2-way communication Examples: Internet phone, video conference
13
Digital Media Lab - Sharif University of Technology
A Sample Framework of Media Delivery
Multicast capable More Robust Access to Storage Relieves Web Server Audio Video Animation Proprietary Format
Media Server
Standalone player Java based player Browser plug-in player Appliance Send Stream To Clients
Media Encoding Clients
Send Request to Media Server Decode Buffer Sync.
To hear or view a media file without downloading it Note: P2P applications and Services increasing
Web Server
Send Request To Servers
Multimedia Expectations Multimedia Expectations from a Communication Network
traffic requirements limits on real-time parameters (delay, jitter) bandwidth and reliability sychronization functional requirements support for multimedia services such as multicasting, security, mobility and session management
More about media & multimedia on next session
15
Digital Media Lab - Sharif University of Technology
Main Problems in Multimedia Applications
Supporting multimedia applications over a computer network renders the application distributed. Multimedia Transmission over Wireless/Wired networks
Convergence on Wireless, Multimedia, and Internet
Multimedia
Multimedia Capability Enhanced Mobility Full Connectivity
Wireless
Internet
16
Digital Media Lab - Sharif University of Technology
Main Problems in Multimedia Applications
Multimedia data is huge
Audio, Images, graphics, and video
Wireless/Internet lacks performance guarantee
Best effort service, no QoS provision by itself Packet loss, congestion, latency, delay jitters Errors in wireless links
Internet is heterogeneous
Varying network conditions, user preferences, device capabilities
Question : How to Enable EFFICIENT, ROBUST, UBIQUITOUS Delivery?
17
Digital Media Lab - Sharif University of Technology
Multimedia Networking Issues
Network Issues
Availability and Performance of NW Bandwidth Reliability of Transport and Performance Availability of Media-aware Middleware Availability and Performance of Applications Required standards for data exchange in heterogeneous environments Security and copyright Issues Wireless networks issues Integration of wired and wireless heterogeneous networking systems
18
Digital Media Lab - Sharif University of Technology
Media Issues
Huge amount of data Different formats of media (need for Coders & Decoders, Different Applications, transmission protocols, ...) Issues for real-time transport of streaming multimedia Quality of media
Solutions
Two basic Approaches
Network-centric End system-based
19
Digital Media Lab - Sharif University of Technology
End-System based solutions
End-System Based
Compression Layered and scalable coding
Base layer, enhancement layers MPEG: SNR, spatial, temporal scalability MPEG-4 fine granularity scalability (FGS), and H.264
MPEG Scalable Video Coding (SVC) Media distribution Media synchronization Multimedia network protocol
20
Digital Media Lab - Sharif University of Technology
End-System based solutions
End-system Based
QoS Control Congestion Control Source-based rate control, Receiver-based rate control, Hybrid rate control Rate-adaptive source encoding Rate shaping Error Control
FEC, retransmission (ARQ), error-resilient encoding, error concealment
21
Digital Media Lab - Sharif University of Technology
Network-centric based solutions
Network-centric
Packet Classification Packet is marked based on the Type of Service Packet Scheduling choose next packet to send on link Integrated Services: flow based architecture for providing QOS guarantees in IP networks for individual application sessions Differentiated Services: packet based Mark IP packet to specify treatment
Multi Protocol Label Switching: flow+ packet based
A forwarding scheme that tags packets with labels
22
Digital Media Lab - Sharif University of Technology
Next Session
Multimedia Networking
23
Sharif University of Technology, Department of Computer Engineering, Multimedia Systems Course
References
Shashank Khanvilkar, Faisal Bashir, Dan Schonfeld, and Ashfaq Khokhar, Multimedia Networks and Communication, University of Illinois at Chicago, 2004. Jenq-Neng Hwang, Introduction to multimedia networking, Cambridge University Press,
24
Digital Media Lab - Sharif University of Technology
