MULTIMEDIA FRAMEWORK
Multimedia System
A Multimedia System is a system capable of processing multimedia data and applications. A Multimedia System is characterized by the processing, storage, generation, manipulation and rendition of Multimedia information.
Characteristics of a Multimedia System
A Multimedia system has four basic characteristics: Multimedia systems must be computer controlled. Multimedia systems are integrated. The information they handle must be represented
digitally. The interface to the final presentation of media is usually interactive.
Challenges for Multimedia Systems
Distributed Networks Temporal relationship between data Render different data at same time continuously. Sequencing within the media playing frames in correct order/time frame in video Synchronisation inter-media scheduling E.g. Video and Audio Lip synchronisation is clearly important for humans to watch playback of video and audio and even animation and audio. Ever tried watching an out of (lip) sync film for a long time?
Challenges
Efficient and High I/O input and output to the file subsystem needs to be efficient and fast. Needs to allow for real-time recording as well as playback of data. e.g. Direct to Disk recording systems. Special Operating System to allow access to file system and process data efficiently and quickly. Needs to support direct transfers to disk, real-time scheduling, fast interrupt processing, I/O streaming etc.
Challenges..
Storage and Memory large storage units (of the
order of hundreds of Tb if not more) and large memory (several Gb or more). Large Caches also required and high speed buses for efficient management. Network Support Client-server systems common as distributed systems common. Software Tools user friendly tools needed to handle media, design and develop applications, deliver media.
Key Issues for Multimedia Systems
The key issues multimedia systems need to deal with here are: How to represent and store temporal information. How to strictly maintain the temporal relationships on play back/retrieval What process are involved in the above. Data has to represented digitally AnalogDigital Conversion, Sampling etc. Large Data Requirements bandwidth, storage, Data compression is usually mandatory
Desirable Features for a Multimedia System
Given the above challenges the following feature a desirable (if not a prerequisite) for a Multimedia System: Very High Processing Power needed to deal with large data processing and real time delivery of media. Special hardware commonplace. Multimedia Capable File System needed to deliver real-time media e.g. Video/Audio Streaming. Special Hardware/Software needed e.g. RAID technology. Data Representations File Formats that support multimedia should be easy to handle yet allow for compression/decompression in realtime.
Components of a Multimedia System
Now let us consider the Components (Hardware and Software) required for a multimedia system: Capture devices Video Camera, Video Recorder, Audio Microphone, Keyboards, mice, graphics tablets, 3D input devices, tactile sensors, VR devices. Digitizing Hardware Storage Devices Hard disks, CD-ROMs, DVD-ROM, etc Communication Networks Local Networks, Intranets, Internet, Multimedia or other special high speed networks. Computer Systems Multimedia Desktop machines, Workstations, MPEG/VIDEO. Display Devices CD-quality speakers, HDTV,SVGA, Hi-Res monitors, Color printers etc.
Multimedia Framework
Consists of Four Models : Multimedia Information System Model Multimedia Conferencing Model Multimedia Distributed Processing Model Multimedia Network Model
Framework provides an overall picture of the development of distributed multimedia system from which a system architecture can be developed. Framework highlights the dominant feature of multimedia system. Integration of multimedia computing and communication include telephony and telecommunication functions.
1. Multimedia Information System
Information system extend the processing ,storage & retrieval capabilities of existing information systems by introducing new media data types, image, audio, video. Information System is decomposed into two models:Multimedia Information Model. Multimedia Distributed Processing Model.
1.A Multimedia Information Model
Includes data modeling for storage, retrieval & processing. Central concern is to find the collection of multimedia documents that are needed for user information. Model supports temporal relationship between components, interactivity, components with active behavior. Model is related to the authoring process for creating multimedia information and then provides interactivity and then relating various components.
1.B Multimedia Distributed Processing Model
Layered View as under:Layer 1: Application Layer 2: Script-wares Layer 3: Toolkits (GUI, Media Device Control ) Layer 4: Orchestration (Admissibility, Multichannel Sync, Media Scheduling) Layer 5: Media Services (Distributed Object Model, Device Server, Conferencing Services, Window Server, Hypermedia Engine) Layer 6: System Services ( Real Time Network Transport, Real Time Scheduling). Layer 7: Hardware Services ( Network Adapters , Digital Storage, CODECS).
2. Multimedia Communication Model
Consists of Further two models: Multiservice Network Model Conferencing Model
2.A Multimedia Network Model :
Networks for Distributed Multimedia Systems called as Multiservice Network because they provide support for wide range of real time traffic requirement . Example: Public Switched Network Internet.
2.B Conferencing Model
Telecommunication sector of the International Telecommunication Union has developed a set of standards for multimedia conferencing over packet based network. This model supports middle scale or large scale mm conference. Model analyses the key technologies in multimedia conference like media server design. Telecommunication System.
Thank You !!!!
