An MPEG-4 based interactive multimedia system

Lecture Notes in Computer Science, 2001

Nearly all of the multimedia streaming applications running on the Internet today are basically configured or designed for 2D video broadcast or multicast purposes. With its tremendous flexibility, MPEG-4 interactive clientserver applications are expected to play an important role in online multimedia services in the future. This paper presents the initial design and implementation of a transport infrastructure for an IP based network that will support a clientserver system which enables end users to: 1) author their own MPEG-4 presentations, 2) control the delivery of the presentation, and 3) interact with the system to make changes to the presentation in real time. A specification for the overall system structure is outlined. Some initial thoughts on the server and client system designs, the data transport component, QoS provisioning, and the control plane necessary to support an interactive application are described.

IEEE Transactions on Circuits and Systems for Video Technology, 1999

We describe the implementation of a streaming client-server system for object-based audio-visual presentations in general and MPEG-4 content in particular. The system augments the MPEG-4 demonstration software implementation (IM1) for PC's by adding network-based operation with full support for the Delivery Multimedia Integration Framework (DMIF) specification, a streaming PC-based server with DMIF support (via Xbind Inc.'s XDMIF suite), and multiplexing software. We describe XDMIF, the first reference implementation of the DMIF specification. The MPEG-4 server is designed for delivering object-based audio-visual presentation. We discuss the issues in the design and implementation of MPEG-4 servers. The system also implements a novel architecture for client-server interaction in object-based audio-visual presentations, using the mechanism of command routes and command descriptors. This new concept of command routes and command descriptors is useful in developing sophisticated interactive applications.

2000

Networking of MPEG-4 content is the topic of standardization e orts in the ISO MPEG and IETF. DMIF Delivery Multimedia Integration Framework was developed in the ISO MPEG as a generic networking platform for MPEG-4 content. In this paper we are describing the implementation of a MPEG-4 client-server architecture, uses DMIF with Internet RTSP Real Time Streaming Protocol for signaling. Mapping of DMIF functionalities onto RTSP messages is shown. The implemented system runs on PC platform and its operation is explained in details.

2000

With the success of the Internet and exibility of MPEG-4, transporting MPEG-4 video over the Internet is expected to be an important component of many m ultimedia applications in the near future. Video applications typically have delay and loss requirements, which cannot be adequately supported by the current I n ternet. Thus, it is a challenging problem to design an e cient MPEG-4 video delivery system that can maximize the perceptual quality while achieving high resource utilization. This paper addresses this problem by presenting an end-to-end architecture for transporting MPEG-4 video over the Internet. We present a framework for transporting MPEG-4 video, which includes source rate adaptation, packetization, feedback control, and error control. The main contributions of this paper are: 1 a feedback control algorithm based on Real Time Protocol and Real Time Control Protocol RTP RTCP, 2 an adaptive source encoding algorithm for MPEG-4 video which is able to adjust the output rate of MPEG-4 video to the desired rate, and 3 an e cient and robust packetization algorithm for MPEG video bit-streams at the sync layer for Internet transport. Simulation results show that our end-to-end transport architecture achieves good perceptual picture quality for MPEG-4 video under low bit-rate and varying network conditions and e ciently utilizes network resources. Keywords| MPEG-4, video object, Internet, packetization, RTP RTCP, feedback control, adaptive encoding.

2000

Networking of MPEG-4 content is the topic of ongoing standardization efforts in the ISO MPEG and IETF. In this paper, we describe a complete architecture for the transport of MPEG-4 content over the Internet. The MPEG-4 concept of separation between applications and delivery mechanism is preserved. The use of well-established Internet protocols, such as the Real Time Protocol (RTP) and the Real Time Streaming Protocol (RTSP) allows for robustness and flexibility in view of interoperability and future extensions. In particular, we present an original proposal for the mapping of MPEG-4 specific signaling primitives onto RTSP functions.

Signal Processing: Image Communication, 1999

Real-time streaming of audio-visual content over Internet Protocol (IP) based networks has enabled a wide range of multimedia applications. An Internet streaming solution has to provide real-time delivery and presentation of a continuous media content while compensating for the lack of Quality-of-Service (QoS) guarantees over the Internet. Due to the variation and unpredictability of bandwidth and other performance parameters (e.g. packet loss rate) over IP networks, in general, most of the proposed streaming solutions are based on some type of a data loss handling method and a layered video coding scheme. In this paper, we describe a real-time streaming solution suitable for non-delay-sensitive video applications such as video-on-demand and live TV viewing.

This paper presents the design of a QoS-aware MPEG-4 multimedia-streaming system. This system was designed as a platform to take advantage of the QoS functionality that is being quickly introduced into the Internet. The system deals with the particular difficulties involved in providing quality of service streaming for complex multi-object media such as MPEG-4. The delivery framework in this design is a hybrid version of the Delivery Multimedia Integration Framework (DMIF). The issues addressed by the proposed Server architecture include resource reservation, QoS messaging, multi-stream scheduling, and rate control.

2001

Abstract--This paper presents implementations of two MPEG-4 Streaming scenarios (remote retrieval and broadcast) for the delivery of multiple elementary stream presentations containing audio-visual objects. These systems have been tested with the MPEG-4 demonstration software implementation (IM1), but are in fact generic platforms for multimedia presentation delivery.

2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763)

We present an efficient MPEG-4-based interactive player for PDA-like embedded devices in this paper. Our system can receive media from various sources, then decompress and compose them in an object-oriented manner. Embedded devices such as PDA usually have limited computational resources, memory size. power budgets. and multimedia capabilities. To overcome these constraints, two novel mechanisms were introduced, namely adaptive frame rule (AFR) and scene cache graph management (SCCMJ. Furthermore, a media decoding framework was proposed such that multimedia objects of different formats can be retrieved from different sources and then be decoded. This framework can be extended by add-on components. A semi-pull model was also designed for the synchronization of heterogeneous media objects. Finally, all the key modules were efficiently implemented and optimized. These modules include MPEG-4 video decoder, 2D/3D graphic engine. buffer management, script engine, and streaming service.

2002

This paper presents an end-to-end application and network framework for delivering multimedia services over QoS aware IP networks as this is implemented within the IST OPENISE project. Several interactive MPEG-4 applications addressing the fields of tele-learning, conferencing and interactive TV have been classified according to their content and QoS requirements. The profile of the traffic that is generated by this set of applications has been clearly identified by using specially implemented traffic analysis tools. The diverse QoS requirements have been carefully mapped to network parameters. The paper reports on the performance capabilities of several packet-scheduling schemes and demonstrates their merits and applicability in delivering time-critical multimedia content.