Annotate, Query and Design Multimedia Documents by Metadata
anis jedidi
Florence Sèdes2009, Lecture Notes in Computer Science
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
In this paper, we focus on the managing of multimedia document and more precisely on the annotation and the generation of adaptable multimedia documents. Our solution is directed towards analysing the ways to "bridge the gap" between physical and semantic levels, for multimedia document modelling and querying. Our goal is to describe how to model and unify features elicited from content and structure mining. These descriptors are built from the various features elicited from the multimedia documents using available processing techniques. The personalization enables dynamic re-structuring and reconstruction of hypermedia documents answering to the user queries. However, more factors should be considered in handling hypermedia documents. Once queried, documents can be adapted by using an indexing scheme, which exploits multiple structures. We can process queries efficiently with minimal storage overhead. We suggest for that, the adaptation of multimedia document content with user needs and preferences. This approach is based on the OOHDM methodology extension with the use of the metadata.
Related papers
A Contribution to Multimedia Document Modeling and Querying
Multimedia Tools and Applications, 2005
Metadata on multimedia documents may help to describe their content and make their processing easier, for example by identifying events in temporal media, as well as carrying descriptive information for the overall resource. Metadata is essentially static and may be associated with, or embedded in, the multimedia contents. The aim of this paper is to present a proposal for multimedia documents annotation, based on modeling and unifying features elicited from content and structure mining. Our approach relies on the availability of annotated metadata representing segment content and structure as well as segment transcripts. Temporal and spatial operators are also taken into account when annotating documents. Any feature is identified into a descriptor called "meta-document". These meta-documents are the basis of querying by adapted query languages.
Conceptual modeling of multimedia documents
Computer, 2000
Our research works are interested in the identification and the representation of the semantic structures of multimedia documents. The semantic structure of a multimedia document is composed of its logical structure as well as the metadata associated to its components. Our goal is to use this semantic structure to store multimedia documents in warehouses. These warehouses must handle and exploit information contained in the relevant documents extracted from disseminated sources. This constitutes a shared repository which must facilitate the cooperative creation and flexible management of the documents.
Towards a User-aware Enrichment of Multimedia Metadata
A recent trend in multimedia information retrieval systems is the integration of users, by their preferences and interests, in the retrieval process. Generally, such systems consider the user only after the query's execution, while the results' presentation. We propose to consider the user as a source of metadata, by exploiting his behaviour and to enrich the document's metadata with a usage metadata. We introduce the concept of temperature, associated to each metadata descriptor, which denotes the popularity of the multimedia document's metadata. An algorithm for the computation, the increase and the decrease of this temperature is described in details. We present also how this algorithm can be used for the enrichment of each metadata descriptor according to the user's interactions with the multimedia content and the metadata.
A conceptual modeling of multimedia documents
Iadis, 2004
Our research works are interested in the identification and the representation of the semantic structures of multimedia documents. The semantic structure of a multimedia document is composed of its logical structure as well as the metadata associated to its components. Our goal is to use this semantic structure to store multimedia documents in warehouses. These warehouses must handle and exploit information contained in the relevant documents extracted from disseminated sources. This constitutes a shared repository which must facilitate the cooperative creation and flexible management of the documents.
Metadata Based Approach for Web Multimedia Model
Due to the rapid growth of digital information over the Internet, it is becoming very important to extract useful information from web multimedia data. The WWW (World Wide Web) provides a simple and effective means for users to retrieve multimedia data on the Internet. Nowadays web multimedia data are used in a much more natural and mature way. Rapid increase in the huge amount of multimedia data over the internet, there is emerging trend to study, modeling and retrieve, and mining the multimedia data from the internet. Due to complex and unstructured nature of the web multimedia data, it is difficult for mining and processing effectively. To overcome from this problem, this paper proposes a new web multimedia data model for presenting web multimedia data components integrating large amounts of data of different types such as text, images, video and audio, with its metadata values for mining and processing web multimedia data effectively.
ToCAI: A Framework for Indexing and Retrieval of Multimedia Documents
1999
This paper presents the ToCAI (table of content-analytical index) description scheme (DS) for content description of audio-visual documents. The original idea comes from the structure used for technical books. One may easily understand a book's sequential organization by looking at its table of contents while quickly retrieving elements of interest by means of the analytical index. This description scheme provides therefore a hierarchical description of the time sequential structure of a multimedia document (thanks to the ToC), suitable for browsing, together with an “analytical index” (AI) of audio-visual objects of the document, suitable for effective retrieval. Besides, two sub-description schemes for information about description generation and about the metadata associated with the document are also enclosed in the general DS. The detailed structure of the DS is also presented by means of UML (unified modelling language) notation and an application example is shown. Finally, some considerations concerning the adopted visual interface are made
Knowledge-Based Multimedia Content Indexing and Retrieval
Methods, Standards and Tools, 2005
By the end of the last century the question was not whether digital archives are technically and economically viable, but rather how digital archives would be efficient and informative. In this framework, different scientific fields such as, on the one hand, development of database management systems, and, on the other hand, processing and analysis of multimedia data, as well as artificial and computational intelligence methods, have observed a close cooperation with each other during the past few years. The attempt has been to develop intelligent and efficient human-computer interaction systems, enabling the user to access vast amounts of heterogeneous information, stored in different sites and archives.
Integration of Structural and Semantic Models for Multimedia Data Management
The management and exchange of multimedia data is challenging due to the variety of formats, standards and intended applications. In addition, production of multimedia data is rapidly increasing due to the availability of off-the-shelf, modern digital devices that can be used by even inexperienced users. It is likely that this volume of information will only increase in the future. A key goal of the MUSCLE (Multimedia Understanding through Semantics, Computation and Learning) network is to develop tools, technologies and standards to facilitate the interoperability of multimedia content and support the exchange of such data. One approach for achieving this was the creation of a specific "E-Team", composed of the authors, to discuss core questions and practical issues based on the participant’s individual work. In this paper, we present the relevant points of view with regards to sharing experiences and to extracting and integrating multimedia data and metadata from different modes (text, images, video).
Automatic metadata extraction and indexing for reusing e-learning multimedia objects
2007
In this paper we present the architecture of a Digital Library for enabling the reusing of audiovisual documents in an e-Learning context. The reuse of Learning Objects is based on automatically extracted descriptors carrying a semantic meaning for the professional that uses these Learning Objects to prepare new interactive multimedia lectures.
Multimedia Document Models: Sealed Fate or Setting Out for New Shores
Multimedia Tools and Applications, 2000
Existing multimedia document models like HTML, MHEG, SMIL, and HyTime lack appropriate modeling primitives to fit the needs of next generation multimedia applications which bring up requirements like reusability of multimedia content in different presentations and contexts, and adaptation to user preferences. In this paper, we motivate and present new requirements stemming from advanced multimedia applications and the resulting consequences for multimedia document models. Along these requirements, we discuss HTML, HyTime, MHEG, SMIL, and Z Y X, a new model that has been developed with special focus on reusability and adaptation. The analysis and comparison of the models show the limitations of existing models, point the way to the need for new flexible multimedia document models, and throw light on the many implications on authoring systems, multimedia content management, and presentation.
Related papers
Object-Oriented Modeling of Multimedia Documents
Computer Networks and Isdn Systems, 1998
This paper describes an object-oriented model for paper-based multimedia documents such as a textbook with embedded graphics. This model is the first step towards building a manageable authoring system for the Web, in which documents can be easily built, extended, truncated, reordered, assembled and disassembled on a component basis, and the document components can be reused. The model will also make accessible properties which might be significant or important to the user, especially in searching or classifying documents, such as the document title and author. The model design is explained, and the class hierarchy for the model is presented. 0 1998 Published by Elsevier Science B.V. All rights reserved.
Guest Editors' Introduction: Multimedia Metadata and Semantic Management
IEEE Multimedia, 2000
A Contribution to Multimedia Document Annotation and Representation
The aim of this paper is to present a solution to cope with the problem of multimedia documents annotation in order to enable user's queries, based on content mining and structure eliciting from semi-structured documents. Whatever the media type, indexing aims at locating spatial and/or temporal (physical) segments. These segments correspond to strings of variable granularity. Their location requires relative or absolute addressing mechanisms, according to the context, as the finite co-ordinate space locator (fcs) in HyTime. Our approach relies on the availability of annotated metadata representing segment content and structure as well as segment transcripts (speech-to-text, closed caption). The available indexing and segmentation tools and techniques make it possible to build describers by eliciting the specific structure of each segment. The aim of this process is to propose a generic view of these specific structures, homogenizing them by combining the different media descri...
EMMA – A Formal Basis for Querying Enhanced Multimedia Meta Objects
Lecture Notes in Computer Science, 2005
Today's multimedia content formats primarily encode the presentation of content but not the information the content conveys. However, this presentation-oriented modeling only permits the inflexible, hard-wired presentation of multimedia content. For the realization of advanced operations like the retrieval and reuse of content, automatic composition, or adaptation to a user's needs, the multimedia content has to be enriched by additional semantic information, e.g. the semantic interrelationships between single multimedia content items. Enhanced Multimedia Meta Objects (EMMOs) are a novel approach to multimedia content modeling, which combines media, semantic relationships between those media, as well as functionality on the media (such as rendering) into tradeable and versionable knowledge-enriched units of multimedia content. For the processing of EMMOs and the knowledge they incorporate, suitable querying facilities are required. Based on the formal definition of the EMMO model, in this paper, we propose and formally define the EMMO Algebra EMMA, a query algebra that is adequate and complete with regard to the EMMO model. EMMA offers a rich set of orthogonal query operators, which are sufficiently expressive to provide access to all aspects of EMMOs and enable efficient query rewriting and optimization. In addition, they allow for the seamless integration of ontological knowledge within queries, such as supertype/subtype relationships, transitive and inverse associations, etc. Thus, EMMA represents a sound and adequate foundation for the realization of powerful EMMO querying facilities. We have finished the implementation of an EMMO container environment and an EMMA query execution engine, and are currently in the process of evaluating the query algebra in several case studies. 1 CULTOS was carried out from 2001 to 2003 by partners from 11 EU countries and Israel. It aimed at providing a collaborative multimedia platform for researchers in intertextual studies enabling them to share and communicate their knowledge about the relationships between cultural artifacts. See http://www.cultos.org for more information.
Integration of Structural and Semantic Models for Multimedia Metadata Management
2007 International Workshop on Content-Based Multimedia Indexing, 2007
The management and exchange of multimedia data is challenging due to the variety of formats, standards and intended applications. In addition, production of multimedia data is rapidly increasing due to the availability of off-the-shelf, modern digital devices that can be used by even inexperienced users. It is likely that this volume of information will only increase in the future. A key goal of the MUSCLE (Multimedia Understanding through Semantics, Computation and Learning) network is to develop tools, technologies and standards to facilitate the interoperability of multimedia content and support the exchange of such data. One approach for achieving this was the creation of a specific "E-Team", composed of the authors, to discuss core questions and practical issues based on the participant's individual work. In this paper, we present the relevant points of view with regards to sharing experiences and to extracting and integrating multimedia data and metadata from different modes (text, images, video).
J11 Scherp Et Al Pattern System For Describing The Semantics Of Structured Multimedia Documents
Today's metadata models and metadata standards often focus on a speci¯c media type only, lack combinability with other metadata models, or are limited with respect to the features they support. Thus they are not su±cient to describe the semantics of rich, structured multimedia documents. To overcome these limitations, we have developed a comprehensive model for representing multimedia metadata, the Multimedia Metadata Ontology (M3O). The M3O has been developed by an extensive analysis of related work and abstracts from the features of existing metadata models and metadata standards. It is based on the foundational ontology DOLCE+DnS Ultralight and makes use of ontology design patterns. The M3O serves as generic modeling framework for integrating the existing metadata models and metadata standards rather than replacing them. As such, the M3O can be used internally as semantic data model within complex multimedia applications such as authoring tools or multimedia management systems. To make use of the M3O in concrete multimedia applications, a generic application programming interface (API) has been implemented based on a sophisticated persistence layer that provides explicit support for ontology design patterns. To demonstrate applicability of the M3O API, we have integrated and applied it with our SemanticMM4U framework for the multichannel generation of semantically annotated multimedia documents.
MultiMedia Metadata Management: a Proposal for an Infrastructure
This paper presents an approach for the integration of multimedia metadata and their management based on Semantic Web technology. In particular, we propose a java-based Infrastructure for MultiMedia Metadata Management -4M -composed of five main components, an MPEG-7 feature processing unit, an XML database management unit, an algorithms ontologyexploiting unit, a multimedia semantic annotation and integration units. This way, we intend to introduce the novel idea of managing also algorithms on a variety of multimedia metadata (audio, images and videos) to add the capability of tracking data processing. This work is mainly carried out in the framework of the European Network of Excellence MUSCLE (Multimedia Understanding through Semantics, Computation and Learning), where ISTI-CNR is leading the 'Representation and Communication of Data and Metadata' Workpackage.
ZYX - A Semantic Model for Multimedia Documents and Presentations
1999
Existing languages, formats, and multimedia document models such as HTML, MHEG, SMIL, HyTime, SGML, and XML, do not provide the appropriate modeling primitives needed to provide adequate support for reusability, interaction, adaptation, and presentation-neutral description of the structure and content of multimedia documents as required in the Cardio-OP project. Since each of these models lacks some signi cant concepts and does not meet all of the requirements, we propose a new approach for the semantic modeling of multimedia content, the Z Y X model, which we implemented on the basis of an object-relational database system. The approach taken allows for ne-grained representation and retrieval of structures and layout of multimedia material, for exible on-the-y composition of multimedia fragments in order to create individualized multimedia documents, and for the realization of adaptation and personalization of multimedia presentations depending on the user environment speci ed by means of user pro les.
Semantic Representation of Multimedia Content - Knowledge Representation and Semantic Indexing
In this paper we present a framework for unified, personalized access to heterogeneous multimedia content in distributed repositories. Focusing on semantic analysis of multimedia documents, metadata, user queries and user profiles, it contributes to the bridging of the gap between the semantic nature of user queries and raw multimedia documents. The proposed approach utilizes as input visual content analysis results, as well as analyzes and exploits associated textual annotation, in order to extract the underlying semantics, construct a semantic index and classify documents to topics, based on a unified knowledge and semantics representation model. It may then accept user queries, and, carrying out semantic interpretation and expansion, retrieve documents from the index and rank them according to user preferences, similarly to text retrieval. All processes are based on a novel semantic processing methodology, employing fuzzy algebra and principles of taxonomic knowledge representation. Part I of this work presented in this paper deals with data and knowledge models, manipulation of multimedia content annotations and semantic indexing, while Part II will continue on the use of the extracted semantic information for personalized retrieval.
A media agent for automatically building a personalized semantic index of Web media objects
Journal of the American Society for Information Science and Technology, 2001
A novel idea of media agent is briefly presented, which can automatically build a personalized semantic index of Web media objects for each particular user. Because the Web is a rich source of multimedia data and the text content on the Web pages is usually semantically related to those media objects on the same pages, the media agent can automatically collect the URLs and related text, and then build the index of the multimedia data, on behalf of the user whenever and wherever she accesses these multimedia data or their container Web pages. Moreover, the media agent can also use an off-line crawler to build the index for those multimedia objects that are relevant to the user's favorites but have not accessed by the user yet. When the user wants to find these multimedia data once again, the semantic index facilitates text-based search for her.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.