Toward a Search Engine of Multimedia Presentations

Computer Networks and ISDN Systems, 1998

While pages on the Web contain more and more multimedia information, such as images, videos and audio, today's search engines are mostly based on textual information. There is an emerging need for a new generation of search engines that try to exploit the full multimedia information present on the Web. The approach presented in this paper is based on a multimedia model intended to describe the various multimedia components, their structure and their relationships with a pre-defined taxonomy of concepts, in order to support the information retrieval process. 0 1998 Publ i shed by Elscvier Science B.V. All rights reserved. Kqwords: Search engines: Multimedia information retrieval ' http://www.itnm.columbia.edu/webseek " http://www.ccrl.neclab.com/nmorc 0169.7552/98/$I9.00 0 I998 Publ i shed by Elsevier Science B.V. All rights re\ervcd P/I SOl69-7552(98)00096-S

2002

ABSTRACT First MUVIS system has been developed three years ago, supporting image indexing and means to retrieve images from large image databases using image visual and semantic features such as color, texture and shape. Recently, MUVIS project has been reformed to become a PC-based system, which supports indexing, browsing and querying on various multimedia types such as audio, video and image.

Information Processing & Management, 2008

Web search engines are beginning to offer access to multimedia searching, including audio, video and image searching. In this paper we report findings from a study examining the state of multimedia search functionality on major general and specialized Web search engines. We investigated 102 Web search engines to examine: (1) how many Web search engines offer multimedia searching, (2) the type of multimedia search functionality and methods offered, such as ''query by example'', and (3) the supports for personalization or customization which are accessible as advanced search. Findings include:

2017

Finding images or videos in multimedia collections is a difficult task. Many collections only have metadata such as filenames or timestamps, and no other information is available. To augment this, we can employ content based analysis techniques that provides extra content based metadata. This provides a good starting point, but the accuracy is often insufficient to automate full collection categorization. A human in the loop is essential to aid with search and categorization. In this thesis we evaluate how to retrieve elements from multimedia collections for a variety of retrieval tasks. We investigate different user interfaces that extend content based retrieval methods with novel user interface techniques. In one interface, MediaTable, we focus on categorization tasks by leveraging table-style user interfaces with images so users can investigate both the multimedia content and associated metadata at the same time. Users can categorize elements by placing them in buckets, and we pe...

Indexing multimedia Web documents can be regarded as an important part of Web engineering, a concept first proposed by one of the authors and his collaborators in 1998 at the World Wide Web WWW7 conference in Brisbane, Australia. Contentbased indexing of multimedia has always been a challenging task. The enormity and diversity of the multimedia content on the World Wide Web (WWW) adds another dimension to this challenge. Today multimedia elements are increasingly being embedded in Web documents, and are being actively used to enhance the description of the document content. Since such documents over the WWW provide a rich source of information, the use of multimedia elements in Web documents has become very prevalent. In this paper, we first give a thorough review on the existing literature related to the traditional content-based image retrieval (CBIR) systems along with the methodology of relevance feedback. We then propose a unified approach for image indexing and retrieval for our Image Search retrieval system that performs relevance feedback on both the images' semantic contents represented by parts of the Web document as well as the low-level visual features. In addition, we will establish an approach with which semantic content and low-level features can be seamlessly integrated for the relevance feedbacks. More specifically, we will examine closely a number of ways that would combine visual and textual information for the content based indexing of multimedia on the Web. In particular, we will also propose and scrutinize different strategies of incorporating various mono media indexing approaches to create a multimedia indexing scheme for the purpose of image searches.

International Journal of Computer Applications, 2012

Retrieval of multimedia has become a requirement for many contemporary information systems. These systems need to provide browsing, querying, navigation, and, sometimes, composition capabilities involving various forms of media. In this survey, we review techniques for text, image, audio and video retrieval. We first look at indexing and retrieval techniques for text, audio, image and video. We also discuss features visual features for video retrieval such as colour, texture, shape. The indexing techniques are discussed for these features. We also compare most popular techniques used for indexing and retrieval.

2008

We have developed an interactive video search system that allows the searcher to rapidly assess query results and easily pivot o those results to form new queries. The system is intended to maximize the use of the discriminative power of the human searcher. The typical video search scenario we consider has a single searcher with the ability to search with

Proceedings 10th International Conference on Image Analysis and Processing, 1999

A framework, called Table of Content-Analytical Index (ToCAI), for the content description of multimedia material is presented. The idea for such a description scheme (DS) comes out from the structures used for indexing technical books (containing a Table of Content, typically placed at the beginning of the book, where the list of topics is organized hierarchically into chapters, sections, and an Analytical Index, typically placed at the end of the book, where keywords are listed alphabetically). The ToCAI description scheme provides similarly a hierarchical description of the time sequential structure of a multimedia document (ToC), suitable for browsing, and an "Analytical Index" (AI) of audiovisual key items for the document, suitable for effective retrieval. Besides two other sub-description schemes are proposed to specify the program category and the description of other metadata associated to the multimedia document in the general DS. The detailed structure of the DS is presented by means of a UML diagram. Moreover, some suitable automatic extraction methods for the identification of the values associated to the descriptors that compose the ToCAI are presented and discussed. Finally, a browsing application example is also proposed.

Proceedings of the seventh ACM international conference on Multimedia (Part 1) - MULTIMEDIA '99, 1999

Several years have passed since the research topic of content based multimedia retrieval emerged. We have witnessed the burgeoning research activities into a plenitude of new indexing, retrieval, and filtering tools for images, video, audio, music, graphics, and their combinations with text-based information. Exciting research opportunities arise when integrating knowledge from multiple disciplines, such as media content processing, database, information retrieval, and machine user interface. In the commercial domain, we have also witnessed several impressive efforts moving technologies into practical arenas.

2000

In this paper, we propose adding metadata to web for the purpose of performing semantics-based web searches and for producing multimedia presentations as a response to users' requests. The model uses (a) topics and "topic maps" as metadata in reaching to relevant worldwide web documents, (b) topic prerequisites and corequisites, also called topic metalinks, to define metadata-based navigational pathways on the web and to reach to web documents that constitute sources, and (c) multimedia presentations, called Topic Comprehension Presentations, for presenting possibly large sources to users in a controlled manner. We investigate automated searching techniques that utilize in an integrated manner (i) topic metalink-and source-information in web documents and in topic map databases, (ii) webaccessible topic map databases, and (iii) local "user-profile" databases that contain users' knowledge on topics. The query output of such a search will be a list of Topic Comprehension Presentations, from which the user for playout purposes will choose one. We describe the first version of a Topic Comprehension Tool that partially implements the proposed framework, and report its preliminary testing.

… Indexing (CBMI), 2011 …, 2011

In this paper we present two interactive systems for video search and browsing; one is a web application based on the Rich Internet Application paradigm, designed to obtain the levels of responsiveness and interactivity typical of a desktop application, while the other exploits multi-touch devices to implement a multi-user collaborative application. Both systems use the same ontology-based video search engine, that is capable of expanding user queries through ontology reasoning, and let users to search for specific video segments that contain a semantic concept or to browse the content of video collections, when it's too difficult to express a specific query.

Flexible Query Answering Systems, 2001

Which concepts are general and specific enough to support hypermedia retrieval? We present in this paper a graphical user interface that makes explicit the following three key concepts for hypermedia retrieval: content of documents, facts about documents and structure of documents.