FORUM: a flexible data integration system based on data semantics
Farouk Toumani2010, Sigmod Record
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
The FORUM project aims at extending existing data integration techniques in order to facilitate the development of mediation systems in large and dynamic environments. It is well known from the literature that a crucial point that hampers the development and wide adoption of mediation systems lies in the high entry and maintenance costs of such systems. To overcome these barriers,
Related papers
Model-based Data Management for Mediation Services for Intelligent Software Agents
Mediation services can be generally defined as a mechanism to map interchange formats (map them to what?), thus increasing the ability for disparate systems to exchange information through common methods. However, when intelligent software agents use these meditation ser- vices, syntactical translations of formats are not sufficient. The semantic context has to be captured and interchanged as well; a common ontology is needed as the basis for the mediation service. While in the commercial world several recent publications are looking at possible automated solutions, in complex environments (is the commercial world not complex?), data engineering is necessary in order to support semantically meaningful me- diation layers. Model-based data management uses a common reference model to map data models to data sources to support intelligent software agents for their internal decision proc- esses This paper defines the phases of data engineering, shows potential conflicts and how they can ...
The conceptual basis for mediation services
IEEE Expert, 1997
AS INFORMATION SYSTEMS GROW, they depend increasingly on diverse, heterogeneous resources, such as databases, knowledge bases, bibliographic files, Web-based information, computational facilities, digital libraries, geographic information systems, and simulations. Users typically develop and maintain these resources autonomously. While the immediate applications of these resources tend to be inventory control, payroll, production control, and the like, the data eventually become important for supporting high-level applications, such as planning and decision-making.
Semantic Information Integration in the Large: Adaptability, Extensibility, and Scalability of the Context Mediation Approach
SSRN Electronic Journal, 2000
There is pressing need for effectively integrating information from an ever increasing number of available sources both on the web and in other existing systems. A key difficulty of achieving this goal comes from the pervasive heterogeneities in all levels of information systems.
Component-based mediation services for the integration of medical applications
Artificial Intelligence in Medicine, 2003
Allowing exchange of information and cooperation among network-wide distributed and heterogeneous applications is a major need of current health-care information systems. The European project SynEx aims at developing an integration platform for both new and legacy applications on each partner's site. We developed, in this project, mediation services based on the generic and reusable software components that facilitate the construction of an integration platform and ease the communication and the meaningful transformation among distributed and heterogeneous applications. The main component of the mediation services is named Pilot, which serves as an intelligent broker. It uses a multi-agents service model allowing the integration platform to be multi-servers. It transforms a client request into a valid high level service on the platform. Each service is broken up into several elementary steps by the Pilot. For each step, the Pilot uses an agent to realize the operation configured by the step. At runtime, the Pilot synchronizes the execution of different steps. To ease the communication and the interaction with the heterogeneous systems, an agent can integrate a Mediator. The Mediators are the communication and interpretation tools within the mediation services. We have developed a generic model that can be specialized for creating specific mediators for the different use cases. The mediator model uses two interfaces to connect the mediator with two systems that need to communicate. Each interface deals with the three aspects through three managers (the Communication Manager, the Syntax Manager and the Semantic Manager). Some ready-to-use specializations are developed for some well defined cases which can reduce the development effort. Once a manager is specialized, it can be used in different combinations with other managers to resolve different problems. The meaningful transformation is ensured on a semantic level in each mediator through the Semantic Model component. This last component allows the mapping among different vocabularies used by different systems through a shared ontology which allows the mapping process to focus on the meaning of the transformed information. We have used XML in different components of the mediation services as the interchange format and the description format. This has enhanced the flexibility of the components. The component based approach allows the generic components to be reused in different contexts and also allows the mediations services to be open to integrate other available technologies thus largely reduce the development efforts. #
Semantic Mediation: An Ontology-Based Architecture Using Metadata
Proc. CSIT2006, Amman; Jordany, 2006
Nowadays, we are witnessing a great growth in the creation of information systems, which contain a huge amount of digital data. The data is stored in separate and autonomous repositories, and varies in their representation and format from structured (e.g. Relation databases), semi-structured (e.g. XML) to unstructured formats (e.g. text, images). However, these different sources can contain complementary or equivalent semantically information that require to be queried in a transparent way through a unique interface and an intelligent system, that can offer critical function. This goal is faced with heterogeneity problems, which can be classified into three types: syntactic heterogeneities, structural heterogeneities and semantic heterogeneities. During last decades, several approaches were adopted to deal with these heterogeneity problems. In this paper, we discuss data integration in general, and focus on our ontology-based approach to resolve semantic heterogeneity. Our purpose is to guarantee transparent and uniform access to heterogeneous and autonomous systems using semantic metadata-based ontologies. These are described in and OWL, the W3C standard language for ontologies and its related SWRL language for rule and axioms description. The XQuery is used to express user queries. Our system will be able to focus on complex semantic problems related to elearning, Digital libraries, e-gov....
D4.6.1.1 Report on ontology mediation for case studies v.1
2005
The aim of this deliverable is to identify the requirements for mediation for the SEKT casestudies. The data sources from each case study are investigated together with the relationships between them and with the scenarios in which two or more of these data sources are used in conjunction, i.e. where data integration is needed. The requirements for mediation are identified based on these scenarios. We should note that as a result of our analysis we identified the opportunity of some architectural changes for two of the casestudies. The new data source landscapes proposed together with guidelines about different mediation approaches should serve as a pillar for the further development of thecase studies. Also the identified requirements show that the main mediation functionality on which the tools developed by the WP4 should focus on is ontology alignment.
Using Agents for Generation and Maintenance of Mediators in a Data Integration System on the Web
2001
In this paper we present a system for data integration on the web, where an XML-based mediator plays a key role providing a homogeneous view of different data sources. One novelty of our approach is that we also propose solutions for the problems of generation and maintenance of mediators. Observe that, in dynamic environments, such as the Web, individual data sources may change not only their data but also their schemas. As a result, whenever a local schema changes, the mediator needs to be updated to reflect the modifications. The system uses agents to support mediator generation and maintenance. We specify a set of tasks that must be performed by the agents in order to support these two tasks. In our approach, we use correspondence assertions for specifying the semantics of XML-based mediators. We also discuss how this high-level specification of the mediator can be used to automate the generation and maintenance of mediators.
Towards Semantic Interoperabilty: Indepth Comparison of Two Approaches to Solve Mediation Tasks
Comparative Evaluation of …, 2007
This paper overviews and compares the DERI and DEI-Cefriel approaches to the SWS-Challenge workshop mediation scenario in terms of the utilized underlying technologies and delivered solutions. In the mediation scenario one partner uses RosettaNet to define its B2B protocol while the other one operates on a proprietary solution. Goal of the workshop participants was to show how could these partners be semantically integrated.
Semantic mediation for standard-based B2B interoperability
Internet Computing …, 2010
The TSIMMIS Approach to Mediation: Data Models and Languages
Journal of intelligent …, 1997
Model-driven engineering of mediation information system for enterprise interoperability
International Journal of Computer Integrated Manufacturing, 2017
The MISE approach (mediation information system engineering) aims at defining and designing a platform, dedicated to initiate and support any collaborative situation among potential partners. Collaborative situations may emerge from manufacturing contexts (industrial production partners), economic contexts (supply chain), social contexts (crisis management partners) and any other contexts in which a set of organisations should work altogether to reach common and individual goals, exploiting each others competencies. The MISE approach is based on a model-driven engineering vision (MDE) dedicated to designing a mediation information system (MIS) in charge of improving interoperability in emerging collaborative situations. This MIS is dedicated to supporting the collaborative behaviour of the collaborative network by dealing with exchanged data, shared services and collaborative workflows. The final objective is a mediator system able to manage the operational collaboration of partners, through there information system, without constraint (at least with as less constraint as possible). The MIS design crosses the different abstraction layers of design (business, logical and technological) and exploits the associated models at each level to build the models of the next level. This paper presents the models involved (dedicated to the computer independent model, platform independent model and platform specific model levels of the MDE approach) and the transition mechanisms between levels.
Supporting interoperability of collaborative networks through engineering of a service-based Mediation Information System (MISE 2.0)
Enterprise Information Systems, 2014
The Mediation Information System Engineering project is currently finishing its second iteration (MISE 2.0). The main objective of this scientific project is to provide any emerging collaborative situation with methods and tools to deploy a Mediation Information System (MIS). MISE 2.0 aims at defining and designing a service-based platform, dedicated to initiating and supporting the interoperability of collaborative situations among potential partners. This MISE 2.0 platform implements a model-driven engineering approach to the design of a serviceoriented MIS dedicated to supporting the collaborative situation. This approach is structured in three layers, each providing their own key innovative points: (i) the gathering of individual and collaborative knowledge to provide appropriate collaborative business behaviour (key point: knowledge management, including semantics, exploitation and capitalization), (ii) deployment of a mediation information system able to computerize the previously deduced collaborative processes (key point: the automatic generation of collaborative workflows, including connection with existing devices or services) (iii) the management of the agility of the obtained collaborative network of organizations (key point: supervision of collaborative situations and relevant exploitation of the gathered data). MISE covers business issues (through BPM), technical issues (through an SOA) and agility issues of collaborative situations (through EDA).
Model-Driven Development of a Mediation Service
2008 12th International IEEE Enterprise Distributed Object Computing Conference, 2008
Although service-oriented architectures offer real benefits when pursuing application integration and business flexibility, there are still no satisfactory solutions for dealing with existing systems that need to cooperate while their services have no perfect match. In the case of incompatible services, a 'mediator' may be introduced which resolves (semantic) interoperability problems by intervening in the cooperation between systems. Building mediators is currently often a manual process, resulting in dedicated IT-driven solutions, with no concern for reuse of process, models or code. This paper presents a framework to guide the development of mediators, with the following objectives: (i) uncover and capture the actual interoperability problem that needs to be solved; (ii) allow the involvement of non-IT (i.e., business) experts in the development of the solution; (iii) support evolution of the solution and re-use of results in case of changing interoperability requirements; (iv) facilitate automation of parts of the process. The framework is based on service-oriented, model-driven and semantic web techniques. Available tool support for the different steps in the framework is indicated.
A Semantic Web Mediation Architecture
Semantic Web and Beyond, 2006
Heterogeneity is an inherent characteristic of open and distributed environments like the Internet that can hamper Web resources and Web services from successful interoperation. Mediation can be used to resolve these issues, which are critical problems in the Semantic Web. Appropriate technologies for mediation need to cover two aspects: first, techniques for handling the different kinds of heterogeneity that can occur between Web resources, and secondly logical components that connect resources and apply required mediation technique along with invocation and execution facilities. This paper presents an integrated model for mediation on the Semantic Web with special attention to Semantic Web services that is developed around the Web Service Modeling Ontology WSMO. Covering both dimensions, we explain the techniques developed for handling different types of heterogeneity as well as the components and architecture for establishing interoperability on the Semantic Web if not given a priori.
XML Mediation Services Utilizing Model Based Data Management
Proceedings of the 2004 Winter Simulation Conference, 2004., 2004
The application of the Extensible Mark-up Language (XML) enabled a new level of interoperability for heterogeneous IT systems. However, although XML enables separation of data definition and data content, it doesn't ensure that data exchanged is interpreted correctly by the receiving system. This motivates data management to support unambiguous definition of data elements for information exchange. Using a common reference model improves this process leading to "model based data management (MBDM)." The results can be used immediately to configure mediation layers integrating services into an overall service oriented architecture. For XML based services, the results of MBDM can be immediately applied in form of an auto-generated XSLT definition used to compose the service without additional modifications with other services. The paper uses the Command and Control Information Exchange Data Model (C2IEDM) -as an example for a common reference model for information exchange -and its potential use in the Global Information Grid (GIG) -as the military example for a service oriented architecture -to integrate web-enabled M&S applications as an example for applying this method.
XML-based information mediation with MIX
ACM SIGMOD Record, 1999
Computing Capabilities of Mediators
Sigmod Record, 1999
Existing data-integration systems based on the mediation architecture employ a v ariety of mechanisms to describe the query-processing capabilities of sources. However, these systems do not compute the capabilities of the mediators based on the capabilities of the sources they integrate. In this paper, we propose a framework to capture a rich v ariety of query-processing capabilities of data sources and mediators. We present algorithms to compute the set of supported queries of a mediator, based on the capability limitations of its sources. Our algorithms take i n to consideration a variety of query-processing techniques employed by mediators to enhance the set of supported queries. We use the relational framework for simplicity of exposition. We believe that all the main ideas presented in this paper carry over seamlessly to other data models like OEM 6 and XML www.w3.org TR REC-xml. In fact, our interest in computing mediator capabilities is based on our work in the TSIMMIS project, which uses the OEM data model.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.