2005 IEEE International Symposium on Mass Storage Systems and Technology, 2005
This paper outlines the research, development, and implementation plans for the Cheshire system a... more This paper outlines the research, development, and implementation plans for the Cheshire system as part of an overall digital library framework. Our plans are based on developing a high-level component framework extensible and flexible enough to accommodate radically different architectural models; one which supports large-scale preservation environments characteristic of content management systems such as DSpace and Fedora; and the support for semantic retrieval and natural language processes involving large-scale distributed datasets, served in a highly parallel environment. Rather than prototyping a single solution, we intend to follow a modular approach with a variety of text and data mining, ontological, document rendering, and text retrieval tools which can be used in various combinations according to need. In essence, the Cheshire digital library framework is designed to address the twin aspects of access and preservation in new and sustainable ways.
The Multivalent Document Model offers a practical, proven, nocompromises architecture for preserv... more The Multivalent Document Model offers a practical, proven, nocompromises architecture for preserving digital documents of potentially any data format. We have implemented from scratch such complex and currently important formats as PDF and HTML, as well as older formats including scanned paper, UNIX manual pages, TeX DVI, and Apple II AppleWorks word processing. The architecture, stable since its definition in 1997, extends easily to additional document formats, defines a cross-format document tree data structure that fully captures semantics and layout, supports full expression of a format's often idiosyncratic concepts and behavior, enables sharing of functionality across formats thus reducing implementation effort, can introduce new functionality such as hyperlinks and annotation t o older formats that cannot express them, and provides a single interface (API) across all formats. Multivalent contrasts sharply with emulation and conversion, and advances Lorie's Universal Virtual Computer with high-level architecture and extensive implementation.
This paper describes the development of a distribu ted annotation sys- tem which enables collabor... more This paper describes the development of a distribu ted annotation sys- tem which enables collaborative document consultation and creates new access to otherwise hard to index digital documents. It ta kes the annotations one step further: not only the same types of annotations are available across file formats, but robust references to the documents introduce fo rmat and location independ-
This paper describes work undertaken by Data Intensive Cyber Environments Center (DICE) at the Un... more This paper describes work undertaken by Data Intensive Cyber Environments Center (DICE) at the University of North Carolina at Chapel Hill and the University of Liverpool on the development of an integrated preservation environment, which has been presented at the National Coordination Office for Networking and Information Technology Research and Development (NITRD), at the National Science Foundation, and at the European Commission. The underlying technology is based on the integrated Rule-Oriented Data System (iRODS), which implements a policy-based approach to distributed data management. By differentiating between different phases of the data life cycle based upon the evolution of data management policies, the infrastructure can be tuned to support data publication, data sharing, data analysis and data preservation. It is possible to build generic data management infrastructure that can evolve to meet the management requirements of each user community, federal agency and academi...
The National Archives and Records Administration (NARA) and EU SHAMAN projects are working with m... more The National Archives and Records Administration (NARA) and EU SHAMAN projects are working with multiple research institutions on tools and technologies that will supply a comprehensive, systematic, and dynamic means for preserving virtually any type of electronic record, free from dependence on any specific hardware or software. This paper describes the joint development work between the University of Liverpool and the San Diego Supercomputer Center (SDSC) at the University of California, San Diego on the NARA and SHAMAN prototypes. The aim is to provide technologies in support of the required generic data management infrastructure. We describe a Theory of Preservation that quantifies how communication can be accomplished when future technologies are different from those available at present. This includes not only different hardware and software, but also different standards for encoding information. We describe the concept of a “digital ontology” to characterize preservation proc...
Proceedings of the 2007 conference on Digital libraries - JCDL '07, 2007
ABSTRACT This paper explores the integration of text mining and data mining techniques, digital l... more ABSTRACT This paper explores the integration of text mining and data mining techniques, digital library systems, and computational and data grid technologies with the objective of developing an online classification service exemplar. We discuss the current research issues relating ...
This poster describes the ongoing research of the Cheshire project with a particular focus on kno... more This poster describes the ongoing research of the Cheshire project with a particular focus on knowledge generation and digital preservation. The infrastructure described makes use of tools from computational linguistics, distributed parallel processing and storage, information retrieval and digital preservation environments to produce new knowledge from very large scale datasets present in the data grid.
This proposal draws upon the continuing 3-year working relationship between the Division of Speci... more This proposal draws upon the continuing 3-year working relationship between the Division of Special Collections and Archives at the University of Liverpool Library and the Digital Libraries Program at the University of California, Berkeley, with the aim of extending it to other research-based repositories in the EU and USA. In addition to the development platforms of the AHDS, CURL, OAC and MOA2 databases, other repositories expressing an interest in the Cheshire project and in using the Cheshire software include Glasgow University
PERICLES (Promoting and Enhancing the Reuse of Information throughout the Content Lifecycle explo... more PERICLES (Promoting and Enhancing the Reuse of Information throughout the Content Lifecycle exploiting Evolving Semantics) is an FP7 project started on February 2013. It aims at preserving by design large and complex data sets. PERICLES is coordinated by King's College London, UK and its partners are
2005 IEEE International Symposium on Mass Storage Systems and Technology, 2005
This paper outlines the research, development, and implementation plans for the Cheshire system a... more This paper outlines the research, development, and implementation plans for the Cheshire system as part of an overall digital library framework. Our plans are based on developing a high-level component framework extensible and flexible enough to accommodate radically different architectural models; one which supports large-scale preservation environments characteristic of content management systems such as DSpace and Fedora; and the support for semantic retrieval and natural language processes involving large-scale distributed datasets, served in a highly parallel environment. Rather than prototyping a single solution, we intend to follow a modular approach with a variety of text and data mining, ontological, document rendering, and text retrieval tools which can be used in various combinations according to need. In essence, the Cheshire digital library framework is designed to address the twin aspects of access and preservation in new and sustainable ways.
The Multivalent Document Model offers a practical, proven, nocompromises architecture for preserv... more The Multivalent Document Model offers a practical, proven, nocompromises architecture for preserving digital documents of potentially any data format. We have implemented from scratch such complex and currently important formats as PDF and HTML, as well as older formats including scanned paper, UNIX manual pages, TeX DVI, and Apple II AppleWorks word processing. The architecture, stable since its definition in 1997, extends easily to additional document formats, defines a cross-format document tree data structure that fully captures semantics and layout, supports full expression of a format's often idiosyncratic concepts and behavior, enables sharing of functionality across formats thus reducing implementation effort, can introduce new functionality such as hyperlinks and annotation t o older formats that cannot express them, and provides a single interface (API) across all formats. Multivalent contrasts sharply with emulation and conversion, and advances Lorie's Universal Virtual Computer with high-level architecture and extensive implementation.
This paper describes the development of a distribu ted annotation sys- tem which enables collabor... more This paper describes the development of a distribu ted annotation sys- tem which enables collaborative document consultation and creates new access to otherwise hard to index digital documents. It ta kes the annotations one step further: not only the same types of annotations are available across file formats, but robust references to the documents introduce fo rmat and location independ-
This paper describes work undertaken by Data Intensive Cyber Environments Center (DICE) at the Un... more This paper describes work undertaken by Data Intensive Cyber Environments Center (DICE) at the University of North Carolina at Chapel Hill and the University of Liverpool on the development of an integrated preservation environment, which has been presented at the National Coordination Office for Networking and Information Technology Research and Development (NITRD), at the National Science Foundation, and at the European Commission. The underlying technology is based on the integrated Rule-Oriented Data System (iRODS), which implements a policy-based approach to distributed data management. By differentiating between different phases of the data life cycle based upon the evolution of data management policies, the infrastructure can be tuned to support data publication, data sharing, data analysis and data preservation. It is possible to build generic data management infrastructure that can evolve to meet the management requirements of each user community, federal agency and academi...
The National Archives and Records Administration (NARA) and EU SHAMAN projects are working with m... more The National Archives and Records Administration (NARA) and EU SHAMAN projects are working with multiple research institutions on tools and technologies that will supply a comprehensive, systematic, and dynamic means for preserving virtually any type of electronic record, free from dependence on any specific hardware or software. This paper describes the joint development work between the University of Liverpool and the San Diego Supercomputer Center (SDSC) at the University of California, San Diego on the NARA and SHAMAN prototypes. The aim is to provide technologies in support of the required generic data management infrastructure. We describe a Theory of Preservation that quantifies how communication can be accomplished when future technologies are different from those available at present. This includes not only different hardware and software, but also different standards for encoding information. We describe the concept of a “digital ontology” to characterize preservation proc...
Proceedings of the 2007 conference on Digital libraries - JCDL '07, 2007
ABSTRACT This paper explores the integration of text mining and data mining techniques, digital l... more ABSTRACT This paper explores the integration of text mining and data mining techniques, digital library systems, and computational and data grid technologies with the objective of developing an online classification service exemplar. We discuss the current research issues relating ...
This poster describes the ongoing research of the Cheshire project with a particular focus on kno... more This poster describes the ongoing research of the Cheshire project with a particular focus on knowledge generation and digital preservation. The infrastructure described makes use of tools from computational linguistics, distributed parallel processing and storage, information retrieval and digital preservation environments to produce new knowledge from very large scale datasets present in the data grid.
This proposal draws upon the continuing 3-year working relationship between the Division of Speci... more This proposal draws upon the continuing 3-year working relationship between the Division of Special Collections and Archives at the University of Liverpool Library and the Digital Libraries Program at the University of California, Berkeley, with the aim of extending it to other research-based repositories in the EU and USA. In addition to the development platforms of the AHDS, CURL, OAC and MOA2 databases, other repositories expressing an interest in the Cheshire project and in using the Cheshire software include Glasgow University
PERICLES (Promoting and Enhancing the Reuse of Information throughout the Content Lifecycle explo... more PERICLES (Promoting and Enhancing the Reuse of Information throughout the Content Lifecycle exploiting Evolving Semantics) is an FP7 project started on February 2013. It aims at preserving by design large and complex data sets. PERICLES is coordinated by King's College London, UK and its partners are
Uploads
Papers by Paul Watry