Tools and Techniques for Mixed Reality Authoring
Florian Ledermann
Sign up for access to the world's latest research
checkGet notified about relevant papers
checkSave papers to use in your research
checkJoin the discussion with peers
checkTrack your impact
Abstract
While Mixed Reality (MR) technology is steadily maturing, application development is still lacking advanced authoring tools -even the simple presentation of information, which should not require any programming, is not systematically addressed by development tools. Moreover, there is also a severe lack of agreed techniques or best practices for the structuring of MR content. In this paper we present APRIL, the Augmented Presentation and Interaction Languge, an authoring platform for MR presentations which provides tools and techniques that are independent of specific applications or target hardware platforms, and should be suitable to raise the level of abstraction on which MR content creators can operate.
Related papers
An Authoring Toolkit for Mixed Reality Experiences
Proceedings of the International Workshop on …, 2001
This paper describes a program of research to develop and implement an integrated system of data collection and authoring tools and a concomitant infrastructure for collecting and presenting a range of information about a specific location in a Mixed Reality experience. The system has been designed so that a wide range of users such as scientific domain experts, artists, or any user with a mobile phone, can author and "post" information to a particular site.
Authoring and Delivering Mixed Reality Experiences
2005
Mixed Reality (MR) offers a unique challenge in integrating interacting agents, show-control devices, graphics and audio presentation, and human interaction into a single consolidated system. While each component may be addressed individually, combining their various functionalities via a dynamic script that delivers an interactive, non-linear story (scenario, world) requires a robust process and system. In this paper, we present a
Authoring Mixed Reality–A Component and Framework-Based Approach
2003
Abstract: This paper describes the basic ideas of our effort to develop a framework for the structured authoring of mixed reality (MR) applications. The overall objective of the AMIRE project is to define and implement a software system that allows content experts to easily design and implement mixed reality applications without detailed knowledge about the underlying base technologies.
Tiles: A mixed reality authoring interface
INTERACT 2001, 2001
Mixed Reality (MR) aims to create user interfaces where interactive virtual objects are overlaid on the physical environment, naturally blending with it in real time. In this paper we presents Tiles, a MR authoring interface for easy and effective spatial composition, layout and arrangement of digital objects in mixed reality environments. Based on a tangible MR interface approach, Tiles is a transparent user interface that allows users to seamlessly interact with both virtual and physical objects. It also introduces a consistent MR interface model, providing a set of tools that allow users to dynamically add, remove, copy, duplicate and annotate virtual objects anywhere in the 3D physical workspace. Although our interaction techniques are broadly applicable, we ground them in an application for rapid prototyping and evaluation of aircraft instrument panels. We also present informal user observations and a preliminary framework for further work.
Rapid Prototyping of Mixed Reality Applications That Entertain and Inform
Entertainment Computing, 2003
This paper describes a prototyping environment for rapid application development. We combine existing AR-technologies with a component-based 3D animation library and a scripting API. Through the development of an interface to a high-level 3D modelling system we are able to use this visual tool for modelling and basic animation features in MR design. This provides content experts with a powerful tool to quickly design and test mixed reality prototypes. We consider applications in the area of interactive mixed reality illustrations in the context of technical descriptions / user manuals and interactive exhibitions in museums.
Mixed Reality: Survey
2009
This chapter presents an overview of the Mixed Reality (MR) paradigm, which proposes to overlay our real-world environment with digital, computer-generated objects. It presents example applications and outlines limitations and solutions for their technical implementation. In MR systems, users perceive both the physical environment around them and digital elements presented through, for example, the use of semitransparent displays. By its very nature, MR is a highly interdisciplinary field engaging signal processing, computer vision, computer graphics, user interfaces, human factors, wearable computing, mobile computing, information visualization, and the design of displays and sensors. This chapter presents potential MR applications, technical challenges in realizing MR systems, as well as issues related to usability and collaboration in MR. It separately presents a section offering a selection of MR projects which have either been partly or fully undertaken at Swiss universities and rounds off with a section on current challenges and trends.
A Visual Programming Tool to Design Mixed and Virtual Reality Interactions
International Journal of Virtual Reality, 2018
Mixed and Virtual Reality (MVR) devices are now more accessible. However, developing MVR applications is still complex for the majority of developers, because it requires specific expertise. For the past few years, several packaged solutions offered to assist developers who are non-MVR experts. These solutions rarely offer full freedom to create specific interactions adapted to the context. We therefore propose a new MVR tool named MIREDGE (MIxed and virtual REality Development tool for Game Engine). Its interface allows visual programming of MVR interactions. This solution aims at allowing developers to capitalize, re- use, share and associate interaction algorithms. It also takes into account software and hardware compatibility in order to compose new algorithms. The specific architecture of MIREDGE provides opportunities for MVR and non-MVR developers to collaborate to meet a common need: writing efficient MVR interaction algorithms. MIREDGE Editor was evaluated by 31 MVR and non...
The Trouble with Augmented Reality/Virtual Reality Authoring Tools
There are many technical and design challenges in creating new, usable and useful AR/VR applications. In particular, non-technical designers and end-users are facing a lack of tools to quickly and easily prototype and test new AR/VR user experiences. We review and classify existing AR/VR authoring tools and characterize three primary issues with these tools based on our review and a case study. To address the issues, we discuss two new tools we designed with support for rapid prototyping of new AR/VR content and gesture-based interactions geared towards designers without technical knowledge in gesture recognition, 3D modeling, and programming.
Abstraction and Implementation Strategies for Augmented Reality Authoring
Interfaces and Design, 2007
Augmented Reality (AR) application development is still lacking advanced authoring tools -even the simple presentation of information, which should not require any programming, is not systematically addressed by development tools. Moreover, there is also a severe lack of agreed techniques or best practices for the structuring of AR content. In this chapter we present APRIL, the Augmented Presentation and Interaction Language, an authoring platform for AR applications which provides concepts and techniques that are independent of specific applications or target hardware platforms, and should be suitable for raising the level of abstraction at which AR content creators can operate. : The interactive furniture construction guide is an example for an application which was created with APRIL by undergraduate students. The construction process is modeled with the state engine, and possible parts for the next step are shown to the user.
An Authoring Tool to Assist the Design of Mixed Reality Learning Games
Lecture Notes in Computer Science, 2012
Mixed Reality Learning Games (MRLG) provide new perspectives in learning. But obviously, MRLG are harder to design than traditional learning games environments. The main complexity is to cope with all the difficulties of learning design, game design and mixed reality design at the same time, and with the integration of all aspects in a coherent way. In this paper, we present existing tools and methods to design learning games or mixed reality environments. Then, we propose a model of MRLG design process. In the last part, we present an authoring tool, MIRLEGADEE, and how it supports this process.
Related topics
Related papers
Developing and authoring mixed reality with MX toolkit
2003
This paper describes a software platform oriented to the augmented reality/mixed reality application developer, aiming at simplifying his/her programming tasks. This platform comprises a software development kit (SDK) for the Windows environment, consisting of a set of C++ classes packaged into modules. The platform is known as MX toolkit and utilises extensively the AR toolkit, for all matters regarding marker-based tracking, but is defined at a somewhat higher abstraction level than the AR toolkit software layer, by hiding from the programmer, low level implementation details and facilitating AR/MR object-oriented programming. The MX toolkit is presented by means of a comparison with the AR toolkit processing pipeline and API and by explaining its eight system modules. We expect to provide this package as an aid for AR toolkit-based applications development. The paper also describes a visual AR/MR authoring tool, the Mix It application, from the user interface point of view, as an illustration of the development support potential of the MX toolkit SDK.
Mixed Reality: A Source for new authoring methodologies
2002
Abstract Mixed Reality, the simultaneous overlay of the real world with a computer-generated world, has a special potential for solving authoring problems. Since the world to be modeled and the actual computer model can be visualized together, it is possible to show their relationship in a less abstract form. This could be very valuable for authoring purposes, since authors are often concerned with building a model of certain aspects of reality. A prominent role in the authoring process is assumed by authoring tools.
Augmented Reality Authoring: Generic Context from Programmer to Designer
Proceedings of the 18th …, 2006
Developing an Augmented Reality (AR) application is usually a long and non-intuitive task. Few methodologies address this problem and tools implementing these are limited or non-existent. To date there is no efficient and easy development tool tailored to the needs of Mixed Reality (MR). We are presenting an initial taxonomy of MR applications, addressing the different levels of abstraction for defining the relation between real and virtual world. We then demonstrate some development approaches and describe tools and libraries that we implemented in order to illustrate aspects of our authoring taxonomy. Finally, we provide a definition addressing the requirements for new generation of AR rapid application development (RAD) tools based on actual implementations.
Dynamic creation of interactive mixed reality presentations
2005
Abstract In this paper, we describe a method of dynamic creation of interactive presentations for Mixed Reality environments. The presentations are created automatically for collections of multimedia objects arbitrarily arranged in virtual presentation spaces stored in a database. Users can navigate between the spaces using Web and 3D multimedia contents. The objects in each space are presented through a presentation template, which determines both the visualization and the interaction aspects of the presentation.
An Authoring Framework for Augmented Reality Presentations
In this thesis, the design of APRIL, an XML-based language to create content-rich Augmented Reality (AR) applications and interactive presentations, is presented. The state of the art of hardware and software for AR systems is analyzed, to deduce the key concepts and features of APRIL. One central feature of APRIL is the separation of an application's content from the description of the hardware configuration the application should run on. This will allow users to run the same application with different hardware configurations, either reflecting different target platforms, or to replace the original target platform by a simulation environment in the development and testing phase.
The Evolution of a Framework for Mixed Reality Experiences
This chapter describes the evolution of a software system specifically designed to support the creation and delivery of Mixed Reality (MR) experiences. We first describe some of the attributes required of such a system. We then present a series of MR experiences that we have developed over the last four years, with companion sections on lessons learned and lessons applied. We conclude with several sample scripts that one might write to create experiences within the current version of this system. The authors' goals are to show the readers the unique challenges in developing an MR system for multimodal, multi-sensory experiences and to demonstrate how developing MR applications informs the evolution of such a framework.
A Component-Oriented Approach for Mixed Reality Applications
2004
Abstract This chapter introduces a component-oriented approach for developing mixed reality (MR) applications. After a short definition of mixed reality, we present two possible solutions for a component-oriented framework. Both solutions have been implemented in two different MR projects (SAVE and AMIRE). The first project, SAVE, is a safety training system for virtual environments, whereas the goal of the AMIRE project is to develop different authoring tools for mixed reality applications.
Mixed Reality
Mixed reality (MR) is something that can be defined as a combination of real and virtual words. It can be used to provide newer visualizations and environments in the digital world and can interact with each other. It is a true mixture of how virtual and physical worlds can coexist. It is a sophisticated approach which uses a specific model and architecture to support 3-D display for free and augmented virtuality. The first phase conceptual design benefits like the first stage of the prototype by additional shapes, patterns and annotations. Both workspaces share a common interface and allow collaboration with different experts, who can configure the system for a specific task .A speedy design workflow and CAD data consistency can be naturally achieved .There is no similar approach that integrates the creation and editing phase of 3D curves and surfaces in Virtual and Augmented Reality (VR/AR).Herein we see the major contributions of our new application.
CollaborationBus Aqua: An Editor for Storytelling In Mixed Reality Settings
e-pub.uni-weimar.de
Mixed reality - beyond conventions
Computers & Graphics, 2001
The rapid advances in computing and communications are dramatically changing all aspects of our lives. In particular, sophisticated 3D visualization, display, and interaction technologies are being used to complement our familiar physical world with computer-generated augmentations. These new interaction and display techniques are expected to make our work, learning, and leisure environments vastly more efficient and appealing.
Loading Preview
Sorry, preview is currently unavailable. You can download the paper by clicking the button above.