Skip to main content

giovanna varni

University of Genoa, Faculty of Engineering, Post-Doc

Followers

29

Following

1

Public Views

University of Patras

University of Zagreb

Idiap research institue

Jean Vanderdonckt

UCLouvain (University of Louvain)

Michael Schnaider

Technische Universität Darmstadt

University of Wolverhampton

Yasar University

Universitat Politecnica de Catalunya

InterestsView All (8)

Uploads

Papers by giovanna varni

A MULTIMODAL FRAMEWORK FOR THE COMMUNICATION OF THE DISABLED

In this paper, a novel system, which aims to provide alternative tools and interfaces to blind an... more In this paper, a novel system, which aims to provide alternative tools and interfaces to blind and deaf-and-mute people and enable their communication and interaction with the computer is presented. All the involved technologies are integrated into a treasure hunting game application that is jointly played by the blind and deaf-and-mute user. The integration of the multimodal interfaces into a game application serves both as an entertainment and a pleasant education tool to the users. The proposed application integrates haptics, audio, visual output and computer vision, sign language analysis and synthesis, speech recognition and synthesis, in order to provide an interactive environment where the blind and deaf-and-mute users can collaborate to play the treasure hunting game.

BeSound: embodied reflexion for music education in childhood

Proceedings of the 11th …, Jan 1, 2012

Embodiment and reflexive interaction proved to be effective approaches to music education in chil... more Embodiment and reflexive interaction proved to be effective approaches to music education in childhood. A research challenge consists of merging them. This paper presents BeSound, an application intended to support children in learning the basic elements of composition. Children explore rhythm, melody, and harmony by playing at mimicking objects or characters; the qualities of their whole-body movements are analysed in real-time according to Rudolf Laban's Theory of Effort and used to control sound. The paper focuses on the design of BeSound and describes the analysis performed to distinguish between direct and flexible movements -the Laban's Space component -and between light and heavy movements -the Laban's Weight component.

An Open Platform for Multimodal Data Streams Processing

musart.dist.unige.it

A sensor pairing and fusion system for a multi-user environment

on Multimodal Interfaces …, Jan 1, 2009

Measuring entrainment in small groups of musicians

Affective Computing and …, Jan 1, 2009

This research is concerned with synchronization (or entrainment), and in particular on emotional ... more This research is concerned with synchronization (or entrainment), and in particular on emotional synchronization, which is likely to be an important driver of collaborative processes. We focus on ensemble musical performance, an ideal test-bed for the development of models and techniques for measuring creative social interaction in an ecologically valid framework. Ongoing work and early results on the automated analysis in real-time of non-verbal cues related to expressive gesture in social interaction is briefly presented.

Video Navigation Tool: Application to browsing a database of dancers' performances

on Multimodal Interfaces …, Jan 1, 2009

Sync'n'Move: social interaction based on music and gesture

User Centric Media, Jan 1, 2010

In future User Centric Media the importance of the social dimension will likely increase. As soci... more In future User Centric Media the importance of the social dimension will likely increase. As social networks and Internet games show, the social dimension has a key role for active participation of the users in the overall media chain. In this paper, a first sample application for social active listening to music is presented. Sync'n'Move enables two users to explore a multi-channel pre-recorded music piece as the result of their social interaction. The application has been developed in the framework of the EU-ICT Project SAME (www.sameproject.eu) and has been presented for the first time at the Agora Festival (IRCAM, Paris, June 2009). In that occasion, Sync'n'Move has also been evaluated by both expert and non expert users.

Modeling expressive individual and collective behavior

musart.dist.unige.it

This paper presents a brief survey of our recent research on analysis and modeling of human expre... more This paper presents a brief survey of our recent research on analysis and modeling of human expressive behavior. In particular, the focus is on nonverbal expressive, emotional communication and research addresses expressive behavior of both individuals and groups of users. Starting from the analysis of expressive gesture in single users, we show how our work is evolving towards the analysis of expressive social interaction in a group. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is a very relevant component for analysis of human behavior, since it provides significant information on the social context behavior is displayed. In this direction, this paper presents the techniques we developed for measuring (i) saliency and emerging behavior (i.e., how the behavior of a single user emerges from the group) and (ii) synchronization within a group of users (i.e., how much the behavior of the group is coherent). Research is performed in the framework of the EU-ICT Project SAME (www.sameproject.eu).

Audio Patterns as a Source of Information for the Perception and Control of Orientation

Virtual Rehabilitation …, Jan 1, 2007

We discuss the use of dynamic auditory that provide user friendly, multimodal feedback. patterns ... more We discuss the use of dynamic auditory that provide user friendly, multimodal feedback. patterns to detect and control human action. We argue that Such technologies can be used to develop novel types such patterns can affect the ability of standing persons to of perceptual feedback for the perception and control of control medio-lateral orientation of their body. Subjects (N = actions. 10) stood a mechanical platform that could rotate in the In this framework, one possible application is to subject's medio-lateral axis. Real-time data about platform provis framework, fee able ancatin is roll were used to generate acoustic stimuli, presented via provide dynamic acoustic feedback about stance. In this headphones. Subjects were asked to control standing sway so paper we present a study on the ability of standing as to achieve specific patterns in the acoustic stimuli. The persons to control their medio-lateral orientation relative results suggest that acoustic stimuli can be used as a source to dynamic patterns in acoustic stimulation. We asked of information for the perception and control of orientation.

Towards a Social Retrieval of Music Content

Privacy, security, risk and trust ( …, Jan 1, 2011

Endowing search engines with multimodal content indexing, sharing, and retrieval is a research ch... more Endowing search engines with multimodal content indexing, sharing, and retrieval is a research challenge for the ICT community. This paper introduces a use case exploiting embodied cooperation as a paradigm for formulating social queries. It focuses on the assessment of the experience of users to this use case and on the design and exploitation of algorithms suitable to provide search engines with social intelligence.

Stabilization of posture relative to audio referents

ENACTIVE/06, Jan 1, 2006

Playful Interaction in a Multi-tracking Environment

musart.dist.unige.it

This project uses mobile phones as interaction devices, utilizing their multimodal input and audi... more This project uses mobile phones as interaction devices, utilizing their multimodal input and audio output capabilities. The users are able to cooperate in the performance of a music piece by interacting with their mobile phones, or by using them as if they were virtual stand-alone musical instruments or sounding objects. In addition, the mobile multimodal inputs are streamed to an external system that is able to provide additional tracking and feature extraction capabilities, such as computer vision based body/blob tracking. The external system synchronizes the mobile interaction streams with its own tracking streams (thus the term "multi-tracking"), analyzes the composite streams, and produces a) control signals that are streamed back to the mobile audio synthesizer, b) audio signals that are reproduced either locally by each mobile phone or globally by a shared audio system, and c) real-time graphics that are rendered to a large display/canvas, which is shared with and visible to all performers.

Emotional entrainment in music performance

Automatic Face & …, Jan 1, 2008

This work aims at defining a computational model of human emotional entrainment. Music, as a non-... more This work aims at defining a computational model of human emotional entrainment. Music, as a non-verbal language to express emotions, is chosen as an ideal test bed for these aims. We start from multimodal gesture and motion signals, recorded in a real world collaborative condition in an ecological setting. Four violin players were asked to play, alone or in duo, a music fragment in two different perceptual feedback modalities and in four different emotional states. We focused our attention on Phase Synchronisation of the head motions of the players. From observation by subjects (musicians and observers), an evidence of entrainment emerges between players. The preliminary results, based on a reduced data set, however do not grasp fully this phenomenon. A more extended analysis is current subject of investigation.

Embodied cooperation using mobile devices: presenting and evaluating the Sync4All application

Proceedings of the International Working …, Jan 1, 2012

Abstract Embodied cooperation" arises when two co-present, individuals in motion coordinate ... more

A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media

Multimedia, IEEE Transactions …, Jan 1, 2010

This paper presents a multimodal system for real-time analysis of nonverbal affective social inte... more This paper presents a multimodal system for real-time analysis of nonverbal affective social interaction in small groups of users. The focus is on two major aspects of affective social interaction: the synchronization of the affective behavior within a small group and the emergence of functional roles, such as leadership. A small group of users is modeled as a complex system consisting of single interacting components that can auto-organize and show global properties. Techniques are developed for computing quantitative measures of both synchronization and leadership. Music is selected as experimental test-bed since it is a clear example of interactive and social activity, where affective nonverbal communication plays a fundamental role. The system has been implemented as software modules for the EyesWeb XMI platform (http://www.eyesweb.org). It has been used in experimental frameworks (a violin duo and a string quartet) and in real-world applications (in user-centric applications for active music listening). Further application scenarios include entertainment, edutainment, therapy and rehabilitation, cultural heritage, and museum applications. Research has been carried out in the framework of the EU-ICT FP7 Project SAME (http://www.sameproject.eu).

Multimodal interfaces for expressive interaction

4th Italian …, Jan 1, 2005

The Italian ACM SIGCHI Chapter, called SIGCHI Italy, has been officially chartered on April 24, 1... more The Italian ACM SIGCHI Chapter, called SIGCHI Italy, has been officially chartered on April 24, 1996. Its aim is to promote an increased knowledge and greater interest in the science, technology, design, development, and application of methods/tools/techniques for HCI. SIGCHI Italy has scientific and educational goals, and aims to provide a mean of communication between persons having interest in HCI. It also organizes meetings, conferences, discussion groups and workshops. SIGCHI, ACM's Special Interest Group on Computer-Human Interaction, brings together people working on the design, evaluation, and implementation of interactive computing systems for human use, and the study of major phenomena surrounding such systems. It embraces work on the hardware and software engineering of interactive systems, the structure of communications between human and machine, characterization of the use and context of use for interactive systems, methodology of design, and new designs themselves. It helps to organize and coordinate information through on line information, traditional publications, conferences, workshops, and symposia relating to human-computer interaction. SIGCHI members are interested in keeping up with changes in this rapidly evolving field -in research and development, or the design and evaluation of new user interfaces -making computers easier to use and extending technology into new domains for new users.

Children music-making with interactive reflexive technology. A case study of spiral model of specification

mirorproject.eu

The MIROR project is an European Union funded project under the 7th Framework programme (FP7/2007... more The MIROR project is an European Union funded project under the 7th Framework programme (FP7/2007-2013. The project deals with the development of an adaptive system for music learning and teaching based on the reflexive interaction paradigm: the MIROR Platform. The platform is developed in the context of early childhood education and addresses improvisation, composition, and body performance both in formal contexts (kindergartens, primary schools, music schools) as well as in informal ones (at home, kinder centres etc.). The objective of this paper is to introduce the theoretical framework and the aims of MIROR project, present the design and development methodology the project adopted and how it was applied to one of the prototypes the project is implementing: MIROR Body-Gesture. This is discussed as a concrete case study of interactive reflexive musical system.

Towards analysis of expressive gesture in groups of users: computational models of expressive social interaction

Gesture in Embodied Communication and …, Jan 1, 2010

In this paper we present a survey of our research on analysis of expressive gesture and how it is... more In this paper we present a survey of our research on analysis of expressive gesture and how it is evolving towards the analysis of expressive social interaction in groups of users. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is an extremely relevant component for analysis of expressive gesture, since it provides significant information on the context expressive gestures are performed in. However, most of the current systems analyze expressive gestures according to basic emotion categories or simple dimensional approaches. Moreover, almost all of them are intended for a single user, whereas social interaction is often neglected. After briefly recalling our pioneering studies on collaborative robothuman interaction, this paper presents two steps in the direction of novel computational models and techniques for measuring social interaction: (i) the interactive installation Mappe per Affetti Erranti for active listening to sound and music content, and (ii) the techniques we developed for explicitly measuring synchronization within a group of users. We conclude with the research challenges we will face in the near future.

Developing multimodal interactive systems with EyesWeb XMI

Proceedings of the 7th …, Jan 1, 2007

EyesWeb XMI (for eXtended Multimodal Interaction) is the new version of the wellknown EyesWeb pla... more EyesWeb XMI (for eXtended Multimodal Interaction) is the new version of the wellknown EyesWeb platform. It has a main focus on multimodality and the main design target of this new release has been to improve the ability to process and correlate several streams of data. It has been used extensively to build a set of interactive systems for performing arts applications for Festival della Scienza 2006, Genoa, Italy. The purpose of this paper is to describe the developed installations as well as the new EyesWeb features that helped in their development.

The 3rd international workshop on social behaviour in music: SBM2012

Proceedings of the 14th …, Jan 1, 2012

ABSTRACT Since its first edition in 2009, the International Workshop on Social Behaviour in Music... more ABSTRACT Since its first edition in 2009, the International Workshop on Social Behaviour in Music (SBM) has been an occasion for researchers and practitioners for discussing recent advances in automated analysis of social behaviour, being music the selected test-bed and application scenario. The first edition of SBM was held in Vancouver, Canada, in the framework of the 2009 IEEE International Conference on Social Computing (SocialCom 2009). The second one was held in Genova, Italy, in the framework of the 4th International ICST Conference on Intelligent Technologies for Interactive Entertainment (Intetain 2011). SBM is now at its third edition, which takes place in the framework of the 14th International Conference on Multimodal Interaction (ICMI 2012), Santa Monica, California, USA. Again, SBM aims at providing a picture of current research breakthrough and issues, giving at the same time directions for future works and collaborations.

A MULTIMODAL FRAMEWORK FOR THE COMMUNICATION OF THE DISABLED

In this paper, a novel system, which aims to provide alternative tools and interfaces to blind an... more In this paper, a novel system, which aims to provide alternative tools and interfaces to blind and deaf-and-mute people and enable their communication and interaction with the computer is presented. All the involved technologies are integrated into a treasure hunting game application that is jointly played by the blind and deaf-and-mute user. The integration of the multimodal interfaces into a game application serves both as an entertainment and a pleasant education tool to the users. The proposed application integrates haptics, audio, visual output and computer vision, sign language analysis and synthesis, speech recognition and synthesis, in order to provide an interactive environment where the blind and deaf-and-mute users can collaborate to play the treasure hunting game.

BeSound: embodied reflexion for music education in childhood

Proceedings of the 11th …, Jan 1, 2012

Embodiment and reflexive interaction proved to be effective approaches to music education in chil... more Embodiment and reflexive interaction proved to be effective approaches to music education in childhood. A research challenge consists of merging them. This paper presents BeSound, an application intended to support children in learning the basic elements of composition. Children explore rhythm, melody, and harmony by playing at mimicking objects or characters; the qualities of their whole-body movements are analysed in real-time according to Rudolf Laban's Theory of Effort and used to control sound. The paper focuses on the design of BeSound and describes the analysis performed to distinguish between direct and flexible movements -the Laban's Space component -and between light and heavy movements -the Laban's Weight component.

An Open Platform for Multimodal Data Streams Processing

musart.dist.unige.it

A sensor pairing and fusion system for a multi-user environment

on Multimodal Interfaces …, Jan 1, 2009

Measuring entrainment in small groups of musicians

Affective Computing and …, Jan 1, 2009

This research is concerned with synchronization (or entrainment), and in particular on emotional ... more This research is concerned with synchronization (or entrainment), and in particular on emotional synchronization, which is likely to be an important driver of collaborative processes. We focus on ensemble musical performance, an ideal test-bed for the development of models and techniques for measuring creative social interaction in an ecologically valid framework. Ongoing work and early results on the automated analysis in real-time of non-verbal cues related to expressive gesture in social interaction is briefly presented.

Video Navigation Tool: Application to browsing a database of dancers' performances

on Multimodal Interfaces …, Jan 1, 2009

Sync'n'Move: social interaction based on music and gesture

User Centric Media, Jan 1, 2010

In future User Centric Media the importance of the social dimension will likely increase. As soci... more In future User Centric Media the importance of the social dimension will likely increase. As social networks and Internet games show, the social dimension has a key role for active participation of the users in the overall media chain. In this paper, a first sample application for social active listening to music is presented. Sync'n'Move enables two users to explore a multi-channel pre-recorded music piece as the result of their social interaction. The application has been developed in the framework of the EU-ICT Project SAME (www.sameproject.eu) and has been presented for the first time at the Agora Festival (IRCAM, Paris, June 2009). In that occasion, Sync'n'Move has also been evaluated by both expert and non expert users.

Modeling expressive individual and collective behavior

musart.dist.unige.it

This paper presents a brief survey of our recent research on analysis and modeling of human expre... more This paper presents a brief survey of our recent research on analysis and modeling of human expressive behavior. In particular, the focus is on nonverbal expressive, emotional communication and research addresses expressive behavior of both individuals and groups of users. Starting from the analysis of expressive gesture in single users, we show how our work is evolving towards the analysis of expressive social interaction in a group. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is a very relevant component for analysis of human behavior, since it provides significant information on the social context behavior is displayed. In this direction, this paper presents the techniques we developed for measuring (i) saliency and emerging behavior (i.e., how the behavior of a single user emerges from the group) and (ii) synchronization within a group of users (i.e., how much the behavior of the group is coherent). Research is performed in the framework of the EU-ICT Project SAME (www.sameproject.eu).

Audio Patterns as a Source of Information for the Perception and Control of Orientation

Virtual Rehabilitation …, Jan 1, 2007

We discuss the use of dynamic auditory that provide user friendly, multimodal feedback. patterns ... more We discuss the use of dynamic auditory that provide user friendly, multimodal feedback. patterns to detect and control human action. We argue that Such technologies can be used to develop novel types such patterns can affect the ability of standing persons to of perceptual feedback for the perception and control of control medio-lateral orientation of their body. Subjects (N = actions. 10) stood a mechanical platform that could rotate in the In this framework, one possible application is to subject's medio-lateral axis. Real-time data about platform provis framework, fee able ancatin is roll were used to generate acoustic stimuli, presented via provide dynamic acoustic feedback about stance. In this headphones. Subjects were asked to control standing sway so paper we present a study on the ability of standing as to achieve specific patterns in the acoustic stimuli. The persons to control their medio-lateral orientation relative results suggest that acoustic stimuli can be used as a source to dynamic patterns in acoustic stimulation. We asked of information for the perception and control of orientation.

Towards a Social Retrieval of Music Content

Privacy, security, risk and trust ( …, Jan 1, 2011

Endowing search engines with multimodal content indexing, sharing, and retrieval is a research ch... more Endowing search engines with multimodal content indexing, sharing, and retrieval is a research challenge for the ICT community. This paper introduces a use case exploiting embodied cooperation as a paradigm for formulating social queries. It focuses on the assessment of the experience of users to this use case and on the design and exploitation of algorithms suitable to provide search engines with social intelligence.

Stabilization of posture relative to audio referents

ENACTIVE/06, Jan 1, 2006

Playful Interaction in a Multi-tracking Environment

musart.dist.unige.it

This project uses mobile phones as interaction devices, utilizing their multimodal input and audi... more This project uses mobile phones as interaction devices, utilizing their multimodal input and audio output capabilities. The users are able to cooperate in the performance of a music piece by interacting with their mobile phones, or by using them as if they were virtual stand-alone musical instruments or sounding objects. In addition, the mobile multimodal inputs are streamed to an external system that is able to provide additional tracking and feature extraction capabilities, such as computer vision based body/blob tracking. The external system synchronizes the mobile interaction streams with its own tracking streams (thus the term "multi-tracking"), analyzes the composite streams, and produces a) control signals that are streamed back to the mobile audio synthesizer, b) audio signals that are reproduced either locally by each mobile phone or globally by a shared audio system, and c) real-time graphics that are rendered to a large display/canvas, which is shared with and visible to all performers.

Emotional entrainment in music performance

Automatic Face & …, Jan 1, 2008

This work aims at defining a computational model of human emotional entrainment. Music, as a non-... more This work aims at defining a computational model of human emotional entrainment. Music, as a non-verbal language to express emotions, is chosen as an ideal test bed for these aims. We start from multimodal gesture and motion signals, recorded in a real world collaborative condition in an ecological setting. Four violin players were asked to play, alone or in duo, a music fragment in two different perceptual feedback modalities and in four different emotional states. We focused our attention on Phase Synchronisation of the head motions of the players. From observation by subjects (musicians and observers), an evidence of entrainment emerges between players. The preliminary results, based on a reduced data set, however do not grasp fully this phenomenon. A more extended analysis is current subject of investigation.

Embodied cooperation using mobile devices: presenting and evaluating the Sync4All application

Proceedings of the International Working …, Jan 1, 2012

Abstract Embodied cooperation" arises when two co-present, individuals in motion coordinate ... more

A system for real-time multimodal analysis of nonverbal affective social interaction in user-centric media

Multimedia, IEEE Transactions …, Jan 1, 2010

This paper presents a multimodal system for real-time analysis of nonverbal affective social inte... more This paper presents a multimodal system for real-time analysis of nonverbal affective social interaction in small groups of users. The focus is on two major aspects of affective social interaction: the synchronization of the affective behavior within a small group and the emergence of functional roles, such as leadership. A small group of users is modeled as a complex system consisting of single interacting components that can auto-organize and show global properties. Techniques are developed for computing quantitative measures of both synchronization and leadership. Music is selected as experimental test-bed since it is a clear example of interactive and social activity, where affective nonverbal communication plays a fundamental role. The system has been implemented as software modules for the EyesWeb XMI platform (http://www.eyesweb.org). It has been used in experimental frameworks (a violin duo and a string quartet) and in real-world applications (in user-centric applications for active music listening). Further application scenarios include entertainment, edutainment, therapy and rehabilitation, cultural heritage, and museum applications. Research has been carried out in the framework of the EU-ICT FP7 Project SAME (http://www.sameproject.eu).

Multimodal interfaces for expressive interaction

4th Italian …, Jan 1, 2005

The Italian ACM SIGCHI Chapter, called SIGCHI Italy, has been officially chartered on April 24, 1... more The Italian ACM SIGCHI Chapter, called SIGCHI Italy, has been officially chartered on April 24, 1996. Its aim is to promote an increased knowledge and greater interest in the science, technology, design, development, and application of methods/tools/techniques for HCI. SIGCHI Italy has scientific and educational goals, and aims to provide a mean of communication between persons having interest in HCI. It also organizes meetings, conferences, discussion groups and workshops. SIGCHI, ACM's Special Interest Group on Computer-Human Interaction, brings together people working on the design, evaluation, and implementation of interactive computing systems for human use, and the study of major phenomena surrounding such systems. It embraces work on the hardware and software engineering of interactive systems, the structure of communications between human and machine, characterization of the use and context of use for interactive systems, methodology of design, and new designs themselves. It helps to organize and coordinate information through on line information, traditional publications, conferences, workshops, and symposia relating to human-computer interaction. SIGCHI members are interested in keeping up with changes in this rapidly evolving field -in research and development, or the design and evaluation of new user interfaces -making computers easier to use and extending technology into new domains for new users.

Children music-making with interactive reflexive technology. A case study of spiral model of specification

mirorproject.eu

The MIROR project is an European Union funded project under the 7th Framework programme (FP7/2007... more The MIROR project is an European Union funded project under the 7th Framework programme (FP7/2007-2013. The project deals with the development of an adaptive system for music learning and teaching based on the reflexive interaction paradigm: the MIROR Platform. The platform is developed in the context of early childhood education and addresses improvisation, composition, and body performance both in formal contexts (kindergartens, primary schools, music schools) as well as in informal ones (at home, kinder centres etc.). The objective of this paper is to introduce the theoretical framework and the aims of MIROR project, present the design and development methodology the project adopted and how it was applied to one of the prototypes the project is implementing: MIROR Body-Gesture. This is discussed as a concrete case study of interactive reflexive musical system.

Towards analysis of expressive gesture in groups of users: computational models of expressive social interaction

Gesture in Embodied Communication and …, Jan 1, 2010

In this paper we present a survey of our research on analysis of expressive gesture and how it is... more In this paper we present a survey of our research on analysis of expressive gesture and how it is evolving towards the analysis of expressive social interaction in groups of users. Social interaction and its expressive implications (e.g., emotional contagion, empathy) is an extremely relevant component for analysis of expressive gesture, since it provides significant information on the context expressive gestures are performed in. However, most of the current systems analyze expressive gestures according to basic emotion categories or simple dimensional approaches. Moreover, almost all of them are intended for a single user, whereas social interaction is often neglected. After briefly recalling our pioneering studies on collaborative robothuman interaction, this paper presents two steps in the direction of novel computational models and techniques for measuring social interaction: (i) the interactive installation Mappe per Affetti Erranti for active listening to sound and music content, and (ii) the techniques we developed for explicitly measuring synchronization within a group of users. We conclude with the research challenges we will face in the near future.

Developing multimodal interactive systems with EyesWeb XMI

Proceedings of the 7th …, Jan 1, 2007

EyesWeb XMI (for eXtended Multimodal Interaction) is the new version of the wellknown EyesWeb pla... more EyesWeb XMI (for eXtended Multimodal Interaction) is the new version of the wellknown EyesWeb platform. It has a main focus on multimodality and the main design target of this new release has been to improve the ability to process and correlate several streams of data. It has been used extensively to build a set of interactive systems for performing arts applications for Festival della Scienza 2006, Genoa, Italy. The purpose of this paper is to describe the developed installations as well as the new EyesWeb features that helped in their development.

The 3rd international workshop on social behaviour in music: SBM2012

Proceedings of the 14th …, Jan 1, 2012

ABSTRACT Since its first edition in 2009, the International Workshop on Social Behaviour in Music... more ABSTRACT Since its first edition in 2009, the International Workshop on Social Behaviour in Music (SBM) has been an occasion for researchers and practitioners for discussing recent advances in automated analysis of social behaviour, being music the selected test-bed and application scenario. The first edition of SBM was held in Vancouver, Canada, in the framework of the 2009 IEEE International Conference on Social Computing (SocialCom 2009). The second one was held in Genova, Italy, in the framework of the 4th International ICST Conference on Intelligent Technologies for Interactive Entertainment (Intetain 2011). SBM is now at its third edition, which takes place in the framework of the 14th International Conference on Multimodal Interaction (ICMI 2012), Santa Monica, California, USA. Again, SBM aims at providing a picture of current research breakthrough and issues, giving at the same time directions for future works and collaborations.