Skip to main content

Mark Neerincx

Followers

9

Following

3

Co-author

1

Public Views

Giannis Petousakis

Ivana Kruijff-Korbayova

German Research Center for Artificial Intelligence

Delft University of Technology

Janusz Bedkowski

Sylvia Pratzler-wanczura

The University of Georgia

Interests

Uploads

Papers by Mark Neerincx

Persistent Robot-Assisted Disaster Response

Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

We report on a field exercise in which a team of human fire-fighters used robots to enact a reali... more We report on a field exercise in which a team of human fire-fighters used robots to enact a realistic disaster response mission in an industrial environment. In this exercise we evaluated the technical working of an integrated robotic system and gained insights concerning the manner in which robots and information streams can be utilized effectively. We have learnt important lessons regarding the employment of human-robot teams in complex, realistic missions.

Us abilit yo fa nA daptive Compute rA ssistant that Improve sS elf-care and Health Literacy of Older Adults

Position Paper INTERACT'99 Workshop 'Making designers aware of existing guidelines for accessibility' The need for a 'universal accessibility' engineering tool

Netherlands Navy as a Lieutenant Commander to found EagleScience

company. In his 14 years of service in the navy, he learned to combine operational experience wit... more

Neerincx, M.A., Grootjen, M. & Veltman, J.A. (2004). How to Manage Cognitive Task Load During Supervision and Damage Control in an All-Electric Ship. IASME Transactions, 2(1), 253-258. How to Manage Cognitive Task Load During Supervision and Damage Contro

Abstract: On one hand, an all-electric ship may take over and support operator tasks in order to ... more Abstract: On one hand, an all-electric ship may take over and support operator tasks in order to improve the operational effectiveness and efficiency on board of a ship. At the other hand, information processing demands seem to increase substantially for the operators in such a ship. Recently, a Cognitive Task Load analysis method was developed for the design of operator tasks and computer support, aiming at optimal load distributions during high-demand situations in current and future naval ships. This paper gives a brief overview of the method, presents results of a task load study in the Multi-purpose frigate of the Royal Netherlands Navy, and summarises current user interface concepts that provide an “integrated view ” for supervision and damage control activities in an all-electric ship. Key-Words: Workload, supervision, human-computer interaction, cognitive engineering, task analysis, navy, ship control centre. 1

Cover by Marco van Vugt and published by Ipskamp Drukkers B.V., Enschede. VRIJE UNIVERSITEIT Adaptive Support for Human-Computer Teams Exploring the Use of Cognitive Models of Trust and Attention

ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector m... more ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector magnificus prof.dr. L.M. Bouter, in het openbaar te verdedigen ten overstaan van de promotiecommissie van de faculteit der Exacte Wetenschappen op donderdag 9 december 2010 om 9.45 uur in de aula van de universiteit, De Boelelaan 1105 door Peter-Paul van Maanen geboren te Raamsdonkpromotor: copromotor: prof.dr. J. Treur

Gebruiksvriendelijkheid van drie prototypes voor het Gemeenschappelijk Voorlichtingsloket (GVL)

De "Stuurgroep GVL" ontwikkelt een V/eb-site, het Gemeenschappelijk Voorlichtingsloket ... more

HEFBOOM-project TUD

Electronic navigation system for blind people

Leverage project TUD

Elektronisch navigatiesysteem voor blinden

Design of an adaptive interface

Optimizing cognitive task load in naval ship control centres:

A Machine With Human-Like Memory Systems

ArXiv, 2022

Inspired by the cognitive science theory, we explicitly model an agent with both semantic and epi... more Inspired by the cognitive science theory, we explicitly model an agent with both semantic and episodic memory systems, and show that it is better than having just one of the two memory systems. In order to show this, we have designed and released our own challenging environment, "the Room", compatible with OpenAI Gym, where an agent has to properly learn how to encode, store, and retrieve memories to maximize its rewards. The Room environment allows for a hybrid intelligence setup where machines and humans can collaborate. We show that two agents collaborating with each other results in better performance than one agent acting alone. We have open-sourced our code and models at https://github.com/tae898/explicit-memory.

Electronic Partners That Diagnose, Guide and Mediate Space Crew’s Social, Cognitive and Affective Processes

Long-duration missions (e.g. to the Moon, asteroids, or Mars) require astronauts to collaborate a... more Long-duration missions (e.g. to the Moon, asteroids, or Mars) require astronauts to collaborate and interact with complex computerized equipment and facilities under dynamic and hazardous conditions. The Mission Execution Crew Assistant (MECA) comprises crew support that acts as an “electronic partner” (ePartner), helping the crew to take care of their mental and social conditions and to schedule crew activities. We have developed a simple prototype of MECA which we use to test MECA’s functionalities in analogue environments where test participants are placed in isolation for longer periods of time.

Robotic Self-Assessment of Competence

In robotics, one of the main challenges is that the on-board Artificial Intelligence (AI) must de... more In robotics, one of the main challenges is that the on-board Artificial Intelligence (AI) must deal with different or unexpected environments. Such AI agents may be incompetent there, while the underlying model itself may not be aware of this (e.g., deep learning models are often overly confident). This paper proposes two methods for the online assessment of the competence of the AI model, respectively for situations when nothing is known about competence beforehand, and when there is prior knowledge about competence (in semantic form). The proposed method assesses whether the current environment is known. If not, it asks a human for feedback about its competence. If it knows the environment, it assesses its competence by generalizing from earlier experience. Results on real data show the merit of competence assessment for a robot moving through various environments in which it sometimes is competent and at other times it is not competent. We discuss the role of the human in robot&#...

Human-agent experience sharing : Creating social agents for elderly people with dementia

As intelligent technology steadily becomes a part of modern societies, people collaborate with ag... more As intelligent technology steadily becomes a part of modern societies, people collaborate with agents more frequently, and so agents need to be socially intelligent, i.e. personalised and context-sensitive. This paper introduces a context-sensitive personalisation framework for social agents that facilitates the establishment of human-agent relationships by sharing past experiences through personal conversation, and sharing new experiences by engaging in joint activities to-gether. We apply the framework in a robot application for the dementia care practice: ReJAM - Robots engaging Elderly in Joint Activities with Music.

Reducing Stress by Bonding with a Social Robot

Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, 2018

Pediatric oncology patients could benefit from bonding with a social robot and talking about thei... more Pediatric oncology patients could benefit from bonding with a social robot and talking about their day in the hospital. With our research we aim to contribute to the development of a robot that is able to facilitate a child-robot bond autonomously and long-term. We propose to use robot-disclosure and a shared interaction history to create a child-robot bond where the child feels comfortable and familiar enough to talk about their day with the robot.

Design Patterns for an Interactive Storytelling Robot to Support Children's Engagement and Agency

Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

In this paper we specify and validate three interaction design patterns for an interactive storyt... more In this paper we specify and validate three interaction design patterns for an interactive storytelling experience with an autonomous social robot. The patterns enable the child to make decisions about the story by talking with the robot, reenact parts of the story together with the robot, and recording self-made sound effects. The design patterns successfully support children's engagement and agency. A user study (N = 27, 8-10 y.o.) showed that children paid more attention to the robot, enjoyed the storytelling experience more, and could recall more about the story, when the design patterns were employed by the robot during storytelling. All three aspects are important features of engagement. Children felt more autonomous during storytelling with the design patterns and highly appreciated that the design patterns allowed them to express themselves more freely. Both aspects are important features of children's agency. Important lessons we have learned are that reducing points of confusion and giving the children more time to make themselves heard by the robot will improve the patterns efficiency to support engagement and agency. Allowing children to pick and choose from a diverse set of stories and interaction settings would make the storytelling experience more inclusive for a broader range of children. CCS CONCEPTS • Human-centered computing → Empirical studies in interaction design; • Computing methodologies → Cognitive robotics; • Applied computing → Consumer health.

Growing-Up Hand in Hand with Robots

Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, 2017

Agent-Based Personalisation and User Modeling for Personalised Educational Games

Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization - UMAP '16, 2016

Personalisation can increase the learning efficacy of educational games by tailoring their conten... more Personalisation can increase the learning efficacy of educational games by tailoring their content to the needs of the individual learner. This paper presents the Personalised Educational Game Architecture (PEGA). It uses a multi-agent organisation and an ontology to offer learners personalised training in a game environment. The multi-agent organisation's flexibility enables adaptive automation; the instructor can decide to control only parts of the training, while leaving the rest to the intelligent agents.

Persistent Robot-Assisted Disaster Response

Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction

We report on a field exercise in which a team of human fire-fighters used robots to enact a reali... more We report on a field exercise in which a team of human fire-fighters used robots to enact a realistic disaster response mission in an industrial environment. In this exercise we evaluated the technical working of an integrated robotic system and gained insights concerning the manner in which robots and information streams can be utilized effectively. We have learnt important lessons regarding the employment of human-robot teams in complex, realistic missions.

Us abilit yo fa nA daptive Compute rA ssistant that Improve sS elf-care and Health Literacy of Older Adults

Position Paper INTERACT'99 Workshop 'Making designers aware of existing guidelines for accessibility' The need for a 'universal accessibility' engineering tool

Netherlands Navy as a Lieutenant Commander to found EagleScience

company. In his 14 years of service in the navy, he learned to combine operational experience wit... more

Neerincx, M.A., Grootjen, M. & Veltman, J.A. (2004). How to Manage Cognitive Task Load During Supervision and Damage Control in an All-Electric Ship. IASME Transactions, 2(1), 253-258. How to Manage Cognitive Task Load During Supervision and Damage Contro

Abstract: On one hand, an all-electric ship may take over and support operator tasks in order to ... more Abstract: On one hand, an all-electric ship may take over and support operator tasks in order to improve the operational effectiveness and efficiency on board of a ship. At the other hand, information processing demands seem to increase substantially for the operators in such a ship. Recently, a Cognitive Task Load analysis method was developed for the design of operator tasks and computer support, aiming at optimal load distributions during high-demand situations in current and future naval ships. This paper gives a brief overview of the method, presents results of a task load study in the Multi-purpose frigate of the Royal Netherlands Navy, and summarises current user interface concepts that provide an “integrated view ” for supervision and damage control activities in an all-electric ship. Key-Words: Workload, supervision, human-computer interaction, cognitive engineering, task analysis, navy, ship control centre. 1

Cover by Marco van Vugt and published by Ipskamp Drukkers B.V., Enschede. VRIJE UNIVERSITEIT Adaptive Support for Human-Computer Teams Exploring the Use of Cognitive Models of Trust and Attention

ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector m... more ter verkrijging van de graad Doctor aan de Vrije Universiteit Amsterdam, op gezag van de rector magnificus prof.dr. L.M. Bouter, in het openbaar te verdedigen ten overstaan van de promotiecommissie van de faculteit der Exacte Wetenschappen op donderdag 9 december 2010 om 9.45 uur in de aula van de universiteit, De Boelelaan 1105 door Peter-Paul van Maanen geboren te Raamsdonkpromotor: copromotor: prof.dr. J. Treur

Gebruiksvriendelijkheid van drie prototypes voor het Gemeenschappelijk Voorlichtingsloket (GVL)

De "Stuurgroep GVL" ontwikkelt een V/eb-site, het Gemeenschappelijk Voorlichtingsloket ... more

HEFBOOM-project TUD

Electronic navigation system for blind people

Leverage project TUD

Elektronisch navigatiesysteem voor blinden

Design of an adaptive interface

Optimizing cognitive task load in naval ship control centres:

A Machine With Human-Like Memory Systems

ArXiv, 2022

Inspired by the cognitive science theory, we explicitly model an agent with both semantic and epi... more Inspired by the cognitive science theory, we explicitly model an agent with both semantic and episodic memory systems, and show that it is better than having just one of the two memory systems. In order to show this, we have designed and released our own challenging environment, "the Room", compatible with OpenAI Gym, where an agent has to properly learn how to encode, store, and retrieve memories to maximize its rewards. The Room environment allows for a hybrid intelligence setup where machines and humans can collaborate. We show that two agents collaborating with each other results in better performance than one agent acting alone. We have open-sourced our code and models at https://github.com/tae898/explicit-memory.

Electronic Partners That Diagnose, Guide and Mediate Space Crew’s Social, Cognitive and Affective Processes

Long-duration missions (e.g. to the Moon, asteroids, or Mars) require astronauts to collaborate a... more Long-duration missions (e.g. to the Moon, asteroids, or Mars) require astronauts to collaborate and interact with complex computerized equipment and facilities under dynamic and hazardous conditions. The Mission Execution Crew Assistant (MECA) comprises crew support that acts as an “electronic partner” (ePartner), helping the crew to take care of their mental and social conditions and to schedule crew activities. We have developed a simple prototype of MECA which we use to test MECA’s functionalities in analogue environments where test participants are placed in isolation for longer periods of time.

Robotic Self-Assessment of Competence

In robotics, one of the main challenges is that the on-board Artificial Intelligence (AI) must de... more In robotics, one of the main challenges is that the on-board Artificial Intelligence (AI) must deal with different or unexpected environments. Such AI agents may be incompetent there, while the underlying model itself may not be aware of this (e.g., deep learning models are often overly confident). This paper proposes two methods for the online assessment of the competence of the AI model, respectively for situations when nothing is known about competence beforehand, and when there is prior knowledge about competence (in semantic form). The proposed method assesses whether the current environment is known. If not, it asks a human for feedback about its competence. If it knows the environment, it assesses its competence by generalizing from earlier experience. Results on real data show the merit of competence assessment for a robot moving through various environments in which it sometimes is competent and at other times it is not competent. We discuss the role of the human in robot&#...

Human-agent experience sharing : Creating social agents for elderly people with dementia

As intelligent technology steadily becomes a part of modern societies, people collaborate with ag... more As intelligent technology steadily becomes a part of modern societies, people collaborate with agents more frequently, and so agents need to be socially intelligent, i.e. personalised and context-sensitive. This paper introduces a context-sensitive personalisation framework for social agents that facilitates the establishment of human-agent relationships by sharing past experiences through personal conversation, and sharing new experiences by engaging in joint activities to-gether. We apply the framework in a robot application for the dementia care practice: ReJAM - Robots engaging Elderly in Joint Activities with Music.

Reducing Stress by Bonding with a Social Robot

Companion of the 2018 ACM/IEEE International Conference on Human-Robot Interaction, 2018

Pediatric oncology patients could benefit from bonding with a social robot and talking about thei... more Pediatric oncology patients could benefit from bonding with a social robot and talking about their day in the hospital. With our research we aim to contribute to the development of a robot that is able to facilitate a child-robot bond autonomously and long-term. We propose to use robot-disclosure and a shared interaction history to create a child-robot bond where the child feels comfortable and familiar enough to talk about their day with the robot.

Design Patterns for an Interactive Storytelling Robot to Support Children's Engagement and Agency

Proceedings of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, 2020

In this paper we specify and validate three interaction design patterns for an interactive storyt... more In this paper we specify and validate three interaction design patterns for an interactive storytelling experience with an autonomous social robot. The patterns enable the child to make decisions about the story by talking with the robot, reenact parts of the story together with the robot, and recording self-made sound effects. The design patterns successfully support children's engagement and agency. A user study (N = 27, 8-10 y.o.) showed that children paid more attention to the robot, enjoyed the storytelling experience more, and could recall more about the story, when the design patterns were employed by the robot during storytelling. All three aspects are important features of engagement. Children felt more autonomous during storytelling with the design patterns and highly appreciated that the design patterns allowed them to express themselves more freely. Both aspects are important features of children's agency. Important lessons we have learned are that reducing points of confusion and giving the children more time to make themselves heard by the robot will improve the patterns efficiency to support engagement and agency. Allowing children to pick and choose from a diverse set of stories and interaction settings would make the storytelling experience more inclusive for a broader range of children. CCS CONCEPTS • Human-centered computing → Empirical studies in interaction design; • Computing methodologies → Cognitive robotics; • Applied computing → Consumer health.

Growing-Up Hand in Hand with Robots

Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction, 2017

Agent-Based Personalisation and User Modeling for Personalised Educational Games

Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization - UMAP '16, 2016

Personalisation can increase the learning efficacy of educational games by tailoring their conten... more Personalisation can increase the learning efficacy of educational games by tailoring their content to the needs of the individual learner. This paper presents the Personalised Educational Game Architecture (PEGA). It uses a multi-agent organisation and an ontology to offer learners personalised training in a game environment. The multi-agent organisation's flexibility enables adaptive automation; the instructor can decide to control only parts of the training, while leaving the rest to the intelligent agents.