2025-10-07
NAVER LABS Europe has shared their impressive results and innovations developed within the HE-UTTER project in their latest...
View more2025-09-02
At this year’s Machine Translation Marathon (August 25–29, Helsinki ), UTTER partners from the University of Edinburgh and...
View more2025-08-18
🚀 We’re excited to be part of the organizing team for AutoMin 2025– a workshop dedicated to advancing research on Automatic...
View more2025-08-04
UTTER participated in advancing research on speech LLMS by proposing TWO systems to the instruction-following shared task.
2025-07-21
As part of the Horizon Europe UTTER Project, we’ve developed two innovative AI prototypes designed to enhance human-AI...
View more2025-06-13
Final Meeting of the UTTER Project
📍 Amsterdam | June 11–13, 2025
The UTTER project reached a key milestone with its final...
View more2025-06-12
We're proud to share that our very own Professor André Martins represented the EuroLLM and UTTER projects in two prominent...
View more2025-06-10
We are excited to announce the 2nd Workshop on Uncertainty-Aware NLP (UncertaiNLP) – a dedicated venue for advancing research...
View more2025-05-20
We’re excited to share the recent progress and achievements from FSTP projects supported by UTTER. These innovative...
View more2025-01-17
UTTER contributed to COLING 2025 with two key papers presented by the team, including Laurent Besacier (NAVER LABS Europe):
📌...
View more2024-12-16
We’re thrilled to reveal the results of UTTER’s FSTP Open Call 2, part of the Horizon Europe Unified Transcription and...
View more2024-12-04
We’re excited to announce EuroLLM-9B, a 9-billion-parameter model trained on 4 trillion tokens across all EU languages + 11...
View more2024-09-17
This year's UTTER in-person meeting took place in sunny Lisbon.
We came together to share new ideas, discuss our vision and...
View more2024-09-05
We’re thrilled to share that Tower LLM, an open multilingual large language model designed for translation-related tasks, ...
View more2024-07-05
For everyone who couldn't join UTTER's 1st User Day on July 5th: Take a look at the recordings of the event here!
View more2024-06-20
Save the date and join us on July 5th for our 2nd User Day where we will explore multilingual and multimodal LLMs and the...
View more2024-05-01
Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...
View more2024-03-27
UTTER has co-organized the first UncertaiNLP workshop, held alongside the 18th EACL Conference in Malta. Focused on...
View more2023-10-30
You can now explore a range of content, from UTTER User Day to our latest collaborations and contributions in multimodal LLMs...
View more2023-07-26
Our Horizon Europe project, UTTER, invites project proposals from research organizations and SMEs to develop and/or pilot...
View more2023-07-05
For everyone who couldn't join UTTER's 1st User Day on July 5th: Take a look at the recordings of the event here!
Demo-José... View more2023-07-03
🌟 Exciting Announcement! 🌟
UTTER USER DAY - JOIN US IN BUILDING THE NEXT GENERATION OF MULTIMODAL EXTENDED REALITY TECHNOLOGIES
2023-06-19
We held the HE-UTTER's first two-day physical meeting in Amsterdam. It was an outstanding opportunity to come together,...
View more2022-10-01
In the last almost three years, the pandemic forced us into our homes, where we endured a stream of lockdowns. We had to...
View more
Date: 11th-13th June, 2025
Location: Amsterdam
Date: 9th-10th September, 2024
Location: Lisbon
Date: 5th July, 2024
Location: online
Date: 5th July, 2023
Location: online
Date: 19th-20th June, 2023
Location: Amsterdam
Date: 24th-27th October, 2022
Location: online
2025-07-01
UTTER has supported 15 FSTP projects - all successfully completed!
Explore highlights of the concluded FSTP projects...
View more2024-12-16
Results of UTTER FSTP Open call 2 for recipients of financial support
Project Horizon European Unified Transcription and...
View more2024-05-01
FINANCIAL SUPPORT FOR THIRD PARTIES (FSTP) CALL 2
Funding opportunity for research organization and SMEs – development and...
View more2023-12-21
Results of UTTER FSTP Open call 1 for recipients of financial support
Project Horizon European Unified Transcription and...
2023-07-06
FINANCIAL SUPPORT FOR THIRD PARTIES (FSTP) CALL 1
Funding opportunity for research organization and SMEs – development and...
View moreBelow are the tentative key facts for the UTTER FSTP funding. For the final version, check each of the calls.
In a sentence, UTTER will take online and hybrid interaction to the next level, where users interact in an extended reality. We will develop the technology which will make that possible and we will demonstrate it in two use cases.
We will develop conversation platforms in which human agents interact while being assisted by AI agents.
Our meeting assistant will empower users of videoconferencing tools, with capabilities such as summarisation, minuting, and retrieval.
Our multilingual customer support assistant empowers a customer service agent to provide support in any language.
In UTTER we will develop technologies that will provide the next level of support for online and hybrid meetings, that will offer an eXtended Reality (XR) experience. We will provide the type of meeting support that would normally only have been possible with a personal assistant, such as automatically taking minutes and summaries, and providing transcripts. Our XR models will also be applied to online customer support.
The main project objectives are:
1. Research: Advancing research in responsible creation and application of multilingual, multimodal pretrained XR models
- Advance the state-of-the-art in multimodal, multilingual pre-trained models and their application to downstream tasks. This project will focus on making them customizable, efficient, and ethical.
2. Deployment: Development of new methods and algorithms for adapted, contextualised, and robust dialogue assistant XR models
- Leverage multimodal models to deliver tools which provide a new paradigm in quality, robustness, and contextualisation capabilities for dialogue assistant components such as transcription, translation, and summarisation.
3. Integration: Development of tools for online meetings and customer support agents
- Design and implementation of interfaces to visualise, edit and publish transcripts, minutes, combined with meeting platforms like Zoom to deliver multilingual transcription and translation support.
4. Exploitation: Sustainable, maintainable platform and services
- Development of a plan for sustainable exploitation and use of the platforms, systems and technologies developed in UTTER.
5. Dissemination: Dissemination and communication of project results to stakeholders
- Dissemination and communication of project results to stakeholders and user group. Successful promotion and use of platform in the pilots run under the financial support to third parties call.
Universiteit van Amsterdam
[ UVA ]
Netherland
Maryam Hashemi Shabestari
Project manager
Unbabel
[ UNB ]
Portugal
Maria Henriques
Dissemination coordinator
Instituto de Telecomunicações
[ IT ]
Portugal
André Martins
Scientific coordinator and Researcher
Naver Labs Europe
[ NAV ]
France
Laurent Besacier
Innovation coordinator and Researcher
The University of Edinburgh
[ UEDIN ]
United Kingdom
Alexandra Birch
Ethics coordinator and Researcher
This project has received funding from the European Union’s Horizon Europe Research and Innovation programme under Grant Agreement No 101070631 and from the UK Research and Innovation (UKRI) under the UK government's Horizon Europe funding guarantee (Grant No 10039436). Views and opinions expressed are however those of the UTTER consortium only and do not necessarily reflect those of the European Union and UKRI. Neither the European Union nor the UKRI nor the granting authority can be held responsible for them.
UTTER's 1st Ethics Review
UTTER's Data Management Plan
UTTER's final report on adaptable and context-aware models
UTTER's final report on data and resources
UTTER's final report on efficient, usable models
UTTER's final report on uncertainty-aware, robust and explainable models
UTTER's final report on XR models
UTTER's first prototype evaluation report
UTTER's first report on adaptable and context
UTTER's first report on data and resources
UTTER's first report on efficient usable models
UTTER's first Report on Uncertainty-Aware, Robust and Explainable Models
UTTER's first report on XR models
UTTER's Report on first set of FSTP projects
UTTER's report on second set of FSTP projects
UTTER's Second Ethics Review
UTTER's Second prototype evaluation report
UTTER's third ethics review
UTTER's third prototype evaluation report
