AIXTRA
Technology
Unity
Hardware
XR headset
Good to know
- Multiplayer VR-Training
- Real-time translation
- KI mit europäischen Modellen
To achieve this, we use AI for real-time translation of voice input and AI-based training partners to simulate realistic human interaction. In this way, we enable multi-person workflows to be carried out with virtual teammates, even when no other person is available. Our aim is to take VR training to a new level and provide an even more interactive learning experience.
Sounds challenging? It certainly is! That’s why we’re embarking on this ambitious project, which is called AIXTRA nor just…
Multiplayer mode on
We are delighted to MindPort to have a competent partner company by our side. They are behind the open-source Unity plugin VR Builder – A real game-changer for the development of VR applications and a welcome tool in the development of our VR training programmes.
Together, our consortium of companies has responded to the open call issued by the European initiative VOXReality awarded. This project funding supports Natural Language Processing (NLP) and Computer Vision (CV) in the XR sector. To this end, it is developing, for example, an AI model with visual understanding that can respond to the users’ surroundings.
Our project AIXTRA is intended to demonstrate, through real-world use cases, where these technologies can be used and what added value they offer.
Key Features
Our project has two objectives – to overcome the language barrier in virtual reality and to revolutionise VR training with AI-based fellow players! Here’s what it’s all about in detail:
Real-time translation – Thanks to AI-based translation tools, we will in future be able to facilitate communication in VR training sessions in a wide variety of languages. Through real-time translation, several training participants will be able to communicate with one another in their respective native languages. This not only ensures a greater degree of inclusion, but also makes understanding considerably easier, particularly when dealing with complex applications.
AI-powered virtual training partners – No training partner available? No problem! Using artificial intelligence and intent recognition, we realistically simulate interaction with human players. This means that, in future, you’ll be able to immerse yourself in interactive training environments even when on your own, and make even better use of the medium for simulating complex processes in multiplayer scenarios.
Step by Step
We’ll take you along on our journey to find virtual sparring partners. Further details about the project will be available shortly on this page or on our YouTube-Channel. The project will run until autumn 2025 – until then, we look forward to plenty of technical updates and a fruitful collaboration with all our partners and funders. There will also be a user study at the end of the project, for which we will be recruiting participants shortly. Anyone interested is welcome to get in touch
Trailer
By loading the video, you agree to YouTube’s privacy policy.
Find out more
Supporters – This is where the EU provides funding
Funded by the European Union. However, the views and opinions expressed are solely those of the author(s) and do not necessarily reflect those of the European Union or the European Executive Agency for Education and Culture (EACEA). Neither the European Union nor the EACEA can be held responsible for them.
Do you like what you see?