Join us on our journey to becoming a virtual sparring partner 🥊

To do this, we use AI to translate voice input in real time and AI-based training partners to simulate realistic human interaction. This allows us to create multi-person workflows with virtual teammates, even if no additional person is available. We want to take VR training to a new level and provide an even more interactive learning experience.
Sounds challenging? It is! That’s why we’re not tackling this ambitious project called AIXTRA alone…

Multiplayer Mode on

We are pleased to have MindPort as a competent partner company at our side. They stand behind the open source Unity plugin VR Builder – a real game changer for the development of VR applications and a valued tool in the development of our VR training courses.

Together, our company consortium has won the Open Call of the European VOXReality initiative. This project funding programme is committed to natural language processing (NLP) and computer vision (CV) in the XR sector. For example, it is developing an AI model with visual understanding that can respond to the user’s environment.
Our AIXTRA project is intended as a practical use case to demonstrate where these technologies can be used and what added value they offer.

Core Features

Our project has two main goals – to overcome the language barrier in virtual reality and to revolutionise VR training with AI-based co-players! Here are the details:
Real-time translation – Thanks to AI-based translation tools, we will be able to realise communication in VR training courses in a wide variety of languages in the future. Using real-time translation, several training participants can communicate with each other in their respective native languages. This not only provides an extra dose of inclusion, but also makes it much easier to understand complex applications in particular.
AI-based virtual training partners – No training buddy available? No problem! We use artificial intelligence and intent recognition to realistically simulate interaction with human players. This means you can immerse yourself alone in interactive training scenarios and improve the use of the medium for simulating complex processes in multi-player scenarios.

Step by step

We take you with us on our journey to creating virtual sparring partners. Further details about the project will be available soon on this page or on our YouTube channel. The project will run until autumn 2025 – by then we look forward to many technical updates and good cooperation with all partners and sponsors. There will also be a utilisation study at the end of the project, for which we are currently looking for test subjects. Please get in touch if you are interested

Supporter – Funding from the EU

Funded by the European Union. Views and opinions expressed are however those of the author(s) only and do not necessarily reflect those of the European Union or the European Education and Culture Executive Agency (EACEA). Neither the European Union nor EACEA can be held responsible for them.