OUR PROJECT · ARTIFICIAL INTELLIGENCE
3D Digital Twin
A 3D digital twin that models a person or an object and talks in real time. It recognizes the speech of the user, generates an answer with a language model and speaks the answer in sync with the facial movements of the avatar. It runs in the browser without installation, the model stays on in-house hardware and the data does not leave the organization. It can be adapted to your organization for use cases from customer service to training.
- Goal
-
To run a talking digital twin in the browser in real time, one that represents a person with their own face and voice or models an object in 3D such as a heart, a lung, a fish farm, a production line or a building. Main use cases:
- Multilingual customer service and kiosk applications
- Medical and vocational training
- Museum and exhibition guides
- Voice-based monitoring of facility and building data
- Internal knowledge assistants
- Benefit
-
Speech recognition, the language model and speech synthesis work in a single flow.
- The model runs on local hardware, data stays inside the organization and GDPR and KVKK compliance is easier
- No installation in the browser, the same experience on every device and in every country
- Serves many users at the same time
- Higher accessibility through voice and face interaction
- Portrait or full body view, camera-based face tracking and a presentation mode