The DIS group at Centrum Wiskunde & Informatica (CWI) has spent three years building an ecosystem of digital tools for immersive experiences in entertainment, art and news. The result is TRANSMIXR: an open platform designed to help Europe’s creative and cultural sector transition to the next generation of digital media using artificial intelligence (AI) and Extended Reality (XR).
TRANSMIXR was developed as part of an EU-funded project, with a focus on sectors including the performing arts, cultural heritage, news media and broadcasting. The rapid evolution of immersive technology has rendered traditional production workflows outdated, and the platform is designed to bridge that gap. To achieve this, the DIS group worked closely with creative practitioners to design entirely new workflows that integrate AI tools directly into the creative process. These workflows were validated through pilots conducted with professionals from the sector.
The platform features a modular architecture that integrates a wide range of services and workflows, supporting the full lifecycle of a production from initial media processing through to the final audience experience. A key component developed within the platform is VR2Gather, a customisable open-source framework for Unity that enables the creation of social VR experiences. The framework has been applied to two distinct use cases. The first is a virtual control room for news and media broadcasting, giving directors and production teams the ability to seamlessly mix and match audio, video and volumetric video in real time for immersive live broadcasts. The second is a Social XR platform for cultural heritage, allowing multiple users to remotely connect via VR headsets and enter the same digital space simultaneously, experiencing interactive environments as if they were physically present at the same cultural heritage location.
VR2Gather is now permanently installed at CWI’s own lab, with additional installations at Delft University of Technology and the University of Amsterdam. Beyond the Netherlands, the platform has been adopted by institutions in Spain (Universidad Politécnica de Madrid), Belgium (Ghent University) and Austria (University of Klagenfurt).