VFXRIO / VIDEO COLLECTION

MMSW: World Models and Robotic Extensions of Synthetic Entities

Matteo Moriconi (VFXRio/VISGRAF) and Luiz Velho (IMPA/VISGRAF) present the recent advances in MMSW (Multicasting Multimodal Story Worlds), in its evolution from multimodality to transmodality and World Models.
The Story World becomes a shared and continuously updatable world state in which digital twins and robotic systems allow a synthetic entity to act in space, producing observable and verifiable consequences.
In the experiments, the synthetic entity Celestia Borealis acts through a Franka Panda robotic arm. In the Aurora Circuit project, a defined motor vocabulary is combined to create a sequence of movements, which is subsequently named and reinterpreted through drawing and sound.
The presentation explores the technical architecture of the system and proposes a reflection on how meaning, perception, and action are reorganized when a computational entity begins to operate through simulated or robotic bodies.

Share this video