Technology: Semantic Animation and Crowds

Semantic Animation describes using high level descriptors (such as verbal commands) to direct the performances of special character assets which are capable of determining their own detailed low-level behaviours and scene interactions. The required semantic information can be created in a manual authoring process or by machine learning. It includes our work in both virtual production and physically based animation.


  • To develop and demonstrate real-time control systems for authoring animated content using smart assets, automatically synthesising new scenes from existing ones and integrating smart assets into virtual production scenarios with editable cameras and lights
  • To research and develop a framework and tools for the automatic transformation and adaptation of smart assets to new contexts, purposes, users and environments, and for the synthesis of new smart assets from existing one.
  • To test the prototype technologies and tool-kits in a series of experimental productions and evaluate their performance in realistic contexts of professional use.

Want more information?

Head to the Semantic Animation and Crowd Docs page for our internal documentation
More information can also be found in our list of Papers
Head to the Downloads page for the mocap shoot developed by UPF and Filmakademie and VPET toolset, developed by Filmakademie

Experimental Production


Latest News