Semi-Automatic Cinematographer

Categories: Virtual Studio

Posted on January 29, 2017, 10:38 pm

The goal of this project was to develop an automatic cinematographer for the interactive virtual stuido. The system is supposed to recognize and suggest, when to cut between the Jib-Arm camera and the robotic camera. In addition, the robotic camera attributes are supposed to be adjusted fully automatically, which include, for instance, the position, rotation, zoom and focus. For this, all necessary information are analysed and evaluated by an expert system, based on fundamental cinematographic rules.

Relevant information about the currently recorded scene are gathered in two ways: Firstly, by tracking the actors’ skeletons with a markerless tracking system – Organic Motion OpenStage. And secondly, by using lavalier microphones, to obtain the actors’ voices. These two sources are used, in order to extract the information needed by the expert system. So, the expert system can choose the next action to be performed, based on customly predefined rules. At the end, the automatic cinematographer was tested within a live broadcast scenario.


Last modified on February 6, 2017, 4:28 pm