This project investigates the possibilities and the potentials of applying spatial, temporal, chrominance and luminance modulated digital light projectors in television studios for enhanced live broadcasts and recordings. The key technical concept applies synchronized projectors and cameras to display information that are visible (e.g., illumination and special effects) or invisible (e.g., coded patterns for acquisition of scene depth and camera pose, or dynamic direction information visible only to the moderator) in the broadcasted/recorded video stream. Several engineering and computer science oriented problems have to be solved throughout the project:

A soft- and hardware framework has to be developed for synchronizing display- and capturing devices. New techniques for automatic projector calibration, as well as for displaying image content in complex and dynamic environments (not optimized for projections) have to be researched. Methods for offline and online scene acquisition and camera tracking have to be evaluated, improved and adapted to the proposed key concept. New projector-based and video-based illumination and augmentation techniques will be implemented. The outcome of this novel technological approach can open new possibilities for modern television studios.