4D film is an immersive entertainment system that presents various physical effects with a film. Despite the recent emergence of 4D theaters, production of 4D effects relies on manual authoring and thus remains laborious. In this paper, we present algorithms that synthesize three classes of motion effects from the audiovisual content of a film. The first class of motion effects is those responding to fast camera motion to enhance the immersiveness of point-of-view shots, delivering fast and dynamic vestibular feedback. The second class provides velocity feedback that moves viewers as closely as possible to a trajectory of slowly moving camera. For these two classes, our algorithms compute the relative camera motion using computer vision techniques and then map it to a motion command to the 4D chair using appropriate motion mapping algorithms. The last class is for special effects, such as explosions and collisions, and our algorithm uses sound for the synthesis of impulses and vibrations. We assessed the subjective quality of our algorithms by user experiments, and all the results indicated that our algorithms can provide compelling motion effects, even comparable to those manually designed by 4D effects designers.
- Jaebong Lee, Bohyung Han, and Seungmoon Choi, "Motion Effects Synthesis for 4D Films," IEEE Transactions on Visualization and Computer Graphics (under review).