An extremely relevant keynote abstract by Professor Timothy K. Shih of the National Central University of Taiwan. This capability speaks directly to uberveillance- information manipulation, misrepresentation and more. These capabilities cannot be ignored- and while they can be used brilliantly within the special effects industry, they will inevitably be misapplied to other contexts.
So much for "direct evidence" from body worn video recorders and digital glass devices! Law enforcement agencies pay attention please- before you go heavily investing in body worn video recorders! And courts- don't believe everything you see! The VIDEO EDITING landscape is about to change drastically.
And we will need to build standards around "video capture" akin to the PROOF required to demonstrate that the DNA collection process has not been tampered with. In many ways dealing with the digital arena is much more difficult than that of the physical sample DNA specimen collection.
Keynote Address: Professor Timothy K. Shih National Central University, Taiwan
Video Forgery is a technique for generating fake video by altering, combining, or creating new video contents. We change the behavior of actors in a video. For instance, the outcome of a 100-meter race in the Olympic Game can be falsified. We track objects and segment motions using a modified mean shift mechanism. The resulting video layers can be played in different speeds and at different reference points with respect to the original video. In order to obtain a smooth movement of target objects, a motion interpolation mechanism is proposed based on reference stick figures (i.e., a structure of human skeleton) and video inpainting mechanism. The video inpainting mechanism is performed in a quasi-3D space via guided 3D patch matching. Interpolated target objects and background layers are fused. It is hard to tell whether a falsified video is the original. In addition, in this talk, we demonstrate a new technique to allow users to change the dynamic texture used in a video background for special effect production. For instance, the dynamic texture of fire, smoke, water, cloud, and others can be edited through a series of automatic algorithms. Motion estimations of global and local textures are used. Video blending techniques are used in conjunction with a color balancing technique. The editing procedure will search for suitable patches in irregular shape blocks, to reproduce a realistic dynamic background, such as large waterfall, fire scene, or smoky background. The technique is suitable for making science fiction movies. We demonstrate the original and the falsified videos in our website at http://www.csie.ncu.edu.tw/~tshih. Although video falsifying may create a moral problem, our intension is to create special effects in movie industry.