Design and Implementation of a Real-time Video Stream Analysis System Based on FFMPEG

this paper introduces the design and implementation of a FFMPEG-based stream analysis system. The system supports real-time analysis of media data from a variety type of transmission protocols, media container formats and video / audio coding standards. The system breaks through the limitation of traditional stream analysis system that only supports a specific data format, and is more suitable for analysis of Internet media stream. First, the paper introduces the structure of the system. Then, the paper implements the FFMPEG-based Decoding Section. Meanwhile, it introduces FFMPEG's important data structures and FFMPEG's decoding process. Finally, the paper implements the Analysis Section. Method mentioned in this paper can be used as the basis of more complex stream analysis system.