People@Places and ToDY: Two Datasets for Scene Classification in Media Production and Archiving

In order to support common annotation tasks in visual media production and archiving, we propose two datasets which cover the annotation of the bustle of a scene (i.e., populated to unpopulated), the cinematographic type of a shot as well as the time of day and season of a shot. The dataset for bustle and shot type, called People@Places, adds annotations to the Places365 dataset, and the ToDY (time of day/year) dataset adds annotations to the SkyFinder dataset. For both datasets, we provide a toolchain to create automatic annotations, which have been manually verified and corrected for parts of the two datasets. We provide baseline results for these tasks using the EfficientNet-B3 model, pretrained on the Places365 dataset.

Automated summary

To support annotation tasks in visual media production and archiving, two datasets, People@Places and ToDY, are proposed. These datasets cover the annotation of scene bustle, shot cinematographic type, and shot time of day and season. Automatic annotations are created using a toolchain and manually verified and corrected. Baseline results using the EfficientNet-B3 model pretrained on Places365 dataset are provided.