Memento: a prototype search engine for LSC 2021

In this extended paper, we describe our lifelog retrieval system called Memento which participated in the 2021 Lifelog Search Challenge in detail. Memento leverages semantic representations of images and textual queries projected into a common latent space to facilitate effective retrieval, aiming to bridge the existing semantic gap between complex visual scenes/events and user information needs expressed as textual and faceted queries. Our system also has a minimalist user interface which includes functionalities such as visual data filtering and temporal search. Finally, we include a comparative analysis of Memento's performance at LSC 2021 and suggest improvements for future iterations of the system.

Automated summary

In this paper, we provide a detailed description of our lifelog retrieval system Memento, which participated in the 2021 Lifelog Search Challenge. Memento uses semantic representations of images and textual queries to bridge the semantic gap between visual scenes and user information needs. The system also includes a minimalist user interface with features like visual data filtering and temporal search. Additionally, we present a comparative analysis of Memento's performance at LSC 2021 and suggest improvements for future iterations.