Abstract
Video summaries or highlights are a compelling alternative for exploring and contextualizing unprecedented amounts of video material. However, the summarization process is commonly automatic, non-transparent and potentially biased towards particular aspects depicted in the original video. Therefore, our aim is to help users like archivists or collection managers to quickly understand which summaries are the most representative for an original video. In this paper, we present empirical results on the utility of different types of visual explanations to achieve transparency for end users on how representative video summaries are, with respect to the original video. We consider four types of video summary explanations, which use in different ways the concepts extracted from the original video subtitles and the video stream, and their prominence. The explanations are generated to meet target user preferences and express different dimensions of transparency: concept prominence, semantic coverage, distance and quantity of coverage. In two user studies we evaluate the utility of the visual explanations for achieving transparency for end users. Our results show that explanations representing all of the dimensions have the highest utility for transparency, and consequently, for understanding the representativeness of video summaries.
Original language | English |
---|---|
Title of host publication | UMAP '20: 28th ACM Conference on User Modeling, Adaptation and Personalization |
Pages | 98-106 |
Number of pages | 9 |
ISBN (Electronic) | 978-1-4503-6861-2 |
DOIs | |
Publication status | Published - 2020 |
Event | 28th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2020 - Genoa, Italy Duration: 14 Jul 2020 → 17 Jul 2020 |
Conference
Conference | 28th ACM International Conference on User Modeling, Adaptation, and Personalization, UMAP 2020 |
---|---|
Country/Territory | Italy |
City | Genoa |
Period | 14/07/20 → 17/07/20 |
Keywords
- user preferences
- video summary representativeness
- video summary transparency
- visual explanation