https://doi.org/10.1140/epjds/s13688-021-00295-6
Regular Article
Finding epic moments in live content through deep learning on collective decisions
1
School of Computing, Korea Advanced Institute of Science and Technology, Daejeon, Republic of Korea
2
Data Science Group, Institute of Basic Science, Daejeon, Republic of Korea
3
School of AI Convergence, Soongsil University, Seoul, Republic of Korea
b
kunwoo.park@ssu.ac.kr
c
mcha@ibs.re.kr
Received:
3
December
2020
Accepted:
12
July
2021
Published online:
18
August
2021
Live streaming services enable the audience to interact with one another and the streamer over live content. The surging popularity of live streaming platforms has created a competitive environment. To retain existing viewers and attract newcomers, streamers and fans often create a well-condensed summary of the streamed content. However, this process is manual and costly due to the length of online live streaming events. The current study identifies enjoyable moments in user-generated live video content by examining the audiences’ collective evaluation of its epicness. We characterize what features “epic” moments and present a deep learning model to extract them based on analyzing two million user-recommended clips and the associated chat conversations. The evaluation shows that our data-driven approach can identify epic moments from user-generated streamed content that cover various contexts (e.g., victory, funny, awkward, embarrassing). Our user study further demonstrates that the proposed automatic model performs comparably to expert suggestions. We discuss implications of the collective decision-driven extraction in identifying diverse epic moments in a scalable way.
Key words: Epic moment / Online live streams / Crowdsourced decisions / Twitch.tv
Supplementary Information The online version contains supplementary material available at https://doi.org/10.1140/epjds/s13688-021-00295-6.
© The Author(s) 2021
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
