Automatic semantic analysis of gameplay videos of ‘This War of Mine’

Abstract

In recent years there has been an increase in published research on video games. However, few articles discuss semantic analysis of gameplay videos, which are available online on platforms such as YouTube or Twitch. A case-study was performed where a three-step approach is proposed to analyze a specific scene in videos of the game ‘This War of Mine’. The first step is to detect the location at which the scene of interest takes place using a SVM with bag-of-visual-words histograms of SIFT features. Then convolutional neural networks are used to detect which scene takes place at that location and what choice the player makes during that scene.