Towards Semantic Fast-Forward and Stabilized Egocentric Videos
First International Workshop on Egocentric Perception, Interaction and Computing at European Conference on Computer Vision (EPIC@ECCV) 2016
Abstract
The emergence of low-cost personal mobiles devices and wearable cameras and the increasing storage capacity of video-sharing websites have pushed forward a growing interest towards first-person videos. Since most of the recorded videos compose long-running streams with unedited content, they are tedious and unpleasant to watch. The fast-forward state-of-the-art methods are facing challenges of balancing the smoothness of the video and the emphasis in the relevant frames given a speed-up rate. In this work, we present a methodology capable of summarizing and stabilizing egocentric videos by extracting the semantic information from the frames. This paper also describes a dataset collection with several semantically labeled videos and introduces a new smoothness evaluation metric for egocentric videos that is used to test our method.
Keywords: Semantic Information, First-person Video, Fast-Forward, Egocentric Stabilization
Methodology and Results |
Citation
@InBook{Silva2016,
Title = {Towards Semantic Fast-Forward and Stabilized Egocentric Videos},
Booktitle = {International Workshop on Egocentric Perception, Interaction and Computing (EPIC) at European Conference on Computer Vsision (ECCV)},
Author = {Silva, Michel Melo and Ramos, Washington Luis Souza and Ferreira, Joao Pedro Klock and Campos, Mario Fernando Montenegro and
Nascimento, Erickson Rangel},
Year = {2016},
Address = {Amsterdam, NL},
month = {Oct.},
Pages = {557–571},
Doi = {10.1007/978-3-319-46604-0_40},
ISBN = {978-3-319-46604-0}
}
Title = {Towards Semantic Fast-Forward and Stabilized Egocentric Videos},
Booktitle = {International Workshop on Egocentric Perception, Interaction and Computing (EPIC) at European Conference on Computer Vsision (ECCV)},
Author = {Silva, Michel Melo and Ramos, Washington Luis Souza and Ferreira, Joao Pedro Klock and Campos, Mario Fernando Montenegro and
Nascimento, Erickson Rangel},
Year = {2016},
Address = {Amsterdam, NL},
month = {Oct.},
Pages = {557–571},
Doi = {10.1007/978-3-319-46604-0_40},
ISBN = {978-3-319-46604-0}
}
Baselines
We compare this proposed methodology against the following methods:
- EgoSampling – Poleg et al., Egosampling: Fast-forward and stereo for egocentric videos, CVPR 2015.
- Microsoft Hyperlapse – Joshi et al., Real-time hyperlapse creation via optimal frame selection, ACM. Trans. Graph. 2015.
- Fast-Forward based on Semantic Extraction – Ramos et al., Fast-forward video based on semantic extraction, ICIP 2016.
Datasets
We conducted the experimental evaluation using the datasets:
- Semantic dataset – Silva et al., Towards Semantic Fast-Forward and Stabilized Egocentric Videos, EPIC 2016.