Publications / 2014 Proceedings of the 31st ISARC, Sydney, Australia

Exploring Local Feature Descriptors for Construction Site Video Stabilization

Jung Yeol Kim, Carlos H. Caldas
Pages 654-660 (2014 Proceedings of the 31st ISARC, Sydney, Australia, ISBN 978-0-646-59711-9, ISSN 2413-5844)

Recent studies on automated activity analysis have adopted construction videos as an input data source to recognize and categorize construction workers’ actions. To ensure the representativeness of its analysis results, these videos have to be gathered randomly in terms of time and location. In doing so, such videos must be taken with hand-held cameras, a fact that inevitably leads to videos including jittery frames. Such frames can decrease the accuracy of automated activity analysis results. One area of the most recent and effective action recognition methods involves using spatio-temporal action recognition algorithms. The jittery frames, however, are fatal to the recognizing of a human worker’s action using such an algorithm. Jitters can be removed from the videos by using video stabilization technologies. The video stabilization is the pre-processing of action recognition for automated activity analysis. Regarding the video stabilization, local feature descriptor plays a major role in the stabilization process, and the correct selection of proper descriptor is critical. Therefore, the purpose of this study is to identify the best local feature descriptor for the video stabilization. This paper describes detail steps of the stabilization and provides performance analysis of various local feature descriptors in terms of stabilization of videos from construction site.

Keywords: IT applications, video stabilization, video interpretation, activity analysis, work sampling, productivity measurement, action recognition