Publications / 2020 Proceedings of the 37th ISARC, Kitakyushu, Japan

Single Camera Worker Detection, Tracking and Action Recognition in Construction Site

Hiroaki Ishioka, Xinshuo Weng, Yunze Man and Kris Kitani
Pages 653-660 (2020 Proceedings of the 37th ISARC, Kitakyushu, Japan, ISBN 978-952-94-3634-7, ISSN 2413-5844)

In Japan, the construction industry strongly be needed productivity improvement and increasing the number of new hires due to improvement of working environment. Site manager needs to grasp whether the daily progress is as planned and updates the schedule appropriately for improve site's productivity and safety. In image-based data acquisition approach in japan, there is a problem that learning is insufficient with only global public data, since construction worker in Japan has originality in image feature compare with other countries. In this study, we make original dataset for additional learning firstly. Then we proposed domain-specific algorithms specific to the Japan construction site, including a worker detection and tracking algorithm and a worker action recognition algorithm. As a result, our worker detection showed 87.9% accuracy in same-site evaluation and 77.5% accuracy in cross-site evaluation. Our worker action recognition showed 60.2% mean accuracy. Finally, the method of translation into activity element based on the output value of worker detection was indicated.

Keywords: Construction Process; Worker Detection and Tracking; Action Recognition