Publications / 2021 Proceedings of the 38th ISARC, Dubai, UAE

Generalization of Construction Object Segmentation Models using Self-Supervised Learning and Copy-Paste Data Augmentation

Yeji Hong, Wei Chih Chern, Tam Nguyen and Hongjo Kim
Pages 843-848 (2021 Proceedings of the 38th ISARC, Dubai, UAE, ISBN 978-952-69524-1-3, ISSN 2413-5844)
Abstract:

To evaluate the safety of construction site workers, deep learning models recognizing workers and safety equipment in construction site images are widely used. However, it is frequently observed that deep learning models based on supervised learning methods do not work well for unseen data in other domains having different visual characteristics. To address this issue, a novel method for generalizing semantic segmentation models was proposed. This method adopts two strategies: a domain adaptation method based on self-supervised learning and a copy-paste data augmentation. Source domain data with annotations (workers and hardhats) and target domain data without annotations are used for model training in a self-supervised learning scheme. The proposed model showed an improved generalization capability in semantic segmentation without annotation data of the target domain.

Keywords: Semantic segmentation; Domain adaptation; Self-supervised learning; Copy-paste data augmentation