Publications / 2019 Proceedings of the 36th ISARC, Banff, Alberta, Canada

Construction Data-Driven Dynamic Sound Data Training and Hardware Requirements for Autonomous Audio-based Site Monitoring

Yiyi Xie, Yong-Cheol Lee, Tallis Huther Da Costa, Jongyoon Park, Jayati H Jui, Jin Woo Choi and Zhongjie Zhang
Pages 1011-1017 (2019 Proceedings of the 36th ISARC, Banff, Alberta, Canada, ISBN 978-952-69524-0-6)

In a dynamic construction site, sound generated by work activities and equipment operations is one of vital field data indicating construction progress, work performance, and safety issues. However, because of an enormous number of construction work types, accurate sound classification is currently limited. To address this challenge, this study proposes a schedule-based sound classification for establishing dynamic sound training data. With the schedule-based dynamic training method, this system retrieves the types of sounds of daily planned construction activities for flexibly restricting training data types of working sounds and ultimately improving the accuracy of sound classification. To reveal the implications of audio-based construction activity detection and site monitoring frameworks, this study also involves the development of a construction sound library, a hardware system, a sound classification framework, and a web-based visualization method. This proposed method is expected to play a critical role in managing a construction project by supporting site monitoring and progress analysis, and safety surveillance.

Keywords: Schedule-based data training; Audio-based site monitoring; Audio sensor-based hardware system; Automated work activity surveillance; Machine Learning-based sound classification