Construction safety has been a major area for research for an extensive time as the number of accidents, injuries and deaths has not significantly declined, despite strong implementation of safety laws and major efforts of the construction safety professionals. According to the Ministry of Employment and Labor, Korea (MOEL)  from 2012 to 2015 the Construction sector occupied the highest percentage of fatalities among all sectors in Korea. Automation of the inspection process of Temporary Safety Structures on Construction sites (TSSC) can reduce fatalities and injuries on work site. This research proposes a unique approach for the safety inspection of TSSC by using an outdoor marker-less AR system along with Structure from Motion (SfM) to reconstruct the 3DCG (3-Dimensional Computer Generated) models by using photographs from different viewpoints. The system(framework) considers area mobility of the inspector and his long relative distance, along with local feature-based image registration technology to target the location for Augmentation of 3DCG models of TSSC. This system would enhance the inspection, verification, and installation of the TSSC and help in ensuring worksite safety of all individuals involved in the construction development process. In future research, a case study would be conducted to confirm the implementation of this framework and integrate other areas for further development.