One of the many ways in which automation may help the construction industry is on-site material management. This paper presents an automated process where materials are selected for staging by detecting construction progress from site images. The materials are then delivered to their re-spective workface locations by a robot. The effectiveness of the material selection process is assessed using a simulated and physical construction site. We demonstrate that our process is successful under a number of different conditions and environments. Our system contributes to the feasibility of autonomously managing materials on a construction site and reveals potential avenues for future research.