Abstract
Effective data and information management is one of the key factors to successful construction project management. However, in current practice, the data and information are hard to search, retrieve, and reuse by the project participants. As a representative example, a large number of as-constructed photos are taken during the construction phase for documentary purposes. They have great value in progress tracking, scheduling, and decision making when their contents and context are grasped and brought to field crews. Traditionally, the contents and context of the photos are manually grasped—a practice that is inefficient and is prone to errors—and results are not shared among project participants in time. A promising alternative is to register the photos to four-dimensional (4D) building information modeling (BIM) (three-dimensional BIM plus time) to identify BIM objects in the photo and retrieve their contents in digital form. This paper presents a method for automated registration of daily photos to 4D BIM and identification of BIM objects. Specifically, a content-based image retrieval approach was devised to find the closest photo-taken location by comparing photos with 4D BIM, and then a two-dimensional grid concept was used to extract BIM objects from the model that is associated with the photos. The method is demonstrated through the implementation of photos of a real construction project, and results illustrate that the method can find the closest photo-taken location and retrieve the contents and context of the given photos.
Get full access to this article
View all available purchase options and get full access to this article.
Acknowledgments
This research was funded by the National Science Foundation (NSF) via Grant CMMI-1462638. The authors gratefully acknowledge NSF’s support. Any opinions, findings, conclusions, and recommendations expressed in this paper are those of the authors and do not necessarily reflect the views of NSF or Purdue University.
References
Alshawi, M., and Ingirige, B. (2003). “Web-enabled project management: An emerging paradigm in construction.” Autom. Constr., 12(4), 349–364.
Amirshahi, S. A., Koch, M., Denzler, J., and Redies, C. (2012). “PHOG analysis of self-similarity in aesthetic images.” Proc., SPIE 8291, Human Vision and Electronic Imaging XVII, SPIE—International Society for Optics and Photonics, Bellingham, WA.
ArchiCAD version 19 [Computer software]. Graphisoft, Budapest, Hungary.
Bosch, A., Zisserman, A., and Munoz, X. (2007). “Representing shape with a spatial pyramid kernel.” Proc., 6th ACM Int. Conf. on Image and Video Retrieval (CIVR ’07), Association for Computing Machinery, New York.
Brilakis, I., Soibelman, L., and Shinagawa, Y. (2005). “Material-based construction site image retrieval.” J. Comput. Civ. Eng., 341–355.
Collins, J., and Okada, K. (2012). “A comparative study of similarity measures for content-based medical image retrieval.” Working Notes of Conf. and Labs of the Evaluation Forum (CLEF) 2012, Participative Research labOratory for Multimedia and Multilingual Information Systems Evaluation, Padova, Italy.
Computer Integrated Construction Research Group. (2010). BIM project execution planning guide version 2.0, Pennsylvania State Univ., State College, PA.
Dai, F., Lu, M., and Kamat, V. R. (2011). “Analytical approach to augmenting site photos with 3D graphics of underground infrastructure in construction engineering applications.” J. Comput. Civ. Eng., 66–74.
Dalal, N., and Triggs, B. (2005). “Histograms of oriented gradients for human detection.” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Vol. 1, IEEE, Piscataway, NJ, 886–893.
Dimitrov, A., and Golparvar-Fard, M. (2014). “Vision-based material recognition for automated monitoring of construction progress and generating building information modeling from unordered site image collections.” Adv. Eng. Inf., 28(1), 37–49.
Fierro-Radilla, A. N., Nakano-Miyatake, M., Perez-Daniel, K., Perez-Meana, H., Garcia-Ugalde, F., and Cedillo-Hernandez, M. (2015). “Image retrieval system based on combination of color, texture and shape features.” Proc., 7th Int. Conf. on Advances in Multimedia (MMEDIA 2015), International Academy, Research, and Industry Association, Wilmington, DE, 37–43.
Forcada, N., Casals, M., Roca, X., and Gangolells, M. (2007). “Adoption of web databases for document management in SMEs of the construction sector in Spain.” Autom. Constr., 16(4), 411–424.
Golparvar-Fard, M., Peña-Mora, F., Arboleda, C. A., and Lee, S. (2009a). “Visualization of construction progress monitoring with 4D simulation model overlaid on time-lapsed photographs.” J. Comput. Civ. Eng., 391–404.
Golparvar-Fard, M., Peña-Mora, F., and Savarese, S. (2009b). “D4AR—A 4-dimensional augmented reality model for automating construction progress monitoring data collection, processing and communication.” J. Inf. Technol. Constr., 14, 129–153.
Golparvar-Fard, M., Peña-Mora, F., and Savarese, S. (2012). “Automated progress monitoring using unordered daily construction photographs and IFC-based building information models.” J. Comput. Civ. Eng., 04014025.
Han, K. K., and Golparvar-Fard, M. (2015). “Appearance-based material classification for monitoring of operation-level construction progress using 4D BIM and site photologs.” Autom. Constr., 53, 44–57.
Hegazy, T., and Abdel-Monem, M. (2012). “Email-based system for documenting construction as-built details.” Autom. Constr., 24, 130–137.
Kim, C., Kim, B., and Kim, H. (2013). “4D CAD model updating using image processing-based construction progress monitoring.” Autom. Constr., 35, 44–52.
Kim, H., and Kano, N. (2008). “Comparison of construction photograph and VR image in construction progress.” Autom. Constr., 17(2), 137–143.
Lazebnik, S., Schmid, C., and Ponce, J. (2006). “Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories.” IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, Vol. 2, IEEE, Piscataway, NJ, 2169–2178.
LIRE. (2017). “LIRE: Lucene image retrieval.” ⟨http://www.lire-project.net⟩ (Feb. 28, 2017).
Liu, J., Li, Z., Tang, J., Jiang, Y., and Lu, H. (2014). “Personalized geo-specific tag recommendation for photos on social websites.” IEEE Trans. Multimedia, 16(3), 588–600.
Lux, M., and Chatzichristofis, S. A. (2008). “LIRE: Lucene image retrieval—An extensible Java CBIR library.” Proc., 16th Int. Conf. on Multimedia 2008, Association for Computing Machinery, New York, 1085–1088.
Lux, M., and Marques, O. (2013). “Visual information retrieval using Java and LIRE.” Synth. Lect. Inf. Concepts Retrieval Serv., 5(1), 1–112.
Manjunath, B. S., Ohm, J., Vasudevan, V. V., and Yamada, A. (2001). “Color and texture descriptors.” IEEE Trans. Circuits Syst. Video Technol., 11(6), 703–715.
Martínez-Rojas, M., Marín, N., and Vila, M. A. (2016). “The role of information technologies to address data handling in construction project management.” J. Comput. Civ. Eng., 04015064.
Navisworks [Computer software]. Autodesk, San Rafael, CA.
Park, J., and Cai, H. (2017a). “Framework for automated as-built photo contents and context retrieval using 4D BIM.” CSCE 2017 Annual Conf., Canadian Society for Civil Engineering, Montréal.
Park, J., and Cai, H. (2017b). “WBS-based dynamic multi-dimensional BIM database for total construction as-built documentation.” Autom. Constr., 77, 15–23.
Park, J., Cai, H., Dunston, P. S., and Ghasemkhani, H. (2017). “Database-supported and web-based visualization for daily 4D BIM.” J. Constr. Eng. Manage., 04017078.
Patil, S., and Talbar, S. (2012). “Content based image retrieval using various distance metrics.” Data Eng. Manage., 6411, 154–161.
Prajapati, N., Nandanwar, A. K., and Prajapati, G. S. (2016). “Edge histogram descriptor, geometric moment and Sobel edge detector combined features based object recognition and retrieval system.” Int. J. Comput. Sci. Inf. Technol., 7(1), 407–412.
Rankohi, S., and Waugh, L. (2013). “Review and analysis of augmented reality literature for construction industry.” Visual. Eng., 1(1), 1–9.
Rankohi, S., and Waugh, L. (2014). “Image-based modeling approaches for projects status comparison.” CSCE 2014 General Conf., Canadian Society for Civil Engineering, Montréal.
Revit. [Computer software]. Autodesk, San Rafael, CA.
Roh, S., Aziz, Z., and Peña-Mora, F. (2011). “An object-based 3D walk-through model for interior construction progress monitoring.” Autom. Constr., 20(1), 66–75.
Sidhu, S., and Saxena, J. (2015). “Content based image retrieval: A review.” Int. J. Res. Comput. Appl. Rob., 3(5), 84–88.
Son, H., and Kim, C. (2010). “3D structural component recognition and modeling method using color and 3D data for construction progress monitoring.” Autom. Constr., 19(7), 844–854.
Staub-French, S., and Khanzode, A. (2007). “3D and 4D modeling for design and construction coordination: Issues and lessons learned.” J. Inf. Technol. Constr., 12, 381–407.
Wu, F. (2009). “Visualizing things in construction photos: Time, spatial coverage, and content for construction management.” Master thesis, Univ. of Victoria, Victoria, BC, Canada.
xBIM Toolkit. (2017). “The eXtensible building information modelling (xBIM) toolkit.” ⟨https://xbim.codeplex.com/⟩ (Aug. 14, 2017).
Information & Authors
Information
Published In
Journal of Computing in Civil Engineering
Volume 32 • Issue 2 • March 2018
Copyright
©2017 American Society of Civil Engineers.
History
Received: Apr 27, 2017
Accepted: Aug 22, 2017
Published online: Dec 16, 2017
Published in print: Mar 1, 2018
Discussion open until: May 16, 2018
Authors
Metrics & Citations
Metrics
Citations
Download citation
If you have the appropriate software installed, you can download article citation data to the citation manager of your choice. Simply select your manager software from the list below and click Download.