Acessibilidade / Reportar erro

UAV-based inspection of bridge and tunnel structures: an application review

Inspeção de estruturas de pontes e túneis baseada em VANTs: uma revisão das aplicações

abstract:

Bridges and tunnels are large and complex structures that demand periodic inspections to assess their physical conditions. Although both have different designs and constructions from each other, a common problem they share is the drawbacks that their conventional inspections face. Moreover, conventional procedures not only are laborious, time-consuming, and costly, but also involve high and/or hard-to-reach places, often exposing the specialized inspectors to danger. To overcome these problems, the Unmanned Aerial Vehicle (UAV) is being explored to automate these inspections. Recently, the number of researches employing it within the civil infrastructure condition assessment has been growing in recent years, especially for the inspection of large and complex structures. Unlike the UAV-based bridge inspection that already has some review articles available in the literature, there are none yet for the tunnel inspection, to the best of authors' knowledge. Therefore, this article intends to conduct not only a review of the few UAV-based tunnel inspection researches available in the literature, but also an up-to-date review of UAV-based bridge inspection researches. Finally, the key challenges and future trends of the UAV-based inspection of these two structures are discussed, followed by the review conclusions.

Keywords:
unmanned aerial vehicle; bridge; tunnel; inspection; applications

resumo:

Pontes e túneis são estruturas complexas e largas que exigem inspeções periódicas para avaliar suas condições físicas. Embora ambos possuam projetos e construções diferentes entre si, um problema comum que eles compartilham são as desvantagens que suas inspeções convencionais enfrentam. Além disso, procedimentos convencionais não só são trabalhosos, demorados e dispendiosos, mas também envolvem lugares altos e/ou de difícil acesso, muitas vezes expondo os inspetores especializados a perigos. Para superar estes problemas, o Veículo Aéreo Não Tripulado (VANT) está sendo explorado para automatizar essas inspeções. Recentemente, o número de pesquisas que o empregam na avaliação da condição de infraestruturas civis vem crescendo nos últimos anos, especialmente para a inspeção de estruturas complexas e largas. Ao contrário da inspeção de pontes com VANT que já possui alguns artigos de revisão disponíveis na literatura, não há nenhum ainda para a inspeção de túneis com VANT, até onde os autores saibam. Portanto, este artigo pretende conduzir não somente uma revisão das poucas pesquisas disponíveis na literatura sobre inspeção de túneis com VANT, como também uma revisão atualizada das pesquisas sobre inspeção de pontes com VANT. Finalmente, os principais desafios e as tendências futuras da inspeção com VANT dessas duas estruturas são discutidas, seguidas das conclusões da revisão.

Palavras-chave:
veículo aéreo não tripulado; ponte; túnel; inspeção; aplicações

1 INTRODUCTION

Bridges and tunnels are often complex large structures that demand specialized inspectors to perform their inspection and assessment in a nondestructive way, which are performed on-site by visual and physical measurement approaches, whose employment depends on the bridge/tunnel type and the material of its structure.

The visual inspection is the predominant non-contact approach used for these structures, as it will at first indicate any visual changes in their surface, such as the crack existence, which is a primary key sign of a structure failure [11 B. M. Phares, D. D. Rolander, B. A. Graybeal, and G. A. Washer, "Reliability of visual bridge inspection,” Public Roads, vol. 64, no. 5, pp. 22–29, 2001. Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/683631.https://trid.trb.org/view/683631
https://trid.trb.org/view/683631.https:/...
], [22 S. Stent, R. Gherardi, B. Stenger, K. Soga, and R. Cipolla, "Visual change detection on tunnel linings," Mach. Vis. Appl., vol. 27, no. 3, pp. 319–330, 2016, http://dx.doi.org/10.1007/s00138-014-0648-8.
http://dx.doi.org/10.1007/s00138-014-064...
]. As its name says, the structure condition is visually reviewed on-site by the inspector, who will register any visual changes with images taken by a camera.

Other approach examples are the acoustic inspection, where hammers or chains are used to detect delamination or hollow areas in concrete components by analyzing the sound changes across its surface; and the infrared (IR)/thermal imaging inspection, or also referred to as infrared thermography (IRT), which may also be used to detect these defects and indicate material degradation by analyzing the infrared radiation changes along the concrete surface, collected by an IR thermal camera.

Regulations and practices vary worldwide, but for example, the manual bridge inspection in the U.S., administered and regulated by Federal Highway Administration (FHWA), usually requires a local traffic control, where the inspectors need to coordinate an inspection date with the traffic controller in order to ensure safety precautions. It is executed by 2 or 3 inspectors on average, depending on the length and complexity of the bridge, where they visually examine all the components by eyesight and prior experience to look for any defects, flaws or potential problem areas that require maintenance [33 A. Zulifqar, M. Cabieses, A. Mikhail, and N. Khan, Design of a Bridge Inspection System (BIS) to Reduce Time and Cost. Farifax, VA, USA: George Mason Univ., 2014.]. If any of these failures are identified, they are registered by pictures taken during the visual inspection and a physical inspection with equipment or tools is performed afterwards to quantify the damage. The FHWA requires each bridge to be inspected in a biennial routine, unless that the bridge is rated as structurally deficient, then it is recommended at least an annual routine.

This bridge conventional inspection procedure faces some drawbacks, being the main ones listed below:

  • existence of inaccessible areas, usually at height;

  • high-costly, as generally requires heavy machinery rental (usually aerial work platforms) to provide temporary access to these areas, in addition to affect the local traffic, as it may require lane closures in the highway bridge/tunnel cases;

  • laborious, demanding a great effort from the inspectors to get near some hard-to-reach places;

  • dangerous, exposing the inspectors to high and complex places, besides the weather conditions and local environment (as gale, dust, and the nearness of water environment, e.g., above lakes and rivers);

  • time-consuming task, since these structures are usually large and complex.

In addition, its inspection results are subjective (dependent on the inspector’s knowledge and experience), yielding to low reliability due to possible inaccuracies and failing defect detection [44 B. A. Graybeal, B. M. Phares, D. D. Rolander, M. Moore, and G. Washer, "Visual inspection of highway bridges," J. Nondestruct. Eval., vol. 21, no. 3, pp. 67–83, 2002, http://dx.doi.org/10.1023/A:1022508121821.
http://dx.doi.org/10.1023/A:102250812182...
]. It is worth noting that tunnel conventional inspection procedure face pretty much these same drawbacks.

To deal with them, some solutions are being explored in the literature and applied to aid or even replace some manual activities within the conventional inspection. One of them that is getting more attention is the use of Unmanned Aerial Vehicles (UAVs).

Although some reviews involving the UAV-based bridge inspection topic are already available in the literature, some of them explore a wider area within the civil infrastructure. In contrast, this article not only intends to provide an extensive up-to-date survey focused on previous works that explored the use of UAVs for bridge inspection, including both non-contact and contact based methods, but also includes the UAV-based tunnel inspection topic, about which there is no literature review available yet, to the best of authors’ knowledge.

Considering all the above statements, the key goals of this review article are as follows:

  1. 1

    To review the researches of bridge and tunnel inspections using UAVs, where the main applications are identified.

  2. 2

    To identify the best practices and solutions to address the UAV-based inspection of this kind of structures.

  3. 3

    To update this topic by presenting emerging commercial off-the-shelf (COTS) UAVs that are promising and have not yet been considered in the literature.

  4. 4

    To provide both current key challenges and potential future trends of the UAV-based research in bridge and tunnel inspections.

Totally, 142 literature documents (including journal/conference papers, master's/PhD theses, technical reports, to name a few) were compiled (retrieved mainly from Web of Science, ScienceDirect, and Google Scholar databases, considering a publication year period of 2000 to 2021), being 132 related to bridge topic and 10 to tunnel. Their year of publication are gathered in a clustered bar chart (Figure 1), showing that there was a large increase of published documents from 2018 onward, indicating a growing interest on UAV employment for inspection of these large structures and its importance in the civil infrastructure field.

Figure 1
Number of documents published through the years concerning bridge and tunnel inspections using UAVs.

2 UAV EMPLOYMENT IN LARGE STRUCTURE INSPECTIONS

Besides the usual expressions “UAV” and “drone”, there are also other correlated expressions found in the literature, as “Micro Aerial Vehicle” (MAV) and “Unmanned Aerial System” (UAS), this latter being usually composed of an UAV with its payload (the equipment it carries) and the ground control system, accordingly to the Unmanned Aerial Vehicle System Association (UAVSA) [55 S. Dorafshan and M. Maguire, "Bridge inspection: human performance, unmanned aerial systems and automation," J. Civ. Struct. Health Monit., vol. 8, no. 3, pp. 443–476, 2018, http://dx.doi.org/10.1007/s13349-018-0285-4.
http://dx.doi.org/10.1007/s13349-018-028...
]. These expressions will be used accordingly to those adopted in each cited reference.

The use of UAVs, especially the multi-rotor types, bring some advantages over the conventional inspection procedure:

  • it is safer, as the UAV operator control it remotely in a near safe place, together with the specialized inspector that can conduct the inspection by monitoring the UAV video broadcast or by accessing the collected images/videos later on a device (pc, tablet, to name a few);

  • offers more accessibility, since the UAV can easily access hard-to-reach places when compared to the conventional procedure;

  • has a relatively lower cost, as UAVs are compact, portable, and low-priced devices in contrast to the rented heavy machinery, as well as the indirect savings, such as the cost reduction associated with traffic control (e.g., lessened lane closure during highway bridge/tunnel inspection, especially the high traffic ones);

  • yields reduced time inspection, due to the UAVs high mobility.

Although the research publications concerning the use of UAVs for bridge inspection begin in 2014, as stated in Figure 1, there are other few documents that were previously published, e.g.:

  • Metni and Hamel [66 N. Metni and T. Hamel, "A UAV for bridge inspection: Visual servoing control law with orientation limits," Autom. Construct., vol. 17, no. 1, pp. 3–10, 2007, http://dx.doi.org/10.1016/j.autcon.2006.12.010.
    http://dx.doi.org/10.1016/j.autcon.2006....
    ], in 2007, that was the first step towards the UAV-based bridge inspection. It evaluated an UAV dynamics for structure monitoring and bridge maintenance, where a control scheme was developed for it under some practical restrictions, and validated the concept of inspecting bridge defects with an UAV equipped with a visual device in an on-site experiment using a small helicopter that flew around a viaduct, in France, while taking a video sequence, from which some pictures have been extracted and presented to bridge inspection experts for evaluation;

  • and Moller [77 P. S. Moller, CALTRANS Bridge Inspection Aerial Robot |(Tech. Rep. CA 08-0182). Sacramento, CA: California Dept. Transp., 2008. Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/917744
    https://trid.trb.org/view/917744...
    ], in 2008, that developed a twin-motor aerial robot called “Aerobot” to carry video cameras up to approximately 61m height to perform close inspection of elevated highway structures (including bridges), but due to some implementation issues, the device was not deployed within the schedule and the project was terminated.

Meanwhile, the UAV technology has had a major breakthrough, especially the multi-rotor types, which are more stable and produce less vibration when compared to single-rotor helicopters [88 C. Brooks et al., Evaluating the Use of Unmanned Aerial Vehicles for Transportation Purposes (Tech. Rep. RC-1616). Lansing, MI: Michigan Dept. Transp., 2014, Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/1352503
https://trid.trb.org/view/1352503...
], being them essential features to collect high quality images.

This way, it was in 2014 that Brooks et al. [88 C. Brooks et al., Evaluating the Use of Unmanned Aerial Vehicles for Transportation Purposes (Tech. Rep. RC-1616). Lansing, MI: Michigan Dept. Transp., 2014, Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/1352503
https://trid.trb.org/view/1352503...
] and Hallermann and Morgenthal [99 N. Hallermann and G. Morgenthal, “Visual inspection strategies for large bridges using unmanned aerial vehicles (UAV),” in Proc. 7th Int. Conf. Bridge Maint., Saf. Manage. (IABMAS), Shanghai, China, 2014, pp. 661–667.] demonstrated the multi-rotor UAV capability for large structure inspections in civil engineering field, where all the aforementioned advantages (over the conventional procedure) were also stated. Brooks et al. [88 C. Brooks et al., Evaluating the Use of Unmanned Aerial Vehicles for Transportation Purposes (Tech. Rep. RC-1616). Lansing, MI: Michigan Dept. Transp., 2014, Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/1352503
https://trid.trb.org/view/1352503...
] used a 6-rotor UAV (Bergen hexacopter), mounted with a Nikon D800 camera and a FLIR Tau 2 IR camera, to analyze two overpass bridges in Livonia, Michigan, whose presented significant structural defects (i.e., spall, crack, and delamination); and Hallermann and Morgenthal [99 N. Hallermann and G. Morgenthal, “Visual inspection strategies for large bridges using unmanned aerial vehicles (UAV),” in Proc. 7th Int. Conf. Bridge Maint., Saf. Manage. (IABMAS), Shanghai, China, 2014, pp. 661–667.] tested an 8-rotor UAV (AscTec Falcon 8), equipped with two cameras (Sony NEX-5 and Panasonic Lumix TZ22), to inspect an 80m long concrete arch bridge, whose arch is approx. 40m high, showing that it was possible to fly at short distance from its structure, even at high heights, although the wind played the major role together with the changing lighting conditions along the structure.

After this, the UAV potential for visual inspection assistance became more and more clear as reported in the literature, e.g., Otero et al. [1010 L. D. Otero, N. Gagliardo, D. Dalli, W.-H. Huang, and P. Cosentino, Proof of Concept for Using Unmanned Aerial Vehicles for High Mast Pole and Bridge Inspections (Tech. Rep. BDV28-TWO-977-02). Tallahassee, FL: Florida Dept. Transp., Res. Center, 2015, http://dx.doi.org/10.13140/RG.2.1.4567.2166.
http://dx.doi.org/10.13140/RG.2.1.4567.2...
] showed that the collected images from the UAS, during field tests, and by inspectors, during previous inspections, were of similar quality, and Seo et al. [1111 J. Seo, L. Duque, and J. Wacker, “Glued-laminated timber arch bridge inspection using UAV,” in Comput. Civ. Eng. 2019: Smart Cities, Sustainability, and Resilience, Reston, 2019, pp. 336–342.] demonstrated that the UAV-enabled inspection of an arch timber stringer bridge provided results almost identical to the conventional inspection report.

Furthermore, recent researches are also exploring the application of the UAV system for contact based inspection procedures, which brings additional challenges involving the development of inspection devices, and the UAV control, once it might interact with the target structure, generating a complex dynamic for the UAV stabilization.

In the following, all these applications are presented through the reviewed documents, which were separated into the tunnel topic (Section 3) and the bridge topic (Section 4).

3 UAV-BASED TUNNEL INSPECTION

Although UAV application for tunnel inspections is still unusual (due to the main issues of this kind of environment, e.g., lack of both lighting and global positioning system (GPS) signal), as demonstrated by the lower number of published documents, it has potential since it avoids the mobility limitations [1212 R. Montero, J. G. Victores, S. Martínez, A. Jardón, and C. Balaguer, "Past, present and future of robotic tunnel inspection," Autom. Construct., vol. 59, pp. 99–112, 2015, http://dx.doi.org/10.1016/j.autcon.2015.02.003.
http://dx.doi.org/10.1016/j.autcon.2015....
] as recent technology innovations on UAVs and photographic equipment are continuously being introduced to the field [1313 L. Attard, C. J. Debono, G. Valentino, and M. Di Castro, "Tunnel inspection using photogrammetric techniques and image processing: A review," ISPRS J. Photogramm. Remote Sens., vol. 144, pp. 180–188, 2018, http://dx.doi.org/10.1016/j.isprsjprs.2018.07.010.
http://dx.doi.org/10.1016/j.isprsjprs.20...
], allowing a faster inspection performance, which will be required in the future [1414 Y. Xue, S. Zhang, M. Zhou, and H. Zhu, "Novel SfM-DLT method for metro tunnel 3D reconstruction and visualization," Undergr. Space, vol. 6, no. 2, pp. 134–141, 2021, http://dx.doi.org/10.1016/j.undsp.2020.01.002.
http://dx.doi.org/10.1016/j.undsp.2020.0...
].

A common characteristic found in these few UAV-based tunnel inspection documents is that all of them used custom-built UAVs, needed to overcome the aforementioned issues, e.g., developed UAVs mounted with light detection and ranging (LiDAR), multiple/rotating camera system, lighting source, and GPS-free navigation system. Their information is briefly described in Table 1.

Table 1
UAV-based tunnel inspection research efforts.

Among them, only Iwamoto et al. [1818 T. Iwamoto, T. Enaka, and K. Tada, "Development of testing machine for tunnel inspection using multi-rotor UAV," J. Phys. Conf. Ser., vol. 842, no. 1, pp. 012068, 2017, http://dx.doi.org/10.1088/1742-6596/842/1/012068.
http://dx.doi.org/10.1088/1742-6596/842/...
] focused their UAV development research for a contact based inspection (impact acoustic method), while the other authors regarded the camera-based visual inspection [1616 T. Özaslan et al., "Towards fully autonomous visual inspection of dark featureless dam penstocks using MAVs,” in 2016 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Daejeon, Korea, 2016, pp. 4998–5005.], [2020 T. Hongyu, “Inspection of human inaccessible tunnel using unmanned aerial vehicle,” M.S. thesis, Dept. Elect. Comput. Eng., Nat. Univ. Singap., Singapore, 2018.]–[2222 R. S. Pahwa, K. Y. Chan, J. Bai, V. B. Saputra, M. N. Do, and S. Foong, “Dense 3D reconstruction for visual tunnel inspection using unmanned aerial vehicle,” in 2019 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Macau, China, 2019, pp. 7025–7032.], [2424 C. Feng, H. Zhang, Y. Li, S. Wang, and H. Wang, "Efficient real-time defect detection for spillway tunnel using deep learning," J. Real-Time Image Process., vol. 18, no. 6, pp. 1–11, 2021, http://dx.doi.org/10.1007/s11554-021-01130-x.
http://dx.doi.org/10.1007/s11554-021-011...
] and concerned the UAV positioning/localization and/or environment mapping, based on LiDAR [1515 T. Özaslan, S. Shen, Y. Mulgaonkar, N. Michael, and V. Kumar, “Inspection of penstocks and featureless tunnel-like environments using micro UAVs,” in Field and Service Robotics, L. Mejias, P. Corke, and J. Roberts, Eds., Cham: Springer International Publishing, 2015, pp. 123–136, http://dx.doi.org/10.1007/978-3-319-07488-7_9.
http://dx.doi.org/10.1007/978-3-319-0748...
], [1717 T. Özaslan et al., "Autonomous navigation and mapping for inspection of penstocks and tunnels with MAVs," IEEE Robot. Autom. Lett., vol. 2, no. 3, pp. 1740–1747, 2017, http://dx.doi.org/10.1109/LRA.2017.2699790.
http://dx.doi.org/10.1109/LRA.2017.26997...
], [1919 C. H. Vong, R. Ravitharan, P. Reichl, J. Chevin, and H. Chung, “Small scale unmanned aerial system (UAS) for railway culvert and tunnel inspection,” in ICRT 2017: Railway Develop., Operations, Maint., Reston, VA, 2018, pp. 1024–1032, http://dx.doi.org/10.1061/9780784481257.102.
http://dx.doi.org/10.1061/9780784481257....
], [2323 S. S. Mansouri, C. Kanellakis, D. Kominiak, and G. Nikolakopoulos, "Deploying MAVs for autonomous navigation in dark underground mine environments," Robot. Auton. Syst., vol. 126, pp. 103472, 2020, http://dx.doi.org/10.1016/j.robot.2020.103472.
http://dx.doi.org/10.1016/j.robot.2020.1...
].

4 UAV-BASED BRIDGE INSPECTION

Regarding now the UAVs used for bridge inspections in the literature, they can be divided into three groups: 1) the literature review articles, 2) the ones that made initial evaluation studies of the topic (or were at early research stage), and 3) the ones that performed case studies with practical tests.

Beginning with the review papers, nine addressed literature reviews involving UAV-based bridge inspections:

  • Dorafshan and Maguire [55 S. Dorafshan and M. Maguire, "Bridge inspection: human performance, unmanned aerial systems and automation," J. Civ. Struct. Health Monit., vol. 8, no. 3, pp. 443–476, 2018, http://dx.doi.org/10.1007/s13349-018-0285-4.
    http://dx.doi.org/10.1007/s13349-018-028...
    ] presented the state of practice for the U.S. bridge inspection programs, where the autonomous navigation, 3D model reconstruction, and automated damage inspection were some of the covered topics, together with a summary of both U.S. Department of Transportation (DOT) investigations and the Federal Aviation Administration regulations on UASs. It concluded that despite the existing challenges involving UAS-assisted bridge inspections, it has the potential to improve inspection accuracy at a relatively lower cost;

  • Duque et al. [2525 L. Duque, J. Seo, and J. Wacker, "Synthesis of unmanned aerial vehicle applications for infrastructures," J. Perform. Constr. Facil., vol. 32, no. 4, pp. 04018046, 2018, http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001185.
    http://dx.doi.org/10.1061/(ASCE)CF.1943-...
    ] provided a review on visual inspection, monitoring, and analysis of infrastructure using UAVs, where the bridge inspection topic was also summarized. It concluded from the findings that the UAV results are satisfactory, leading to a more efficient visual inspection in a lower time when compared with the conventional inspection procedure;

  • Agnisarman et al. [2626 S. Agnisarman, S. Lopes, K. Chalil Madathil, K. Piratla, and A. Gramopadhye, "A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection," Autom. Construct., vol. 97, pp. 52–76, 2019, http://dx.doi.org/10.1016/j.autcon.2018.10.019.
    http://dx.doi.org/10.1016/j.autcon.2018....
    ] reviewed literature publications that investigated automated visual inspection technologies applied for civil infrastructures, including the UAV-based bridge inspection. It identified that the inspection of bridges is the most frequently addressed domain among the automation-assisted inspection applications (20 of 53 reviewed studies), reflecting the importance of its structure maintenance and repair;

  • Greenwood et al. [2727 W. W. Greenwood, J. P. Lynch, and D. Zekkos, "Applications of UAVs in civil infrastructure," J. Infrastruct. Syst., vol. 25, no. 2, pp. 04019002, 2019, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000464.
    http://dx.doi.org/10.1061/(ASCE)IS.1943-...
    ] summarized the UAV development efforts on civil infrastructure applications, where one of the discussed topics was the key cases of UAVs being used in bridge inspection and monitoring. It stated that, among the civil infrastructure monitoring, bridge inspection is the most widely approached topic for UAV integration;

  • Sony et al. [2828 S. Sony, S. Laventure, and A. Sadhu, "A literature review of next-generation smart sensing technology in structural health monitoring," Struct. Contr. Health Monit., vol. 26, no. 3, e2321, 2019, http://dx.doi.org/10.1002/stc.2321.
    http://dx.doi.org/10.1002/stc.2321...
    ] presented a review of next-generation smart sensing technology (such as UAVs, robotic sensors, cameras, and smartphones) applied for structural health monitoring, where the bridge inspection topic was discussed within the UAV-based literature section;

  • Ahmed et al. [2929 H. Ahmed, H. M. La, and N. Gucunski, "Review of non-destructive civil infrastructure evaluation for bridges: State-of-the-art robotic platforms, sensors and algorithms," Sens., vol. 20, no. 14, pp. 3954, 2020, http://dx.doi.org/10.3390/s20143954.
    http://dx.doi.org/10.3390/s20143954...
    ] examined recent developments in autonomous robotic platforms for NDE and structural health monitoring of bridges, where UAV-based non-destructive inspections were addressed. It stated that it is a relatively new field of research, where its flexibility and versatility need to be exploited in order to access and monitor the distinct bridge infrastructure parts;

  • Outay et al. [3030 F. Outay, H. A. Mengash, and M. Adnan, "Applications of unmanned aerial vehicle (UAV) in road safety, traffic and highway infrastructure management: recent advances and challenges," Transp. Res. Part A Policy Pract., vol. 141, pp. 116–129, 2020, http://dx.doi.org/10.1016/j.tra.2020.09.018.
    http://dx.doi.org/10.1016/j.tra.2020.09....
    ] concerned three major domains of transportation: road safety, traffic monitoring, and highway infrastructure management; where the advancements of key feature extraction from UAV collected images/videos by computer vision algorithms were addressed. Within the highway infrastructure management topic, some research efforts that used UAVs for bridge inspection and monitoring were briefly summarized;

  • Jeong et al. [3131 E. Jeong, J. Seo, and J. Wacker, "Literature review and technical survey on bridge inspection using unmanned aerial vehicles," J. Perform. Constr. Facil., vol. 34, no. 6, pp. 04020113, 2020, http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001519.
    http://dx.doi.org/10.1061/(ASCE)CF.1943-...
    ] summarized the literature central findings on UAV techniques for bridge inspection and damage quantification, where both conventional UAV-enabled visual inspection and damage detection algorithm studies were briefly described. It concluded that UAV can be considered for bridge inspection as a feasible and efficient tool, and a continued interest in it is expected;

  • and Feroz and Abu Dabous [3232 S. Feroz and S. Abu Dabous, "Uav-based remote sensing applications for bridge condition assessment," Remote Sens., vol. 13, no. 9, pp. 1809, 2021, http://dx.doi.org/10.3390/rs13091809.
    http://dx.doi.org/10.3390/rs13091809...
    ] conducted a review of UAV applications in bridge condition monitoring, based on remote sensing technologies (such as LiDAR, IR and visual imagery, in addition to other sensors), where sixty-five journal and conference papers were compiled and summarized. It concluded that the use of UAVs improved the cost efficiency and accessibility, while reducing safety hazards and avoiding traffic closures during the inspection process.

Within the group that made initial evaluation studies, composed of [3333 Z. Yin, A Quadcopter with Heterogeneous Sensors for Autonomous Bridge Inspection (Tech. Rep. 25-1121-0003-197). Lincoln, NE: Mid-America Transp. Center, 2014. [Online]. Available: https://trid.trb.org/view/1331073
https://trid.trb.org/view/1331073...
]–[4242 S. HekmatiAthar, N. Goudarzi, A. Karimoddini, A. Homaifar, and D. Divakaran, “A systematic evaluation and selection of UAS-enabled solutions for bridge inspection practices,” in 2020 IEEE Aerosp. Conf., Big Sky, MT, USA, 2020, pp. 1–11, http://dx.doi.org/10.1109/AERO47225.2020.9172795.
http://dx.doi.org/10.1109/AERO47225.2020...
], although they were at early stage from a practical point of view, some important details were discussed, such as the necessary specifications and payloads of the UAV, the flight mission planning considerations (including the on-site risk evaluation, the protocols to be followed by the operator, and the bridge data collection), together with the main advantages and challenges of the UAV-based bridge inspection applications.

Lastly, considering the ones that performed practical inspection tests, the used UAVs were identified and listed in Table 2, together with their models, approximate flight time (depending on the UAV series model, its payload, battery lifetime, and environmental conditions, as temperature and weather), and the used cameras.

Table 2
UAVs used for bridge inspection found in the literature.

One can see from Table 2 that the COTS DJI models [152152 DJI Official. https://www.dji.com (accessed Sept. 21, 2021).
https://www.dji.com...
] are predominant in the applications, together with the custom-built ones, whose were developed by researches within academic institutions or by collaborating companies, not to mention the UAVs that were not specified in their papers.

These UAV applications can be divided into two main groups, the non-contact and contact based methods, described in the sequence.

4.1 Non-contact based inspection applications

The majority of the applications, listed in Table 2, are non-contact based methods, where the predominant one is the visual imagery, which consists in acquiring images, videos, and other visual information. Within it, there are two main approaches: the visual and the infrared inspections.

4.1.1 Visual inspection applications

In the visual inspection, considering the UAV application, the inspector search for any visual structural changes in the images/videos collected by the UAV cameras, either on-site or later in a device. Although this type of application has all the UAV benefits listed in Section 2, the defect detection still relies on the specialized inspectors, whose similar subjective and inaccurate results from the conventional procedure still remain unsolved. Another method used to tackle this problem is the automatic inspection (or the term “vision” is also commonly used), where image processing techniques are specifically developed to detect and/or identify the structural defects in the images/videos collected by the UAV cameras.

All these visual inspection applications are listed in Table 3, where they are separated within the structure material of the bridge and their related defect types.

Table 3
Structural defect detection researches in UAV-based bridge visual inspection applications.

It can be seen that the most explored defect type:

  • in concrete structures is the crack, as expected, since it is the main visual warning for a possible failure;

  • and in steel structures is the corrosion, as it is one of the main defects that arise in this type of material due to its exposure to environmental conditions (as temperature and humidity, to name a few);

and the most employed technique within the automatic inspection is the deep learning, whose popularity in the literature has been increasing due to its advantages, such as the simultaneous detection of multiple different defect types, e.g., [6060 J. J. Lin, A. Ibrahim, S. Sarwade, and M. Golparvar-Fard, "Bridge inspection with aerial robots: Automating the entire pipeline of visual data capture, 3D mapping, defect detection, analysis, and reporting," J. Comput. Civ. Eng., vol. 35, no. 2, pp. 04020064, 2021, http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000954.
http://dx.doi.org/10.1061/(ASCE)CP.1943-...
], [100100 R. Ali, D. Kang, G. Suh, and Y.-J. Cha, "Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures," Autom. Construct., vol. 130, pp. 103831, 2021, http://dx.doi.org/10.1016/j.autcon.2021.103831.
http://dx.doi.org/10.1016/j.autcon.2021....
], [108108 X. Peng, X. Zhong, C. Zhao, Y. F. Chen, and T. Zhang, "The feasibility assessment study of bridge crack width recognition in images based on special inspection UAV," Adv. Civ. Eng., vol. 2020, pp. 1–17, 2020., http://dx.doi.org/10.1155/2020/8811649.
http://dx.doi.org/10.1155/2020/8811649...
], [115115 S. Yoon, G.-H. Gwon, J.-H. Lee, and H.-J. Jung, "Three-dimensional image coordinate-based missing region of interest area detection and damage localization for bridge visual inspection using unmanned aerial vehicles," Struct. Health Monit., vol. 20, no. 4, pp. 1462–1475, 2021, http://dx.doi.org/10.1177/1475921720918675.
http://dx.doi.org/10.1177/14759217209186...
], [150150 J. Dang and P. Chun, "Mixed training of deep convolutional neural network for bridge deterioration detection with UAV and inspection report sourced images,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations. CRC Press, 2021, pp. 308–312.].

Despite the defect detection/identification, there are other UAV applications for aiding visual inspection, such as 3D reconstructions [4343 J. Wells and B. Lovelace, Improving the Quality of Bridge Inspections Using Unmanned Aircraft Systems (UAS) (Tech. Rep. MN/RC 2018-26). St. Paul, MN: Minnesota Dept. Transp., 2018. [Online]. Available: https://trid.trb.org/view/1539868
https://trid.trb.org/view/1539868...
], [4545 M. N. Gillins, “Unmanned aircraft systems for bridge inspection: testing and developing end-to-end operational workflow,” M.S. thesis, Oregon State Univ., Corvallis, OR, USA, 2016. [Online]. Available: http://hdl.handle.net/1957/60001
http://hdl.handle.net/1957/60001...
], [4848 S. Dorafshan, M. Maguire, N. V. Hoffer, and C. Coopmans, Fatigue Crack Detection Using Unmanned Aerial Systems in Under-Bridge Inspection (Tech. Rep. FHWA-ITD-17-256). Boise, Idaho: Idaho Transp. Dept., 2017.], [5050 B. J. Perry, “Streamlined bridge inspection framework utilizing unmanned aerial vehicles (UAVs),” M.S. thesis, Dept. Civ. Environ. Eng., Colorado State Univ., Fort Collins, CO, USA, 2019. [Online]. Available: https://hdl.handle.net/10217/197417
https://hdl.handle.net/10217/197417...
], [5151 B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning," Meas., vol. 164, pp. 108048, 2020, http://dx.doi.org/10.1016/j.measurement.2020.108048.
http://dx.doi.org/10.1016/j.measurement....
], [5555 B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Unmanned aerial vehicle (UAV)-enabled bridge inspection framework,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations, H. Yokota and D.M. Frangopol, Eds., London: CRC Press, 2021, pp. 158–165.], [6060 J. J. Lin, A. Ibrahim, S. Sarwade, and M. Golparvar-Fard, "Bridge inspection with aerial robots: Automating the entire pipeline of visual data capture, 3D mapping, defect detection, analysis, and reporting," J. Comput. Civ. Eng., vol. 35, no. 2, pp. 04020064, 2021, http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000954.
http://dx.doi.org/10.1061/(ASCE)CP.1943-...
], [6666 S. Chen, D. F. Laefer, E. Mangina, S. M. I. Zolanvari, and J. Byrne, "UAV bridge inspection through evaluated 3D reconstructions," J. Bridge Eng., vol. 24, no. 4, pp. 05019001, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001343.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
], [7070 E. Ciampa, L. D. Vito, and M. R. Pecce, "Practical issues on the use of drones for construction inspections," J. Phys. Conf. Ser., vol. 1249, no. 1, pp. 012016, May 2019, http://dx.doi.org/10.1088/1742-6596/1249/1/012016.
http://dx.doi.org/10.1088/1742-6596/1249...
], [7171 I.-H. Kim, H. Jeon, S.-C. Baek, W.-H. Hong, and H.-J. Jung, "Application of crack identification techniques for an aging concrete bridge inspection using an unmanned aerial vehicle," Sens., vol. 18, no. 6, pp. 1881, 2018, http://dx.doi.org/10.3390/s18061881.
http://dx.doi.org/10.3390/s18061881...
], [7474 Y.-F. Liu, X. Nie, J.-S. Fan, and X.-G. Liu, "Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction," Comput. Aided Civ. Infrastruct. Eng., vol. 35, no. 5, pp. 511–529, 2020, http://dx.doi.org/10.1111/mice.12501.
http://dx.doi.org/10.1111/mice.12501...
], [7676 Y. Z. Ayele, M. Aliyari, D. Griffiths, and E. L. Droguett, "Automatic crack segmentation for UAV-assisted bridge inspection," Energies, vol. 13, no. 23, pp. 6250, 2020, http://dx.doi.org/10.3390/en13236250.
http://dx.doi.org/10.3390/en13236250...
], [9090 G. Morgenthal et al., "Framework for automated UAS-based structural condition assessment of bridges," Autom. Construct., vol. 97, pp. 77–95, 2019, http://dx.doi.org/10.1016/j.autcon.2018.10.006.
http://dx.doi.org/10.1016/j.autcon.2018....
], [9191 K. W. Lee and J. K. Park, "Modeling and management of bridge structures using unmanned aerial vehicle in korea," Sens. Mater., vol. 31, no. 11, pp. 3765–3772, 2019, http://dx.doi.org/10.18494/SAM.2019.2467.
http://dx.doi.org/10.18494/SAM.2019.2467...
], [9898 D. Lattanzi and G. R. Miller, "3D scene reconstruction for robotic bridge inspection," J. Infrastruct. Syst., vol. 21, no. 2, pp. 04014041, 2015, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000229.
http://dx.doi.org/10.1061/(ASCE)IS.1943-...
], [9999 K. W. Franke et al., "Reconnaissance of two liquefaction sites using small unmanned aerial vehicles and structure from motion computer vision following the april 1, 2014 chile earthquake," J. Geotech. Geoenviron. Eng., vol. 143, no. 5, pp. 04016125, 2017, http://dx.doi.org/10.1061/(ASCE)GT.1943-5606.0001647.
http://dx.doi.org/10.1061/(ASCE)GT.1943-...
], [105105 L. Yang, B. Li, W. Li, H. Brand, B. Jiang, and J. Xiao, "Concrete defects inspection and 3D mapping using CityFlyer quadrotor robot,” IEEE/CAA J," Autom. Sin., vol. 7, no. 4, pp. 991–1002, 2020, http://dx.doi.org/10.1109/JAS.2020.1003234.
http://dx.doi.org/10.1109/JAS.2020.10032...
], [106106 L. Yang, B. Li, W. Li, Z. Liu, G. Yang, and J. Xiao, “A robotic system towards concrete structure spalling and crack database,” in 2017 IEEE Int. Conf. Robot. Biomimetics (ROBIO), Macau, China, 2017, pp. 1276–1281.], [118118 A. Khaloo, D. Lattanzi, K. Cunningham, R. Dell’Andrea, and M. Riley, "Unmanned aerial vehicle inspection of the placer river trail bridge through image-based 3D modelling," Struct. Infrastruct. Eng., vol. 14, no. 1, pp. 124–136, 2018.], [142142 C. Eschmann and T. Wundsam, "Web-based georeferenced 3D inspection and monitoring of bridges with unmanned aircraft systems," J. Surv. Eng., vol. 143, no. 3, pp. 04017003, 2017., http://dx.doi.org/10.1061/(ASCE)SU.1943-5428.0000221.
http://dx.doi.org/10.1061/(ASCE)SU.1943-...
] and damage quantification [6363 L. Duque, J. Seo, and J. Wacker, “Timber bridge inspection using UAV,” in Struct. Congr. 2018: Bridges, Transp. Struct., Nonbuild. Struct., Fort Worth, TX, USA, 2018, pp. 186–196, http://dx.doi.org/10.1061/9780784481332.017.
http://dx.doi.org/10.1061/9780784481332....
], [6666 S. Chen, D. F. Laefer, E. Mangina, S. M. I. Zolanvari, and J. Byrne, "UAV bridge inspection through evaluated 3D reconstructions," J. Bridge Eng., vol. 24, no. 4, pp. 05019001, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001343.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
], [6767 L. Duque, “UAV-based bridge inspection and computational simulations,” M.S. thesis, Dept. Civ. Environ. Eng., South Dakota State Univ., Brookings, SD, USA, 2017.], [6969 L. Duque, J. Seo, and J. Wacker, "Bridge deterioration quantification protocol using UAV," J. Bridge Eng., vol. 23, no. 10, pp. 04018080, 2018, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001289.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
], [7171 I.-H. Kim, H. Jeon, S.-C. Baek, W.-H. Hong, and H.-J. Jung, "Application of crack identification techniques for an aging concrete bridge inspection using an unmanned aerial vehicle," Sens., vol. 18, no. 6, pp. 1881, 2018, http://dx.doi.org/10.3390/s18061881.
http://dx.doi.org/10.3390/s18061881...
], [8080 J. Seo, E. Jeong, and J. Wacker, “Visual bridge damage measurement using drone-captured image quality optimization,” in Eur. Workshop Struct. Health Monit., P. Rizzo and A. Milazzo, Eds., Cham: Springer International Publishing, 2021, pp. 503–513, http://dx.doi.org/10.1007/978-3-030-64908-1_47.
http://dx.doi.org/10.1007/978-3-030-6490...
], [8181 E. Jeong, J. Seo, and J. Wacker, “Grayscale drone inspection image enhancement framework for advanced bridge defect measurement,” Transp. Res. Rec., vol. 2675, no. 8, pp. 603–612, 2021.], [8181 E. Jeong, J. Seo, and J. Wacker, “Grayscale drone inspection image enhancement framework for advanced bridge defect measurement,” Transp. Res. Rec., vol. 2675, no. 8, pp. 603–612, 2021.], [9696 A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, "Bridge related damage quantification using unmanned aerial vehicle imagery," Struct. Contr. Health Monit., vol. 23, no. 9, pp. 1168–1179, 2016, http://dx.doi.org/10.1002/stc.1831.
http://dx.doi.org/10.1002/stc.1831...
], [108108 X. Peng, X. Zhong, C. Zhao, Y. F. Chen, and T. Zhang, "The feasibility assessment study of bridge crack width recognition in images based on special inspection UAV," Adv. Civ. Eng., vol. 2020, pp. 1–17, 2020., http://dx.doi.org/10.1155/2020/8811649.
http://dx.doi.org/10.1155/2020/8811649...
], [131131 X. Peng, X. Zhong, C. Zhao, A. Chen, and T. Zhang, "A UAV-based machine vision method for bridge crack recognition and width quantification through hybrid feature learning," Constr. Build. Mater., vol. 299, pp. 123896, 2021, http://dx.doi.org/10.1016/j.conbuildmat.2021.123896.
http://dx.doi.org/10.1016/j.conbuildmat....
], [136136 J.-H. Lee, S.-S. Yoon, I.-H. Kim, and H.-J. Jung, “Study on image quality assessment and processing, damage diagnosis of crack for bridge inspection based on unmanned aerial vehicle,” in ACEM18/Struct. 18, Incheon, Korea, 2018, pp. 1–6. [Online]. Available: http://hdl.handle.net/10203/247365
http://hdl.handle.net/10203/247365...
], [140140 J.-H. Lee, S.-S. Yoon, H.-J. Jung, and I.-H. Kim, “Diagnosis of crack damage on structures based on image processing techniques and R-CNN using unmanned aerial vehicle (UAV),” in Proc. SPIE 10598, Sens. Smart Struct. Technol. Civ., Mech., Aerosp. Syst., Denver, CO, USA, 2018, pp. 265–272.], [143143 J.-W. Kim, S.-B. Kim, J.-C. Park, and J.-W. Nam, “Development of crack detection system with unmanned aerial vehicles and digital image processing,” in 2015 World Congr. Adv. Struct. Eng. Mechanics (ASEM), Incheon, Korea, 2015, pp. 1–11.].

Another emerging imaging-based application with UAVs is the displacement/deformation measurement techniques of bridge structure, e.g., photogrammetric computer vision [99 N. Hallermann and G. Morgenthal, “Visual inspection strategies for large bridges using unmanned aerial vehicles (UAV),” in Proc. 7th Int. Conf. Bridge Maint., Saf. Manage. (IABMAS), Shanghai, China, 2014, pp. 661–667.], [8383 D. Erdenebat and D. Waldmann, "Application of the DAD method for damage localisation on an existing bridge structure using close-range UAV photogrammetry," Eng. Struct., vol. 218, pp. 110727, 2020, http://dx.doi.org/10.1016/j.engstruct.2020.110727.
http://dx.doi.org/10.1016/j.engstruct.20...
], [8989 F. Jalinoos, M. Amjadian, A. K. Agrawal, C. Brooks, and D. Banach, "Experimental evaluation of unmanned aerial system for measuring bridge movement," J. Bridge Eng., vol. 25, no. 1, pp. 04019132, 2020, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001508.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
], [9797 A. Ellenberg, L. Branco, A. Krick, I. Bartoli, and A. Kontsos, "Use of unmanned aerial vehicle for quantitative infrastructure evaluation," J. Infrastruct. Syst., vol. 21, no. 3, pp. 04014054, 2015, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000246.
http://dx.doi.org/10.1061/(ASCE)IS.1943-...
], [146146 O. Özcan and O. Özcan, "Multi-hazard assessment of RC bridges using unmanned aerial vehicle-based measurements," Balt. J. Road Bridge Eng., vol. 13, no. 3, pp. 192–208, 2018, http://dx.doi.org/10.7250/bjrbe.2018-13.412.
http://dx.doi.org/10.7250/bjrbe.2018-13....
] and digital image correlation (DIC) [7979 E. Jeong, J. Seo, and J. Wacker, “New bridge inspection approach with joint UAV and DIC system,” in Struct. Congr. 2020, 2020, pp. 349–359.], [9292 D. Reagan, A. Sabato, and C. Niezrecki, "Feasibility of using digital image correlation for unmanned aerial vehicle structural health monitoring of bridges," Struct. Health Monit., vol. 17, no. 5, pp. 1056–1072, 2018, http://dx.doi.org/10.1177/1475921717735326.
http://dx.doi.org/10.1177/14759217177353...
]–[9595 D. Reagan, A. Sabato, C. Niezrecki, T. Yu, and R. Wilson, “An autonomous unmanned aerial vehicle sensing system for structural health monitoring of bridges,” in Proc. SPIE 9804, Nondestruct. Charact. Monit. Adv. Mater., Aerosp., Civ. Infrastruct., Las Vegas, NV, USA, 2016, pp. 244–252, http://dx.doi.org/10.1117/12.2218370.
http://dx.doi.org/10.1117/12.2218370...
], [148148 G. Chen, Q. Liang, W. Zhong, X. Gao, and F. Cui, "Homography-based measurement of bridge vibration using UAV and DIC method," Meas., vol. 170, pp. 108683, 2021, http://dx.doi.org/10.1016/j.measurement.2020.108683.
http://dx.doi.org/10.1016/j.measurement....
]. Despite these imaging-based techniques, it is also worth mentioning the use of Laser Doppler Vibrometers (LDV) in UAVs as a non-contact sensor to measure bridge displacements [8484 P. Garg et al., "Measuring transverse displacements using unmanned aerial systems laser doppler vibrometer (UAS-LDV): Development and field validation," Sens., vol. 20, no. 21, pp. 6051, 2020, http://dx.doi.org/10.3390/s20216051.
http://dx.doi.org/10.3390/s20216051...
]–[8686 P. Garg, F. Moreu, A. Ozdagli, M. R. Taha, and D. Mascareñas, "Noncontact dynamic displacement measurement of structures using a moving laser doppler vibrometer," J. Bridge Eng., vol. 24, no. 9, pp. 04019089, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001472.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
].

4.1.2 Infrared inspection applications

Unlike the aforementioned great number of visual applications, the IR inspection is still underexplored within the UAV applications, although IR images of bridge decks are already commonly used during conventional bridge inspections to obtain information on subsurface defects, like concrete delamination [103103 J. Zink and B. Lovelace, Unmanned Aerial Vehicle Bridge Inspection Demonstration Project (Tech. Rep. MN/RC 2015-40). St. Paul, MN: Minnesota Dept. Transp., 2015, [Online]. Available: https://trid.trb.org/view/1410491
https://trid.trb.org/view/1410491...
]. Some few researches that explore this nondestructive method are briefly described below:

  • Brooks et al. [88 C. Brooks et al., Evaluating the Use of Unmanned Aerial Vehicles for Transportation Purposes (Tech. Rep. RC-1616). Lansing, MI: Michigan Dept. Transp., 2014, Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/1352503
    https://trid.trb.org/view/1352503...
    ] and Escobar-Wolf et al. [8888 R. Escobar-Wolf, T. Oommen, C. N. Brooks, R. J. Dobson, and T. M. Ahlborn, "Unmanned aerial vehicle (UAV)-based assessment of concrete bridge deck delamination using thermal and visible camera sensors: a preliminary analysis," Res. Nondestruct. Eval., vol. 29, no. 4, pp. 183–198, 2018, http://dx.doi.org/10.1080/09349847.2017.1304597.
    http://dx.doi.org/10.1080/09349847.2017....
    ] used the FLIR Tau 2 IR camera, installed on the Bergen Hexacopter, to detect six delamination areas on the inspected bridge deck, where a total of seven delamination areas (all without visible signs) had been spotted before with a handheld FLIR SC 640 IR camera, whose presence were confirmed with a hammer test, i.e., only one delamination area was not found with the UAV IR imagery. Then, their proposed method improves the classification by also including the images collected by a Nikon D800 camera (also installed on the UAV) in the analysis;

  • Zink and Lovelace [103103 J. Zink and B. Lovelace, Unmanned Aerial Vehicle Bridge Inspection Demonstration Project (Tech. Rep. MN/RC 2015-40). St. Paul, MN: Minnesota Dept. Transp., 2015, [Online]. Available: https://trid.trb.org/view/1410491
    https://trid.trb.org/view/1410491...
    ] tested the integrated IR camera from the Aeyron Skyranger UAV in one of the evaluated bridges, where the collected IR images clearly showed the thermal gradient at the deck beam locations;

  • Khan et al. [119119 F. Khan et al., "Investigation on bridge assessment using unmanned aerial systems,” in Struct. Congr. 2015, Portland, OR, USA, 2015, pp. 404–413.] and Ellenberg et al. [120120 A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, “Low-cost, quantitative assessment of highway bridges through the use of unmanned aerial vehicles,” in Proc. SPIE 9805, Health Monit. Struct. Biol. Syst., Las Vegas, NV, USA, 2016, pp. 612–621, http://dx.doi.org/10.1117/12.2219741.
    http://dx.doi.org/10.1117/12.2219741...
    ] performed experimental investigations on a mock-up concrete bridge, where a hexacopter based on DJI F550 frame (equipped with a GoPro Hero3 camera and a FLIR TAU2 IR camera) was used to map it using a multispectral approach, consisted of visual and IR imaging. While Khan et al. [119119 F. Khan et al., "Investigation on bridge assessment using unmanned aerial systems,” in Struct. Congr. 2015, Portland, OR, USA, 2015, pp. 404–413.] presented the collected UAV images that clearly showed three delaminated regions on the mock-up, Ellenberg et al. [120120 A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, “Low-cost, quantitative assessment of highway bridges through the use of unmanned aerial vehicles,” in Proc. SPIE 9805, Health Monit. Struct. Biol. Syst., Las Vegas, NV, USA, 2016, pp. 612–621, http://dx.doi.org/10.1117/12.2219741.
    http://dx.doi.org/10.1117/12.2219741...
    ] used a gradient following algorithm to identify the delaminated regions;

  • Ellenberg et al. [141141 A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, "Bridge deck delamination identification from unmanned aerial vehicle infrared imagery," Autom. Construct., vol. 72, pp. 155–165, 2016, http://dx.doi.org/10.1016/j.autcon.2016.08.024.
    http://dx.doi.org/10.1016/j.autcon.2016....
    ] used a commercially available six-rotor UAV equipped with both GoPro Hero3+ silver edition camera and IR camera (FLIR Tau 2) to collect real-time video imagery from a bridge deck mock-up (an eight inch thick concrete slab, supported by three structural steel I-beams) with multiple pre-manufactured defects (including delamination instances) for field testing, in which the collected IR images/videos were sufficiently clear for their developed image post-processing algorithm to identify the delamination locations;

  • Omar and Nehdi [7272 T. Omar and M. L. Nehdi, "Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography," Autom. Construct., vol. 83, pp. 360–371, 2017, http://dx.doi.org/10.1016/j.autcon.2017.06.024.
    http://dx.doi.org/10.1016/j.autcon.2017....
    ], [7575 T. Omar and M. L. Nehdi, "Thermal detection of subsurface delaminations in reinforced concrete bridge decks using unmanned aerial vehicle," Spec. Publ., vol. 331, pp. 1–14, 2019.] mounted an IR camera (FLIR Vue Pro) on a DJI UAV (Inspire 1 Pro) to detect subsurface delamination in concrete bridge decks, where the feasibility of the proposed system was investigated in two full-scale in-service reinforced concrete bridge decks and demonstrated by comparing its results with other nondestructive testing technique results (including hammer sounding and half-cell potential testing), where the defect regions identified by the proposed system were confirmed;

  • Wells and Lovelace [4444 B. Lovelace, Unmanned Aircraft System Bridge Inspection Demonstration Project Phase II (Tech. Rep. MN/RC 2017-18). St. Paul, MN: Minnesota Dept. Transp., June 2017, [Online]. Available: https://trid.trb.org/view/1475149
    https://trid.trb.org/view/1475149...
    ] detected deck delamination with good accuracy in one of the on-field bridge inspections with an onboard thermal sensor of the SenseFly Albris UAV, whose results were validated by comparing them with the ones obtained by a handheld FLIR thermal camera, where the delamination areas were previously located and marked with the chain dragging method;

  • Hiasa et al. [5757 S. Hiasa, E. Karaaslan, W. Shattenkirk, C. Mildner, and F. N. Catbas, “Bridge inspection and condition assessment using image-based technologies with UAVs,” in Struct. Congr. 2018: Bridges, Transp. Struct., Nonbuild. Struct., Fort Worth, TX, USA, 2018, pp. 217–228.] tested a FLIR T420 IR camera (a handheld IR camera that is not intended for UAV application) attached to a DJI Phantom 3 Advanced UAV using gummed tape, where it was examined if the vibration of the UAV during a hovering flight would affect the images taken from the IR camera (e.g., generate blurred images). They showed that it was possible to capture clearly lattice pattern squares from 1m to 5m range, concluding that if even in this test was possible to capture the target without blurry, then other IR cameras meant for UAV application are also capable, as they are typically used with a gimbal (that mitigates the vibration effects). It is worth noticing that the test was made during hovering flight, i.e., the flying speed during UAV motion may still affect the IRT results, e.g., for a video application;

  • Mac et al. [8282 V. H. Mac, Q. H. Tran, J. Huh, N. S. Doan, C. Kang, and D. Han, "Detection of delamination with various width-to-depth ratios in concrete bridge deck using passive IRT: Limits and applicability," Mater., vol. 12, no. 23, pp. 3996, 2019, http://dx.doi.org/10.3390/ma12233996.
    http://dx.doi.org/10.3390/ma12233996...
    ] conducted experiments on a concrete specimen (emulating a bridge deck surface) with artificial delamination, where two methods were employed to capture its surface temperature: a professional handheld IR camera (FLIR SC660) and a DJI M200 UAV equipped with IR camera (FLIR Zenmuse XT2). A good agreement was observed between their results, which validated the UAV application;

  • Jang et al. [153153 K. Jang, N. Kim, and Y.-K. An, "Deep learning–based autonomous concrete crack evaluation through hybrid image scanning," Struct. Health Monit., vol. 18, no. 5-6, pp. 1722–1737, 2019, http://dx.doi.org/10.1177/1475921718821719.
    http://dx.doi.org/10.1177/14759217188217...
    ] presented a deep learning based concrete crack detection using hybrid images, where a hybrid image scanning system was developed to combine vision and IRT images for unmanned vehicle, in which an integration with UAVs is in progress by the process of miniaturization and packaging of the developed system to reduce its size and weight for mounting it onto a custom-built sticking-type UAV;

  • and Cheng et al. [8787 C. Cheng, Z. Shang, and Z. Shen, "Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography," NDT Int., vol. 116, pp. 102341, 2020, http://dx.doi.org/10.1016/j.ndteint.2020.102341.
    http://dx.doi.org/10.1016/j.ndteint.2020...
    ] developed a customized deep learning model based on encoder-decoder to segment concrete delamination areas in thermal images at the pixel level. This model is validated with experiments conducted in an in-service concrete bridge, where two UAV configurations were employed to take both thermal and visible images, being the thermal camera (FLIR A8300) mounted on a DJI Matrice 600.

Most of them involved automatic inspection methods, where distinct image processing algorithms were developed to mainly detect the delamination areas, being on the other hand [4444 B. Lovelace, Unmanned Aircraft System Bridge Inspection Demonstration Project Phase II (Tech. Rep. MN/RC 2017-18). St. Paul, MN: Minnesota Dept. Transp., June 2017, [Online]. Available: https://trid.trb.org/view/1475149
https://trid.trb.org/view/1475149...
], [5757 S. Hiasa, E. Karaaslan, W. Shattenkirk, C. Mildner, and F. N. Catbas, “Bridge inspection and condition assessment using image-based technologies with UAVs,” in Struct. Congr. 2018: Bridges, Transp. Struct., Nonbuild. Struct., Fort Worth, TX, USA, 2018, pp. 217–228.], [8282 V. H. Mac, Q. H. Tran, J. Huh, N. S. Doan, C. Kang, and D. Han, "Detection of delamination with various width-to-depth ratios in concrete bridge deck using passive IRT: Limits and applicability," Mater., vol. 12, no. 23, pp. 3996, 2019, http://dx.doi.org/10.3390/ma12233996.
http://dx.doi.org/10.3390/ma12233996...
], [103103 J. Zink and B. Lovelace, Unmanned Aerial Vehicle Bridge Inspection Demonstration Project (Tech. Rep. MN/RC 2015-40). St. Paul, MN: Minnesota Dept. Transp., 2015, [Online]. Available: https://trid.trb.org/view/1410491
https://trid.trb.org/view/1410491...
], [119119 F. Khan et al., "Investigation on bridge assessment using unmanned aerial systems,” in Struct. Congr. 2015, Portland, OR, USA, 2015, pp. 404–413.] based on manual inspection or other analysis methods.

4.2 Contact based inspection applications

Although UAVs are being widely used for non-contact inspections, especially the image-based ones, as can be noticed above by the number of documents available in the literature, they are also still underexplored for contact inspection tasks. It is mainly due to the challenges that this type of methods involves, requiring specific device developments to be installed onboard the UAV, hampered by its limited payload capacity, along with the requirement of a more sophisticated control algorithm to deal with the complex dynamics derived by the interaction between UAV and target structure.

There is still no COTS UAV available for contact based inspection and both research and development are necessary to overcome these challenges. Thus, there are few documents in the literature that developed custom-built UAVs focused on dealing with this problem.

An example is the displacement or strain measurement application, for which the custom-built UAVs in Sanchez-Cuevas et al. [113113 P. J. Sanchez-Cuevas, G. Heredia, and A. Ollero, “Multirotor UAS for bridge inspection by contact using the ceiling effect,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 767–774.], [114114 P. J. Sanchez-Cuevas, P. Ramon-Soria, B. Arrue, A. Ollero, and G. Heredia, "Robotic system for inspection by contact of bridge beams using UAVs," Sens., vol. 19, no. 2, pp. 305, 2019, http://dx.doi.org/10.3390/s19020305.
http://dx.doi.org/10.3390/s19020305...
] and Jimenez-Cano et al. [122122 A. E. Jimenez-Cano, P. J. Sanchez-Cuevas, P. Grau, A. Ollero, and G. Heredia, "Contact-based bridge inspection multirotors: design, modeling, and control considering the ceiling effect," IEEE Robot. Autom. Lett., vol. 4, no. 4, pp. 3561–3568, 2019.] were developed. Different from the previously visual-based ones, these UAVs rely on a reflector prism (360º miniprisms) installed in their structure, to perform the bridge inspection while in contact with its ceiling, where a total station (Leica Geosystem MS50) continuously tracks the prism position, from which an estimation of the bridge deformation can be obtained. Additionally, the ceiling effect (arisen when the UAV gets close to the bridge ceiling) is exploited to improve the UAV flight performance, where the increment in rotor thrust (derived from this effect) is explored by the developed UAV control while keeping the UAV stable and preventing it from crashing into the ceiling.

Another example is the acoustic inspection application, performed by the custom-built UAVs developed in Chun et al. [109109 P. Chun et al., "Utilization of unmanned aerial vehicle, artificial intelligence, and remote measurement technology for bridge inspections," J. Robot. Mechatron., vol. 32, no. 6, pp. 1244–1258, 2020, http://dx.doi.org/10.20965/jrm.2020.p1244.
http://dx.doi.org/10.20965/jrm.2020.p124...
], Mason et al. [144144 J. D. Mason, E. T. Ayorinde, D. D. Mascarenas, and F. Moreu, Tap Testing Hammer Using Unmanned Aerial Systems (UASs) (Tech. Rep. LA-UR-16-26204). Los Alamos, NM: Los Alamos Nat. Lab. (LANL), 2016.], and Moreu et al. [145145 F. Moreu, E. Ayorinde, J. Mason, C. Farrar, and D. Mascarenas, "Remote railroad bridge structural tap testing using aerial robots," Int. J. Intell. Robot. Appl., vol. 2, no. 1, pp. 67–80, 2018, http://dx.doi.org/10.1007/s41315-017-0041-7.
http://dx.doi.org/10.1007/s41315-017-004...
], whose onboard hammering device systems were developed to perform both impact and sound recording for post-processing analyses of concrete structure assessment. Besides that, the implementation of onboard manipulators on UAVs, both 1 Degree-of-Freedom (DoF) ones (explored in Ikeda et al. [124124 T. Ikeda et al., “Wall contact by octo-rotor UAV with one DoF manipulator for bridge inspection,” in 2017 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), British Columbia, Canada, 2017, pp. 5122–5127.] and Ichikawa et al. [126126 A. Ichikawa et al., “UAV with manipulator for bridge inspection: hammering system for mounting to UAV,” in 2017 IEEE/SICE Int. Symp. Syst. Integration (SII), Taipei, Taiwan, 2017, pp. 775–780.]) and 3 DoF ones (in Jimenez-Cano et al. [123123 A. E. Jimenez-Cano, J. Braga, G. Heredia, and A. Ollero, “Aerial manipulator for structure inspection by contact from the underside,” in 2015 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Hamburg, Germany, 2015, pp. 1879–1884.] and Ikeda et al. [125125 T. Ikeda et al., "Stable impact and contact force control by UAV for inspection of floor slab of bridge," Adv. Robot., vol. 32, no. 19, pp. 1061–1076, 2018, http://dx.doi.org/10.1080/01691864.2018.1525075.
http://dx.doi.org/10.1080/01691864.2018....
]), may not only be employed for this kind of test, but also for other contact based inspection applications, where a specific device may be manipulated by these UAVs.

5 DISCUSSION OF THE REVIEWED LITERATURE

Following the above description of UAV-based application researches for bridge and tunnel inspection, it would be interesting to have an overview of these main applications. To aid this, the following pie charts (Figure 2) are presented.

Figure 2
Percentage of the main UAV-based applications for bridge and tunnel inspection.

It is evident that the most employed application is the visual inspection, corroborating with the statements made previously in Subsection 4.1. It was expected since this is also the main employed method in the conventional procedure and the availability of lightweight high-definition cameras (especially the on-board/integrated ones on COTS UAV platforms) enable a good quality inspection. Although in the tunnel case it is not as expressive as in the bridge case, the visual inspection still represents half of UAV-based tunnel applications, followed by the ones focused on LiDAR-based UAV positioning/localization and/or environment mapping, since the lack of GPS signal in this environment is still a main challenge.

Note that, within all the UAV-based inspection applications, it was employed either manual or automatic flight navigation, where in the former the operator manually controls the UAV position during the inspection process, and in the latter a pre-determined trajectory is programmed and uploaded in the UAV, so that it can automatically navigate on-site, where the operator supervise it during all the inspection and may intervene it by taking the UAV control, if any unexpected external event occurs.

It is worth emphasizing the difference between automatic and autonomous flight navigation. While the former is developed to reduce the human intervention during its operation to a minimum, the latter does not allow any human intervention during its flight mission, being independent and self-governing while coping with all unforeseen and unpredictable situations that may happen during its navigation. Currently, UAV regulations of many countries do not allow autonomous flight navigation in open airspace since it is still immature and may pose risk to itself and to all of its surroundings. However, this may change as this development becomes more mature and ensures more security during its operation.

Despite the flight navigation mode, it was shown in Section 2 that UAVs provide several advantages over the conventional inspection of bridge and tunnel structures, overcoming the main drawbacks related to their procedures (described in Section 1), e.g., the UAV enable the access and assess of dangerous and/or tight spots that are inaccessible to humans [2020 T. Hongyu, “Inspection of human inaccessible tunnel using unmanned aerial vehicle,” M.S. thesis, Dept. Elect. Comput. Eng., Nat. Univ. Singap., Singapore, 2018.], [130130 M. Yamada, M. Nakao, Y. Hada, and N. Sawasaki, “Development and field test of novel two-wheeled UAV for bridge inspections,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 1014–1021.].

However, the use of this type of technology also brings some challenges, as described in the following.

5.1 Key challenges

The use of UAVs presents some challenges/limitations as:

  • the flight planning, which requires a specialized UAV operator (who needs to be trained and certified to ensure a safe UAV operation) to conduct a manual flight or even to attend an automatic flight (which requires a previously developed path planning) to inspect the on-site structure, along with the evaluation of the environment and weather conditions, which may preclude the flight mission, e.g., gale and heavy rain;

  • limited flight time and payload capacity, which varies for each UAV platform, requiring some extra batteries for long structure inspections;

  • the noise on collected images, derived mainly from the local conditions, e.g., dust, changing lighting conditions along the structure, and wind disturbances during UAV flight (that may lead to blurry images);

  • the existence of GPS-denied areas, whose hinder the UAV navigation, precluding the inspection of structure components at these areas, e.g., at tunnel environments and underneath large bridges;

  • and the regulations of governing authorities for UAV operation, which varies from country to country [3434 B. Chan, H. Guan, J. Jo, and M. Blumenstein, "Towards UAV-based bridge inspection systems: a review and an application perspective," Struct. Monit. Maint., vol. 2, no. 3, pp. 283–300, 2015, http://dx.doi.org/10.12989/smm.2015.2.3.283.
    http://dx.doi.org/10.12989/smm.2015.2.3....
    ].

However, they are continuously being dealt with by the researchers of the area, as the research and development of autonomous flight that provide high accuracy positioning to collect images without blurry effects, along with the UAV technology advancement (e.g., energy-efficient UAV platform designs, enhanced batteries, and GPS-free flight capability) and also the regulations improvement by the associated government agencies in charge.

Concerning the UAV-based tunnel inspection, as stated in Section 2, the major challenges are the lack of both light and GPS-signal, which were mainly overcome by custom-built UAVs developed in the few literature documents (see Table 1), besides some of them being inaccessible by humans, where the UAV must do its inspection out of the operator view, making the task even more challenging (e.g., problem tackled by Özaslan et al. [1717 T. Özaslan et al., "Autonomous navigation and mapping for inspection of penstocks and tunnels with MAVs," IEEE Robot. Autom. Lett., vol. 2, no. 3, pp. 1740–1747, 2017, http://dx.doi.org/10.1109/LRA.2017.2699790.
http://dx.doi.org/10.1109/LRA.2017.26997...
] and Hongyu [2020 T. Hongyu, “Inspection of human inaccessible tunnel using unmanned aerial vehicle,” M.S. thesis, Dept. Elect. Comput. Eng., Nat. Univ. Singap., Singapore, 2018.]).

Likewise, among the main challenges of UAV-based bridge inspection, the underside deck can be mentioned, which is one of the most problematic areas to perform the inspection by an UAV. Some few examples that designed UAVs to overcome this problem are Sanchez-Cuevas et al. [113113 P. J. Sanchez-Cuevas, G. Heredia, and A. Ollero, “Multirotor UAS for bridge inspection by contact using the ceiling effect,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 767–774.], [114114 P. J. Sanchez-Cuevas, P. Ramon-Soria, B. Arrue, A. Ollero, and G. Heredia, "Robotic system for inspection by contact of bridge beams using UAVs," Sens., vol. 19, no. 2, pp. 305, 2019, http://dx.doi.org/10.3390/s19020305.
http://dx.doi.org/10.3390/s19020305...
] and Jimenez-Cano et al. [122122 A. E. Jimenez-Cano, P. J. Sanchez-Cuevas, P. Grau, A. Ollero, and G. Heredia, "Contact-based bridge inspection multirotors: design, modeling, and control considering the ceiling effect," IEEE Robot. Autom. Lett., vol. 4, no. 4, pp. 3561–3568, 2019.], whose UAV platforms explore the ceiling effect when in contact with it in a fixed position during an under-bridge inspection, and Wang et al. [112112 H.-F. Wang, L. Zhai, H. Huang, L.-M. Guan, K.-N. Mu, and G. Wang, "Measurement for cracks at the bottom of bridges based on tethered creeping unmanned aerial vehicle," Autom. Construct., vol. 119, pp. 103330, 2020, http://dx.doi.org/10.1016/j.autcon.2020.103330.
http://dx.doi.org/10.1016/j.autcon.2020....
], whose tethered creeping UAV platform ensures the distance between the camera and the bottom of the bridge for an accurate crack detection. Other examples related to this problem are Yang et al. [117117 C.-H. Yang, M.-C. Wen, Y.-C. Chen, and S.-C. Kang, “An optimized unmanned aerial system for bridge inspection,” in 2015 Proc. 32nd Int. Symp. Automat. Robot. Constr. (ISARC), Oulu, Finland, 2015, pp. 1–6.] and Peng et al. [131131 X. Peng, X. Zhong, C. Zhao, A. Chen, and T. Zhang, "A UAV-based machine vision method for bridge crack recognition and width quantification through hybrid feature learning," Constr. Build. Mater., vol. 299, pp. 123896, 2021, http://dx.doi.org/10.1016/j.conbuildmat.2021.123896.
http://dx.doi.org/10.1016/j.conbuildmat....
] that mounted a camera in an upward gimbal on the top of their UAVs (solution that are also being provided by some specific COTS UAVs, mentioned in Subsection 5.2).

However, its main issue is again the lack of GPS signal, especially at large bridges. Dorafshan et al. [4848 S. Dorafshan, M. Maguire, N. V. Hoffer, and C. Coopmans, Fatigue Crack Detection Using Unmanned Aerial Systems in Under-Bridge Inspection (Tech. Rep. FHWA-ITD-17-256). Boise, Idaho: Idaho Transp. Dept., 2017.] not only summarized some instances during state DOT missions, but also underwent it during their field experiments, where though the built-in sonar sensors, installed on the bottom of their DJI Mavic, allowed the operator to substantially control it while flying under the bridge (in absence of GPS signal), some instability occurred when flying over the river, precluding the under-bridge inspection over this region. Other authors have also reported this issue, e.g., [55 S. Dorafshan and M. Maguire, "Bridge inspection: human performance, unmanned aerial systems and automation," J. Civ. Struct. Health Monit., vol. 8, no. 3, pp. 443–476, 2018, http://dx.doi.org/10.1007/s13349-018-0285-4.
http://dx.doi.org/10.1007/s13349-018-028...
], [103103 J. Zink and B. Lovelace, Unmanned Aerial Vehicle Bridge Inspection Demonstration Project (Tech. Rep. MN/RC 2015-40). St. Paul, MN: Minnesota Dept. Transp., 2015, [Online]. Available: https://trid.trb.org/view/1410491
https://trid.trb.org/view/1410491...
], [113113 P. J. Sanchez-Cuevas, G. Heredia, and A. Ollero, “Multirotor UAS for bridge inspection by contact using the ceiling effect,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 767–774.], [117117 C.-H. Yang, M.-C. Wen, Y.-C. Chen, and S.-C. Kang, “An optimized unmanned aerial system for bridge inspection,” in 2015 Proc. 32nd Int. Symp. Automat. Robot. Constr. (ISARC), Oulu, Finland, 2015, pp. 1–6.], [127127 S. Jung et al., “Toward autonomous bridge inspection: a framework and experimental results,” in 2019 16th Int. Conf. Ubiquitous Robots (UR), Jeju, Korea, 2019, pp. 208–211.], [128128 A. P. Tomiczek, T. J. Whitley, J. A. Bridge, and P. G. Ifju, "Bridge inspections with small unmanned aircraft systems: case studies," J. Bridge Eng., vol. 24, no. 4, pp. 05019003, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001376.
http://dx.doi.org/10.1061/(ASCE)BE.1943-...
], for which an auxiliary positioning system is required, such as other position estimation approaches (as optical flow and visual odometry techniques) and/or other technologies (as LiDARs and image based navigational sensors).

At last, but not least, the success of the UAV-based inspection task rely on the UAV flight parameters (e.g., the distance between the UAV and the structure), the payload choice (the sensors and instruments carried by the UAV) and their parameter configuration (e.g., the high definition camera settings, as the shutter speed, aperture, and ISO), which may be cumbersome even for experienced UAV operators.

5.2 Future trends

Throughout the survey, an identified trend regarding the UAV-based inspection of both tunnels and bridges is the development of automatic flights and even semi-autonomous navigation that are being explored by some of the research studies. This will lead to a future trend of completely autonomous UAV navigation, which will play an important role to enable the automation of the inspection procedure.

Seeing this and the rapid advance on UAV and remote sensing technologies, together with the development of advanced control and navigation, another expected future trend is the multi-UAV cooperation, whose collected multi-data will not only improve the efficiency and performance of the inspection, but also decrease the execution time.

Before this, a trend provided by the rapid advancement of UAV technology is the emerging of COTS models focused on inspection tasks, which are probably already being used in current researches of UAV-based inspection of this kind of structures. Some examples of these 4-rotors UAVs are:

  • the DJI Mavic 2 Enterprise Series (launched on October 29, 2018) [154154 DJI Official. "DJI Unveils Mavic 2 Enterprise." https://www.dji.com/newsroom/news/dji-mavic-2-enterprise (accessed June 4, 2021).
    https://www.dji.com/newsroom/news/dji-ma...
    ], which is based on the Mavic 2 flight platform (with same 31min flight time), but with new features, as the modular accessories (spotlight, speaker, and beacon), the camera upgrades (in which the IR camera addition, available in Dual and Advanced series, is highlighted here), and the add-on Real Time Kinematics (RTK) module for the Advanced series only;

  • the collision-resistant Flyability Elios 2 (launched on April 29, 2019) [155155 M. Gandillon. "Flyability Launches Elios 2 for Intuitive Indoor Inspections." Flyability.com. https://www.flyability.com/news/flyability-elios-2-indoor-inspections (accessed June 10, 2021).
    https://www.flyability.com/news/flyabili...
    ] (with up to 10min flight time) that has a protective frame as a distinctive feature (a carbon fiber spherical cage that encloses the UAV, protecting it from collisions up to 1.5 m/s), in addition to embeds both 12.3MP camera (that records 4K videos) and Lepton 3.5 FLIR IR camera (160x120 video), together with onboard LEDs that provide 10K lumens of light with a remotely adjustable intensity;

  • and the DJI Matrice 300 Series (launched on May 7, 2020) [156156 DJI. "DJI Defines a New Standard for Industrial Tools by Unveiling the Most Advanced Commercial Drone Platform and its First Hybrid Camera Series." DJI Official. https://www.dji.com/newsroom/news/matrice-300-rtk-zenmuse-h20-series (accessed June 4, 2021).
    https://www.dji.com/newsroom/news/matric...
    ] (with up to 55min flight time), compatible with more Zenmuse Series cameras (including powerful full-frame, optical zoom, and IR options) and supporting an upward gimbal, in addition to have the RTK module available.

Although some UAV model comparatives were made in the literature, e.g., [55 S. Dorafshan and M. Maguire, "Bridge inspection: human performance, unmanned aerial systems and automation," J. Civ. Struct. Health Monit., vol. 8, no. 3, pp. 443–476, 2018, http://dx.doi.org/10.1007/s13349-018-0285-4.
http://dx.doi.org/10.1007/s13349-018-028...
], [2525 L. Duque, J. Seo, and J. Wacker, "Synthesis of unmanned aerial vehicle applications for infrastructures," J. Perform. Constr. Facil., vol. 32, no. 4, pp. 04018046, 2018, http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001185.
http://dx.doi.org/10.1061/(ASCE)CF.1943-...
], [5151 B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning," Meas., vol. 164, pp. 108048, 2020, http://dx.doi.org/10.1016/j.measurement.2020.108048.
http://dx.doi.org/10.1016/j.measurement....
], the aforementioned models had not been released yet.

Considering all the presented UAV models (Table 2 and the aforementioned ones), the authors highlight here two of them: the DJI Matrice 210 RTK V2 and the DJI Matrice 300 RTK, since they support not only both IR camera and RTK module (which are desirable features for this kind of inspection), but also an upward gimbal, which is a highly recommended feature for both tunnel and underside bridge deck inspections. Although DJI Mavic 2 Enterprise Advanced also provide both IR camera and RTK module, it does not offer the upward gimbal option, but its relative lower price makes it a good alternative. At last, but not least, it is worth mentioning the Flyability Elios 2, whose protective frame and GPS-free flight capability are strong features to also inspect complex and confined indoor spaces, being a great option especially for tunnel inspections.

The IR camera availability is emphasized since the use of hybrid image processing (in this case, the fusion of infrared and visible images) will provide more information to the inspection process, where their individual advantages can be explored to improve the defect detection. Moreover, other sensors may also be explored in this kind of approach, such as the ultrasonic displacement sensor (to provide a distance measurement from the target structure) [157157 H. Kim, J. Lee, E. Ahn, S. Cho, M. Shin, and S.-H. Sim, "Concrete crack identification using a UAV incorporating hybrid image processing," Sens., vol. 17, no. 9, pp. 2052, 2017, http://dx.doi.org/10.3390/s17092052.
http://dx.doi.org/10.3390/s17092052...
].

6 CONCLUSIONS

There has been a rapid increase in the number of researches on UAV-based inspection applications in civil infrastructure field, especially for large and complex structures, promoted by the fast advancing electronics technology that is aiding the development of powerful custom-built UAV platforms and also enabling the emergence of COTS UAV solutions focused on inspection tasks. They bring several benefits over the conventional procedures of bridge and tunnel inspection, such as more accessibility and safety, along with a reduced cost and inspection time, overcoming the main drawbacks faced by them, which are practically the same for both.

This review article has gathered and surveyed both UAV-based inspection researches of bridges and tunnels, and the main applications have been identified, whose relevant information were summarized in detailed tables to provide a convenient overview of their state-of-art. This includes the several identified COTS UAV platforms that were employed for bridge visual inspection and the diverse custom-built UAVs developed specifically for tunnel inspection.

Although the challenges for both bridge and tunnel UAV-based inspections are practically the same, it is worth to emphasize that the lack of lighting and GPS signal in tunnel environments are far more critical when compared to the bridge case, as in the latter these regions are relatively smaller (usually under its deck), where it is still possible to collect images with some UAV platforms that can point the camera in an angular way towards the bottom of the deck. Consequently, the percentage of researches focusing on positioning and mapping in tunnel environments is still expressive (see Figure 2).

It also has shown that the current main employed application is the visual inspection, boosted by the great number of available lightweight high-definition cameras, especially the on-board/integrated ones on COTS UAV platforms, which provide high quality images and enable an inspection result of similar quality from the conventional procedures.

Despite the still existence of some limitations that hinder the applications of UAV-based inspection of large structures, such as the existence of diverse UAV regulations that vary for each country and the weather conditions that may preclude and delay the on-site inspection execution, some other challenges are being overcome by the fast advancing of UAV and remote sensing technologies, together with the development of advanced control and navigation, which may enable some new future possibilities such as the automatic condition monitoring of these structures, where an UAV will autonomously execute a periodic inspection with a precise positioning during the path-planned trajectory, and the collected data from different sensors will be evaluated and compared with the previous ones, yielding to a shorter-time assessment and a better maintenance management.

ACKNOWLEDGEMENTS

The authors would like to thank Fundação para o Desenvolvimento Tecnológico da Engenharia (FDTE) for their support.

  • Financial support: FDTE, proc. nº BP 1924.04.21.
  • Data Availability: Data-sharing is not applicable to this article as no new data were created or analyzed in this study.
  • How to cite: F. Y. Toriumi, T. N. Bittencourt, and M. M. Futai, “UAV-based inspection of bridge and tunnel structures: an application review,” Rev. IBRACON Estrut. Mater., vol. 16, no. 1, elocation, 2023, https://doi.org/10.1590/S1983-41952023000100003

REFERENCES

  • 1
    B. M. Phares, D. D. Rolander, B. A. Graybeal, and G. A. Washer, "Reliability of visual bridge inspection,” Public Roads, vol. 64, no. 5, pp. 22–29, 2001. Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/683631.https://trid.trb.org/view/683631
    » https://trid.trb.org/view/683631.https://trid.trb.org/view/683631
  • 2
    S. Stent, R. Gherardi, B. Stenger, K. Soga, and R. Cipolla, "Visual change detection on tunnel linings," Mach. Vis. Appl., vol. 27, no. 3, pp. 319–330, 2016, http://dx.doi.org/10.1007/s00138-014-0648-8
    » http://dx.doi.org/10.1007/s00138-014-0648-8
  • 3
    A. Zulifqar, M. Cabieses, A. Mikhail, and N. Khan, Design of a Bridge Inspection System (BIS) to Reduce Time and Cost. Farifax, VA, USA: George Mason Univ., 2014.
  • 4
    B. A. Graybeal, B. M. Phares, D. D. Rolander, M. Moore, and G. Washer, "Visual inspection of highway bridges," J. Nondestruct. Eval., vol. 21, no. 3, pp. 67–83, 2002, http://dx.doi.org/10.1023/A:1022508121821
    » http://dx.doi.org/10.1023/A:1022508121821
  • 5
    S. Dorafshan and M. Maguire, "Bridge inspection: human performance, unmanned aerial systems and automation," J. Civ. Struct. Health Monit., vol. 8, no. 3, pp. 443–476, 2018, http://dx.doi.org/10.1007/s13349-018-0285-4
    » http://dx.doi.org/10.1007/s13349-018-0285-4
  • 6
    N. Metni and T. Hamel, "A UAV for bridge inspection: Visual servoing control law with orientation limits," Autom. Construct., vol. 17, no. 1, pp. 3–10, 2007, http://dx.doi.org/10.1016/j.autcon.2006.12.010
    » http://dx.doi.org/10.1016/j.autcon.2006.12.010
  • 7
    P. S. Moller, CALTRANS Bridge Inspection Aerial Robot |(Tech. Rep. CA 08-0182). Sacramento, CA: California Dept. Transp., 2008. Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/917744
    » https://trid.trb.org/view/917744
  • 8
    C. Brooks et al., Evaluating the Use of Unmanned Aerial Vehicles for Transportation Purposes (Tech. Rep. RC-1616). Lansing, MI: Michigan Dept. Transp., 2014, Accessed: Mar. 30, 2021. [Online]. Available: https://trid.trb.org/view/1352503
    » https://trid.trb.org/view/1352503
  • 9
    N. Hallermann and G. Morgenthal, “Visual inspection strategies for large bridges using unmanned aerial vehicles (UAV),” in Proc. 7th Int. Conf. Bridge Maint., Saf. Manage. (IABMAS), Shanghai, China, 2014, pp. 661–667.
  • 10
    L. D. Otero, N. Gagliardo, D. Dalli, W.-H. Huang, and P. Cosentino, Proof of Concept for Using Unmanned Aerial Vehicles for High Mast Pole and Bridge Inspections (Tech. Rep. BDV28-TWO-977-02). Tallahassee, FL: Florida Dept. Transp., Res. Center, 2015, http://dx.doi.org/10.13140/RG.2.1.4567.2166
    » http://dx.doi.org/10.13140/RG.2.1.4567.2166
  • 11
    J. Seo, L. Duque, and J. Wacker, “Glued-laminated timber arch bridge inspection using UAV,” in Comput. Civ. Eng. 2019: Smart Cities, Sustainability, and Resilience, Reston, 2019, pp. 336–342.
  • 12
    R. Montero, J. G. Victores, S. Martínez, A. Jardón, and C. Balaguer, "Past, present and future of robotic tunnel inspection," Autom. Construct., vol. 59, pp. 99–112, 2015, http://dx.doi.org/10.1016/j.autcon.2015.02.003
    » http://dx.doi.org/10.1016/j.autcon.2015.02.003
  • 13
    L. Attard, C. J. Debono, G. Valentino, and M. Di Castro, "Tunnel inspection using photogrammetric techniques and image processing: A review," ISPRS J. Photogramm. Remote Sens., vol. 144, pp. 180–188, 2018, http://dx.doi.org/10.1016/j.isprsjprs.2018.07.010
    » http://dx.doi.org/10.1016/j.isprsjprs.2018.07.010
  • 14
    Y. Xue, S. Zhang, M. Zhou, and H. Zhu, "Novel SfM-DLT method for metro tunnel 3D reconstruction and visualization," Undergr. Space, vol. 6, no. 2, pp. 134–141, 2021, http://dx.doi.org/10.1016/j.undsp.2020.01.002
    » http://dx.doi.org/10.1016/j.undsp.2020.01.002
  • 15
    T. Özaslan, S. Shen, Y. Mulgaonkar, N. Michael, and V. Kumar, “Inspection of penstocks and featureless tunnel-like environments using micro UAVs,” in Field and Service Robotics, L. Mejias, P. Corke, and J. Roberts, Eds., Cham: Springer International Publishing, 2015, pp. 123–136, http://dx.doi.org/10.1007/978-3-319-07488-7_9
    » http://dx.doi.org/10.1007/978-3-319-07488-7_9
  • 16
    T. Özaslan et al., "Towards fully autonomous visual inspection of dark featureless dam penstocks using MAVs,” in 2016 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Daejeon, Korea, 2016, pp. 4998–5005.
  • 17
    T. Özaslan et al., "Autonomous navigation and mapping for inspection of penstocks and tunnels with MAVs," IEEE Robot. Autom. Lett., vol. 2, no. 3, pp. 1740–1747, 2017, http://dx.doi.org/10.1109/LRA.2017.2699790
    » http://dx.doi.org/10.1109/LRA.2017.2699790
  • 18
    T. Iwamoto, T. Enaka, and K. Tada, "Development of testing machine for tunnel inspection using multi-rotor UAV," J. Phys. Conf. Ser., vol. 842, no. 1, pp. 012068, 2017, http://dx.doi.org/10.1088/1742-6596/842/1/012068
    » http://dx.doi.org/10.1088/1742-6596/842/1/012068
  • 19
    C. H. Vong, R. Ravitharan, P. Reichl, J. Chevin, and H. Chung, “Small scale unmanned aerial system (UAS) for railway culvert and tunnel inspection,” in ICRT 2017: Railway Develop., Operations, Maint., Reston, VA, 2018, pp. 1024–1032, http://dx.doi.org/10.1061/9780784481257.102
    » http://dx.doi.org/10.1061/9780784481257.102
  • 20
    T. Hongyu, “Inspection of human inaccessible tunnel using unmanned aerial vehicle,” M.S. thesis, Dept. Elect. Comput. Eng., Nat. Univ. Singap., Singapore, 2018.
  • 21
    C. H. Tan et al., "A smart unmanned aerial vehicle (UAV) based imaging system for inspection of deep hazardous tunnels," Water Pract. Technol., vol. 13, no. 4, pp. 991–1000, 2018, http://dx.doi.org/10.2166/wpt.2018.105
    » http://dx.doi.org/10.2166/wpt.2018.105
  • 22
    R. S. Pahwa, K. Y. Chan, J. Bai, V. B. Saputra, M. N. Do, and S. Foong, “Dense 3D reconstruction for visual tunnel inspection using unmanned aerial vehicle,” in 2019 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Macau, China, 2019, pp. 7025–7032.
  • 23
    S. S. Mansouri, C. Kanellakis, D. Kominiak, and G. Nikolakopoulos, "Deploying MAVs for autonomous navigation in dark underground mine environments," Robot. Auton. Syst., vol. 126, pp. 103472, 2020, http://dx.doi.org/10.1016/j.robot.2020.103472
    » http://dx.doi.org/10.1016/j.robot.2020.103472
  • 24
    C. Feng, H. Zhang, Y. Li, S. Wang, and H. Wang, "Efficient real-time defect detection for spillway tunnel using deep learning," J. Real-Time Image Process., vol. 18, no. 6, pp. 1–11, 2021, http://dx.doi.org/10.1007/s11554-021-01130-x
    » http://dx.doi.org/10.1007/s11554-021-01130-x
  • 25
    L. Duque, J. Seo, and J. Wacker, "Synthesis of unmanned aerial vehicle applications for infrastructures," J. Perform. Constr. Facil., vol. 32, no. 4, pp. 04018046, 2018, http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001185
    » http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001185
  • 26
    S. Agnisarman, S. Lopes, K. Chalil Madathil, K. Piratla, and A. Gramopadhye, "A survey of automation-enabled human-in-the-loop systems for infrastructure visual inspection," Autom. Construct., vol. 97, pp. 52–76, 2019, http://dx.doi.org/10.1016/j.autcon.2018.10.019
    » http://dx.doi.org/10.1016/j.autcon.2018.10.019
  • 27
    W. W. Greenwood, J. P. Lynch, and D. Zekkos, "Applications of UAVs in civil infrastructure," J. Infrastruct. Syst., vol. 25, no. 2, pp. 04019002, 2019, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000464
    » http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000464
  • 28
    S. Sony, S. Laventure, and A. Sadhu, "A literature review of next-generation smart sensing technology in structural health monitoring," Struct. Contr. Health Monit., vol. 26, no. 3, e2321, 2019, http://dx.doi.org/10.1002/stc.2321
    » http://dx.doi.org/10.1002/stc.2321
  • 29
    H. Ahmed, H. M. La, and N. Gucunski, "Review of non-destructive civil infrastructure evaluation for bridges: State-of-the-art robotic platforms, sensors and algorithms," Sens., vol. 20, no. 14, pp. 3954, 2020, http://dx.doi.org/10.3390/s20143954
    » http://dx.doi.org/10.3390/s20143954
  • 30
    F. Outay, H. A. Mengash, and M. Adnan, "Applications of unmanned aerial vehicle (UAV) in road safety, traffic and highway infrastructure management: recent advances and challenges," Transp. Res. Part A Policy Pract., vol. 141, pp. 116–129, 2020, http://dx.doi.org/10.1016/j.tra.2020.09.018
    » http://dx.doi.org/10.1016/j.tra.2020.09.018
  • 31
    E. Jeong, J. Seo, and J. Wacker, "Literature review and technical survey on bridge inspection using unmanned aerial vehicles," J. Perform. Constr. Facil., vol. 34, no. 6, pp. 04020113, 2020, http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001519
    » http://dx.doi.org/10.1061/(ASCE)CF.1943-5509.0001519
  • 32
    S. Feroz and S. Abu Dabous, "Uav-based remote sensing applications for bridge condition assessment," Remote Sens., vol. 13, no. 9, pp. 1809, 2021, http://dx.doi.org/10.3390/rs13091809
    » http://dx.doi.org/10.3390/rs13091809
  • 33
    Z. Yin, A Quadcopter with Heterogeneous Sensors for Autonomous Bridge Inspection (Tech. Rep. 25-1121-0003-197). Lincoln, NE: Mid-America Transp. Center, 2014. [Online]. Available: https://trid.trb.org/view/1331073
    » https://trid.trb.org/view/1331073
  • 34
    B. Chan, H. Guan, J. Jo, and M. Blumenstein, "Towards UAV-based bridge inspection systems: a review and an application perspective," Struct. Monit. Maint., vol. 2, no. 3, pp. 283–300, 2015, http://dx.doi.org/10.12989/smm.2015.2.3.283
    » http://dx.doi.org/10.12989/smm.2015.2.3.283
  • 35
    K. Cunningham et al., "UAS-based inspection of the placer river trail bridge: a data-driven approach,” in Struct. Congr. 2015, Portland, OR, USA, 2015, pp. 607–615, http://dx.doi.org/10.1061/9780784479117.053
    » http://dx.doi.org/10.1061/9780784479117.053
  • 36
    N. Bolourian, M. M. Soltani, A. Albahri, and A. Hammad“High level framework for bridge inspection using LiDAR-equipped UAV,” in 2017 Proc. 34th Int. Symp. Automat. Robot. Constr. (ISARC), Taipei, Taiwan, 2017, pp. 683–688.
  • 37
    H.-J. Jung, J.-H. Lee, and I.-H. Kim, “Challenging issues and solutions of bridge inspection technology using unmanned aerial vehicles,” in Proc. SPIE 10598, Sens. Smart Struct. Technol. Civ., Mech., Aerosp. Syst., Denver, CO, USA, 2018, pp. 1–6.
  • 38
    Y. Z. Ayele and E. L. Droguett, “Application of UAVs for bridge inspection and resilience assessment,” in Proc. 29th Eur. Saf. Rel. Conf., Hannover, Germany, 2019, pp. 1328–1335.
  • 39
    D. Cheyne, B. Merrill, and J. Boggs, Use of Small Unmanned Aerial Systems for Bridge Inspection (Tech. Rep. FHWA-HIF-19-056). Washington, DC: Fed. Hig. Adm. (FHWA), 2019, [Online]. Available: https://trid.trb.org/view/1749103
    » https://trid.trb.org/view/1749103
  • 40
    K. K. Jena, S. Mishra, S. Mishra, and S. K. Bhoi, “Unmanned aerial vehicle assisted bridge crack severity inspection using edge detection methods,” in 2019 3rd Int. Conf. I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Palladam, India, 2019, pp. 284–289.
  • 41
    Y. Zou, V. Gonzalez, J. Lim, R. Amor, B. Guo, and M. Babaeian Jelodar, “Systematic framework for postearthquake bridge inspection through UAV and 3D BIM reconstruction,” in Proc. CIB World Build. Congr., Hong Kong, China, 2019, pp. 1–9.
  • 42
    S. HekmatiAthar, N. Goudarzi, A. Karimoddini, A. Homaifar, and D. Divakaran, “A systematic evaluation and selection of UAS-enabled solutions for bridge inspection practices,” in 2020 IEEE Aerosp. Conf., Big Sky, MT, USA, 2020, pp. 1–11, http://dx.doi.org/10.1109/AERO47225.2020.9172795
    » http://dx.doi.org/10.1109/AERO47225.2020.9172795
  • 43
    J. Wells and B. Lovelace, Improving the Quality of Bridge Inspections Using Unmanned Aircraft Systems (UAS) (Tech. Rep. MN/RC 2018-26). St. Paul, MN: Minnesota Dept. Transp., 2018. [Online]. Available: https://trid.trb.org/view/1539868
    » https://trid.trb.org/view/1539868
  • 44
    B. Lovelace, Unmanned Aircraft System Bridge Inspection Demonstration Project Phase II (Tech. Rep. MN/RC 2017-18). St. Paul, MN: Minnesota Dept. Transp., June 2017, [Online]. Available: https://trid.trb.org/view/1475149
    » https://trid.trb.org/view/1475149
  • 45
    M. N. Gillins, “Unmanned aircraft systems for bridge inspection: testing and developing end-to-end operational workflow,” M.S. thesis, Oregon State Univ., Corvallis, OR, USA, 2016. [Online]. Available: http://hdl.handle.net/1957/60001
    » http://hdl.handle.net/1957/60001
  • 46
    S. Dorafshan, R. J. Thomas, C. Coopmans, and M. Maguire, “Deep learning neural networks for sUAS-assisted structural inspections: feasibility and application,” in 2018 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Dallas, TX, USA, 2018, pp. 874–882.
  • 47
    S. Dorafshan, M. Maguire, N. V. Hoffer, and C. Coopmans, "Challenges in bridge inspection using small unmanned aerial systems: results and lessons learned,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 1722–1730.
  • 48
    S. Dorafshan, M. Maguire, N. V. Hoffer, and C. Coopmans, Fatigue Crack Detection Using Unmanned Aerial Systems in Under-Bridge Inspection (Tech. Rep. FHWA-ITD-17-256). Boise, Idaho: Idaho Transp. Dept., 2017.
  • 49
    S. Dorafshan, R. J. Thomas, and M. Maguire, "Fatigue crack detection using unmanned aerial systems in fracture critical inspection of steel bridges," J. Bridge Eng., vol. 23, no. 10, pp. 04018078, 2018, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001291
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001291
  • 50
    B. J. Perry, “Streamlined bridge inspection framework utilizing unmanned aerial vehicles (UAVs),” M.S. thesis, Dept. Civ. Environ. Eng., Colorado State Univ., Fort Collins, CO, USA, 2019. [Online]. Available: https://hdl.handle.net/10217/197417
    » https://hdl.handle.net/10217/197417
  • 51
    B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning," Meas., vol. 164, pp. 108048, 2020, http://dx.doi.org/10.1016/j.measurement.2020.108048
    » http://dx.doi.org/10.1016/j.measurement.2020.108048
  • 52
    Y. Turkan, Bridge structural inspections using bridge information modeling (BrIM) and unmanned aerial vehicles (UAVs) (Pacific Northwest Transp. Consortium, Seattle, WA, USA, Tech. Rep. 2017-S-OSU-2, 2019. [Online]. Available: http://hdl.handle.net/1773/45581
    » http://hdl.handle.net/1773/45581
  • 53
    Y. Xu and Y. Turkan, "BrIM and UAS for bridge inspections and management,” Eng. Constr. Archit. Manage., vol. 27, no. 3, pp. 785–807, 2020, http://dx.doi.org/10.1108/ECAM-12-2018-0556
    » http://dx.doi.org/10.1108/ECAM-12-2018-0556
  • 54
    S. Dorafshan, R. J. Thomas, C. Coopmans, and M. Maguire, "A practitioner’s guide to small unmanned aerial systems for bridge inspection," Infrastruct., vol. 4, no. 4, pp. 72, 2019, http://dx.doi.org/10.3390/infrastructures4040072
    » http://dx.doi.org/10.3390/infrastructures4040072
  • 55
    B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Unmanned aerial vehicle (UAV)-enabled bridge inspection framework,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations, H. Yokota and D.M. Frangopol, Eds., London: CRC Press, 2021, pp. 158–165.
  • 56
    B. J. Perry, Y. Guo, R. Atadero, and J. W. van de Lindt, "Tracking bridge condition over time using recurrent UAV-based inspection,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations CRC Press, 2021, pp. 286–291.
  • 57
    S. Hiasa, E. Karaaslan, W. Shattenkirk, C. Mildner, and F. N. Catbas, “Bridge inspection and condition assessment using image-based technologies with UAVs,” in Struct. Congr. 2018: Bridges, Transp. Struct., Nonbuild. Struct., Fort Worth, TX, USA, 2018, pp. 217–228.
  • 58
    M. N. Gillins, D. T. Gillins, and C. Parrish, “Cost-effective bridge safety inspections using unmanned aircraft systems (UAS),” in Geotech. Struct. Eng. Congr., Phoenix, AZ, USA, 2016, pp. 1931–1940.
  • 59
    H. Yoon, J. Shin, and B. F. Spencer Jr, "Structural displacement measurement using an unmanned aerial system," Comput. Aided Civ. Infrastruct. Eng., vol. 33, no. 3, pp. 183–192, 2018, http://dx.doi.org/10.1111/mice.12338
    » http://dx.doi.org/10.1111/mice.12338
  • 60
    J. J. Lin, A. Ibrahim, S. Sarwade, and M. Golparvar-Fard, "Bridge inspection with aerial robots: Automating the entire pipeline of visual data capture, 3D mapping, defect detection, analysis, and reporting," J. Comput. Civ. Eng., vol. 35, no. 2, pp. 04020064, 2021, http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000954
    » http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000954
  • 61
    W. Wu, M. A. Qurishee, J. Owino, I. Fomunung, M. Onyango, and B. Atolagbe, “Coupling deep learning and UAV for infrastructure condition assessment automation,” in 2018 IEEE Int. Smart Cities Conf. (ISC2), Kansas City, MO, USA, 2018, pp. 1–7.
  • 62
    J. Seo, L. Duque, and J. Wacker, "Drone-enabled bridge inspection methodology and application," Autom. Construct., vol. 94, pp. 112–126, 2018, http://dx.doi.org/10.1016/j.autcon.2018.06.006
    » http://dx.doi.org/10.1016/j.autcon.2018.06.006
  • 63
    L. Duque, J. Seo, and J. Wacker, “Timber bridge inspection using UAV,” in Struct. Congr. 2018: Bridges, Transp. Struct., Nonbuild. Struct., Fort Worth, TX, USA, 2018, pp. 186–196, http://dx.doi.org/10.1061/9780784481332.017
    » http://dx.doi.org/10.1061/9780784481332.017
  • 64
    J. Seo, J. P. Wacker, and L. Duque, Evaluating the Use of Drones for Timber Bridge Inspection (Tech. Rep.). Madison, WI: US Dept. Agriculture, Forest Service, Forest Products Lab., 2018.
  • 65
    J. Seo, L. Duque, and J. P. Wacker, "Field application of UAS-based bridge inspection," Transp. Res. Rec., vol. 2672, no. 12, pp. 72–81, 2018, http://dx.doi.org/10.1177/0361198118780825
    » http://dx.doi.org/10.1177/0361198118780825
  • 66
    S. Chen, D. F. Laefer, E. Mangina, S. M. I. Zolanvari, and J. Byrne, "UAV bridge inspection through evaluated 3D reconstructions," J. Bridge Eng., vol. 24, no. 4, pp. 05019001, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001343
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001343
  • 67
    L. Duque, “UAV-based bridge inspection and computational simulations,” M.S. thesis, Dept. Civ. Environ. Eng., South Dakota State Univ., Brookings, SD, USA, 2017.
  • 68
    A. Humpe, "Bridge inspection with an off-the-shelf 360º camera drone," Drones, vol. 4, no. 4, pp. 67, 2020, http://dx.doi.org/10.3390/drones4040067
    » http://dx.doi.org/10.3390/drones4040067
  • 69
    L. Duque, J. Seo, and J. Wacker, "Bridge deterioration quantification protocol using UAV," J. Bridge Eng., vol. 23, no. 10, pp. 04018080, 2018, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001289
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001289
  • 70
    E. Ciampa, L. D. Vito, and M. R. Pecce, "Practical issues on the use of drones for construction inspections," J. Phys. Conf. Ser., vol. 1249, no. 1, pp. 012016, May 2019, http://dx.doi.org/10.1088/1742-6596/1249/1/012016
    » http://dx.doi.org/10.1088/1742-6596/1249/1/012016
  • 71
    I.-H. Kim, H. Jeon, S.-C. Baek, W.-H. Hong, and H.-J. Jung, "Application of crack identification techniques for an aging concrete bridge inspection using an unmanned aerial vehicle," Sens., vol. 18, no. 6, pp. 1881, 2018, http://dx.doi.org/10.3390/s18061881
    » http://dx.doi.org/10.3390/s18061881
  • 72
    T. Omar and M. L. Nehdi, "Remote sensing of concrete bridge decks using unmanned aerial vehicle infrared thermography," Autom. Construct., vol. 83, pp. 360–371, 2017, http://dx.doi.org/10.1016/j.autcon.2017.06.024
    » http://dx.doi.org/10.1016/j.autcon.2017.06.024
  • 73
    J. Hackl, B. T. Adey, M. Woźniak, and O. Schümperlin, "Use of unmanned aerial vehicle photogrammetry to obtain topographical information to improve bridge risk assessment," J. Infrastruct. Syst., vol. 24, no. 1, pp. 04017041, 2018, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000393
    » http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000393
  • 74
    Y.-F. Liu, X. Nie, J.-S. Fan, and X.-G. Liu, "Image-based crack assessment of bridge piers using unmanned aerial vehicles and three-dimensional scene reconstruction," Comput. Aided Civ. Infrastruct. Eng., vol. 35, no. 5, pp. 511–529, 2020, http://dx.doi.org/10.1111/mice.12501
    » http://dx.doi.org/10.1111/mice.12501
  • 75
    T. Omar and M. L. Nehdi, "Thermal detection of subsurface delaminations in reinforced concrete bridge decks using unmanned aerial vehicle," Spec. Publ., vol. 331, pp. 1–14, 2019.
  • 76
    Y. Z. Ayele, M. Aliyari, D. Griffiths, and E. L. Droguett, "Automatic crack segmentation for UAV-assisted bridge inspection," Energies, vol. 13, no. 23, pp. 6250, 2020, http://dx.doi.org/10.3390/en13236250
    » http://dx.doi.org/10.3390/en13236250
  • 77
    M. Aliyari, B. Ashrafi, and Y. Z. Ayele, "Hazards identification and risk assessment for UAV-assisted bridge inspections," Struct. Infrastruct. Eng., vol. 18, no. 3, pp. 412–428, 2022, http://dx.doi.org/10.1080/15732479.2020.1858878
    » http://dx.doi.org/10.1080/15732479.2020.1858878
  • 78
    Z. Yu, Y. Shen, and C. Shen, "A real-time detection approach for bridge cracks based on YOLOv4-FPM," Autom. Construct., vol. 122, pp. 103514, 2021, http://dx.doi.org/10.1016/j.autcon.2020.103514
    » http://dx.doi.org/10.1016/j.autcon.2020.103514
  • 79
    E. Jeong, J. Seo, and J. Wacker, “New bridge inspection approach with joint UAV and DIC system,” in Struct. Congr. 2020, 2020, pp. 349–359.
  • 80
    J. Seo, E. Jeong, and J. Wacker, “Visual bridge damage measurement using drone-captured image quality optimization,” in Eur. Workshop Struct. Health Monit., P. Rizzo and A. Milazzo, Eds., Cham: Springer International Publishing, 2021, pp. 503–513, http://dx.doi.org/10.1007/978-3-030-64908-1_47
    » http://dx.doi.org/10.1007/978-3-030-64908-1_47
  • 81
    E. Jeong, J. Seo, and J. Wacker, “Grayscale drone inspection image enhancement framework for advanced bridge defect measurement,” Transp. Res. Rec., vol. 2675, no. 8, pp. 603–612, 2021.
  • 82
    V. H. Mac, Q. H. Tran, J. Huh, N. S. Doan, C. Kang, and D. Han, "Detection of delamination with various width-to-depth ratios in concrete bridge deck using passive IRT: Limits and applicability," Mater., vol. 12, no. 23, pp. 3996, 2019, http://dx.doi.org/10.3390/ma12233996
    » http://dx.doi.org/10.3390/ma12233996
  • 83
    D. Erdenebat and D. Waldmann, "Application of the DAD method for damage localisation on an existing bridge structure using close-range UAV photogrammetry," Eng. Struct., vol. 218, pp. 110727, 2020, http://dx.doi.org/10.1016/j.engstruct.2020.110727
    » http://dx.doi.org/10.1016/j.engstruct.2020.110727
  • 84
    P. Garg et al., "Measuring transverse displacements using unmanned aerial systems laser doppler vibrometer (UAS-LDV): Development and field validation," Sens., vol. 20, no. 21, pp. 6051, 2020, http://dx.doi.org/10.3390/s20216051
    » http://dx.doi.org/10.3390/s20216051
  • 85
    P. Garg, “Displacement measurement using a laser doppler vibrometer mounted on an unmanned aerial vehicles,” M.S. thesis, Dept. Elect. Comput. Eng., Univ. New Mex., Albuquerque, NM, USA, 2017.
  • 86
    P. Garg, F. Moreu, A. Ozdagli, M. R. Taha, and D. Mascareñas, "Noncontact dynamic displacement measurement of structures using a moving laser doppler vibrometer," J. Bridge Eng., vol. 24, no. 9, pp. 04019089, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001472
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001472
  • 87
    C. Cheng, Z. Shang, and Z. Shen, "Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography," NDT Int., vol. 116, pp. 102341, 2020, http://dx.doi.org/10.1016/j.ndteint.2020.102341
    » http://dx.doi.org/10.1016/j.ndteint.2020.102341
  • 88
    R. Escobar-Wolf, T. Oommen, C. N. Brooks, R. J. Dobson, and T. M. Ahlborn, "Unmanned aerial vehicle (UAV)-based assessment of concrete bridge deck delamination using thermal and visible camera sensors: a preliminary analysis," Res. Nondestruct. Eval., vol. 29, no. 4, pp. 183–198, 2018, http://dx.doi.org/10.1080/09349847.2017.1304597
    » http://dx.doi.org/10.1080/09349847.2017.1304597
  • 89
    F. Jalinoos, M. Amjadian, A. K. Agrawal, C. Brooks, and D. Banach, "Experimental evaluation of unmanned aerial system for measuring bridge movement," J. Bridge Eng., vol. 25, no. 1, pp. 04019132, 2020, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001508
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001508
  • 90
    G. Morgenthal et al., "Framework for automated UAS-based structural condition assessment of bridges," Autom. Construct., vol. 97, pp. 77–95, 2019, http://dx.doi.org/10.1016/j.autcon.2018.10.006
    » http://dx.doi.org/10.1016/j.autcon.2018.10.006
  • 91
    K. W. Lee and J. K. Park, "Modeling and management of bridge structures using unmanned aerial vehicle in korea," Sens. Mater., vol. 31, no. 11, pp. 3765–3772, 2019, http://dx.doi.org/10.18494/SAM.2019.2467
    » http://dx.doi.org/10.18494/SAM.2019.2467
  • 92
    D. Reagan, A. Sabato, and C. Niezrecki, "Feasibility of using digital image correlation for unmanned aerial vehicle structural health monitoring of bridges," Struct. Health Monit., vol. 17, no. 5, pp. 1056–1072, 2018, http://dx.doi.org/10.1177/1475921717735326
    » http://dx.doi.org/10.1177/1475921717735326
  • 93
    D. Reagan, A. Sabato, and C. Niezrecki, "Unmanned aerial vehicle acquisition of three-dimensional digital image correlation measurements for structural health monitoring of bridges,” in Proc. SPIE 10169, Nondestruct. Charact. Monit. Adv. Mater., Aerosp., Civ. Infrastruct., Portland, OR, USA, 2017, pp. 68–77, http://dx.doi.org/10.1117/12.2259985
    » http://dx.doi.org/10.1117/12.2259985
  • 94
    D. Reagan, “Unmanned aerial vehicle measurement using three dimensional digital image correlation to perform bridge structural health monitoring,” M.S. thesis, Dept. Mech. Eng., Univ. Massachusetts Lowell, Lowell, MA, USA, 2017.
  • 95
    D. Reagan, A. Sabato, C. Niezrecki, T. Yu, and R. Wilson, “An autonomous unmanned aerial vehicle sensing system for structural health monitoring of bridges,” in Proc. SPIE 9804, Nondestruct. Charact. Monit. Adv. Mater., Aerosp., Civ. Infrastruct., Las Vegas, NV, USA, 2016, pp. 244–252, http://dx.doi.org/10.1117/12.2218370
    » http://dx.doi.org/10.1117/12.2218370
  • 96
    A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, "Bridge related damage quantification using unmanned aerial vehicle imagery," Struct. Contr. Health Monit., vol. 23, no. 9, pp. 1168–1179, 2016, http://dx.doi.org/10.1002/stc.1831
    » http://dx.doi.org/10.1002/stc.1831
  • 97
    A. Ellenberg, L. Branco, A. Krick, I. Bartoli, and A. Kontsos, "Use of unmanned aerial vehicle for quantitative infrastructure evaluation," J. Infrastruct. Syst., vol. 21, no. 3, pp. 04014054, 2015, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000246
    » http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000246
  • 98
    D. Lattanzi and G. R. Miller, "3D scene reconstruction for robotic bridge inspection," J. Infrastruct. Syst., vol. 21, no. 2, pp. 04014041, 2015, http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000229
    » http://dx.doi.org/10.1061/(ASCE)IS.1943-555X.0000229
  • 99
    K. W. Franke et al., "Reconnaissance of two liquefaction sites using small unmanned aerial vehicles and structure from motion computer vision following the april 1, 2014 chile earthquake," J. Geotech. Geoenviron. Eng., vol. 143, no. 5, pp. 04016125, 2017, http://dx.doi.org/10.1061/(ASCE)GT.1943-5606.0001647
    » http://dx.doi.org/10.1061/(ASCE)GT.1943-5606.0001647
  • 100
    R. Ali, D. Kang, G. Suh, and Y.-J. Cha, "Real-time multiple damage mapping using autonomous UAV and deep faster region-based neural networks for GPS-denied structures," Autom. Construct., vol. 130, pp. 103831, 2021, http://dx.doi.org/10.1016/j.autcon.2021.103831
    » http://dx.doi.org/10.1016/j.autcon.2021.103831
  • 101
    P. Darby, W. Hollerman, and J. Miller, "Exploring the potential utility of unmanned aerial vehicles for practical bridge inspection in Louisiana," MATEC Web Conf., vol. 271, pp. 01001, 2019, http://dx.doi.org/10.1051/matecconf/201927101001
    » http://dx.doi.org/10.1051/matecconf/201927101001
  • 102
    P. Darby and V. Gopu, Bridge Inspecting with Unmanned Aerial Vehicles R&D (Tech. Rep. 17STLSU11). Baton Rouge, LA: Transp. Consortium of South-Central States (Tran-SET), 2018.
  • 103
    J. Zink and B. Lovelace, Unmanned Aerial Vehicle Bridge Inspection Demonstration Project (Tech. Rep. MN/RC 2015-40). St. Paul, MN: Minnesota Dept. Transp., 2015, [Online]. Available: https://trid.trb.org/view/1410491
    » https://trid.trb.org/view/1410491
  • 104
    Q. Zhu, T. H. Dinh, M. D. Phung, and Q. P. Ha, “Hierarchical convolutional neural network with feature preservation and autotuned thresholding for crack detection,” IEEE Access, vol. 9, pp. 60201–60214, 2021.
  • 105
    L. Yang, B. Li, W. Li, H. Brand, B. Jiang, and J. Xiao, "Concrete defects inspection and 3D mapping using CityFlyer quadrotor robot,” IEEE/CAA J," Autom. Sin., vol. 7, no. 4, pp. 991–1002, 2020, http://dx.doi.org/10.1109/JAS.2020.1003234
    » http://dx.doi.org/10.1109/JAS.2020.1003234
  • 106
    L. Yang, B. Li, W. Li, Z. Liu, G. Yang, and J. Xiao, “A robotic system towards concrete structure spalling and crack database,” in 2017 IEEE Int. Conf. Robot. Biomimetics (ROBIO), Macau, China, 2017, pp. 1276–1281.
  • 107
    M. R. Saleem, J.-W. Park, J.-H. Lee, H.-J. Jung, and M. Z. Sarwar, "Instant bridge visual inspection using an unmanned aerial vehicle by image capturing and geo-tagging system and deep convolutional neural network," Struct. Health Monit., vol. 20, no. 4, pp. 1760–1777, 2021, http://dx.doi.org/10.1177/1475921720932384
    » http://dx.doi.org/10.1177/1475921720932384
  • 108
    X. Peng, X. Zhong, C. Zhao, Y. F. Chen, and T. Zhang, "The feasibility assessment study of bridge crack width recognition in images based on special inspection UAV," Adv. Civ. Eng., vol. 2020, pp. 1–17, 2020., http://dx.doi.org/10.1155/2020/8811649
    » http://dx.doi.org/10.1155/2020/8811649
  • 109
    P. Chun et al., "Utilization of unmanned aerial vehicle, artificial intelligence, and remote measurement technology for bridge inspections," J. Robot. Mechatron., vol. 32, no. 6, pp. 1244–1258, 2020, http://dx.doi.org/10.20965/jrm.2020.p1244
    » http://dx.doi.org/10.20965/jrm.2020.p1244
  • 110
    B. Lei, N. Wang, P. Xu, and G. Song, "New crack detection method for bridge inspection using UAV incorporating image processing," J. Aerosp. Eng., vol. 31, no. 5, pp. 04018058, 2018, http://dx.doi.org/10.1061/(ASCE)AS.1943-5525.0000879
    » http://dx.doi.org/10.1061/(ASCE)AS.1943-5525.0000879
  • 111
    Z. Yin, Y. Mao, and C. Seto, Develop a UAV Platform for Automated Bridge Inspection (Tech. Rep. 25-1121-0003-295). Lincoln, NE: Mid-America Transp. Center, Mar. 2015. [Online]. Available: https://trid.trb.org/view/1522949
    » https://trid.trb.org/view/1522949
  • 112
    H.-F. Wang, L. Zhai, H. Huang, L.-M. Guan, K.-N. Mu, and G. Wang, "Measurement for cracks at the bottom of bridges based on tethered creeping unmanned aerial vehicle," Autom. Construct., vol. 119, pp. 103330, 2020, http://dx.doi.org/10.1016/j.autcon.2020.103330
    » http://dx.doi.org/10.1016/j.autcon.2020.103330
  • 113
    P. J. Sanchez-Cuevas, G. Heredia, and A. Ollero, “Multirotor UAS for bridge inspection by contact using the ceiling effect,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 767–774.
  • 114
    P. J. Sanchez-Cuevas, P. Ramon-Soria, B. Arrue, A. Ollero, and G. Heredia, "Robotic system for inspection by contact of bridge beams using UAVs," Sens., vol. 19, no. 2, pp. 305, 2019, http://dx.doi.org/10.3390/s19020305
    » http://dx.doi.org/10.3390/s19020305
  • 115
    S. Yoon, G.-H. Gwon, J.-H. Lee, and H.-J. Jung, "Three-dimensional image coordinate-based missing region of interest area detection and damage localization for bridge visual inspection using unmanned aerial vehicles," Struct. Health Monit., vol. 20, no. 4, pp. 1462–1475, 2021, http://dx.doi.org/10.1177/1475921720918675
    » http://dx.doi.org/10.1177/1475921720918675
  • 116
    B. Lei, Y. Ren, N. Wang, L. Huo, and G. Song, "Design of a new low-cost unmanned aerial vehicle and vision-based concrete crack inspection method," Struct. Health Monit., vol. 19, no. 6, pp. 1871–1883, 2020, http://dx.doi.org/10.1177/1475921719898862
    » http://dx.doi.org/10.1177/1475921719898862
  • 117
    C.-H. Yang, M.-C. Wen, Y.-C. Chen, and S.-C. Kang, “An optimized unmanned aerial system for bridge inspection,” in 2015 Proc. 32nd Int. Symp. Automat. Robot. Constr. (ISARC), Oulu, Finland, 2015, pp. 1–6.
  • 118
    A. Khaloo, D. Lattanzi, K. Cunningham, R. Dell’Andrea, and M. Riley, "Unmanned aerial vehicle inspection of the placer river trail bridge through image-based 3D modelling," Struct. Infrastruct. Eng., vol. 14, no. 1, pp. 124–136, 2018.
  • 119
    F. Khan et al., "Investigation on bridge assessment using unmanned aerial systems,” in Struct. Congr. 2015, Portland, OR, USA, 2015, pp. 404–413.
  • 120
    A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, “Low-cost, quantitative assessment of highway bridges through the use of unmanned aerial vehicles,” in Proc. SPIE 9805, Health Monit. Struct. Biol. Syst., Las Vegas, NV, USA, 2016, pp. 612–621, http://dx.doi.org/10.1117/12.2219741
    » http://dx.doi.org/10.1117/12.2219741
  • 121
    L. Yoder and S. Scherer, "Autonomous exploration for infrastructure modeling with a micro aerial vehicle,” in Field and Service Robotics, D. S. Wettergreen and T. D. Barfoot, Eds., Cham: Springer International Publishing, 2016, pp. 427–440, http://dx.doi.org/10.1007/978-3-319-27702-8_28
    » http://dx.doi.org/10.1007/978-3-319-27702-8_28
  • 122
    A. E. Jimenez-Cano, P. J. Sanchez-Cuevas, P. Grau, A. Ollero, and G. Heredia, "Contact-based bridge inspection multirotors: design, modeling, and control considering the ceiling effect," IEEE Robot. Autom. Lett., vol. 4, no. 4, pp. 3561–3568, 2019.
  • 123
    A. E. Jimenez-Cano, J. Braga, G. Heredia, and A. Ollero, “Aerial manipulator for structure inspection by contact from the underside,” in 2015 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), Hamburg, Germany, 2015, pp. 1879–1884.
  • 124
    T. Ikeda et al., “Wall contact by octo-rotor UAV with one DoF manipulator for bridge inspection,” in 2017 IEEE/RSJ Int. Conf. Intell. Robots Syst. (IROS), British Columbia, Canada, 2017, pp. 5122–5127.
  • 125
    T. Ikeda et al., "Stable impact and contact force control by UAV for inspection of floor slab of bridge," Adv. Robot., vol. 32, no. 19, pp. 1061–1076, 2018, http://dx.doi.org/10.1080/01691864.2018.1525075
    » http://dx.doi.org/10.1080/01691864.2018.1525075
  • 126
    A. Ichikawa et al., “UAV with manipulator for bridge inspection: hammering system for mounting to UAV,” in 2017 IEEE/SICE Int. Symp. Syst. Integration (SII), Taipei, Taiwan, 2017, pp. 775–780.
  • 127
    S. Jung et al., “Toward autonomous bridge inspection: a framework and experimental results,” in 2019 16th Int. Conf. Ubiquitous Robots (UR), Jeju, Korea, 2019, pp. 208–211.
  • 128
    A. P. Tomiczek, T. J. Whitley, J. A. Bridge, and P. G. Ifju, "Bridge inspections with small unmanned aircraft systems: case studies," J. Bridge Eng., vol. 24, no. 4, pp. 05019003, 2019, http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001376
    » http://dx.doi.org/10.1061/(ASCE)BE.1943-5592.0001376
  • 129
    C. J. O. Salaan et al., "Close visual bridge inspection using a UAV with a passive rotating spherical shell," J. Field Robot., vol. 35, no. 6, pp. 850–867, 2018, http://dx.doi.org/10.1002/rob.21781
    » http://dx.doi.org/10.1002/rob.21781
  • 130
    M. Yamada, M. Nakao, Y. Hada, and N. Sawasaki, “Development and field test of novel two-wheeled UAV for bridge inspections,” in 2017 Int. Conf. Unmanned Aircr. Syst. (ICUAS), Miami, FL, USA, 2017, pp. 1014–1021.
  • 131
    X. Peng, X. Zhong, C. Zhao, A. Chen, and T. Zhang, "A UAV-based machine vision method for bridge crack recognition and width quantification through hybrid feature learning," Constr. Build. Mater., vol. 299, pp. 123896, 2021, http://dx.doi.org/10.1016/j.conbuildmat.2021.123896
    » http://dx.doi.org/10.1016/j.conbuildmat.2021.123896
  • 132
    H.-J. Jung, J.-H. Lee, S. Yoon, and I.-H. Kim, "Bridge inspection and condition assessment using unmanned aerial vehicles (UAVs): major challenges and solutions from a practical perspective," Smart Struct. Syst., vol. 24, no. 5, pp. 669–681, 2019, http://dx.doi.org/10.12989/sss.2019.24.5.669
    » http://dx.doi.org/10.12989/sss.2019.24.5.669
  • 133
    D. Kang and Y.-J. Cha, “Damage detection with an autonomous UAV using deep learning,” in Proc. SPIE 10598, Sens. Smart Struct. Technol. Civ., Mech., Aerosp. Syst., Denver, CO, USA, 2018, pp. 7–14, http://dx.doi.org/10.1117/12.2295961
    » http://dx.doi.org/10.1117/12.2295961
  • 134
    Z. Ma, E. Zhao, G. Granello, and G. Loporcaro, "Drone aided machine-learning tool for post-earthquake bridge damage reconnaissance,” in 17th World Conf. Earthq. Eng. (WCEE), Sendai, Japan, 2020, pp. 1–12. [Online]. Available: https://hdl.handle.net/10092/101461
    » https://hdl.handle.net/10092/101461
  • 135
    M. M. Karim, C. H. Dagli, and R. Qin, "Modeling and simulation of a robotic bridge inspection system," Procedia Comput. Sci., vol. 168, pp. 177–185, 2020, http://dx.doi.org/10.1016/j.procs.2020.02.276
    » http://dx.doi.org/10.1016/j.procs.2020.02.276
  • 136
    J.-H. Lee, S.-S. Yoon, I.-H. Kim, and H.-J. Jung, “Study on image quality assessment and processing, damage diagnosis of crack for bridge inspection based on unmanned aerial vehicle,” in ACEM18/Struct. 18, Incheon, Korea, 2018, pp. 1–6. [Online]. Available: http://hdl.handle.net/10203/247365
    » http://hdl.handle.net/10203/247365
  • 137
    P. J. Sarkis and J. M. Sarkis, “Uso de drone em inspeção e definição de recuperação em OAEs,” in 9th Cong. Bras. Pontes e Estrut. (CBPE), Rio de Janeiro, Brazil, 2016, pp. 1–10.
  • 138
    T. Harweg, A. Peters, D. Bachmann, and F. Weichert, "CNN-based deep architecture for health monitoring of civil and industrial structures using UAVs," Proc., vol. 42, no. 1, pp. 69, 2020, http://dx.doi.org/10.3390/ecsa-6-06640
    » http://dx.doi.org/10.3390/ecsa-6-06640
  • 139
    E. Bianchi, A. L. Abbott, P. Tokekar, and M. Hebdon, "COCO-bridge: structural detail data set for bridge inspections," J. Comput. Civ. Eng., vol. 35, no. 3, pp. 04021003, 2021, http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000949
    » http://dx.doi.org/10.1061/(ASCE)CP.1943-5487.0000949
  • 140
    J.-H. Lee, S.-S. Yoon, H.-J. Jung, and I.-H. Kim, “Diagnosis of crack damage on structures based on image processing techniques and R-CNN using unmanned aerial vehicle (UAV),” in Proc. SPIE 10598, Sens. Smart Struct. Technol. Civ., Mech., Aerosp. Syst., Denver, CO, USA, 2018, pp. 265–272.
  • 141
    A. Ellenberg, A. Kontsos, F. Moon, and I. Bartoli, "Bridge deck delamination identification from unmanned aerial vehicle infrared imagery," Autom. Construct., vol. 72, pp. 155–165, 2016, http://dx.doi.org/10.1016/j.autcon.2016.08.024
    » http://dx.doi.org/10.1016/j.autcon.2016.08.024
  • 142
    C. Eschmann and T. Wundsam, "Web-based georeferenced 3D inspection and monitoring of bridges with unmanned aircraft systems," J. Surv. Eng., vol. 143, no. 3, pp. 04017003, 2017., http://dx.doi.org/10.1061/(ASCE)SU.1943-5428.0000221
    » http://dx.doi.org/10.1061/(ASCE)SU.1943-5428.0000221
  • 143
    J.-W. Kim, S.-B. Kim, J.-C. Park, and J.-W. Nam, “Development of crack detection system with unmanned aerial vehicles and digital image processing,” in 2015 World Congr. Adv. Struct. Eng. Mechanics (ASEM), Incheon, Korea, 2015, pp. 1–11.
  • 144
    J. D. Mason, E. T. Ayorinde, D. D. Mascarenas, and F. Moreu, Tap Testing Hammer Using Unmanned Aerial Systems (UASs) (Tech. Rep. LA-UR-16-26204). Los Alamos, NM: Los Alamos Nat. Lab. (LANL), 2016.
  • 145
    F. Moreu, E. Ayorinde, J. Mason, C. Farrar, and D. Mascarenas, "Remote railroad bridge structural tap testing using aerial robots," Int. J. Intell. Robot. Appl., vol. 2, no. 1, pp. 67–80, 2018, http://dx.doi.org/10.1007/s41315-017-0041-7
    » http://dx.doi.org/10.1007/s41315-017-0041-7
  • 146
    O. Özcan and O. Özcan, "Multi-hazard assessment of RC bridges using unmanned aerial vehicle-based measurements," Balt. J. Road Bridge Eng., vol. 13, no. 3, pp. 192–208, 2018, http://dx.doi.org/10.7250/bjrbe.2018-13.412
    » http://dx.doi.org/10.7250/bjrbe.2018-13.412
  • 147
    A. Marchewka, P. Ziółkowski, and V. Aguilar-Vidal, "Framework for structural health monitoring of steel bridges by computer vision," Sens., vol. 20, no. 3, pp. 700, 2020, http://dx.doi.org/10.3390/s20030700
    » http://dx.doi.org/10.3390/s20030700
  • 148
    G. Chen, Q. Liang, W. Zhong, X. Gao, and F. Cui, "Homography-based measurement of bridge vibration using UAV and DIC method," Meas., vol. 170, pp. 108683, 2021, http://dx.doi.org/10.1016/j.measurement.2020.108683
    » http://dx.doi.org/10.1016/j.measurement.2020.108683
  • 149
    J. Dang et al., "Arial patrol for bridge routine and post-earthquake emergency inspection using small aerial photography UAV,” in Proc. 5th Int. Symp. Adv. Civ. Environ. Eng. Practises Sustain. Develop. (ACEPS), Galle, Sri Lanka, 2017, pp. 260–267.
  • 150
    J. Dang and P. Chun, "Mixed training of deep convolutional neural network for bridge deterioration detection with UAV and inspection report sourced images,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations CRC Press, 2021, pp. 308–312.
  • 151
    J. Shi, J. Dang, and R. Zuo, "Bridge damage cropping-and-stitching segmentation using fully convolutional network based on images from UAVs,” in Bridge Maintenance, Safety, Management, Life-Cycle Sustainability and Innovations CRC Press, 2021, pp. 264–270.
  • 152
    DJI Official. https://www.dji.com (accessed Sept. 21, 2021).
    » https://www.dji.com
  • 153
    K. Jang, N. Kim, and Y.-K. An, "Deep learning–based autonomous concrete crack evaluation through hybrid image scanning," Struct. Health Monit., vol. 18, no. 5-6, pp. 1722–1737, 2019, http://dx.doi.org/10.1177/1475921718821719
    » http://dx.doi.org/10.1177/1475921718821719
  • 154
    DJI Official. "DJI Unveils Mavic 2 Enterprise." https://www.dji.com/newsroom/news/dji-mavic-2-enterprise (accessed June 4, 2021).
    » https://www.dji.com/newsroom/news/dji-mavic-2-enterprise
  • 155
    M. Gandillon. "Flyability Launches Elios 2 for Intuitive Indoor Inspections." Flyability.com. https://www.flyability.com/news/flyability-elios-2-indoor-inspections (accessed June 10, 2021).
    » https://www.flyability.com/news/flyability-elios-2-indoor-inspections
  • 156
    DJI. "DJI Defines a New Standard for Industrial Tools by Unveiling the Most Advanced Commercial Drone Platform and its First Hybrid Camera Series." DJI Official. https://www.dji.com/newsroom/news/matrice-300-rtk-zenmuse-h20-series (accessed June 4, 2021).
    » https://www.dji.com/newsroom/news/matrice-300-rtk-zenmuse-h20-series
  • 157
    H. Kim, J. Lee, E. Ahn, S. Cho, M. Shin, and S.-H. Sim, "Concrete crack identification using a UAV incorporating hybrid image processing," Sens., vol. 17, no. 9, pp. 2052, 2017, http://dx.doi.org/10.3390/s17092052
    » http://dx.doi.org/10.3390/s17092052

Edited by

Editors: Luís Oliveira Santos, Guilherme Aris Parsekian.

Publication Dates

  • Publication in this collection
    06 May 2022
  • Date of issue
    2023

History

  • Received
    08 Nov 2021
  • Accepted
    09 Mar 2022
IBRACON - Instituto Brasileiro do Concreto Instituto Brasileiro do Concreto (IBRACON), Av. Queiroz Filho, nº 1700 sala 407/408 Torre D, Villa Lobos Office Park, CEP 05319-000, São Paulo, SP - Brasil, Tel. (55 11) 3735-0202, Fax: (55 11) 3733-2190 - São Paulo - SP - Brazil
E-mail: arlene@ibracon.org.br