The Skagit River bridge collapse on Interstate 5 in Washington State, USA, got me thinking about using the Arducopter for large, inaccessible infrastructure inspections. I drove my family across this bridge many times so I took its unanticipated collapse harder than most who heard the news in far away places. Granted, metal fatigue or corrosion didn't directly lead to the collapse. Current data (witnesses and surveillance camera footage) point to repeated collisions between a large truck-ferried load and the overhead bridge structure as the truck passed through that section of bridge. But the bridge dates from the 1950s and didn't include redundant load-bearing paths. It's classified as a "fracture critical" bridge. There are more "fracture critical" bridges in the USA and we don't necessarily know their structural health in detail.
The quadcopter platform appears well suited for bridge inspections from beneath or above the bridge deck. I figure it needs to stay in line of sight of an operator's RC controller, needs to provide video on-screen display so the operator sees what the drone sees, and some level of "standoff protection" to keep the quad from striking the bridge structure. The bridge is more dangerous to the quad than the quad is to the bridge. Maybe ultrasonic ranging for structure following or standoff might do the trick. The quadcopter must keep its distance from the structure while under control of the operator, though. I lean toward a "hard envelop limiter" in the control law or control mode software so the quad won't hit the inspected item no matter what the operator commands ( or a variable limiter that requires a lot of operator override to get the quad closer, that's more in keeping with my Boeing bias.)
The quad blades may require a perimeter shield round the blades to keep them from contacting bridge structure, too. Just in case a wind gust shove the "airbot" inspector too close to the structure.
Protecting the quadcopter from inadvertent structure contact is an interesting problem in itself. It seem tractable on the surface. The greater challenge is remote sensing of the structure. What kind of sensors can a quad carry near to a structure to probe its integrity? Is it limited to passive sensing (optical) or active sensing (induction from a distance, or via a probe, to measure structure response, or sampling (wow, take a flake), or ultrasound? We can learn a lot by dumping some energy into the structure and measuring its response, in addition to watching it in parts of the visual spectrum.
Remote sensing satellites solved a lot of these problems. They may offer direct of indirect advice on the sensor approach. Satellite sensors can measure the reflected light spectrum from soils, plants, rocks, for example. Making sense of the spectra requires "ground truth" measurements. The spectra need to be calibrate to soil or plant conditions and mineral types.
But paint can mask rust. And fatigue cracks may not show at the structure surface. If this is the case, then energy needs to be directed into the structure, from the quad, and it's effects need to be measured, by the quad. The wikipedia entry on non-destructive metal testing lists some interesting methods that could (in theory) be adapted to a quad - such as magnetic particle testing, liquid penetrate testing, and methods that require some form of physical contact during the measurement, like eddy current testing, ultrasound testing.
Physical contact testing would be a challenge in that the quad need to station keep, not hit the structure, and simultaneously extend one or more devices to make contact with the structure during the test. Is that a great controls problem or what? And more - the quad measurement device needs energy (battery) and that's weight. The quad itself needs energy from a battery to fly for a while - 10 minutes or so. This may be the biggest challenge to quad copters that actively probe structures. The energy need to fly and actively probe the structure must be provided by batteries. It may be a difficult optimization to allow a reasonable inspection and reasonable mission time.
Passive structure observation seems like a shoe-in with a quad and one or more cameras, with respect to passively probing the structure and mission time. A quad can take close-up video and pictures of structures illuminated from beyond the quad by the operator. That can address the battery issue - if the operator can use a different device to illuminate the structure with ultraviolet or infrared or laser, and the quad can measure the reflected result, then the "active probe" is not on the quad, doesn't need to be lifted and doesn't need to be powered by the quad.
But the kinds of light we can shine on the subject may not illuminate all possible defects we want to detect.
Overall an interesting set of engineering problems, when we think about using a quad copter to inspect structures...
Comments
The Washington State DOT Bridge Inspection Manual in on-line for the public. It gives examples, including pictures, of the kinds of wear and tear to be checked for visually by bridge element type, the acceptable kinds of wear, and the actionable kinds of wear or damage. See Chapter 4.
http://www.wsdot.wa.gov/publications/manuals/fulltext/m36-64/bridge...
An inspection drone under operator guidance would need to accomplish the same kinds of visual inspections. The manual also covers acceptable Ultrasonic Test results for bridge element types.
An inspection drone doesn't take people out of the visual inspection loop. The inspection drone operator may also be the subject matter expert (SME) for corrosion and wear assessment at the site. Or the SME may be looking at the same image on another display as the operator flies the drone, or it autonomously flies. Inspection drones could also allow for long-distance collaboration with off--site human inspectors, like we see in radiology today. Hospitals and clinics can send x-rays and other scans to remote sites for near-real time or batch "processing." The hospital doesn't keep its own radiology staff and instead relies on radiology expertise as needed. Inspection experts can assess the images from many structures from a wide area, using the drones (and a field team) as their eyes (and other senses.) That could lead to significant cost savings.
I hate to burst everyone's bubble, but this technology (IR, LIDAR, etc.) isn't widely used now (at least not in the States), nevermind with the assistance of drone technology due to cost effectiveness. Drones aren't going to make it that much cheaper. Municipalities and State DOTs don't have the budgets for this kind of thing. The bridge engineers in my firm do the majority of inspections on foot or with the assistance of a bucket truck or other similar specialized vehicle. When drones can't assist with an inspection due to weather, wind, etc., it doesn't make their use very practicle either no matter what the cost savings might be otherwise.
I agree with R Lefebvre who said, "Just to play devil's advocate on this one... how is a quadcopter, or any unmanned system (boat, rover, etc.) a better tool for this job than simply sending in an engineer on foot?
I do see a pretty good opportunity for a UAV to inspect the the underside of the bridge, avoiding the need for complicated rigging for a human to do it. But the topside? Especially for a low bridge such as this?"
I also don't see drones doing any probing or taking rust samples, which, by the way isn't a common practice in most bridge inspections either.
I love that you're thinking about marketable applications for UA. I am an Aerospace Engineering student and Space Policy and STEM advocate, making yearly trips to Capitol Hill. I am currently working on an info packet and editorials for uses and markets for UA, in response to the legislative concern I have recently been presented with in the US congress.
Other applications to keep in mind are;
Disaster response- Imagine UAs sweeping areas devastated by tornadoes and hurricanes. They could be used to focus search efforts, survey damage and detect gas leaks and downed power lines ahead of rescuers.
Utility and Structural Inspection- Power lines, bridges, dams, towers, pipelines, etc can all benefit from UA remote inspection.
Security- Critical security areas (think Boston Marathon, etc) could benefit from aerial surveillance and crowd control.
The list is endless.
Great and interesting comments, everyone - my thanks!
@ Max Levine - the aerial inspection services video is spot on, using different imaging sensors to examine the
@R_Lefebvre - it can make sense to use drones over direct person inspection whenever the cost of direct person inspection exceeds the cost of remote inspection by drone. Cost would include the risk to human safety to accomplish the inspection, and the cost of conducting the inspection. Closing a bridge for a day in order to check it from one end to another costs the local economy some (computable) amount. Hanging inspectors over and under the bridge deck in "cherry picker" baskets can require a bridge closure while it puts the inspector's safety at risk. Climbing the bridge structure above the deck is also a risk.
@ Monroe Lee King Jr - those are great examples of large infrastructure posing risk to human physical inspection - antennae, smokestacks, petroleum refineries and chemical plants, fuel depots, etc. The Skagit Bridge may not be the ideal candidate for quad/octocopter inspection, but there is a bridge size/traffic level/height above water combination where it may be more cost effective to use remote sensors to up-close inspect the bridge in broad terms, with targeted human inspection of trouble spots identified by the drone inspection.
@FD - yes, breaking down inspections into different detail types, by task and tools, would clarify the need for remote quad/octocopter inspection. Thanks!
@Bruno Guerreiro - interesting! Can you tell us more about the diagnostic capabilities of LiDAR mapping of the structure? How does the approach reveal fatigue cracking in the structure, or corrosion? Is it detected by subtle changes in the shape of the structure over time? Can it pick up on changes in bending mode frequencies and amplitudes over time?
Oh yeah, I absolutely agree that these other types of structures are perfect applications for the technology. I was just asking because this particular bridge doesn't strike me as a great candidate but was being used as an example application.
Just to play devil's advocate on this one... how is a quadcopter, or any unmanned system (boat, rover, etc.) a better tool for this job than simply sending in an engineer on foot?
I do see a pretty good opportunity for a UAV to inspect the the underside of the bridge, avoiding the need for complicated rigging for a human to do it. But the topside? Especially for a low bridge such as this?
Hi John,
thanks for sharing the thoughts, I think this is an interesting engineering task.
One thought coming to my mind was whether the task of inspection can be broken down regarding the detail levels / tools of inspection. Let's assume not all parts of a bridge are critical, can the critical parts first be inspected on a visual level with HD video / multispectral cameras, etc. and then after a first round of analysis, the next level of inspection using more sophisticated (but also more time consuming) methods starts.
Regarding flight time: could some form of perching help, such as these types of magnets that can be switched on/off with low energy consumption: http://www.kickstarter.com/projects/412473553/opengrab-open-hardwar... or maybe some suction devices such as the ones used by ETHZ's construction copters?
Regarding positioning: is anybody aware of some cheap way of "beacon" (I remember Ardubeacon) as a means of referencing a copter's location relative to a (precisely) known device? That would be useful in many other applications as well (such as follow-me or breadcrumbs-style orientation). The next best thing I know are avalanche beacons or those things used by the ARDF people: http://en.wikipedia.org/wiki/Amateur_radio_direction_finding
Cheers,
Florian
GPS would only be a long term correction tool. To get the LIDAR accuracy need for inspecting structural integration, the positional correction would have to operate at a very high frequency and accuracy. And even more important would be tracking rotation since that would affect the scan result the most..
I have some ideas for placing high speed HD cameras with zoom lenses at ground level pointing at the copter, and tracking the copter motion for post correction of the scan. But it would not be a very in-the-field friendly setup.
I've been working on this subject for some years. We're using big RC helicopters to put SLR cameras, LiDARs several high quality GPSs, infrared cameras, and so on.
Despite our (very) low budgets for research (we're in Portugal), we've managed to acquire high quality LiDAR data and image of several of these critical infrastructures, as can be seen in the picture below.
The problems for LiDAR reconstruction are the lack of accurate GPS signals (specially near bridges), payload for HD imaging/infrared,vibration, and the perfect sensor fusion that must be used for accurate pose estimation. The unreliability of GPS is also a huge problem in the operation of drones near these structures, as the operator will have to fly without any GPS mode, and severe wind gusts will appear...