3D Robotics

Let Skynet Become Self-Aware!

3689666587?profile=original

Here's a crosspost of my article this morning in Hackaday. We'll see how many people get the Terminator joke. 

Not so long ago, it was hard to fly. Forget actual manned aircraft and pilots licenses; even flying model aircraft required hours of practice, often under the tutelage of a master at a flying field. But along with that training came an education in the rules of safe flight, including flying at a designated airfield and watching out for obstacles.

We accidentally messed that up. We in the drone industry made aircraft super easy to fly — perhaps too easy to fly. Thanks to smart autopilots and GPS, you can open a box, download an app and press “take off”. The copter will dutifully rise into the air and wait there for further instructions — no skill required. And it will do this even if you happen to be in an NFL football stadium in the middle of a big game. Or near an airport. Or in the midst of a forest fire.

The problem is that along with taking training out of the process of flying a drone, we inadvertently also took out the education process of learning about safe and responsible flight. Sure, we drone manufacturers include all sorts of warning and advisories in our instructions manual (which people don’t read) and our apps (which they swipe past), and companies such as DJI and my own 3DR include basic “geofencing” restrictions to try to keep operators below 400 feet and within “visual line of sight”. But it’s not enough.

Every day there are more reports of drone operators getting past these restrictions and flying near jetliners, crashing into stadiums, and interfering with first responders. So far it hasn’t ended in tragedy, but the way things are going it eventually will. And in the meantime, it’s making drones increasingly controversial and even feared. I call this epidemic of (mostly inadvertent) bad behavior “mass jackassery”. As drones go mass market, the odds of people doing dumb things with them reach the singularity of certainty.

We’ve got to do something about this before governments do it for us, with restrictions that catch the many good uses of drones in the crossfire. The reality is that most drone operators who get in trouble aren’t malicious and may not even know that what they’re doing is irresponsible or even illegal. Who can blame them? It’s devilishly hard to understand the patchwork quilt of federal, state and local regulations and guidelines, which change by the day and even the hour based on “airspace deconfliction” rules and FAA alerts written for licensed pilots and air traffic control. Many drone owners don’t even know that such rules exist.

Drones Themselves Should Know Rules of Each Area

Fortunately, they don’t have to. Our drones can be even smarter — smart enough to know where they should and shouldn’t fly. Because modern drones are connected to phones, they’re also connected to the cloud. Every time you open their app, that app can check online to find appropriate rules for flight where you are, right then and there.

Here’s how it works. The app sends four data fields to a cloud service: Who (operator identifier), What (aircraft identifier), Where (GPS and altitude position) and When (either right now or a scheduled time in the case of autonomous missions). The cloud service then returns a “red light” (flight not allowed), a “green light” (flight allowed, with basic restrictions such as a 400 feet altitude ceiling), or “yellow light” (additional restrictions or warnings, which can be explained to the operator in context and at the point of use).

image01

Right now industry groups such as the Dronecode Foundation, the Small UAV Coalition (I help lead both of them, but this essay just reflects my own personal views) and individual manufacturers such as 3DR and DJI are working on these “safe flight” standards and APIs. Meanwhile, a number of companies such as Airmap and Skyward are building the cloud services to provide the up-to-date third-party data layer that any manufacturer can use. It will start with static no-fly zone data such as proximity to airports, US national parks and other banned airspace such as Washington DC. But it will quickly add dynamic data, too, such as forest fires, public events, and proximity to other aircraft.

(For more on this, you can read a white paper from one of the Dronecode working groups here and higher level description here.)

There’s Always a Catch

Of course, this system isn’t perfect. It’s only as good as the data it uses, which is still pretty patchy worldwide, and the ways that the manufacturers implement those restrictions. Some drone makers may choose to treat any area five miles from an airport as a hard ban and prohibit all flight in that zone, even at the cost of furious customers who had no idea they were five miles from an airport when they bought that toy at Wal-mart (nor do they think it should matter, since it’s just a “toy”). Other manufacturers may choose to make a more graduated restriction for the sake of user friendliness, adding a level of nuance that is not in the FAA regulation. They might ban, say, flight one mile from an airport, but only limit flight beyond that to something like 150ft of altitude (essentially backyard-level flying).

That’s a reasonable first step. But the ultimate safe flight system would go a lot further. It would essentially extend the international air traffic control system to millions of aircraft (there are already a million consumer drones in the air) flown by everything from children to Amazon. The only way to do that is to let the drones regulate themselves (yes, let Skynet become self-aware).

Peer-to-peer Air Traffic Control

There’s a precedent for such peer-to-peer air traffic control: WiFI. Back in the 1980s, the FCC released spectrum in the 2.4 Ghz band for unlicensed use. A decade later, the first 802.11 standards for Wifi were released, which was based on some principles that have application to drones, too.

  1. The airspace used is not otherwise occupied by commercial operators
  2. The potential for harm is low (in the case of WiFi, low transmission power. In the case of drones, low kinetic energy due to the weight restrictions of the “micro” category)
  3. The technology has the capability to self-”deconflict” the airspace by observing what else is using it and picking a channel/path that avoids collisions.

That “open spectrum” sandbox that the FCC created also created a massive new industry around WiFi. It put wireless in the hands of everyone and routed around the previous monopoly owners of the spectrum, cellphone carriers and media companies. The rest was history.

We can do the same thing with drones. Let’s create an innovation “sandbox” with de minimus regulatory barriers for small UAVs flying within very constrained environments. The parameters of the sandbox could be almost anything, as long as they’re clear, but it should be kinetic energy and range based (a limit of 2kg and 20m/s at 100m altitude and 1,000m range within visual line of sight would be a good starting point).

As in the case of open spectrum, in relatively low risk applications, such as micro-drones, technology can be allowed to “self-deconflict the airspace” without the need for monopoly exclusions such as exclusive licences or regulatory permits. How? By letting the drones report their position using the same cellphone networks they used to get permission to fly in the first place. The FAA already has a standard for this, called ADS-B, which is based on transponders in each aircraft reporting their position. But those transponders are expensive and unnecessary for small drones, which already know their position and are connected to the cloud. Instead, they can use “virtual ADS-B” to report their position via their cell network connections, and that data can be injected into the same cloud data services they used to check if their flight was safe in the first place.

Once this works, we’ll have a revolution. What WiFi did the telecoms industry, autonomous, cloud-connected drones can do to the aerospace industry. We can occupy the skies, and do it safely. Technology can solve the problems it creates.


E-mail me when people leave their comments –

You need to be a member of diydrones to add comments!

Join diydrones

Comments

  •      quid pro quo is appropriate here

  • You can always tell when an industry has been co-opted by the 'suits.'  They will call for greater regulation, licensing, and other such nonsense measures.  It is also the relative death of that industry as well.  Fortunately I don't have a profit motive and I do this for the intellectual challenge alone.  Given the current push by these individuals, I recommend one stockpiles whatever parts (hardware and software) they need to be able to continue their endeavors in private.  Quis custodiet ipsos custodes?

  • Great article Chris. Many similarities to what I've been quietly promoting to internal & some gov't reps for some time... and there's a few startups (Neil, I'm looking at you) that are heading right into this space. I suggest folks google 'multichannel mesh networks' (like this -- we've been doing similar for the last couple of years), and non-wire based comm protocols, cause that's where we are heading.

    In the end, the 2 enablers of this technology are Localization (GPS mainly) and RF Robustness (FHSS mainly). Hence, hazard assessment for these enablers must be addressed, through a common infrastructure/paradigm before we open the flood gates for full commercialization. Everything else relies on this. In the end, it's getting the information to the ground to help the smarts in the sky, or in other words: using the right tool for the right context.

    The WiFi model is a great start, though I prefer the cellular model instead--self-heals faster at the expense of bandwidth from an architectural standpoint...

    Lastly, we'll be in good company when the autonomous cars and boats ;) come into scene, same issues...

  • If the people wont be informed we just inform the drones.

    If you want special privileges get a license

    Sounds like a great solution to me. 

  • MR60

    So far , comments and reactions for finding a solution could be summarized & classified in the following categories:

    -Those advocating better user awareness and education, asking for more operator's responsibility

    -Those advocating future advancements in technology , substituting parts( or all of) the operator's responsibility

    We'll see, if in the next stages of this interesting discussion/debate, other solution categories will emerge...

  • Chris

    Man it is good to see you taking the lead in innovative technology for drone safety!

    I think for starters it would not be difficult to limit altitude and LOS range based on a laser range finder and RSSI signal strength.

    Second I would use the FAA charts to avoid air traffic routes completely and limit range to airports. I would include up to date no fly zones on the state and local level.

    Third I'd use ADSB for avoidance because this standard should be implemented in all aircraft in the near term and also avoid first response issues.

    It would seem to me that on start the drone would download the area rules determined by GPS and would not enable until that is complete.

    There would be no more debate about these issues ever again.

    The drone could check for updates on the fly and do an automatic RTL if there are updates.

    Getting the FAA to speed up ADSB implementation would be a much easier avoidance task.

    Disabling any of these safety features would then put the target on the real issue the jackass that did it.

    If your interested I would take on the job of helping you make that happen in all aspects.  

  • I'm looking for the birds that can fly 500 mph horizontally through cloud.  Am I missing something?

  • Also, with a huge grin on my face, I propose we are replicating the future as envisioned by the movieWALL-E crossed with Idiocracy.  :)

  • @rob_lefebvre, here's a link to some fairly fast flying birds. 

    Fast Birds Link

    They fly pretty fast and in close proximity to the kinds of environments that most of the drone industry is interested in conquering. 

    List of birds by flight speed
    This is a list of the fastest flying birds in the world. A bird's velocity is necessarily variable; a hunting bird will reach much greater speeds whi…
  • I would propose a slight variation on Chris's proposed scheme.

    Vehicles would download regional information for their location and save it locally.  If when they boot up, they find themselves outside of their saved area, and with no network, they will refuse to arm.  If they are inside the area of locally stored data, but have no network connection, they will allow flight, but only with extreme caution.  Low altitude, short range, etc.

    If the system finds that it has network connection, then it would allow extended flight capabilities. Longer ranges, higher altitudes, etc.

    There could be some exceptions made for certified professional operators.

This reply was deleted.