Canadian face-detecting drones respond to voice, gesture commands


Researchers at Vancouver’s Simon Frasier University have developed a fleet of Unmanned Aerial Vehicles (UAV) that accept group voice commands or can be controlled silently through hand gestures. In addition, individual drones recognize which of them their controller is speaking to via on-board face recognition cameras.

Once a drone recognizes it is being singled out, it can be commanded to join or remove itself from the group. Packs of drones can then be given group commands such as take off, land or perform a pre-set mission.

To determine which of the drones is being commanded, each UAV rates the angle of the controller’s face relative to the camera. After comparing each other’s “Face Rank”, the drone with the highest score is then deemed to be the one targeted.

The controller can then tell the targeted drone to join the group by saying “And you” or remove one from the group with “not you”. Alternately, a controller can add drones by waving their right hand. Once grouped, sets of drones can be commanded with “You two” or “You three” to perform the same action simultaneously.

Presented at the the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in Japan this month, the researchers’ paper (pdf link) says work still needs to be done on the robotic drones face recognition system. In addition, they hope to expand voice commands so groups of drones can be given names (e.g. “You all are team red” etc.)

Views: 825

Comment by Morli on November 28, 2013 at 1:54pm


Thats how you use the media to your advantage. Use embedded code and paste it after  clicking media. Cheers

Comment by Dany Thivierge on November 28, 2013 at 2:01pm

Canada RULES!  hehehe  nice toy! 

Comment by criro1999 on November 28, 2013 at 3:59pm

Wondering what is the purpose to "talk" directly to drone and drone to recognize you. When drone is at few meters away, yes, it makes sense.

But when drone in "mission", then scenario is different.

I am sure actual Mission Planer could  use the existing scripting feature and with a voice recognition API software conversion, could translate those commands into signals for drone.

Not gesture, not face recognition, but at least voice recognition.

Comment by Nabil Aldhaleai on February 15, 2015 at 1:19pm

Great job  and keep up the good job.


You need to be a member of DIY Drones to add comments!

Join DIY Drones


Season Two of the Trust Time Trial (T3) Contest 
A list of all T3 contests is here. The current round, the Vertical Horizontal one, is here

© 2019   Created by Chris Anderson.   Powered by

Badges  |  Report an Issue  |  Terms of Service