http://www.canadianmanufacturing.com/design-engineering/news/canadian-face-detecting-drones-respond-to-voice-gesture-commands-design-eng-125448

 

Researchers at Vancouver’s Simon Frasier University have developed a fleet of Unmanned Aerial Vehicles (UAV) that accept group voice commands or can be controlled silently through hand gestures. In addition, individual drones recognize which of them their controller is speaking to via on-board face recognition cameras.

Once a drone recognizes it is being singled out, it can be commanded to join or remove itself from the group. Packs of drones can then be given group commands such as take off, land or perform a pre-set mission.

To determine which of the drones is being commanded, each UAV rates the angle of the controller’s face relative to the camera. After comparing each other’s “Face Rank”, the drone with the highest score is then deemed to be the one targeted.

The controller can then tell the targeted drone to join the group by saying “And you” or remove one from the group with “not you”. Alternately, a controller can add drones by waving their right hand. Once grouped, sets of drones can be commanded with “You two” or “You three” to perform the same action simultaneously.

Presented at the the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) in Japan this month, the researchers’ paper (pdf link) says work still needs to be done on the robotic drones face recognition system. In addition, they hope to expand voice commands so groups of drones can be given names (e.g. “You all are team red” etc.)

E-mail me when people leave their comments –

You need to be a member of diydrones to add comments!

Join diydrones

Comments

  • Great job  and keep up the good job.

  • Wondering what is the purpose to "talk" directly to drone and drone to recognize you. When drone is at few meters away, yes, it makes sense.

    But when drone in "mission", then scenario is different.

    I am sure actual Mission Planer could  use the existing scripting feature and with a voice recognition API software conversion, could translate those commands into signals for drone.

    Not gesture, not face recognition, but at least voice recognition.

  • Distributor

    Canada RULES!  hehehe  nice toy! 

  • Admin

    Good.

    Thats how you use the media to your advantage. Use embedded code and paste it after  clicking media. Cheers

This reply was deleted.