From BotJunkie:
"This little helicopter is able to understand you when you tell it what to do. No pushing buttons, no using special commands, you just tell it where you want it to go and (eventually) it goes. Of course, I’m sure it required a bit of work to define where “door” and “elevator” and “window” are, but it’s a much more intuitive way to control a UAV that works when your hands are full, when you’re stressed (think military), or simply when you have no idea now to control a UAV.
I don’t have much in the way of other details on this project, besides the fact that it probably comes from the Robust Robotics Group at MIT, and possibly from someone who lives in this dorm. How do I know? Well, one of the research goals of the RRG is “to build social robots that can quickly learn what people want without being annoying or intrusive,” and this video is on the same YouTube channel. ‘Nuff said.
Comments
Although this level of sophistication is probably too much for the typical hobbyist, I'll bet it wouldn't be that difficult to get a groundstation to interpret much simpler commands (e.g. "left", stop" "climb" etc) to command a telemetry equipped UAV
- Roy
How do they do the map thing in the lower right corner?
So i would say it works like this:
-The speech recognition translates the voice input into text.
-the natural language processing system translates the text into a flight plan.
-the 3d navigation system defines the optimal path
- the quad starts to execute the flight plan, adjustments are made to the flight plan to avoid moving obstacles like people until the drone reaches its targeted location.
easy, right? no not at all... great work!
Nice videos Bosak !, amazing !
I have seen a music-controlled research quadcopter at a polytechnic institute at Zurich.
It was oscillating in sync with music from typical mp3 player fed to the machine.
http://roboticcircus.blogspot.com/