Vision based upgrade for Aerial filmmakers

1911204.jpg?950

Hey guys,

An update for you all from before (here). We got some awesome feedback from you guys last time about our work on vision-based tracking and intelligence for drones. Check out our demo reel and launch video here:

https://www.youtube.com/watch?v=5_DdVMLJa5U

https://www.youtube.com/watch?v=7rCkB8Dg_Zs

Based on all your comments we improved our algorithms and packaged them into a feature-rich product for aerial film-makers that we’re pretty excited to share with you all today.

It’s called the SHIFT and it’s a film-maker’s smart upgrade kit for drones that simplifies many of the complexities of filming with a flying camera. The SHIFT plugs into your autopilot (currently supporting DJI and 3DR) and partially takes over control of the drone and gimbal to let you auto-frame moving subjects and fly smooth, precise paths - totally sweat free.

Thanks to an overwhelming response from aerial filmmakers we’re now launching a pre-order campaign for the SHIFT on our website: http://www.flytheshift.com

We’re working with film-makers on a whole lot more features to add new levels of creative freedom to aerial filming. Like us on facebook and we’ll keep you updated! If you guys have more questions, feel free to ask. And for all you aerial cinematographers around do read our FAQ or contact us directly :) We’d love to hear from you!

Your friends at Perceptiv Labs!

http://www.flytheshift.com

You need to be a member of diydrones to add comments!

Join diydrones

Comments

Euan Ramsay February 24, 2015 at 2:01am

Biggest thing in your material is the tie to specific gimbals and cameras. Can this kit be made to work with DSLR gimbals? A simple bracket for the camera, and signals for alexmos 32bit boards is what I'm thinking.
Julien Dubois February 24, 2015 at 12:02am

Great job!!! seems you've outclassed http://hexoplus.com/
Yan Ma February 23, 2015 at 4:52pm

@Crispin thanks! Super rewarding to hear that.
Yan Ma February 23, 2015 at 4:40pm

Hi Jonathan,

Yes! There is a WiFi connection to a phone or a tablet for camera control.

Essentially your tablet/phone will act as a smart FPV kit that allows camera control using the touch interface. Our current prototype streams video from the SHIFT camera at a resolution of 320x240 at 30fps. Our range is approximately 300m, and we have identified solutions that boost the range upto 500m or above. Based on the data we have right now, our latency is within 100ms, and we are definitely looking to improve with better compression algorithms and transport protocols.

Thanks for reaching out with these great questions, and we will post the specs on our website very soon!

Cheers,

Yan
Crispin February 23, 2015 at 4:29pm

Very very cool.
Jonathan Hair February 23, 2015 at 4:19pm

Really impressed!

Maybe i missed this, but there is a WiFi connection to phone or tablet for framing and control?

Can you give range, resolution, and latency specs on that?

Cheers,
Yan Ma February 23, 2015 at 10:41am

Hey Daniel, actually it didn't do redetection, sorry for the confusion.

The point of that clip was to show how easy it is to reinitiate tracking. But yes, global redetection and prediction via motion model of an tracked object are in the works!
Yan Ma February 23, 2015 at 10:32am

@vis.asta, super cool! I'm so jealous of your drone. Are you doing processing onboard?
vis.asta February 23, 2015 at 10:27am

our tests: :)

https://www.youtube.com/watch?v=o8owVfs-rPg
Daniel Nugent February 23, 2015 at 10:26am

Ok. The occlusion detection with the car was neat. Does it actually predict the location of a moving target or does it just mark the frame position where the target was last seen?

of 3

This reply was deleted.