Visual Tracking Gimbal Control

Hey peeps,

So I've been playing around with drone videography lately, find it really hard to film stuff while controlling the camera gimbal to keep things i'm interested in frame.

Being a roboticist, I hacked together a working prototype that uses the video stream to track anything I want, using computer vision algorithms:
https://www.youtube.com/watch?v=QJW9ReKU-0I&list=UUy6SYEB_Gk40j9NOy8RI5aQ

Currently, I have a video tracking software running on PC and control a gimbal to keep the region of interest I select in frame. I'm also planning  to dev. an android/ipad app so that you can just multi-touch define a subject with 2 fingers.

Is anyone out there also be into something like this? Would love to hear your feedback!

Thanks in advanced

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • Guys I totally forgot to follow up the thread, a year and half later, this is what we came up with!

    Thanks guys for your support. Without your initial feedback we wouldn't have gone through with it!

    Yan

    • Hi Yan,

      I've been beta testing your vertical application.  On your forum I have suggested that you integrate your technology with Ardupilot, especially given that DJI is offering their own similar technology in the Phantom 4.  Those suggestions where pretty much ignored.

      So I'm a little surprised to find this thread and to learn that this is where you started.  Why the reluctance to use this with the Pixhawk class flight controllers?

      Have you implemented it somewhere and I just missed it?  I think the commercial market will eventually be significantly larger than the consumer market which will provide much more opportunity for third party developers.  Not sure why you want to hitch your wagon solely to DJI? 

       

  • Dear Yan,

    interesting experiment and seems to work. your approach is interesting too. Can we have a conversation soon. Consider this also useful for our project. Also based on reversed use systems. Best Winfriedrijssenbeek@gmail.com 

  • Yan,

    The gimbal controller that seems to be getting the most traction these days is the Storm32 done by a guy call Olli who seems to be surpassing AlexMoss 32 Bit for about the cost of $25 for a 3 Axis open source board. You can check out a huge thread on RC Groups devoted to it. You probably know about it. I believe this kind of gimbal control is one of Olli's stated aims. There might be no synergy at all, and he seems to have no interest in making $$ whatsoever -- so that may be a non-starter.

    Marc

  • Is there a target date for release? And........any idea of the cost? 

    Also, How is this system integrated with the gimbal? I assume it mimics the 1520 microsecond (1.52ms) center position of a standard transmitter and receiver to control yaw and pitch? If so, that would mean it simply replaces or maybe parallels the signal input from the receiver to yaw and pitch? I also assume that a switch would have to be engaged or disengaged to switch between auto operation and manual operation to remove any conflicts or cross signals between your system and the receiver output?

    I'm really interested in this setup as I do  lot of filming of moving subjects. 

    I like to have complete control over where my drone flies. I don't want it to autonomously follow the subject as some other systems already do.

    Thank you for your time!! 

    Merv

  • Hey Yan, your project is really good, congrats!
    I work with search and rescue with airplanes that was crashed, and this one will be a good ideia to my project with my drone!

  • Hey Guys, we just got covered by TechCrunch! Wouldn't have been possible without the amazing feedback we got from you all.

    Please feel free to reach out to us and we'll love to hear what you think of the SHIFT and how we can improve!

    Perceptiv’s SHIFT Turns Drones Into Smart Dollies For Filmmakers
    Drone tech is exciting and full of potential, but few companies are focusing on tech that provides benefits drone users can enjoy now, without spendi…
    • One year already... Please please please do it for planes also ... And let me be your beta user ! :-)

  • Moderator

    Brilliant! There are so many professional and amateur uses for this it's hard to believe it hasn't been done in this way before. We could have used it to great benefit for the last 18 months!

    • Thanks Graham for the love! Hearing that this product solves your problem warms my heart :)

This reply was deleted.

Activity

DIY Robocars via Twitter
RT @gclue_akira: 柏の葉で走行させてるjetracerの中身 #instantNeRF #jetracer https://t.co/giVvuE4hP7
Jul 4
DIY Robocars via Twitter
Cool web-based self-driving simulator. Click save when the AI does the right thing https://github.com/pncsoares/self-driving-car
Jul 4
DIY Robocars via Twitter
RT @donkey_car: Human-scale Donkey Car! Hope this makes it to a @diyrobocars race https://www.youtube.com/watch?v=ZMaf031U8jg
Jun 25
DIY Robocars via Twitter
Jun 25
DIY Robocars via Twitter
Jun 16
DIY Robocars via Twitter
RT @GrantEMoe: I won my first @diyrobocars @donkey_car virtual race! Many thanks to @chr1sa @EllerbachMaxime @tawnkramer and everyone who m…
Jun 13
DIY Robocars via Twitter
RT @gclue_akira: JetRacerで自動走行したコースを、InstantNeRFで再構築。データセットは別々に収集 #jetracer #instantNeRT https://t.co/T8zjg3MFyO
Jun 13
DIY Robocars via Twitter
RT @SmallpixelCar: SPC 3.0 Now the motor also works. This car is doable. I just need to design a deck to mount my compute and sensors. http…
Jun 13
DIY Robocars via Twitter
RT @SmallpixelCar: My new car SPC 3.0. https://t.co/CKtkZOxeNQ
Jun 7
DIY Robocars via Twitter
RT @SmallpixelCar: High speed at @diyrobocars thanks @EdwardM26321707 for sharing the video https://t.co/o4317Y2U1S
Jun 7
DIY Robocars via Twitter
RT @SmallpixelCar: Today at @RAMS_RC_Club for @diyrobocars. Used @emlid RTK GPS and @adafruit @BoschGlobal IMU. Lap time 28s https://t.co/R…
May 28
DIY Robocars via Twitter
May 15
DIY Robocars via Twitter
May 14
DIY Robocars via Twitter
May 13
DIY Robocars via Twitter
RT @f1tenth: Say hi to our newest #F1TENTH creation for @ieee_ras_icra next week in Philly. It’s going to be huge! 😎 🔥 @AutowareFdn @PennEn…
May 13
DIY Robocars via Twitter
May 11
More…