Visual Tracking Gimbal Control

Hey peeps,

So I've been playing around with drone videography lately, find it really hard to film stuff while controlling the camera gimbal to keep things i'm interested in frame.

Being a roboticist, I hacked together a working prototype that uses the video stream to track anything I want, using computer vision algorithms:
https://www.youtube.com/watch?v=QJW9ReKU-0I&list=UUy6SYEB_Gk40j9NOy8RI5aQ

Currently, I have a video tracking software running on PC and control a gimbal to keep the region of interest I select in frame. I'm also planning  to dev. an android/ipad app so that you can just multi-touch define a subject with 2 fingers.

Is anyone out there also be into something like this? Would love to hear your feedback!

Thanks in advanced

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • Guys I totally forgot to follow up the thread, a year and half later, this is what we came up with!

    Thanks guys for your support. Without your initial feedback we wouldn't have gone through with it!

    Yan

    • Hi Yan,

      I've been beta testing your vertical application.  On your forum I have suggested that you integrate your technology with Ardupilot, especially given that DJI is offering their own similar technology in the Phantom 4.  Those suggestions where pretty much ignored.

      So I'm a little surprised to find this thread and to learn that this is where you started.  Why the reluctance to use this with the Pixhawk class flight controllers?

      Have you implemented it somewhere and I just missed it?  I think the commercial market will eventually be significantly larger than the consumer market which will provide much more opportunity for third party developers.  Not sure why you want to hitch your wagon solely to DJI? 

       

  • Dear Yan,

    interesting experiment and seems to work. your approach is interesting too. Can we have a conversation soon. Consider this also useful for our project. Also based on reversed use systems. Best Winfriedrijssenbeek@gmail.com 

  • Yan,

    The gimbal controller that seems to be getting the most traction these days is the Storm32 done by a guy call Olli who seems to be surpassing AlexMoss 32 Bit for about the cost of $25 for a 3 Axis open source board. You can check out a huge thread on RC Groups devoted to it. You probably know about it. I believe this kind of gimbal control is one of Olli's stated aims. There might be no synergy at all, and he seems to have no interest in making $$ whatsoever -- so that may be a non-starter.

    Marc

  • Is there a target date for release? And........any idea of the cost? 

    Also, How is this system integrated with the gimbal? I assume it mimics the 1520 microsecond (1.52ms) center position of a standard transmitter and receiver to control yaw and pitch? If so, that would mean it simply replaces or maybe parallels the signal input from the receiver to yaw and pitch? I also assume that a switch would have to be engaged or disengaged to switch between auto operation and manual operation to remove any conflicts or cross signals between your system and the receiver output?

    I'm really interested in this setup as I do  lot of filming of moving subjects. 

    I like to have complete control over where my drone flies. I don't want it to autonomously follow the subject as some other systems already do.

    Thank you for your time!! 

    Merv

  • Hey Yan, your project is really good, congrats!
    I work with search and rescue with airplanes that was crashed, and this one will be a good ideia to my project with my drone!

  • Hey Guys, we just got covered by TechCrunch! Wouldn't have been possible without the amazing feedback we got from you all.

    Please feel free to reach out to us and we'll love to hear what you think of the SHIFT and how we can improve!

    Perceptiv’s SHIFT Turns Drones Into Smart Dollies For Filmmakers
    Drone tech is exciting and full of potential, but few companies are focusing on tech that provides benefits drone users can enjoy now, without spendi…
    • One year already... Please please please do it for planes also ... And let me be your beta user ! :-)

  • Moderator

    Brilliant! There are so many professional and amateur uses for this it's hard to believe it hasn't been done in this way before. We could have used it to great benefit for the last 18 months!

    • Thanks Graham for the love! Hearing that this product solves your problem warms my heart :)

This reply was deleted.

Activity

DIY Robocars via Twitter
RT @chr1sa: Donkeycar 4.4 released with tons of new features, including path learning (useful with GPS outdoors), better Web and Lidar supp…
Nov 27, 2022
DIY Robocars via Twitter
RT @NXP: We are already biting our nails in anticipation of the #NXPCupEMEA challenge! 😉 Did you know there are great cash prizes to be won…
Nov 24, 2022
DIY Robocars via Twitter
RT @gclue_akira: レースまであと3日。今回のコースは激ムズかも。あと一歩 #jetracer https://t.co/GKcEjImQ3t
Nov 24, 2022
DIY Robocars via Twitter
UC Berkeley's DIY robocar program https://roar.berkeley.edu/
Nov 24, 2022
DIY Robocars via Twitter
RT @chr1sa: The next @DIYRobocars autonomous car race at @circuitlaunch will be on Sat, Dec 10. Thrills, spills and a Brazilian BBQ. Fun…
Nov 24, 2022
DIY Robocars via Twitter
RT @arthiak_tc: Donkey car platform ... Still training uses behavioral cloning #TCXpo #diyrobocar @OttawaAVGroup https://t.co/PHBYwlFlnE
Nov 20, 2022
DIY Robocars via Twitter
RT @emurmur77: Points for style. @donkeycar racing in @diyrobocars at @UCSDJacobs thanks @chr1sa for taking the video. https://t.co/Y2hMyj1…
Nov 20, 2022
DIY Robocars via Twitter
RT @SmallpixelCar: Going to @diyrobocars race at @UCSDJacobs https://t.co/Rrf9vDJ8TJ
Nov 8, 2022
DIY Robocars via Twitter
RT @SmallpixelCar: Race @diyrobocars at @UCSDJacobs thanks @chr1sa for taking the video. https://t.co/kK686Hb9Ej
Nov 8, 2022
DIY Robocars via Twitter
RT @PiWarsRobotics: Presenting: the Hacky Racers Robotic Racing Series in collaboration with #PiWars. Find out more and register your inter…
Oct 23, 2022
DIY Robocars via Twitter
RT @Hacky_Racers: There will be three classes at this event: A4, A2, and Hacky Racer! A4 and A2 are based around UK paper sizing and existi…
Oct 23, 2022
DIY Robocars via Twitter
Oct 23, 2022
DIY Robocars via Twitter
Oct 19, 2022
DIY Robocars via Twitter
Oct 18, 2022
DIY Robocars via Twitter
RT @NeaveEng: Calling all UK based folks interested in @diyrobocars, @f1tenth, @donkey_car, and similar robot racing competitions! @hacky_r…
Oct 13, 2022
DIY Robocars via Twitter
RT @araffin2: 🏎️ After hours of video editing, I'm happy to share a best of my Twitch videos on learning to race with RL. 🏎️ Each part is…
Oct 13, 2022
More…