APM + OpenCV

Hello guys,i need some help and advice. i've a mission in a competition. The mission state that my UAV have to scan and detect a 'X" target on the ground and loiter b4 release a sand bomb onto the target.  i've seen that this mission need image processing by a camera and send the data back to APM to command the rotor to fly and loiter, then command a servo to release  a bomb. Image processing can done by using OpenCV on ground station. but i wonder how the camera can transfer the real time image data to OpenCV and the OpenCV transfer to APM as an input to the servo??

my option is using the video telemetry for transferring the real time image data to openCV. is it the correct way?

but how the openCV data transfer to APM??

Anyone can give some ideas??

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • I have been looking at a similar use case, where a copter could LAND on a visual target, based on control inputs generated from computer vision on an onboard camera. That would be an amazing transitional-technlology capability, useful for deliveries, before Lidar and other advanced sensors come out of the labs.

    There is this sensor board, which might be usable to do the processing on board:

    https://store.3drobotics.com/products/px4flow

    The NKE Hunter UAV is not a copter, but it does vision-based target drops (Supplies, not sand bombs in this case - but from the UAV's perspective the difference is minor :-). The Hunter is based on open source stacks, including OpenCV.

    http://www.novemberkiloecho.com/robots/hunter-synthetic-vision-robo...

    Regards,

    Knut

This reply was deleted.

Activity

DIY Robocars via Twitter
RT @_JonMyer: 🚨Attention DeepRacer's including #UndergroundDeepRacer🚨 Check our our LIVE stream that including @IAM_dbro Take a few moments…
Wednesday
DIY Drones via Twitter
RT @MarvelmindMaxim: Extreme precision for 60 swarming robots. #marvelmind #autonomousrobotics #robotics #swarmrobotics #rtls #ips #indoor…
Monday
DIY Drones via Twitter
RT @MarvelmindMaxim: Precise (±2cm) tracking for racing boats and autonomous boats. Works outdoor and indoor. #autonomous #AutonomousVehic…
Monday
DIY Drones via Twitter
RT @MarvelmindMaxim: Helping PixHawk folks to fly autonomous quadcopters using PX4 and ArduPilot. https://marvelmind.com/drones/ Equally suitab…
Monday
DIY Robocars via Twitter
RT @chr1sa: The @DIYRobocars @donkey_car virtual AI car race is starting in 15 minutes! Watch it live on Twitch https://www.twitch.tv/mossmann3333 htt…
Aug 1
DIY Robocars via Twitter
RT @chr1sa: Don't miss our monthly @DIYRobocars @donkey_car virtual AI car race tomorrow at 10:00am PT live on Twitch. Head-to-head racing…
Jul 31
DIY Robocars via Twitter
RT @sparkfun: Our completed tutorial on building an @NVIDIA Jetson Nano-powered @Sphero RVR gets your bot up and running via teleoperation…
Jul 30
DIY Robocars via Twitter
RT @SmallpixelCar: Freeway test https://t.co/4V5tV9lhIP
Jul 29
DIY Robocars via Twitter
Very small autonomous cars racing, thanks to an overhead camera: https://control.ee.ethz.ch/research/team-projects/autonomous-rc-car-racing.html
Jul 29
DIY Robocars via Twitter
Jul 29
DIY Robocars via Twitter
Jul 29
DIY Robocars via Twitter
RT @chr1sa: Don't miss our virtual AI car race this Saturday! Real developers + virtual cars =🏎️🏎️🏎️ Head-to-head battles with thrills, sp…
Jul 28
DIY Robocars via Twitter
Jul 27
DIY Robocars via Twitter
RT @usashirou1: Jetson nano by Isaac Kaya #jetson https://t.co/Mu1N0CyQkN
Jul 23
DIY Robocars via Twitter
RT @GPUsolution: JetRacer mady by Iflytek company #JetsonNANO #Nvidia https://t.co/MimTymIwge
Jul 23
DIY Robocars via Twitter
RT @openmvcam: I love this: Mega or Mini? Image Classification on the 1MB OpenMV Cam H7 by Ish Ot Jr. in OpenMV, Edge Impulse, Internet of…
Jul 23
More…