I am currently doing my Master's thesis at Linköping University (Sweden) and would be much grateful for advices. The task is to make an UAV autonomously plan a route as well as detect and track animals using an IR camera.

For the image processing and control of the platform there are two alternatives: computations onboard or computations on the ground.

Important parts for the image processing:
* Thermal camera with video stream to computer
* Measured sensor information (angles) from the gimbal
* GPS and sensor information from the platform

If the image processing are to be performed on the ground, a link with telemetry (including gimbal pose) and video is needed. Also a remote control that can be controlled from a computer is needed. If the computations are to take place on the platform, there must be a way to communicate with the flight controller, to control the platform. 

Is there any system that are RTF, or almost RTF, and fulfils these requirements? It seems that most flight controllers are closed, and cannot be controlled from a device onboard. Are there remote controllers that can be controlled from a computer?

Lastly, a link with some examples. The important difference is that the image processing in my project must be in real time, which introduces difficulties.
http://wildlifesecurity.se/projects/aerial/

Thank you for your input!

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • Hi Cornelius, you've come to the right place!  The apm/pixhawk flight controllers that most people here use are very open and crucially they have a simple api (mavlink) that you can query in realtime for gimbal angles, gps/sensor info etc.  You can also control the flight controller through the same mavlink, so for example if you do image processing and find an area of animals through thermal imaging that you want to investigate further your code could automatically point the craft and gimbal towards that area.

    http://dev.ardupilot.com/wiki/mavlink-commands/

    Onboard computers are no problem, lots of people here use them and they're very simple to hook up:

    http://dev.ardupilot.com/wiki/companion-computers/

    Quite a few people do realtime image processing through onboard computers.  Here's a good example:

    http://dev.ardupilot.com/wiki/odroid-via-mavlink/

    http://diydrones.com/profiles/blogs/red-balloon-finder

    Lots of people use a raspberry, and there's lots of interest in the newer nvidia and qualcomm boards.

    Take a look at this new rangefinder as well which you'd probably need:

    http://diydrones.com/profiles/blogs/the-sf11-c-laser-altimeter-awes...

    Do post back here if you get anywhere :)

    • Thank you, Fnoop Dogg, for the inspiring welcome to the community!

      This weekend me and my colleague have searched for and found many capable drones. Since we have a limited time for the project, we have decided to go for an RTF solution: 3DR X8+. The only things to add are a gimbal, a thermal camera and an onboard computer. Probably we will use Odroid XU4 for image processing.

      As for the gimbal, we would like to have a 3D gimbal to get a stable view and be able to move the camera in all directions. Do you have any recommendations on a good 3D gimbal that can send the attitude over MAVLINK on request? We would prefer a gimbal with an included controller board and IMU. The STorM32 brushless gimbal controller looks promising, but does it ship with any gimbals? 

      http://copter.ardupilot.com/wiki/common-storm32-gimbal/

      Good point! A range finder will be needed in the final project, but in this demonstration a 3D map is available for simulations. The map will also be used for estimation of the camera footprint on the ground.

This reply was deleted.

Activity

DIY Robocars via Twitter
Friday
DIY Robocars via Twitter
RT @_JonMyer: 🏎 We need your help in naming my #AWS DeepRacer Underground Track 🏎 @davidfsmith's track is going to be referred to as 𝗔𝗪𝗦 𝗗…
Thursday
DIY Robocars via Twitter
RT @gclue_akira: 仕事もおわったし、電脳化にとらい #マリオカートハック https://t.co/4IU90hCLgm
Thursday
DIY Robocars via Twitter
This is the hashtag to follow all the people in Japan who are hacking the new Nintendo Mario Kart with the real AR… https://twitter.com/i/web/status/1319281354664677376
Thursday
DIY Robocars via Twitter
RT @gclue_akira: @chr1sa @diyrobocars jupyter mario https://t.co/P0oHdjlCRq
Thursday
DIY Robocars via Twitter
RT @_JonMyer: 🚨Our 1st AWS DeepRacer Community Race is Underway on http://twitch.tv/aws 🚨 Join us to find out which member of your commu…
Oct 20
DIY Robocars via Twitter
Oct 19
DIY Robocars via Twitter
RT @BackyardRobotcs: After an admittedly long wait, the new Tinymovr R3.3 motor controller is now available https://tinymovr.com 🥳
Oct 19
DIY Robocars via Twitter
RT @_JonMyer: 🏎 1 hr left before the #AWS #DeepRacer Community 🏎 Top 5 Race tomorrow LIVE on Twitch 1st Place = $50 Amazon GC or AWS Credit…
Oct 19
DIY Robocars via Twitter
Oct 16
DIY Robocars via Twitter
Oct 15
DIY Robocars via Twitter
Oct 14
DIY Robocars via Twitter
RT @davidfsmith: Race virtually with The AWS DeepRacer Community Race and then join us on the track to see how your times compare on the ph…
Oct 14
DIY Robocars via Twitter
Oct 14
Hiroki Tanaka liked Hiroki Tanaka's profile
Oct 13
DIY Robocars via Twitter
RT @breadcentric: It's now!
Oct 13
More…