Hi,

I am starting a new project which aims to take a live stream from a DSLR type camera (HDMI), and overlay a visual proximity warning system over it. Ideally, i would then like to output this over either an analogue or digital data link.

I was going to use RPLIDAR, a cheap lightweight 360 degree laser scanner to obtain distance information for objects around my octi-rotor. I was then planning to use this information in order to give me a visual warning when i am getting too close to an object. The warning would come in the form of a border overlay on my video feed. 

This border around the OSD would be split up into 8 sections, the colour of each section changing as objects get closer to my multi-rotor. (e.g. green(d>5m), orange (3m<d<5m), or red (d<3m)). For example, an object 2m away to the aircraft's right hand side would cause the right hand side of the OSD border to turn red. An object 4m away in front of me would cause the top section of the border on the OSD to appear orange. Etc...

I will need to decode the LIDAR data (USB -UART), and then produce the border image from these measurements. In terms of the video streaming and overlay, i have read a fair bit on Gstreamer which would seem to do what i need. Am i correct in my thinking?

I was looking into different hardware setups, and thought that this could be a good project for the Raspberry Pi however im not sure the Pi could take in digital video from cameras (HDMI)? Also, not sure if the processor is going to be able to handle this kind of task?

I would be really grateful for some advice regarding the best HW and SW setup for this kind of project. I don't mind hard work, but want to make sure i set off in the right direction at the start!

I will jkeep you all in the loop regarding my progress

Thanks in advance

James

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • This might not help you directly but we've been looking at anti-collision LIDAR for several years and have a commercial system working with a range of 100m. This runs on a Linux box and can handle complex shaped alarm zones - so the alarm distances might depend on the air speed and the direction of travel. Unfortunately, this system is not available to the public as it is part of an OEM product and there are contractual restrictions.

    However, we are considering adding high speed (1000 rps), long range (>100m) capability to one of our small laser modules, the SF10/C. Whilst this wouldn't be a complete scanning LIDAR on its own, it would be straightforward to mount it onto a rotating platform or servo to make a narrow or wide angle scanner.

    The reason why we want such long range is that once the UAV is at full speed, there is a significant reaction time to obstacles. During the slowing down process, the 'copter tilts backwards and may lose sight of the obstacle. Having sufficient warning time helps to keep evasive maneuvers more gentle, and may only necessitate a minor course change instead of an emergency stop.

    In addition to the long range sensors, we are also developing multi-beam devices that could help to keep obstacles in view whilst the 'copter is tilted backwards or forwards during deceleration and acceleration.

    Like I said, this might not be directly relevant to your project but thought I'd post the info anyway :).

This reply was deleted.

Activity

DIY Robocars via Twitter
May 15
DIY Robocars via Twitter
May 14
DIY Robocars via Twitter
May 13
DIY Robocars via Twitter
RT @f1tenth: Say hi to our newest #F1TENTH creation for @ieee_ras_icra next week in Philly. It’s going to be huge! 😎 🔥 @AutowareFdn @PennEn…
May 13
DIY Robocars via Twitter
May 11
DIY Robocars via Twitter
May 8
DIY Robocars via Twitter
RT @SmallpixelCar: Noticed my car zigzagged in last run. It turned out to be the grass stuck in the wheel and made the odometry less accura…
May 8
DIY Robocars via Twitter
RT @SmallpixelCar: Test my car. RTK GPS worked great. Thanks @emlid for their support. https://t.co/EkQ6qmjmWR
May 8
DIY Drones via Twitter
RT @chr1sa: @kane That's @diydrones circa 2009. Still have a box of those Canon cameras that we used to strap into planes, just like this.…
May 3
DIY Robocars via Twitter
RT @chr1sa: Our next @diyrobocars race is going to be outside at a real RC racetrack in Fremont on May 28. Fully autonomous racing, head-to…
Apr 30
DIY Robocars via Twitter
RT @f1tenth: Our Spring 2022 F1TENTH course @PennEngineers is coming to an end with a head-to-head race as a big finale. So proud of our st…
Apr 26
DIY Robocars via Twitter
RT @DanielChiaJH: I wrote a thing! Throughout the development of my @diyrobocars car I've been using @foxglovedev Studio to visualize and d…
Apr 23
DIY Robocars via Twitter
RT @SmallpixelCar: My new car for high speed. Low body, everything ( @NVIDIAEmbedded Jetson Xavier NX, @emlid RTK GPS, IMC) under the deck…
Apr 23
DIY Robocars via Twitter
Apr 21
DIY Robocars via Twitter
RT @f1tenth: F1TENTH Race training setup @PennEngineers for our upcoming ICRA2022 @ieee_ras_icra competition. @OpenRoboticsOrg @IndyAChalle…
Apr 21
DIY Robocars via Twitter
RT @fatcatFABLAB: Proud to be hosting a restarted DIY Robocars NYC Meetup April 26. Come by if you want to talk about and race self-driving…
Apr 17
More…