Telemetry and HD video over 4G

I am successfully using a 4G LTE network connection to send bidirectional telemetry AND HD (1280X1024 / 25fps) Video from my drones.  The video is perfect, the telemetry is perfect - regardless of range (assumes 4G is available).  I use my cell phone as a hotspot and connect using MISSION PLANNER on my laptop. The video is "snow free" and is viewed  on CHROME or FireFox browsers. 

The cost of all the equipment is under $100, but I do have to pay for a data plan ($15-$50/month) - and a small monthly amount for server time. The server setup is special to allow for the 4G<->4G connection.  The telemetry data is encrypted, the video data is not (at this time, anyway).  The system camera is non-standard but tiny.I can control the drone with a joystick connected through Mission Planner.  The latency is 0.8 seconds - max. The total weight of the system is 100 grams.  No equipment other than a computer running Mission Planner is needed on the "ground side" (except for a cell phone or other hot-spot).

I was thinking that others could use my setup as well. In that case I would have to set up multiple accounts on the server and manage them.  Before I take this any further -

Would anyone else be interested in the setup I have?

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • Hi Charles, thanks for sharing the wonderful info.

    Before Xmas, I bought the most updated RFD900 (rfd900x to be exact) just to test the amazing claim (RC PPM Passthrough with telemetry at the same time) made by RFDesign  in Australia (http://store.rfdesign.com.au/rfd-900x-modem/). I haven't had time ever since to set it up and make a real test on it. Maybe you can use RFD900X to realize your wish of utilizing Futaba transmitter instead of Logitech game controller.

    Cheers

    Richard


    Charles Linquist said:

    I could give you a diagram, but it is really easy.

    APM or PixHawk connects (via its telemetry port)  to a little (1" X 1") board which acts as a level shifter / failover / data selector.  That board connects to 6 GPIO and power pins on a Raspberry pi, and 4 pins of a RFD 900 radio (also works with 3DR radio).

    The Raspberry pi has a ribbon cable (CSI2 interface) which connects to a camera (Raspberry pi 8MP camera).  A 4G "dongle" connects to the Raspberry pi's USB port.

    The Raspberry pi is programmed (over WiFi) to connect to a special server - for example:  ec2-server1.drone.com. This needs to be done one time only.

    On the ground, a laptop is connected to the internet.  This can be done either by plugging in another 4G dongle into one  its USB ports, or by using a "HotSpot".  I use my cell phone as a hotspot. No software is needed in the laptop except Mission Planner and a web browser.

    You power the drone and wait about 90 seconds for the Raspbery pi to boot and the 4G connection is made, which is shown by a blue blinking LED on the 4G dongle. Using Mission Planner, you connect using EITHER a RFD900 radio over a COM port,  OR  by via tcp (4G). The tcp server will be the same as above (ec2-server1.drone.com). Choose whichever connection method you wish and press CONNECT.  Voila!  You will be connected.  Mission Planner remembers the url and port number of the tcp connection, so that information needs to be entered only once.

    If you want to see video, you use either the laptop that is running Mission Planner or use two laptops.  The video works with Chrome or FireFox browsers only.  In the search bar, type in  ec2-server1.drone.com:XXXX (where 'XXXX' is a port number).  You will then be watching video.  Note that you cannot show the video in Mission Planner's inlay. The video must be shown in a web browser. A  LogiTech game controller can be connected to the USB port of the machine running Mission Planner, and you can control your drone by that method (setup described in the Mission Planner docs).  I don't like the little Logitech game controller as much as I like my Futaba radio, but it is usable.  I'm thinking of modifying a REAL controller (like the Futaba) so it will connect to my laptop using USB.  

    At any rate, the video must come over 4G, but the telemetry can be done either with the RFD 900 or 4G.  I use 4G exclusively unless I'm somewhere where there is no 4G coverage.  If the 4G signal goes away while I'm in flight, I can take over with the RFD900, assuming I'm within radio range. 

    Latency is about 0.8 seconds, both with the telemetry and video.

    RFD 900x Modem
    RFDesign designs and manufactures the Antennas, RF Electronics and the RFD900 radio modem

  • Sure, fully understood your concern. Earlier I thought it was a public server run by Amazon.

    As for Logitech game controller, I'll check it out in Mission Planner.

    Thanks.


    Charles Linquist said:



    Charles Linquist said:

    No, you can't connect to the server I use.  Not only do I pay for it, but you would have to know the protocols, the ports and a lot of other things to use it. The last thing I need is someone screwing up MY setup.

    The Logitech game controller model is described in the Mission Planner documentation.

    Richard Huang said:

    Hi Charles, can I get an account for the server? Mind telling me the model-name of Logitech game controller? I'll try to buy one by local store.  Cheers.

    Richard

  • I could give you a diagram, but it is really easy.

    APM or PixHawk connects (via its telemetry port)  to a little (1" X 1") board which acts as a level shifter / failover / data selector.  That board connects to 6 GPIO and power pins on a Raspberry pi, and 4 pins of a RFD 900 radio (also works with 3DR radio).

    The Raspberry pi has a ribbon cable (CSI2 interface) which connects to a camera (Raspberry pi 8MP camera).  A 4G "dongle" connects to the Raspberry pi's USB port.

    The Raspberry pi is programmed (over WiFi) to connect to a special server - for example:  ec2-server1.drone.com. This needs to be done one time only.

    On the ground, a laptop is connected to the internet.  This can be done either by plugging in another 4G dongle into one  its USB ports, or by using a "HotSpot".  I use my cell phone as a hotspot. No software is needed in the laptop except Mission Planner and a web browser.

    You power the drone and wait about 90 seconds for the Raspbery pi to boot and the 4G connection is made, which is shown by a blue blinking LED on the 4G dongle. Using Mission Planner, you connect using EITHER a RFD900 radio over a COM port,  OR  by via tcp (4G). The tcp server will be the same as above (ec2-server1.drone.com). Choose whichever connection method you wish and press CONNECT.  Voila!  You will be connected.  Mission Planner remembers the url and port number of the tcp connection, so that information needs to be entered only once.

    If you want to see video, you use either the laptop that is running Mission Planner or use two laptops.  The video works with Chrome or FireFox browsers only.  In the search bar, type in  ec2-server1.drone.com:XXXX (where 'XXXX' is a port number).  You will then be watching video.  Note that you cannot show the video in Mission Planner's inlay. The video must be shown in a web browser. A  LogiTech game controller can be connected to the USB port of the machine running Mission Planner, and you can control your drone by that method (setup described in the Mission Planner docs).  I don't like the little Logitech game controller as much as I like my Futaba radio, but it is usable.  I'm thinking of modifying a REAL controller (like the Futaba) so it will connect to my laptop using USB.  

    At any rate, the video must come over 4G, but the telemetry can be done either with the RFD 900 or 4G.  I use 4G exclusively unless I'm somewhere where there is no 4G coverage.  If the 4G signal goes away while I'm in flight, I can take over with the RFD900, assuming I'm within radio range. 

    Latency is about 0.8 seconds, both with the telemetry and video.

  • Can you at least provide a diagram of the system so that I can understand. Is it like MissionPlanner  connecting to the drone through your custom server? Do you see the Video stream in Mission Planner? Is the controller stick sending the telemetry through Mission Planner (routed by your server)? 

    I hope I am not asking too much. I am new but very much interested to repeat your achievement (possibly using your server?) 

    Regards,

  • A large part of it is open source, but not all - at least not yet.



    Mohammad Bhuyan said:

    Hi Charles,

    I would like to know the details of setting up the same. I am new to drone but would love to stream/control over 4G. Is this opne source?

  •  I guess I didn't understand what Mavproxy did before I decided to "roll my own", but I have what I think is a great solution that works with video as well as telemetry.  I just have a few more things to work out before it becomes what I would say is nearly perfect.  No more multipath, no more "snow".  And no more "lost telemetry for X seconds messages"!

    You should also know that I have my Part 107 license and have applied for a non-VLOS exemption.

    JB said:

    Hey Charles

    It depends on what country you are operating 4G in. Australia uses "drones" too ;-)

    Besides theres are a bunch of forwarding services that work out of the box.

    Mavproxy is a easy way, that is purpose built to distribute telemetry. There's no need to run it over "hardware" if you're already relying on a pi to run the 4G and camera. A PXH (or APM) can already connect and run both RFD900 and 4G telemetry via the pi at the same time (one PXH serial to the RFD900 and one serial to the pi). Why switch between them if both work at the same time with mavproxy? (You can also use UDPCI for telemetry etc) Mavproxy also works on the ground to route different mavlink streams, like from 4G and RFD900 to run Mission Planner.

    Wifi has plenty range for video for legal line of sight operations and half decent latency, let alone no data costs.

    Anyways, just wanting to share whats been working for us for over 4 years in the OBC etc thanks to CUAV's work.

    http://ardupilot.github.io/MAVProxy/html/index.html

  • And since the FAA tells us we can't go over 400'.  No problem!



    Michel said:

    This shouldn't be a problem for most of us, but take into consideration that cellular towers only provide a strong signal at or near ground level. I'm a (manned) glider pilot and my phone doesn't establish a reliable data connection above 1500 ft AGL or so.

    It is pretty amazing how far cellular data connections have advanced. I easily reach 75-100 megabits/s and 25 ms ping where I live.

    So 4G is great, except for high altitude applications.

  • Hey Charles

    It depends on what country you are operating 4G in. Australia uses "drones" too ;-)

    Besides theres are a bunch of forwarding services that work out of the box.

    Mavproxy is a easy way, that is purpose built to distribute telemetry. There's no need to run it over "hardware" if you're already relying on a pi to run the 4G and camera. A PXH (or APM) can already connect and run both RFD900 and 4G telemetry via the pi at the same time (one PXH serial to the RFD900 and one serial to the pi). Why switch between them if both work at the same time with mavproxy? (You can also use UDPCI for telemetry etc) Mavproxy also works on the ground to route different mavlink streams, like from 4G and RFD900 to run Mission Planner.

    Wifi has plenty range for video for legal line of sight operations and half decent latency, let alone no data costs.

    Anyways, just wanting to share whats been working for us for over 4 years in the OBC etc thanks to CUAV's work.

    http://ardupilot.github.io/MAVProxy/html/index.html

    MAVProxy — MAVProxy 1.6.4 documentation
  • Hi Charles,

    I would like to know the details of setting up the same. I am new to drone but would love to stream/control over 4G. Is this opne source?

  • This shouldn't be a problem for most of us, but take into consideration that cellular towers only provide a strong signal at or near ground level. I'm a (manned) glider pilot and my phone doesn't establish a reliable data connection above 1500 ft AGL or so.

    It is pretty amazing how far cellular data connections have advanced. I easily reach 75-100 megabits/s and 25 ms ping where I live.

    So 4G is great, except for high altitude applications.

This reply was deleted.

Activity