Developer

NEW FEATURE: Automatic Compass Declination

3689450754?profile=original

 

Hello DiyDroners,

 

I recently completed the implementation of a new feature for ArduPlane & ArduCopter. I have to thank Jan Scherrer for the idea and especially thank Andrew Tridgell for pushing me to improve the original implementation. The new feature is automatic compass declination.

Currently you are supposed to look up the magnetic declination value for your flight location and input that value into the Mission Planner so the compass heading can be corrected. If you are like me and constantly flying at new locations, it is a bit annoying to have to look this up every single time. In this post, Jan asked why it couldn't just be automatic... I did not have an answer so I decided to see if I could make that happen.

 

USAGE:

 

The automatic declination code is enabled by default. There is a new configuration parameter you can set in the Mission Planner if you wish to disable/re-enable it. See below:

3689450771?profile=original

To enable, set COMPASS_AUTODEC to 1. To disable, set COMPASS_AUTODEC to 0.

After any parameter changes you need to click the "Write Params" button.

With automatic declination enabled, the declination will be approximated to the declination at your GPS Lat/Lng coordinates as soon as a 3D fix is acquired. So far from our tests we show a +/- error of .5 degrees depending on your location. Andrew Tridgell reported accuracy of within .3 and I am seeing accuracy within .05.

The latest code that includes the automatic declination is available in the git repository. I should warn you that while most of the code in there is already tested, some of it may not be because that git repository is constantly in flux. If you feel confident, give it a try! The more testers the better. Otherwise, if you prefer to wait, this feature will be included in the next official release.

 

TECHNICAL:

What is magnetic declination? Good question...Read this

 

I ended up finding another person that had put together a look up data table that used bi-linear interpolation to pull an approximate declination based on lat/lng GPS coordinates. This was definitely a good start. So I took that code and adapted it for our code base (of course giving proper credit to the original author). The problem with the original implementation was that the look up table took up a massive amount of space ( > 5kb ) and the way I had originally written it, that look up table was being stored in RAM instead of flash memory. Without going into too much detail on the difference between those two types of memory, the first is memory that is volatile memory that is used to store variables during code execution. It is fast, but resources are limited. Because the look up table is a static set of data that gets used infrequently, it is a much better option to store it in the flash memory (using PROGMEM). You can read about it all here.

 

Ok... so how to go from a 5kb to a lot less. We are dealing with integer values which vary in size. The first thing we need to do is make sure that we are using the smallest possible integer size for the values that we have in the look up table. The range of values in the original table -99 to 179. So out of the standard int sizes (int8_t, int16_t and int32_t) int16_t is the smallest we could use with a supported range of -32768 to 32767. The next smallest size, int8_t, supports a range of -128 to 127. You can see that the the lower end of the look up values will fit (-99 is greater than -128), but the upper range will not (179 is greater than the allowed 127).

 

Turns out there are a lot of clever ways to compress data. Here are a few that I considered, some of which I used.

1. Shift all the values -52 bringing the highest value in the look up table to 127 which is within int8_t. Oops that doesn't work. Now the lower end exceeds the lower limit of int8_t.

2. Store the first value in each row and then the differences between each consecutive value instead of the values themselves. This is a very promising approach because the difference between each value is quite small, meaning we can use a smaller integer size to store the value.

3. Pack the sign bits in a different array.

 

Lets take the highest value in the array (179) and see what that means in terms of a 16bit integer. 179 is represented by the following:

0000000010110011

You can see that the upper 8 bits are not used (all zeros), but unfortunately we need at least one more bit to represent the sign of the lower end values. All of our values can fit into 9 bits, but when you create a 9 bit integer it is automatically padded up to 16 bits. What we could do is take all the extra sign bits out of the original array and put them in their own array. That means all of the absolutevalues fit in 8bits (a good improvement over the 16bits before, half the space). So how do we pack those sign bits? Remember that I said that the number of bits is automatically rounded up to the nearest byte. That means that if we tried to declare a 1 bit int for the sign and store it, it would actually take up 8 bits. Take the following:

00000001 - this would represent negative

00000000 - this would represent positive

All we need is that one value (1 or 0) to say that it is either negative or positive. So what we can do to avoid wasting those other 7 bits is to store 7 more signs in that one byte.

Take these values -99, 75, 43, -23, 175, 132, -45, -32

So that would be: 10010011 (1s for negative signs, zeros for the positive signs)

Now we are taking advantage of the full byte (8 bits) and not losing any space because of the padded bits.

Using a combination of the above methods allowed me to pack the values into around 1.6kb. When you compress the values, the retrieval strategy must change. Normally you would access values in an array using this simple syntax. MyArray[12][2] which means give me the value in the 13th row, 3rd column. If we are splitting the array into their starting values, consecutive delta values, and signs, we will need to pull those values out in a different way. If you are interested in learning how it works, feel free to check out the code from the git repository. The logic is located in the AP_Declination.cpp file in the libraries folder.

As always, questions are welcome!

Thanks,

Adam

E-mail me when people leave their comments –

You need to be a member of diydrones to add comments!

Join diydrones

Comments

  • Hi, if I look on Magetic Declination web services, they use the year also as input because apparently, the result will increase a little each year (0.12° E per year for me). I'm pretty sure you already checked out this webpage: http://www.ngdc.noaa.gov/geomag-web/. Your code is accurate for which year ?

  • Developer

    @Andke: The compass calibration improvements were the result of work done by Bill Premerlani and Andrew Tridgell. I think that they have it pretty well nailed down. When the next release comes out (it may actually be out already for ArduPlane), see if you still have issues. If you do, then report back with a log. Thanks!

  • @Adam Riviera

    Thank you.  I am currently using compass + learning, but I also experience some strange results,  like plane is waving a *lot* in some directions (like north/south)  and flies very well east and west. (while flying on AUTO)

    So I am looking forward to those improvements.

    I guess you are working on that - so if you need any logs from today/with current firmware, I can provide.

  • Developer

    @Andke: I am glad to hear you had a good result! With the next release it would be best if you just leave compass learning on all the time. The new algorithm is much more sophisticated and deals with noise more effectively. The release should be coming soon.

  • Thank you.

    The declination where I flew today was 7,14 according to the site.

    After the flight, with default (COMPAS_AUTODEC=1)   it is 7,144704   - assuming the software looked it up, it did a great job.

    Thank you.

    I assume you know a bit more than the average user about magnetic offsets too, are they too expected to change ? - or once tuned in for the hardware, learning should be turned off ?  

  • Developer

    @Andke: Yes, just go to the area where you would normally input your declination (in the MP) and you should see the value that was automatically placed there. Then you can validate that number against the magnetic declination lookup website.

  • Thanks - flew this code it for the first time today  - how do I check that it worked as expected ? - just read out saved declination in settings, and compare it to the mag.declination site?

  • It is a clever way to compress data,   excellently !

  • Developer

    @Andke: I see your point. Right now there is a safeguard in place to prevent a bad GPS fix. There is a purposeful delay in the setting of "home" coordinates. I have not personally experienced any bad GPS fixes so I can't comment on that.

  • I agree, just thought of that to DIR (Do It Right) - and - because I've seen a few strange GPS errors during boot:

    it gets a fix for a few sec, enough to set home 20000KM away from where actually are, - of course, home is set bad, and declination would be too. - Messing it up flight for those who maybe did not plan to use RTL/AUTO, just fly and maybe PH.  - now, If declination were recalculated now-and-then  there would be one less potential problem.

This reply was deleted.