The right tool for the job

There have been recent posts on the “wall” about scientific and “toy” cameras for mapping. The focus is on NDVI which is simply an index that provides information about the difference between reflected red and near-infrared radiation from a target. It's an index because it is unitless and it is normalized so values always fall between -1 and +1. It tends to be a good indication of plant vigor and has been correlated to different aspects of plant productivity.

In any digital camera that I'm familiar with a pixel starts its life as a voltage. The next step is where the the scientific and point-and-shoot cameras diverge. In a scientific camera voltage is simply calibrated to output radiance and in a point-and-shoot camera it follows a more complex processing path to output something pleasing to the human eye. Scientific cameras are trying to measure physical variables as accurately as possible and point-and-shoot cameras are trying to make a good looking photograph – science vs art. Point-and-shoot cameras are more complex than scientific imagers but they use lower quality and mass produced parts to keep the costs down whereas the scientific cameras use precision everything which are produced in low volumes. That's a brief summery but the bottom line is that the two different cameras are designed for different uses. To imagine that a camera designed for making pretty pictures can be used for scientific studies seems a bit ludicrous – or does it? It' depends on what you want to do.

There is a good bit of work going on to try and convert point-and-shoot camera from an art tool to a scientific tool. This is an area that fascinates me. I realize there are serious limitations when working with low quality sensors and imaging systems but some (perhaps many) of those radiometric and geometric imperfections can be modeled and adjusted using calibration techniques and software. For example, there are a few articles in the peer-reviewed literature about people calibrating commercial digital cameras (usually DSLRs) to record radiance and the results are pretty encouraging. I have been developing my own work flow to calibrate point-and-shoot cameras although I'm using simple DIY approaches since I no longer have access to precision lab equipment that would allow me to more accurately characterize my cameras. If anyone is interested I post my calibration experiments on the Public Labs web site (http://publiclab.org/). I'm always looking for feedback to advance this work so comments are welcome. My intent is to convert simple cameras to the best scientific tools that is possible.

When deciding which instrument to use you need to consider the goals of the project and available financial resources. For the financial resources you need to consider purchase cost, maintenance and replacement costs if it gets damaged. There is no comparison from a cost perspective. On the bargain side of scientific imagers you should expect to pay a few thousand dollars and if you want a large format mapping camera it's in the ball-park of $1 million. The precision/scientific-grade cameras are very expensive, require careful maintenance and recalibrating (can also be costly), and if you have one in a UAV that crashed you will likely lose a lot. You can get a used digital camera and convert it to an NDVI capable imager for well under $100 or purchase one designed for mapping like the Mapir for about $300.

What about accuracy, precision and stability? Clearly instruments designed with these qualities in mind will be better than something made to make pretty pictures. A more appropriate question is what is good enough for our purposes? I'll focus on NDVI mapping and it's important to realize different applications (e.g., creating 3D point clouds, ortho-mapping, land cover classification) will have other qualities to consider. One important factor to consider is radiometric accuracy. Although I'm trying to improve what we can get from point-and-shoot cameras I realize I will never attain the accuracy or precision possible with scientific imagers. How important are radiometric qualities for NDVI mapping? In most of the applications I see on this and similar forums people are mostly interested in relative changes in NDVI throughout an image and not absolute NDVI values. Some folks want to monitor NDVI over time and in that case it's important to be able to standardize or normalize NDVI but that is possible with calibration work flows. For these applications a well designed and calibrated point-and-shoot cameras can perform good enough to provide the information required such as to spot problem areas in an agricultural field. One point that is often overlooked is that close-range imaging and NDVI typically do not go well together. The problem is that we are imaging scenes with leaves, stems and soil and at the fine resolution provided by most point-and-shoot cameras we are trying to get the NDVI values from very small areas on the ground. For example, we can see different parts of a leaf and each part of the leaf is angled somewhat differently which will effect the NDVI value. Our scenes tend to be very complex and you can have the most accurate and precise instrument available and you might still be disappointed because of the physical issues (bi-direction reflectance, mixed pixels, small area shadows...) that create noise in the images. It is certainly nice to reduce as many sources of noise as possible but with a scientific camera I'm not convinced (at least not yet) that the improved radiometric performance is significant enough to overcome all of the noise coming from the scene to justify their use.

As far as the Mapir camera I received one of these last week and am trying to set time aside to calibrate it and see how well it performs. My initial reaction is that it is a nice compact camera well suited to small UAV mapping. I would prefer a red dual-pass filter but I expect that and other enhancements will become available in future versions. I like the fact that someone is focused on developing practical low-cost mapping cameras.

I welcome any comparisons between cameras and hope we can work together to improve the output we get from simple inexpensive cameras.  

You need to be a member of diydrones to add comments!

Join diydrones

Email me when people reply –

Replies

  • MR60

    The title is the whole point: what is the job to be done and then what is the tool, as affordable as possible, to do this job? It seems to me "the job" has never been clearly defined to start with. Fashionable themes, such as ndvi, are discussed but not a single agronomy engineer I know of has shown a real useful application or service farmers would be ready to pay for. So camera debates look futile when we do not even know what concrete real uses would be applicable outside pure academic research or hobby uses. Like IT, often engineers take routes that look the most interesting and sophisticated, ending up producing something which is maybe technology and scientifically excellent but completely out of focus from a customer's perspective. I hope the drone community's will not fall in the same pitfalls. That being said, I am the first one to love building and developing stuff because it is simply a challenge or fun...Just a thought...

    • There are several agricultural technology companies that offer products based on NDVI or a close relative. Farmers (corporate or mom & pop) do pay for value-added products based on vegetation indices as well as general crop health maps based on NDVI. The very good companies are aware of the shortcomings of NDVI and modify it appropriately or offer a more suitable alternative based on particular crop canopy attributes at relevant development stages. 

      Most of the added value to NDVI is related to fertilizer management, but some companies provide NDVI growth curves as well as other specialized services. NDVI is only effective at chlorophyll estimation (used as a basis for N application) under certain conditions, especially when water is not limiting. If you want to accurately estimate chlorophyll so you can make variable rate applications of what it is made of (Nitrogen) then you are best served by a well calibrated, narrow red-edge band that is normalized by a NIR band (but keep in mind that NDVI is a workhorse and is used very often). That said, the modified S100 red-edge bands are actually quite broad. The higher end cameras will allow you to divide a chlorophyll index (e.g. MCARI or NDRE) by a structural index (e.g. NDVI or OSAVI) to account for high soil contribution to light reflected from a plant canopy but I don't see any instance of where a low cost camera can do this.

      The next shortcoming of low cost cameras is accounting for incident light in each waveband during image capture. Doing so lets you generate better growth curves.

      There you go. That is "the job" definition as well as some issues for the DIY community to address. I am intentionally not identifying any products or companies so that my comments may be interpreted as objective. I will agree with Hugues in that there is a plethora of research that will never see the light of day but keep in mind that it doesn't have to if it is good science and basic enough to inform future efforts at understanding canopy:light interactions.

      Last of all, these views are solely my own and are not necessarily representative of any organization I am or have been affiliated with.

        

    • What are the limitations of low cost cameras that would prevent or make it difficult to calculate other indices such as MCARI and NDRE? If you had a cluster of small cameras with narrow band filters on and near the red edge wouldn't that be sufficient? Even if cost would drive people to use cameras with sensors using a color filter array it seems like that would be doable. Or do the band-pass widths have to be extremely narrow (~10nm) so is available light on the sensor is a show-stopper or is sensor quality the issue? 

    • I think the first real data will come from this ROI calculator study when finished and available http://measure32.com/roi-calculator-for-precision-agriculture/

  • OK to put some other multispectral cameras into comparison, I have collected following list:

    Gopro-like

    http://www.mapir.camera/

    http://multispek.myshopify.com/ - seems to be calibrated with accessories

    http://www.ir-pro.com/

    DIY or PRO P&S and DSLR conversions

    http://www.event38.com/SearchResults.asp?Cat=1830

    maxmax.com - not recommended, bad quality (own experience)

    http://www.lifepixel.com/

    http://www.astrosurf.com/luxorion/photo-ir-uv.htm

    http://flightriot.com/mapping/ndvi/

    http://regent.qc.ca/assets/wincam_about.html

    Specialized multichannel (more expensive but should have more accurate results)

    http://www.tetracam.com/

    http://www.optec.eu/en/telecamere_multicanale/telecamere_multicanal... - seems not finished yet for UAV use

    http://www.quest-innovations.com/uav-cameras

    http://www.micasense.com/

    If you are interested in more scientific use, look for hyperspectral cameras. I have a list of those too, can provide if interested too.

    • Moderator

      Thanks Michael. I don't mind starting a spreadsheet and maintaining it, but I'm probably one of the least-qualified. 

      If someone would like to give some input on specs to compare, I'll get started. 

  • Moderator

    Vega, your approach has been a little frustrating to me, but you have a lot of knowledge that could be useful to the community, if we can make it a little less...aggressive? I'd really like to see if we can come up with a wiki entry that is laid out in a sort of "Camera options for NDVI...For dummies" manner. I know (as others do as well) that these converted consumer cameras can produce some kind of useful information. If you will concede that point, give us a rundown on what we can expect to get for results from the full range of options available...in layman's terms. 

    It's obvious that you would like to share your expertise and recommendations, so present it in a manner that is palpable and gives us an upgrade path and some information on what to expect for functionality. Ned has done a lot of work for the community, and I would definitely like to see some collaboration. 

  • 100KM

    Thanks for the great article. What do you think of the Tetracam cameras, especially the ADC Snap with the global shutter?

    • I'm not familiar with the camera system you mention beyond the online documentation but I like the global shutter and ability to create arrays of single narrow-band cameras. Working with well defined narrow-band filter/cameras is an advantage for making better NDVI and other index products. ADC has been around for a long time and they are used quite extensively and for scientific type cameras. They are a step up from using a point-and-shoot but maybe that difference isn't as great as some think. I would love to build something like that using tiny cameras with no Bayer filter over the sensor. Some folks in the astronomy community actually scrape off the Bayer filter from a digital camera to improve the light sensitivity. That seems a bit extreme but to each his own: http://petapixel.com/2013/08/04/scratching-the-color-filter-array-l...

    • I didn't know Mapir camera, looks interesting, It's your proyect Mario or you are an owner?

This reply was deleted.