There have been recent posts on the “wall” about scientific and “toy” cameras for mapping. The focus is on NDVI which is simply an index that provides information about the difference between reflected red and near-infrared radiation from a target. It's an index because it is unitless and it is normalized so values always fall between -1 and +1. It tends to be a good indication of plant vigor and has been correlated to different aspects of plant productivity.
In any digital camera that I'm familiar with a pixel starts its life as a voltage. The next step is where the the scientific and point-and-shoot cameras diverge. In a scientific camera voltage is simply calibrated to output radiance and in a point-and-shoot camera it follows a more complex processing path to output something pleasing to the human eye. Scientific cameras are trying to measure physical variables as accurately as possible and point-and-shoot cameras are trying to make a good looking photograph – science vs art. Point-and-shoot cameras are more complex than scientific imagers but they use lower quality and mass produced parts to keep the costs down whereas the scientific cameras use precision everything which are produced in low volumes. That's a brief summery but the bottom line is that the two different cameras are designed for different uses. To imagine that a camera designed for making pretty pictures can be used for scientific studies seems a bit ludicrous – or does it? It' depends on what you want to do.
There is a good bit of work going on to try and convert point-and-shoot camera from an art tool to a scientific tool. This is an area that fascinates me. I realize there are serious limitations when working with low quality sensors and imaging systems but some (perhaps many) of those radiometric and geometric imperfections can be modeled and adjusted using calibration techniques and software. For example, there are a few articles in the peer-reviewed literature about people calibrating commercial digital cameras (usually DSLRs) to record radiance and the results are pretty encouraging. I have been developing my own work flow to calibrate point-and-shoot cameras although I'm using simple DIY approaches since I no longer have access to precision lab equipment that would allow me to more accurately characterize my cameras. If anyone is interested I post my calibration experiments on the Public Labs web site (http://publiclab.org/). I'm always looking for feedback to advance this work so comments are welcome. My intent is to convert simple cameras to the best scientific tools that is possible.
When deciding which instrument to use you need to consider the goals of the project and available financial resources. For the financial resources you need to consider purchase cost, maintenance and replacement costs if it gets damaged. There is no comparison from a cost perspective. On the bargain side of scientific imagers you should expect to pay a few thousand dollars and if you want a large format mapping camera it's in the ball-park of $1 million. The precision/scientific-grade cameras are very expensive, require careful maintenance and recalibrating (can also be costly), and if you have one in a UAV that crashed you will likely lose a lot. You can get a used digital camera and convert it to an NDVI capable imager for well under $100 or purchase one designed for mapping like the Mapir for about $300.
What about accuracy, precision and stability? Clearly instruments designed with these qualities in mind will be better than something made to make pretty pictures. A more appropriate question is what is good enough for our purposes? I'll focus on NDVI mapping and it's important to realize different applications (e.g., creating 3D point clouds, ortho-mapping, land cover classification) will have other qualities to consider. One important factor to consider is radiometric accuracy. Although I'm trying to improve what we can get from point-and-shoot cameras I realize I will never attain the accuracy or precision possible with scientific imagers. How important are radiometric qualities for NDVI mapping? In most of the applications I see on this and similar forums people are mostly interested in relative changes in NDVI throughout an image and not absolute NDVI values. Some folks want to monitor NDVI over time and in that case it's important to be able to standardize or normalize NDVI but that is possible with calibration work flows. For these applications a well designed and calibrated point-and-shoot cameras can perform good enough to provide the information required such as to spot problem areas in an agricultural field. One point that is often overlooked is that close-range imaging and NDVI typically do not go well together. The problem is that we are imaging scenes with leaves, stems and soil and at the fine resolution provided by most point-and-shoot cameras we are trying to get the NDVI values from very small areas on the ground. For example, we can see different parts of a leaf and each part of the leaf is angled somewhat differently which will effect the NDVI value. Our scenes tend to be very complex and you can have the most accurate and precise instrument available and you might still be disappointed because of the physical issues (bi-direction reflectance, mixed pixels, small area shadows...) that create noise in the images. It is certainly nice to reduce as many sources of noise as possible but with a scientific camera I'm not convinced (at least not yet) that the improved radiometric performance is significant enough to overcome all of the noise coming from the scene to justify their use.
As far as the Mapir camera I received one of these last week and am trying to set time aside to calibrate it and see how well it performs. My initial reaction is that it is a nice compact camera well suited to small UAV mapping. I would prefer a red dual-pass filter but I expect that and other enhancements will become available in future versions. I like the fact that someone is focused on developing practical low-cost mapping cameras.
I welcome any comparisons between cameras and hope we can work together to improve the output we get from simple inexpensive cameras.
Replies
I think the Mapir camera is a modified SJCAM and it has the same form factor as a GoPro I think. The white balance settings are: Auto, Daylight, Cloudy and Tungsten. There is no custom white balance as far as I can tell.
The latest calibration options in the photo monitoring plugin shouldn't be impacted by color balance although only testing will tell if that's an accurate statement. I don't recommend auto white balance if using the calibration work flow since the white balance is set independently for each photo based on scene composition. The other white balance settings should remain constant since they are based on illumination source blackbody properties - at least that is my understanding.
Great write up, thanks Ned. Keep it coming !
The title is the whole point: what is the job to be done and then what is the tool, as affordable as possible, to do this job? It seems to me "the job" has never been clearly defined to start with. Fashionable themes, such as ndvi, are discussed but not a single agronomy engineer I know of has shown a real useful application or service farmers would be ready to pay for. So camera debates look futile when we do not even know what concrete real uses would be applicable outside pure academic research or hobby uses. Like IT, often engineers take routes that look the most interesting and sophisticated, ending up producing something which is maybe technology and scientifically excellent but completely out of focus from a customer's perspective. I hope the drone community's will not fall in the same pitfalls. That being said, I am the first one to love building and developing stuff because it is simply a challenge or fun...Just a thought...
What are the limitations of low cost cameras that would prevent or make it difficult to calculate other indices such as MCARI and NDRE? If you had a cluster of small cameras with narrow band filters on and near the red edge wouldn't that be sufficient? Even if cost would drive people to use cameras with sensors using a color filter array it seems like that would be doable. Or do the band-pass widths have to be extremely narrow (~10nm) so is available light on the sensor is a show-stopper or is sensor quality the issue?
I think the first real data will come from this ROI calculator study when finished and available http://measure32.com/roi-calculator-for-precision-agriculture/
OK to put some other multispectral cameras into comparison, I have collected following list:
Gopro-like
http://www.mapir.camera/
http://multispek.myshopify.com/ - seems to be calibrated with accessories
http://www.ir-pro.com/
DIY or PRO P&S and DSLR conversions
http://www.event38.com/SearchResults.asp?Cat=1830
maxmax.com - not recommended, bad quality (own experience)
http://www.lifepixel.com/
http://www.astrosurf.com/luxorion/photo-ir-uv.htm
http://flightriot.com/mapping/ndvi/
http://regent.qc.ca/assets/wincam_about.html
Specialized multichannel (more expensive but should have more accurate results)
http://www.tetracam.com/
http://www.optec.eu/en/telecamere_multicanale/telecamere_multicanal... - seems not finished yet for UAV use
http://www.quest-innovations.com/uav-cameras
http://www.micasense.com/
If you are interested in more scientific use, look for hyperspectral cameras. I have a list of those too, can provide if interested too.
Thanks Michael. I don't mind starting a spreadsheet and maintaining it, but I'm probably one of the least-qualified.
If someone would like to give some input on specs to compare, I'll get started.
Vega, your approach has been a little frustrating to me, but you have a lot of knowledge that could be useful to the community, if we can make it a little less...aggressive? I'd really like to see if we can come up with a wiki entry that is laid out in a sort of "Camera options for NDVI...For dummies" manner. I know (as others do as well) that these converted consumer cameras can produce some kind of useful information. If you will concede that point, give us a rundown on what we can expect to get for results from the full range of options available...in layman's terms.
It's obvious that you would like to share your expertise and recommendations, so present it in a manner that is palpable and gives us an upgrade path and some information on what to expect for functionality. Ned has done a lot of work for the community, and I would definitely like to see some collaboration.
Thanks for the great article. What do you think of the Tetracam cameras, especially the ADC Snap with the global shutter?
I'm not familiar with the camera system you mention beyond the online documentation but I like the global shutter and ability to create arrays of single narrow-band cameras. Working with well defined narrow-band filter/cameras is an advantage for making better NDVI and other index products. ADC has been around for a long time and they are used quite extensively and for scientific type cameras. They are a step up from using a point-and-shoot but maybe that difference isn't as great as some think. I would love to build something like that using tiny cameras with no Bayer filter over the sensor. Some folks in the astronomy community actually scrape off the Bayer filter from a digital camera to improve the light sensitivity. That seems a bit extreme but to each his own: http://petapixel.com/2013/08/04/scratching-the-color-filter-array-l...
-
5
-
6
-
7
-
8
-
9
of 9 Next