About serial image processing techniques: automatic methods with time history needed

Hi all,
since I am doing photomapping of terrain,
I have experienced, that the light tends to change progressively as I shot photos.
The problem is, the flight is following zig-zag or spiral shape and as a result I have gradual variation
of brightness and contrast across ortophotomap.
In my case I am striving for fast response, not for HDR quality, and it might be difficult to repeat a mission
that takes up to 2h of UAV flight.
The question is, are there any tools that can linearly/gradually or maybe automatically apply some correction to a list of images?
We are talking abotu 300-3000 photos per flight, up to a few times per day. A real mill.
I am aware of ImageMagick toolset, but it is not a solution:
The problem is that any automatic method I know gathers statistics over a single image, then applies the correction to one or many.
Also ImageMagick scripts I tried to apply by merging photos etc show insufficient processing speed of Image Magick (it is general tool, with dozens of intermediary memory copies/logic layers during processing a script).
What is needed is a tool that analyses 3..tens..all neighboring images (consecutive in the list) and applies slowly changing correction.
I know that somebody will advise fixing exposition in the camera but thsi is NOT the way to go in 50% cloud cover changing the lighting 8 times during the flight.

What is needed is something like Deflicker algorithm used in movies, but this would be ideal but I doubt it exist for photos.
At the moment I am looking for anything that works.

I know the issue could be known to ppl doing Timelapses but I have no idea what are the solutions (I guess they usually merge the results into a movie, then apply Deflicker filter in movie processing soft, but the resolution, compression and quality is lost).

At the moment typical application of autobalance or histogram equalize/anything leads to photos where 1 out of 20 pops up with very off colors or other parameters.

Views: 882

Tags: adjust, brightness, contrast, deflicker, equalize, gamma, image, processing, timelapse

Comment by Ritchie on February 6, 2011 at 4:08am

I have a brief idea from the robot vision site but it would require copious programing on your part. You want the same pictures from a long (or short) flight which is pretty much impossible because as the auto settings change the sensor comes out of its "comfort" range more and more until you start seeing the small dot artifacts.

The robot vision site suggested a few methods for image manipulation (nothing specific to your circumstance but) using a summing algorithm you could analyse the colour content of your picture and make adjustments to thers after. Having say a base pool and some thresholds may give you a pixel by pixel adjustment to help.

Also I would highly recommend using CMOS cameras if this is your goal as their colour sensing is inferior to CCD so you will make the job easier. Canon DLSR shot against Nikon DSLR is a classic CMOS vs CCD argument is why I know.

Comment by Krzysztof Bosak on February 6, 2011 at 4:12am
The problem is that I know I can do it, but not sure if it is not already done.
Comment by Johann Van Niekerk on February 6, 2011 at 4:26am

Hi Krzysztof

 

I am by no means a expert or have any expierance in this line of work but i am getting into it now. and very interested in what you are trying to achieve , I thought of a way to do this but dont know if it will work.

If take a High res Video camera like GoPro and film the complete area and afterwards use software to split the video up into images worked out on time frame of the movie ? that way the gopro Auto corrects light exposure over the course of flight and your images should be all the same ?

Comment by Krzysztof Bosak on February 6, 2011 at 4:29am

Will not work because digital camcorders use interframe compression.

Splitted photos will have bad quality (and typically lots of noise as well).

Comment by Johann Van Niekerk on February 6, 2011 at 4:41am

I have a different opinion on that krzysztof .

 

from what altitude are you taking these photo's on average?


Developer
Comment by John Arne Birkeland on February 6, 2011 at 5:11am

The photomerge function in Adobe Photoshop CS4/CS5 is good. But I have only used it for a limited number of images. Not sure how well it would hold up when using hundreds of images.

 

Does your camera support RAW images? That would allow for much more aggressive brightness and color correction without introducing artifacts.

Comment by Stephane Rocca on February 6, 2011 at 5:53am

Hi,

Enblend/enfuse is what your looking for : command line for your several thousand of pictures is possible with a bit of code... Already done it, really awesome program !

Comment by MarcS on February 6, 2011 at 6:21am
Hi,
Enblend looks interesting, but like a black box from the first look. I will try that...

Regarding a program capable of handling several hundred images, try ImageJ (http://rsbweb.nih.gov/ij/).
The task sounds like writing a small plugin for that. There are many good examples.
Comment by Krzysztof Bosak on February 6, 2011 at 6:27am

RAW is out of question because of quantity of data and required shotrate below 4s. Unless I missed a camera that can do 1000 RAWs every 4s.

 

The flight altitude is 200m agl on average.

300m on rare cases.

Almost never below.

Over 300m no chance.

Comment by Kris Nackaerts on February 6, 2011 at 6:38am

Enblend seems interesting for you: http://enblend.sourceforge.net/details.htm

Gain some experience how it's used in Hugin ( examples on enblend results at http://hugin.sourceforge.net/tech/ ). Detailed info on how Hugin uses enblend: http://hugin.sourceforge.net/tutorials/Blend-masks/en.shtml

 

Comment

You need to be a member of DIY Drones to add comments!

Join DIY Drones

Social Networking

Contests

Season Two of the Trust Time Trial (T3) Contest has now begun. The fourth round is an accuracy round for multicopters, which requires contestants to fly a cube. The deadline is April 14th.

A list of all T3 contests is here

Groups

Advertisement

© 2013   Created by Chris Anderson.   Powered by

Badges  |  Report an Issue  |  Terms of Service