[0001] The present application relates to a method and apparatus for expanding dynamic range
of original image data in digital images.
[0002] Michael Reichmann: "Contrast Masking", 15. October 2002, XP 000002656960 discloses a method to reduce dynamic range in digital images by
combining an original image and a tone mapped version of this image according to a
luminance-dependent mask, to permit printing while preserving colors.
Background
[0003] The human eye is sensitive light over a very wide range of intensities. Images must
have high dynamic ranges to accurately reproduce real scenes. High-performance image
sensors, such as high-performance CCD arrays are capable of acquiring images having
high dynamic ranges. There are displays, such as the displays available from Dolby
Canada Corporation are capable of displaying high dynamic range images. However, many
computer displays, televisions and the like have limited dynamic ranges and are incapable
of displaying such high dynamic range images.
[0004] Some image data has low dynamic range because of the way that the image data is acquired
or generated. In other cases, the dynamic range of image data may be reduced to match
the characteristics of displays on which image of the image data will be reproduced.
A tone mapping operator can be applied to higher dynamic range image data to reduce
the dynamic range of the image data. This may be done, for example, to provide image
data that matches the dynamic range of a type of display or a particular image data
format.
[0005] There is a vast amount of existing image data that has a dynamic range that is lower
than the dynamic range that can be displayed by available high dynamic range displays
and/or appreciated by the human eye.
[0006] There is a need for methods and apparatus that can boost the dynamic range of lower
dynamic range image data.
Summary
[0007] The following embodiments and aspects thereof are described and illustrated in conjunction
with systems, tools and methods which are meant to be exemplary and illustrative,
not limiting in scope. In various embodiments, one or more of the above-described
problems have been reduced or eliminated, while other embodiments are directed to
other improvements.
[0008] One aspect of the invention provides a method for increasing the dynamic range of
original image data representing an image. The method comprises, in any order: applying
an expansion function to generate from the original image data expanded data having
a dynamic ranged greater than that of the original image data; and, obtaining an expand
map comprising data indicative of a degree of luminance of regions associated with
pixels in the image. The method combines the original image data and the expanded
data according to the expand map to yield enhanced image data.
[0009] Another aspect of the invention provides apparatus for expanding the dynamic range
of original image data. The apparatus comprises: a dynamic range expander connected
to receive original image data and to output expanded data having a dynamic range
in terms of possible pixel values greater than that of the original image data; a
luminance distribution analyzer configured to generate an expand map indicative of
the luminance of regions associated with pixels in the image of the original image
data; and an image combiner configured to combine the original image data with the
expanded data from the dynamic range expander according to the expand map to yield
enhanced image data.
[0010] In addition to the exemplary aspects and embodiments described above, further aspects
and embodiments are described below and/or will become apparent by reference to the
drawings and by study of the following detailed description.
Brief Description of Drawings
[0011] The appended drawings which illustrate non-limiting embodiments of the invention.
[0012] Figure 1 is a flow chart illustrating a method according to an embodiment of the
invention.
[0013] Figure 2 is a block diagram of an apparatus according to the invention.
[0014] Figure 3 is a block diagram of an apparatus according to another embodiment of the
invention.
[0015] Throughout the following description specific details are set forth in order to provide
a more thorough understanding to persons skilled in the art. However, well known elements
may not have been shown or described in detail to avoid unnecessarily obscuring the
disclosure. Accordingly, the description and drawings are to be regarded in an illustrative,
rather than a restrictive, sense.
[0016] This invention provides methods and apparatus for boosting the dynamic range of image
data. The methods and apparatus may be applied, for example, to increase the dynamic
range of legacy images (which may be still or video images, for example) for display
on high dynamic range displays.
[0017] Figure 1 shows a method
20 according to an embodiment of the invention. Method
20 acts on original image data
23 obtained in block
24 to expand the dynamic range of the image data
23. In block
26, method
20 expands original image data
23 to obtain expanded image data
25. Expanding maps pixel luminosity values from a first range to a second range. The
second range provides more possible values than the first range. For example, the
first range may permit values in the range of 0 to 255 while the second, expanded,
range may permit values in the range of 0 to 1023 or values in the range of 0.00 to
1.00 to some specified precision. In some embodiments, the luminosity value of a pixel
in expanded image data
25 is a function of the luminosity value of the corresponding pixel in original image
data
23.
[0018] Expanding may involve any of: linear scaling, non-linear scaling or applying a more
complicated expansion function such as the inverse of a tone mapping function. Where
block
26 applies an inverse tone-mapping function, the inverse tone-mapping function applied
in block
26 is not necessarily the inverse of any particular tone mapping function used in the
creation of original image data
23. Indeed, in some cases, original image data 23 may have been obtained without the
application of a tone mapping function or through the application of a tone mapping
function different from the inverse of the tone mapping function applied in block
26.
[0019] One example tone mapping function is the
Photographic Tone Reproduction described in Reinhard et al., Photographic tone reproduction
for digital images, ACM Trans. Graph., 21, 3, 267-276 (2002). Other tone mapping functions are described, for example, in
Smith et al, Beyond tone mapping: Enhanced depiction of tone mapped HDR images. ,
Computer Graphics Forum 25, 3 (2006); and
Ledda et al. Evaluation of tone mapping operators using a high dynamic range display,
ACM Trans. Graph., 24, 3, 640-648 (2005).
[0020] The photographic tone reduction tone mapping operator scales pixel luminosity values
based on a geometric average, which is or approximates the key of the scene and then
compresses the resulting values. The scaling may be given by:

where
Lm is the scaled value, α is a user parameter,
Lw is the luminosity of the pixel in original image data 23. If original image data
23 is in an RGB format then
Lw may be given by:

where
Rw,
Gw and
Bw are respectively the red, green and blue pixel values for the pixel in the RGB color
space.
L̅w is the geometric average defined by:

where δ is a small non-negative value and
N is a number of pixels in the image.
[0021] The compression maybe provided by a function which takes input values within a first
range and produces output values within a second, narrower range. For example, compression
could be provided by:

where
Ld is the compressed value for the pixel at (x, y). In a more flexible embodiment, the
compression is provided by:

where
Lwhite is a parameter that corresponds to the smallest luminance value from the uncompressed
data that will be mapped to white in the compressed data.
[0022] Equation (5) can be inverted by solving the quadratic equation:

In Equation (5),
Lm can be replaced by the value from Equation (1) to yield:

Equation (7) can be solved for
Lw using the quadratic formula to obtain the largest positive-valued solution. This
can be performed for each pixel in an image to obtain expanded image data
25.
[0023] To apply the solution of Equation (7) for inverse tone-mapping one must assign values
to the parameters α,
Lwhite,
Ld and the geometric average
L̅w. Unless one knows what tone-mapping operator (if any) was applied to obtain the lower
dynamic range image being worked on, these parameters will not be known. In methods
according to some embodiments, a user may set values for these parameters. In some
embodiments, the parameters may be automatically set or predetermined. In some embodiments,
some or all of the parameters are set automatically to initial values and a user can
vary the parameter values from those initial values, if desired.
[0024] One way to assign
L̅w is to use the geometric average luminance of the lower dynamic range image being
processed. It has been found that the geometric average luminance of a higher- and
lower-dynamic range images of the same scene are typically quite similar (unless the
lower-dynamic-range image is significantly over- or under-exposed). Certain tone-mapping
operators tend to change the geometric average luminance. Where such tone mapping
operators have been used in the generation of original image data
23 it may be desirable to use a function of the geometric average luminance of the lower
dynamic range image being processed for
L̅w. The function may be chosen based upon knowledge of the tone-mapping operator used
to generate original image data
23 or may be determined empirically.
[0025] One way to assign a value to the parameter
Ld (
x,y) is to realize that
Ld is the luminance of the lower-dynamic range image being processed.
[0026] The parameters α and
Lwhite may be set by the user. The meaning of the parameter α is somewhat enigmatic. Therefore,
the inventors prefer to define a parameter
Lmax' such that:
Lmax' is the maximum luminance value expected in the inverse tone-mapped image.
Lwhite affects the expansion of the original low- and medium-luminance values. If
Lwhile is very high, those values are mapped to very low luminance values. If
Lwhite is very low, the inverse-tone-mapped image will have luminance values similar to
those in the original lower-dynamic range image scaled by the factor
Lmax'. In typical applications, setting
Lwhite and
Lmax' to have values that are equal or of the same order tends to produce reasonable results.
[0027] The expansion function applied in block
26 may produce an expanded image that is not completely acceptable. If the expansion
function produces output luminance values that are high then the resulting image may
be "blocky" in appearance.
[0028] Method
20 obtains an output image
33 by combining expanded image
25 with original image
23 according to an expand map
29 generated in block
28. Expand map
29 identifies higher-luminance and lower-luminance areas of original image
23. Using expand map
29, method
20 bases output image
33 more heavily on expanded image
25 in higher-luminance areas and bases output image
33 more heavily on original image
23 in lower-luminance areas. Block
28 may use any suitable method for evaluating the luminance level of an area to which
a pixel belongs. For example, block
28 may compute an average luminance or weighted average luminance of pixels in an area
to which each pixel belongs. Expand map
29 includes weights associated with each pixel. The weights indicate the relative degree
to which original image
23 and expanded image
25 contribute to the value for that pixel in enhanced image
33.
[0029] In the illustrated embodiment, block
28 applies a median cut algorithm in block
28A. The median cut algorithm is described, for example, in
Debevec, P., A median cut algorithm for light probe sampling, ACM Siggraph 2005 posters
(2005). The median cut algorithm identifies a set of point light sources that are clustered
near areas of high luminance in an image. The number and intensity of such light sources
in the vicinity of a pixel is used to create expand map
29 in some embodiments.
[0030] The median cut algorithm divides an image into 2
n regions of similar light energy. These areas may be identified by subdividing the
image along the longest dimension such that the luminance is equally apportioned between
the resulting regions. The process is repeated for the resulting regions. A light
source is placed at the centroid of each of the 2° regions obtained by iterating the
process of dividing the image into regions
n times. The colour of each light source is set to an average value across the region
(for example, the colour may be set to equal a sum of pixel values within the region.
[0031] In some embodiments of the invention n is at least 9 (corresponding to 512 light
sources). In some embodiments
n is 10 or more.
[0032] In some implementations, the point light sources may be stored in a data structure
comprising a 2D tree to facilitate nearest-neighbour searches that may be performed
in creation of expand map
29.
[0033] It is not mandatory that the original image
23 be used for identification of higher- and lower-luminance areas. The distribution
of higher- and lower-luminance areas will be similar in original image data 23 and
expanded image data
25. The median cut algorithm may be performed on expanded image data
25.
[0034] One way to obtain a set of weights from the light-sources identified by the median
cut algorithm performed in block
28A is to determine for each pixel (
x,y) the density of light sources within an area surrounding the pixel. The area may
conveniently comprise a circular area having some radius
r for example. Other area shapes could also be used. Density estimation is described
in
Duda et al. Pattern Classification 2nd Edition, Wiley Interscience (2001).
[0035] A basic formula that may be used for density estimation is:

where: Λ is the density;
X is the location (
x.y) in the image; Ψ
p is the luminance value for a light source at point
p; and ,
P is the set of points within the area (a circle having radius
r and centered at X in this example) that correspond to light sources identified by
the median cut algorithm.
r
[0036] The density estimation can be improved in a number of ways including:
- iterating the median cut algorithm to obtain a greater number of light sources (i.e.
making n larger);
- applying a smoothing filter to the results of the density estimation;
- requiring that at least a threshold number of light sources (for example, where there
are 1024 or more light sources - n=10 the threshold number could be 4 or more - in some cases 4-6 light sources) be
within a region of influence of a pixel (e.g. within a radius r of the pixel) before assigning a non-zero density A to the pixel.
[0037] A smoothing filter may comprise a Gaussian smoothing filter. For example, a prototype
embodiment applied a Gaussian filter defined by the weight of the kernel given by:

where:

is the kernel; γ and β are parameters. This filter is described, for example in
Pavicic, Convenient Anti-Aliasing Filters that Minimize Bumpy Sampling, Morgan Kaufmann,
(1990). Example values for γ and β are γ =0.918 and β =1.953. This filter is normalized
and can be applied by scaling the luminances by

when computing the density estimation as described above. It can be seen that this
filter weights light sources that are closer to the pixel more deavily than light
sources that are farther from the pixel.
[0038] In block
30, original data
23 and expanded data
25 are combined using expand map
29 to yield enhanced data
33. In an illustrative example, expand map
29 provides a value in the range [0,1] for each pixel. This value can be used as weights
for a linear interpolation between original data
23 and expanded data
25. For example:

where:
Lfinal is a pixel luminance value in enhanced data
33 for a pixel at location (
x,y);
Lw is a luminance value for the pixel in expanded data
25;
Ld is a luminance value for the pixel in original data
23; and A is a weight for the pixel in the range [0,1] from expand map
29.
[0039] Block
30 could optionally combine original data
23 and expanded data
25 in other ways. For example, the interpolation could be non-linear.
[0040] The methods described herein may be applied to enhance the dynamic range of digital
still images or video images, for example. Enhanced data
33 may be saved, as indicated in block
34 or displayed on a display, as indicated in block
36.
[0041] The inverse tone mapping operator described above with reference to Equations (6)
and (7) has application outside of method
20. For example, the inverse tone mapping operator could be applied directly to increase
the dynamic range of frames in a video. In such embodiments, the image of each frame
of the video may be processed by the inverse tone mapping operator to obtain an expanded
frame. The expanded frames may be stored and/or played back to provide video having
a dynamic range higher than that of the original video.
[0042] Typical images contain hundreds of thousands of pixels and, more typically, millions
of pixels. The methods described herein are performed using automated apparatus, such
as specialized hardware and/or programmed computer systems.
[0043] Figure 2 shows schematically apparatus
40 for producing images having expanded dynamic ranges from original image data
23. Apparatus
40 comprises a dynamic range expander
44 that processes original image data
23 to yield expanded data
25. In some embodiments, dynamic range expander
44 comprises a software module that takes original image data
23 and applies a dynamic range expansion function to each luminance value in original
image data
23 to yield expanded data
25.
[0044] Apparatus
40 comprises a luminance distribution analyzer
46 that processes original image data
23 (or optionally expanded data
25) to yield expand map
29. Luminance distribution analyzer
46 determines the degree to which pixels in the original image data
23 belong to high-luminance and low-luminance areas of the image represented by original
image data
23.
[0045] Combiner
48 combines original image data
23 and expanded data
25 to yield enhanced data
33. The relative degree to which each pixel of enhanced data
33 is based upon the value for the corresponding pixel of original image data
23 and expanded data
25 depends upon the value of the corresponding pixel in expand map
29.
[0046] Each of dynamic range expander
44, luminance distribution analyzer
46 and combiner
48 may comprise a hardware module, a combination of hardware and software, or configurable
hardware, such as one or more suitably configured field-programmable gate arrays (FPGAs).
In some embodiments, apparatus
40 is provided in a high dynamic range electronic display system capable of displaying
still and/or video images. In such embodiments, apparatus
40 may be activated to enhance legacy images and/or video images having dynamic ranges
lower than a dynamic range that the display system is capable of reproducing.
[0047] Figure 3 illustrates apparatus
50 according to another embodiment of the invention. Apparatus
50 has a user interface
52 which permits a user to control values of parameters
31 in a data store
54. Parameters
31 control the operation of a dynamic range boosting system
56 that processes original image data
23 to obtain enhanced image data 33 as described herein. Enhanced image data
33 is displayed on a display
60 controlled by a high dynamic range display driver
58. In the illustrated embodiment, a user can view the effect of a particular set of
parameters
31 on the image displayed on display
60 and then alter the values of one or more parameters
31 by way of user interface
52 to achieve a desired appearance of the image. The user can then save the enhanced
image data
33 for later display on display
60 or on other high dynamic range displays.
[0048] Certain implementations of the invention comprise computer processors which execute
software instructions which cause the processors to perform a method of the invention.
For example, one or more processors in an image-processing or image display system
may implement the methods of Figure 1 by executing software instructions in a program
memory accessible to the processors. The invention may also be provided in the form
of a program product. The program product may comprise any medium which carries a
set of computer-readable signals comprising instructions which, when executed by a
data processor, cause the data processor to execute a method of the invention. Program
products according to the invention may be in any of a wide variety of forms. The
program product may comprise, for example, physical media such as magnetic data storage
media including floppy diskettes, hard disk drives, optical data storage media including
CD ROMs, DVDs, electronic data storage media including ROMs, flash RAM, or the like.
The computer-readable signals on the program product may optionally be compressed
or encrypted.
[0049] Where a component (e.g. a software module, processor, assembly, device, circuit,
etc.) is referred to above, unless otherwise indicated, reference to that component
(including a reference to a "means") should be interpreted as including as equivalents
of that component any component which performs the function of the described component
(i.e., that is functionally equivalent), including components which are not structurally
equivalent to the disclosed structure which performs the function in the illustrated
exemplary embodiments of the invention.
[0050] While a number of exemplary aspects and embodiments have been discussed above, those
of skill in the art will recognize certain modifications, permutations, additions
and sub-combinations thereof. For example:
- Application of the invention is not limited to any particular formats for representing
image data or to any particular colour spaces. Although luminance values are processed,
it is not necessary that the original image data 23 or the enhanced image data 33 be in a LUV or other format in which luminance values are explicitly represented.
The invention can be practiced with other image formats that contain information from
which luminance values can be derived. For example, where image data is represented
in a RGB format, luminance values can be derived through the application of Equation
(2) or other suitable relationship which produces a value related to luminance from
values for individual colours in the image.
It is therefore intended that the following appended claims are interpreted to include
all such modifications, as are within their scope.
1. A method for increasing dynamic range of original image data representing an image,
the method comprising:
in any order:
applying an expansion function to generate from the original image data expanded data
having a dynamic range in terms of possible pixel values greater than that of the
original image data; and,
obtaining an expand map comprising data indicative of a degree of luminance of regions
associated with pixels in the image; and,
combining the original image data and the expanded data according to the expand map
to yield enhanced image data.
2. A method according to claim 1 wherein obtaining the expand map comprises performing
a median cut algorithm on data representing the image.
3. A method according to claim 2 wherein the data representing the image comprises the
original image data or the expanded data.
4. A method according to any one of claims 2 to 4 wherein obtaining the expand map comprises
estimating a density of light sources identified by the median cut algorithm in the
regions associated with the pixels.
5. A method according to claim 4 wherein the regions associated with the pixels comprise
circular regions centered on the pixels.
6. A method according to any one of claims 4 or 5 wherein estimating the density comprises
weighting the light sources according to a smoothing function.
7. A method according to claim 6 wherein the smoothing function comprises an exponential
of a negative value that is a function of a distance of the light source from the
pixel.
8. A method according to any one of claims 5 to 6 wherein estimating the density for
a pixel comprises weighting the light sources according to their distance from the
pixel with light sources closer to the pixel weighed more heavily than light sources
further from the pixel.
9. A method according to claim 12 comprising setting a pixel value in the expand map
to a predetermined value if there are not at least a threshold number of light sources
in the region associated with the pixel.
10. A method according to any one of claims 1 to 9 wherein applying the expansion function
comprises applying an inverse tone-mapping operator.
11. A method according to any one of claims 1 to 9 wherein applying the expansion function
comprises linear scaling pixel luminosity values of the original image data.
12. A method according to any one of claims 1 to 9 wherein applying the expansion function
comprises solving for L
w in the quadratic equation:

or a mathematical equivalent thereof, where α,
Lwhile, and
L̅w are parameters and
Ld is a luminance value corresponding to a pixel in the original image data, and
Lw (
x, y) is a luminance value for a pixel at a location (x,y) in the expanded data.
13. A method according to any one of claims 1 to 12 wherein combining the original image
data and the expanded data comprises computing weighted averages of pixel luminance
values of the original image data and expanded data with weighting values determined
from the expand map.
14. A method according to any one of claims 1 to 12 wherein combining the original image
data and the expanded data comprises interpolating pixel luminance values of the original
image data and expanded data with weighting values determined from the expand map.
15. Apparatus for expanding the dynamic range of original image data, the apparatus comprising:
a dynamic range expander connected to receive original image data and output expanded
data having a dynamic range in terms of possible pixel values greater than that of
the original image data;
a luminance distribution analyzer configured to generate an expand map indicative
of the luminance of regions associated with pixels in the image of the original image
data;
an image combiner configured to combine the original image data with the expanded
data from the dynamic range expander according to the expand map to yield enhanced
image data.
16. Apparatus according to claim 15 wherein the luminance distribution analyzer is configured
to perform a median cut algorithm.
1. Verfahren zur Erhöhung des dynamischen Bereichs von originalen Bilddaten, die ein
Bild darstellen, wobei das Verfahren Folgendes umfasst:
in einer beliebigen Reihenfolge:
- Anwenden einer Expansionsfunktion, um aus den originalen Bilddaten expandierte Daten
zu generieren, die im Hinblick auf mögliche Pixelwerte einen dynamischen Bereich aufweisen,
der größer ist als der der originalen Bilddaten; und
- Erhalten einer Expandierungskarte, die Daten umfasst, die einen Leuchtdichtegrad
von Regionen anzeigt, die Pixeln in dem Bild zugeordnet sind; und
- Kombinieren der originalen Bilddaten und der expandierten Daten gemäß der Expandierungskarte,
um optimierte Bilddaten zu erhalten.
2. Verfahren nach Anspruch 1, wobei das Erhalten der Expandierungskarte das Ausführen
eines Medianschnittalgorithmus an Daten, die das Bild darstellen, umfasst.
3. Verfahren nach Anspruch 2, wobei die Daten, die das Bild darstellen, die originalen
Bilddaten oder die expandierten Daten enthalten.
4. Verfahren nach einem der Ansprüche 2 bis 4, wobei das Erhalten der Expandierungskarte
das Schätzen einer Dichte von Lichtquellen umfasst, die durch den Medianschnittalgorithmus
in den Regionen, die den Pixeln zugeordnet sind, identifiziert werden.
5. Verfahren nach Anspruch 4, wobei die Regionen, die den Pixeln zugeordnet sind, kreisförmige
Regionen umfassen, die auf die Pixel zentriert sind.
6. Verfahren nach einem der Ansprüche 4 oder 5, wobei das Schätzen der Dichte das Gewichten
der Lichtquellen gemäß einer Glättungsfunktion umfasst.
7. Verfahren nach Anspruch 6, wobei die Glättungsfunktion ein Exponential eines negativen
Wertes umfasst, der eine Funktion einer Entfernung der Lichtquelle von dem Pixel ist.
8. Verfahren nach einem der Ansprüche 5 bis 6, wobei das Schätzen der Dichte für einen
Pixel umfasst, die Lichtquellen entsprechend ihrer Entfernung von dem Pixel zu gewichten,
wobei Lichtquellen, die näher an dem Pixel liegen, schwerer gewichtet werden als Lichtquellen,
die weiter von dem Pixel entfernt liegen.
9. Verfahren nach Anspruch 12, das umfasst, einen Pixelwert in der Expandierungskarte
auf einen zuvor festgelegten Wert zu setzen, wenn sich nicht mindestens eine Schwellenanzahl
von Lichtquellen in der Region, die dem Pixel zugeordnet ist, befindet.
10. Verfahren nach einem der Ansprüche 1 bis 9, wobei das Anwenden der Expansionsfunktion
das Anwenden eines inversen Ton-Mapping-Operators umfasst.
11. Verfahren nach einem der Ansprüche 1 bis 9, wobei das Anwenden der Expansionsfunktion
das lineare Skalieren von Pixelleuchtkraftwerten der originalen Bilddaten umfasst.
12. Verfahren nach einem der Ansprüche 1 bis 9, wobei das Anwenden der Expansionsfunktion
das Auflösen für
Lw in der quadratischen Gleichung

oder eines mathematischen Äquivalents davon umfasst, wobei α
, Lwhite und
L̅w Parameter sind und
Ld ein Leuchtdichtewert ist, der einem Pixel in den originalen Bilddaten entspricht,
und
Lw (
x, y) ein Leuchtdichtewert für einen Pixel an einer Position (
x,
y) in den expandierten Daten ist.
13. Verfahren nach einem der Ansprüche 1 bis 12, wobei das Kombinieren der originalen
Bilddaten und der expandierten Daten das Berechnen gewichteter Mittelwerte von Pixelleuchtdichtewerten
der originalen Bilddaten und expandierten Daten mit Gewichtungswerten, die anhand
der Expandierungskarte bestimmt wurden, umfasst.
14. Verfahren nach einem der Ansprüche 1 bis 12, wobei das Kombinieren der originalen
Bilddaten und der expandierten Daten das Interpolieren von Pixelleuchtdichtewerten
der originalen Bilddaten und expandierten Daten mit Gewichtungswerten, die anhand
der Expandierungskarte bestimmt wurden, umfasst.
15. Vorrichtung zum Erweitern des dynamischen Bereichs von originalen Bild-Daten, wobei
die Vorrichtung Folgendes umfasst:
- einen Expandierer des dynamischen Bereichs, der so angeschlossen ist, dass er originale
Bilddaten und ausgegebene expandierte Daten empfängt, die im Hinblick auf mögliche
Pixelwerte einen dynamischen Bereich aufweisen, der größer ist als der der originalen
Bilddaten;
- einen Leuchtdichteverteilungsanalysator, der dafür konfiguriert ist, eine Expandierungskarte
zu generieren, welche die Leuchtdichte von Regionen anzeigt, die Pixeln in dem Bild
der originalen Bilddaten zugeordnet sind;
- einen Bildkombinierer, der dafür konfiguriert ist, die originalen Bilddaten mit
den expandierten Daten aus dem Expandierer des dynamischen Bereichs entsprechend der
Expandierungskarte zu kombinieren, um optimierte Bilddaten zu erhalten.
16. Vorrichtung nach Anspruch 15, wobei der Leuchtdichteverteilungsanalysator dafür eingerichtet
ist, einen Medianschnittalgorithmus auszuführen.
1. Procédé d'augmentation de la plage dynamique de données d'image originales représentant
une image, le procédé consistant à :
dans n'importe quel ordre :
- appliquer une fonction d'extension pour générer, à partir des données d'image originales,
des données étendues ayant une plage dynamique, sur le plan des valeurs de pixels
possibles, supérieure à celle des données d'image originales ; et,
- obtenir une carte d'extension comprenant des données indiquant un degré de luminance
de régions associées à des pixels dans l'image ; et,
- combiner les données d'image originales et les données étendues selon la carte d'extension
pour produire des données d'image améliorées.
2. Procédé selon la revendication 1, dans lequel l'obtention de la carte d'extension
consiste à exécuter un algorithme de coupe médiane sur des données représentant l'image.
3. Procédé selon la revendication 2, dans lequel les données représentant l'image comprennent
les données d'image originales ou les données étendues.
4. Procédé selon l'une quelconque des revendications 2 à 4, dans lequel l'obtention de
la carte d'extension consiste à estimer une densité de sources de lumière identifiées
par l'algorithme de coupe médiane dans les régions associées aux pixels.
5. Procédé selon la revendication 4, dans lequel les régions associées aux pixels comprennent
des régions circulaires centrées sur les pixels.
6. Procédé selon l'une quelconque des revendications 4 ou 5, dans lequel l'estimation
de la densité consiste à pondérer les sources de lumière selon une fonction de lissage.
7. Procédé selon la revendication 6, dans lequel la fonction de lissage comprend un exponentiel
d'une valeur négative qui est fonction d'une distance de la source de lumière par
rapport au pixel.
8. Procédé selon l'une quelconque des revendications 5 à 6, dans lequel l'estimation
de la densité pour un pixel consiste à pondérer les sources de lumière en fonction
de leur distance par rapport au pixel, en pondérant plus lourdement des sources de
lumière plus proches du pixel que des sources de lumière plus éloignées du pixel.
9. Procédé selon la revendication 12, consistant à mettre une valeur de pixel dans la
carte d'extension à une valeur prédéterminée s'il n'y a pas au moins un nombre seuil
de sources de lumière dans la région associée au pixel.
10. Procédé selon l'une quelconque des revendications 1 à 9, dans lequel l'application
de la fonction d'extension consiste à appliquer un opérateur de redistribution des
tonalités inverse.
11. Procédé selon l'une quelconque des revendications 1 à 9, dans lequel l'application
de la fonction d'extension consiste à effectuer une mise à l'échelle linéaire de valeurs
de luminosité de pixel des données d'image originales.
12. Procédé selon l'une quelconque des revendications 1 à 9, dans lequel l'application
de la fonction d'extension consiste à résoudre
Lw dans l'équation quadratique :

ou un équivalent mathématique, où α,
Lwhite, et
L̅w sont des paramètres et
Ld est une valeur de luminance correspondant à un pixel dans les données d'image originales,
et
Lw (
x, y) est une valeur de luminance pour un pixel à un emplacement (
x,
y) dans les données étendues.
13. Procédé selon l'une quelconque des revendications 1 à 12, dans lequel la combinaison
des données d'image originales et des données étendues consiste à calculer des moyennes
pondérées de valeurs de luminance de pixel des données d'image originales et des données
étendues avec des valeurs de pondération déterminées à partir de la carte d'extension.
14. Procédé selon l'une quelconque des revendications 1 à 12, dans lequel la combinaison
des données d'image originales et des données étendues consiste à interpoler des valeurs
de luminance de pixel des données d'image originales et des données étendues avec
des valeurs de pondération déterminées à partir de la carte d'extension.
15. Appareil permettant d'étendre la plage dynamique de données d'image originales, l'appareil
comprenant :
- un extenseur de plage dynamique connecté pour recevoir des données d'image originales
et fournir en sortie des données étendues ayant une plage dynamique, sur le plan des
valeurs de pixels possibles, supérieure à celle des données d'image originales ;
- un analyseur de distribution de luminance configuré pour générer une carte d'extension
indiquant la luminance de régions associées à des pixels dans l'image des données
d'image originales ;
- un combineur d'image configuré pour combiner les données d'image originales avec
les données étendues à partir de l'extenseur de plage dynamique selon la carte d'extension
pour produire des données d'image améliorées.
16. Appareil selon la revendication 15, dans lequel l'analyseur de distribution de luminance
est configuré pour exécuter un algorithme de coupe médiane.