BACKGROUND
[0001] The present invention proposes techniques for creating multi-ink luminescent color
halftone images with means of verifying their authenticity. In addition, the invented
luminescent color halftone image synthesizing techniques enable increasing the attractiveness
and aesthetics of color images.
[0002] Providing new authenticating techniques coupled with corresponding design tools is
of high importance, since existing documents and valuable products are often counterfeited
due to the availability of high-quality and low-priced color photocopiers, desktop
scanners, color printers and image processing software.
[0003] These new authenticating and design capabilities rely on the extended gamut and the
strong luminescent colors offered by the invented methods for creating color images
with combinations of classical and of daylight luminescent inks. The presence of a
luminescent image part, verified by using an illuminant different from a reference
illuminant (e.g. a UV light source, a colored light source, or a white light source
different from the reference illuminant) validates the authenticity of the document,
respectively product. Security documents such as banknotes, checks, credit cards,
identity cards, travel documents, business documents, diploma as well as medical drug
packages, commercial art and fashion articles may benefit from the enhanced security
and the new design features provided by color separations into classical non-luminescent
and daylight luminescent inks.
[0004] A further application concerns valuable products where protective and decorative
features can be combined. For example luxury goods such as watches and clocks, bottles
of expensive liquids (perfumes, body care liquids, alcoholic drinks), clothes (e.g.
dresses, skirts, blouses, jackets and pants), pieces of art (paintings) may show under
normal daylight light striking luminescent color images and at the same time prevent
counterfeits by making the unauthorized reproduction of such luminescent color images
difficult to achieve with commercially available desktop scanners and printers.
The present invention relies on the synthesis of color images with daylight luminescent
inks. Until now, daylight luminescent colors were mostly used within fluorescent markers
and for painting purposes. Slightly fluorescent inks have been used in the past by
the print industry for increasing the saturation of an ink, for example the magenta
ink. Daylight luminescent inks produce, when seen under daylight, saturated and intense
colors since part of the energy absorbed at excitation wavelengths within the UV and
the visible wavelength ranges is reemitted by luminescence within the visible wavelength
range. Since daylight luminescent inks absorb energy in the visible wavelength range,
they cannot be additively mixed, such as for example fluorescent inks that are invisible
under daylight and possibly create non-interfering emission colors under UV light.
In addition, since for most daylight luminescent inks, energy is also absorbed in
the UV excitation wavelength range, daylight luminescent inks form, thanks to their
emission spectra, also visible colors, when seen under a UV illumination (also called
"black light").
The term "luminescence" encompasses both the de-excitation of molecules by fluorescent
emission, where the lifetime of an exited molecule ranges between 10
-10s to 10
-7s and slower radiative emission de-excitation processes, where the lifetime of the
excited state of molecules ranges between 10
-7s to several seconds. The terms "UV illumination", "UV illuminant" or "UV light" mean
that the illuminant emits within the UV wavelength range, between 150nm and 400nm.
Commercially available UV lamps, also called blacklight lamps, have peaks at 254nm
(UVC wavelength range), 311 or 313nm (UVB wavelength range) or at 365nm (UVA wavelength
range).
Throughout the present disclosure, we refer to the CIE-XYZ and the CIELAB colorimetric
systems (see
Color fundamentals for digital imaging, in Digital Color Imaging Handbook, Sharma
G. Ed., Chap. 1, Sections 1.5 to 1.7, pp. 15-40, CRC Press, 2003, and denoted [Sharma 2003]). In the present disclosure, the
L*,
a*,
b* coordinates, as well as the chroma
C* and the hue
h* of the CIELAB colorimetric system are written without the star, i.e. respectively
L, a, b, C,
h.
[0005] There were prior art attempts to create color images by using several luminescent
inks each emitting in a different part of the visible wavelength range.
US Pat. 7,054,038, Method and apparatus for generating digital halftone images by multi color dithering,
filed Jan 4, 2000, to Ostromoukhov and Hersch (also inventor in the present patent
application), teaches a multi-color dithering method where one or more inks are possibly
fluorescent inks. However, since the teachings of that patent are limited to juxtaposed
halftones, i.e. side by side printed surfaces of fluorescent and non-fluorescent inks,
it cannot be applied to today's mainstream screening technologies, such as mutually
rotated clustered dots, where ink dots do partially overlap. In addition, juxtaposed
halftoning requires a high registration accuracy which is difficult or impossible
to achieve on high-throughput and/or on large size printing systems (offset, gravure,
flexo, serigraphy).
[0006] In several inventions, fluorescent inks which are invisible when seen under normal
daylight are used to check the authenticity of documents under UV light.
US Pat. Appl. 10/818058, "Methods and ink compositions for invisibly printed security images having multiple
authentication features", to Coyle, W. J. and Smith, J. C, filed April 5, 2004, proposes
to create fluorescent color images with red, green and blue emitting fluorescent inks,
which are invisible under day light.
US Patent 7,005,166, "Method for fluorescent image formation, print produced thereby and thermal transfer
sheet thereof," to Narita and Eto (2002), teaches how to form an image with color
gradations using fluorescent red, green and blue colorants, colorless under normal
daylight and emitting fluorescence under UV illumination.
US Pat. Appl. 10/482,892 "Halftone image produced by printing", inventors Brehm L. and Erbar H., priority
Jul. 25, 2001, also describes an additive fluorescent ink mixing process capable of
creating continuous tone halftone images. However, since the proposed halftoning process
is additive, it can only be applied to inks which to do not absorb in the visible
wavelength range, i.e. to substantially invisible fluorescent inks.
[0007] US Pat Appl. 11/785931, "Printing color images visible under UV light on security documents and valuable
articles", filed 23
rd April 2007 to Hersch (also inventor in present application), Donzé and Chosson (hereinafter:
"Hersch, Donzé, Chosson 2007") teaches a method for printing full color images invisible
under daylight and visible under UV illumination with fluorescent inks which may have
emission colors different from red, green and blue.
[0008] A fluorescent or luminescent optical symbol scanner is disclosed in
US Pat. 7,357,326, filed Nov. 30, 2005 to Hattersley and Blackwell III, relying on a light emitting diode illuminating in the visible spectrum at a first
wavelength, and a filter and sensor for capturing light at a second wavelength. The
presence of light at the second wavelength enables reading fluorescent or luminescent
markings.
[0009] US Pat. Appl. 10/517299, "System and methods for product and document authentication", filed June 7, 2002
to G. Jones II, S. Burke and P. McDonald describes a method of marking products by
tags formed by luminescent inks having specific emission wavelength ranges and specific
decay times.
[0010] US Pat 7,422,158, Fluorescent hidden indicium, filed Oct. 24, 2003 to Auslander and Cordery propose
a print head system with a first ink having a first color under normal daylight and
a second fluorescent ink having the same color as the first ink under normal daylight
but discernible from the first ink when subjected to fluorescent-exciting radiation.
This second ink visible only under a fluorescence exciting radiation enables creating
covert markings.
US Pat 7,379,205 " System and method for embedding and extracting key information "to J.D. Auslander
et. al, filed 16
th of Dec. 2003 adds the possibility of revealing key information by the second fluorescent
ink under fluorescent exciting light.
[0011] US Pat 7,182,451 " Method and apparatus for halftone printing with multi-signal transmission ink"
to J.D. Auslander, filed 24
th of Oct 2003, teaches a method for reducing the amount of a single printed fluorescent
ink by using single ink halftoning without reducing the intensity of the emitted fluorescent
signal in the same proportion.
[0012] US Pat 7,536,553 " Method and system for validating a security marking"to J.D. Auslander, R.A. Cordery
and C. Zeller, filed 24 April 2002, teaches a method for printing a security marking
with an ink absorbing light under daylight (dark patterns) and emitting light under
an excitation illumination. This security marking is viewed both under daylight and
by fluorescence under fluorescent excitation illumination.
[0013] US 2010/0157377 "UV fluorescence encoded background images using adaptive halftoning into disjoint
sets" describes substrate fluorescence watermarking techniques combined with metamer
color pair generation. In contrast to the above mentioned disclosures, the present
invention aims at creating variable intensity color halftone images visible under
normal daylight which incorporate color halftones produced by combining classical
non-luminescent and daylight luminescent inks. The colors of the individual daylight
luminescent inks need not be the same as the ones of the classical inks. The synthesized
color halftone images may represent continuous tone pictures from different origins
such as photographs, graphic designs, paintings or synthetic images.
SUMMARY
[0014] The present invention proposes techniques for creating authenticable multi-ink luminescent
continuous tone color halftone images with means of verifying their authenticity.
In addition, the invented luminescent color halftone image synthesizing techniques
enable increasing the attractiveness and aesthetics of color images. When printed
on valuable items or on their packages, the authenticable luminescent or partly luminescent
color images provide strong means of verifying their authenticity. Counterfeiters
do not have access to systems allowing to color separate continuous tone color images
into luminescent ink layers and to create faithful color reproductions with daylight
luminescent inks. Considered valuable items are banknotes, checks, trust papers, identification
cards, passports, travel documents, tickets, diploma, business documents, bank documents,
tracing documents, medical drug packages, commercial art, fashion articles, watches,
clocks, bottles of perfumes, body care liquids, alcoholic drinks, clothes, as well
as attached labels.
[0015] The present invention proposes a computer-based method for producing authenticable
printed luminescent color images visible under daylight. First, a luminescent set
of inks comprising at least one daylight luminescent ink is selected. By relying on
a color prediction model, the luminescent gamut of halftones created by the selected
luminescent set of inks is established. The gamut of an input image or the gamut of
the display device showing the input image is mapped onto the luminescent gamut of
the selected luminescent set of inks of by applying gamut expansion and/or gamut reduction
operations. Gamut expansion has the effect of increasing the chroma of image parts
as well as possibly their lightness. The gamut mapped input image is then separated
into the ink layers, i.e. for each gamut mapped input image color, the corresponding
surface coverages of the inks are computed, either by using the color prediction model
and by fitting the surface coverages of the inks, or by accessing a previously established
3D color separation table creating the relationship between colors and surface coverages
of the inks. The resulting color separated image is halftoned and printed. Under a
specific excitation illumination, the resulting luminescent halftone image can be
authenticated by comparing its excitation trace image, i.e. its image under a specific
excitation illuminant, with a corresponding previously registered excitation trace
image. If the actual and the previously registered excitation trace images are substantially
similar, the luminescent halftone image as well as the support (valuable item) on
which it is printed are considered as authentic.
[0016] When printed with a luminescent set of inks comprising classical non-luminescent
as well as daylight luminescent inks, the resulting daylight luminescent color images
have a larger gamut than the ones achievable with classical cyan, magenta, yellow
and black inks. This is especially important for high quality faithful color reproductions,
such as photographs of paintings.
[0017] An additional protection is provided by creating a partly luminescent partly non-luminescent
printed output image incorporating a message which remains hidden under a reference
illuminant and which is revealed under an illuminant different from the reference
illuminant. For that purpose, a set of non-luminescent and a set of luminescent inks
are selected. Message areas which contain image colors located at the intersection
between luminescent and non-luminescent gamuts can be reproduced with the luminescent
set of inks. Optionally, input image colors can be gamut mapped into the volume formed
by the intersection between luminescent and non-luminescent gamuts. Within the message
areas, the color separation is carried out with the luminescent set of inks and outside
the message areas, the color separation is carried out with the non-luminescent set
of inks or vice-versa. The resulting partly luminescent halftone image is authenticated
by verifying that the message is hidden under the reference illuminant and that it
appears under a substantially different illuminant.
[0018] A further variant consists in creating two hidden messages, one hidden with the luminescent
set of inks under a first reference illuminant and the second one hidden with the
luminescent set of inks under a second reference illuminant. The resulting partly
luminescent halftone image is authenticated by illuminating it successively with the
first and the second illuminant, thereby verifying that each time one of the two messages
is hidden and the other one is visible.
[0019] An additional variant consists in selecting two different luminescent sets of inks,
the first one for hiding a first message and the second one for hiding a second message
under selected reference illuminants. In addition to the absence, respectively presence,
of the messages under the corresponding respective reference and non-reference illuminants,
the resulting partly luminescent halftone image is authenticated by comparing the
excitation trace images of the first and second messages with previously registered
excitation trace images. Since the two luminescent sets of inks are different, the
two colors of the two excitation trace images will also be different. A further variant
of printing with two luminescent sets of inks consists in spatially interpolating
between the two sets of inks along one orientation, thereby creating an excitation
trace image having colors evolving between the excitation trace image of one luminescent
set of inks and the excitation trace image of the second luminescent set of inks
[0020] In case that the input image colors are gamut expanded into the gamut colors of a
luminescent set of inks, one may apply gamut expansion only to those regions of the
input image which should stand out and attract the attention of the observer. These
regions can then be rendered with the luminescent set of inks and authenticated by
examining their excitation trace image. In order to avoid discontinuities between
gamut expanded regions rendered with the luminescent set of inks and non-gamut expanded
or gamut reduced regions, possibly rendered with the non-luminescent set of inks,
a deltamap specifies gamut expansion limitation factors at the locations of the gamut
expanded regions. These gamut expansion limitation factors are the largest at the
boundary of the gamut expanded regions and are reduced as a function of the distance
to the boundary. They may be become zero from a certain distance of the boundaries
of the gamut expanded parts.
[0021] Considered embodiments of printing systems for printing daylight luminescent color
images are inkjet, electrophotography, dye diffusion, and thermal transfer printers
as well as offset, flexographic, gravure, intaglio and serigraphy printing systems.
Further embodiments comprise ink deposition systems as well as patterning systems,
such as photolithography, etching, coating, laser marking, laser engraving, and laser
ablation.
[0022] Authentication of a daylight luminescent color image may be carried out by a human
observer as well as by an apparatus incorporating light sources illuminating the images
with a reference illuminant and with an excitation illuminant different from the reference
illuminant. The apparatus also incorporates a multi-sensor acquisition device (e.g.
a camera) acquiring the luminescent color images under the different illuminants.
It further incorporates a computing system for memorizing the images under the reference
and under the excitation illuminants and for comparing them with corresponding previously
registered images and accordingly deciding if the printed luminescent color image
is authentic or not. Such an apparatus may work either in reflection mode or in transmissive
mode.
[0023] A daylight luminescent color halftone image printed on a valuable item can be authenticated
by illuminating it with an excitation illuminant such as a UV light and verifying
that its excitation trace halftone image exists and that it is substantially similar
to a previously registered excitation trace halftone image. In case a message is hidden
within the luminescent color halftone image, it will be revealed under the excitation
illuminant or under an illuminant substantially different from the reference illuminant.
Further sophistication by hiding messages under multiple illuminants or with different
luminescent sets of inks is possible.
[0024] For a second level authentication, a daylight luminescent color halftone image printed
on a valuable item is examined under a magnifying glass or a microscope. An enlarged
view of a specific region of the luminescent color halftone image (or a sampled image
of that region acquired with a multi-channel sensor) is compared with a corresponding
registered image of the same region both under normal daylight (first test) and under
UV light (second test). If in both cases the acquired enlarged images and the registered
images are substantially similar, the luminescent color halftone image and therefore
the valuable item are authentic. This check can be performed either by a person or
by an authentication apparatus sampling the luminescent color halftone image at a
sufficiently high resolution.
BRIEF DESCRIPTION OF THE DRAWINGS
[0025]
FIG. 1A shows the total reflectance as well as the pure reflectance of a daylight
luminescent ink and FIG. 1B shows its emission spectrum;
FIGS 2A and 2B show at different lightness levels a display gamut GsRGB, a classical cyan magenta and yellow gamut Gc,m,y as well as a luminescent gamut Gc,mF,yF formed by cyan, daylight luminescent magenta and daylight luminescent yellow inks;
FIGS. 3A and 3B show an input gamut 302 and a luminescent output gamut 303, as well
as corresponding gamut expansion-reduction schemes;
FIG. 4A shows an input gamut 402 and a luminescent output gamut 403 whose maximal
lightness is higher than the achromatic white;
FIG. 4B shows similar gamuts as FIG. 4A, where the maximal chroma values CoutMax of the luminescent gamut are reduced to effective maximal chroma values CoutMaxEff;
FIG. 5 shows schematically the processes contributing to the creation of halftoned
daylight luminescent color images;
FIG. 6 shows an example of a color image printed with cyan, magenta, and yellow inks
incorporating a hidden message printed with cyan, daylight luminescent magenta and
daylight luminescent yellow inks;
FIG. 7A shows that the message of FIG. 6 is hidden when viewed under the reference
illuminant IRef and FIG. 7B shows that it appears under an illuminant IUV or IB different from the reference illuminant;
FIGS. 8A, 8B, 8C, and 8D show a first message Ma hidden under illuminant Ia and a second message Mb hidden under illuminant Ib, which are individually revealed respectively under illuminant Ib and Ia or are both revealed under illuminant Ic ;
FIGS. 9A and 9B show a first message hidden with a first set of luminescent inks and
a second message hidden with a second set of luminescent inks, which are both revealed
under an illuminant different from the reference illuminant, e.g. a UV light source;
FIG. 10 shows a message hidden by interpolating between two sets of luminescent inks,
where the interpolation is performed spatially;
FIG. 11A shows the picture of a watch, whose golden frame is rendered with a set of
daylight luminescent inks, which is revealed in FIG. 11B under an illuminant different
from the reference illuminant;
FIG. 12 shows a setting sun over the ocean, where the red sky surrounding the sun
is rendered with a low gamut expansion limitation factor and where the gamut expansion
limitation factor increases as a function of the distance from sky locations to the
sun boundary;
FIG. 13 shows a setting sun over the ocean, where the sun boundary is rendered with
a high gamut expansion limitation factor and where the gamut expansion limitation
factor decreases as a function of the distance from sun locations to the sun boundary;
FIG. 14 shows a computing system for creating luminescent color halftone images comprising
a CPU, memory, I/O interfaces, disks, a display, a keyboard and a network connection;
FIG. 15 describes the initialization steps performed when launching the computing
system creating daylight luminescent color halftone images;
FIG. 16 shows steps performed in order to create daylight luminescent color images
possibly incorporating hidden messages;
FIG. 17 shows the interacting software modules of a computing system operable for
synthesizing daylight luminescent color halftone images;
FIG. 18A shows an example of a computer-based authenticating apparatus working in
transmission mode and FIG. 18B shows another example of a computer-based authenticating
apparatus working in reflection mode;
FIGS. 19A, 19C and 19E show an enlargement of respectively the cyan, magenta and yellow
separation layers of a non-luminescent {c,m,y} halftone and FIGS 19B, 19D and 19F show an enlargement of respectively the cyan,
luminescent magenta and luminescent yellow separation layers of the luminescent {c,mF,yF} halftone of the same color as the non-luminescent {c,m,y} halftone, as created in memory before printing;
FIG. 20A is a grayscale photograph of a color image illuminated by normal daylight,
incorporating the messages "LSP" hidden under the D65 illuminant;
FIG. 20B is a grayscale photograph of the same color image, illuminated by UV light,
incorporating the messages "LSP" hidden under the D65 illuminant;
FIG. 21A shows the red (R), green (G) and blue (B) channels of a photograph of a "fruits"
image printed with a set of inks comprising the classical cyan, magenta, yellow inks
as well as the daylight luminescent magenta and daylight luminescent yellow inks,
taken under normal daylight; and
FIG. 21B shows the red (R), green (G) and blue (B) channels of a photograph of the
same reproduced "fruits" image taken under UV light.
DESCRIPTION OF THE INVENTION
[0026] The present invention aims at producing variable intensity color images visible under
normal daylight comprising parts which are produced with classical inks and parts
which are produced with daylight luminescent inks, possibly combined with classical
inks. The parts produced with classical inks only, called "non-luminescent halftones",
form the colors of a normal print gamut. The parts printed with daylight luminescent
inks and possibly classical inks, called "luminescent halftones", form the colors
of an extended luminescent print gamut and therefore provide visually enhanced printed
color images. Such visually enhanced color images tend to capture the observer's attention.
A document or a valuable article incorporating on one of its parts a daylight luminescent
color image printed with luminescent halftones can be authenticated by observing the
luminescent halftones under an illuminant revealing mainly the luminescent emission,
e.g. a UV illuminant or a colored illuminant. The comparison between the revealed
luminescent image and a known luminescent image enables authentication of the daylight
luminescent color image.
[0027] Thanks to gamut mapping and color separation with luminescent ink layers, a message
can be hidden within the luminescent halftones for a given selected illuminant, for
example the D65 illuminant emulating daylight. Under a different illuminant, for example
tungsten light (illuminant A) or under a UV illumination, the hidden message is revealed.
The revealed message is compared with a known message and depending on the comparison,
the daylight luminescent color image can be authenticated.
[0028] Regarding the vocabulary, the term "illuminant light source" or simply "illuminant"
refers to a light source having a specific spectral power distribution. Given surface
coverages of the inks create under a given illuminant a specific color. Under a different
illuminant, the same ink surface coverages generally create a different color, especially
if the considered inks comprise one or several daylight fluorescent inks. The term
"input gamut" refers to the color volume in colorimetric space (e.g. CIELAB) formed
by the colors present within an input image, present within several input images or
formed by the colors that are displayable on a given display, e.g. an sRGB display.
Gamuts are referred to by symbol G and the ink indices, for example the symbol
Gu,
v,w for classical inks
u,
v, and w or by the symbol
Gu,vF,wF for classical non-luminescent ink u, daylight luminescent ink
vF and daylight luminescent ink
wF. The term "classical inks" refers to inks normally used in printers, such as cyan,
magenta, yellow, light magenta, red, green, or blue, which do not exhibit much luminescence,
i.e. substantially non-luminescent inks. We therefore also call such inks "non-luminescent
inks". The term "luminescent gamut" or "luminescent output gamut" refers to the color
volume formed by colors of the output image, printed with halftones made of luminescent
and possibly classical inks. The term "non-luminescent gamut" or "classical gamut"
refers to the color volume formed by colors of the output image, printed with halftones
made of classical inks. The term "luminescent color image" specifies a color image
where at least one region of it is rendered and printed with a luminescent set of
inks, i.e. a set of inks comprising at least one daylight luminescent ink. A "message"
is a piece of information such as a few typographic characters, a word, a sentence,
a symbol, a graphic design or a logo. A message can be hidden within a color image.
When the message is revealed, it appears as a color or as a multitude of colors that
differ from the surrounding image colors. A message is either defined by areas with
well delimited contours, e.g. the contours of typographic characters or symbols or
it may have unsharp boundaries, i.e. the colors of the message distinguish themselves
from the surrounding image colors more at the center of the message elements than
at their boundaries. In most examples, we consider a non-luminescent color gamut given
by the classical cyan, magenta and yellow inks and luminescent color gamuts given
by combinations of classical cyan, magenta luminescent and yellow luminescent inks.
However, other non-luminescent inks can also be used, e.g. red, orange, green and
blue inks as well as other daylight luminescent inks can be used, for example daylight
luminescent cyan, daylight luminescent orange, and daylight luminescent green. Within
the present disclosure, input and output images are assumed to be color images. Nevertheless,
gray intensities are also part of the color space and as is well known in the art,
can be rendered with colored inks. Therefore, the present invention is also applicable
to gray level images.
[0029] The invention relies on (a) daylight luminescent inks, (b) luminescent color halftones,
(c) spectral and/or color prediction models for luminescent halftones, (d) color gamuts
produced with combinations of luminescent and non-luminescent inks, (e) color separation
into luminescent and/or non-luminescent ink halftone surface coverages, (f) mapping
of an input gamut into a luminescent target gamut, (g) mapping of an input gamut into
a gamut located at the intersection between a non-luminescent gamut and a luminescent
gamut, (h) luminescent color halftone image generation and printing. These elements
are detailed in the text that follows.
(a) Daylight luminescent inks.
[0030] Daylight luminescent inks are inks which have a certain color under daylight, i.e.
they absorb light within the excitation wavelength range (FIG. 1, 101), reemit part
of the absorbed energy in the emission wavelength range 102 and also reflect the incident
light. The total reflectance
Rtot(λ) 105 of a luminescent ink is the sum of the pure reflectance
Rpure(λ) 104 and of the light emission factor
F(λ)/
I0(λ)
, where
F(λ) is the irradiance of the luminescent emitted light (FIG. 1B, 107) and
I0(λ) is the incident light irradiance. The amplitude of the irradiance
F(λ) depends on the amplitude and the spectral power distribution of the incident irradiance
I0(λ) in the excitation wavelength range. For most luminescent single component inks,
varying the spectral distribution
I(λ) of the incident light only modifies the amplitude of the emission irradiance
F(λ) and not its spectral distribution.
(b) Luminescent color halftones obtained by superposed halftone ink layers.
[0031] As is known in the art, color halftones may be formed by mutually rotated layers
of clustered ink dots (see
C. Hains, S.G. Wang, K. Knox, Digital color halftones, in Digital Color Imaging Handbook,
G. Sharma Ed, CRC Press, 2003, Chapter 6, Sections 6.1 to 6.4.11, pp. 385-430). They may also be formed by stochastic dots, generated with a blue noise dither
matrix, or by error-diffusion (see
C. Hains, S.G. Wang, K. Knox, Digital color halftones, in Digital Color Imaging Handbook,
G. Sharma Ed, CRC Press, 2003, Chapter 6, Sections 6.8.1 to 6.8.9, pp. 457-470). In these main stream halftoning techniques, halftone ink dot do partially overlap.
This means that several inks may be partially superposed and printed at the same pixel
locations.
[0032] In the case of three classical non-luminescent inks, such as cyan (
c), magenta (
m) and yellow (
y), the superposition of the 3 ink halftone layers yields halftones with colorants
comprising the paper white (
w), each ink color and each ink superposition color, in the present case: white (
w), cyan (
c), magenta (
m), yellow (
y), red (
r =
m & y), green (
g =
c &
y), blue (
b =
m & c), and chromatic black (
k =
c & m &
y), where the "&" sign indicates the superposition operation. Therefore, all superposition
variants of 3 inks yield 8 colorants and of 4 inks yield 16 colorants.
[0033] In the case of combined classical non-luminescent and luminescent inks, the same
logic applies. For example, in the case of classical non-luminescent cyan (
c), daylight luminescent magenta (
mF) and daylight luminescent yellow (
yF), the superposition of the 3 ink halftone layers yields halftones with colorants
comprising the paper white (
w), each ink color and each ink superposition color, in the present case: white (
w), cyan (
c), luminescent magenta (
mF), luminescent yellow (
yF), luminescent red (
rF =
mF &
yF), i.e. the superposition of luminescent magenta and luminescent yellow inks, luminescent
green (g
F =
c & yF), i.e. the superposition of cyan and luminescent yellow inks, luminescent blue (
bF =
c &
mF), i.e. the superposition of cyan and luminescent inks, and luminescent brown (
kF =
c &
mF &
yF), i.e. the superposition of the cyan, luminescent magenta and luminescent yellow
inks
[0034] When printing the ink layers independently of one another, for example with mutually
rotated layers, with blue noise dithering, or with error diffusion, the surface coverages
of the colorants
a1 to
a8 representing the paper, the single inks or the superpositions of two or three inks
can be expressed as functions of the surface coverages of the inks
u1,
u2,
u3, as follows:

[0035] Equations (1) are known as the Demichel equations and are also valid in case that
one or several inks are luminescent inks. They can be extended to 4 or more inks,
see
Th. Bugnon, M. Brichon, R.D. Hersch, Simplified Ink Spreading Equations for CMYK
Halftone Prints, Proc. SPIE Color Imaging XIII: Processing, Hardcopy, and Applications,
Vol. 6807, paper 680717, pp 1-12.
[0036] In the case of luminescent halftones created with several different luminescent inks,
the halftone emission irradiance spectrum
Fh(λ) depends on the spectral distribution of the illuminant
I(λ). As an illustration, consider two luminescent inks A and B with respective emission
spectra
FA1(λ) and
FB1(λ) under illuminant
I1(λ) and emission spectra
FA2(λ)=
a FA1(λ) and
FB2(λ)=
b FB1(λ) under illuminant
I2(λ) placed side by side, forming a halftone with each ink having a 50% surface coverage.
Then, the resulting halftone emission spectrum under illuminant
I1(λ) is
Fh1(λ)= ½
FA1(λ) + ½
FB1(λ) and under illuminant
I2(λ) is
Fh2(λ)=½
FA2(λ)+½
FB2(λ)= ½
a FA1(λ)+½
b FB1(λ). Since in the general case the two scalar values
a and
b are different one from another, halftone emission spectrum
Fh2(λ) under illuminant
I2(λ) is not a scaled instance of halftone emission spectrum
Fh1(λ) under illuminant
I1(λ). Such a halftone has therefore different emission colors under different illuminants.
Note that under UV light (black light), the emission colors are directly visible.
(c) Spectral and color prediction models for classical and luminescent halftones.
[0037] The goal of a color prediction model is to establish a mapping between ink surface
coverages of a selected set of inks and resulting colors. When such a mapping is known,
one find the inverse mapping, i.e. the mapping between desired color and ink surface
coverages of the considered set of inks. Under a given illuminant, the light reflected
by a known reflectance spectrum can always be converted to a color (see Eq. (4) in
the next section). Therefore, every spectral prediction model is also a color prediction
model.
[0038] As alternative to a color prediction model, one may directly establish a mapping
between desired color and surface coverages of the inks by printing samples with combinations
of all selected inks at variations of surface coverages e.g. surface coverages of
[0, 0.05, 0.10, ... 0.95, 1]. This yields 21 samples per ink, i.e., for a luminescent
set of 3 inks, 9261 samples. Each sample is measured by a spectrophotometer under
the reference illumination and converted to a color value. One may then interpolate
between these color values to create the mapping between desired color and surface
coverages of the inks, see
R. Bala, Chapter 5, Device Characterization, Section 5.4.5. Lattice-based interpolation,
in Digital Color Imaging Handbook, (Ed. G. Sharma), pp. 301-304.
[0040] Instead of the YNSN model described by Eq. (2), it is also possible to use a color
prediction model, where reflectances are replaced by colorimetric values, such as
CIE-XYZ tri-stimulus values or multiple broadband sensor responses, such as red, green,
blue and possibly infra-red sensor responses. It is also possible to use a different
spectral prediction model, such as the Clapper-Yule model, see
R.D. Hersch, P. Emmel, F. Collaud, F. Crete, Spectral reflection and dot surface
prediction models for color halftone prints, Journal of Electronic Imaging, Vol. 14,
No. 3, 2005, article 33001, pp. 1-12.
[0041] In order to make accurate spectral or color predictions, the YNSN model needs to
be extended, for example by combining it with an ink spreading model, see the following
publication about the ink-spreading enhanced YNSN model:
R.D. Hersch, F. Crete, Improving the Yule-Nielsen modified spectral Neugebauer model
by dot surface coverages depending on the ink superposition conditions, Color Imaging
X: Processing, Hardcopy and Applications, Proc SPIE 5667, 2005, pp. 434-445, hereinafter referenced as [Hersch 2005].
[0042] The prediction accuracy is further improved for halftones combining classical and
luminescent inks by allowing within the ink-spreading enhanced YNSN model each ink
halftone to have its optimal n-exponent and by computing the overall n-exponent for
each considered halftone as a weighted average of the inks n-exponents, with the weights
being given by a parabolic function of the surface coverages of the inks. For a system
of 3 inks with nominal surface coverages
u1,
u2,
u3 and corresponding best n-exponents
n1,
n2 and
n3 fitted at 50% nominal surface coverages, we calculate the optimal n-exponent

where
p(u) is the parabola equation
p(
u) = -4·(
u -1/2)
2 +1. This optimal n-exponent is then used as n-exponent in Eq. (2), for surface coverages
ai derived from Eq. (1). The corresponding theory has been published on the
14th of June 2010 in the article by Romain Rossier and Roger D. Hersch, "Ink-dependent
n-factors for the Yule-Nielsen modified spectral Neugebauer model," Proc. 5th European
Conference on Colour in Graphics, Imaging, and Vision (CGIV 2010), Joensuu, Finland,
pp. 202-206, referred to as [Rossier and Hersch, 2010].
[0043] Another possibility of extending the YNSN model in order to provide higher prediction
accuracy is to consider not only reflectances
Ri of printed patches at all combination of 0 and 1 surface coverages (8 combinations
for 3 inks), but reflectances of printed patches
Ri (called sub-domain reflectances) at all combinations of 0, 0.5 and 1 surface coverages
(27 combinations for 3 inks). According to this extension, derived from the known
cellular Neugebauer model (see
R. Balasubramanian, Optimization of the spectral Neugebauer model for printer characterization,
J. Electronic Imaging, Vol. 8, No. 2, 156-166, 1999), reflectance predictions are carried out within the sub-domains formed by ink surface
coverages either between 0 and 0.5 or between 0.5 and 1. Ink spreading is accounted
for within each sub-domain. The details are given in the article by
R. Rossier and R.D. Hersch, "Introducing ink spreading within the cellular Yule-Nielsen
modified Neugebauer model", to be published on the 7th of November 2010 at the 18th
Color Imaging Conference.
(d) Luminescent color gamuts produced with combinations of luminescent and non-luminescent
inks.
[0044] We describe new methods for the computer-based rendering and printing of images with
daylight luminescent inks. Since a set of available daylight luminescent inks may
not allow to produce the colors printable with classical cyan, magenta, yellow and
black inks (hereinafter:
"cmyk inks"), it is necessary to consider printing images with a combination of daylight
luminescent ink and classical (non-luminescent) inks. As example, we consider a system
for printing with daylight luminescent yellow (hereinafter:
yF), daylight luminescent magenta (hereinafter:
mF), classical cyan (hereinafter: c), classical magenta (hereinafter:
m), classical yellow (hereinafter:
y) and classical black (hereinafter:
k) inks. In order to create a printed color image with a color gamut as large as possible
and with the strongly saturated colors offered by daylight luminescent inks, we consider
the gamut (volume in a 3D colorimetric space such as CIELAB) of all possible colors
which may be generated with the above set of luminescent and classical non-luminescent
inks. A first sub-gamut is formed by the colors printable with the set of inks
mF (daylight luminescent magenta),
yF (daylight luminescent yellow) and
c (cyan) under a selected reference illuminant. By considering suitable variations
of surface coverages of the set of {
c,
mF,
yF} inks, for examples in steps of 0.02, we obtain according to the ink spreading extended
YNSN model described by Eqs. (1), (2) and (3) the corresponding set of total reflectances
R
1, R
2,
···. For the selected reference illuminant, this set of total reflectances can be converted
to tri-chromatic CIE-XYZ values and then to CIELAB values [Sharma 2003]. The conversion
of a spectrum
Ri to tri-stimulus CIE-XYZ is carried out with the selected reference illuminant
Iref, according to the well-known formula

where the "diag" operator creates a matrix whose diagonal elements comprise the spectral
reflectance components
of Ri and whose other elements are zero and where the vectors
x , y and
z contain the color matching coefficients of the color matching functions known as
x(
λ),
y(
λ), and
z(
λ). Vectors
Iref and
Ri have one sample per wavelength, for example 36 samples at wavelengths [380nm, 390nm,
.. 730nm]. As known in the art,
K is a normalization scalar calculated to yield a
Y value of 100 for the unity reflectance [1 1 ...1]
T. The reference illuminant
Iref is also used to calculate the CIE
Xn,
Yn,
Zn, value of the white stimulus used for computing the CIELAB values.
[0045] These CIELAB values span the sub-gamut (sub-volume in CIELAB) denominated
Gc,mF,yF. In a similar manner, the set of inks {
c,
mF,
y} allows producing colors with the luminescent sub-gamut
Gc,mF,y. The set of inks {c,
m, yF} allows producing colors with the luminescent sub-gamut
Gm,yF,c. Similarly, the classical set of inks {
c,
m, y} allow producing colors with the luminescent sub-gamut
Gc,m,y. The set of inks {
c,
m, y, k} allows producing colors within the classical ink gamut
Gc,m,y,k. Corresponding colors are predicted with an ink-spreading enhanced YNSN model extended
to the 4
cmyk inks. As illustration, FIGS. 2A and 2B show schematically a typical input gamut
GsRGB (sRGB display gamut 201) as well as the
Gc,mF,yF (203), and
Gc,m,y (202) sub-gamuts, displayed at two CIELAB L lightness ranges of L=75 and L=88. The
total target gamut
Gc,m,y,k,,mF,yF, of the set of inks {
c, m, y, k, mF,
yF} may be formed by the union of the
Gc,mF,yF, Gc,mF,y, G
c,m,yF, Gc,m,y and
Gc,m,y,,k sub-gamuts. Its external hull is formed by the hull of the union of these gamuts.
Alternately, one may use a spectral prediction model extended to 6 inks (e.g. {
c,
m, y, k, mF, yF}) in order to directly obtain the largest possible
Gc,m,y,k,mF,yF gamut achievable with these inks.
[0046] In case that a message needs to be hidden within the luminescent halftones, a possible
target output gamut is the gamut formed by the intersection of the classical ink gamut
Gc,m,y or
Gc,m,y,k and of the luminescent ink gamut
Gc,mF,yF,. Alternately one may use the
Gc,m,y or
Gc,m,y,k classical gamut as target output gamut and create the areas of the message whenever
possible with the luminescent set of inks, and when impossible, with the classical
non-luminescent set of inks. This will create a luminescent message only within message
areas of the output color halftone image, whose colors are located within the luminescent
gamut
Gc,mF,yF.
(e) Color separation into luminescent and/or non-luminescent ink halftone surface
coverages.
[0047] For the color separation of digital color images into daylight luminescent ink print
layers, we create a color separation table incorporating the correspondence between
colorimetric values (e.g. CIELAB) and surface coverages of the inks. Since, in the
present example, we consider printing halftones with the subsets of inks {
c,m
F,
yF}, {
c,m, yF}, {
c,m
F,
y}, {
c,
m, y}, for each CIELAB entry in the 3D color separation table, we enter the corresponding
nominal surface coverages for each of the 4 considered ink subsets. When one subset
of inks is not able to produce a given color, the corresponding entry contains a corresponding
flag (e.g. the number -1). The nominal surface coverages are fitted by minimizing
the sum of the differences between desired CIELAB L*a*b* color components and predicted
L*a*b* color components under a reference illuminant according to a selected prediction
model, e.g. the ink spreading enhanced YNSN model, augmented with ink-dependent n-factors
[Rossier and Hersch 2010]. This is performed by a computer executable optimization
procedure such as the "fminsearch" or "fmincon" function offered by the Matlab package.
After having created the color separation table, at image creation time, the input
image colors can be color separated into surface coverages of the inks by interpolating
between the stored table values.
(f) Mapping of an input gamut into a luminescent target gamut
[0048] The goal is to map an input gamut given for example as sRGB values or as input cyan
cin, magenta
min,, and yellow
yin values into an output gamut printable with a daylight luminescent set of inks. There
are several ways of generating daylight luminescent color prints from original color
images by mapping the input color gamut onto the luminescent target gamut, for example
Gc,m,y mF,yF.
[0049] FIG. 3 shows a typical example where the input gamut 302 is partially inside and
partially outside the luminescent output (target) gamut 303. Therefore, in order to
have a mapping between the input gamut and the luminescent output gamut which expands
the input gamut towards the luminescent gamut and at the same time preserves the hues
as much as possible, there is a need to perform both gamut reduction and gamut expansion.
A method for gamut reduction has been described in
US Pat Appl. 11/785931 to Hersch, Donzé, and Chosson [Hersch, Donzé, Chosson 2007]. A method for gamut expansion is described in the publication by
T. Morioka, Y. Azumi and M. Inui, "A psychophysical evaluation of a gamut expansion
algorithm based on chroma mapping", published in Proc. International Conference on
Digital Printing Technologies, Baltimore, USA, 2005, pp. 433-436. Another method of gamut expansion is proposed in
US Pat. 5,317,426, "Color estimation method for expanding a color image for reproduction in a different
color gamut", to T. Hoshino, priority Nov. 26, 1990. The hue preserving gamut reduction
and/or expansion method proposed in the present disclosure relies on the mapping A
of the input lightness range into the luminescent output gamut lightness range, e.g.
a linear mapping, on the preservation of the hue and on the mapping of the input chroma
range into the output chroma range of the luminescent gamut (FIGS. 3A and 3B).
[0050] Before performing the mapping of an input gamut into an output luminescent gamut,
one must be able to compute the external hulls of both the input and the output gamuts
with a method known in the art, for example by computing in 3D a mesh of the gamut's
hull, see
T. Cholewo, S. Love, Gamut boundary determination using alpha-shapes, Proc. IS&T 7th
Imaging Conf., pp. 200-204, 1999, hereinafter referenced as [Cholewo and Love 1999] or by computing in 2D, separately
for each hue or for each lightness slice (e.g. a hue slice may correspond to a hue
angle interval Δ
h of 15 degrees and a lightness slice to a lightness interval Δ
L of 5) the boundaries of input and output gamuts.
[0051] Gamut expansion and gamut reduction are performed as follows. First, a given input
CIELAB lightness
Lin is mapped into the corresponding output lightness
Lout by the lightness mapping operation Λ. Then, for the current hue angle
hin=arctan(
bin/
ain), the input chroma
Cin is mapped into an output chroma
Cout. Mapping the input CIELAB chroma
Cin=((
ain)
2+(
bin)
2)
1/2 to the output chroma
Cout requires intersecting the constant
Lout chroma line passing through
Cin with the input and output gamut boundaries and obtaining the respective intersection
points
CinMax and
CoutMax. The chroma remains constant (
Cout=
Cin) in the
C interval between 0 and α
CinMax in case
CinMax <
CoutMax (gamut expansion, FIG. 3B upper part) and between 0 and α
CoutMax in case
CinMax >
CoutMax (gamut reduction, FIG. 3A lower part). The factor α, between 0 and 1, for example
1/2, defines the internal part of the gamut where the chroma does not change. In case
of gamut expansion (FIG. 3B, upper part), the part of the input chroma α
CinMax <
Cin <
CinMax is mapped according to the following formula

where the
γ exponent expresses a possible non-linearity of the chroma mapping. With γ=1, the
mapping is linear.
[0052] In case that the maximal gamut expansion is not desired, one may use a gamut expansion
limitation factor δ. This gamut expansion limitation factor limits the effective maximal
gamut expansion
CoutMaxEff to values between
CoutMax and
CinMax, see FIG. 4B. The effective maximal gamut expansion becomes

[0053] This effective maximal gamut expansion chroma
CoutMaxEff then replaces
CoutMax in Eq.(5).
[0054] In case of gamut reduction (FIG. 3A, lower part), the part of the input chroma α
CoutMax <
Cin <
CinMax is mapped according to the following formula

[0055] FIGS. 3A and 3B show the geometries of both gamut expansion and gamut reduction.
In FIG. 3A, the gamut reduction consists in keeping the chroma
C between 0 and α
CoutMax without change and in mapping the input chroma interval
p from α
CoutMax to
CinMax into the interval
q from α
CoutMax to
CoutMax. In FIG 3B, the gamut expansion consists in keeping the chroma between 0 and α
CinMax without change and mapping the input chroma interval
p from α
CinMax to
CinMax into the interval
q from α
CinMax to
CoutMax. Therefore, in both the expansion and reduction cases, in the low saturation region
formed by colors with chroma
Cin<=α
CoutMax, respectively
Cin<=α
CinMax, the output chroma values are kept equal to the input chroma values. Note that in
these two cases, there is no further modification of the lightness, beyond the one
performed during the lightness mapping operation Λ, i.e.
Lout = Λ(
Lin). Note that for the wide gamut reproduction of color images, it may be sufficient
to apply gamut reduction (see section: "Application V: Creation of luminescent wide
gamut color images").
[0056] There are cases where due to a strong luminescence of one or several inks, part of
the luminescent output gamut has a CIELAB lightness larger than the lightness
Lwhite of the white reference. FIG. 4A shows the input display gamut and the output luminescent
print gamut along a constant hue slice. A non-zero chroma region 401 comprises colors
of a lightness higher than
Lwhite, i.e. colors with a lightness higher than the lightness of the white substrate on
which the inks are printed or higher than the lightness of the unity reflectance.
In order to map the input to the output gamut by performing a gamut expansion making
use of the increased lightness regions, we define a lightness
Linc from which input color chroma in intervals
p' are centrally projected into corresponding output color chroma in intervals
q' of the output gamut, keeping their hues constant and increasing their respective
chroma and lightnesses. This may be carried out by calculating the intersection of
the line defined by the achromatic color (
L,C)=(
Linc,0) and by the color (
Lin' =Λ(
Lin),
Cin') with the input gamut boundaries (402) and the output gamut (luminescent gamut 403)
boundaries, yielding the respective intersections (
LinMax',
CinMax') at chroma
CinMax' and (
LoutMax',
CoutMax') at chroma
CoutMax'. In case
Cin'>α
CinMax', the mapping from lightness mapped input color (
Lin',
Cin',
h') to output color (
Cout',
Cout',
h') may be calculated according to Equation (8):

[0057] If
Cin' <= α
CinMax', the identity mapping is applied, i.e. (
Lout'=
Lin') and (
Cout' =
Cin'). For lightnesses
Lin'<=
Linc, normal gamut expansion given by Equation (5) or respectively gamut reduction given
by Equation (7) apply.
[0058] Expression (8) indicates that colors with lightness
Lin' larger than
Linc and chroma
Cin' larger than α
CinMax', i.e. colors which are neither dark nor desaturated are mapped towards the more
saturated and higher lightness colors offered by the luminescent gamut 401.
[0059] Here also, one may limit the gamut expansion with a gamut expansion limitation factor
δ, and obtain effective maximal lighness and chroma as follows:

[0060] These
CoutMaxEff' and
LoutMaxEff' values replace
CoutMax and
LoutMax' in Eq. (8).
[0061] The gamut expansion with increased lightness is appropriate for color images where
colors such as yellow, orange, red or green are to be highlighted, for example in
the case of graphic designs or publicity. However, such an increased lightness gamut
expansion is not always desirable, for example when human skin needs to be reproduced.
In that case, one may artificially clip the boundary of the output gamut to lightness
values equal or lower than
Lwhite, see FIG. 4B, 404. This is done by simply performing the constant lightness gamut
expansion-reduction according to Equations (5) and (7).
[0062] The mapping of an input gamut into the luminescent target gamut can be embodied by
a gamut mapping table in the selected colorimetric space, e.g. CIELAB. In such an
embodiment, each CIELAB entry representing an input color such as a display color
incorporates a mapped luminescent target CIELAB value. In another embodiment, gamut
mapping can be incorporated into the color separation table by having directly for
each CIELAB entry (input color) the surface coverages yielding when printed with the
corresponding subset of luminescent and/or classical inks, the mapped CIELAB values.
(g) Mapping of an input gamut into a gamut located at the intersection between a non-luminescent
gamut and a luminescent gamut
[0063] In applications, where a message is hidden into a color image, one may use as output
gamut the gamut that can be rendered with both the luminescent and the non-luminescent
inks. It is located at the intersection between the non-luminescent ink gamut and
the luminescent ink gamut. The input gamut is mapped into the output gamut by combining
gamut expansion and reduction or by gamut reduction alone. The goal is to bring input
gamut colors into colors located within the boundaries of the intersection between
the non-luminescent and the luminescent color gamuts. The gamut mapping methods described
in the previous section (f) are applicable. However, instead of considering as output
gamut the intersection between the non-luminescent ink gamut and the luminescent ink
gamut, one may also use the larger
Gc,m,y or
Gc,m,y,k classical gamut as target output gamut and halftone the areas of the message whenever
possible with the luminescent set of inks, and when impossible, with the classical
non-luminescent set of inks.
(h) Color image halftone generation and printing with daylight luminescent inks
[0064] Color image halftone generation is carried out by creating in a computer memory the
separation layers corresponding to the input image. The separation layers indicate
if an ink or no ink is to printed or how much of each ink is to printed at each output
pixel location. Output image separation layers are created by scanning in computer
memory the output image representation, scanline by scanline (FIG. 5, 501) and pixel
by pixel, at each output pixel (
x,
y) finding according to the mapping (502) between input image and output image space,
the corresponding location (
x',
y') within the input image, reading the color
Cin(
x',y') at that location, performing the gamut mapping by accessing (503) the gamut mapping
table and reading the mapped color C
lum(
x',
y'), performing the color separation by accessing (504) the color separation table
and reading (505) the surface coverages of the selected subset of inks, e.g. {
uc,
umF,
uyF} or {
uc,
um,
uy}, and with the obtained surface coverages, performing the halftoning (506) according
to the selected halftoning method, for example, classical screening by dithering the
ink layers with mutually rotated clustered dot dither matrices or FM screening with
a blue-noise dispersed dither matrix. In case that both a luminescent and a non-luminescent
set of inks is used, each set including 3 or 4 inks, the classical mutually rotated
clustered dot techniques can be applied. Since an output image pixel is either printed
with an ink from the non-luminescent or from the luminescent set of inks, ink layers
of the two sets can share the same rotated halftone layers. For example, with the
two sets of inks {
c,
m, y}, and {
c,
mF,
yF}, cyan (c) is screened at an orientation of 15°, magenta (
m) shares with luminescent magenta (
mF) the 75° orientation and yellow (
y) shares with luminescent yellow (
yF) the 45° orientation. For sets of inks with more than 4 inks, up to 6 orientated
line screens can be used (orientations 15°, 45°, 75°, 105°, 135°, 165°). One can also
use color FM screening or color error diffusion (see
C. Hains, S.G. Wang, K. Knox, Digital color halftones, in Digital Color Imaging Handbook,
G. Sharma Ed, CRC Press, 2003, Chapter 6, pp. 385-470).
[0065] The halftoning operation 506 indicates, for each ink layer, if the current pixel
is to be set or not, or in case of variable pixel dot sizes, the dot sizes at which
the inks are to be printed. Once created, the separation layers are sent to the printer
for printing (printing technologies: ink-jet, electrophotography, thermal transfer,
etc...) or are used to create the plates for offset printing, the cylinders for gravure
printing or the screen for screen printing. The resulting printed image will incorporate
the target output color image, printed with the selected subsets of inks.
Application I: Embedding a message hidden by luminescent halftones within a printed
image.
[0066] Since the subsets of inks, in the present example the subsets {
c,m
F,
yF}, {
c,
mF,
y}, {
c,m, yF}, and {
c,
m, y} have partially overlapping gamuts, colors located at the intersection of the luminescent
{
c,m
F,
yF} and the classical non-luminescent {
c,
m, y} gamuts can be generated under a selected reference illuminant either with luminescence
or without luminescence. After mapping of image input colors to colors located at
the intersection between luminescent and non-luminescent gamuts or to colors located
within the non-luminescent gamut, it is possible to incorporate onto the variable
intensity color or grayscale image (FIG. 6, 601) to be reproduced a hidden message
602, e.g. the letters "VALID". The halftone colors inside the areas 603 formed by
the letters are whenever possible reproduced with a luminescent subset of inks, e.g.
{
c,m
F,
yF} and the halftone colors outside the letter areas are reproduced with a non-luminescent
subset of inks, e.g. {
c,
m, y}
. Since the spectral prediction model, respectively the color prediction model, enables
creating within the color separation table for each entry accurate values of the amounts
of inks (surface coverages), under a selected reference illuminant (e.g. D65 simulating
a daylight illuminant), it is not possible to distinguish under that reference illuminant
the color printed with the luminescent ink subset and the one printed with the non-luminescent
ink subset. Therefore, the message areas (dashed line 603) remain hidden under that
reference illumination; only the variable intensity color image is visible (FIG. 7A,
702). Under a different illuminant, e.g. a UV illuminant, a blue light illuminant,
or a tungsten lamp illuminant (illuminant A), the luminescent inks create a luminescent
emission different from the one allowing to hide the message. For example, when the
color halftone generated with inks {
c,m
F,
yF} is not distinguishable from the one generated with inks {
c,
m, y} under a D65 illuminant, the two halftones will be clearly distinguishable under
an A illuminant. Luminescent emission of ink halftones induced by an illuminant different
from the reference illuminant (FIG. 7B, 703) makes the hidden message areas stand
out of the surrounding image (702), and reveals its message. Therefore, a message
printed with luminescent halftones hidden under a reference illuminant and appearing
under an illuminant different from the reference illuminant indicates that the valuable
item (document, article) on which the image is printed is authentic. When viewed under
a UV illuminant (e.g. UV-A black light), the hidden message is revealed as a colored
image, named "UV illuminant excitation trace image", or "UV excitation trace image".
Under a colored illuminant in the excitation wavelength range of the luminescent halftone,
the corresponding colored illuminant excitation trace image is revealed. For example,
under a blue excitation illuminant, a yellow luminescent ink contributing to a visible
halftone may produce a blue illuminant excitation trace image with a green or with
a greenish yellow that is different from the one seen under daylight. As a concrete
example, FIG. 20A shows a photograph (converted to grayscale) of a printed luminescent
color image taken under normal daylight, hiding the message "LSP" under the D65 illuminant.
FIG. 20B is a photograph (converted to grayscale) of the same printed luminescent
color image, taken under UV light. The corresponding original color photograph represents
the UV excitation trace image of that printed luminescent color image.
Application II: Embedding within a printed image multiple messages hidden by luminescent
halftones, each one under a different reference illuminant
[0067] In the present application, instead of hiding a message within an image only when
seen under a single illuminant, one may hide message
Ma (FIG. 8A, 801) under a first reference illuminant
Ia and hide a second message
Mb (802) under a second reference illuminant
Ib. Therefore, when seen under illuminant
Ia (FIG. 8B, 803), message
Ma (804) is hidden and message
Mb (805) is revealed and when seen under illuminant
Ib (FIG. 8C, 806), message
Mb (807) is hidden and message
Ma (808) is revealed. Under a third non-reference illuminant
Ic (FIG. 8D, 808), both messages
Ma (809) and
Mb (810) are revealed. Under a specific UV illuminant (black light) or under a specific
visible colored illuminant, each message is revealed by its corresponding trace image
(UV excitation trace image or colored illuminant excitation trace image).
Application III: Embedding multiple hidden messages comprising different halftones
exhibiting different luminescent properties within the printed luminescent image.
[0068] There can be many different luminescent subsets of inks, in the present example the
subset with the luminescent magenta {
c,mF,
y} and the subset with the luminescent yellow ink {
c,m, yF}
. It is possible to associate within a color image (FIG. 9A, 900) different subset
of luminescent inks to different messages, located each one within its specific areas,
for example allocating the subset {
c,m
F,
y} to the areas "OK1" (FIG. 9A, 901) and the subset {
c,m, yF} to the areas "OK2" (902). Colors at the intersection of the gamuts of the different
luminescent subsets and of the non-luminescent subset can be halftoned and printed
either as non-luminescent halftone colors or as halftone colors with specific luminescence
properties associated to the corresponding luminescent subset of inks. In the present
case, the luminescent subset {
c,m
F,
y} has the property of emitting in the red wavelength range under UV light and the
subset {
c,m, yF} has the property of emitting in the green wavelength range under UV light. When
a hidden message is halftoned with a specific subset of inks, the content of that
message and the emission color specific to that subset of inks are revealed under
UV light. In FIG. 9B, message "OK1" appears in red (905) and message OK2 appears in
green (906) as UV excitation trace images under UV light (907). Checking both the
presence of the message and of the emission colors of the UV excitation trace images
offers an additional means for authenticating the image incorporating the hidden message.
Application IV: Embedding hidden messages comprising halftones by spatially interpolating
between two or more subsets of inks.
[0069] One may hide a message within a color image (FIG. 10, 1000) whose colors within the
message areas are located at the intersection of the non-luminescent (e.g. {
c,m,y}) and the luminescent (e.g. {
c,mF,
y}, {
c,m, yF}) color gamuts. The message components (e.g. its individual letters) can be halftoned
with halftones comprising a weighted average of two (or more) luminescent subsets
of inks. The respective weights of the luminescent ink subsets are calculated according
to the position of the message components. The weighted average is performed spatially,
for example by allocating part of the output pixels to halftones of the first subset
of inks and part of the output pixels to halftones of the second subset of inks. Classical
dithering techniques allow for example to define these two sets of pixels, according
to the ratio of the weights of the luminescent ink subsets. When the color image with
the hidden message is revealed under UV light (black light), the message appears as
a UV excitation trace halftone image (or under a specific colored illuminant as a
colored illuminant excitation trace halftone image) with colors varying smoothly between
the emission color of the first luminescent ink set and the emission color of the
second luminescent ink set. In the example of FIG. 10, at each horizontal position,
there is another ratio of the weights of the {
c,m
F,
y} (1001) and {
c,m, yF} (1002) subsets of inks. At the border of letter "L", we have the ratios given by
positions 1003 and 1004, e.g. 2/5 and 3/5. The dithering pattern 1005, is obtained
by dithering a horizontally linear range of intensities between 2/5 and 3/5, e.g.
with a rotated Bayer dither matrix (see
US Pat. 5,438,431) or with a small diagonally oriented cluster-dot screen. The black and white pixel
regions 1006 and 1007 obtained by the dithering operation indicate respectively locations
where the message is halftoned with the {
c,
mF,
yF} ink set and locations halftoned with the {
c,
m, yF} ink set.
Application V: Creation of luminescent wide gamut color images
[0070] In addition to the creation of authenticable color prints, the present invention
also enables the wide gamut reproduction of input color images. This is especially
important for high quality faithful color reproductions, such as reproductions of
art paintings for postcards, books and posters. As can seen in the examples of FIGS.
2A and 2B the display gamut (
GsRGB) is considerably larger than a typical classical cyan, magenta and yellow (
Gc,m,y) ink gamut or in general, than a classical cyan, magenta and yellow and black ink
gamut (
Gc,m,y,k). But the union of the gamut (e.g.
Gc,m,y) formed by classical inks and the gamut (e.g.
Gc,mF,yF) formed by a luminescent set of classical and daylight luminescent ink is closer
to the display gamut and therefore enables a more faithful reproduction of input image
colors. The gamut mapping maps the input gamut (e.g.
GsRGB) into the union of the luminescent and classical non-luminescent gamuts (e.g.
Gc,m,y ∨
Gc,mF,yF) or into the smooth gamut (e.g.
Gc,m,y,mF,yF) obtainable with a set of more than 3 inks (e.g. the set of 5 inks {
c,
m, y, mF,
yF})
. The colors produced by a set of more than 3 inks can be predicted with a spectral
or color prediction model accounting for the number of used inks (e.g. the ink-spreading
enhanced YNSN model, extended to 5 inks).
[0071] When carrying out the color separation of an input color image, colors reproducible
only with the classical set of inks are reproduced by performing the color separation
with the classical non-luminescent inks and colors reproducible only with the luminescent
set of inks are reproduced by performing the color separation with the luminescent
set of inks. In regions reproducible by both sets of inks, one may perform the color
separation by either of the two sets of inks or by spatially interpolating (see Application
IV, spatial interpolating by dithering) between the classical and luminescent color
separations. The red (R), green (G) and blue (B) channels of a color photograph of
a color image printed with cyan, magenta, yellow, daylight luminescent magenta and
daylight luminescent yellow inks, taken under normal daylight, are shown in FIG. 21A.
The red, green and blue channels of a color photograph of the same printed color image
taken under UV light are shown in FIG. 21B. This color photograph forms the UV excitation
trace image of that printed luminescent color image and can be used for its authentication.
Application VI: Creation of luminescent enhanced color images
[0072] By having the possibility of mapping an input gamut to an output luminescent ink
gamut (see Section (f)), one may create luminescent enhanced color images which under
daylight have outstanding picture elements and which, under a UV illuminant, respectively
under a colored illuminant, allow these outstanding picture elements to appear as
UV excitation trace images, respectively as colored illuminant excitation trace images.
These trace images can be identified and compared with pre-recorded trace images.
This enables combining into a single printed design both protective and decorative
features. For example, the design of a package for a beauty article needs to be attractive
and at the same time offers a simple means of verifying that the corresponding article
is authentic.
[0073] Since the color gamuts obtainable with all considered ink sets and ink subsets are
known, a soft proofing software module running on a computing system can display a
preview of (a) the color image printed with classical inks only e.g. {
c,
m,
y} and (b) a preview of the same image, but gamut expanded into the luminescent gamut,
printed with a combination of classical and luminescent inks, e.g. {
c,m,y,mF,
yF}
. These two views give the designer an idea of how specific parts of the image can
be gamut extended so as to reinforce their appearance. Based on these views, the designer
can specify by a selection operation, for example with a lasso tool, the elements
that should stand out within the target color image. These elements are created by
combining classical and luminescent inks and by applying gamut expansion.
[0074] Since the emission spectra of the daylight fluorescent inks and of their superpositions
under UV light are known, the software previewing module can also predict the emission
spectra of color halftones viewed under UV light, for example by applying the ink
spreading enhanced Yule-Nielsen Spectral Neugebauer model [Hersch 2005]. The predicted
emission spectra are converted into a CIE-XYZ color (for more details, see [Hersch,
Donzé, Chosson 2007]) and are therefore displayable on a display (e.g. by a CIE-XYZ
to sRGB conversion, as known in the art). The predicted emission color image can be
saved onto a computer server and recalled later in order to compare it with the corresponding
color image viewed under UV light (black light). Depending on the comparison, one
may decide if the color image is authentic or not.
[0075] As an example, FIG. 11A shows an authentic graphic design representing a watch with
a golden frame 1101. In order to underline that the watch frame is made of gold, the
elements formed by this golden frame are selected, their colors are gamut expanded
and printed with luminescent inks. By examining that printed document under a UV illuminant,
the golden watch frame appears as a green frame (1102) within the UV illuminant trace
image. The authenticity of the document can be verified by typing the ID number of
this watch on the corresponding Web authentication server. If authentic, the same
green watch frame picture is displayed as the one seen under the UV illuminant.
[0076] In the case of color images obtained by photography, the designer may decide to limit
the gamut expansion by creating a deltamap with δ values, in order to allow only a
certain degree of gamut expansion. For example, in a picture of a setting sun over
the ocean (FIG. 12, 1202), different parts (1203 to 1204) of the reddish sky are imaged
with different gamut expansion limitation factors. The sun (1201) has a gamut expansion
limitation factor δ=0, i.e. the full luminescent gamut is used. At the boundary of
the sun 1203, δ=0, and at a certain distance 1204 of the sun, δ=1, i.e. we have a
total gamut expansion limitation. In between, there may be a linear or a non-linear
interpolation between the sun boundary 1203 and distance 1204, for example a function
f(x) of the relative distance of a point in respect to the boundary of the sun 1203.
The color of the UV excitation trace image depends on the deltamap defining the degree
of gamut expansion limitation.
[0077] In another setting, pixels close to the boundaries of the selected element areas
(e.g. the boundary 1302 of the sun 1301 in FIG. 13) may have a strong expansion limitation
factor, (e.g. a δ factor close to 1) and pixels further away from the boundaries have
a low or zero δ expansion limitation factor. One may for example define a boundary
offset region 1304 within the selected element area, where the δ expansion limitation
factor is inversely proportional to the distance to the element boundary 1302. The
soft proofing software module can then display the resulting partly luminescent color
image. The designer can further modify its element selections and gamut expansion
limitation parameters until he is satisfied with the result. He may then ask the computing
system to perform the color separation of the resulting image into the ink layers,
halftone them and send the resulting ink halftone layers to the printer. Here also,
if needed, the excitation trace image seen under a UV illuminant or under a colored
illuminant can be compared against the one registered onto a Web server.
[0078] Computer-based implementation of the methods for creating daylight luminescent color
halftone images.
[0079] A software package running on a computing system (FIG. 14: CPU, memory, input/output
1401, communication means 1402, storage means such as disks 1403) allows creating
in memory or on disks daylight luminescent color halftone images. Let us first describe
the initialization steps (FIG. 15) performed when launching the system. The daylight
luminescent color halftone rendering system is initialized by performing the steps
of measuring the reflectances 1501 of the contributing classical and daylight fluorescent
inks as well as their superpositions (colorants) under a reference illuminant. With
the help of a color or spectral prediction model, a relationship is established between
surface coverages of the inks and predicted spectrum or color. By predicting a large
number of colors thanks to many combinations of surface coverages of the selected
subset of inks (e.g. each ink at nominal surface coverages of 0, 0.05, 0.1, 0.15,
0.2, ... 0.9, 0.95, 1), a data set comprising many colors is formed and its gamut
given by its external hull is determined 1502, see [Cholewo and Love 1999]. A non-luminescent
set of inks yields a non-luminescent gamut. A set of non-luminescent inks and at least
one luminescent ink yields a luminescent color gamut. In a further step, a selected
input gamut, e.g. the display gamut, or the input image gamut can be mapped into non-luminescent
as well as into luminescent output target gamuts, by gamut reduction and/or gamut
expansion 1503. The input gamut can also be mapped into the intersection, respectively
union, of non-luminescent and luminescent gamuts (logical AND, respectively OR, operation
between the two gamuts). This operation results in gamut mapping tables 1504 mapping
the input gamut colors into non-luminescent, respectively luminescent output gamut
colors. A last initialization step consists in building 1505, thanks to the spectral
or color prediction model, the color separation table(s) indicating for each color
within a grid of the selected color space (e.g. CIELAB) the amounts of inks, or in
terms of nominal surface coverages, the surface coverages of the selected subsets
of inks allowing to print that color under the reference illuminant. Once the system
is initialized, actual luminescent color images can be synthesized by the software
and sent to the printer (FIG. 16). This may be carried out by the following steps.
An automatic or an operator driven procedure enable defining the original input color
image 1601 as well as, if desired, the contents, layouts and reference illuminants
of the hidden messages 1602. The target output color image is generated by determining
at each output location the corresponding original input image color, by performing
the gamut mapping into the desired target output gamut (non-luminescent gamut, luminescent
gamut, intersection or union between luminescent and non-luminescent gamuts) through
access of the gamut mapping table, and by determining the surface coverages of the
inks to be printed at the current output image location, see 1603. These surface coverages
are halftoned and the ink separation layers are sent to the printer, used to create
the offset plates for offset printing or the cylinders for gravure printing. In case
of creation of luminescent enhanced color images (Application VI above), the initialization
steps are the same and the synthesizing steps may comprise the definition of a delta
map 1605 specifying at each output image location a gamut expansion limitation factor.
Computing system for synthesizing daylight luminescent color halftone images
[0080] A computing system for synthesizing daylight luminescent color halftone images comprises
a number of software modules, simply called "modules". At system initialization time,
a non-luminescent and luminescent color (or spectral) prediction module (FIG. 17,
1701) establishes the relationship between surface coverages of the selected subsets
of inks and resulting colors by creating color separation tables 1702 for luminescent
and non-luminescent subsets of inks. A gamut calculation module 1703 computes the
boundaries 1704 of the gamuts of the selected subsets of inks by relying on the colors
produced by the color prediction module. A gamut reduction and expansion module 1705
performs the gamut mapping (gamut expansion and/or reduction) of the input gamut onto
the non-luminescent, the luminescent, the intersection or the union between non-luminescent
and luminescent output gamuts. At output image synthesizing time, a luminescent output
image synthesizing module 1706 scans the locations of the output image, locates the
corresponding locations within the original input color image 1708, gets that original
colors, calls 1709 the gamut reduction and expansion module in order to map the input
gamut colors into the non-luminescent gamut colors, into the luminescent gamut colors
or into corresponding colors at the intersection or the union of these two gamuts,
determines the surface coverages of the non-luminescent and/or luminescent ink subsets,
performs the halftoning and sends the resulting non-luminescent and luminescent ink
separation layers 1710 for further processing to a printer processing system 1711,
i.e. either directly to the printer, or to the imaging device responsible for producing
the supports required for printing (offset plates for offset, cylinders for gravure
printing or flexo, screens for screen printing, etc..).
Authenticating a valuable item by a human being or by an apparatus
[0081] The authentication of a valuable item can be carried out by a human being, for example
the person verifying the identity of the passengers embarking on an airplane or the
customer buying a valuable item such as a watch. In this case, the person verifying
the valuable item's partly luminescent halftone color image will first view it (FIG.
7A, 704 represents a human eye) under the reference illuminant
IRef (FIG. 7A, 700) hiding the message (705) and then under an illuminant different from
the reference illuminant (FIG. 7B, 701). The person will verify that the message is
indeed hidden (705) under the reference illuminant and appears correctly (703) under
a different illuminant (701). If several authentication levels are present (e.g. by
hiding different messages under different reference illuminants), the valuable item
may be viewed under several different illuminations, with always one illumination
hiding one of the hidden messages.
[0082] The authentication of the valuable item may also be carried out by an apparatus,
which (a) projects a reference illuminant light source onto the valuable item's partly
luminescent color image and acquires with an acquisition device (e.g. camera, multi-channel
sensor array) an image of that printed color image under the reference illuminant,
(b) projects an illuminant different from the reference illuminant (e.g. a different
white light source, a UV light or a colored illuminant) onto the partly luminescent
color image, acquires with the acquisition device the corresponding partly reflective
partly emissive image, and (c) processes the partly reflective partly luminescent
image and extracts the image parts exhibiting the luminescent behavior corresponding
to the property of the luminescent ink present within the subset of inks used to halftone
these image parts. This apparatus then compares the extracted luminescent image parts
with previously registered image parts and according to matching techniques known
in the art, decides if the extracted luminescent image parts match the previously
registered image parts or not. If a match is found, the valuable item incorporating
the partly luminescent color halftone image is labeled as authentic.
[0083] An example of such a computer-based authenticating apparatus is given in FIG. 18A.
This apparatus is appropriate for authenticating non-opaque documents by transmittance
measurements. It comprises a reference illuminant 1803 (e.g. white light source),
an optional filtering layer 1802 for modifying the spectral distribution of the light
source, the luminescent transmissive color image 1801 on the valuable item to be authentified,
the multi-channel sensor array 1804 and its electronics 1808 as well as a computing
system 1805 storing in its memory the images acquired by the multi-channel sensor
array. The computing system may also incorporate a display indicating if the valuable
item being scanned is authentic or not. In addition, as an option the computing system
may be connected to the Internet 1807 in order to validate that the acquired images
from the scanned valuable item are valid.
[0084] In FIG. 18B, a variant of this apparatus is given for scanning documents in reflective
mode. Here, there is a first light source 1803 with the reference illuminant and a
second light source 1811 with an illuminant different from the reference illuminant,
for example a UV illuminant (black light) or a colored illuminant (e.g. blue light).
Here also, there is a multi-channel sensor array 1804 and its electronics 1810, and
a computing system 1805 storing in its memory the images acquired by the multi-channel
sensor array.
[0085] Let us give an example of how such an apparatus works. The apparatus scans the valuable
item 1801 by displacing the valuable item in respect to the light sources and multi-channel
sensor array. There is a scan of the valuable item under the reference illuminant
and a scan of the valuable item under an illuminant different from the reference illuminant.
In reflective mode, it is possible to perform the two scans within a single displacement
by alternately illuminating with the reference illuminant and with a non-reference
illuminant. The scan performed with the reference illuminant generates the smooth
output image visible under normal light and the scan performed with the non-reference
illuminant generates an image where the parts generated with luminescent inks stand
out. Both images are scanned multi-channel images, for example with blue (wavelength
range 400nm-500nm), green (wavelength range 500nm-570nm), red (wavelength range 570nm-730nm)
channels. If the non-reference illuminant is a UV light (black light), the multi-channel
sensor will directly acquire the emission colors present in the image and be able
to compare it with a previously registered emissive image by applying image matching
techniques. The non-reference illuminant can also be a white light, a blue light or
a green light. In the case of a white light different from the reference illuminant,
classical image segmentation methods may allow to extract the luminescent image parts.
In the case of blue light, image parts with yellow and magenta luminescent inks will
stand out. These image parts can be compared with stored image parts for the purpose
of document authentication.
Second level authentication
[0086] This second level authentication requires an enlarging device such as an enlarging
glass or a microscope, possibly connected to an image acquisition device. A first
test consists in authenticating the halftone of the luminescent color image under
daylight and a second test consists in authenticating the halftone of the luminescent
color image under UV light or colored light, by making use of a microscope and possibly
of a UV, respectively colored light source. Under normal light, the luminescent image
halftone is formed by the ink dots of the different luminescent and non-luminescent
inks. Such a halftone located within a specific small region of a luminescent color
image can be produced and registered as original halftone image on a Web server. The
registered original halftone image can be compared with the printed actual halftone
image obtained by enlargement of the same small region of the luminescent color halftone
image under normal light. If the registered and the actual halftone images are substantially
similar, the first test is passed. The second test consists in examining a specific
region of the luminescent image halftone under UV, respectively colored light, under
a microscope. Here the apparent halftone (enlarged excitation trace halftone image)
should be formed by the partly luminescent ink dots. A previously registered excitation
trace halftone image is compared with the printed actual excitation trace halftone
image of the same small region of the luminescent color halftone image under UV, respectively
colored light. If the registered registered excitation trace halftone image and the
actual excitation trace halftone image are substantially similar, the second test
is passed. Passing these two tests is an additional indication that the valuable item
incorporating the luminescent color image halftone is authentic.
Illustration of the counterfeit prevention properties of the invented multi-ink daylight
luminescent color halftone image synthesis capabilities
[0087] In order to illustrate the counterfeit prevention properties of the presented daylight
luminescent image synthesis capabilities, let us present an example of a specific
color printed with a non-luminescent set of classical cyan, magenta and yellow inks
and the same color printed with a luminescent set of classical cyan, daylight luminescent
magenta and daylight luminescent yellow inks. FIGS. 19A, 19C and 19E show an enlargement
of respectively the cyan, magenta and yellow layers of a non-luminescent {
c,
m,
y} halftone and FIGS 19B, 19D and 19F show an enlargement of respectively the cyan,
luminescent magenta and luminescent yellow separation layers of the luminescent {
c,mF,yF} halftone producing the same color as the non-luminescent {
c,
m,
y} halftone, as created in memory before printing. Clearly, for the same color, the
non-luminescent set of inks requires much less ink surface coverages than the luminescent
set of inks. This indicates that a counterfeiter simply replacing non-luminescent
inks by luminescent inks would not be able to create with the luminescent inks a faithful
color reproduction of an input color image.