BACKGROUND OF THE INVENTION
Field of the Invention
[0001] The present disclosure relates to the field of medical imaging and in particular
to clinical imaging of tissue such as skin or other bodily tissue, with or without
lesions, for reference and analysis.
Description of the Related Art
[0002] Conventional methods of clinical imaging employ methods where there is little or
no control over the light source, exposure, orientation to the subject or the optical
characteristics of the image. Images are used to document the visible characteristics
of a scene and are used in diverse fields such as remote sensing, dermatology and
forensics. In some cases, a measurement tool is introduced into the imaging field
of view to allow for approximate correlation of the captured images to a linear scale.
In photogrammetry time scale images are compared and corrected for spectral and spatial
frequency distributions. This is often a laborious process. Spectral artifacts are
difficult to correlate in a time series of digital images due to variation in angles
of the source light and variation in optical axes and the impacts of ambient conditions.
Photogrammetric observations use tracking of parameters such as position, distance
from the subject and time, to ensure the optical angles of reference can be used in
image correlation and rectification. Rectification is often complicated by the three
dimensional characteristics of the scene. In medical imaging, coordinate systems can
be used to spatially relate subject matter to a standard, such as the Talairach atlas.
[0003] In patent application
WO 2008/064120 a method and system are described which can provide a way for a person to objectively
screen himself or herself for increased skin cancer risks using ABCD parameters in
conjunction with a digital photograph and a computer. A digital photograph of a skin
lesion can be obtained and the lesion can be segmented from the image. Next, several
features of the lesion can be measured and these measurements can be displayed graphically
in a manner which is understandable to a user who may not have any medical training.
[0004] Applicant is not aware of any standard by which photographic or spectroscopic images
of human tissue can be used to repeatedly establish the tissue specific molecular
optical characteristics of all subjects at different times, with different optical
conditions.
US patent 6738652 discusses the optical thickness of the skin as a ratio of protein to fat spectra.
The correlation of an image time series using conventional techniques is complicated
by the inability to accurately compensate for exact changes due to variations in the
ambient conditions.
WO 2007/035597 discloses an optical phantom according to the preamble of claim 12.
[0005] Therefore there is a need for technical approaches in clinical imaging that allow
clinicians to quickly acquire skin images without having to concern themselves with
the complex optical considerations that surround the rectification and registration
of images.
[0006] This background information is provided to reveal information believed by the applicant
to be of possible relevance to the present application. No admission is necessarily
intended, nor should be construed, that any of the preceding information constitutes
prior art against the present application.
BRIEF SUMMARY
[0007] Systems, methods and articles allow correction of tissue images corresponding to
spectral effects in a tissue sample due to the complex interactions of light and where
a computer model of tissue image data may be used to cross reference and compare data
from various spatial and spectral components and or from different images, to model
lesion shape.
[0008] Systems, method and articles allow correction and analysis of a digital image in
three dimensions, where physical and/or virtual fiducial markers are used in the imager
field of view, and where the fiducial marker is of a form that includes a well defined
shape and color variations and where some of the color areas on the fiducial marker
are used as optical phantoms to match the spectral character of living tissue including
a reflective layer to simulate the optical character of the skin.
[0009] A system and a method may be summarized as performing correction and analysis of
digital images in three dimensions in which a fiducial marker appears, the fiducial
marker having a well defined shape and color variations, where some of the color areas
on the fiducial marker are optical phantoms to match the spectral character of living
tissue and have a reflective layer to simulate an optical character of living bodily
tissue such as skin.
[0010] The correction may correspond to a set of spectral effects of the tissue sample,
which arise due to complex interactions of light. A computer or digital model of tissue
image data may be used by the system or method to cross reference and compare data
from various spatial and spectral components and/or from different images, to model
lesion shape. The analysis comparison of layers may take the form of a histogram.
[0011] The system or method may use the optical spectral data from the digital image to
create a three dimensional digital reconstruction of the lesion, including multispectral
data and image timeline data.
[0012] The optical phantom can be related to the individual spectral components of skin
with layers. The system or method may normalize a multiple image series. The optical
phantom may include an Epidermal Layer Phantom in the visible spectrum of 500 nm to
600 nm; a Melanin Layer Phantom in the spectrum of 300 nm to 500 nm; a Hemoglobin
Layer Phantom where oxyhemoglobin absorption peaks close to 415 nm, 515 nm, 590nm
or where in contrast deoxyhemoglobin peaks at 430 nm, 575 nm, 610nm; a Collagen Layer
Phantom where absorption is between 340 nm to 400 nm with a fluorescence peak between
450 nm to 550 nm (the fluorescent peak may be created with fluorescein or 5-carboxyfluorescein),
a water phantom where absorption peaks in the range of 450 nm; 575 nm; 630 nm; 730
nm; 820 nm, or in contrast reflection peaks at 514 nm; 606 nm; 660 nm; 739 nm.
[0013] A system and method for correction and analysis of digital images in three dimensions,
may employ one or more fiducial markers, which are physically placed or optically
projected into the image field of view, and where the fiducial marker is of a form
that includes a well defined shape and color variations and where some of the color
areas on the fiducial marker that are used as optical phantoms to match the spectral
character of living tissue also have a reflective layer to simulate the optical character
of the skin.
[0014] A digital image time series is normalized using numerical methods, for example by
measuring the difference of the spectral distribution between the optical character
of the tissue in combination with the fiducial marker where the monotonicity of certain
spectral relationships may be outside or approaching the limit of the normal spectral
distribution. Normal may be determined by the optical character of a subjects' healthy
tissue or in comparison to a population. A digital image may be normalized to the
fiducial marker, yet require to be normalized based on the spectral markers such those
of hemoglobin and collagen. A normalization of optical relationships may result in
an analysis including generation of a probability distribution of a tissue being abnormal.
The abnormal relationship may be represented by an optical density compared to a percentage
of optical spectra that can be attributed to that of collagen. An abnormal relationship
represented in the digital images may be viewed within an assigned probability index,
that allows certain digital images to be weighted by their diagnostic value or weighted
by comparative changes between spectra, which may show or be indicative of a trend.
The optical properties of hemoglobin, collagen, melanin and/or epidermis may be used
as an optical signature representative of tissue or of a specific individual person.
[0015] Correction for correlation of digital images may also include color correction information
in order to establish lesion border parameters that might include fluorescence and
reflection changes, or by comparison of the surface optical spectra to the subsurface
spectra. A multidimensional lesion map can be made to track the pixel characteristics
in the digital image such as surface, sub-surface and other layers or depth characteristics
as may be determined from the spectral analysis, such as areas of molecular activity,
blood flow or tissue density. Variation between image layer coordinates in a time
series of digital images may be used for registration and a standardized method of
optical correlation.
[0016] The optical or spectral data may be combined with spatial data to create true three
dimensional digital models of the lesions including growth comparisons, and where
the shape of the tissue is rectified with a three dimensional topographic map of the
body that combines three dimensional model probabilities, with correlation of coordinate
locations and spectral effects and complex interactions.
[0017] The normalized images enable clinicians through automated updates, to be able to
make diagnostic decisions using a standard protocol. The system and method may also
be used to establish a baseline optical/molecular index for an individual patient
and this data used to contribute to the normalization of images or be used in a timeline
as a diagnostic test. In particular, the digital images may be analyzed and a probability
index created from the combination of distributed properties of the variables including
normalization, exposure correction, geometric correlation, optical spectroscopic correction,
signal to noise characterization and diagnostic protocols.
[0018] A method of operating a system for use in tissue analysis may be summarized as including
comparing by at least one processor an appearance of at least one shape of at least
a first fiducial marker in a first digital image of a portion of a tissue to at least
one defined actual shape of the fiducial marker; and at least one of correlating,
normalizing, or correcting at least the first digital image, based at least in part
on the comparisons. The method may be characterized in that it further comprises comparing
by the at least one processor an appearance of each of a plurality of sections of
the fiducial marker in the first digital image to respective ones of defined sections
of the fiducial marker including a number of tissue phantoms each having a respective
spectral characteristic that matches a respective spectral characteristic of tissue
of a type represented in the first digital image. The fiducial marker may include
a scatter layer that overlies at least some of the tissue phantoms and which simulates
an optical character of the type of tissue represented in the first digital image,
and wherein comparing an appearance of each of a plurality of sections of the fiducial
marker in the first digital image to respective ones of defined sections of the fiducial
marker includes comparing the appearance of the sections which include the tissue
phantoms which are overlaid by the scatter layer with a number of defined sections
which include the tissue phantoms overlaid by the scatter layer. A number of sections
of the fiducial marker may include a respective color including at least one of black,
white, a plurality of different shades of grey, and a plurality of additional colors
that are not black, white or grey, and wherein comparing an appearance of each of
a plurality of sections of the fiducial marker in the first digital image to respective
ones of defined sections of the fiducial marker includes comparing the appearance
of the sections which include the respective colors with respective ones of a defined
set of respective colors.
[0019] The method may further include storing to at least one nontransitory storage medium
the digital image as a multi-layer image file, including a first digital image layer
that stores and at least a second digital image layer that stores image metadata.
[0020] The method may further include storing to a diagnostic layer of the digital image
on the nontransitory storage medium information indicative of at least one of an NADH
fluorescence, a collagen fluorescence, a physical scattering of light from the tissue
at a number of physical layers of the tissue due to tissue density, a spectral distribution
due to a size of a cell nuclei, and a hemoglobin absorption due to increased blood
flow or oxygenation.
[0021] The method may further include registering a number of subsequent digital images
in spatial and optical relationship by the at least one processor; and comparing the
first and the subsequent digital images on a layer by layer basis by the at least
one processor.
[0022] The system may further include referencing by the at least one processor at least
one of spectral changes or optical density at specific coordinates in the first digital
image to allow later comparison to changes in a number of subsequent digital images
of the region of interest.
[0023] The method may further include comparing by the at least one processor a number of
ratios of respective radiant spectral intensity of a number of wavelengths or wavebands
in the first digital image.
[0024] The method may further include comparing by the at least one processor a number of
ratios of respective radiant spectral intensity of a number of wavelengths or wavebands
in at least one subsequent digital image. Normalizing may include normalizing a plurality
of digital images including the first digital image by measuring a difference of a
spectral distribution between an optical character of the tissue in combination with
the fiducial marker, where a monotonicity of a number of defined spectral relationships
is proximate or exceeds a limit of a normal spectral distribution.
[0025] The method may further include establishing a subject specific baseline by the at
least one processor which is specific to an individual; and wherein the normalizing
is based at least in part on the subject specific baseline the first digital image
and a plurality of sequential digital images, the sequential digital images sequentially
captured at various times following a capture of the first digital image.
[0026] The method may further include determining a number of differences in the region
of interest as the region of interest appears between the normalized digital images
including the first digital image and the plurality of sequential digital images,
by the at least one processor, as part of a tissue analysis. Determining a number
of differences may include determining any morphological changes of the region of
interest as the region of interest appears between the digital images as part of the
determination of the differences in the region of interest as the region of interest
appears between the normalized digital images including the first digital image and
the plurality of sequential digital images. Determining a number of differences may
include assessing any change in at least one of a level of skin hydration, a total
number of wrinkles or a size of at least one wrinkle, or a total number of blemishes
or a size of at least one blemish. Determining a number of differences may include
assessing at least one of a level of hydration or a level of blood flow between the
first digital image and at least one subsequent digital image, where the first digital
image represents the region of interest prior to a first application of a cosmetic,
a moisturizer, a therapeutic or a therapeutic treatment and the at least one subsequent
digital mage represents the region of interest after the first application of the
cosmetic, the moisturizer, the therapeutic or the therapeutic treatment. Normalizing
may include normalizing at least the first digital image based at least in part on
a spectral marker of hemoglobin and a spectral marker of collagen.
[0027] The system may further include generating a probability index by the at least one
processor based on a combination of distributed properties of a number of variables
including a normalization, an exposure correction, a geometric correlation, an optical
spectroscopic correction, a signal to noise characterization, or a defined diagnostic
protocol. The instructions may further cause the at least one processor to generate
a digital model that geometrically represents the region of interest in three dimensions
based on spatial and spectral data from the digital images.
[0028] The method may further include associating at least one of multispectral data or
image timeline data to the digital model that geometrically represents the region
of interest in three dimensions by the at least one processor.
[0029] The method may further include rectifying the tissue by the at least one processor
with a three dimensional map of at least a portion of a body which combines a set
of three dimensional model probabilities with a correlation of a set of coordinate
locations, a set of spectral effects and a set of complex interactions. Correcting
may include correcting at least the first digital image based at least in part on
color correction information.
[0030] The method may further include generating by the at least one processor a digital
multidimensional lesion map that tracks a set of pixel characteristics in at least
the first digital image including at least one of a surface, a sub-surface, other
layers or a depth characteristic of the tissue as determined from a spectral analysis
of the tissue as represented in at least the first digital image.
[0031] Correcting may further include correcting for spectral effects in the tissue represented
in at least the first digital image which spectral effects are due to interactions
of light absorption, reflectance and fluorescence, and to cross reference and compare
a number of spatial and a number of spectral components specified by at least one
of a digital model of tissue image data or another digital image to generate the digital
three dimensional model of the region of interest. Correcting may include correcting
for differences in spatial orientation of at least one of an excitation axis or an
imaging axis of a tissue imaging system in Cartesian space.
[0032] The method may further include registering each of a plurality of digital images
of the tissue by the at least one processor, including the first digital image, based
at least in part on a variation between image layer coordinates in a temporal sequence
of a plurality of digital images of the tissue.
[0033] The method may further include generating by the at least one processor an analysis
comparison of layers in at least the first digital image as a histogram.
[0034] The method may further include generating by the at least one processor a probability
distribution of a tissue being abnormal. Generating a probability distribution of
a tissue being abnormal may include generating the probability distribution of the
tissue being abnormal based at least in part on a comparison of an optical density
to a percentage of optical spectra that is attributable to collagen. A probability
distribution of a tissue being abnormal may include generating the probability distribution
with a probability index that weights at least some digital images according to at
least one of a diagnostic value or a comparative amount of change between spectra.
[0035] A system for use in tissue analysis may be summarized as including at least one processor;
and at least one nontransitory storage medium that stores processor executable instructions
which when executed cause the at least one processor to: compare an appearance of
at least one shape of at least a first fiducial marker in a first digital image of
a portion of a tissue to at least one defined actual shape of the fiducial marker;
and at least one of correlate, normalize, or correct at least the first digital image,
based at least in part on the comparisons. The system for use in tissue analysis may
be characterized by the processor being further configured to compare an appearance
of each of a plurality of sections of the fiducial marker in the first digital image
to respective ones of defined sections of the fiducial marker including a number of
tissue phantoms each having a respective spectral characteristic that matches a respective
spectral characteristic of tissue of a type represented in the first digital image.
The fiducial marker may include a scatter layer that overlies at least some of the
tissue phantoms and which simulates an optical character of the type of tissue represented
in the first digital image, and the instructions cause the at least one processor
to compare the appearance of the sections which include the tissue phantoms which
are overlaid by the scatter layer with a number of defined sections which include
the tissue phantoms overlaid by the scatter layer. A number of sections of the fiducial
marker may include a respective color including at least one of black, white, a plurality
of different shades of grey, and a plurality of additional colors that are not black,
white or grey, and the instructions cause the at least one processor to compare the
appearance of the sections which include the respective colors with respective ones
of a defined set of respective colors.
[0036] The instructions may further cause the at least one processor to store the digital
image as a multi-layer image file, including a first digital image layer that stores
and at least a second digital image layer that stores image metadata.
[0037] The instructions may further cause the at least one processor to store to a diagnostic
layer of the digital image information indicative of at least one of an NADH fluorescence,
a collagen fluorescence, a physical scattering of light from the tissue at a number
of physical layers of the tissue due to tissue density, a spectral distribution due
to a size of a cell nuclei, and a hemoglobin absorption due to increased blood flow
or oxygenation.
[0038] The instructions may further cause the at least one processor to register a number
of subsequent digital images in spatial and optical relationship and to compare the
first and the subsequent digital images on a layer by layer basis.
[0039] The instructions may further cause the at least one processor to reference at least
one of spectral changes or optical density at specific coordinates in the first digital
image to allow later comparison to changes in a number of subsequent digital images
of the region of interest.
[0040] The instructions may further cause the at least one processor to compare a number
of ratios of respective radiant spectral intensity of a number of wavelengths or wavebands
in the first digital image.
[0041] The instructions may further cause the at least one processor to compare the number
of ratios of respective radiant spectral intensity of the number of wavelengths or
wavebands in the first digital image to a number of ratios of a respective radiant
spectral intensity of a number of wavelengths or wavebands in at least one subsequent
digital image.
[0042] The instructions may further cause the at least one processor to normalize a plurality
of digital images including the first digital image by measuring a difference of a
spectral distribution between an optical character of the tissue in combination with
the fiducial marker, where a monotonicity of a number of defined spectral relationships
is proximate or exceeds a limit of a normal spectral distribution.
[0043] The instructions may further cause the at least one processor to establish a subject
specific baseline which is specific to an individual, and normalize based at least
in part on the subject specific baseline the first digital image and a plurality of
sequential digital images, the sequential digital images sequentially captured at
various times following a capture of the first digital image.
[0044] The instructions may further cause the at least one processor to determine differences
in the region of interest as the region of interest appears between the normalized
digital images including the first digital image and the plurality of sequential digital
images as part of a analysis.
[0045] The instructions may further cause the at least one processor to determine morphological
changes of the region of interest as the region of interest appears between the digital
images as part of the determination of the differences in the region of interest as
the region of interest appears between the normalized digital images including the
first digital image and the plurality of sequential digital images. The instructions
may cause the at least one processor to determine the number of differences by assessing
any change in at least one of a level of skin hydration, a total number of wrinkles
or a size of at least one wrinkle, or a total number of blemishes or a size of at
least one blemish. The instructions may cause the at least one processor to determine
the number of differences by assessing at least one of a level of hydration or a level
of blood flow between the first digital image and at least one subsequent digital
image, where the first digital image represents the region of interest prior to a
first application of a cosmetic, a moisturizer, a therapeutic or a therapeutic treatment
and the at least one subsequent digital mage represents the region of interest after
the first application of the cosmetic, the moisturizer, the therapeutic or the therapeutic
treatment.
[0046] The instructions may further cause the at least one processor to normalize at least
the first digital images] based at least in part on a spectral marker of hemoglobin
and a spectral marker of collagen.
[0047] The instructions may further cause the at least one processor to generate a probability
index based on a combination of distributed properties of a number of variables including
a normalization, an exposure correction, a geometric correlation, an optical spectroscopic
correction, a signal to noise characterization, or a defined diagnostic protocol.
[0048] The instructions may further cause the at least one processor to generate a digital
model that geometrically represents the region of interest in three dimensions based
on spatial and spectral data from the digital images.
[0049] The instructions may further cause the at least one processor to associate at least
one of multispectral data or image timeline data to the digital model that geometrically
represents the region of interest in three dimension
[0050] The instructions may further cause the at least one processor to rectify the tissue
with a three dimensional map of at least a portion of a body which combines a set
of three dimensional model probabilities with a correlation of a set of coordinate
locations, a set of spectral effects and a set of complex interactions.
[0051] The instructions may further cause the at least one processor to correct at least
the first digital image based at least in part on color correction information.
[0052] The instructions may further cause the at least one processor to generate a digital
multidimensional lesion map that tracks a set of pixel characteristics in at least
the first digital image including at least one of a surface, a sub-surface, other
layers or a depth characteristic of the tissue as determined from a spectral analysis
of the tissue as represented in at least the first digital image.
[0053] The instructions may further cause the at least one processor to correct for spectral
effects in the tissue represented in at least the first digital image which spectral
effects are due to interactions of light absorption, reflectance and fluorescence,
and to cross reference and compare a number of spatial and a number of spectral components
specified by at least one of a digital model of tissue image data or another digital
image to generate the digital three dimensional model of the region of interest.
[0054] The instructions may further cause the at least one processor to correct for differences
in spatial orientation of at least one of an excitation axis or an imaging axis of
a tissue imaging system in Cartesian space.
[0055] The instructions may further cause the at least one processor to perform a registration
on each of a plurality of digital images of the tissue, including the first digital
image, based at least in part on a variation between image layer coordinates in a
temporal sequence of a plurality of digital images of the tissue.
[0056] The instructions may further cause the at least one processor to generate an analysis
comparison of layers in at least the first digital image as a histogram.
[0057] The instructions may further cause the at least one processor to generate a probability
distribution of a tissue being abnormal.
[0058] The instructions may further cause the at least one processor to generate the probability
distribution of the tissue being abnormal based at least in part on a comparison of
an optical density to a percentage of optical spectra that is attributable to collagen.
[0059] The instructions may further cause the at least one processor to generate the abnormal
relationship of the images are viewed within a probability index that weights at least
some digital images according to at least one of a diagnostic value or a comparative
amount of change between spectra.
[0060] A fiducial marker for use in tissue imaging may be summarized as including a substrate
having a defined profile and bearing a plurality of sections having respective wavelength
selective absorption, reflectance or florescence characteristic, at least a first
number of the sections form a color chart of a plurality of different colors and at
least a second number of the sections are optical phantoms, the fiducial marker being
characterized in that each of the optical phantoms have a respective spectral characteristic
that matches a respective spectral characteristic of the tissue.
[0061] The fiducial marker may further include a scattering layer overlying at least a first
set of the sections. The scattering layer may have a number of characteristics that
simulate a number of optical characteristics of at least one layer of the living tissue.
The optical characteristics may be those of skin. The second number of the sections
may include at least one of a first section having a selective spectral absorption
at a waveband of about 330nm to about 500nm, a second section having a selective spectral
absorption at a wavelength at about 415nm, about 515nm, or about 590nm, a third section
having a selective spectral absorption at a waveband of about 340nm to about 400nm,
a fourth section having a selective spectral fluorescence at a waveband of about 450nm
to about 550nm, or a fifth section having a selective spectral absorption at about
550nm, about 630nm, about 730nm, or about 820nm or a reflection peak at about 514nm,
about 606nm or about 739nm. The fourth section may include at least one of fluorescein
or 5-carboxyfluorescein. The second number of the sections may include each of a melanin
layer phantom section having a selective spectral absorption at a waveband of about
330nm to about 500nm, a hemoglobin layer phantom section having a selective spectral
absorption at a wavelength at approximately 415nm, about 515nm, or about 590nm, a
first collagen layer phantom section having a selective spectral absorption at a waveband
of about 340nm to about 400nm, a second collagen layer phantom section having a spectral
fluorescence at a waveband of about 450nm to about 550nm, and a fifth section having
a selective spectral absorption at about 550nm, about 630nm, about 730nm, or about
820nm or a reflection peak at about 514nm, about 606nm or about 739nm. At least a
second set of the sections may not be overlaid by the scattering layer. The colors
in the color chart may include at least one of black or white. The colors in the color
chart may include a plurality of different shades of grey. A first set of the sections
may include a first color chart having a black section, a white section, a plurality
of sections each of which is a respective shade of grey and a plurality of sections
each of which is a respective one of a plurality of additional colors, all the sections
of the first set overlaid by a scattering layer, and a second set of the sections
includes a second color chart having a black section, a white section, a plurality
of sections each of which is a respective shade of grey and a plurality of sections
each of which is a respective one of a plurality of additional colors, none of the
sections of the second set overlaid by a scattering layer. The defined profile may
be a polygon.
[0062] A system to image bodily tissues may be summarized as including a physical fiducial
marker selectively positionable at least proximate a region of interest on a portion
of a bodily tissue to be imaged, the physical fiducial marker including a substrate
having a defined profile and bearing a plurality of sections having respective wavelength
selective absorption, reflectance or florescence characteristic, at least a first
number of the sections form a color chart of a plurality of different colors and at
least a second number of the sections are optical phantoms, the system being characterized
in that each of the optical phantoms have a respective spectral characteristic that
matches a respective spectral characteristic of the tissue; at least one light source
operable to project a virtual fiducial marker at least proximate the region of interest
on the portion of the bodily tissue to be imaged, the virtual fiducial marker having
a defined profile and a plurality of defined shapes; and an image capture device having
a field of view and configured to capture digital images of bodily tissue including
the region of interest, the physical fiducial marker and the virtual fiducial marker
all encompassed by the field of view of the image capture device. The virtual fiducial
marker may be projected with the plurality of defined shapes as straight line segments.
The virtual fiducial marker may be projected with the profile of a circle and with
the plurality of defined shapes as straight line segments emanating from a center
point of the circular profile. The defined profile of the physical fiducial marker
may be a polygon. The colors in the color chart may include at least one of black,
white, a plurality of different shades of grey, a plurality of additional colors that
are not black, white or grey.
[0063] A method of operating a system for use in tissue analysis may be summarized as including
assessing by at least one processor of the system a change in at least one of a level
of hydration, a level of blood flow, a total number of wrinkles, a size of at least
one wrinkle, a total number of blemishes, or a size of at least one blemish between
a first digital image of a region of interest of a bodily tissue and at least one
subsequent digital image of the region of interest of the bodily tissue, where the
first digital image represents the region of interest prior to a first application
of a cosmetic, a moisturizer, a therapeutic or a therapeutic treatment and the at
least one subsequent digital mage represents the region of interest after the first
application of the cosmetic, the moisturizer, the therapeutic or the therapeutic treatment;
and reporting by the at least one processor of the system the assessed difference
in a visual form. Assessing a change in at least one of a level of hydration, a level
of blood flow, a total number of wrinkles, a size of at least one wrinkle, a total
number of blemishes, or a size of at least one blemish between a first digital image
of a region of interest of a bodily tissue and at least one subsequent digital image
of the region of interest of the bodily tissue may include assessing a number of spectral
characteristics of the region of interest in the first and the at least one subsequent
digital image. Assessing a number of spectral characteristics of the region of interest
in the first and the at least one subsequent digital image may include assessing a
spectral absorption, reflectance or fluorescence response of a number of layers of
skin characteristic of water, hemoglobin, and collagen.
[0064] The method may further include comparing by the at least one processor of the system
an appearance of at least one shape of at least a first fiducial marker in a first
digital image of a portion of a tissue to at least one defined actual shape of the
fiducial marker; comparing by the at least one processor of the system an appearance
of each of a plurality of sections of the fiducial marker in the first digital image
to respective ones of defined sections of the fiducial marker including a number of
tissue phantoms each having a respective spectral characteristic that matches a respective
spectral characteristic of tissue of a type represented in the first digital image;
and at least one of correlating, normalizing, or correcting at least the first digital
image based at least in part on the comparisons. The assessing may be performed after
the at least one of correlating, normalizing, or correcting at least the first digital
image based at least in part on the comparisons.
[0065] A system for use in tissue analysis may be summarized as including at least one processor;
and at least one nontransitory storage medium that stores processor executable instructions
which when executed cause the at least one processor to: assess a change in at least
one of a level of hydration, a level of blood flow, a total number of wrinkles, a
size of at least one wrinkle, a total number of blemishes, or a size of at least one
blemish between a first digital image of a region of interest of a bodily tissue and
at least one subsequent digital image of the region of interest of the bodily tissue,
where the first digital image represents the region of interest prior to a first application
of a cosmetic, a moisturizer, a therapeutic or a therapeutic treatment and the at
least one subsequent digital mage represents the region of interest after the first
application of the cosmetic, the moisturizer, the therapeutic or the therapeutic treatment;
and report the assessed difference in a visual form. The instructions may cause the
at least one processor to assess a change in at least one of a level of hydration,
a level of blood flow, a total number of wrinkles, a size of at least one wrinkle,
a total number of blemishes, or a size of at least one blemish between a first digital
image of a region of interest of a bodily tissue and at least one subsequent digital
image of the region of interest of the bodily tissue by assessing a number of spectral
characteristics of the region of interest in the first and the at least one subsequent
digital image. The instructions may cause the at least one processor to assess a number
of spectral characteristics of the region of interest in the first and the at least
one subsequent digital image by determining a spectral absorption, reflectance or
fluorescence response of a number of layers of skin characteristic of water, hemoglobin,
and collagen. The instructions may cause the at least one processor to: compare an
appearance of at least one shape of at least a first fiducial marker in a first digital
image of a portion of a tissue to at least one defined actual shape of the fiducial
marker; compare an appearance of each of a plurality of sections of the fiducial marker
in the first digital image to respective ones of defined sections of the fiducial
marker including a number of tissue phantoms each having a respective spectral characteristic
that matches a respective spectral characteristic of tissue of a type represented
in the first digital image; and at least one of correlate, normalize, or correct at
least the first digital image based at least in part on the comparisons. The at least
one processor may perform the assessing after performing the at least one of correlation,
normalization, or correction of at least the first digital image based at least in
part on the comparisons. The at least one processor performs may includes a therapy
recommendation in the report based on the assessment.
[0066] The invention is defined in the independent claims.
BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
[0067] In the drawings, identical reference numbers identify similar elements or acts. The
sizes and relative positions of elements in the drawings are not necessarily drawn
to scale. For example, the shapes of various elements and angles are not drawn to
scale, and some of these elements and angles are arbitrarily enlarged and positioned
to improve drawing legibility. Further, the particular shapes of the elements as drawn,
are not intended to convey any information regarding the actual shape of the particular
elements, and have been solely selected for ease of recognition in the drawings.
Figure 1 is a schematic diagram that illustrates a tissue imaging system and a subject
tissue, showing an orientation of the imaging to the subject tissue, according to
one illustrated embodiment.
Figure 2 is a schematic diagram that illustrates a field of view which encompasses
a subject tissue, including an area of interest and a fiducial marker, showing a spatial
context of the subject components and the fiducial marker within the field of view
or relative to the area of interest (x, y), according to one illustrated embodiment.
Figure 3 is a schematic diagram of an tissue imaging system and tissue image processing
host computing system, remotely located from and communicatively coupled to the tissue
imaging system, according to one illustrated embodiment.
Figure 4 is a graph that illustrates optical spectra of skin tissue with particular
consideration for optical layers that make up a basis for comparative analysis, according
to one illustrated embodiment.
Figure 5 is a cross sectional view of a fiducial marker optical phantom with a reflective
layer overlying a number of reference sections of the tissue optical layers, according
to one illustrated embodiment.
Figure 6 is a top plan view of a fiducial marker, according to one illustrated embodiment,
which illustrates color sectors of the fiducial marker; (a, b, c, d, e, f) being the
primary and secondary reference colors; (g, h) being the skin pigment reference colors;
(i, j, k, l) being the black, white and grey scale; and (m, n, o, p) being the optical
phantom reference sections of the tissue optical layers.
Figure 7 is a top plan view of a fiducial marker including a first portion having
a first color chart and a scattering layer overlying the first color chart, and a
second portion having a second color chart which is not overlaid by a scattering layer.
Figure 8 is a top plan view of a physical and a virtual fiducial marker on at flat
surface and one a surface that is not flat, according to one illustrated embodiment,
illustrating the change in geometry which is perceptible via variation in geometric
elements or shapes of the fiducial marker.
Figure 9 is a flow diagram illustrating an operation of a tissue imaging and digital
image processing system, according to one illustrated embodiment.
DETAILED DESCRIPTION
[0068] In the following description, certain specific details are set forth in order to
provide a thorough understanding of various embodiments of the invention. However,
one skilled in the art will understand that the invention may be practiced without
these details. In other instances, well-known structures associated with cameras,
imagers, scanners, optics, computers, computer networks, data structures, databases,
and networks such as the Internet or cellular networks, have not been described in
detail to avoid unnecessarily obscuring the descriptions of the embodiments of the
invention.
[0069] Unless the context requires otherwise, throughout the specification and claims which
follow, the word "comprise" and variations thereof, such as "comprises" and "comprising"
are to be construed in an open, inclusive sense, that is as "including but not limited
to."
[0070] Reference throughout this specification to "one embodiment" or "an embodiment" means
that a particular feature, structure or characteristic described in connection with
the embodiment is included in at least one embodiment of the present invention. Thus,
the appearances of the phrases "in one embodiment" or "in an embodiment" in various
places throughout this specification are not necessarily all referring to the same
embodiment. Furthermore, the particular features, structures, or characteristics may
be combined in any suitable manner in one or more embodiments.
[0071] The headings provided herein are for convenience only and do not interpret the scope
or meaning of the claimed invention.
[0072] As used herein and in the claims, "spectral effects" means the absorption, reflection,
exposure levels, white balance and fluorescence and variations for optical conditions
such as chromatic aberrations and focus, and spherical aberrations and spatial corrections
such as three dimensional characteristics and the orientation of the tissue imaging
system in Cartesian space.
[0073] As used herein and in the claims, "complex interactions" means the interaction of
light in the various types of tissue due to tissue layers, spectral effects where
a subject image is transformed into a coordinate system and imaging conditions are
the result of the relationship between various optical spectra and the tissue of interest.
[0074] As used herein and in the claims, "lesion shape" means the three dimensional shape,
volume and/or depth of infiltration of a skin lesion including compensation for spectral
effects and complex interactions, where digital images or digital photographs can
be normalized using a fiducial marker via computer image processing methods.
[0075] As used herein and in the claims, "analysis or diagnosis" means the resulting comparison
of differences from one portion of an image to another portion of the image, or from
one image to another image. A static or timeline image sequence can be used by clinicians
to evaluate the significance of any changes due to the propagation and attenuation
of light of certain defined wavelengths and for the different physical layers of the
skin, and data regarding the spectral distribution of the reflected and the back scattered
light including compensation for lesion shape, spectral effects and complex interactions.
[0076] As used herein and in the claims, "fiducial marker" means a system for correcting
for the variations in spectral power distribution from one image to another including
a fiducial marker color chart with a physical arrangement of known colors and used
for color registration within the image space including calibration of the reflected
light from the subject including comparing and adjusting with the color chart including
the white balance and grey scale and where a tissue phantom on the fiducial marker
is used for correlation of light from deeper tissue and to minimize the effect from
surface reflection.
[0077] As used herein and in the claims, the term "about" refers to a +/-10% variation from
the nominal value. It is to be understood that such a variation is always included
in a given value provided herein, whether or not it is specifically referred to.
[0078] Unless defined otherwise, all technical and scientific terms used herein have the
same meaning as commonly understood by one of ordinary skill in the art to which this
application relates.
Overview
[0079] Figure 1 shows a tissue imaging system 100 according to one illustrated embodiment,
which may be used to capture images of tissue 102 for analysis and diagnosis.
[0080] The tissue imaging system 100 includes a digital camera 104 or other image capture
device operable to capture images of tissue 102. One example of a professional digital
camera that may be suitable is an Alta U series digital camera commercially available
from Apogee Instruments. Alternatively, a consumer style camera may be suitable, for
example an SD 1300 digital camera commercially available from Canon.
[0081] The tissue imaging system 100 may include one or more excitation sources 106, which
may, or may not, be integral to the digital camera 104. Suitable excitation sources
106 may include a xenon flash tube or bulb and associated circuitry. The tissue imaging
system 100 may include one or more excitation filters 108 positioned between the excitation
source(s) 106 and the tissue 102 to filter electromagnetic radiation emitted by the
excitation source(s) 106.
[0082] The tissue imaging system 100 may include one or more imaging lenses 110. The imaging
lenses 110 may, or may not, be integral to the digital camera 104. The imaging lenses
110 may be used to adjust a focal point and/or depth of field of the tissue imaging
system 100. The tissue imaging system 100 may include one or more imaging filters
112 positioned between the tissue 102 and the imaging lenses 110 or digital camera
104 to filter electromagnetic radiation returned
(e.g., reflected, emitted) by the tissue 102. Within the image field of view 114 of the
digital camera 104 is placed a fiducial marker 116 which facilitates normalization
between digital images.
[0083] Figure 2 shows the field of view 116 of the digital camera 104 (Figure 1), according
to one illustrated embodiment.
[0084] The field of view 114 encompasses a portion of tissue 102, which includes a region
of interest 118. The region of interest 118 may take the form of a lesion, growth
or some other structure of, or on, the tissue 102. The field of view 114 also encompasses
the fiducial marker 116.
[0085] Figure 3 shows a tissue imaging and digital image processing system 200 according
to one illustrated embodiment.
[0086] The tissue imaging and digital image processing system 200 includes one or more tissue
imaging systems 100, for example identical or similar to the tissue imaging system
100 discussed in reference to Figures 1 and 2. The tissue imaging and digital image
processing system 200 also includes one or more tissue image processing host computer
systems 202. The tissue imaging system(s) 100 is(are) communicatively coupled to the
tissue image processing host computer system(s) 202 by one or more communications
channels, for example the Internet 206, one or more local area networks (LANs) 208
or wide area networks (WANs) 210. The tissue image processing host computer system
202 will at times be referred to in the singular herein, but this is not intended
to limit the embodiments to a single device since in typical embodiments, there may
be more than one clinic, hospital, or image processing service or facility involved.
Unless described otherwise, the construction and operation of the various blocks shown
in Figure 2 are of conventional design. As a result, such blocks need not be described
in further detail herein, as they will be understood by those skilled in the relevant
art.
[0087] The tissue image processing host computer system 202 may take the form of a conventional
mainframe computer, mini-computer, workstation computer, personal computer (desktop
or laptop), or handheld computer. Non-limiting examples of commercially available
computer systems include, but are not limited to, an 80x86 or Pentium series microprocessor
from Intel Corporation, U.S.A., a PowerPC microprocessor from IBM, a Sparc microprocessor
from Sun Microsystems, Inc., a PA-RISC series microprocessor from Hewlett-Packard
Company, or a 68xxx series microprocessor from Motorola Corporation.
[0088] The tissue image processing host computer system 202 may include one or more processing
units 212a, 212b (collectively 212), a system memory 214 and a system bus 216 that
couples various system components including the system memory 214 to the processing
units 212. The processing units 212 may be any logic processing unit, such as one
or more central processing units (CPUs) 212a, digital signal processors (DSPs) 212b,
application-specific integrated circuits (ASICs), field programmable gate arrays (FPGAs),
etc. The system bus 216 can employ any known bus structures or architectures, including
a memory bus with memory controller, a peripheral bus, and a local bus. The system
memory 214 includes read-only memory ("ROM") 218 and random access memory ("RAM")
220. A basic input/output system ("BIOS") 222, which can form part of the ROM 218,
contains basic routines that help transfer information between elements within the
tissue image processing host computer system 202, such as during start-up.
[0089] The tissue image processing host computer system 202 may include a hard disk drive
224 for reading from and writing to a hard disk 226, an optical disk drive 228 for
reading from and writing to removable optical disks 232, and/or a magnetic disk drive
230 for reading from and writing to magnetic disks 234. The optical disk 232 can be
a CD-ROM, while the magnetic disk 234 can be a magnetic floppy disk or diskette. The
hard disk drive 224, optical disk drive 228 and magnetic disk drive 230 may communicate
with the processing unit 212 via the system bus 216. The hard disk drive 224, optical
disk drive 228 and magnetic disk drive 230 may include interfaces or controllers (not
shown) coupled between such drives and the system bus 216, as is known by those skilled
in the relevant art. The drives 224, 228 and 230, and their associated computer-readable
storage media 226, 232, 234, may provide nonvolatile and non-transitory storage of
computer readable instructions, data structures, program modules and other data for
the tissue image processing host computer system 202. Although the depicted tissue
image processing host computer system 202 is illustrated employing a hard disk 224,
optical disk 228 and magnetic disk 230, those skilled in the relevant art will appreciate
that other types of computer-readable storage media that can store data accessible
by a computer may be employed, such as magnetic cassettes, flash memory, digital video
disks ("DVD"), Bernoulli cartridges, RAMs, ROMs, smart cards, etc.
[0090] Program modules can be stored in the system memory 214, such as an operating system
236, one or more application programs 238, other programs or modules 240 and program
data 242. Application programs 238 may include instructions that cause the processor(s)
212 to automatically normalize digital images or information therefrom based on fiducial
markers in those digital images and/or compare tissue or lesions between normalized
digital images. Other program modules 240 may include instructions for handling security
such as password or other access protection and communications encryption. The system
memory 214 may also include communications programs for example a Web client or browser
244 for permitting the tissue image processing host computer system 202 to access
and exchange data with sources such as Web sites of the Internet, corporate intranets,
extranets, or other networks as described below, as well as other server applications
on server computing systems such as those discussed further herein. The browser 244
in the depicted embodiment is markup language based, such as Hypertext Markup Language
(HTML), Extensible Markup Language (XML) or Wireless Markup Language (WML), and operates
with markup languages that use syntactically delimited characters added to the data
of a document to represent the structure of the document. A number of Web clients
or browsers are commercially available such as those from Mozilla, Google and Microsoft
of Redmond, Washington.
[0091] While shown in Figure 2 as being stored in the system memory 214, the operating system
236, application programs 238, other programs/modules 240, program data 242 and browser
244 can be stored on the hard disk 226 of the hard disk drive 224, the optical disk
232 of the optical disk drive 228 and/or the magnetic disk 234 of the magnetic disk
drive 230.
[0092] An operator can enter commands and information into the tissue image processing host
computer system 202 through input devices such as a touch screen or keyboard 246 and/or
a pointing device such as a mouse 248, and/or via a graphical user interface. Other
input devices can include a microphone, joystick, game pad, tablet, scanner, etc.
These and other input devices are connected to one or more of the processing units
212 through an interface 250 such as a serial port interface that couples to the system
bus 216, although other interfaces such as a parallel port, a game port or a wireless
interface or a universal serial bus ("USB") can be used. A monitor 252 or other display
device is coupled to the system bus 216 via a video interface 254, such as a video
adapter. The host computer system tissue image processing can include other output
devices, such as speakers, printers, etc.
[0093] The tissue image processing host computer system 202 can operate in a networked environment
using logical connections to one or more remote computers and/or devices. For example,
the tissue image processing host computer system 202 can operate in a networked environment
using logical connections to one or more network server computer systems (not shown).
Communications may be via a wired and/or wireless network architecture, for instance
wired and wireless enterprise-wide computer networks, intranets, extranets, and the
Internet. Other embodiments may include other types of communication networks including
telecommunications networks, cellular networks, paging networks, and other mobile
networks.
[0094] As explained herein, the tissue image processing host computer systems 202 may perform
human tissue image correlation, image analysis, normalization and/or correction of
optical exposure, spectral and spatial distribution in order to compensate for the
surface reflections, sub surface tissue interactions and spatial orientation of the
excitation and imaging axes to the subject tissue.
[0095] The tissue imaging and tissue image processing system 200 should be flexible such
that clinicians can model tissue image data in different forms in order to cross reference
and compare data from various spectral components and/or from different digital images.
The ability for human interpretation between images is substantial and the tissue
imaging and tissue image processing system 202 may enable variations to be seen between
images, even when the spectral and spatial optical conditions or the image resolution
or sensitivity are compromised or vary between times of image capture.
[0096] The use of the tissue image processing host computer system 202 to correct an image
involves more than adjusting the same exposure levels and white balance. The introduction
of a color card or fiducial marker into the field of view of the digital camera or
image can enable the tissue image processing host computer systems 202 to automatically
make corrections corresponding to the spectral effects in a tissue sample due to the
complex interactions of light absorption, reflection and fluorescence and to automatically
make spatial corrections to correct errors or differences due to the three dimensional
characteristics and the orientation of the tissue imaging system 100 in Cartesian
space.
[0097] The three dimensional shape, volume and depth of infiltration of a skin lesion are
significant factors for ongoing clinical analysis. The tissue image processing host
computer system 202 (Figure 3) uses computer image processing methods on digital images
or digital photographs to normalize much of the information, and to enhance critical
features such as Lesion Shape and lesion borders and metabolically active areas that
can aid in clinical analysis and diagnosis. The tissue image processing host computer
202 may produce appropriate digital or physical reports 270.
[0098] While the tissue imaging system 100 is described in terms of a digital camera and
an excitation source 106 such as a light source or Xenon flash tube, other types of
sensors such as spectrometers and other types of modulated excitation (e.g., light)
sources could be employed. The tissue image processing host computer system 202 executes
one or more computer software programs, processes or algorithms to perform various
image processing techniques on the optical spectral data from the captured digital
image. The host computer system is programmed to create a virtual three dimensional
reconstruction or three dimensional digital model of the lesion, and to add multispectral
data and image timeline data to the digital model or to a data structure associated
with the digital model. The resulting digital model may be displayed as images on
an appropriate device
(e.g., LCD display, cathode ray tube display). Analysis of differences from normal versus
lesion data in a static or timeline image sequence can be used by clinicians to evaluate
the significance of any changes. The tissue image processing host computer system
202 may also be programmed to establish a baseline of what is normal for a given patient
from an optical/molecular perspective, and this data used to contribute to the normalization
of digital images or be used in a timeline as at least part of a diagnostic test.
[0099] Figure 4 shows a graph 400 that illustrates optical spectra of skin tissue with particular
consideration for optical layers that make up a basis for comparative analysis, according
to one illustrated embodiment.
Characterising the Optical Inhomogeneity
[0100] The tissue image processing host computer system 202 is programmed to correct for
electromagnetic radiation returned from the tissue 102 (Figure 1). For example, the
tissue image processing host computer system 202 may correct the reflected light spectra,
in the visible portion of the electromagnetic spectrum, of the skin area surrounding
a skin lesion. Electromagnetic radiation (
e.g., light in the visible and non-visible portions the electromagnetic spectrum) undergoes
absorption and multiple scattering in the skin and is back scattered and re-emerges
carrying information which characterizes or is indicative of certain physical characteristics
of the structure of the skin and/or the lesion. The propagation and attenuation of
electromagnetic radiation of certain wavelengths
(e.g., light) varies for the different layers of the skin. The tissue imaging and digital
image processing system 200 captures data regarding the spectral distribution of the
electromagnetic radiation (
e.g., light) which is reflected and/or back scattered and/or fluoresces from the tissue
(
e.g., skin, lesion). The tissue image processing host computer system 202 can separate
the wavelengths or wavebands in the digital image, and compare the ratios of the respective
radiant spectral intensity of the wavelengths or wavebands. This allows for evaluation
of specific areas within a single image. This also allows for direct comparison at
a later date to the data obtained from other images of the same tissue 102 (Figure
1) or region of interest 118 (Figure 2). In this way, a spectral distribution of certain
areas of the digital image can be used to manage or aid in the interpretation of a
digital image or timeline (
i.e., sequence) of digital images. Further, the data from the digital image or sequence
of digital images can be used to aid in the interpretation of the molecular structure
of the subject tissue.
[0101] In use, the tissue imaging system 100 (Figure 1) may capture a first subject digital
image at a first time, and may capture further digital images at later times. Thus,
the captured digital images may represent a sampling of the same scene or object or
area at different times, and/or under different optical conditions. The tissue image
processing host computer system 202 transforms the first subject digital image
I1 into a defined coordinate system and certain conditions are highlighted within an
image layer
Ln or as metadata. One layer might represent the relationship between various optical
spectra. As further or sequential digital images are added
I1+n, tissue image processing host computer system 202 can compare those digital images
on a layer to layer
L1...n basis by registering the new digital image in spatial coordinates and optical relationships.
Deformation of the subject digital image due to either poor imaging technique, or
morphological change is made to evaluate optical changes at specific coordinates in
the digital image within the layers
Ln or compare the changes to the variations from the first subject digital image
I1 or other layers in different digital images along a timeline.

[0102] In this manner, the tissue image processing host computer system 202 compares the
layers of each digital image such as the difference of one layer to the average:

[0103] In which case the tissue image processing host computer system 202 may recalculate
the individual pixel values. In certain cases only the pixel values of specific x,
y coordinates would be used.
[0104] One layer might represent the relationship between various optical spectra. Optical
changes such as spectral changes or optical density at specific coordinates in the
digital image
O(xn, yn) can be referenced to compare the changes to the variations from another subject digital
image
I1+n, such as the coordinates that were indicative of the lesion area. Alternatively,
or additionally, a numerical value could be created by a clinician identifying a cross
sectional area where a histogram (
hist) would be generated to visualize the probability density of certain optical spectra
within, or between, layers such as for the set of specific
x,
y values in chosen layers:

[0105] Histograms or other types of analysis such as derivatives or ratios can be used to
determine the changes between areas of interest 118 (Figure 1) within a layer or between
layers.
Fiducial Marker
[0106] One or more fiducial markers 116 (Figure 1) may be employed to provide information
in the digital images which allows the tissue image processing host computer system
202 to perform various image processing acts (e.g., normalization, comparison, three
dimensional modeling). As explained in detail below, the fiducial markers 116 may
take the form of physical objects (e.g., physical media) which are placed at, on,
or proximate the region of interest 118 (Figure 1) of the tissue 102 for image capture
Alternatively, or additionally, the fiducial markers 116 may be virtual, taking the
form of structure light projected to illuminate an area at, on, or proximate the region
of interest 118 (Figure 1) of the tissue 102 for image capture. Whether physical fiducial
markers, virtual fiducial markers or both are employed, a knowledge of baseline or
starting physical characteristics of the fiducial markers 116 is used to identify
differences (e.g., spectral, geometric or topological) between the baseline or starting
physical characteristics and how the fiducial markers 116 appear in a captured digital
image. Such allows characterization of differences between captured images, which
differences may arise due to system variations or ambient environment variations,
which variations are unrelated to variations in the tissue itself.
[0107] As best illustrated in Figure 6, the fiducial markers 116 have a defined shape or
two dimensional profile. While illustrated as rectangular, other shapes may be employed,
for example hexagonal, octagonal, or another polygon. In some instances, fiducial
markers may have other non-polygonal profiles, for example oval or circular, although
such may be less preferable since such non-polygonal shapes may limit the amount of
information regarding orientation which can otherwise be discerned from the appearance
of the fiducial marker 116 in a digital image. In such instances it may be advantageous
to include additional defined shapes in the fiducial markers 116, for radial line
segments.
[0108] Also as best illustrated in Figure 6, the fiducial markers 116 may take the form
of a plurality of discrete portions, denominated as sections herein. Each portion
or section may have a respective characterizing physical property, for example a respective
spectral electromagnetic radiation absorption or reflectance property or characteristic.
Thus, for example, the fiducial marker 116 may appear as an array of different color,
grey scale or white sections, each section preferentially absorbing certain wavelengths
or bands of wavelengths while reflecting, back scattering or fluorescing other wavelengths
or bands of wavelengths. While the sections may typically arranged in a two dimensional
array, such as illustrated in Figure 6, some fiducial markers may take the form of
a one dimensional or linear array, while other fiducial markers may include an unordered
array or collection of sections. The characterizing physical properties (e.g., spectral
absorption and/or reflectance properties) and relative positions of each sections
are known to the tissue image processing host computer system 202, at least during
image processing, as is the baseline or starting shape or profile.
[0109] These sections may be organized by function or characterizing property. For example,
a number of sections may form a color chart, including primary/secondary color portion
(sections labeled A-F), skin pigment reference colors portion (sections labeled G-H),
black, white, grey scale portion (sections labeled I-L). A number of sections may
form a tissue phantom portion (sections labeled M-P). Each portion may respectively
include one or more distinct sections with respective physical characteristics such
as selective wavelength absorption, reflectance and/or florescence.
[0110] For example, the primary/secondary color portion (sections labeled A-F) of the color
chart may take the form of a physical arrangement of defined primary and/or secondary
colors, which can be used for color registration within the image space. For instance,
sections A-F may appear as blue, teal, green, magenta, red, and yellow, respectively.
The grey scale portion of the color chart may be an arrangement of sections used as
a middle gray reference of in the order of 13 - 18 % reflectance, and the black or
white balance portion of the color chart may be in the order of 90% reflectance and
used by the tissue image processing host computer system 202 to compensate for variations
in apparent optical excitation such as variations in excitation source to subject
distance (
i.e., distance between excitation source 106 and target tissue 102). For instance, sections
I-L may appear as dark grey, white, black, light grey, respectively. For instance,
the sections G and H may be brown and a Caucasian skin tone (e.g., tan), respectively.
For instance, the sections M-P may appear as violet, blue, purple and light blue,
respectively.
[0111] Corrections are to be used for calibration of the light returned (e..g., reflected,
back scattered, fluoresced) from the subject tissue 102. The tissue image processing
host computer system 202 can correct multiple digital images by comparing and adjusting
for the appearance of the primary/secondary color portion (sections labeled A-F),
black, white balance and grey scale portion (sections labeled I-L) in the digital
image based on the known values of the various sections. In more complex optical correlation
between digital images, tissue phantom portion (sections labeled M-P) on the fiducial
marker 116 may be used for correlation of light from deeper tissue and to minimize
the effect from surface reflection. Thus, the tissue image processing host computer
system 202 uses the appearance of the fiducial marker 116 in digital images to measure
and correct for variations in spectral power distribution from one digital image to
another digital image.
[0112] As best illustrated in Figure 5, a tissue phantom fiducial marker 116 is a structure
to correct for the reflection and the backscatter of the dominant wavebands of the
skin. The tissue phantom portion of the fiducial marker 116 includes a wavelength
selective portion 502 that has an overlying surface or coating 504. The overlying
surface or coating 504 causes some surface scatter while also allowing transmission
of some light, and has a known optical density O
n. The wavelength selective portion 502 of the tissue phantom portion may include a
plurality of sections or swatches of different colors (five illustrated in Figure
5) 502a-502e that advantageously represent the spectral absorption and reflection
of collagen and also of hemoglobin. The overlying surface or coating 504 may advantageously
take the form of a matt surface that yields a five to seven percent reflection.
[0113] Figure 7 shows a physical fiducial marker 700, according to one illustrated embodiment.
[0114] The physical fiducial marker 700 has a first portion 702a which includes a scatter
layer 702a overlying a first plurality of sections A-P. The sections A-P of the first
plurality each have respective different colors or wavelength selective spectral absorption,
reflectance, and/or florescence characteristics (sixteen illustrated, labeled A-P),
identical or similar to those discussed above. The physical fiducial marker 700 has
at least a second portion 702b which omits the scatter layer overlying a second plurality
of sections. The sections A-P of the second plurality each have respective different
colors or wavelength selective spectral absorption, reflectance, and/or florescence
characteristics (sixteen illustrated, labeled A-P), identical or similar to those
discussed above.
[0115] Each portion 702a, 702b may include the same set and spatial arrangement of sections
or colors. For example, each sector A-P of the first portion 702a may be a respective
one of 16 colors, while each sector A-P of the second portion 702b may be a respective
one of the same 16 colors. The colors of the sectors A-P of the second portion 702b
may be spatially arranged in the same order or relative positions with respect to
one another as the order or relative positions of the sectors A-P of the first portion
702a. Thus, sector A of both the first portion 702a and the second portions 702b may
both be, for example red or otherwise have the same wavelength selective spectral
absorption, reflectance and/or florescence characteristics.
[0116] The inclusion of a scatter layer 504 (Figure 5) on the first portion 702a and omission
of such from the second portion 702b facilitates automated normalization that corrects
for spectral distribution of a sensor (e.g., image sensor such as an array of charge
coupled device, or CMOS image sensor). Notably, sensors may respond differently in
changing ambient conditions, such as changing light and/or temperature conditions.
The correction for sensitivity across the spectral distribution and scatter at specific
wavebands can be used to optimize the image processing, especially to compare the
ratios of sectors.
[0117] The fiducial marker 116 (Figures 1 and 2) may be virtual, being formed by projecting
structured light from the excitation source 106 (Figure 1) which forms a pattern of
light on the subject tissue 102. The projection may be of multi-dimensions and include
variations of optical spectra. The projection may be sweeping by use of a laser scanner,
holographic scanner or monochromator or may achieved via one or more filters or diffractive
optical lenses to fit over the excitation source 106 (Figure 1) for example a flash
tube or bulb of a digital camera 104. Using structured light allows the tissue image
processing host computer system 202 to perform automated tissue layer analysis due
to the variations in triangulation with multiple spectra. Variations in optical spectra
can be used to measure or otherwise determine the molecular optical character of the
subject without interference from out of band wavelengths. The sensor or digital camera
104 captures the incident light from the surface of the subject tissue 102, which
provides a digital image containing information which can be analyzed and/or processed
to create an image map.
[0118] Figure 8 shows a physical fiducial marker 802a, 802b (collectively 802) and projected
or virtual fiducial marker 804a 804b (collectively 804) used in combination.
[0119] The physical fiducial marker 802a, 802b has a defined shape or profile, rectangular
in Figure 8, and includes a plurality of sectors, each with respective spectral absorption,
reflectance or florescence characteristics, as discussed above. When projected onto
a flat surface, the projected or virtual fiducial marker 804a has a defined shape.
For example when projected onto a flat surface, as illustrated in the lower portion
of Figure 8, the projected or virtual fiducial marker 804a may have a circular profile
and a plurality of straight radial line segments which emanate from a center point
of the circular profile. However, when projected onto a surface that is not flat (e.g.,
lesion), the projected or virtual fiducial marker 804b has a shape that conforms to
the non-flat surface. For example when projected onto a lesion, as illustrated in
the upper portion of Figure 8, the projected or virtual fiducial marker 804b the profile
may be changed and/or the radial line segments may no longer be straight but rather
reflect the three dimensional contours of the lesion.
[0120] Thus, the physical fiducial marker 802 and projected or virtual fiducial marker 804
can be used in combination to assure that the benefits of each are utilized. The physical
fiducial marker 802 may advantageously provide improved normalization and correction
for spectral character, while the projected or virtual fiducial marker 804 may advantageously
provide improved shape correlation to spectral abnormalities.
[0121] The projected fiducial marker 804 can be of a form that provides information which
allows the tissue image processing host computer system 202 to effectively analyze
three dimensional tissue (
i.e., tissue that has a relatively large change in curvature or change along the Z-axis
over the XY area of tissue being imaged), such as the cervix. A scatter distribution
can be obtained in combination with shape measurement. The tissue image processing
host computer system 202 can compare this information at various wavelengths to create
a spatial and spectral map of the tissue and the optical characteristics of the tissue.
[0122] As noted above, the projected or virtual fiducial marker 804 can be used as various
shapes to enable the collection of both spectral and spatial information. The projected
or virtual fiducial marker can use optically discrete parameters, for example projected
lines, so as to measure the distortion of the area of interest. The reflective nature
of the subject tissue can be measured or otherwise determined or assessed as local
distortion of the projected line such as optical saturation of the sensor versus incident
reflection. In this respect it is noted that two spatially identical optical line
projections at different wavelengths display different scatter characteristics. The
tissue image processing host computer system 202 can measure or otherwise determine
such for various wavelengths of light to get a better measure of the reflection, absorption,
transmission and fluorescence at coordinates within the digital image. For example,
two spatially identical projections of a line, varied only in their wavelength, might
have greater reflectance at one point at a specific wavelength versus another. This
enables the post processing of digital images to account for reflectance artifacts.
[0123] Figure 9 is a flow diagram illustrating a method 900 of operating a tissue imaging
and digital image processing system 202, according to one illustrated embodiment.
The method 900 is exemplary. In use, the method 900 may include additional acts, omit
some acts, and/or perform acts in different orders. The method 900 is presented as
an overview. Many of the specifics of performing the various acts of the method 900
are described in detail herein.
[0124] At 902, the tissue image processing host computer system 202 performs spatial correction
on a digital image. The tissue image processing host computer system 202 may rely
on the difference between how the fiducial marker appears in the digital image and
a known appearance of the fiducial marker. Spatial correction may, for example correct
for various digital imaging system misalignments and is generally discussed elsewhere
herein.
[0125] At 904, the tissue image processing host computer system 202 registers and/or rectifies
the digital image. Image registration and/or rectification are discussed in more detail
elsewhere herein.
[0126] At 906, the tissue image processing host computer system 202 may generate a region
of interest spatial baseline
(e.g., lesion spatial baseline). The spatial baseline may facilitate comparisons over time.
Spatial baseline generation is discussed in more detail elsewhere herein.
[0127] At 908, the tissue image processing host computer system 202 may generate a three
dimensional model of the region of interest (
e.g., lesion). The tissue image processing host computer system 202 may employ information
stored in a database of historical parameters 910, stored on one or more nontransitory
computer readable storage mediums. The three dimensional model facilitates comparisons,
and is discussed in more detail elsewhere herein.
[0128] At 912, the tissue image processing host computer system 202 may perform spectral
correction on the digital image. The tissue image processing host computer system
202 may rely on the difference between how the fiducial marker appears in the digital
image and a known appearance of the fiducial marker. Spectral correction may, for
example, correct for various differences in imaging conditions, for example variations
in lighting, and is generally discussed elsewhere herein.
[0129] At 914, the tissue image processing host computer system 202 may perform spectral
normalization on the digital image. The tissue image processing host computer system
202 may employ information stored in the database of historical parameters 910 to
perform spectral normalization. Spectral normalization is discussed in detail elsewhere
herein.
[0130] At 916, the tissue image processing host computer system 202 may create spectral
layers in the digital image file, storing spectral information thereto Layers of the
digital image file are discussed in detail elsewhere herein.
[0131] At 918, the tissue image processing host computer system 202 determines reflection,
absorption, fluorescence values or characteristics for the digital image. As described
elsewhere herein, the tissue represented in the image may be characterized by is spectral
characteristics, in particular in the particular wavelengths of wave bands which the
tissue, or portions thereof, absorb, reflect or fluoresce. Determination of the reflection,
absorption, fluorescence values or characteristics are described in detail elsewhere
herein.
[0132] At 920, the tissue image processing host computer system 202 generates a region of
interest spectral baseline (e.g., lesion spectral baseline). The spectral baseline
allows spectral changes in the region of interest to be easily and accurately compared
and identified. Generation of spectral baselines are discussed in detail elsewhere
herein.
[0133] At 922, the tissue image processing host computer system 202 performs post processing.
There are numerous possible post processing procedures, which are described elsewhere
herein.
[0134] At 924, the tissue image processing host computer system 202 determines spectral
ratios. As described herein, spectral ratios may be particularly advantageous for
allow comparisons within a digital image or between digital images. The determination
and use of spectral ratios are described in detail elsewhere herein.
[0135] At 926, the tissue image processing host computer system 202 determines probability
indices. The tissue image processing host computer system 202 may employ the lesion
spectral baseline generated at 920 in determining the probability indices. Probability
indices facilitate the diagnosis of tissue, such as lesions, and the generation and
use of such are discussed in detail elsewhere herein.
[0136] At 928, the tissue image processing host computer system 202 generates a three dimensional
digital model of the region of interest (e.g., lesion) incorporating the spectral
changes. The generation of the three dimensional digital model and the benefits thereof
are discussed in detail elsewhere herein.
[0137] At 930, the tissue image processing host computer system 202 may register the three
dimensional digital model generated at 928 with a three dimensional map of a human
body or portion thereof. The tissue image processing host computer system 202 may
employ information from the database of historical parameters generated at 910. The
registration may facilitate analysis and/or diagnosis, as discussed in more detail
elsewhere herein.
Normalization
[0138] In some embodiments, the tissue image processing host computer system 202 may normalize
an image time series (
i.e., temporal sequence of digital images). Those digital images may have been captured
over a relatively long time (
e.g., decades, years, months) at any variety of frequencies or intervals, and/or over
a relatively short time (
e.g., weeks, days, hours) at any variety of frequencies or intervals. In the case of
multiple digital images taken over variable ambient conditions, any difference of
the spectral distribution between the reflective character of a digital image, such
as those taken in low ambient light versus digital images created with electronic
flash, will reduce the probability of confidence in an image correlation. Such a case
will require numerical methods to correct or normalize the digital images.
[0139] The monotonicity of certain spectral relationships may be outside or approaching
the limit of the normal spectral distribution. This might be typical for the case
where a digital image is normalized to the fiducial marker 116, yet still requires
to be normalized based on the spectral markers such as hemoglobin and collagen.
[0140] The presence by measure of reflective, absorptive, transmissive or fluorescent light,
or relationship of one spectra to another is computationally bounded within certain
limits of what is normal. Normal may be determined by the spectral distribution ratios
of healthy tissue in the person of interest or in comparison to a population. Once
there has been a normalization, certain optical relationships can be analyzed such
as a probability distribution. One example of this is the optical density compared
to the percentage of the optical spectra that can be attributed to that of collagen.
Another example is to remove the spectra that are attributed to the surface skin and
allow for sub surface analysis.
[0141] In the case where spectral distribution is corrected by numerical methods, a computed
distribution that results in increases of a waveband that might normally cause fluorescence
will not be able to assign fluorescent values outside of what is considered normal.
However, by analysis the distribution can be automatically assessed by the tissue
image processing host computer system 202 to determine if there are corresponding
increases in spectra that would relate to absorption and fluorescence. To correct
for fluorescence in a time series of numerically processed digital images requires
then that the digital images are assessed or analyzed within a probability index.
[0142] Some embodiments may advantageously employ digital images that are displayed in layers
assigned to the wavebands of excitation and with a probability index that allows certain
images to be weighted in their diagnostic value.
[0143] The monotonicity of spectral changes, whether individual spectra or comparative changes
between spectra may show a trend; for instance, a trend that highlights a decreasing
amount of collagen in one tissue versus another tissue. The tissue image processing
host computer system 202 may consider or assess a linearity of the function versus
the normalization.
Exposure and color correction
[0144] Exposure may vary with both the angle of incidence, the relative angle of the illumination
(
e.g., flash) to the subject tissue 102 (Figure 1), the irradiance of the illumination
and the spectral distribution of the illumination, the orientation of the subject
tissue 102 from one digital image to another digital image with respect to the optical
axes, the distance and angle of the imaging optics to the subject tissue 102, any
filters 108, 112 in the optical paths (arrows in Figure 1) and shutter speed, aperture
and sensitivity of the imager or image capture device 104.
[0145] In at least some embodiments, the tissue image processing host computer system 202
is designed to compensate for the optical effects that vary with the optical exposure.
Exposure may be initially established by comparing the features of the fiducial markers
116 and correction for spectral distribution of the excitation source 106 (Figure
1) and then the tissue characteristics. Compensation for reflection involves separation
of the surface effects from the subsurface effects.
[0146] In at least some embodiments, color correction includes exposure analysis based on
the fiducial markers 116, modeling of the tissue depth profile, and further includes
use of information of the ratios of lesion colors, width, fluorescence and reflection
to that of surrounding tissue in a two dimensional normalization.
[0147] In at least some embodiments, color correction includes exposure analysis based on
the fiducial markers 116, modeling of the tissue depth profile with greater degrees
of specificity including spectral correction of non-lesion tissue components such
as optical biomarkers from subsurface tissue excitation including, blood, oxygen,
glucose, collagen, flavins, elastin, tryptophan, NADH etc.
[0148] Notably, the apparent optical exposure may also vary due to changes in the subject,
including hydration, blood flow, temperature and the ratios of the natural skin components
including epidermis, melanin, hemoglobin, collagen, bilirubin and other chromophores
such as carotenoids and porphyrins. Further the apparent optical exposure may be altered
by the use of topical creams, cosmetics or by drug and food interactions with the
natural skin components. In such situations, the tissue image processing host computer
system 202 then adjust the digital image to a baseline normal of the reflected light,
and remove any artifacts, and the ratio of subsurface backscatter from one digital
image to another digital image can then be more easily compared by using a subsurface
ratio.
[0149] In at least some embodiments, the tissue image processing host computer system 202
uses the ratios of the optical scattering of hemoglobin to that of collagen as a reference
to adjust and normalize the optical exposure of the subsurface.
Optical Ratios
[0150] The reflective properties of the epidermis of one person versus another person can
vary significantly as so can the ratios of hemoglobin, collagen, melanin to epidermis
from person to person. As a result, the complexity of human skin requires that in
order to accurately reference one digital image to another digital image, that an
accurate model is representative of each person. A system of optical layers for each
image
I1L1 that conforms to the principle optical absorption bands is used to separate the optical
spectra as further described below.
[0151] An Epidermal Layer where scattering dominates absorption in the visible spectrum
of
500 nm to
600 nm I1LE.
[0152] A Melanin Layer where the melanin absorption in the spectrum of
300 nm to
500 nm I1LM may be characterized by the optical density O or computed by comparison to other
spectra from various molecular optical sources at different wavelength
Oλ. Melanin does not have a defined peak in the visible but its absorption coefficient
decreases with the longer wavelengths.
[0153] A Hemoglobin Layer where the hemoglobin absorption in the visible spectrum primary
absorption of oxyhemoglobin peaks at
415 nm I1LH. Adjustments to the hemoglobin layer may be made by comparison to deoxyhemoglobin
such as primary absorption peaks at
430 nm or by using the absorption of hemoglobin to correct for artifacts in other layers,
such as secondary absorption peaks for oxyhemoglobin at
542 nm and 577
nm, and secondary absorption peaks for deoxyhemoglobin at
555 nm.
[0154] A Collagen Layer where the collagen absorption is measured in the visible portion
of the electromagnetic spectrum in the near UV such as the optical region between
340 nm to 400 nm I1LC. In addition, a fluorescence peak would be measured in comparison to the absorption
in the optical wavelengths between 450
nm to 550 nm I1LCF.
[0155] A Water Layer where the water absorption is measured in the visible and NIR spectrum
at peaks
730 nm, 820 nm I1LW.
[0156] In at least some embodiments, the tissue image processing host computer system 202
uses the ratios of the optical scattering of the epidermis to that of melanin as a
reference to adjust and normalize the exposure of the subsurface.
[0157] The tissue image processing host computer system 202 can use a normalized ratio of
one known spectral property to another to create a personal optical profile. These
spectral ratios or other ratios can be used as a personal optical profile for each
person.
Morphology Correction
[0158] Correction for correlation of digital images should also include color correction
information in order to establish the border parameters. The tissue borders are often
areas where lesions can be analyzed for changes in tissue that might include fluorescence
and reflection changes. Hence the control of light exposure will have an impact on
the measurement of borders and boundaries which are used in physical size and growth
comparisons.
[0159] The analysis of boarders then can be made by measuring or otherwise determining the
subsurface components of the optical spectral components of the tissue. The amount
of collagen in tissue decreases as tissue becomes neoplastic. Other components such
as NADH increases and changes in blood flow are known to be synonymous with lesions
and serve as excellent markers for lesion boarders.
[0160] Lesion boarders can also be established by comparison of the surface optical spectra
to the subsurface spectra. This further allows for a reference to be used in a timeline.
A numerical index based on the optical characteristics can be established.
[0161] In a multiple image series, normalizing the surface reflection in each digital image
would be achieved by normalizing the color markers. Such allows accurate comparison
of the Epidermal Layer in the visible spectrum of
500 nm to 600
nm I1LE to the Melanin Layer in the spectrum of
300 nm to
500 nm I1LM and comparing and adjusting ratios as required at proximity to lesion site. Subsurface
scatter may be advantageously normalized via measurement or determination of ratios
such as those of hemoglobin / collagen, a relative Hemoglobin Layer where absorption
of oxyhemoglobin peaks at
415 nm I1LH to the Collagen Layer where absorption is between
340 nm to 400 nm I1LC or a fluorescence peak in the optical wavelengths between
450 nm to 550 nm I1LCF and comparison and adjustment of ratios as required at proximity to lesion site border.
[0162] Once the borders spectral distribution has been established, the borders' spectra
can be compared to the surrounding tissue and a lesion map can be generated by visual
analysis or by automated image processing methods or techniques that track the pixel
characteristics in the digital image. The lesion map may be multidimensional and have
reference layers such as surface, sub-surface and other layers or depth characteristics
as may be determined from the spectral analysis, such as areas of molecular activity,
blood flow or tissue density.
[0163] In some cases tissue image processing host computer system 202 may combine the optical
data with spatial data to create true three dimensional digital models of the lesions
or combined with physical anatomical models, for instance in a form of rubber sheeting
to create pseudo three dimensional physical models.
[0164] Growth comparisons are the combination of changes in color and changes in shape.
The color data is either the absolute changes in total color or the variation in the
layers. Either or both can be used to monitor change at any x, y coordinates, or as
a method to reference the changes in a sample such as a cross section and its normalized
spectral distribution.
Combined Methods of Rectification.
[0165] The shape of the fiducial marker 116 (Figures 1 and 2) allows for image rectification,
but the lesion or some area or region of interest 118 in the tissue 102 must be used
to relate images to each other. In some cases, this can be done manually with obvious
image characteristics. In other cases, it can be done automatically (
i.e., computationally by a processor such as a digital microprocessor) by examining areas
within the image layers that have a notable and repeatable spatial and spectral variation
such as the difference between image layer coordinates in a time series:

[0166] Relative spherical and chromatic aberrations can be caused by the optical system
in normal function, or by variance to the conditions or settings used such as excitation
irradiance, focal length and aperture.
[0167] In at least some embodiments, the tissue image processing host computer system 202
performs digital image rectification which converts digital images to a standard coordinate
system for registration and a standardized method of optical correlation. This is
done by matching areas of the tissue 102 (Figures 1 and 2) or the fiducial marker
116 in the source image
I1(
xn,yn) with areas of the tissue 102 or the fiducial marker 116 within the time series images
I1..n(
xn, yn). This process is designed to overcome difficulties in clinical imaging where accuracy
or aberrations in area analysis cannot be well defined, or where the digital images
or layers lack clearly identifiable points with which to correlate between the digital
images. A time sequence of digital images can also be used to correct for distortion
such as variations of optical aberrations in the tissue imaging system 100.
[0168] The shape of the tissue 102 may be rectified with a 3D topographic map of the body
or simulation thereof to compensate for distortion from the tissue topography at the
area or region of interest 118. The geometric correction of digital images requires
calculating the distortion at each pixel or area, and then comparing the digital image
to the proper location in the 3D topographical map. The digital image is registered
when each pixel or area is placed in the correct precise 3D position or location.
The adjustment may also take into consideration the excitation source 106 (Figure
1) and sensor 104 orientations and locations. This method combines 3D model probabilities
with measurements from digital images to provide precise, orthographically correct
coordinate locations. This process registers digital images and areas or regions of
interest 118 from digital images with x, y, and z coordinates. The displacement is
then calculated for each area in the digital image, with variable resolution, and
distortion is removed or measured or otherwise quantified. Multiple digital images
can be analyzed, corrected, and mosaicked all at once by a bundle adjustment, in which
interrelated sets of equations are used to find a globally optimal set of corrections
across all of a number of digital images. Spectral conditions are handled in an analogous
way by correlating light intensities for different color bands and then compensating
for 3D influences of the digital model.
Diagnostic Protocol
[0169] One objective of providing normalized digital images is to enable clinicians to be
able to make diagnostic decisions. Using the ABCD rules as would be considered normal
in dermatology, the tissue imaging and digital image processing system 200 can provide
data that would enable clinicians to interpret the data in a manner that provides
a rapid and consistent method of diagnostic reference. Image morphology data would
be available to automatically update the ABCD protocol with data about asymmetry,
irregularity diameter and supplemental data regarding the evolving nature and form
of and skin lesion.
[0170] In implementations, a vasodilator may be applied to the tissue 102 (
e.g., skin) or taken orally to enable the measurement of changes in blood flow in the tissue,
and to assist in contrast enhancement of the area or region of interest 118.
High Specificity Analysis
[0171] Optical analysis can be used to access the molecular components of tissue and can
be used to characterize the physical changes in tissues. The tissue imaging and digital
image processing system 200 may employ an optical tissue imaging system 100 (Figure
1), which may include a digital camera 104. Such an optical tissue imaging system
100 may employ monochromatic light control structures, for example a grating or band
pass filter, or a series of optical filters. Additionally, or alternatively, the optical
tissue imaging system 100 (Figure 1) may be operated in a controlled environment,
where additional metadata or other information is stored in non-transitory storage
media characterizing the ambient conditions. For example, metadata may characterize
the orientation of the subject tissue to the optical axes, the use or presence of
filters on both the irradiant source excitation and subject radiant emission imaging
axes. In the case where "off the shelf" digital cameras 104 are used, the digital
cameras 104 often have integral filters positioned over the sensor(s) to normalize
the response of the sensor in the visible portion of the electromagnetic spectrum.
In some cases, the visible portion of the electromagnetic spectrum is not desirable
or the use of light in non-visible portions (e.g., UV or NIR) of the electromagnetic
spectrum may advantageously enhance analysis. In this case, the filters could be removed
or omitted to allow the maximum multi-spectral response of the wavelengths of interest.
[0172] In these manners, close control over the optical characteristics of the tissue imaging
system 100 (Figure 1) can be maintained and adjusted, and the tissue image processing
host computer system 202 can be used for higher degrees of specificity than might
otherwise be the case. Optimizing the variable conditions may assist in using the
tissue image processing host computer system 202 for situations typical to clinical
general practice. This could also become typical of a dedicated tissue imaging and
digital image processing system 200 as might be used for colposcopy, dentistry, during
surgery, or for other applications that require a high degree of precision.
Communications
[0173] In practical applications, the tissue imaging system 100 (Figures 1 and 2) and the
tissue image processing host computer 202 (Figure 3) may be remotely located from
one another, for example at different sites or facilities. Communications of digital
images can be made by comparing a series of films and not digital data. This would
require the handling of the physical media, but ideally the communication of images
is shared over a network, for example including the Internet. Digital images can be
transferred from a camera 104 of the tissue imaging system 100 to a tissue image processing
host computer 202 via the Internet and/or some other network(s). For example, digital
images could be attached to an electronic mail message (
i.e., email), or communicatively transferred in an encrypted format, for example via a
Web based server. Various methods of data encryption or decryption may be used to
ensure privacy as would be expected in the handling of medical data. Other methods
could include physically delivering a disk or memory card to an image analysis service.
In some cases the tissue image processing host computer 202 and the tissue imaging
system 100 are in the same location and the tissue image processing host computer
202 would then create a laboratory imaging report 270.
Signal Enhancement
[0174] In a controlled environment, various techniques of signal enhancement can be used
such as pulsed excitation sources 106 (Figure 1) and digital filters (not shown) that
allow for frequency or amplitude modulation or time filtering. For instance, detection
of short time domain fluorescence would require sharp cut off of the excitation source
106. Correlation of triggering of optical excitation source 106 with sensor electronics
allows for the use with frequency or amplitude methods, including electronic methods
such as FM and BPSK or mechanical shutters and choppers. Detection of low light signals
might be further enhanced by measuring and filtering the ambient signal noise.
Probability Index
[0175] In at least some embodiments, the tissue image processing host computer system 202
uses a probability index, which is the combination of distributed properties resulting
from combined probability analysis of one or more variables including normalization,
exposure correction, geometric correlation, color correction, signal to noise characterization
and diagnostic protocols as would be used in a time series.
[0176] This can be applied using multivariate time series analysis techniques such as linear
methods based on correlation functions or spectral decompositions or nonlinear approaches
such as recurrence features and include the determination of heterogeneous data in
subsurface layers, layer matching and morphological image matching.
[0177] Physical means of image correction can also be used to acquire optical metadata prior
to the image acquisition. Optical filters can be used, such as spectral bandpass filters,
polarizer's, or the addition of spectral indices that were created by using a spectrophotometer
can be used to act as digital filters.
[0178] Operation is described below with respect to specific examples. It will be understood
that the following examples are intended to describe various embodiments but are not
intended to limit the embodiments in any way.
EXAMPLES
EXAMPLE 1: NORMALIZATION OF EXCITATION
[0179] In one example, the inclusion of fiducial marker(s) 116 (Figures 1 and 2) in digital
images captured using a digital camera 104 (Figure 1) allows the tissue image processing
host computer 202 (Figure 3) to compensate for variations in apparent optical excitation
such as variations in excitation source to subject distance. The images
I1...n may have been acquired with different digital cameras 104, and/or with variations
in and spatial and spectral sensitivity. Other variations might include distance to
subject, focal length and optical axes. Ideally when digital images are captured,
the excitation source 106 (e.g., flash) should be ON or illuminating the subject tissue
102, the optical normal of both the region of interest (e.g., lesion) and the fiducial
marker 116 should be equal and perpendicular to the optical normal of the digital
camera 104, however, this also must be accounted for. Variations might also be the
result of ambient conditions and poor image quality. The reflection and the backscatter
from the fiducial marker 116 enables the spectral distribution of the entire image
to be registered by the tissue image processing host computer 202.
EXAMPLE 2: REFLECTION VS. BACKSCATTER
[0180] In one example, the tissue image processing host computer 202 (Figure 3) characterizes
the tissue response from various optical layers of tissue 102 (Figures 1 and 2) in
order to be able to differentiate tissue variations that might not be fully visible
to the naked eye. The spectra from two digital images are normalized using the fiducial
marker 116 and/or areas of tissue 102 in some or all digital images where melanin
or hemoglobin spectra appear normal. The spectral distribution is compared between
either the whole digital image or a localized area of the digital image. With the
major spectral components removed that contribute to reflection from the Epidermal
Layer
I1LE, the changes in other optical layers such as Melanin Layer
I1LM, Hemoglobin Layer
I1LH, Collagen Layer
I1LC or
I1LCF can be more easily compared.
EXAMPLE 3: SPATIAL DISTRIBUTION
[0181] In one example, low cost digital cameras 104 (Figure 1) with minimal capacity for
measuring spectral changes but adequate for accessing the shape and color or lesion
borders are employed to capture digital images of the tissue 102. Correlation of digital
images enables a clinician or automated system
(e.g., tissue image processing host computer 202 of Figure 3) to assess if there are morphological
changes. These morphological changes would - subsequently be noted in the ABCD guidance
of tissue evolution. The digital images timeline is corrected based on the fiducial
marker(s) 116 appearing in the source image
I1(xn, y) and the fiducial marker(s) 116 appearing within the time series images
I1..n(xn, yn).
EXAMPLE 4: CONTROLLED LABORATORY SYSTEM AND ANALYSIS
[0182] In one example, a patient specific model generated by a tissue image processing host
computer 202 (Figure 3) allows cross reference between digital images in a timeline
or sequence for the same patient. A useful analysis would determine if there is a
relationship between spectral changes whether or not there has been any noticeable
change in morphology. Once correction has been made for the optical tissue imaging
system 100 (Figure 1), and an image registration has been made, a time series of digital
images can be compared. In an optical tissue imaging system 100 capable of being used
with cut off filters, and with ambient conditions remaining similar, then regions
of interest 118
(e.g., skin lesions) can be measured and a digital record of the digital image and/or measured
information stored for later reference. In a time series of digital images, increases
in NADH fluorescence, decreases of collagen fluorescence, physical scatter of light
from tissue at various physical layers due to tissue density, spectral distribution
due to size of cell nuclei, and changes in hemoglobin absorption due to increased
blood flow or oxygenation may be combined in a diagnostic image layer. In some cases
such digital images and associated information may be used to track tumor formation
or be used as a screening tool.
EXAMPLE 5: SINGLE IMAGE COMPARED TO PHANTOM IMAGE.
[0183] In one example, rather than correcting a single digital image for morphologic changes,
is the digital image is corrected for the digital image's spectral distribution compared
to a tissue phantom. A tissue image processing host computer 202 (Figure 3) breaks
the digital image down into spectral layers. The resulting data is used as an input
to the ABCD rules, where as part of the color analysis, the spectral distribution
is compared to a standard and is reported as variations in the visible, Ultra Violet,
Near Infra Red, with particular notes or emphasis on: any brown or black streaks;
textures variations measured by reflection; and pink or red areas. The phantom image
could be a baseline standard, could be an image taken on the subject in an area where
there is no concern, or could be based on a projection of optical features of a fiducial
marker 116 (Figures 1 and 2).
EXAMPLE 6: CONTRAST AGENT
[0184] In one example, a first digital image is captured before and a second digital image
is captured after the use of a contrast agent such as a dye that combines with protein
or bacteria, and/or after administration of a vasodilator, and/or a biomarker with
a fluorescent marker, and/or acetic acid or water. The first and second digital images
are combined and the difference is used to screen for the tissue or region of interest.
Conclusion
[0185] The above description of illustrated embodiments, including what is described in
the Abstract, is not intended to be exhaustive or to limit the embodiments to the
precise forms disclosed. Although specific embodiments of and examples are described
herein for illustrative purposes, various equivalent modifications can be made without
departing from the spirit and scope of the disclosure, as will be recognized by those
skilled in the relevant art. The teachings provided herein of the various embodiments
can be applied to other systems, not necessarily the exemplary tissue imaging and
digital image processing system generally described above.
[0186] For instance, the systems, devices, and methods described herein may also be applied
to other testing and/or analysis, including testing or analyzing the effect of various
cosmetics or therapeutics on tissue, such as skin, to discern whether such cosmetics
have a beneficial effect. For example, digital images may be captured of a region
of interest (
e.g., proximate the eyes, chin or mouth) both before application of a cosmetic or therapeutic
material or treatment, and following such application or treatment. The tissue image
processing host computer systems may analyze the digital images to assess the effect
of the cosmetic or therapeutic material or treatment on the region of interest. For
example, the tissue image processing host computer systems 202 may determine whether
a level of hydration has been increased, whether a level of blood flow or oxygenation
has increased, whether a total number of wrinkles have decreased, or size of wrinkles
decreased, or whether blemishes have been reduced.
[0187] The system may be used to measure skin health or beauty, including surface and subsurface
layers. For example, the system may be used to measure or otherwise assess a degree
of hydration or a level or rate of blood flow, which could be further compared to
collagen. Alternatively, or additionally, the system may measure or otherwise assess
a total number of wrinkles in a given area and/or size of such wrinkles, and/or a
total number of blemishes in a given area and/or size of such blemishes.
[0188] In particular, the wavelength ratios of the optical layers could be used to characterize
a skin hydration assessment between two images at different times. This could be used
with a fixed optical set up that includes optical excitation sources located at different
fixed angles to better access skin reflection. Such can be measured with either a
physical or projected fiducial marker scatter layer employed. For instance a projected
marker, if it were linear and monochromatic, would have variable scatter along its
axes. The excitation wavelength of this fiducial marker could be varied to include
reference to other optical layers such as the water absorption layer, the hemoglobin
absorption layer, and the collagen absorption layer. If such a linear and monochromatic
fiducial marker were compared over a series or sequence of digital images, the ability
to characterize the skin surface, such as wrinkles, and the skin health such as hydration,
blood flow and collagen, could be visually presented, for example as indices, graphs
or as comparative images.
[0189] Such a system could be used as a standardized approach to determine the health and
beauty impacts of various cosmetics, moisturizers, therapeutic materials, other skin
creams, and/or therapeutic treatments. Such may be advantageously employed in clinical
trials or for use in point of sale retail facilities where an individual's skin could
be assessed and the indices of skin health or beauty could be used for product selection.
Results of such an assessment may be presented in a visual form, for example a display
or printout of indices, graphs or comparative images.
[0190] The foregoing detailed description has set forth various embodiments of the devices
and/or processes via the use of block diagrams, schematics, and examples. Insofar
as such block diagrams, schematics, and examples contain one or more functions and/or
operations, it will be understood by those skilled in the art that each function and/or
operation within such block diagrams, flowcharts, or examples can be implemented,
individually and/or collectively, by a wide range of hardware, software, firmware,
or virtually any combination thereof. The present subject matter may be implemented
via Application Specific Integrated Circuits (ASICs). However, those skilled in the
art will recognize that the embodiments disclosed herein, in whole or in part, can
be equivalently implemented in standard integrated circuits, as one or more computer
programs running on one or more computers (
e.g., as one or more programs running on one or more computer systems), as one or more
programs running on one or more controllers (e.g., microcontrollers) as one or more
programs running on one or more processors (e.g., microprocessors), as firmware, or
as virtually any combination thereof, and that designing the circuitry and/or writing
the code for the software and or firmware would be well within the skill of one of
ordinary skill in the art in light of this disclosure.
[0191] In addition, those skilled in the art will appreciate that the mechanisms taught
herein are capable of being distributed as a program product in a variety of forms,
and that an illustrative embodiment applies equally regardless of the particular type
of nontransitory signal bearing storage media used to actually carry out the distribution.
Examples of nontransitory signal bearing storage media include, but are not limited
to, the following: recordable type media such as floppy disks, hard disk drives, CD
ROMs, digital tape, and computer memory; and other non-transitory computer-readable
storage media.
[0192] The various embodiments described above can be combined to provide further embodiments.
1. A method (900) of operating a system (200) for use in tissue analysis, the method
comprising:
comparing by at least one processor (212) an appearance of at least one shape of a
virtual fiducial marker (804) in a first digital image of a portion of a tissue (102)
to at least one defined actual shape of the virtual fiducial marker (804);
comparing by the at least one processor (212) an appearance of each of a plurality
of sections (A-P) of a physical fiducial marker (700, 802) in the first digital image
to respective ones of defined sections (A-P) of the physical fiducial marker (700,
802), wherein the defined sections (A-P) include a number of tissue phantoms (M-P)
each having a respective spectral characteristic that matches a respective spectral
characteristic of tissue (102) of a type represented in the first digital image; and
at least one of correlating, normalizing (914), or correcting (902; 912) at least
the first digital image, based at least in part on the comparisons;
wherein
the physical fiducial marker (700, 802) includes a scatter layer (504) that overlies
at least some of the tissue phantoms (M-P) and which simulates an optical character
of the type of tissue (102) represented in the first digital image; and
the method further comprises comparing the appearance of the sections which include
the tissue phantoms (M-P) which are overlaid by the scatter layer (504) with a number
of defined sections which include the tissue phantoms (M-P) that are not overlaid
by the scatter layer (504).
2. The method of claim 1:
(a) wherein normalizing (914) includes normalizing a plurality of digital images including
the first digital image by measuring a difference of a spectral distribution between
an optical character of the tissue (102) in combination with the physical fiducial
marker (116; 700), where a monotonicity of a number of defined spectral relationships
is proximate or exceeds a limit of a normal spectral distribution;
(b) wherein normalizing (914) includes normalizing at least the first digital image
based at least in part on a spectral marker of hemoglobin and a spectral marker of
collagen;
(c) generating (928) a digital model that geometrically represents a region of interest
in three dimensions based on spatial and spectral data from the digital images;
(d) wherein correcting (912) includes correcting at least the first digital image
based at least in part on color correction information
3. The method of claim 1, wherein a number of sections (A-P) of the physical fiducial
marker (700, 802) include a respective color including at least one of black, white,
a plurality of different shades of grey, and a plurality of additional colors that
are not black, white or grey, and wherein comparing an appearance of each of a plurality
of sections (A-P) of the physical fiducial marker (700, 804) in the first digital
image to respective ones of defined sections (A-P) of the physical fiducial marker
(700, 802) includes comparing the appearance of the sections (A-P) which include the
respective colors with respective ones of a defined set of respective colors.
4. The method of claim 1, further comprising:
(a) storing to at least one nontransitory storage medium the digital image as a multi-layer
image file, including a first digital image layer that stores and at least a second
digital image layer that stores image metadata;
(b) referencing by the at least one processor at least one of spectral changes or
optical density at specific coordinates in the first digital image to allow later
comparison to changes in a number of subsequent digital images of the region of interest
(118);
(c) comparing by the at least one processor (212) a number of ratios of respective
radiant spectral intensity of a number of wavelengths or wavebands in the first digital
image;
(d) establishing a subject specific baseline by the at least one processor (212) which
is specific to an individual; and wherein the normalizing is based at least in part
on the subject specific baseline the first digital image and a plurality of sequential
digital images, the sequential digital images sequentially captured at various times
following a capture of the first digital image;
(e) generating a probability index (926) by the at least one processor (212) based
on a combination of distributed properties of a number of variables including a normalization,
an exposure correction, a geometric correlation, an optical spectroscopic correction,
a signal to noise characterization, or a defined diagnostic protocol;
(f) registering each of a plurality of digital images of the tissue (102) by the at
least one processor (102), including the first digital image, based at least in part
on a variation between image layer coordinates in a temporal sequence of a plurality
of digital images of the tissue;
(g) generating by the at least one processor an analysis comparison of layers in at
least the first digital image as a histogram; and
(h) generating by the at least one processor a probability distribution of a tissue
being abnormal.
5. The method of claim 4:
(i) wherein step (a) further comprises storing to a diagnostic layer of the digital
image on the nontransitory storage medium information indicative of at least one of
an NADH fluorescence, a collagen fluorescence, a physical scattering of light from
the tissue at a number of physical layers of the tissue due to tissue density, a spectral
distribution due to a size of a cell nuclei, and a hemoglobin absorption due to increased
blood flow or oxygenation;
(ii) wherein step (a) further comprises registering a number of subsequent digital
images in spatial and optical relationship by the at least one processor (212); and
comparing the first and the subsequent digital images on a layer by layer basis by
the at least one processor;
(iii) wherein step (c) further comprises comparing by the at least one processor (212)
a number of ratios of respective radiant spectral intensity of a number of wavelengths
or wavebands in at least one subsequent digital image;
(iv) wherein step (d) further comprises determining a number of differences in the
region of interest (118) as the region of interest (118) appears between the normalized
digital images including the first digital image and the plurality of sequential digital
images, by the at least one processor (212), as part of a tissue analysis; or
(v) wherein step (h) further comprises generating the probability distribution of
the tissue being abnormal based at least in part on a comparison of an optical density
to a percentage of optical spectra that is attributable to collagen.
6. The method of claim 5, wherein determining a number of differences in step (iv) comprises:
(1) determining any morphological changes of the region of interest (118) as the region
of interest (118) appears between the digital images as part of the determination
of the differences in the region of interest (118) as the region of interest (118)
appears between the normalized digital images including the first digital image and
the plurality of sequential digital images;
(2) assessing any change in at least one of a level of skin hydration, a total number
of wrinkles or a size of at least one wrinkle, or a total number of blemishes or a
size of at least one blemish; or
(3) assessing at least one of a level of hydration or a level of blood flow between
the first digital image and at least one subsequent digital image, where the first
digital image represents the region of interest (118) prior to a first application
of a cosmetic, a moisturizer, a therapeutic or a therapeutic treatment and the at
least one subsequent digital mage represents the region of interest (118) after the
first application of the cosmetic, the moisturizer, the therapeutic or the therapeutic
treatment.
7. The method of claim 2:
(i) wherein step (d) further comprises associating at least one of multispectral data
or image timeline data to the digital model that geometrically represents the region
of interest (118) in three dimensions by the at least one processor (212);
(ii) wherein step (d) further comprises rectifying the tissue by the at least one
processor (212) with a three dimensional map of at least a portion of a body which
combines a set of three dimensional model probabilities with a correlation of a set
of coordinate locations, a set of spectral effects and a set of complex interactions;
(iii) wherein step (e) further comprises generating by the at least one processor
(212) a digital multidimensional lesion map (908) that tracks a set of pixel characteristics
in at least the first digital image including at least one of a surface, a sub-surface,
other layers or a depth characteristic of the tissue as determined from a spectral
analysis of the tissue (102) as represented in at least the first digital image.
(iv) wherein step (e) further comprises correcting for spectral effects in the tissue
(102) represented in at least the first digital image which spectral effects are due
to interactions of light absorption, reflectance and fluorescence, and to cross reference
and compare a number of spatial and a number of spectral components specified by at
least one of a digital model of tissue image data or another digital image to generate
the digital three dimensional model of the region of interest.
(v) wherein step (e) further comprises correcting for differences in spatial orientation
of at least one of an excitation axis or an imaging axis of a tissue imaging system
in Cartesian space.
8. A system (200) for use in tissue analysis, the system (200) comprising:
at least one processor (212); and
at least one nontransitory storage medium (214) that stores processor executable instructions
which when executed cause the at least one processor to:
compare an appearance of at least one shape of a virtual fiducial marker (804) in
a first digital image of a portion of a tissue (102) to at least one defined actual
shape of the virtual fiducial marker (804);
compare an appearance of each of a plurality of sections (A-P) of a physical fiducial
marker (700; 802) in the first digital image to respective ones of defined sections
(A-P) of the physical fiducial marker (700; 802), wherein the defined sections (A-P)
include a number of tissue phantoms (M-P) each having a respective spectral characteristic
that matches a respective spectral characteristic of tissue (102) of a type represented
in the first digital image; and
at least one of correlate, normalize (914), or correct (902; 912) at least the first
digital image, based at least in part on the comparisons; wherein
the physical fiducial marker (700; 802) includes a scatter layer (504) that overlies
at least some of the tissue phantoms (M-P) and which simulates an optical character
of the type of tissue (102) represented in the first digital image, and the instructions
cause the at least one processor (212) to compare the appearance of the sections (A-P)
which include the tissue phantoms (M-P) which are overlaid by the scatter layer (504)
with a number of defined sections (A-P) which include the tissue phantoms (M-P) that
are not overlaid by the scatter layer (504; 702a).
9. The system of claim 8:
(a) wherein the instructions further cause the at least one processor (212) to store
the digital image as a multi-layer image file, including a first digital image layer
that stores and at least a second digital image layer that stores image metadata;
(b) wherein the instructions further cause the at least one processor (212) to reference
at least one of spectral changes or optical density at specific coordinates in the
first digital image to allow later comparison to changes in a number of subsequent
digital images of the region of interest (118);
(c) wherein the instructions further cause the at least one processor (212) to compare
a number of ratios of respective radiant spectral intensity of a number of wavelengths
or wavebands in the first digital image;
(d) wherein the instructions further cause the at least one processor (212) to normalize
a plurality of digital images including the first digital image by measuring a difference
of a spectral distribution between an optical character of the tissue (102) in combination
with the physical fiducial marker (700; 802), where a monotonicity of a number of
defined spectral relationships is proximate or exceeds a limit of a normal spectral
distribution;
(e) wherein the instructions further cause the at least one processor (212) to establish
a subject specific baseline which is specific to an individual, and normalize based
at least in part on the subject specific baseline the first digital image and a plurality
of sequential digital images, the sequential digital images sequentially captured
at various times following a capture of the first digital image;
(f) wherein the instructions further cause the at least one processor (212) to normalize
at least the first digital images based at least in part on a spectral marker of hemoglobin
and a spectral marker of collagen;
(g) wherein the instructions further cause the at least one processor (212) to generate
a probability index (926) based on a combination of distributed properties of a number
of variables including a normalization, an exposure correction, a geometric correlation,
an optical spectroscopic correction, a signal to noise characterization, or a defined
diagnostic protocol;
(h) wherein the instructions further cause the at least one processor (212) to generate
a digital model that geometrically represents the region of interest (118) in three
dimensions based on spatial and spectral data from the digital images;
(i) wherein the instructions further cause the at least one processor (212) to correct
at least the first digital image based at least in part on color correction information;
(j) wherein the instructions further cause the at least one processor (212) to perform
a registration (930) on each of a plurality of digital images of the tissue (102),
including the first digital image, based at least in part on a variation between image
layer coordinates in a temporal sequence of a plurality of digital images of the tissue;
(k) wherein the instructions further cause the at least one processor (212) to generate
an analysis comparison of layers in at least the first digital image as a histogram;
(l) wherein the instructions further cause the at least one processor (212) to generate
a probability distribution of a tissue being abnormal; or
(m) wherein the instructions further cause the at least one processor (212) to generate
the abnormal relationship of the images are viewed within a probability index that
weights at least some digital images according to at least one of a diagnostic value
or a comparative amount of change between spectra.
10. The system of claim 9:
(i) wherein a number of sections (A-F) of the physical fiducial marker (700; 802)
comprises a respective color including at least one of black, white, a plurality of
different shades of grey, and a plurality of additional colors that are not black,
white or grey, and the instructions cause the at least one processor to compare the
appearance of the sections (A-F) which include the respective colors with respective
ones of a defined set of respective colors;
(ii) wherein step (a) further comprises the instructions further cause the at least
one processor (212) to store to a diagnostic layer of the digital image information
indicative of at least one of an NADH fluorescence, a collagen fluorescence, a physical
scattering of light from the tissue at a number of physical layers of the tissue due
to tissue density, a spectral distribution due to a size of a cell nuclei, and a hemoglobin
absorption due to increased blood flow or oxygenation
(iii) wherein step (a) further comprises the instructions further cause the at least
one processor (212) to register a number of subsequent digital images in spatial and
optical relationship and to compare the first and the subsequent digital images on
a layer by layer basis;
(iv) wherein step (c) further comprises the instructions further cause the at least
one processor (212) to compare the number of ratios of respective radiant spectral
intensity of the number of wavelengths or wavebands in the first digital image to
a number of ratios of a respective radiant spectral intensity of a number of wavelengths
or wavebands in at least one subsequent digital image;
(v) wherein step (e) further comprises the instructions further cause the at least
one processor (212) to determine differences in the region of interest (118) as the
region of interest (118) appears between the normalized digital images including the
first digital image and the plurality of sequential digital images as part of a analysis;
(vi) wherein step (i) further comprises the instructions further cause the at least
one processor (212) to associate at least one of multispectral data or image timeline
data to the digital model that geometrically represents the region of interest in
three dimension
(vii) wherein step (i) further comprises the instructions further cause the at least
one processor (212) to rectify the tissue with a three dimensional map of at least
a portion of a body which combines a set of three dimensional model probabilities
with a correlation of a set of coordinate locations, a set of spectral effects and
a set of complex interactions;
(viii) wherein step (j) further comprises the instructions further cause the at least
one processor (212) to generate a digital multidimensional lesion map (908) that tracks
a set of pixel characteristics in at least the first digital image including at least
one of a surface, a sub-surface, other layers or a depth characteristic of the tissue
as determined from a spectral analysis of the tissue (102) as represented in at least
the first digital image;
(ix) wherein step (j) further comprises the instructions further cause the at least
one processor (212) to correct for spectral effects in the tissue (102) represented
in at least the first digital image which spectral effects are due to interactions
of light absorption, reflectance and fluorescence, and to cross reference and compare
a number of spatial and a number of spectral components specified by at least one
of a digital model of tissue image data or another digital image to generate the digital
three dimensional model of the region of interest (118);
(x) wherein step (j) further comprises the instructions further cause the at least
one processor (212) to correct for differences in spatial orientation of at least
one of an excitation axis or an imaging axis of a tissue imaging system in Cartesian
space;
(xi) wherein step (m) further comprises the instructions further cause the at least
one processor (212) to generate the probability distribution of the tissue being abnormal
based at least in part on a comparison of an optical density to a percentage of optical
spectra that is attributable to collagen.
11. The system of claim 10, wherein step (v) further comprises:
(1) the instructions further cause the at least one processor (212) to determine morphological
changes of the region of interest as the region of interest (118) appears between
the digital images as part of the determination of the differences in the region of
interest (118) as the region of interest (118) appears between the normalized digital
images including the first digital image and the plurality of sequential digital images;
(2) the instructions cause the at least one processor (212) to determine the number
of differences by assessing any change in at least one of a level of skin hydration,
a total number of wrinkles or a size of at least one wrinkle, or a total number of
blemishes or a size of at least one blemish; or
(3) the instructions cause the at least one processor (212) to determine the number
of differences by assessing at least one of a level of hydration or a level of blood
flow between the first digital image and at least one subsequent digital image, where
the first digital image represents the region of interest prior to a first application
of a cosmetic, a moisturizer, a therapeutic or a therapeutic treatment and the at
least one subsequent digital mage represents the region of interest after the first
application of the cosmetic, the moisturizer, the therapeutic or the therapeutic treatment.
12. A physical fiducial marker (700; 802) for use in tissue imaging, comprising:
a substrate having a defined profile and bearing a plurality of sections (A-P) having
respective wavelength selective absorption, reflectance or florescence characteristic,
at least a first number of the sections (A-F) form a color chart of a plurality of
different colors and at least a second number of the sections (M-P) are optical phantoms
that each have a respective spectral characteristic that matches a respective spectral
characteristic of the tissue (102);
characterized in that the physical fiducial marker (700; 802) further comprises a scatter layer (504) that
overlies at least some but not all of the tissue phantoms (M-P) wherein the scattering
layer has a number of characteristics that simulate a number of optical characteristics
of at least one tissue layer of the tissue.
13. A system (100) to image bodily tissues (102), the system (100) comprising:
a physical fiducial marker (700; 802) of claim 12 selectively positionable at least
proximate a region of interest (118) on a portion of a bodily tissue (102) to be imaged;
at least one light source (106) operable to project a virtual fiducial marker (804)
at least proximate the region of interest (118) on the portion of the bodily tissue
(102) to be imaged, the virtual fiducial marker (804) having a defined profile and
a plurality of defined shapes; and
an image capture device (104) having a field of view (114) and configured to capture
digital images of bodily tissue (102) including the region of interest (118), the
physical fiducial marker (700; 802) and the virtual fiducial marker (804) all encompassed
by the field of view (116) of the image capture device (104).
14. The method (900) of operating a system (200) for use in tissue analysis of claim 1,
the method (900) further comprising:
assessing by at least one processor (212) of the system (200) a change in at least
one of a level of hydration, a level of blood flow, a total number of wrinkles, a
size of at least one wrinkle, a total number of blemishes, or a size of at least one
blemish between a first digital image of a region of interest (118) of a bodily tissue
(102) and at least one subsequent digital image of the region of interest (118) of
the bodily tissue (102), where the first digital image represents the region of interest
(118) prior to a first application of a cosmetic, a moisturizer, a therapeutic or
a therapeutic treatment and the at least one subsequent digital mage represents the
region of interest (118) after the first application of the cosmetic, the moisturizer,
the therapeutic or the therapeutic treatment; and
reporting by the at least one processor (212) of the system (200) the assessed difference
in a visual form.
15. The system (200) for use in tissue analysis of claim 8, the processor (212) being
further configured to:
assess a change in at least one of a level of hydration, a level of blood flow, a
total number of wrinkles, a size of at least one wrinkle, a total number of blemishes,
or a size of at least one blemish between a first digital image of a region of interest
of a bodily tissue and at least one subsequent digital image of the region of interest
(118) of the bodily tissue (102), where the first digital image represents the region
of interest (118) prior to a first application of a cosmetic, a moisturizer, a therapeutic
or a therapeutic treatment and the at least one subsequent digital mage represents
the region of interest (118) after the first application of the cosmetic, the moisturizer,
the therapeutic or the therapeutic treatment; and
report the assessed difference in a visual form.
1. Verfahren (900) zum Betreiben eines Systems (200) zur Nutzung bei einer Gewebeanalyse,
wobei das Verfahren aufweist:
Vergleichen eines Aussehens von mindestens einer Form einer virtuellen Bezugsmarkierung
(804) in einem ersten digitalen Bild von einem Teilbereich eines Gewebes (102) mit
mindestens einer definierten tatsächlichen Form der virtuellen Bezugsmarkierung (804)
mittels mindestens eines Prozessors (212);
Vergleichen eines Aussehens von jedem aus einer Mehrzahl von Bereichen (A-P) einer
physischen Bezugsmarkierung (700, 800) in dem ersten digitalen Bild mit entsprechenden
definierten Bereichen (A-P) der physischen Bezugsmarkierung (700, 800) mittels des
mindestens einen Prozessors (212), wobei die definierten Bereiche (A-P) eine Anzahl
von Gewebephantomen (M-P) aufweisen, wovon jedes eine entsprechende spektrale Charakteristik
aufweist, welche mit der entsprechenden spektralen Charakteristik des Gewebetyps (102)
übereinstimmt, der in dem ersten digitalen Bild repräsentiert ist; und
Korrelieren und/oder Normalisieren (914) und/oder oder Korrigieren (902; 912) von
mindestens dem ersten digitalen Bild zumindest teilweise auf Basis der Vergleiche;
wobei die physische Bezugsmarkierung (700, 802) eine Streuschicht (504) aufweist,
welche mindestens einige der Gewebephantome (M-P) überlagert und welche eine optische
Eigenschaft des Typs des Gewebes (102) simuliert, welches in dem ersten digitalen
Bild repräsentiert ist; und wobei das Verfahren ferner aufweist:
Vergleichen des Aussehens der Bereiche, welche die Gewebephantome (M-P) aufweisen,
die von der Streuschicht (504) überlagert sind, mit einer Anzahl von definierten Bereichen,
welche die Gewebephantome (M-P) aufweisen, die nicht von der Streuschicht (504) überlagert
sind.
2. Verfahren gemäß Anspruch 1:
(a) wobei Normalisieren (914) Normalisieren einer Mehrzahl von digitalen Bildern inklusive
des ersten digitalen Bildes aufweist durch Messen einer Differenz in einer spektralen
Verteilung zwischen einer optischen Eigenschaft des Gewebes (102) in Kombination mit
der physischen Bezugsmarkierung (116; 700), wobei eine Monotonie einer Anzahl von
definierten spektralen Zusammenhängen sich einem Grenzwert einer normalen spektralen
Verteilung annähert oder diesen überschreitet;
(b) wobei Normalisieren (914) Normalisieren von mindestens dem ersten digitalen Bild
aufweist zumindest teilweise basierend auf einer spektralen Markierung von Hämoglobin
und einer spektralen Markierung von Kollagen;
(c) Erzeugen (928) eines digitalen Modells, welches einen Bereich, der von Interesse
ist, in drei Dimensionen repräsentiert basierend auf räumlichen und spektralen Daten
aus den digitalen Bildern;
(d) wobei Korrigieren (912) Korrigieren von mindestens dem ersten digitalen Bild zumindest
teilweise auf Basis von Farbkorrekturinformationen aufweist.
3. Verfahren gemäß Anspruch 1, wobei eine Anzahl von Bereichen (A-P) der physischen Bezugsmarkierung
(700, 800) jeweils eine entsprechende Farbe aufweisen, bei welcher es sich um schwarz
und/oder weiß und/oder eine Vielzahl von unterschiedlichen Tönen von grau und/oder
eine Vielzahl von zusätzlichen Farben handelt, welche nicht schwarz, weiß oder grau
oder sind, und wobei Vergleichen eines Aussehens von jedem aus einer Mehrzahl von
Bereichen (A-P) der physischen Bezugsmarkierung (700, 802) in dem ersten digitalen
Bild mit entsprechenden definierten Bereichen (A-P) der physischen Bezugsmarkierung
(700, 802) ein Vergleichen des Aussehens von Bereichen (A-P), welche die entsprechenden
Farben aufweisen, mit entsprechenden Farben aus einer definierten Menge von entsprechenden
Farben aufweist.
4. Verfahren gemäß Anspruch 1, ferner aufweisend:
(a) Speichern der digitalen Bilder auf mindestens einem nichtflüchtigen Speichermedium
als eine Bilddatei mit mehreren Ebenen, aufweisend eine erste digitale Bildebene,
welche speichert, und mindestens eine zweite digitale Bildebene, welche Bild-Metadaten
speichert;
(b) Referenzieren mittels des mindestens einen Prozessors (112) eine spektrale Veränderung
und/oder eine optische Dichte an spezifischen Koordinaten in dem ersten digitalen
Bild, um einen späteren Vergleich mit Veränderungen in einer Anzahl von folgenden
digitalen Bildern des Bereiches, der von Interesse ist (118), zu ermöglichen;
(c) Vergleichen mittels des mindestens einen Prozessors (212) eine Anzahl von Verhältnissen
von entsprechenden spektralen Strahlungsintensitäten von einer Anzahl von Wellenlängen
oder Wellenlängenbereichen in dem ersten digitalen Bild;
(d) Bestimmen einer spezifischen Basislinie mittels des mindestens einen Prozessors
(212), welche für ein Individuum spezifisch ist; und wobei das Normalisieren zumindest
teilweise auf Basis der spezifischen Basislinie in dem ersten digitalen Bild und einer
Anzahl von aufeinanderfolgenden digitalen Bildern erfolgt, wobei die aufeinanderfolgenden
Bilder aufeinanderfolgend zu verschiedenen Zeitpunkten nach Aufnahme des ersten digitalen
Bildes aufgenommen worden sind;
(e) Erzeugen eines Wahrscheinlichkeitsindex (926) mittels des mindestens einen Prozessors
(212) basierend auf einer Kombination von verteilten Eigenschaften einer Anzahl von
Variablen umfassend eine Normalisierung, eine Belichtungskorrektur, eine geometrische
Korrelation, eine optische spektroskopische Korrelation, eine Signal-Rausch-Charakterisierung
oder ein definiertes diagnostisches Protokoll;
(f) Registrieren jedes aus einer Mehrzahl von digitalen Bildern des Gewebes (102)
mittels des mindestens einen Prozessors (212), einschließlich des ersten digitalen
Bildes, zumindest teilweise basierend auf einer Variation zwischen Bildebenen-Koordinaten
in einer zeitlichen Sequenz einer Mehrzahl von digitalen Bildern des Gewebes;
(g) Erzeugen eines Analysevergleiches von Ebenen zumindest in dem ersten digitalen
Bild als ein Histogramm mittels des mindestens einen Prozessors (212); und
(h) Erzeugen einer Wahrscheinlichkeitsverteilung dafür, dass ein Gewebes abnormal
ist, mittels des mindestens einen Prozessors (212).
5. Verfahren gemäß Anspruch 4:
(i) wobei Schritt (a) ferner Abspeichern von Informationen in eine Diagnostikebene
des digitalen Bildes auf dem nichtflüchtigen Speichermedium aufweist, welche indikativ
sind für eine NADH-Fluoreszenz und/oder eine Kollagen-Fluoreszenz und/oder eine physikalische
Streuung von Licht an einer Anzahl von physischen Schichten des Gewebes aufgrund von
Gewebedichte und/oder eine Spektralverteilung aufgrund von einer Größe eines Zellkerns
und/oder eine Hämoglobin-Absorption aufgrund von erhöhtem Blutfluss oder Oxigenierung;
(ii) wobei Schritt (a) ferner Registrieren einer Anzahl von nachfolgenden digitalen
Bildern in einer räumlichen oder optischen Beziehung zueinander mittels des mindestens
einen Prozessors (212) aufweist; und Vergleichen des ersten und der nachfolgenden
digitalen Bilder Ebene für Ebene mittels des mindestens einen Prozessors (212);
(iii) wobei Schritt (c) ferner Vergleichen einer Anzahl von Verhältnissen von entsprechenden
spektralen Strahlungsintensitäten von einer Anzahl von Wellenlängen oder Wellenlängenbereichen
in mindestens einem nachfolgenden digitalen Bild aufweist;
(iv) wobei Schritt (d) ferner Bestimmen einer Anzahl von Unterschieden in dem Bereich
(118), welcher von Interesse ist, mittels des mindestens einen Prozessors (112) aufweist
während der Bereich (118) zwischen den normalisierten digitalen Bildern erscheint,
welche das erste digitale Bild und die Mehrzahl von nachfolgenden digitalen Bildern
aufweisen, als ein Teil einer Gewebeanalyse;
(v) wobei Schritt (h) ferner Erzeugen der Wahrscheinlichkeitsverteilung aufweist dafür,
dass das Gewebe abnormal ist, zumindest teilweise auf einem Vergleich einer optischen
Dichte mit einer Prozentzahl des optischen Spektrums basierend, welches Kollagen zugeordnet
werden kann.
6. Verfahren gemäß Anspruch 5, wobei Bestimmen einer Anzahl von Unterschieden in Schritt
(iv) aufweist:(1) Bestimmen von jeglichen morphologischen Änderungen des Bereiches
(118), welcher von Interesse ist, während dieser Bereich (118) zwischen den digitalen
Bildern erscheint als ein Teil der Bestimmung der Unterschiede in dem Bereich (118),
welcher von Interesse ist, während dieser Bereich (118) zwischen den normalisierten
digitalen Bildern erscheint, welche das erste digitale Bild und die Mehrzahl von nachfolgenden
digitalen Bildern aufweisen;
(2) Beurteilen jeglicher Veränderungen bei Hautfeuchtegrad und/oder bei einer Gesamtzahl
von Falten oder einer Größe von mindestens einer Falte und/oder bei einer Gesamtzahl
von Hautmakel oder einer Größe von mindestens einem Hautmakel;
(3) Beurteilen eines Hautfeuchtegrades und/oder eines Blutflussgrades zwischen dem
ersten digitalen Bild und zumindest einem nachfolgenden digitalen Bild, wobei das
erste digitale Bild den Bereich (118), welcher von Interesse ist, vor der Anwendung
eines Kosmetikums, einer Feuchtigkeitscreme, eines Therapeutikums oder einer therapeutischen
Behandlung repräsentiert und das mindestens eine nachfolgende digitale Bild den Bereich
(118), der von Interesse ist, nach der Anwendung eines ersten Kosmetikums, einer Feuchtigkeitscreme,
eines Therapeutikums oder einer therapeutischen Behandlung repräsentiert.
7. Das Verfahren gemäß Anspruch 2:
(i) wobei Schritt (d) ferner Assoziieren von multispektralen Daten und/oder Bildzeitstrahldaten
mit dem digitalen Modell, welches den Bereich (118), welcher von Interesse ist, geometrisch
in drei Dimensionen repräsentiert, mittels des mindestens einen Prozessors (212);
(ii) wobei Schritt (d) ferner Berichtigen des Gewebes mittels des mindestens einen
Prozessors (212) aufweist mit einer dreidimensionalen Karte von mindestens einem Teilbereich
des Körpers, welche eine Menge von dreidimensionalen Modellwahrscheinlichkeiten mit
einer Korrelation einer Menge von Ortskoordinaten, einer Menge von Spektraleffekten
und einer Menge von komplexen Interaktionen verknüpft;
(iii) wobei Schritt (e) ferner Erzeugen einer digitalen multidimensionalen Läsionskarte
(908) aufweist mittels des mindestens einen Prozessors (212), welche eine Menge von
Pixelcharakteristika, aufweisend eine Oberfläche und/oder Sub-Oberfläche, andere Ebenen
oder eine Tiefencharakteristik des Gewebes durch eine Spektralanalyse des mindestens
in dem ersten digitalen Bild repräsentierten Gewebes (102) bestimmt, mindestens in
dem ersten digitalen Bild nachverfolgt;
(iv) wobei Schritt (e) ferner Korrigieren von Spektraleffekten im Gewebe (102) aufweist,
welches in dem mindestens ersten digitalen Bild repräsentiert ist, wobei die Spektraleffekte
bedingt sind durch Interaktionen wie Lichtabsorption, Reflexion und Fluoreszenz, und
Vergleichen und Querverweisbildung zwischen einer Anzahl von räumlichen und einer
Anzahl von spektralen Komponenten aufweist, welche durch ein digitales Modell von
Gewebebilddaten oder ein anderes digitales Bild bestimmt sind, um ein digitales dreidimensionales
Modell des Bereiches (118) zu bilden, welcher von Interesse ist;
(v) wobei Schritt (e) ferner Korrigieren von Unterschieden bei einer räumlichen Orientierung
von einer Anregungsachse und/oder einer Abbildungsachse eines Gewebeabbildungssystems
im kartesischen Raum aufweist.
8. Ein System (200) zur Nutzung bei einer Gewebeanalyse, wobei das System (200) aufweist:
mindestens einen Prozessor (212); und
mindestens ein nichtflüchtiges Speichermedium (214), in welchem prozessorausführbare
Anweisungen gespeichert sind, welche bei ihrer Ausführung bewirken, dass der Prozessor
die folgenden Schritte ausführt:
Vergleichen eines Aussehens von mindestens einer Form einer virtuellen Bezugsmarkierung
(804) in einem ersten digitalen Bild von einem Teilbereich eines Gewebes (102) mit
mindestens einer definierten tatsächlichen Form der virtuellen Bezugsmarkierung (804)
;
Vergleichen eines Aussehens von jedem aus einer Mehrzahl von Bereichen (A-P) einer
physischen Bezugsmarkierung (700, 800) in dem ersten digitalen Bild mit entsprechenden
definierten Bereichen (A-P) der physischen Bezugsmarkierung (700, 800), wobei die
definierten Bereiche (A-P) eine Anzahl von Gewebephantomen (M-P) aufweisen, wovon
jedes eine entsprechende spektrale Charakteristik aufweist, welche mit der entsprechenden
spektralen Charakteristik des Typs des Gewebes (102) übereinstimmt, welches in dem
ersten digitalen Bild repräsentiert ist; und
Korrelieren und/oder Normalisieren (914) und/oder oder Korrigieren (902; 912) von
mindestens dem ersten digitalen Bild zumindest teilweise auf Basis der Vergleiche;
wobei die physische Bezugsmarkierung (700, 802) eine Streuschicht (504) aufweist,
welche mindestens einige der Gewebephantome (M-P) überlagert und welche eine optische
Eigenschaft des Typs des Gewebes (102) simuliert, welches in dem ersten digitalen
Bild repräsentiert ist; und die Anweisungen bewirken ferner, dass der mindestens eine
Prozessor (212) das Aussehen der Bereiche (A-P), welche die Gewebephantome (M-P) aufweisen,
die von der Streuschicht (504) überlagerst sind, mit einer Anzahl von definierten
Bereichen (A-P) vergleicht, welche die Gewebephantome (M-P) aufweisen, die nicht von
der Streuschicht (504, 702a) überlagert sind.
9. System gemäß Anspruch 8:
(a) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
das digitale Bild als Bilddatei mit mehreren Ebenen speichert aufweisend eine erste
digitale Bildebene, welche speichert, und eine zweite digitale Bildebene, welche Bildmetadaten
speichert;
(b) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
spektrale Änderungen und/oder optische Dichte bei spezifischen Koordinaten in dem
ersten digitalen Bild referenziert, so dass ein späterer Vergleich mit Änderungen
von dem Bereich (118), der von Interesse ist, in einer Anzahl von nachfolgenden digitalen
Bildern ermöglicht wird;
(c) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
eine Anzahl von Verhältnissen von entsprechenden spektralen Strahlungsintensitäten
von einer Anzahl von Wellenlängen oder Wellenlängenbereichen in dem ersten digitalen
Bild vergleicht;
(d) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
eine Mehrzahl von digitalen Bildern normalisiert, welche das erste digitale Bild aufweisen,
durch Messen eines Unterschiedes bei einer spektralen Verteilung zwischen optischen
Eigenschaften des Gewebes (102) in Kombination mit der physischen Bezugsmarkierung
(700; 802), wobei eine Monotonie einer Anzahl von definierten spektralen Zusammenhängen
nahe an einer Grenze einer normalen Spektralverteilung liegt oder diese überschreitet;
(e) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
eine spezifischen Basislinie bestimmt, welche für ein Individuum spezifisch ist, und
zumindest teilweise auf Basis der spezifischen Basislinie in dem ersten digitalen
Bild und einer Anzahl von aufeinanderfolgenden digitalen Bildern normalisiert, wobei
die aufeinanderfolgenden Bilder aufeinanderfolgend zu verschiedenen Zeitpunkten nach
Aufnahme des ersten digitalen Bildes aufgenommen worden sind;
(f) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
zumindest das erste digitale Bild normalisiert zumindest teilweise auf Basis eines
Spektralmarkers von Hämoglobin und eines Spektralmarkers von Kollagen;
(g) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
einen Wahrscheinlichkeitsindex (926) erzeugt basierend auf einer Kombination von verteilten
Eigenschaften einer Anzahl von Variablen umfassend eine Normalisierung, eine Belichtungskorrektur,
eine geometrische Korrelation, eine optische spektroskopische Korrelation, eine Signal-Rausch-Charakterisierung
oder ein definiertes diagnostisches Protokoll;
(h) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
ein digitales Modell erzeugt, welches den Bereich (118), welcher von Interesse ist,
in drei Dimensionen geometrisch modelliert, basierend auf räumlichen und spektralen
Daten aus dem digitalen Prozess;
(i) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
mindestens das erste digitale Bild korrigiert zumindest teilweise basierend auf Farbkorrekturinformationen;
(j) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
eine Registrierung (930) auf jedem aus einer Mehrzahl von digitalen Bildern des Gewebes
(102) durchführt, einschließlich des ersten digitalen Bildes, zumindest teilweise
basierend auf einer Variation zwischen Bildebenen-Koordinaten in einer zeitlichen
Sequenz einer Mehrzahl von digitalen Bildern des Gewebes;
(k) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
zumindest in dem ersten digitalen Bild einen Analysevergleich von Ebenen als ein Histogramm
erzeugt;
(l) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
eine Wahrscheinlichkeitsverteilung dafür erzeugt, dass das Gewebe abnormal ist; oder
(m) wobei die Anweisungen ferner bewirken, dass der mindestens eine Prozessor (212)
die Abnormalitätsbeziehung der Bilder erzeugt, welche innerhalb eines Wahrscheinlichkeitsindex
betrachtet werden, welcher zumindest einige digitale Bilder gemäß einem diagnostischen
Wert und/oder einer komparativen Größe der Änderung zwischen den Spektren gewichtet.
10. System gemäß Anspruch 9:
(i) wobei eine Anzahl von Bereichen (A-P) der physischen Bezugsmarkierung (700, 802)
jeweils eine entsprechende Farbe aufweist, bei welcher es sich um schwarz und/oder
weiß und/oder eine Vielzahl von unterschiedlichen Tönen von grau und/oder eine Vielzahl
von zusätzlichen Farben handelt, welche nicht schwarz, weiß oder grau oder sind, und
wobei die Anweisungen bewirken, dass der mindestens eine Prozessor (212) das Aussehen
der Bereiche (A-F), welche die entsprechenden Farben aufweisen, mit entsprechenden
Farben aus einer definierten Menge von entsprechenden Farben vergleicht;
(ii) wobei Schritt (a) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) Informationen in eine Diagnostikebene des digitalen Bildes speichert,
welche indikativ sind für eine NADH-Fluoreszenz und/oder eine Kollagen-Fluoreszenz
und/oder eine physikalische Streuung von Licht an einer Anzahl von physischen Schichten
des Gewebes aufgrund von Gewebedichte und/oder eine Spektralverteilung aufgrund von
einer Größe eines Zellkerns und/oder eine Hämoglobin-Absorption aufgrund von erhöhtem
Blutfluss oder Oxigenierung;
(iii) wobei Schritt (a) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) eine Anzahl von nachfolgenden Bildern registriert in einer räumlichen
und spektralen Beziehung zueinander und das erste und das nachfolgende Bild Ebene
für Ebene vergleicht;
(iv) wobei Schritt (c) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) die Anzahl von Verhältnissen von entsprechenden spektralen Strahlungsintensitäten
von der Anzahl von Wellenlängen oder Wellenlängenbereichen in dem ersten digitalen
Bild mit einer Anzahl von Verhältnissen von entsprechenden spektralen Strahlungsintensitäten
von einer Anzahl von Wellenlängen oder Wellenlängenbändern in mindestens einem nachfolgenden
digitalen Bild vergleicht;
(v) wobei Schritt (c) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) Unterschiede in dem Bereich (118), welcher von Interesse ist,
bestimmt während der Bereich (118), welcher von Interesse ist, zwischen den normalisierten
digitalen Bildern erschein, welche das erste digitale Bild und die Mehrzahl von nachfolgenden
digitalen Bildern aufweisen, als ein Teil einer Gewebeanalyse;
(vi) wobei Schritt (i) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) multispektrale Daten und/oder Bildzeitstrahldaten mit dem digitalen
Modell assoziiert, welches den Bereich (118), welcher von Interesse ist, geometrisch
in drei Dimensionen repräsentiert;
(vii) wobei Schritt (i) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) das Gewebe mit einer dreidimensionalen Karte von mindestens einem
Teilbereich des Körpers berichtigt, welche eine Menge von dreidimensionalen Modellwahrscheinlichkeiten
mit einer Korrelation zwischen einer Menge von Ortskoordinaten, einer Menge von Spektraleffekten
und einer Menge von komplexen Interaktionen verknüpft;
(viii) wobei Schritt (j) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) eine digitale multidimensionale Läsionskarte (908) erzeugt, welche
eine Menge von Pixelcharakteristika mindestens in dem ersten digitalen Bild nachverfolgt
aufweisend eine Oberfläche und/oder eine Sub-Oberfläche, andere Ebenen oder eine Tiefencharakteristik
des Gewebes, durch eine Spektralanalyse des mindestens in dem ersten digitalen Bild
repräsentierten Gewebes (102) bestimmt;
(ix) wobei Schritt (j) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) Spektraleffekte im Gewebe (102) korrigiert, welches in dem mindestens
ersten digitalen Bild repräsentiert ist, wobei die Spektraleffekte bedingt sind durch
Interaktionen wie Lichtabsorption, Reflexion und Fluoreszenz, und zwischen einer Anzahl
von räumlichen und einer Anzahl von spektralen Komponenten Querverweise bildet und
sie vergleicht, welche durch ein digitales Modell von Gewebebilddaten oder durch ein
anderes digitales Bild bestimmt sind, um ein digitales dreidimensionales Modell des
Bereiches (118) zu bilden, welcher von Interesse ist;
(x) wobei Schritt (j) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) Unterschiede bei einer räumlichen Orientierung von einer Anregungsachse
und/oder einer Abbildungsachse eines Gewebeabbildungssystems im kartesischen Raum
korrigiert;
(xi) wobei Schritt (m) ferner Anweisungen aufweist, die bewirken, dass der mindestens
eine Prozessor (212) eine Wahrscheinlichkeitsverteilung dafür erzeugt, dass das Gewebe
abnormal ist, zumindest teilweise auf einem Vergleich einer optischen Dichte mit einer
Prozentzahl des optischen Spektrums basierend, welches Kollagen zugeordnet werden
kann.
11. System gemäß Anspruch 10, wobei der Schritt (v) ferner aufweist:
(1) Anweisungen die bewirken, dass der mindestens eine Prozessor (212) ferner morphologische
Änderungen des Bereiches (118) bestimmt, welcher von Interesse ist, während dieser
Bereich (118) zwischen den digitalen Bildern erscheint als ein Teil der Bestimmung
der Unterschiede in dem Bereich (118), welcher von Interesse ist, während dieser Bereich
(118) zwischen den normalisierten digitalen Bildern erscheint, welche das erste digitale
Bild und die Mehrzahl von nachfolgenden digitalen Bildern aufweisen;
(2) Anweisungen die bewirken, dass der mindestens eine Prozessor (212) ferner die
Anzahl von Unterschieden bestimmt durch Beurteilen jeglicher Veränderungen bei Hautfeuchtegrad
und/oder bei einer Gesamtzahl von Falten oder einer Größe von mindestens einer Falte
und/oder bei einer Gesamtzahl von Hautmakel oder einer Größe von mindestens einem
Hautmakel;
(3) Anweisungen die bewirken, dass der mindestens eine Prozessor (212) ferner die
Anzahl von Unterschieden bestimmt durch Beurteilen eines Hautfeuchtegrades und/oder
eines Blutflussgrades zwischen dem ersten digitalen Bild und zumindest einem nachfolgenden
digitalen Bild, wobei das erste digitale Bild den Bereich (118), welcher von Interesse
ist, vor der Anwendung eines Kosmetikums, einer Feuchtigkeitscreme, eines Therapeutikums
oder einer therapeutischen Behandlung repräsentiert und das mindestens eine nachfolgende
digitale Bild den Bereich (118), der von Interesse ist, nach der Anwendung eines ersten
Kosmetikums, einer Feuchtigkeitscreme, eines Therapeutikums oder einer therapeutischen
Behandlung repräsentiert.
12. Eine physikalische Bezugsmarkierung (700; 802) zur Nutzung bei einer Gewebeanalyse;
aufweisend:
ein Substrat mit einem definierten Profil und einer Anzahl von Bereichen (A-P), welche
entsprechende wellenlängenselektive Absorptions-, Reflexions- oder Fluoreszenzcharakteristika
aufweisen, wobei eine erste Anzahl von Bereichen (A-F) ein Farbdiagramm ausbildet
mit einer Mehrzahl unterschiedlicher Farben und mindestens eine zweite Anzahl von
Bereichen (M-P) optische Phantome sind, wovon jedes eine entsprechende spektrale Charakteristik
aufweist, welche mit einer entsprechenden spektralen Charakteristik des Gewebes (102)
übereinstimmt;
dadurch gekennzeichnet, dass die physikalische Bezugsmarkierung (700; 802) ferner eine Streuschicht (504) aufweist,
welche zumindest einige aber nicht alle der Gewebephantome (M-P) überlagert, wobei
die Streuschicht (504) eine Anzahl von Eigenschaften aufweist, welche eine Anzahl
von optischen Eigenschaften von mindestens einer Gewebeschicht des Gewebes simulieren.
13. System (100) zum Abbilden von Körpergeweben (102), wobei das System (100) aufweist:
eine physikalische Bezugsmarkierung (700; 802) gemäß Anspruch 12, welche selektiv
zumindest in der Nähe eines Bereiches (118),welcher von Interesse ist, auf einem Teilbereich
eines abzubildenden Körpergewebes positionierbar ist;
mindestens eine Lichtquelle (106), betriebsbereit zum Projizieren einer virtuellen
Bezugsmarkierung zumindest in die Nähe eines Bereiches (118),welcher von Interesse
ist, auf einem Teilbereich eines abzubildenden Körpergewebes, wobei die virtuelle
Bezugsmarkierung (804) ein definiertes Profil und eine Mehrzahl von definierten Formen
aufweist; und
eine Bildaufnahmeeinrichtung (104), welche ein Sichtfeld (114) aufweist und eingerichtet
ist digitale Bilder vom Körpergewebe (120) aufzunehmen, einschließlich des Bereiches
(118), welcher von Interesse ist, wobei die physische Bezugsmarkierung (700; 802)
und die virtuelle Bezugsmarkierung (804) zusammen vom Sichtfeld (116) der Bildaufnahmeeinrichtung
(104) umfasst sind.
14. Verfahren (900) zum Betreiben eines Systems (200) zur Nutzung bei einer Gewebeanalyse
gemäß Anspruch 1, wobei das Verfahren (900) ferner umfasst:
Beurteilen mittels des mindestens einen Prozessors (212) des Systems (200) eine Veränderung
bei einem Hautfeuchtegrad und/oder einem Durchblutungsgrad und/oder einer Gesamtzahl
von Falten und/oder einer Größe von mindestens einer Falte und/oder einer Gesamtzahl
von Hautmakeln und/oder einer Größe von mindestens einem Hautmakel zwischen einem
ersten digitalen Bild eines Bereiches (118), welcher von Interesse ist, von einem
Körpergewebe (102) und zumindest einem nachfolgenden digitalen Bild des Bereiches
(118), welcher von Interesse ist, von dem Körpergewebe (102), wobei das erste digitale
Bild den Bereich (118), welcher von Interesse ist, vor der Anwendung eines Kosmetikums,
einer Feuchtigkeitscreme, eines Therapeutikums oder einer therapeutischen Behandlung
repräsentiert und das mindestens eine nachfolgende digitale Bild den Bereich (118),
der von Interesse ist, nach der Anwendung eines ersten Kosmetikums, einer Feuchtigkeitscreme,
eines Therapeutikums oder einer therapeutischen Behandlung repräsentiert.
15. System (200) zur Nutzung bei einer Gewebeanalyse gemäß Anspruch 8, wobei der Prozessor
(212) ferner eingerichtet ist zum:
Beurteilen einer Veränderung bei einem Hautfeuchtegrad und/oder einem Durchblutungsgrad
und/oder einer Gesamtzahl von Falten und/oder einer Größe von mindestens einer Falte
und/oder einer Gesamtzahl von Hautmakeln und/oder einer Größe von mindestens einem
Hautmakel zwischen einem ersten digitalen Bild eines Bereiches (118), welcher von
Interesse ist, von einem Körpergewebe (102) und zumindest einem nachfolgenden digitalen
Bild des Bereiches (118), welcher von Interesse ist, von dem Körpergewebe (102), wobei
das erste digitale Bild den Bereich (118), welcher von Interesse ist, vor der Anwendung
eines Kosmetikums, einer Feuchtigkeitscreme, eines Therapeutikums oder einer therapeutischen
Behandlung repräsentiert und das mindestens eine nachfolgende digitale Bild den Bereich
(118), der von Interesse ist, nach der Anwendung eines ersten Kosmetikums, einer Feuchtigkeitscreme,
eines Therapeutikums oder einer therapeutischen Behandlung repräsentiert; und
Berichten des beurteilten Unterschiedes in einer visuellen Form.
1. Procédé (900) d'opération d'un système (200) destiné à être utilisé dans l'analyse
de tissu, le procédé comprenant :
comparer par au moins un processeur (212) une apparence d'au moins une forme d'un
trait de repère virtuel (804) dans une première image numérique d'une portion d'un
tissu (102) à au moins une forme réelle définie du trait de repère virtuel (804) ;
comparer par l'au moins un processeur (212) une apparence de chacune d'une pluralité
de sections (A à P) d'un trait de repère physique (700, 802) dans la première image
numérique à des sections respectives de sections définies (A à P) du trait de repère
physique (700, 802), dans lequel les sections définies (A à P) incluent un certain
nombre de fantômes de tissu (M à P) ayant chacun une caractéristique spectrale respective
qui correspond à une caractéristique spectrale respective de tissu (102) d'un type
représenté dans la première image numérique ; et au moins une action parmi mettre
en corrélation, normaliser (914) ou corriger (902 ; 912) au moins la première image
numérique en fonction au moins en partie des comparaisons ;
dans lequel
le trait de repère physique (700, 802) inclut une couche de dispersion (504) qui recouvre
au moins certains des fantômes de tissu (M à P) et qui simule un caractère optique
du type de tissu (102) représenté dans la première image numérique ; et
le procédé comprend en outre comparer l'apparence des sections qui incluent les fantômes
de tissu (M à P) qui sont recouverts par la couche de dispersion (504) à un certain
nombre de sections définies qui incluent les fantômes de tissu (M à P) qui ne sont
pas recouverts par la couche de dispersion (504).
2. Procédé selon la revendication 1 :
(a) dans lequel normaliser (914) inclut normaliser une pluralité d'images numériques
incluant la première image numérique en mesurant une différence d'une distribution
spectrale entre un caractère optique du tissu (102) en combinaison avec le trait de
repère physique (116 ; 700), où une monotonicité d'un certain nombre de relations
spectrales définies est proche de ou dépasse une limite d'une distribution spectrale
normale ;
(b) dans lequel normaliser (914) inclut normaliser au moins la première image numérique
en fonction au moins en partie d'un marqueur spectral d'hémoglobine et d'un marqueur
spectral de collagène ;
(c) générer (928) un modèle numérique qui représente géométriquement une région pertinente
en trois dimensions en fonction de données spatiales et spectrales provenant des images
numériques ;
(d) dans lequel corriger (912) inclut corriger au moins la première image numérique
en fonction au moins en partie d'informations de correction de couleur.
3. Procédé selon la revendication 1, dans lequel un certain nombre de sections (A à P)
du trait de repère physique (700, 802) incluent une couleur respective incluant au
moins une parmi noir, blanc, une pluralité de différentes nuances de gris et une pluralité
de couleurs supplémentaires qui ne sont pas noir, blanc ou gris, et dans lequel comparer
une apparence de chacune d'une pluralité de sections (A à P) du trait de repère physique
(700, 802) dans la première image numérique à des sections respectives de sections
définies (A à P) du trait de repère physique (700, 802) inclut comparer l'apparence
des sections (A à P) qui incluent les couleurs respectives à des sections respectives
d'un ensemble défini de couleurs respectives.
4. Procédé selon la revendication 1, comprenant en outre :
(a) stocker sur au moins un support de stockage non transitoire l'image numérique
comme fichier d'image multicouche, incluant une première couche d'image numérique
qui stocke et au moins une seconde couche d'image numérique qui stocke des métadonnées
d'image ;
(b) référencer par l'au moins un processeur au moins un élément parmi des changements
spectraux ou une densité optique à des coordonnées spécifiques dans la première image
numérique pour permettre une comparaison ultérieure à des changements dans un certain
nombre d'images numériques subséquentes de la région pertinente (118) ;
(c) comparer par l'au moins un processeur (212) un certain nombre de rapports d'intensité
spectrale radiante respective d'un certain nombre de longueurs d'onde ou gammes d'ondes
dans la première image numérique ;
(d) établir une ligne de base spécifique à un sujet par l'au moins un processeur (212)
qui est spécifique à un individu ; et dans lequel la normalisation se base au moins
en partie sur la ligne de base spécifique à un sujet, la première image numérique
et une pluralité d'images numériques séquentielles, les images numériques séquentielles
étant capturées de manière séquentielle à divers moments suite à une capture de la
première image numérique ;
(e) générer un indice de probabilité (926) par l'au moins un processeur (212) en fonction
d'une combinaison de propriétés distribuées d'un certain nombre de variables incluant
une normalisation, une correction d'exposition, une corrélation géométrique, une correction
spectroscopique optique, une caractérisation de signal sur bruit ou un protocole diagnostique
défini ;
(f) enregistrer chacune d'une pluralité d'images numériques du tissu (102) par l'au
moins un processeur (212), incluant la première image numérique, en fonction au moins
en partie d'une variation entre des coordonnées de couche d'image dans une séquence
temporelle d'une pluralité d'images numériques du tissu ;
(g) générer par l'au moins un processeur une comparaison d'analyse de couches dans
au moins la première image numérique comme histogramme ; et
(h) générer par l'au moins un processeur une distribution de probabilités d'un tissu
qui est anormal.
5. Procédé selon la revendication 4 :
(i) dans lequel l'étape (a) comprend en outre stocker sur une couche diagnostique
de l'image numérique sur le support de stockage non transitoire des informations indicatrices
d'au moins un élément parmi une fluorescence NADH, une fluorescence au collagène,
une dispersion physique de lumière depuis le tissu au niveau d'un certain nombre de
couches physiques du tissu en raison de la densité du tissu, une distribution spectrale
en raison d'une taille d'un noyau cellulaire et d'une absorption d'hémoglobine en
raison d'un flux sanguin ou d'une oxygénation accru(e) ;
(ii) dans lequel l'étape (a) comprend en outre enregistrer un certain nombre d'images
numériques subséquentes en relation spatiale et optique par l'au moins un processeur
(212) ; et comparer la première et les images numériques subséquentes couche par couche
par l'au moins un processeur ;
(iii) dans lequel l'étape (c) comprend en outre comparer par l'au moins un processeur
(212) un certain nombre de rapports d'intensité spectrale radiante respective d'un
certain nombre de longueurs d'onde ou gammes d'ondes dans au moins une image numérique
subséquente ;
(iv) dans lequel l'étape (d) comprend en outre déterminer un certain nombre de différences
dans la région pertinente (118) alors que la région pertinente (118) apparaît entre
les images numériques normalisées incluant la première image numérique et la pluralité
d'images numériques séquentielles, par l'au moins un processeur (212), dans le cadre
d'une analyse de tissu ; ou
(v) dans lequel l'étape (h) comprend en outre générer la distribution de probabilités
du tissu qui est anormal en fonction au moins en partie d'une comparaison d'une densité
optique à un pourcentage de spectres optiques qui est attribuable à du collagène.
6. Procédé selon la revendication 5, dans lequel déterminer un certain nombre de différences
à l'étape (iv) comprend :
(1) déterminer tout changement morphologique de la région pertinente (118) alors que
la région pertinente (118) apparaît entre les images numériques dans le cadre de la
détermination des différences dans la région pertinente (118) alors que la région
pertinente (118) apparaît entre les images numériques normalisées incluant la première
image numérique et la pluralité d'images numériques séquentielles ;
(2) évaluer tout changement d'au moins un élément parmi un niveau d'hydratation cutanée,
un nombre total de rides ou une taille d'au moins une ride, ou un nombre total d'imperfections
ou une taille d'au moins une imperfection ; ou
(3) évaluer au moins un élément parmi un niveau d'hydratation ou un niveau de flux
sanguin entre la première image numérique et au moins une image numérique subséquente,
où la première image numérique représente la région pertinente (118) avant une première
application d'un produit cosmétique, d'un hydratant, d'un agent thérapeutique ou d'un
traitement thérapeutique et l'au moins une image numérique subséquente représente
la région pertinente (118) après la première application du produit cosmétique, de
l'hydratant, de l'agent thérapeutique ou du traitement thérapeutique.
7. Procédé selon la revendication 2 :
(i) dans lequel l'étape (d) comprend en outre associer au moins des données parmi
des données multispectrales ou des données de chronologie d'image au modèle numérique
qui représente géométriquement la région pertinente (118) en trois dimensions par
l'au moins un processeur (212) ;
(ii) dans lequel l'étape (d) comprend en outre rectifier le tissu par l'au moins un
processeur (212) avec une carte tridimensionnelle d'au moins une portion d'un corps
qui combine un ensemble de probabilités de modèle tridimensionnel avec une corrélation
d'un ensemble d'emplacements de coordonnées, d'un ensemble d'effets spectraux et d'un
ensemble d'interactions complexes ;
(iii) dans lequel l'étape (e) comprend en outre générer par l'au moins un processeur
(212) une carte de lésions multidimensionnelle numérique (908) qui trace un ensemble
de caractéristiques de pixel dans au moins la première image numérique, incluant au
moins un élément parmi une surface, une surface secondaire, d'autres couches ou une
caractéristique de profondeur du tissu tel que déterminé à partir d'une analyse spectrale
du tissu (102) tel que représenté dans au moins la première image numérique ;
(iv) dans lequel l'étape (e) comprend en outre corriger pour des effets spectraux
dans le tissu (102) représenté dans au moins la première image numérique, lesquels
effets spectraux sont dus à des interactions d'absorption lumineuse, de facteur de
réflexion et de fluorescence, et de renvoyer et comparer un certain nombre de composants
spatiaux et un certain nombre de composants spectraux spécifiés par au moins un élément
parmi un modèle numérique de données d'image de tissu ou une autre image numérique
afin de générer le modèle tridimensionnel numérique de la région pertinente ;
(v) dans lequel l'étape (e) comprend en outre corriger pour des différences dans l'orientation
spatiale d'au moins un axe parmi un axe d'excitation ou un axe d'imagerie d'un système
d'imagerie de tissu dans l'espace cartésien.
8. Système (200) destiné à être utilisé dans l'analyse de tissu, le système (200) comprenant
:
au moins un processeur (212) ; et
au moins un support de stockage non transitoire (214) qui stocke des instructions
exécutables par le processeur qui, lors de leur exécution, amènent l'au moins un processeur
à :
comparer une apparence d'au moins une forme d'un trait de repère virtuel (804) dans
une première image numérique d'une portion d'un tissu (102) à au moins une forme réelle
définie du trait de repère virtuel (804) ;
comparer une apparence de chacune d'une pluralité de sections (A à P) d'un trait de
repère physique (700 ; 802) dans la première image numérique à des sections respectives
de sections définies (A à P) du trait de repère physique (700 ; 802), dans lequel
les sections définies (A à P) incluent un certain nombre de fantômes de tissu (M à
P) ayant chacun une caractéristique spectrale respective qui correspond à une caractéristique
spectrale respective de tissu (102) d'un type représenté dans la première image numérique
; et
au moins une action parmi mettre en corrélation, normaliser (914) ou corriger (902
; 912) au moins la première image numérique en fonction au moins en partie des comparaisons
; dans lequel le trait de repère physique (700 ; 802) inclut une couche de dispersion
(504) qui recouvre au moins certains des fantômes de tissu (M à P) et qui simule un
caractère optique du type de tissu (102) représenté dans la première image numérique,
et les instructions amènent l'au moins un processeur (212) à comparer l'apparence
des sections (A à P) qui incluent les fantômes de tissu (M à P) qui sont recouverts
par la couche de dispersion (504) à un certain nombre de sections définies (A à P)
qui incluent les fantômes de tissu (M à P) qui ne sont pas recouverts par la couche
de dispersion (504 ; 702a).
9. Système selon la revendication 8 :
(a) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
stocker l'image numérique comme fichier d'image multicouche, incluant une première
couche d'image numérique qui stocke et au moins une seconde couche d'image numérique
qui stocke des métadonnées d'image ;
(b) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
référencer au moins un élément parmi des changements spectraux ou une densité optique
à des coordonnées spécifiques dans la première image numérique pour permettre une
comparaison ultérieure à des changements dans un certain nombre d'images numériques
subséquentes de la région pertinente (118) ;
(c) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
comparer un certain nombre de rapports d'intensité spectrale radiante respective d'un
certain nombre de longueurs d'onde ou gammes d'ondes dans la première image numérique
;
(d) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
normaliser une pluralité d'images numériques incluant la première image numérique
en mesurant une différence d'une distribution spectrale entre un caractère optique
du tissu (102) en combinaison avec le trait de repère physique (700 ; 802), où une
monotonicité d'un certain nombre de relations spectrales définies est proche de ou
dépasse une limite d'une distribution spectrale normale ;
(e) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
établir une ligne de base spécifique à un sujet qui est spécifique à un individu,
et normaliser en fonction au moins en partie de la ligne de base spécifique à un sujet
la première image numérique et une pluralité d'images numériques séquentielles, les
images numériques séquentielles étant capturées de manière séquentielle à divers moments
suite à une capture de la première image numérique ;
(f) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
normaliser au moins les premières images numériques en fonction au moins en partie
d'un marqueur spectral d'hémoglobine et d'un marqueur spectral de collagène ;
(g) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
générer un indice de probabilité (926) en fonction d'une combinaison de propriétés
distribuées d'un certain nombre de variables incluant une normalisation, une correction
d'exposition, une corrélation géométrique, une correction spectroscopique optique,
une caractérisation de signal sur bruit ou un protocole diagnostique défini ;
(h) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
générer un modèle numérique qui représente géométriquement la région pertinente (118)
en trois dimensions en fonction de données spatiales et spectrales provenant des images
numériques ;
(i) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
corriger au moins la première image numérique en fonction au moins en partie d'informations
de correction de couleur ;
(j) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
réaliser un enregistrement (930) de chacune d'une pluralité d'images numériques du
tissu (102), incluant la première image numérique, en fonction au moins en partie
d'une variation entre des coordonnées de couche d'image dans une séquence temporelle
d'une pluralité d'images numériques du tissu ;
(k) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
générer une comparaison d'analyse de couches dans au moins la première image numérique
comme histogramme ;
(l) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
générer une distribution de probabilités d'un tissu qui est anormal ; ou
(m) dans lequel les instructions amènent en outre l'au moins un processeur (212) à
générer la relation anormale des images sont visualisées dans un indice de probabilité
qui pondère au moins certaines images numériques en fonction d'au moins un élément
parmi une valeur diagnostique ou une quantité comparative de changement entre des
spectres.
10. Système selon la revendication 9 :
(i) dans lequel un certain nombre de sections (A à F) du trait de repère physique
(700 ; 802) incluent une couleur respective incluant au moins une parmi noir, blanc,
une pluralité de différentes nuances de gris et une pluralité de couleurs supplémentaires
qui ne sont pas noir, blanc ou gris, et les instructions amènent l'au moins un processeur
à comparer l'apparence des sections (A à F) qui incluent les couleurs respectives
à des sections respectives d'un ensemble défini de couleurs respectives ;
(ii) dans lequel l'étape (a) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à stocker sur une couche diagnostique de l'image numérique
des informations indicatrices d'au moins un élément parmi une fluorescence NADH, une
fluorescence au collagène, une dispersion physique de lumière depuis le tissu au niveau
d'un certain nombre de couches physiques du tissu en raison de la densité du tissu,
une distribution spectrale en raison d'une taille d'un noyau cellulaire et d'une absorption
d'hémoglobine en raison d'un flux sanguin ou d'une oxygénation accru(e) ;
(iii) dans lequel l'étape (a) comprend en outre les instructions amènent en outre
l'au moins un processeur (212) à enregistrer un certain nombre d'images numériques
subséquentes en relation spatiale et optique et à comparer la première et les images
numériques subséquentes couche par couche ;
(iv) dans lequel l'étape (c) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à comparer le nombre de rapports d'intensité spectrale radiante
respective du nombre de longueurs d'onde ou gammes d'ondes dans la première image
numérique à un certain nombre de rapports d'une intensité spectrale radiante respective
d'un certain nombre de longueurs d'onde ou gammes d'ondes dans au moins une image
numérique subséquente ;
(v) dans lequel l'étape (e) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à déterminer des différences dans la région pertinente (118)
alors que la région pertinente (118) apparaît entre les images numériques normalisées
incluant la première image numérique et la pluralité d'images numériques séquentielles
dans le cadre d'une analyse ;
(vi) dans lequel l'étape (i) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à associer au moins des données parmi des données multispectrales
ou des données de chronologie d'image au modèle numérique qui représente géométriquement
la région pertinente en trois dimensions ;
(vii) dans lequel l'étape (i) comprend en outre les instructions amènent en outre
l'au moins un processeur (212) à rectifier le tissu avec une carte tridimensionnelle
d'au moins une portion d'un corps qui combine un ensemble de probabilités de modèle
tridimensionnel avec une corrélation d'un ensemble d'emplacements de coordonnées,
d'un ensemble d'effets spectraux et d'un ensemble d'interactions complexes ;
(viii) dans lequel l'étape (j) comprend en outre les instructions amènent en outre
l'au moins un processeur (212) à générer une carte de lésions multidimensionnelle
numérique (908) qui trace un ensemble de caractéristiques de pixel dans au moins la
première image numérique, incluant au moins un élément parmi une surface, une surface
secondaire, d'autres couches ou une caractéristique de profondeur du tissu tel que
déterminé à partir d'une analyse spectrale du tissu (102) tel que représenté dans
au moins la première image numérique ;
(ix) dans lequel l'étape (j) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à corriger pour des effets spectraux dans le tissu (102)
représenté dans au moins la première image numérique, lesquels effets spectraux sont
dus à des interactions d'absorption lumineuse, de facteur de réflexion et de fluorescence,
et à renvoyer et comparer un certain nombre de composants spatiaux et un certain nombre
de composants spectraux spécifiés par au moins un élément parmi un modèle numérique
de données d'image de tissu ou une autre image numérique afin de générer le modèle
tridimensionnel numérique de la région pertinente (118) ;
(x) dans lequel l'étape (j) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à corriger pour des différences dans l'orientation spatiale
d'au moins un axe parmi un axe d'excitation ou un axe d'imagerie d'un système d'imagerie
de tissu dans l'espace cartésien ;
(xi) dans lequel l'étape (m) comprend en outre les instructions amènent en outre l'au
moins un processeur (212) à générer la distribution de probabilités du tissu qui est
anormal en fonction au moins en partie d'une comparaison d'une densité optique à un
pourcentage de spectres optiques qui est attribuable à du collagène.
11. Système selon la revendication 10, dans lequel l'étape (v) comprend en outre :
(1) les instructions amènent en outre l'au moins un processeur (212) à déterminer
des changements morphologiques de la région pertinente alors que la région pertinente
(118) apparaît entre les images numériques dans le cadre de la détermination des différences
dans la région pertinente (118) alors que la région pertinente (118) apparaît entre
les images numériques normalisées incluant la première image numérique et la pluralité
d'images numériques séquentielles ;
(2) les instructions amènent l'au moins un processeur (212) à déterminer le nombre
de différences en évaluant tout changement d'au moins un élément parmi un niveau d'hydratation
cutanée, un nombre total de rides ou une taille d'au moins une ride, ou un nombre
total d'imperfections ou une taille d'au moins une imperfection ; ou
(3) les instructions amènent l'au moins un processeur (212) à déterminer le nombre
de différences en évaluant au moins un élément parmi un niveau d'hydratation ou un
niveau de flux sanguin entre la première image numérique et au moins une image numérique
subséquente, où la première image numérique représente la région pertinente avant
une première application d'un produit cosmétique, d'un hydratant, d'un agent thérapeutique
ou d'un traitement thérapeutique et l'au moins une image numérique subséquente représente
la région pertinente après la première application du produit cosmétique, de l'hydratant,
de l'agent thérapeutique ou du traitement thérapeutique.
12. Trait de repère physique (700 ; 802) destiné à être utilisé dans l'imagerie de tissu,
comprenant :
un substrat ayant un profil défini et portant une pluralité de sections (A à P) ayant
une caractéristique d'absorption, de facteur de réflexion ou de fluorescence sélective
de la longueur d'onde respective, au moins un premier nombre des sections (A à F)
forment un tableau couleur d'une pluralité de couleurs différentes et au moins un
second nombre des sections (M à P) sont des fantômes optiques qui ont chacun une caractéristique
spectrale respective qui correspond à une caractéristique spectrale respective du
tissu (102) ;
caractérisé en ce que le trait de repère physique (700 ; 802) comprend en outre une couche de dispersion
(504) qui recouvre au moins certains mais pas l'ensemble des fantômes de tissu (M
à P), dans lequel la couche de dispersion a un certain nombre de caractéristiques
qui simulent un certain nombre de caractéristiques optiques d'au moins une couche
de tissu du tissu.
13. Système (100) pour imager des tissus corporels (102), le système (100) comprenant
:
un trait de repère physique (700 ; 802) selon la revendication 12 pouvant être positionné
sélectivement au moins à proximité d'une région pertinente (118) sur une portion d'un
tissu corporel (102) devant être imagée ;
au moins une source lumineuse (106) pouvant opérer pour projeter un trait de repère
virtuel (804) au moins à proximité de la région pertinente (118) sur la portion du
tissu corporel (102) devant être imagée, le trait de repère virtuel (804) ayant un
profil défini et une pluralité de formes définies ; et
un dispositif de capture d'images (104) ayant un champ de vision (114) et étant configuré
pour capturer des images numériques de tissu corporel (102) incluant la région pertinente
(118), le trait de repère physique (700 ; 802) et le trait de repère virtuel (804)
tous englobés par le champ de vision (116) du dispositif de capture d'images (104).
14. Procédé (900) d'opération d'un système (200) destiné à être utilisé dans l'analyse
de tissu selon la revendication 1, le procédé (900) comprenant en outre :
évaluer par au moins un processeur (212) du système (200) un changement d'au moins
un élément parmi un niveau d'hydratation, un niveau de flux sanguin, un nombre total
de rides, une taille d'au moins une ride, un nombre total d'imperfections ou une taille
d'au moins une imperfection entre une première image numérique d'une région pertinente
(118) d'un tissu corporel (102) et au moins une image numérique subséquente de la
région pertinente (118) du tissu corporel (102), où la première image numérique représente
la région pertinente (118) avant une première application d'un produit cosmétique,
d'un hydratant, d'un agent thérapeutique ou d'un traitement thérapeutique et l'au
moins une image numérique subséquente représente la région pertinente (118) après
la première application du produit cosmétique, de l'hydratant, de l'agent thérapeutique
ou du traitement thérapeutique ; et
rapporter par l'au moins un processeur (212) du système (200) la différence évaluée
sous une forme visuelle.
15. Système (200) destiné à être utilisé dans l'analyse de tissu selon la revendication
8, le processeur (212) étant en outre configuré pour :
évaluer un changement d'au moins un élément parmi un niveau d'hydratation, un niveau
de flux sanguin, un nombre total de rides, une taille d'au moins une ride, un nombre
total d'imperfections ou une taille d'au moins une imperfection entre une première
image numérique d'une région pertinente d'un tissu corporel et au moins une image
numérique subséquente de la région pertinente (118) du tissu corporel (102), où la
première image numérique représente la région pertinente (118) avant une première
application d'un produit cosmétique, d'un hydratant, d'un agent thérapeutique ou d'un
traitement thérapeutique et l'au moins une image numérique subséquente représente
la région pertinente (118) après la première application du produit cosmétique, de
l'hydratant, de l'agent thérapeutique ou du traitement thérapeutique ; et
rapporter la différence évaluée sous une forme visuelle.