Technical field
[0001] The present invention pertains to computer implemented methods for detecting optical
defects within windshields.
Technical background
[0002] Windshields are well-known in the transport industry, e.g. automotive, rail transport
and aeronautics. They are usually made of two bended sheets of glass that are laminated
with a polymer interlayer.
[0003] A windshield is a glazing through which a driver views what is ahead, e.g. roads,
rails, landscapes, ... Therefore, for security reasons, the distortion of objects
as seen through a windshield should be as low as possible, at least it should not
confuse the driver. In this context, the optical quality of windshields has to fulfil
certain requirements which are detailed in section 9.2 of Annex 3 of the Regulation
No 43 of the Economic Commission for Europe of the United Nations (UN/ECE).
[0004] Several methods and instruments are described in the art, that may be intended to
measure the optical distortion of windshields in the framework of the Regulation No
43.
[0005] EP 0 463 940 A1 describes a process for measuring the optical quality of a windshield based on shadow
illumination.
[0007] WO 2017/008159 A1 describes a method to detect optical defects in windshields through analysis of composite
images of chromatic aberrations.
Summary of the invention
Technical problem
[0008] As efficient as they may be, methods described in the art may fail to detect some
optical defects which may however be detected by human eyes. Since human vision is
generally more flexible than most of the inspection systems which implements said
methods, optical defects, which may be only visible on the driver and/or passenger
side of the windshield, sometimes at a specific angle or different angles, may be
completely overlooked by inspection systems on manufacturing line. A direct and negative
consequence is that a windshield, which was initially considered as fulfilling the
technical specifications, may be rejected by customers afterwards. Complaints and
production losses may occur.
[0009] Moreover, it has been found that some of these overlooked or undetected optical defects
may have not the same features or signature, so that inspection systems may behave
differently from one to another regarding their detection. With some specific setups,
certain inspection systems may be able to detect them while others may fail. Thus,
finding out a setup and/or a criterion to make inspection systems detect them regardless
the features of the inspection systems is challenging. Furthermore, even if such setup
or criterion may be found, this still requires to remain compatible with the whole
configuration of a manufacturing line.
[0010] Therefore, there is a need for a novel, easy-to-implement method for detecting those
specific optical defects which may be undetected by current inspection systems but
may remain visible to a human driver.
Solution to the technical problem
[0011] In a first aspect of the invention, there is provided a computer implemented method
for detecting optical defects within windshields as described in claim 1, dependant
claims being advantageous embodiments.
[0012] In a second aspect of the invention, there is provided a data processing system,
a computer program and a computer-readable medium to implement the method.
[0013] In a third aspect of the invention, there is provided a process for detecting optical
defects within windshields as described in claim 10, independent claims being advantageous
embodiment.
[0014] Both method and process may be used in a manufacturing process of windshields.
Advantages of the invention
[0015] A first outstanding benefit of the invention is that it allows to detect optical
defects in windshields that may remain undetected by most common inspection systems
but may still be seen by human eyes, e.g. eyes of a driver.
[0016] A second advantage is that the invention is relatively easy to implement in existing
manufacturing processes so that it requires few, if any, adaptation. More precisely,
the computer implemented invention and the process according to the invention may
benefit from the facilities for acquiring digital image maps of optical power that
are already available in manufacturing lines and/or control quality processes.
[0017] A third advantage is that the invention indirectly provides insights on the relative
size with which an optical defect may appear to a driver when looking at distant object
through a windshield. It then allows to assess whether an optical defect may impinge
the ease of viewing.
Brief description of drawings
[0018]
Fig 1 is a data flow diagram of a computer implemented method for detecting optical
defects to an embodiment of the first aspect of the invention
Fig. 2 is an example of a digital image map, in greyscale, of the intensity of optical
power of a windshield.
Fig. 3 is a data processing system according to the second aspect of the invention.
Detailed description of embodiments
[0019] With reference to fig 1, in an embodiment of the first aspect of the invention, there
is provided a computer implement method 1000 for detecting optical defects within
a windshield,
wherein said method takes, as input 11001, a digital image map of intensity of optical
power of a windshield, and provides, as output 03001, a digital image map of optical
defects,
wherein said method 1000 comprises the following steps:
- (a) image processing 1001 of said digital image map of optical powers for detecting
and delimiting regions that differs in intensity of optical power;
- (b) computing 1002, for each detected regions, a representative geometric dimension
and a representative value of the optical power;
- (c) computing 1003 an image map of the detected regions for which the product between
the representative geometric distance and the representative value of the optical
power is equal or superior to 2.9.10-4.
[0020] The method 1000 takes, as input 11001, a digital image map of intensity of optical
power of a windshield, an example of which is provided on fig. 2. Optical power refers
to the ability of a lens to focus light. Depending on how the lens refracts light,
the light may diverge or converge. The SI unit for optical power is the inverse meter
(m
-1), also called dioptre (dpt).
[0021] On fig. 2, the intensity of optical power is represented by the greyscale pattern
over the whole windshield, the white boxed regions are discussed later on.
[0022] Measurement of optical power in windshield is well described in the art, e.g.
EP 3012619 A1,
EP 0 463 940 A1,
EP 0 342 127 A1,
EP 0 685 733 A1. Alternatively, or as complement to measurements, optical power may also be simulated,
e.g.
EP 3 756 114 A1. All these methods may provide directly or may be adapted to acquire a digital image
map of optical power of a windshield.
[0023] In some embodiments, the digital image maps may be acquired at a specific angle or
for a range of given angles in respect to normal of the windshield. In preferred embodiments,
the digital image maps may be acquired at an angle or in a range of angles corresponding
or being representative of the angles at which a driver may view objects through the
windshields when in used. Indeed, as the inclination angle of a windshield in respect
to the framework of a vehicle usually vary from a vehicle to another, the viewing
angle of the driver, and then the probability of an optical defect to be viewed, may
also vary depending on this inclination angle. Therefore, it may be advantageous to
take this effect into account when acquiring the digital maps of the optical power.
The precision and the reliability of the method may be improved.
[0024] The image processing 1001 of step (a) to detect and delimit regions of the digital
image map that differs in intensity of optical power may any adapted image processing
method for objet detection. The image processing method may be neural network or non-neural
network methods.
[0025] In preferred embodiments, the image processing 1001 may be a blob detection, in particular
a blob detection through the computing of the Laplacian of the Gaussian of the digital
image map of optical powers, of the difference of the Gaussian of the digital image
map of optical powers or of the determinant of the Hessian of the digital image map
of optical powers. Blob detection may be simpler to implement than neural network
method while still providing valuable results for most kinds of windshield and applications.
[0026] In step (b), the representative geometric dimension of detected regions may depend
on the shape chosen to represent their boundaries at step (a). However, as a general
rule of thumb, to be representative, the computed value for geometric dimension should
advantageously show little variations whatever the chosen shape providing that the
shape is relevant to delimit the detected regions.
[0027] Many shapes may suit and may be more or less complex depending on the image processing
method used for detecting and delimiting the regions and the degree of closeness and
preciseness which may be looked for to the boundaries of the regions. For example,
they may be convex shapes such as convex polygons, e.g., squares or rectangles, or
curved figures, e.g., circles or ellipses, or concave shapes such as concave polygons
or concave curved figures.
[0028] Since the optical defects under the scope of the invention may often have regular,
relatively rounded or elongated convex shape, in certain advantageous embodiments,
the detected regions at step (a) may be delimited with ellipses and wherein the representative
geometric distances of the detected regions computed at step (b) are the minor axis
of said ellipses.
[0029] A step (b), the computed representative geometric dimension of each detected regions
has the unit of length, e.g. meter in SI unit, and the computed representative value
of optical power has the unit of reciprocal length, e.g. m
-1 or dpt in SI unit.
[0030] The representative value of the optical power of each detected region may be computed
through different methods. In some embodiments, the representative value of the optical
power of each detected regions is the average optical power, the median optical power,
the maximum optical power or the maximum / minimum optical power difference in said
detected region.
[0031] The value of the product computed at step (c) is a dimensionless number. In certain
embodiments, this number may be considered as representative of an angle which may
be expressed in radians (rad). In this respect, the minimum value of 2.9.10
-4 provided at step (c) may then be considered as representative of a minimal distortion
factor at which an optical defect may appear to human eyes, i.e. driver, when looking
through a windshield at an object located at given distance, D, from that windshield.
The product of this minimum value of 2.9.10
-4, expressed in radians, with the distance D may provide the apparent size of an optical
defect with the regard to the distance, D, of the object at which a driver may look
at.
[0032] In some embodiments, the value of the product computed at step (c) may be comprised
between 5.10
-4 and 2.10
-3, preferably between 7.10
-4 and 1.5.10
-3; more preferably, may be 1.10
-3. These values may be less stringent than the value of 2.9.10
-4 and may be more adapted to the most common configuration of windshields, in particular
in respect to the framework of most common vehicles.
[0033] The method provides, as output O1001, an image map of the detected regions for which
the product between the representative geometric distance and the representative value
of the optical power is equal or superior to 2.9.10
-4. An example of such image map is provided on fig. 2 on which the white boxed regions
represent the detected regions and are superimposed to the digital image map of optical
power.
[0034] In certain embodiments, the detected regions at step (b) may further be such that
their apparent size in the scale of visual decimal acuity is between 0.5 and 3; preferably
between 0.67 and 1.25, more preferably is 1. The visual acuity, in the scope of human
vision, is well known in the art and fully described in the EN ISO 8596:2018 standard.
A criterion on the apparent size may be an advantageous complement in some applications,
i.e. aeronautics, motorsports, premium vehicles, in which a high degree of optical
quality is requested. Such criterion may ensure that the optical defects to which
human eyes may be sensitive may be detected with a high degree of reliability.
[0035] The method 1000 according to the first aspect of the invention may be advantageously
used in a manufacturing process of windshields. As manufacturing processes may already
comprise instruments for acquiring digital maps of optical power, few, if any, adaptation
of said process may be required to implement the method.
[0036] In a second aspect of the invention, with reference to fig.3, there is provided a
data processing system 3000 comprising means for carrying out a method 1000 according
to any one of the embodiments of the first aspect of the invention, and a computer
program 13001 comprising instructions which, when executed by a computer, cause the
computer to carry out a method according to any one of embodiments of the first aspect
of the invention.
[0037] The data processing system 3000 comprises means 3001 for carrying out a method according
to any of the embodiments of the first and second aspect of the invention. Example
of means 3001 for carrying out the method may be a device which can be instructed
to carry out sequences of arithmetic or logical operations automatically to perform
tasks or actions. Such device, also called computer, can comprise one or more Central
Processing Unit (CPU) and at least a controller device that are adapted to perform
those operations. It can further comprise other electronic components like input/output
interfaces 3002, non-volatile or volatile storage devices 3003, and buses that are
communication systems for the data transfer between components inside a computer,
or between computers. One of the input/output devices can be user interface for human-machine
interaction, for example graphical user interface to display human understandable
information.
[0038] As calculation may require a lot of computational power to process substantial amounts
of data, the data processing system may advantageously comprise one or more Graphical
Processing Units (GPU) whose parallel structure makes them more efficient than CPU,
in particular for image processing in ray tracing.
[0039] Regarding the computer program I3001, any kind of programming language, either compiled
or interpreted, may be used to implement the steps of the method of the invention.
The computer program 13001 may be part of a software solution, i.e., part of a collection
of executable instructions, code, scripts, or the like and/or databases.
[0040] In certain embodiments, there is also provided a computer-readable storage or medium
3003 comprising instructions which, when executed by a computer, cause the computer
to carry out the method according to any of the embodiments of the first aspect of
the invention.
[0041] The computer-readable storage 3003 may be preferably a non-volatile storage or memory,
for example hard disk drive or solid-state drive. The computer-readable storage may
be removable storage media or a non-removable storage media as part of a computer.
[0042] Alternatively, the computer-readable storage may be a volatile memory inside a removable
media.
[0043] The computer-readable storage 3003 may be part of a computer used as a server from
which executable instructions can be downloaded and, when they are executed by a computer,
cause the computer to carry out a method according to any of the embodiments described
herein.
[0044] Alternatively, the program I3001 may be implemented in a distributed computing environment,
e.g., cloud computing. The instructions can be executed on the server to which client
computers can connect and provide encoded data as inputs to the method. Once data
are processed, the output can be downloaded and decoded onto the client computer or
directly send, for example, as instructions. This kind of implementation can be advantageous
as it can be realised in a distributed computing environment such as a cloud computing
solution.
[0045] In an embodiment of the third aspect of the invention, there is provided a process
for detecting optical defects within a windshield, wherein said method comprises the
following steps:
- (a) acquiring a digital image map of the intensity of optical power of a windshield;
- (b) processing, with a computing system, said digital image map for detecting and
delimiting regions that differs in intensity of optical power;
- (c) computing, with a computing, system, an image map of the detected regions for
which the product between the representative geometric distance and the representative
value of the optical power is equal or superior to 0.3.
[0046] Technical aspects and features of the different embodiments detailed in the context
of the first and second aspects of the invention may also apply to the third aspect
of the invention. It is in the reach of a person skilled in the art to change, transform
or adapt them in a process according to the third aspect of the invention.
1. Computer implement method for detecting optical defects within a windshield, wherein
said method takes, as input, a digital image map of the intensity of optical power
of a windshield, and provides, as output, a digital image map of optical defects,
wherein said method comprises the following steps:
(a) an image processing of said digital image map of optical powers for detecting
and delimiting regions that differs in intensity of optical power;
(b) computing, for each detected regions, a representative geometric dimension and
a representative value of the optical power;
(c) computing an image map of the detected regions for which the product between the
representative geometric distance and the representative value of the optical power
is equal or superior to 2.9.10-4.
2. Method according to claim 1, wherein the product in step (c) is comprised between
5.10-4 and 2.10-3, preferably between 7.10-4 and 1.5.10-3; more preferably; is 1.10-3.
3. Method according to any of claims 1 to 2, wherein the image processing of step (a)
is a blob detection, in particular a blob detection through the computing of the Laplacian
of the Gaussian of the digital image map of optical powers, of the difference of the
Gaussian of the digital image map of optical powers or of the determinant of the Hessian
of the digital image map of optical powers.
4. Method according to any of claims 1 to 3, wherein the detected regions at step (b)
are such that their apparent size in the scale of visual decimal acuity is between
0.5 and 3; preferably between 0.67 and 1.25, more preferably is 1.
5. Method according to any of claims 1 to 4, wherein the detected regions at step (a)
are delimited with ellipses and wherein the representative geometric distances of
the detected regions computed at step (b) are the minor axis of said ellipses.
6. Method according to any of claims 1 to 5, wherein the representative value of the
optical power of each detected regions is the average optical power, the median optical
power, the maximum optical power or the maximum / minimum optical power difference
in said detected region.
7. A data processing system comprising means for carrying out the method according to
any of claim 1 to 6.
8. A computer program comprising instructions which, when the program is executed by
a computer, cause the computer to carry out the method according to any of claim 1
to 6.
9. A computer-readable medium comprising instructions which, when executed by a computer,
cause the computer to carry out the method according to any of claim 1 to 6.
10. Process for detecting optical defects within a windshield, wherein said method comprises
the following steps:
(a) acquiring a digital image map of the intensity of optical power of a windshield;
(b) processing, with a computing system, said digital image map for detecting and
delimiting regions that differs in intensity of optical power;
(c) computing, with a computing, system, an image map of the detected regions for
which the product between the representative geometric distance and the representative
value of the optical power is equal or superior to 2.9.10-4.
11. Process according to claim 11, wherein the product in step (c) is comprised between
0.5 and 2, preferably between 0.7 and 1.5, more preferably; is 1.
12. Use of a method according to any of claims 1 to 6 in a manufacturing process of a
windshield.