[0001] The field of the present invention is product discrimination systems based on color.
[0002] Fruit and vegetable products have been subject to sorting based on color in the past.
Initially, such tasks were performed manually. More recently, as labor continues to
be more and more expensive and unavailable, machine sorting by color has been attempted.
A device capable of sorting by color is described in U.S -A- 4,106,628. In this system,
color from a product unit is directed through lenses, fiber optics and filters to
a sensing mechanism. Light from both sides of a product unit are equally mixed by
a splitting and reforming of optic fibers used to transmit the light. In this way,
an average from both sides of the product unit is achieved. The optic fibers are then
split into two bundles. Filters of different wavelength capacity are employed to filter
the light derived from the fiber optic bundles. Red and green filters are given as
examples. The signals generated by the filtered light are then compared with a standard
such that a red/green color classification may be made based on the readings compared
with the standard.
[0003] More complicated sensing devices have been developed which use line scan cameras
for determining such attributes as cross-sectional area. Such cameras have used light
to present pixel information which may then be processed for summation and the like.
In order to detect color using such a system, a very complicated system would be required
because of the substantial amount of data to be received and processed. With product
units traveling at any reasonable speed past such a discrimination system, it quickly
becomes impossible to keep up with the processing of relevant information without
a very substantial data processing system.
[0004] The present invention is directed to a product discrimination system employing the
sensing of a variety of light spectra, which may include wavelengths both in and beyond
the visible spectrum, from product units being classified. The magnitudes of the sensed
light spectra may then be analysed for determining such attributes of a product as
size, ripeness, blemishes and colour. According to the present invention, a manageable
amount of data is received and processed by such a system with a maximum number of
product factors being determined.
[0005] US-A-4 454 029 discloses a method of discriminating products in accordance with the
prior art portion of claim 1. This prior disclosure utilises a filtered chromatic
light signal to recognise a product unit to be rejected simply when a single signal
showing a blemish is received. The present invention, as characterised in claim 1,
does not rely upon a single signal but instead sums a number of individual signals
for each product unit with the result that a far more flexible discrimination operation
can be achieved rich can be used for sorting functions additional simply to recognising
blemishes due to a colour change. Thus, the present invention provides a method for
discriminating attributes of product units, rich uses absolute magnitudes and comparative
relationships between the sums of magnitudes of various spectra of light sensed from
a product unit to determine such attributes as size, as well as colour, ripeness and
blemishes averaged over the role product unit.
[0006] US-A-4 150 287 and US-A-3 993 899 show other apparatus by which different light spectra
reflected from an article are sensed to recognise characteristics of the article being
sensed. However, these are typical of the prior art in that they contain no suggestion
as to how features other than simple colour or appearance changes at single locations
can be utilised for discrimination purposes. Other and further objects and advantages
will appear hereinafter.
BRIEF DESCRIPTION OF DRAWINGS
[0007] Figure 1 is a schematic illustration of a discrimination system of the present invention.
[0008] Figure 2 is a schematic illustration of an optical sensing device of the present
invention.
[0009] Figure 3 is a schematic view of the viewing area of the device of Figure 2.
[0010] Figure 4 is a cross-sectional view taken along line 4-4 of Figure 2.
[0011] Figure 5 is a cross-sectional view taken along line 5-5 of Figure 2.
[0012] Figure 6 is a cross-sectional view taken along line 6-6 of Figure 2.
[0013] Figure 7 is a logic flow chart for analysis of the sensed light.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
[0014] A product discrimination system is schematically illustrated in Figure 1. One or
more objects 10, which are units of product to be sensed, are brought into appropriate
position at a viewing station by a conveying means. Such a conveying means is illustrated
in copending EP-A-0345036 The objects 10 may be illuminated as needed for appropriate
sensing by conventional lights. Lens assemblies 12 are positioned to view and sense
the electromagnetic energy, or light spectrum, from the objects 10. The lens assemblies
12 are positioned in accordance with the system design. It is possible to sense characteristics
of each product unit passing through a station with one, two, three or more lens assemblies
12 directed at the station. With two such lens assemblies, as illustrated in Figure
1, a substantial portion of the object may be viewed. Additionally, the object may
be rotated for sensing by the same elements or by additional elements further along
the conveying path. Fiber optic cables 18 convey the sensed electromagnetic energy
to a signal conditioning and processing unit. Depending on the capability of the processing
unit, more than one station may be established on separate conveying paths with separate
sets of lens assemblies.
[0015] Looking in greater detail to the optical sensing device, each lens assembly 12 includes
a housing 14 with a lens 16 positioned at an aperture to the housing 14. The lens
16 is positioned at a specific distance from the path along which product units are
to pass. With the single lens 16, a focal plane is thus defined within the housing
14. But for the aperture at which the lens 16 is located, the housing 14 is conveniently
closed to prevent extraneous light from entering the housing and projecting on the
focal plane.
[0016] Extending into the lens assembly 12 is a randomized fiber optic cable 18. Such a
cable 18 is made up of a plurality of light transmitting fibers which are randomly
bundled such that a pattern of light impinging on one end of the cable 18 will be
mixed, or averaged, upon exiting the other end of the cable 18.
[0017] The cable 18 has a first end which is positioned at the focal plane of the lens 16.
Further, the first end is arranged in a thin rectangular pattern in that focal plane.
The pattern of this first end 20 is best illustrated in Figure 4. The arrangement
of the first end 20 in a thin rectangular array at the focal plane of the lens 16
causes the image received by the cable 18 to be a thin rectangular area of the pathway
through which product units travel. The image received by the cable 18 is, therefore,
like that of a line scan camera. The length of the rectangle transverse to the direction
of movement of the product unit is preferably greater than the largest dimension transverse
to the conveying path of any anticipated product unit. The width of the rectangular
viewing area parallel to the direction of a movement is substantially smaller than
the dimension along the conveying path of the anticipated product units. Given a constant
speed of advancement of each product unit along the conveying path, the discrimination
system can be configured such that sequential sensings are made as the product passes
by the lens assemblies 12. A complete view of the product unit may be achieved by
collecting sequential readings from the viewing area as the product moves across that
viewing area.
[0018] The light energy received by the rectangular first end 20 of the cable 18 is transmitted
along the cable to a second end 22. The second end 22 is conveniently circular in
the present embodiment. The light transmitted through the cable is averaged and directed
against a plano convex lens 24. The lens 24 is positioned such that the second end
22 lies at the focal point of the lens. Thus, the light passing through the lens from
the second end 22 of the cable 18 is directed in a substantially nonconverging and
nondiverging path. If the second end 22 of the cable 18 is in a circular shape, a
similar yet magnified pattern will be transmitted by the lens 24.
[0019] Adjacent the lens 24 is a filter assembly 26. The filter assembly 26 may be positioned
against or near the lens 24 to receive the light from the cable 18. The filter assembly
26 includes filter elements 28. The filter elements 28 are selected such that the
separate elements filter different spectra of light. Thus, the filter assembly may
include, for example, a red filter, a green filter, a yellow filter and even a filter
outside of the visible spectrum. If the light from the lens 24 is arranged as discussed
above, the filter assembly 26 is most conveniently circular with sectors of the circular
assembly constituting the filter elements 28. Thus, from a rectangular image of a
small slice of the product unit being viewed, a plurality of differently filtered
light portions of the averaged light of the image are derived through the filter assembly
26. Four such equal portions are shown in the preferred embodiment. However, other
arrangements could well be found beneficial for viewing particular product units.
[0020] To receive the divided and filtered portions of light from the original image, photodiodes
30 are presented adjacent the filter elements 28. In the preferred embodiment, one
such diode 30 is associated with each filter element sector 28. Thus, an electronic
signal is generated by each diode responsive to the magnitude of light conveyed through
each of the filter elements.
[0021] The magnitude of each filtered portion may be compared against a standard stored
in the data processing unit or converted by a factor or factors developed from prior
comparisons with standard samples or tests. The accumulated segments or views making
up an image formed by sequential images of the entire unit may also be processed in
like manner. The standards within the processor or forming a basis for data conversion
can be derived from sample product units having known physical attributes. Thus a
pattern of magnitudes from the separate filtered portions or accumulation of portions
for an entire unit can be compared with standards or converted for cross-sectional
size, blemishes, ripeness and color. An indexing of the unit is also processed to
fix the product unit on the conveying system. The processing unit may then time the
diversion of each product unit according to its physical attribute or attributes to
predetermined off-loading stations on the conveying system.
[0022] Figure 7 schematically illustrates analysis of the sensed light received by the photodiodes
30. Step 100 initiates the program. Step 102 initializes the sensed values, i.e.,
the product length and the magnitude of the light spectra separately sensed.
[0023] By step 102, the product length is set to zero. Product length is the length of the
product in the direction of motion of the conveyor regardless of the product orientation.
For example, what might normally be thought of as the product length may be lying
crosswise to the conveyor and hence become its width as recognized by the system for
purposes of discrimination. The length is measured in units of movement of the conveyor
by a conventional indexing mechanism.
[0024] The summation of light magnitudes perceived by the photodiodes 30 is also set to
zero. With multiple diodes 30, a plurality of light magnitudes are stored in separate
sums. In the present example, four such magnitude summations are processed by the
system.
[0025] Step 104 times the measurement of light magnitude to coincide with the presentation
of a new unit length of product. This step is controlled by the indexing mechanism
for the conveyor. By viewing sequential units or slices of the product as it passes
through the station, a line scan process is approximated. However, the light received
is averaged and individual units of the line scan, or pixels, do not exist. Thus,
the useful attribute received is spectra magnitude.
[0026] Step 106 stores the magnitude of each light spectra sensed as the successive unit
length passes through the viewing station. This storage of magnitude is controlled
by step 104 such that an area which is one unit in length and the actual dimension
of the product transverse to the direction of motion of the conveyor is sensed. The
magnitudes of the selected light spectra are sensed by the photodiodes 30 and stored
by this step.
[0027] Step 108 detects whether or not a product unit is present and whether or not the
product unit just ceased to be present at the sensing station. If no product is sensed
and no product was sensed in the just prior view, the no product logic path 110 is
selected. Under this circumstance, logic step 102 is again initiated. If a product
is sensed as being present, the product present logic path 112 is followed. If a product
unit is not sensed but the just prior view did sense a product unit, the product end
logic path 114 is followed.
[0028] In the product present logic path 112 when a product is sensed, the magnitude of
each light spectra is added to any prior sum of such magnitudes in logic step 116.
When the first sensing of a product unit passing through the viewing station occurs,
the sum is zero from logic step 102. In successive views, each reading is added to
the cumulative sum of magnitudes. The length is also summed in a similar manner with
each sensed view being added to the prior length in step 118. Logic step 104 is then
instituted to time the next reading.
[0029] The product end logic path 114 represents the conclusion of the sensing process on
a product unit. In this path, the logic step 120 takes an average of the summed magnitude
per unit length by dividing the summed magnitude by the length of the product unit.
Other algorithms could be employed in this step. Such algorithms would depend on the
unit being observed and the physical attribute or attributes to be employed for discrimination.
Further, multiple algorithms could also be used where necessary. One such algorithm
would be to pick the largest magnitude value of the units measured of a given product.
Finally, logic step 122 allows the selection of an algorithm for calculating one or
more of a plurality of physical attributes. Such attributes might include color, size
of the product and product grade. In the case of size, the average color magnitude
in association with the product length may give a sufficient approximation of cross-sectional
area that the size or weight of the product unit might be determined. Under such circumstances,
the readings might be used directly to provide discrimination or might be first converted
into conventional units such as weight or volume through a comparison of the sensed
values with a standard. Such a comparison might be undertaken with a constant factor,
a table or other conventional means by which a standard is integrated into the interpretation
of measured data. Once having resolved the nature of the product, the program is returned
to initialize the summations of light spectra magnitude and length at zero.
[0030] The recognition of the physical attribute of the product may be result in a binary
output or present specific magnitudes. In the case of a binary output, the product
may be either retained or rejected at a given station through an on or off signal
to an actuator employed to remove products from a conveyor. As an example, heavily
blemished product units or unusually large or small product units might be automatically
off-loaded from the conveying system at an appropriate off-loading station. Further
processing of sensed magnitudes on the other hand might be employed, for example,
in selecting from a plurality of off-loading stations to achieve a specific load at
each station. Through such a scheme, the estimated weight of individual units could
be calculated and units selectively off-loaded at a at a plurality of stations to
achieve a certain bag weight at each station. The signals generated by the system
typically may actuate solenoid devices which in turn actuate off-loading systems.
Naturally, the indexing mechanism associated with the conveyor is required to present
input to the logic system such that the logic system can determine when a given product
unit reaches an off-loading station and time the off-loading of the product unit.
[0031] Thus, a mechanism is contemplated for inputting light images of product units or
portions thereof in an arrangement such that the output presents a plurality of measurable
magnitudes of light in specified spectra useful for distinguishing between product
units.
1. A method of discriminating product units by physical attributes using light spectra,
wherein a product unit is viewed sequentially in a first direction across the product
unit (10) as a series of thin rectangular segments, each substantially narrower than
the product unit in the first direction, the viewed light from each segment is averaged
and then divided into portions which are separately filtered (at 28) to obtain spectra
different from one another, the magnitude of each filtered portion is sensed (at 30),
and the product unit is discriminated in dependence of characteristics determined
by such sensing, characterised in that the thin rectangular segments are at least
as wide as the product unit in a second direction perpendicular to the first direction
and in that for each light spectrum the magnitude (at 106) of the filtered portions
for a single product unit are summed (at 116) and the separate sums are processed
(at 120,122) to provide a discriminating signal for such product unit.
2. A method according to claim 1, wherein the processing (at 120) of the summed signal
includes dividing the sum by a signal representative of the length of the product
unit as determined by the number of thin rectangular segments needed to scan the product
unit to obtain average values for the separate spectrum portions for the product unit.
3. A method according to claim 2, wherein the size of the product unit is determined
(at 122) by processing the average values and the sensed length of the product unit.
4. A method according to any preceding claim, wherein the product unit (10) is viewed
from two different directions (12).
5. A method according to any preceding claim, wherein the viewed light is randomly mixed
with a randomised fibre optic cable (18) and the light from the cable is directed
to different filter elements (28).
6. A method according to any preceding claim, wherein a standard is established by performing
the method steps on products having known attributes to be measured and collecting
the magnitudes of each filtered portion, the summed magnitudes sensed of the product
unit being compared with the standard to provide the discrimination decision.
1. Verfahren zur Erkennung von Produkteinheiten über physikalische Merkmale unter Verwendung
von Lichtspektren, in welchen eine Produkteinheit sequentiell in einer ersten Richtung
entlang der Produkteinheit (10) in einer Serie von dünnen, rechteckigen Segmenten
optisch abgetastet wird, wobei jedes dieser Segmente wesentlich enger dimensioniert
ist als die Produkteinheit in der ersten Richtung, wobei das optisch aufgenommene
Licht von jedem Segment gemittelt und dann in Teile aufgeteilt wird, die separat gefiltert
werden (bei 28), um voneinander unterschiedliche Spektren zu erhalten, wobei die Größe
jedes gefilterten Anteils aufgenommen wird (bei 30) und wobei die Produkteinheit abhängig
von den durch diese Aufnahme bestimmten Charakteristiken erkannt wird,
dadurch gekennzeichnet,
daß die dünnen, rechteckigen Segmente zumindest so breit sind wie die Produkteinheit
in einer zweiten Richtung, die senkrecht auf der ersten steht, und daß für jedes Lichtspektrum
die Größe (bei 106) der gefilterten Anteile für eine einzelne Produkteinheit summiert
wird (bei 116), und daß die separaten Summen verarbeitet werden (bei 120, 122), um
ein Erkennungssignal für jede Produkteinheit zu erhalten.
2. Verfahren nach Anspruch 1, dadurch gekennzeichnet, daß die Verarbeitung (bei 120)
der aufsummierten Signale das Dividieren der Summe durch ein Signal umfaßt, das repräsentativ
für die Länge der Produkteinheit ist, die über die Zahl der dünnen, rechteckigen Segmente
bestimmt wird, die benötigt wird, um die gesamte Produkteinheit abzugreifen, um Mittelwerte
für die separaten Spektralbereiche der Produkteinheit zu erhalten.
3. Verfahren nach Anspruch 2, dadurch gekennzeichnet, daß die Größe der Produkteinheit
dadurch bestimmt wird (bei 121), daß die Mittelwerte und die aufgenommene Lange der
Produkteinheit verarbeitet werden.
4. Verfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß die
Produkteinheit (10) von zwei unterschiedlichen Richtungen (12) aus optisch abgetastet
wird.
5. Verfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß das
optisch aufgenommene Licht zufallsverteilt mit einem zufallsverteilten Fiberoptik-Kabel
(18) gemischt wird und daß das Licht von dem Kabel in unterschiedliche Filterelemente
(28) geleitet wird.
6. Verfahren nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, daß ein
Standard dadurch hergestellt wird, daß die Verfahrensschritte bei einem Produkt mit
bekannten Eigenschaften durchgeführt werden und daß die Größen jedes Filterbereichs
gesammelt werden, und daß die aufsummierten Größen, die von der Produkteinheit aufgenommen
wurden, mit dem Standard verglichen werden, um eine Erkennungsentscheidung zu fällen.
1. Procédé de sélection de produits par des attributs physiques utilisant des spectres
lumineux, dans lequel un produit est examiné séquentiellement dans une première direction
à travers le produit (10) sous la forme d'une série de segments rectangulaires minces,
chacun étant sensiblement plus étroit que le produit dans la première direction, la
lumière examinée à partir de chaque segment est moyennée et ensuite divisée en parties
qui sont filtrées séparément (en 28) pour obtenir des spectres différents les uns
des autres, l'amplitude de chaque partie filtrée est détectée (en 30), et le produit
est sélectionné en fonction de caractéristiques déterminées par cette détection, caractérisé
en ce que les segments rectangulaires minces sont au moins aussi larges que le produit
dans une seconde direction perpendiculaire à la première direction et en ce que pour
chaque spectre de lumière, l'amplitude (en 106) des parties filtrées pour un unique
produit sont sommées (en 116) et les sommes distinctes sont traitées (en 120,122)
pour produire un signal de sélection pour ce produit.
2. Procédé selon la revendication 1, dans lequel le traitement (en 120) du signal sommé
comprend une division de la somme par un signal représentatif de la longueur du produit
tel que déterminé par le nombre de segments rectangulaires minces nécéssaires pour
analyser le produit afin d'obtenir des valeurs moyennes pour les parties de spectre
distinctes du produit.
3. Procédé selon la revendication 2, dans lequel la dimension du produit est déterminée
(en 122) en traitant les valeurs moyennes et la longueur détectée du produit unitaire.
4. Procédé selon l'une quelconque des revendications précédentes, dans lequel le produit
(10) est examiné à partir de deux directions différentes ( 12).
5. Procédé selon l'une quelconque des revendications précédentes, dans lequel la lumière
examinée est mélangée de façon aléatoire avec un câble à fibre optique aléatoire (18)
et la lumière émergeant du câble est dirigée vers des éléments différents de filtre
(28).
6. Procédé selon l'une quelconque des revendications précédentes, dans lequel un étalonnage
est réalisé en effectuant les étapes de procédé sur des produits ayant des attributs
connus devant être mesurés et en collectant les amplitudes de chaque partie filtrée,
les amplitudes sommées détectées du produit étant comparées aux valeurs-étalon pour
délivrer la décision de sélection.