Field of the Invention
[0001] This invention relates to monitoring of machines. In particular, it relates to monitoring
of machinery performance, especially rotating machines and to predict failure time.
Background
[0002] Rotating machinery, such as fans, is often mission critical and it can be very important
to be able to predict the lifetime and probable time-to-failure of such machinery
in order that planned maintenance and replacement may take place with minimal downtime.
[0003] Presently, failure times are predicted by measuring at least one parameter of a machine
in order to predict a time at which failure of the machine is anticipated based on
said method parameter. The parameters measured can be acquired from a number of different
types of data such as airborne acoustic noise or structure borne acoustic emissions
(ie vibrations). However, the parameters acquired from these different types of data
can be negatively affected by the presence of external noise. This external noise
may be background acoustic noise, external vibrations or noise from nearby machinery
or vehicles or other externally generated noise. It might be acoustic noise or could
also mean electromagnetic noise. Such external noise can lead to confusion in the
system and poor results, leading to poor system performance.
[0004] No previously proposed systems are known which factor in the presence of external
noise.
[0005] The present invention arose in an attempt to provide an improved method and system
for predicting failure times of rotating machinery.
Summary of the Invention
[0006] According to the present invention, in a first aspect, there is provided a method
of machine monitoring comprising measuring, over time, at least two different modes
of data relating to the machine and fusing the data in a manner which takes into account
environmental factors, in order to provide an indication of wear of the machine.
[0007] Preferably, the method is used for predicting time to failure (or remaining useful
lifetime (RUL)). The modes of data may be selected from various modes, such as acoustic
noise, structure-borne noise (vibration) or temperature, for example.
[0008] Most preferably, a decision level adaptive fusion approach of multiple modes of data
is used in order to predict failure time of the machine. This applies weightings to
the fusion which takes into account the different effects that environmental factors,
such as external noise, have upon the different modes.
[0009] Preferably, the fusion method takes into account confusion of output probabilities
of each classifier, whereby a relatively high confusion is likely to represent a relatively
low signal to noise ratio of the monitored data for a mode and a relatively low confusion
likely to represent a relatively high signal to noise ratio of the monitored data
for a mode.
[0011] According to the present invention in a further aspect, there is provided a method
of machine monitoring comprising measuring, over time, two different modes of data
relating to machine and fusing the data in a manner which takes into account environmental
factors, in order to monitor one or more parameters relating to the machine's performance.
[0012] The individual parameters measured may be used to obtain individual and independent
classifiers, which can then be combined using decision fusion techniques in order
to make a determination as to RUL or other parameters relating to functioning of a
machine.
[0013] A measure of confusion may be used to determine how each different modality (parameter)
is being effected by external noise factors. For example, measures of the entropy
or variance of classifier output scores can be used to determine confusion levels
of each mode.
[0014] In preferred embodiments, weighting is used to weight the contribution of each mode
before decision level multi-modal fusion, whereby modes that are relatively noise
free are weighted more heavily than those modes that are more effected by external
noise factors.
Description of Drawings
[0015] Embodiments of the invention will now be described, by way of example only, with
reference to the accompanying drawings, in which:
Figure 1 shows schematically a machine and sensors for measuring two parameters;
Figure 2 shows a machine that senses the measuring three parameter; and
Figure 3 shows a chart showing the main steps in a decision making method.
Description of Some Embodiments of the Invention
[0016] Referring to Figure 1, a machine 1 may comprise a rotating machine such as a fan,
or possibly a plurality of machines.
[0017] At least two modes of data (modalities), ie different parameters relating to the
functioning and operation of the machine, are measured. These may relate to, for example,
acoustic airborne noise, structure borne noise (ie vibration), temperature (either
at a point of the machine itself or in its vicinity|) or other modes of data. Figure
1 shows two such modes, in this case this might be acoustic data (airborne noise)
2 and vibration data 3 which measures variation at the machine. However, any number
of different modes of data may be measured.
[0018] Figure 2 shows an alternative arrangement comprising sensors for measuring. acoustic
noise 2, vibrations 3 and temperature 4.
[0019] Sensors 2 to 4 in the figure may be any convenient type of sensor for measuring the
relevant mode of data. For example, microphones or other transducers may be used to
measure acoustic signal; temperature sensors to measure temperature; or other sensors
may be used to measure other parameters. Outputs from these are then applied to a
computational unit 5 for further processing. Instead of a single unit, this may of
course comprise a number of different units, such as individual units for extracting
relevant features and classifiers from each of the modes of data and then a further
unit for combining these, or this may all be done in a single unit.
[0020] Data is obtained from the various sensors at fixed or variable sampling rates over
time while the machine is operating, or alternatively during an initial testing phase.
[0021] During an initial classification process, the various modalities (ie acoustic input,
vibration input, temperature input, and so on), and processed independently, to generate
respective independent classifiers.
[0022] Figure 3 shows a typical method for determining remaining useful lifetime (RUL) of
a rotating machine.
[0023] Referring to the figure, two sets of data are obtained in this example. As described,
however, more than two sets may be obtained, ie three or more types of data may be
obtained.
[0024] In the example, the sets of data are acoustic data and vibration data. The acoustic
data is obtained from a suitable sensor 2 (eg a microphone) as raw acoustic samples
5. These samples may be obtained at periodic intervals, such as every second, every
minute, every hour or any other time interval, which interval may vary. The samples
will of course obtain, in addition to acoustic noise generated by the machine itself,
environmental and external noise generated by external sources such as motor vehicles,
external machinery and others.
[0025] Similarly, vibration data is obtained from vibration sensor 3 and used to obtain
raw vibration sample 6, again at the same or different sampling rates. The vibrations
from the machine will also be affected to external perturbations affecting the vibration
of the machine and these might arise for example from air currents, the operation
of other machinery or plant in the vicinity, movements of a vehicle in which the machine
is in, or many other external factors which will affect the vibrations of the machine.
[0026] Each of the samples 5 and 6 is applied to a separate and independent feature extraction
engine 7, 8 respectively. Feature extraction is in itself an known technique and a
set of representative features is obtained from each of the independent feature extraction
engines 7 and 8. These are applied to respective classifiers for the acoustic data
9 and for the vibration data 10.
[0027] Classifiers are also well-known in themselves. A classifier essentially represents
a mapping from a discrete or continuous feature space to a discrete set of labels.
The classifier may be, for example, an indication of wear, such that classification
A means that the machine is barely worn, classification B means that the machine is
beginning to wear and classification C means that the machine is nearly worn out.
In quantitative terms, classification A may mean that the machine is zero to one third
worn, classification B from one third to two thirds and classification C greater than
two thirds worn, on a simplistic level.
[0028] The outputs from the independent classifiers 9 and 10 are then combined in a decision
fusion technique at a decision level fusion engine 11 which combines them in order
to determine a hopefully more accurate remaining useful life (RUL) prediction 12.
[0029] The decision fusion may be a multiplicative, additive or other process, including
combinations of processes.
[0030] In a simple fusion technique, the output of the two classifiers 9 and 10 represent
a list of all possible classes/outcome, ie worn, partially worn, not worn, and their
associated scores (probability). Thus, there may be a probability Pa of a first wear
state, Pb of a second wear state and Pc of a third wear state. The scores are simply
multiplied in the decision level fusion 11 or their log scores are added and the most
likely output is determined.
[0031] A mechanism may also be provided which provides information on the reliability of
each modality (ie acoustic and vibration input in the example of Figure 3) and thereby
weightings that should be applied to each. That is, if it is found that acoustic data
is more reliable in determining wear (or other parameters) than vibration data then
greater emphasis and weighting may be placed upon the results from the acoustic classification
than the vibration classification.
[0032] Adaptive weightings are weightings that are dynamically adjusted during the fusion
process. In one example of a fusion scheme, the process is multiplicative using rules
of probability. Such a scheme initially selects a candidate that maximises the product
of the N-best output probabilities of the modalities.
[0033] In more detail, a scheme may use the following equation:

where
Pav is the joint probability of the acoustic and vibrational modes of each class k, given
the feature set x.
Let l be the number of possible classes, k is one of the l classes.
x is the set of features; acoustic or vibrational.
σa and σv are the variances of the audio and vibrational modality's N-best output
probabilities, respectively. The visual N-best output probabilities are weighted using
λ and the audio N-best output probabilities using 1 -λ.
[0034] The N-best output probabilities of the acoustic and vibration mode are weighted according
to the dispersion, variances or entropy of their N-best output probabilities. They
will therefore account to some extent for the confusability of the N-best probabilities
or outputs from each classifier which can be affected by external noise factors. The
weighting scheme accounts for the reliability of each of these modes.
[0035] The contribution of each mode is then adaptively weighted before performing decision
level multi-modal fusion. In this adaptive weighting process, each mode is evaluated
and the mode that is considered to be least effected by external noise factors is
weighted more heavily than that is more affected.
[0036] An example is given below.
[0037] In the example shown in Figure 3, the two modes are acoustic and vibration data.
A separate classifier 9 and 10 respectively is trained for each type of data or mode.
For each sample presented to the classifier (ie from the respective feature extraction
module 7 and 8) a list of probabilities for each potential class is provided. In one
example, there are three possible classes, classes A to C. In some embodiments, there
may be more or less than three classes. As described, the classes may represent the
degree of wear, or other parameters relating to the functioning and RUL of the machine.
In one embodiment, the output classes for each class A to C given by the acoustic
classifier 9 are:
Probability of Class A : 0.6
Probability of Class B : 0.3
Probability of Class C : 0.1
[0038] The output probabilities for each Class A to C given by vibration classifier:
Probability of Class A : 0.33
Probability of Class B : 0.33
Probability of Class C : 0.34
[0039] It is seen from this that the vibration classifier 10 is confused in that it provides
broadly similar probabilities for all three classes. This could well be due to vibration
data being corrupted with noise, which confuses the classifier. Alternatively, the
vibration data may not provide enough information to clearly separate the classes
A to C.
Thus, a relatively high 'confusion' for a mode of data is considered to represent
a low signal to noise ratio for that mode, suggesting the mode is more prone to noise
interference. A low 'confusion' on the other hand indicates a higher signal to noise
ratio, suggesting less noise interference.
[0040] In real world terms, this may be envisaged in that if there were no environmental
factors at all then increased vibration from a machine might normally be implied as
meaning that the machine is wearing more. However, if there are external factors then
an external factor which causes an extensive vibration might overwhelm an inherent
small vibration of the machine at any time.
[0041] From the above probabilities, it is seem that the acoustic classifier is much less
confused as this assigns a much higher probability to Class A, a lower probability
to Class B and significantly lower still probability to Class C. Thus, a clear decision
can be made from classifier 9.
[0042] Thus, in the decision level fusion 11, the acoustic output can be weighted higher
than the vibration output. The acoustic output is considered to be much less affected
by external environmental factors than the vibrational classifier. By weighting the
acoustic output higher than the vibration output, the affects of vibration or noise
on the overall multi-modal system decision is minimised.
[0043] The machine or machines upon which the process may be used might be a fan or other
rotating machine operated in a factory, data centre or wind farm for example.
[0044] The description and drawings merely illustrate the principles of the invention. It
will thus be appreciated that those skilled in the art will be able to devise various
arrangements that, although not explicitly described or shown herein, embody the principles
of the invention and are included within its spirit and scope. Furthermore, all examples
recited herein are principally intended expressly to be only for pedagogical purposes
to aid the reader in understanding the principles of the invention and the concepts
contributed by the inventor(s) to furthering the art, and are to be construed as being
without limitation to such specifically recited examples and conditions. Moreover,
all statements herein reciting principles, aspects and embodiments of the invention,
as well as specific examples thereof, are intended to encompass equivalents thereof.
[0045] Embodiments may be used to provide indication of RUL of a machine (or group of machines)
or other parameters or indications relating to wear, such as an indication of when
a machine or a component is likely to need servicing or maintenance, or when it is
likely to be X% worn, or other indications.
1. A method of machine monitoring comprising measuring, over time, at least two different
modes of data relating to the machine and fusing the data in a manner which takes
into account environmental factors, in order to provide an indication of wear of the
machine.
2. A method as claimed in Claim 1, comprising extracting one or more parameters from
each mode of data and using each one as an input to a respective classifier for that
mode, wherein outputs from the classifiers are used to determine the parameters relating
to wear.
3. A method as claimed in Claim 1, used for estimating the remaining useful lifetime
(RUL) of the machine.
4. A method as claimed in Claim 1, 2 or 3, wherein the two different modes of data are
used to obtain independent classifiers which are combined using decision fusion.
5. A method as claimed in Claim 4, wherein a measure of confusion is used to determine
the affect on each individual modality of data of external noise factors.
6. A method as claimed in Claim 4 or 5, wherein the fusion method takes into account
confusion of output probabilities of each classifier, whereby a relatively high confusion
is likely to represent a relatively low signal to noise ratio of the monitored data
for a mode and a relatively low confusion likely to represent a relatively high signal
to noise ratio of the monitored data for a mode.
7. A method as claimed in Claim 5 or 6, wherein the measure of confusion is entropy or
variants of classifier scores.
8. A method as claimed in any preceding claim, wherein the contribution of each of mode
measured data is weighted and modes that are considered to be relatively noise free
are weighted more heavily than those modes that are more affected by external noise
factors.
9. A method as claimed in any preceding claim, wherein a candidate that maximises the
product of the N-best output probabilities of the modes of data is selected.
10. A method as claimed in Claim 9, wherein the joint probability P
av of the modes of data of each class a, given the feature set x, is determined according
to:

where

P
av is the joint probability of the acoustic and vibrational modes of each class k, given
the feature set x; I is the number of possible classes, k is one of the I classes;
x is the set of features; acoustic or vibrational; σa and σv are the variances of
the audio and vibrational modality's N-best output probabilities, respectively.
11. A method as claimed in any preceding claim, wherein the two or more modalities of
data are used to generate respective classifiers and the classifiers are used to determine
the relative effects of environmental noise on the measurement of each respective
mode of data, and wherein weightings are applied accordingly.
12. Apparatus for measuring one or more parameters relating to functioning of a machine,
comprising monitoring, over time, two or more modes of data independently and combining
the result with a weighting according to the effect environmental noise has on each
mode of data to determine said parameter.
13. Apparatus as claimed in Claim 12, wherein the parameter is remaining useful lifetime
(RUL).
14. Apparatus as claimed in Claim 12 or Claim 13, including sensors for sensing at least
two modes of data and computational means adapted to receive inputs from the sensors
and to determine RUL.
15. Apparatus as claimed in claim 14, wherein the sensors are for measuring, respectively,
sound and vibration modes of data.