FIELD OF THE INVENTION
[0001] The present invention relates to a method of adaptive blind equalization. Specifically,
the invention relates to a method of adapting in a device, such as a receiver, a modem
or a demodulator, an equalizer for blind equalization, and to a device for demodulating
a modulated signal, particularly a Phase Shift Keying (PSK) modulated signal, an Amplitude
Phase Shift Keying (APSK) modulated signal, a Differential Phase Shift Keying (DPSK)
modulated signal and/or a Differential Amplitude Phase Shift Keying (DAPSK) modulated
signal.
BACKGROUND OF THE INVENTION
[0002] In data communication, digital information is transmitted over a communication medium.
The communication channel consists of a digital signal processing device, a digital-to-analog
converter, a modulator, an amplifier and a coupling device on the transmitter side,
the communication medium and a coupling device, a demodulator, an analog-to-digital
converter and a digital signal processing device on the receiver side. The channel
shows some distortion which is time-variant due to the varying condition of the communication
medium (length, topology, environmental effects).
[0003] Channel distortion limits the transmission capacity and needs to be equalized. The
higher the bandwidth efficiency of the chosen modulation format is, the less channel
distortion is accepted for achieving a desired bit error rate. In the case where the
channel is time-varying, the equalizer must adaptively track the changing conditions
as fast as possible.
[0004] Adaptive channel equalization has been studied since the 1960s. Typical approaches
are:
- Training-symbol based adaptive equalization: The transmitter sends in a regular time
interval a defined signal sequence, which is known to the receiver. The receiver compares
the received signal with this defined sequence to update the channel equalizer. Since
part of the time is used to send auxiliary information (the defined signal sequence),
the bandwidth efficiency is reduced and the transmission delay increased.
- Blind equalization: unlike in the training-symbol based approach, no predefined information
is transmitted. The adaptive algorithm to update the equalizer relies only on the
information in the received signal. There are various approaches for blind equalization:
- Decision-feedback equalization (DFE): it minimizes the mean-squared error between
the equalizer output and the output of the decision device, which detects and recovers
the symbols. Its effectiveness is based on a good performance of the decision device.
The closer the initial settings to the optimal equalizer are, the better the performance.
If the initial settings are far from the optimum values, the adaptive equalizer might
end up in a spurious solution (since the detection device delivers wrong outputs).
Therefore, DFE must be combined with another method providing good initial settings
for the DFE.
- Constant-modulus algorithm (CMA): as described in J.R. Treichler, B.G. Agee, "A new approach to the multi-path correction of constant
modulus signals", IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.
ASSP-31, no. 2, 1983, pp. 459-472, the update algorithm for the adaptive equalizer forces the equalizer output to have
a defined average energy. The approach is insensitive to the phase, i.e. does not
make use of any information that the received signal carries in the phase. The algorithm
is effective for APSK and PSK signal constellation, but rather slow in the adaptation
process.
- Information-theoretical methods (IT): the information theoretic approach can be formulated
as recovering the probability distribution of the transmitted signal, i.e. the equalizer
is forced to process the received signal such that its probability distribution equals
the one of the transmitted signal, which is defined by selection of the modulation
scheme. The distance between two probability distributions can be measured by the
Kullback-Leibner divergency.
[0005] Conventionally, the update algorithms are based on a gradient of a cost/objective
function.
DESCRIPTION OF THE INVENTION
[0006] It is therefore an objective of the present invention to provide a method and a device
for adaptive blind equalization of modulated signals, particularly PSK, APSK, DPSK,
and/or DAPSK modulated signals. It is particularly an objective of the present invention
to provide a method of adapting an equalizer for adaptive blind equalization of modulated
signals that yields an efficient, i.e. rapid, convergence.
[0007] This objective is achieved by a method of adapting an equalizer for adaptive blind
equalization according to claim 1, and a device for demodulating a modulated signal
according to claim 7. Further preferred embodiments are evident from the dependent
claims.
[0008] According to the present invention, the above-mentioned objects are particularly
achieved in that, for adapting an equalizer for blind equalization of a modulated
signal received in a device, e.g. a receiver, a modem or a demodulator, from a transmitter,
determined in the device are equalizer coefficients based on an instantaneous gradient
of a cost function derived from the equalizer output. The cost function employs a
constant-modulus algorithm which enforces the equalizer output to have a defined average
energy, i.e. a constant average output. The gradient is a natural gradient which takes
into account the structure of the equalizer coefficients. The equalizer is updated
adaptively with the determined equalizer coefficients. It has been shown in
S. Amari, "Natural gradient works efficiently in learning", Neural Computation, 10:251-276,
1998, that forming the natural gradient yields efficient convergence for the de-convolution
problem. An implementation of the natural gradient-based algorithm is introduced in
S. Amari, S.C: Douglas, A. Cichocki, and H. H: Yang, "Multichannel blind de-convolution
and equalization using natural gradient", IEEE Int. Workshop on Wireless Communication,
pages 101-104, 1997. Thus, for PSK, APSK, DPSK, DAPSK and also for QAM modulated signals, applying the
natural gradient to the constant-modulus algorithm for determining the equalizer coefficients
makes possible an adaptive blind equalization with an efficient convergence.
[0009] In an alternative embodiment, the modulated signal is a PSK, an APSK, a DPSK or a
DAPSK modulated signal, and the cost function employs an information theoretic approach,
rather than the constant-modulus algorithm. Hence, the cost function enforces the
equalizer output to have a probability distribution equal to a probability distribution
of the modulated signal transmitted by the transmitter. Thus, for PSK, APSK, DPSK
and DAPSK modulated signals, applying the natural gradient to the information theoretic
approach for determining the equalizer coefficients makes possible an adaptive blind
equalization with an efficient convergence.
[0010] Typically the equalizer is configured to sample the input signal at 1/T
sym, T
sym being the period of the symbols in the modulated signal. Preferably, however, the
equalizer is configured as a so called fractionally-spaced equalizer using a sampling
rate higher than 1/T
sym, e.g. a multiple of 1/T
sym. Advantages of fractionally-spaced equalizers are described in
G.Ungerboeck "Fractional tap-spacing equalizer and consequences for clock recovery
in data modems", IEEE Transactions on Communications, Vol. COM-24, No.8, August 1976,
pp.856-864. Using a fractionally-spaced equalizer extends the possibilities of application of
the proposed method from PLC receivers/modems/demodulators to radio transmission,
particularly to mobile radio receivers/modems/demodulators.
[0011] In an embodiment, updates to the equalizer coefficients are scaled by a step size
function for protecting from noise outliers. The step size function is dependent on
the equalizer output. For fractionally-spaced equalizers, the step size function is
dependent on a down-sampled equalizer output.
[0012] In a further embodiment, the step size function is based on an estimated equalization
error which is determined based on the equalizer output and symbols detected by a
de-mapper from the equalizer output. Thus in this embodiment, the step-size of the
adaptive equalizer is controlled adaptively to optimize the tracking speed of the
equalizer.
[0013] In addition to a method of adapting an equalizer for blind equalization of a modulated
signal received from a transmitter, the present invention also relates to a device
for demodulating a modulated signal received from a transmitter via a communication
channel, e.g. a receiver, a modem or a demodulator for PLC or (mobile) radio communication.
[0014] In general, the proposed method and device are applicable in communication systems
where a phase ambiguity of the equalized channel is acceptable. Specifically, the
proposed CMA and information-theoretic approach for blind adaptive equalization is
applicable in a power line carrier where circular differential phase modulation schemes
(e.g. DPSK, ADPSK) are used. Though the proposed method equalizes the channel only
up to a phase ambiguity, this has no negative impact when differential modulation
schemes are applied.
BRIEF DESCRIPTION OF THE DRAWINGS
[0015] The present invention will be explained in more detail, by way of example, with reference
to the drawings in which:
Fig. 1a shows the phase-dependent factor of a non-linear function in the information-theoretic
approach,
Fig. 1b shows the amplitude-dependent factor of the non-linear function in the information-theoretic
approach,
Fig. 2 shows a block diagram illustrating a transmitter and a receiver with a blind
adaptive equalizer based on the information-theoretic approach,
Fig. 3 shows an impulse response of the channel (top), of the equalizer after adaptation
(middle) and of channel and equalizer combined (bottom),
Fig. 4 shows a graph comparing the evolution of intersymbol interference for the constant
modulus algorithm and the information-theoretic approach, both with the natural gradient
technique,
Fig. 5a shows the signals before equalization,
Fig. 5b shows the signals after equalization using the information-theoretic approach,
Fig. 6 shows a graph comparing the evolution of intersymbol interference for the constant
modulus algorithm using the standard or the natural gradient, and
Fig. 7 shows a graph comparing the evolution of intersymbol interference for the information-theoretic
approach using the standard or the natural gradient.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
[0016] Fig. 2 shows a block diagram illustrating schematically a device 10, e.g. a receiver,
a modem or a demodulator, for demodulating a modulated signal s' received from a transmitter
12 via a communication channel 11, e.g. a PLC carrier or a wireless radio communication
link. As is indicated in Fig. 2, communication channel 11 is affected by noise n.
Device 10 comprises a receiving filter 8, an equalizer 1 with equalizer coefficients
w, a down-sampling module 2, a nonlinearity module 3, a correlation module 4, a calculation
module 5, a step-size control module 6, and a symbol detector 7 (de-mapper). Depending
on the embodiment, equalizer 1 is a symbol-spaced equalizer (SSE) or a fractionally
symbol-spaced equalizer (FSE). They differ in the sampling rate of the equalized signal.
While in SSE, the received signal is sampled with the symbol rate as sampling frequency
1/
TS, the FSE input signal has a multiple sampling rate
ND/
TS. In the latter case, the equalizer output signal
u(k') is decimated to symbol rate or down-sampled in the down-sampling module 2 by a factor
of
ND yielding the signal
û(
k). The update equation for equalizer 1 can be stated as follows:
S1) In equalizer 1, calculation of ND equalizer output values by filtering x with w (sampling time: TS/ND):

where wi(k), i=0,...,N are the equalizer coefficients at time k. Signals are complex-valued and sampling is at symbol rate. In the initialization
phase, the equalizer coefficients w must be set.
S2) In down-sampling module 2, decimating to symbol rate or down-sampling by a factor
ND yields the symbol-spaced output signal (sampling time: TS):

[0017] Adaptive equalization is performed by maximizing or minimizing an objective or a
cost function
J(w0, ...,wN), respectively,
w0, ...,wN being the coefficients of equalizer 1. In the real-time environment, the adaptive
algorithm works on-line and updates for the equalizer coefficients
w0, ...,wN are built from the instantaneous gradient of J. The update formula for the standard
gradient is:

[0018] Where ∇ represents the gradient operator. The standard gradient does not take care
of the parameter structure. In contrast, the natural gradient technique introduced
by Amari, takes the parameter structure into account. The effect of the natural gradient
is similar to an orthogonalization of the parameter space.
[0019] Two cost functions for adaptive blind equalization are considered; the information-theoretic
approach and the Constant Modulus algorithm.
Information-Theoretic Approach
[0020] As mentioned above, the information-theorgtic approach for blind equalization seeks
to recover the probability distribution function (pdf) of the source signal (the pdf
is described by the PSK and APSK constellation, for example). At the same time, the
statistical independence within the time series of the received symbols (equalizer
output) is maximized. To achieve these goals, cost functions are introduced. Deriving
the gradient of these cost functions yield update terms for adaptive equalization.
For example, the cost function describing the closeness of the pdf of the source signal
with the pdf of the equalizer output, is the well-known
Kullback-Leibner divergence (KL):

[0021] Where

p
s represents the pdf of the source signal (e.g. the APSK or PSK constellation) and
pu the pdf of the equalizer output.
[0022] The Kullback-Leibner divergence is always either nonnegative, or 0, if
ps ≡
pu. For discrete distribution
ps, the KL must only be evaluated for the finite support of
ps. The KL is minimized when only noise n is superposed and channel distortion is equalized.
Thus, the KL is used as cost function to derive a gradient for adaptive blind equalization.
[0023] The gradient is first derived for a cyclic convolution in the channel and then approximated
for the linear convolution. Applying the natural gradient, which has a similar effect
as the orthogonalization of the parameter space, yields the update rule:

where
w(
k) represents the equalizer filter taps, µ the step size,
δ(0) a Kronecker-Delta sequence with

[0024] û(
k) the equalizer output signal decimated by the factor N
D,
û(
k)=
u(
NDk),

the complex-conjugate time-reversed equalizer output series with
u(k) (
i) =
conj(
u(
kND -
i)), and * the convolution of
w(
k), and the time series in the brackets
f(.) is the so-called score function which is defined as
f(·)
= p's (·)/
ps(·).
f is applied to

is then multiplied with
f(
û(
k)). Since perfect equalization requires infinite length of the equalizer filter, which
is generally non-causal, real implementations are approximations. For this, the equalizer
filter is initialized by a
w(0) which is 0 apart from the D
th tap which is 1. By this, a delay of D is introduced to approximate the non-causal
ideal equalizer by a causal filter.
[0025] Thus, with the information theoretic approach, subsequent to S 1 and S2, the next
steps are:
NT3) Calculation in the nonlinearity module 3 of a nonlinear function f of the down-sampled equalizer output. Ideally, this nonlinear function is the score
function (see above). In the case of discrete and complex-valued signals, f(u) must be approximated. For APSK and PSK signals, preferably, f(u) is approximated as a product of a phase-dependent and an amplitude-dependent factor:

where the phase-dependent factor is (M symbols on a circle)

and the amplitude-dependent factor becomes:

for PSK, where A is the amplitude of the symbols and

for APSK, where Amin and Amax describe the amplitudes of the inner and the outer circle of the APSK constellation
(here an APSK constellation with 2 radii Amin and Amax is assumed, but this can be extended to more radii). The phase-dependent factor and
the amplitude-dependent factor of the non-linear function are shown in Fig. 1a or
Fig. 1b, respectively.
IT4) Correlating in correlation module 4 the complex-conjugate equalizer output signal
u with the equalizer filter coefficients w:

IT5) Determining in calculation module 5 the update term of the equalizer coefficients
wi:

Where µ(k) describes the step size. Derivation of this update algorithm is given in S. Amari, S.C: Douglas, A. Cichocki, and H. H: Yang, "Multichannel blind de-convolution
and equalization using natural gradient", IEEE Int. Workshop on Wireless Communication,
pages 101-104, 1997.
IT6) To protect the algorithm from the effect of outliers in the additive noise, included
is the step-size control module 6 with a correction mechanism such as:

where µ0 can be selected as a constant.
Furthermore, the step size calculation can be enhanced by taking the current progress
of the adaptation into account by defining µ0 as a function h of the magnitude of the equalization error e: the smaller the equalization error
is, the smaller has the step size to be chosen to reduce the equalization error further.

y(k) being the detected symbol provided by symbol detector 7.
Constant Modulus (CMA)
[0027] Where

and
q=
1,2,3,..., CMA referring to
q=
2, as outlined in
J.R. Treichler, B.G. Agee, "A new approach to the multi-path correction of constant
modulus signals," IEEE Transactions on Acoustics, Speech, and Signal Processing, vol.
ASSP-31, no. 2, 1983, pp. 459-472.
[0028] Deriving the cost function for CMA with respect to the filter coefficients yields
the update formula for the equalizer coefficients
wi:

being the complex-conjugate time-reversed equalizer output series, with

[0029] Applying the natural gradient yields

[0030] The update of the equalizer is done with a frequency of the symbol rate.
[0031] Thus, with the CM algorithm, subsequent to S 1 and S2, the next steps are:
CMA3) Calculation in the nonlinearity module 3 of the nonlinear term

respectively

CMA4) Correlating in correlation module 4 the complex-conjugate equalizer output signal
with the equalizer filter coefficients wi:

CMA5) Determining in calculation module 5 the update term of the equalizer coefficients:

where
y(k) describes the step size as in step IT6).
[0032] Based on simulations, Fig. 3 illustrates the effectiveness of the information-theoretic
approach for the adaptation of the equalizer 1. For the simulation, a non-minimum-phase
channel impulse response was selected. In Fig. 3 illustrated are, at the top, the
impulse response of the channel 11, the sampling time being equal to the symbol time;
in the middle, the equalizer 1 after adaptation; and at the bottom, the channel 11
and equalizer 1 combined.
[0033] Figs. 5a and 5b show the sampled symbols before and after the equalization, respectively,
when the information-theoretic approach with step-size 0.02 was applied.
[0034] Figs. 4 and 6 show the evolution of the intersymbol interference of the overall impulse
response, i.e. evaluated as the summed square of the difference between the ideal
and the equalized impulse response for the different algorithm when APSK symbols were
transmitted (in both cases with additive white Gaussian noise of 30dB). As can be
seen in Fig. 6, the natural gradient approach for CMA, is much faster than the standard-gradient
approach. Fig. 4 shows that the information-theoretic approach and CMA, both with
the natural gradient, are comparable in adaptation speed. For each algorithm, the
step-size was selected to achieve the same remaining intersymbol interference. The
step-size was kept constant during the simulation. It is advantageous to use a time-varying
step-size µ(k) that is dependent on an error measure in addition to the protection
from outliers.
[0035] Fig. 7 shows the evolution of the intersymbol interference for the case of PSK symbols
(PSK signal constellation). As can be seen in Fig. 7, the three algorithms (information-theoretic
approach, CMA with natural and standard gradient) show a comparable performance (in
all cases with additive white Gaussian noise of 30dB).
1. A method of adapting in a device (10) an equalizer (1) for blind equalization of a
modulated signal received from a transmitter (12), the method comprising:
determining in the device (10) equalizer coefficients (w) based on an instantaneous
gradient of a cost function derived from equalizer output (u(k')), the cost function
employing a constant-modulus algorithm enforcing the equalizer output decimated to
symbol rate (û(k)) to have a defined average energy, and the gradient being a natural gradient taking
into account a structure of the equalizer coefficients (w), and updating adaptively
the equalizer coefficients (w).
2. The method according to claim 1, wherein the modulated signal is one of a Quadrature
Amplitude Modulated signal, a Phase Shift Keying modulated signal, an Amplitude Phase
Shift Keying modulated signal, a Differential Phase Shift Keying modulated signal,
and a Differential Amplitude Phase Shift Keying modulated signal.
3. The method according to claim 1, wherein the modulated signal is one of a Phase Shift
Keying modulated signal, an Amplitude Phase Shift Keying modulated signal, a Differential
Phase Shift Keying modulated signal, and a Differential Amplitude Phase Shift Keying
modulated signal, and wherein the cost function employs an information theoretic approach,
rather than the constant-modulus algorithm, enforcing the equalizer output decimated
to symbol rate (û(k)) to have a probability distribution equal to a probability distribution of the modulated
signal transmitted by the transmitter (12).
4. The method according to one of claims 1 to 3, wherein the equalizer (1) uses a sampling
rate higher than 1/Tsym, Tsym being the period of symbols transmitted with the modulated signal.
5. The method according to one of claims 1 to 4, wherein updates to the equalizer coefficients
(w) are scaled by a step size function for protecting from noise outliers, the step
size function being dependent on the equalizer output, decimated to symbol rate, (û(k)).
6. The method according to claim 5, wherein the step size function is based on an estimated
equalization error (e), the estimated equalization error (e) being determined based
on the equalizer output, decimated to symbol rate, (û(k)) and symbols detected from the equalizer output.
7. A device (10) for demodulating a modulated signal received from a transmitter (12)
via a communication channel (11), the device comprising:
an equalizer (1) for blind equalization of the modulated signal,
means for determining in the device equalizer coefficients (w) based on an instantaneous
gradient of a cost function derived from equalizer output decimated to symbol rate
(û(k)), the cost function employing a constant-modulus algorithm enforcing the equalizer
output decimated to symbol rate (û(k)) to have a defined average energy, and the gradient being a natural gradient taking
into account a structure of the equalizer coefficients (w), and
means for updating adaptively the equalizer coefficients (w).
8. The device (10) according to claim 7, wherein the modulated signal is one of a Quadrature
Amplitude Modulated signal, a Phase Shift Keying modulated signal, an Amplitude Phase
Shift Keying modulated signal, a Differential Phase Shift Keying modulated signal,
and a Differential Amplitude Phase Shift Keying modulated signal.
9. The device (10) according to claim 7, wherein the modulated signal is one of a Phase
Shift Keying modulated signal, an Amplitude Phase Shift Keying modulated signal, a
Differential Phase Shift Keying modulated signal, and a Differential Amplitude Phase
Shift Keying modulated signal, and wherein the means for determining the equalizer
coefficients (w) are configured to use a cost function that employs an information
theoretic approach, rather than the constant-modulus algorithm, enforcing the equalizer
output decimated to symbol rate (û(k)) to have a probability distribution equal to a probability distribution of the modulated
signal transmitted by the transmitter.
10. The device (10) of claim 9, wherein the communication channel (11) is one of a power
line communication carrier and a radio communication channel.