Multi-channel audio treatment system and method

(19)

(11)

EP 2 046 076 A1

(12)	EUROPEAN PATENT APPLICATION

(43)	Date of publication:
	08.04.2009 Bulletin 2009/15

(21)	Application number: 07291210.8

(22)	Date of filing: 04.10.2007

(51)

International Patent Classification (IPC):

H04S 3/02^(2006.01)

H04S 1/00^(2006.01)

(84)	Designated Contracting States:
	AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR
	Designated Extension States:
	AL BA HR MK RS

(71)	Applicant: Hurtado-Huyssen, Antoine-Victor
	75019 Paris (FR)

(72)	Inventor:
	Hurtado-Huyssen, Antoine-Victor 75019 Paris (FR)

(74)	Representative: Demulsant, Xavier
	Dejade & Biset 35, rue de Châteaudun 75009 Paris 75009 Paris (FR)


	Remarks:
	Amended claims in accordance with Rule 137(2) EPC.

(54)	Multi-channel audio treatment system and method

(57) A multi-channel audio treatment method ensuring compatibility of a multi-channel signal and a stereo signal, comprising
- producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);
- producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);
- producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);
- adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

Description

FIELD OF THE INVENTION

[0001] The present invention relates to a multi-channel audio treatment system and method.

BACKGROUND OF THE INVENTION

[0002] To achieve compatibility between a multi-channel system and a stereo technique, US patent N° 5,638,451 discloses a transmission and storage method for audio signals. In this prior art method, signals from additional audio channels of the multi-channel audio system are added to the left and right basic signals of the multi-channel audio system, such that two modified stereo signals are created for reproduction via a stereo system.

[0003] US 2004/0141619 discloses a method of generating a left modified and a right modified audio signal for a stereo system from multi-channel audio signals with a left and a right channel and at least one further audio channel. In this prior art method, the signal of the channel of higher energy is modified in a filter with a transformation function in a first parallel branch and is modified in a second filter with a reverberation function in a second parallel branch, the modified signals being joined together in a summation unit.

[0004] W02005/036925 discloses an apparatus for processing a multi-channel audio signal in a stereo compatible manner. This prior art apparatus comprises means for providing a first Lc and second Rc downmix channels derived from the original channels, Lc and Rc being defined as follows:

wherein t, a and b are weighted factors smaller than 1, L is an original left channel, C is an original center channel, R is an original right channel, Ls is an original left surround channel and Rs is an original right surround channel.

SUMMARY OF THE INVENTION

[0005] A first object of the present invention is a multi-channel audio treatment method ensuring compatibility of a multi-channel signal and a stereo signal, this method comprising

producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);
producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);
producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);
adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

Advantageously, adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal comprises :

producing a mono component of the difference signal
producing a stereo component of the difference signal
adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, ) using adjustment variables.

[0006] Advantageously, said left-hand downmix channel dwnMxL(t) is defined as

said right-hand downmix channel dwnMxR(t) being defined as

eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal.
Advantageously, adjustment variables are two adjustment variables M, S, having values between 0 and 1, the output multi-channel signal being

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

[0007] A second object of the present invention is a computer program product comprising a computer usable medium having control logic stored therein for causing a computer to ensure compatibility of a multi-channel signal and a stereo signal, said control logic comprising

first computer readable program code for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);
second computer readable program code for producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);
third computer readable program code for producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);
fourth computer readable program code for adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.
Advantageously, said control logic comprises fifth computer readable program code for producing a mono component of the difference signal

and sixth computer readable program code for producing a stereo component of the difference signal

said computer program code comprising seventh computer readable program code for adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.
Advantageously, said control logic comprises eight computer readable program code for producing said left-hand downmix channel dwnMxL(t) has defined as

and said right-hand downmix channel dwnMxR(t) has defined as

eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal.
Advantageously, adjustment variables are two adjustment variables M, S, having values between 0 and 1, said control logic comprising computer readable program code for producing the following output multi-channel signal

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

[0008] A third object of the present invention is a multi-channel audio treatment device ensuring compatibility of a multi-channel signal and a stereo signal, comprising

means for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);
means for producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);
means for producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);
means for adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

[0009] Advantageously, the device comprises means for producing a mono component of the difference signal deltam(t) = 0,5*(deltaL(t)+deltaR(t)), means for producing a stereo component of the difference signal dettaS(t) = 0,5*(deltaL(t)-deltaR(t)) and means for adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

[0010] Advantageously, the device comprises means for producing left-hand downmix channel dwnMxL(t) defined as

said device comprising means for producing right-hand downmix channel dwnMxR(t) defined as

eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal.
adjustment variables being two adjustment variables M, S, having values between 0 and 1,
said device comprising means for producing output multi-channel

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal.

[0011] The above and other objects and advantages of the invention will become apparent from the detailed description of preferred embodiments, considered in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

[0012]

Figure 1 is a schematic block diagram for the process.

Figure 2 represents graphically the effect of the adjustment variable

DESCRIPTION OF PREFERRED EMBODIMENTS

[0013] Consider an audio programme (radio broadcast, soundtrack for an audio-visual programme, etc.) being presented in two formats: on the one hand, stereo, and on the other, multi-channel.

[0014] The process according to the invention acts in such a manner that the two formats produce the same audio results when reproduced on stereophonic and monophonic receivers.

[0015] To ensure this compatibility of the multi-channel format with the stereo and mono formats, the stereo downmix from the multi-channel signals must be equal to the original stereo format signal. To achieve this, the process according to the invention determines the difference between the original stereo signal and the stereo downmix from the multi-channel signal, and this difference, obtained by subtraction, is then added into the multi-channel signal. The addition of this difference into the multi-channel signal ensures mathematically a downmix of the multi-channel signal that is identical to the stereo signal.

[0016] The process according to the invention is characterized by the method of adding the difference signal into the multi-channel signal, on two points in particular: on the one hand, the process separates the mono component and the stereo component of the difference signal in order to add them independently into the multi-channel signal channels; on the other hand, the process offers two adjustment variables to control this addition into the various channels of the multi-channel signal.

[0017] The mathematical description of the process can be established as follows:

[0018] The input channels are:

eStL(t), the left-hand channel of the stereo signal

eStR(t), the right-hand channel of the stereo signal

eL(t), the left-hand channel of the multi-channel signal

eR(t), the right-hand channel of the multi-channel signal

eC(t), the centre channel of the multi-channel signal

eLFE(t), the sub-bass channel of the multi-channel signal

esL(t), the rear left-hand channel of the multi-channel signal

esR(t), the rear right-hand channel of the multi-channel signal.

[0019] The left-hand downmix channel is defined as:

[0020] The right-hand dowmix channel is defined as:

[0021] The difference signal channels are the left-hand channel of the difference signal deltaL(t) and the right-hand channel of the difference signal deltaR(t) as defined below:

[0022] The MS format conversion of the difference signal is:

the mono component of the difference signal
the stereo component of the difference signal

[0023] The adjustment variables control the distribution of the mono and stereo components of the difference signal. The value of these variables is between 0 and 1.

[0024] Adjustment variable 'M' distributes the monophonic component between the C(t) and L(t) / R(t) channels of the multi-channel signal.

[0025] Adjustment variable 'S' distributes the stereo component between the L(t) / R(t) and sL(t) / sR(t) channels of the multi-channel signal.

[0026] The output multi-channel signal is then:

and in the case where the adjustment variables are not being applied (M=1, S=1), the output signal is then:

[0027] The stereo signal remains unchanged.

Claims

1. A multi-channel audio treatment method ensuring compatibility of a multi-channel signal and a stereo signal, comprising

- producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);

- producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);

- adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

2. A multi-channel audio treatment method according to claim 1, wherein adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal comprises :

- producing a mono component of the difference signal

- producing a stereo component of the difference signal

- adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

3. A multi-channel audio treatment method according to claim 1 or 2, wherein said left-hand downmix channel dwnMxL(t) is defined as

said right-hand downmix channel dwnMxR(t) being defined as

4. A multi-channel audio treatment method according to claim 3, wherein adjustment variables are two adjustment variables M, S, having values between 0 and 1, the output multi-channel signal being

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

5. A computer program product comprising a computer usable medium having control logic stored therein for causing a computer to ensure compatibility of a multi-channel signal and a stereo signal, said control logic comprising

- first computer readable program code for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- second computer readable program code for producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);

- third computer readable program code for producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);

- fourth computer readable program code for adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

6. A computer program product according to claim 5, wherein said control logic comprises fifth computer readable program code for producing a mono component of the difference signal

and sixth computer readable program code for producing a stereo component of the difference signal

said computer program code comprising seventh computer readable program code for adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

7. A computer program product according to claim 6, wherein said control logic comprises eight computer readable program code for producing said left-hand downmix channel dwnMxL(t) has defined as

and said right-hand downmix channel dwnMxR(t) has defined as

0 eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal.

8. A computer program product according to claim 7, wherein adjustment variables are two adjustment variables M, S, having values between 0 and 1, said control logic comprising computer readable program code for producing the following output multi-channel signal

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

9. A multi-channel audio treatment device ensuring compatibility of a multi-channel signal and a stereo signal, comprising

- means for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- means for producing a left-hand difference channel deltaL(t), said left-hand difference channel being the difference between the left-hand channel of the stereo signal eStL(t) and the left-hand downmix channel dwnMxL(t);

- means for producing a right-hand difference channel deltaR(t), said right-hand difference channel being the difference between the right-hand channel of the stereo signal eStR(t) and the right-hand downmix channel dwnMxR(t);

- means for adding the right hand difference channel delatR(t) and the left hand difference channel deltaL(t) into the multi-channel signal.

10. A multi-channel audio treatment device according to claim 9, comprising means for producing a mono component of the difference signal deltaM(t) = 0,5*(deltaL(t)+deltaR(t)), means for producing a stereo component of the difference signal deltaS(t) = 0,5*(deltaL(t)-deltaR(t)) and means for adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

11. A multi-channel audio treatment device according to claim 9 and 10, comprising means for producing left-hand downmix channel dwnMxL(t) defined as

said device comprising means for producing right-hand downmix channel dwnMxR(t) defined as

eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal.
adjustment variables being two adjustment variables M, S, having values between 0 and 1,
said device comprising means for producing output multi-channel

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

Amended claims in accordance with Rule 137(2) EPC.

1. A multi-channel audio treatment method ensuring compatibility of a multi-channel signal and a stereo signal, comprising

- producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the input multi-channel signal.

- producing a mono component of the difference signal

- producing a stereo component of the difference signal

- adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

3. A multi-channel audio treatment method according to claim 1 or 2, wherein said left-hand downmix channel dwnMxL(t) is defined as

said right-hand downmix channel dwnMxR(t) being defined as

4. A multi-channel audio treatment method according to claim 3, wherein adjustment variables are two adjustment variables M, S, having values between 0 and 1, the output multi-channel signal being

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

5. A multi-channel audio treatment method according to claim 1, said 5 method using a computer program product comprising a computer usable medium having control logic stored therein for causing a computer to ensure compatibility of a multi-channel signal and a stereo signal, said control logic comprising

- first computer readable program code for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- fourth computer readable program code for adding the right hand difference channel deltaR(t) and the left hand difference channel deltaL(t) into the input multi-channel signal.

6. A multi-channel audio treatment method according to claim 5, wherein said control logic comprises fifth computer readable program code for producing a mono component of the difference signal

and sixth computer readable program code for producing a stereo component of the difference signal

7. A multi-channel audio treatment method according to claim 6, wherein said control logic comprises eight computer readable program code for producing said left-hand downmix channel dwnMxL(t) has defined as

and said right-hand downmix channel dwnMxR(t) has defined as

8. A multi-channel audio-treatment method according to claim 7, wherein adjustment variables are two adjustment variables M, S, having values between 0 and 1, said control logic comprising computer readable program code for producing the following output multi-channel signal

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

9. A multi-channel audio treatment device ensuring compatibility of a multi-channel signal and a stereo signal, comprising

- means for producing a left-hand downmix channel dwnMxL(t) and a right-hand downmix channel dwnMxR(t);

- means for adding the right hand difference channel delatR(t) and the left hand difference channel deltaL(t) into the input multi-channel signal.

10. A multi-channel audio treatment device according to claim 9, comprising means for producing a mono component of the difference signal deltaM(t)=0,5*(deltaL(t)+deltaR(t)), means for producing a stereo component of the difference signal deltaS(t)=0,5*(deltaL(t)-deltaR(t)) and means for adding said mono component of the difference signal and said stereo component of the difference signal to the multi-channel signal, using adjustment variables.

11. A multi-channel audio treatment device according to claim 9 and 10, comprising means for producing left-hand downmix channel dwnMxL(t) defined as

said device comprising means for producing right-hand downmix channel dwnMxR(t) defined as

eL(t) being the left-hand channel of the multi-channel signal
eR(t) being the right-hand channel of the multi-channel signal
eC(t) being the centre channel of the multi-channel signal
eLFE(t) being the sub-bass channel of the multi-channel signal
esL(t) being the rear left-hand channel of the multi-channel signal
esR(t) being the rear right-hand channel of the multi-channel signal
adjustment variables being two adjustment variables M, S, having values between 0 and 1,
said device comprising means for producing output multi-channel

wherein
eStL(t) is the left-hand channel of the stereo signal
eStR(t) is the right-hand channel of the stereo signal

Drawing

Search report

Cited references

REFERENCES CITED IN THE DESCRIPTION

This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

Patent documents cited in the description