|
(11) | EP 1 557 827 A1 |
| (12) | EUROPEAN PATENT APPLICATION |
| published in accordance with Art. 158(3) EPC |
|
|
|
|
||||||||||||||||||||
| (54) | VOICE INTENSIFIER |
| (57) A voice intensifier capable of reducing abrupt changes in the amplification factor
between frames and realizing excellent sound quality with less noise feeling by dividing
input voices into the sound source characteristic and the vocal tract characteristic,
so as to individually intensify the sound source characteristic and the vocal tract
characteristic and then synthesize them before being output. The voice intensifier
comprises a signal separation unit for separating the input sound signal into the
sound source characteristic and the vocal tract characteristic, a characteristic extraction
unit for extracting characteristic information from the vocal tract characteristic,
a corrective vocal tract characteristic calculation unit for obtaining vocal tract
characteristic correction information from the vocal tract characteristic and the
characteristic information, a vocal tract characteristic correction unit for correcting
the vocal tract characteristic by using the vocal tract characteristic correction
information, and a signal synthesizing means for synthesizing the corrective vocal
tract characteristic from the vocal tract characteristic correction unit and the sound
source characteristic, so that the sound synthesized by the signal synthesizing means
is output. |
[0001] The present invention relates to a voice enhancement device which makes the received voice in a portable telephone or the like easier to hear in an environment in which there is ambient background noise.
[0002] In recent years, portable telephones have becomes popular, and such portable telephones are now used in various locations. Portable telephones are commonly used not only in quiet locations, but also in noisy environments with ambient noise such as airports and [train] station platforms. Accordingly, the problem of the received voice of portable telephones becoming difficult to hear as a result of ambient noise arises.
[0003] The simplest method of making the received voice easier to hear in a noisy environment is to increase the received sound volume in accordance with the noise level. However, if the received sound volume is increased to an excessive extent, there may be cases in which the input into the speaker of the portable telephone becomes excessive, so that sound quality conversely deteriorates. Furthermore, the following problem is also encountered: namely, if the received sound volume is increased, the burden on the auditory sense of the listener (user) is increased, which is undesirable from the standpoint of health.
[0004] Generally, when ambient noise is large, the clarity of voice is insufficient, so that the voice becomes difficult to hear. Accordingly, a method is conceivable in which the clarity is improved by amplifying the high-band components of the voice at a fixed rate. In the case of such a method, however, not only the high-band components, but also noise (transmission side noise) components contained in the received voice, are enhanced at the same time, so that the sound quality deteriorates.
[0005] Here, there are generally peaks in the voice frequency spectrum, and these peaks are called formants. An example of the voice frequency spectrum is shown in Fig. 1. Fig. 1 shows a case in which there are three peaks (formants) in the spectrum. In order from the low frequency side, these formants are called the first formant, second formant and third formant, and the peak frequencies fp(1), fp(2) and fp(3) of the respective formants are called the formant frequencies.
[0006] Generally, the voice spectrum has the property of showing a decrease in amplitude (power) as the frequency becomes higher. Furthermore, the voice clarity has a close relationship to the formants, and it is known that the voice clarity can be improved by enhancing the higher (second and third) formants.
[0007] An example of spectral enhancement is shown in Fig. 2. The solid line in Fig. 2 (a) and the dotted line in Fig. 2 (b) show the voice spectrum prior to enhancement. Furthermore, the solid line in Fig. 2 (b) shows the voice spectrum following enhancement. In Fig. 2 (b), the slope of the spectrum as a whole is flattened by increasing the amplitudes of the higher formants; as a result, the clarity of the voice as a whole can be improved.
[0008] A method using a band splitting filter (Japanese Patent Application Laid-Open No. 4-328798) is known as a method for improving clarity by enhancing such higher formants. In this method using a band filter, the voice is split into a plurality of frequency bands by part of this band splitting filter, and the respective frequency bands are separately amplified or attenuated. In this method, however, there is no guarantee that the voice formants will always fall within the split frequency bands; accordingly, there is a danger that components other than the formants will also be enhanced, so that the clarity conversely deteriorates.
[0009] Furthermore, a method in which protruding parts and indented parts of the voice spectrum are amplified or attenuated (Japanese Patent Application Laid-Open No. 2000-117573) is known as a method for solving the problems encountered in the abovementioned conventional method using a band filter. A block diagram of this conventional technique is shown in Fig. 3. In this method, the spectrum of the input voice is determined by a spectrum estimating part 100, protruding bands and indented bands are determined from the determined spectrum by a protruding band (peak)/indented band (valley) determining part 101, and the amplification factor (or attenuation factor) is determined for these protruding bands and indented bands.
[0010] Next, coefficients fir realizing the abovementioned amplification factor (or attenuation factor) are given to a filer part 103 by a filter construction part 102, and enhancement of the spectrum is realized by inputting the input voice into the abovementioned filter part 103.
[0011] In other words, in conventional methods using a band filter, voice enhancement is realized by separately amplifying peaks and valleys of the voice spectrum.
[0012] In the abovementioned conventional technique, in the case of methods in which the sound quantity is increased, there are cases in which an increase in the sound quantity results in an excessive input into the speaker, so that the playback sound is distorted. Furthermore, if the received sound quantity is increased, the burden on the auditory sense of the listener (user) is increased, which is undesirable from a health standpoint.
[0013] Furthermore, in conventional methods using a high-band enhancement filter, if simple high-band enhancement is used, high bands of noise other than the voice are enhanced, so that the feeling of noise is increased, which does not always lead to an improvement in clarity.
[0014] Moreover, in conventional methods using a band splitting filter, there is no guarantee that the voice formants will always fall within the split frequency bands. Accordingly, there may be cases in which components other than the formants are enhanced, so that the clarity conversely deteriorates. Furthermore, since the input voice is amplified without separating the sound source characteristics and the vocal tract characteristics, the problem of severe distortion of the sound source characteristics arises.
[0015] Fig. 4 shows a voice production model. In the process of voice production, the sound source signal produced by the sound source (vocal chords) 110 is input into a sound adjustment system (vocal tract) 111, and vocal tract characteristics are added in this vocal tract 111. Subsequently, the voice is finally output as a voice waveform from the lips 112 (see "Onsei no Konoritsu Fugoka" ["High Efficiency Encoding of Voice"]m pp. 69-71, by Toshio Nakada, Morikita Shuppan).
[0016] Here, the sound source characteristics and vocal tract characteristics are completely different characteristics; however, in the case of the abovementioned conventional technique using a band splitting filter, the voice is directly amplified without splitting the voice into sound source characteristics and vocal tract characteristics. Accordingly, the following problem arises: namely, the distortion of the sound source characteristics is great, so that the feeling of noise is increased, and the clarity deteriorates. An example is shown in Figs. 5 and 6. Fig. 5 shows the input voice spectrum prior to enhancement processing. Furthermore, Fig. 6 shows the spectrum in a case where the input voice shown in Fig. 5 is enhanced by a method using a band splitting filter. In Fig. 6, the amplitude is amplified while maintaining the outline shape of the spectrum in the case of high band components of 2 kHz or greater. However, in the case of portions in the range of 500 Hz to 2 kHz (portions surrounded by circles in Fig. 6), it is seen that the spectrum differs greatly from the spectrum shown in Fig. 5 prior to enhancement, with a deterioration in the sound source characteristics.
[0017] Thus, in conventional methods using a band splitting filter, there is a danger that the distortion of the sound source characteristics will be great, so that the sound quality deteriorates.
[0018] Furthermore, in methods in which the abovementioned protruding portions or indented portions of the spectrum are amplified, the following problems exist.
[0019] First of all, as in the abovementioned conventional methods using a band splitting filter, the voice itself is directly enhanced without splitting the voice into sound source characteristics and vocal tract characteristics; accordingly, the distortion of the sound source characteristics is great, so that the feeling of noise is increased, thus causing a deterioration in clarity.
[0020] Secondly, direct formant enhancement is performed for the LPC (linear prediction coefficient) spectrum or FFT (frequency Fourier transform) spectrum determined from the voice signal (input signal). Consequently, in cases where the input voice is processed for each frame, the conditions of enhancement (amplification factor or attenuation factor) vary between frames. Accordingly, if the amplification factor or attenuation factor varies abruptly between frames, the feeling of noise is increased by the fluctuation of the spectrum.
[0021] Such a phenomenon is illustrated in a bird's eye view spectrum diagram. Fig. 7 shows the spectrum of the input voice (prior to enhancement). Furthermore, Fig. 8 shows the voice spectrum in a case where the spectrum is enhanced in frame units. In particular, Figs. 7 and 8 show voice spectra in which frames that are continuous in time are lined up. It is seen from Figs. 7 and 8 that the higher formants are enhanced. However, discontinuities are generated in the enhanced spectrum at around 0.95 seconds and around 1.03 seconds in Fig. 8. Specifically, in the spectrum prior to enhancement shown in Fig. 7, the formant frequencies vary smoothly, while in Fig. 8, the formant frequencies vary discontinuously. Such discontinuities in the formants are sensed as a feeling of noise when the processed voice is actually heard.
[0022] In Fig. 3, a method in which the frame length is increased is conceived as a method for solving the problem of discontinuity, which is the second of the abovementioned problems. If the frame length is lengthened, average spectral characteristics with little variation over time are obtained. However, when the frame length is lengthened, the problem of a large delay time arises. In communications applications such as portable telephones and the like, it is necessary to minimize the delay time. Accordingly, methods that increase the frame length are undesirable in communications applications.
DISCLOSURE OF THE INVENTION
[0023] The present invention was devised in light of the problems encountered in the prior art; it is an object of the present invention to provide a voice enhancement method which makes the voice clarity extremely easy to hear, and a voice enhancement device applying this method.
[0024] As a first aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising a signal separating part which separates the input voice signal into sound source characteristics and vocal tract characteristics, a characteristic extraction part which extracts characteristic information from the abovementioned vocal tract characteristics, a vocal tract characteristic correction part which corrects the abovementioned vocal tract characteristics from the abovementioned vocal tract characteristics and the abovementioned characteristic information, and signal synthesizing part for synthesizing the abovementioned sound source characteristics and the abovementioned corrected vocal tract characteristics from the abovementioned vocal tract characteristic correction part, wherein a voice synthesized by the abovementioned signal synthesizing part is output.
[0025] As a second aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising a self-correlation calculating part that determines the self-correlation function from the input voice of the current frame, a buffer part which stores the self-correlation of the abovementioned current frame, and which outputs the self-correlation function of a past frame, an average self-correlation calculating part which determines a weighted average of the self-correlation of the abovementioned current frame and the self-correlation function of the abovementioned past frame, a first filter coefficient calculating part which calculates inverse filter coefficients from the weighted average of the abovementioned self-correlation functions, an inverse filter which is constructed by the abovementioned inverse filter coefficients, a spectrum calculating part which calculates a frequency spectrum from the abovementioned inverse filter coefficients, a formant estimating part which estimates the formant frequency and formant amplitude from the abovementioned calculated frequency spectrum, an amplitude factor calculating part which determines the amplitude factor from the abovementioned calculated frequency spectrum, the abovementioned estimated formant frequency and the abovementioned estimated formant amplitude, a spectrum enhancement part which varies the abovementioned calculated frequency spectrum on the basis of the abovementioned amplitude factor, and determines the varied frequency spectrum, a second filter coefficient calculating part which calculates the synthesizing filter coefficients from the abovementioned varied frequency spectrum, and a synthesizing filter which is constructed from the abovementioned synthesizing filter coefficients, wherein a residual signal is determined by inputting the abovementioned input voice into the abovementioned inverse filter, and the output voice is determined by inputting the abovementioned residual signal into the abovementioned synthesizing filter.
[0026] As a third aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising a linear prediction coefficient analysis part which determines a self-correlation function and linear prediction coefficients by subjecting the input voice signal of the current frame to a linear prediction coefficient analysis, an inverse filter that is constructed by the abovementioned coefficients, a first spectrum calculating part which determines the frequency spectrum from the abovementioned linear prediction coefficients, a buffer part which stores the self-correlation of the abovementioned current frame, and outputs the self-correlation function of a past frame, an average self-correlation calculating part which determines a weighted average of the self-correlation of the abovementioned current frame and the self-correlation function of the abovementioned past frame, a first filter coefficient calculating part which calculates average filter coefficients from the weighted average of the abovementioned self-correlation functions, a second spectrum calculating part which determines an average frequency spectrum from the abovementioned average filter coefficients, a formant estimating part which determines the formant frequency and formant amplitude from the abovementioned average spectrum, an amplitude factor calculating part which determines the amplitude factor from the abovementioned average spectrum, the abovementioned formant frequency and the abovementioned formant amplitude, a spectrum enhancement part which varies the frequency spectrum calculated by the abovementioned first spectrum calculating part on the basis of the abovementioned amplitude factor, and determines the varied frequency spectrum, a second filter coefficient calculating part which calculates the synthesizing filter coefficients from the abovementioned varied frequency spectrum, and a synthesizing filter which is constructed from the abovementioned synthesizing filter coefficients, wherein a residual signal is determined by inputting the abovementioned input signal into the abovementioned inverse filter, and the output voice is determined by inputting the abovementioned residual signal into the abovementioned synthesizing filter.
[0027] As a fourth aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising a self-correlation calculating part which determines the self-correlation function from the input voice of the current frame, a buffer part which stores the self-correlation of the abovementioned current frame, and outputs the self-correlation function of a past frame, an average self-correlation calculating part which determines a weighted average of the self-correlation of the abovementioned current frame and the self-correlation function of the abovementioned past frame, a first filter coefficient calculating part which calculates inverse filter coefficients from the weighted average of the abovementioned self-correlation functions, an inverse filter which is constructed by the abovementioned inverse filter coefficients, a spectrum calculating part which calculates the frequency spectrum from the abovementioned inverse filter coefficients, a formant estimating part which estimates the formant frequency and formant amplitude from the abovementioned frequency spectrum, a tentative amplification factor calculating part which determines the tentative amplification factor of the current frame from the abovementioned frequency spectrum, the abovementioned formant frequency and the abovementioned formant amplitude, a difference calculating part which calculates the difference amplification factor from the abovementioned tentative amplification factor and the amplification factor of the preceding frame, and an amplification factor judgment part which takes the amplification factor determined from a predetermined threshold value and the amplification factor of the preceding frame as the amplification factor of the current frame in cases where the abovementioned difference is greater than this threshold value, and which takes the abovementioned tentative amplification factor as the amplification factor of the current frame in cases where the abovementioned difference is smaller than the abovementioned threshold value, this voice enhancement device further comprising, a spectrum enhancement part which varies the abovementioned frequency spectrum on the basis of the amplification factor of the abovementioned current frame, and which determines the varied frequency spectrum, a second filter coefficient calculating part which calculates synthesizing filter coefficients from the abovementioned varied frequency spectrum, a synthesizing filter which is constructed from the abovementioned synthesizing filter coefficients, a pitch enhancement coefficient calculating part which calculates pitch enhancement coefficients from the abovementioned residual signal, and a pitch enhancement filter which is constructed by the abovementioned pitch enhancement coefficients, wherein a residual signal is determined by inputting the abovementioned input voice into the abovementioned inverse filter, a residual signal whose pitch periodicity is enhanced is determined by inputting the abovementioned residual signal into the abovementioned pitch enhancement filter, and the output voice is determined by inputting the abovementioned residual signal whose pitch periodicity has been enhanced into the abovementioned synthesizing filter.
[0028] As a fifth aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising an enhancement filter which enhances some of the frequency bands of the input voice signal, a signal separating part which separates the input voice signal that has been enhanced by the abovementioned enhancement filter into sound source characteristics and vocal tract characteristics, a characteristic extraction part which extracts characteristic information from the abovementioned vocal tract characteristics, a corrected vocal tract characteristic calculating part which determines vocal tract characteristic correction information from the abovementioned vocal tract characteristics and the abovementioned characteristic information, a vocal tract characteristic correction part which corrects the abovementioned vocal tract characteristics using the abovementioned vocal tract characteristic correction information, and signal synthesizing part for synthesizing the abovementioned sound source characteristics and the corrected vocal tract characteristics from the abovementioned vocal tract characteristic correction part, wherein a voice synthesized by the abovementioned signal synthesizing part is output.
[0029] As a sixth aspect, the voice enhancement device that achieves the abovementioned object of the present invention is a voice enhancement device comprising a signal separating part which separates the input voice signal into sound source characteristics and vocal tract characteristics, a characteristic extraction part which extracts characteristic information from the abovementioned vocal tract characteristics, a corrected vocal tract characteristic calculating part which determines vocal tract characteristic correction information from the abovementioned vocal tract characteristics and the abovementioned characteristic information, a vocal tract characteristic correction part which corrects the abovementioned vocal tract characteristics using the abovementioned vocal tract characteristic correction information, a signal synthesizing part which synthesizes the abovementioned sound source characteristics and the corrected vocal tract characteristics from the abovementioned vocal tract characteristic correction part, and a filter which enhances some of the frequency bands of the abovementioned signal synthesized by the abovementioned signal synthesizing part.
[0030] The further characteristics of the present invention will be clarified by the embodiments of the invention described below in accordance with the drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
[0031]
Fig. 1 is a diagram which shows an example of the voice frequency spectrum;
Fig. 2 is a diagram which shows examples of the voice frequency spectrum before enhancement and after enhancement;
Fig. 3 is a block diagram of the conventional technique described in Japanese Patent Application Laid-Open No. 2000-117573;
Fig. 4 is a diagram which shows a voice production model;
Fig. 5 is a diagram which shows an example of the input voice spectrum;
Fig. 6 is a diagram which shows an example of the spectrum in a case where the spectrum is enhanced in frame units;
Fig. 7 is a diagram which shows the input voice spectrum (before enhancement);
Fig. 8 is a diagram which shows the voice spectrum in a case where the voice spectrum is enhanced in frame units;
Fig. 9 is a diagram which shows the operating principle of the present invention;
Fig. 10 is a diagram which shows constituent blocks of a first embodiment of the present invention;
Fig. 11 is a flow chart which shows the processing of the amplification factor calculating part 6 in the embodiment shown in Fig. 10;
Fig. 12 is a diagram which shows the conditions in a case where the amplitude of the formants F(k) in the embodiment shown in Fig. 10 is adjusted in accordance with the reference power Pow_ref.
Fig. 13 is a diagram which illustrates the determination of the amplification factor β(1) at frequencies between formants by part of an interpolation curve R(k,l);
Fig. 14 is a diagram showing constituent blocks of a second embodiment of the present invention;
Fig. 15 is a diagram showing constituent blocks of a third embodiment of the present invention;
Fig. 16 is a diagram showing constituent blocks of a fourth embodiment of the present invention;
Fig. 17 is a diagram showing constituent blocks of a fifth embodiment of the present invention;
Fig. 18 is a diagram showing constituent blocks of a sixth embodiment of the present invention;
Fig. 19 is a diagram showing the spectrum enhanced by the present invention;
Fig. 20 is a structural diagram of the principle whereby the present invention further solves the problem of an increase in the feeling of noise when there is a great fluctuation in the amplification factor between frames;
Fig. 21 is another structural diagram of the principle whereby the present invention further solves the problem of an increase in the feeling of noise when there is a great fluctuation in the amplification factor between frames; and
Fig. 22 is a diagram which shows the constituent blocks of an embodiment of the present invention according to the principle diagram shown in Fig. 20.
BEST MODE FOR CARRYING OUT THE INVENTION
[0032] Embodiments of the present invention will be described below with reference to the attached figures.
[0033] Fig. 9 is a diagram which illustrates the principle of the present invention. The present invention is characterized by the fact that the input voice is separated into sound source characteristics and vocal tract characteristics by a separating part 20, the sound source characteristics and vocal tract characteristics are separately enhanced, and these characteristics are subsequently synthesized and output by a synthesizing part 21. The processing shown in Fig. 9 will be described below.
[0034] In the time axis region, the input voice signal x(n), (0 ≤ n < N) (here, N is the frame length) which has an amplitude value that is sampled at a specified sampling frequency is obtained, and the average spectrum sp1(1), (0 ≤ 1 < NF) is calculated from this input voice signal x(n) by the average spectrum calculating part 1 of the separating part 20.
[0035] Accordingly, in the average spectrum calculating part 1, which is a linear prediction circuit, the self-correlation function of the current frame is first calculated. Next, the average self-correlation is determined by obtaining a weighted average of the self-correlation function of said current frame and the self-correlation function of a past frame. The average spectrum sp1(1), (0 ≤ 1 < NF) is determined from this average self-correlation. Furthermore, NF is the number of data points of the spectrum, and N ≤ NF. Moreover, sp1(1) may also be calculated as the weighted average of the LPC spectrum or FFT spectrum calculated from the input voice of the current frame and the LPC spectrum or FFT spectrum calculated from the input voice of the past frame.
[0036] Next, the spectrum sp1(1) is input into the first filter coefficient calculating part 2 inside the separating part 20, and the inverse filter coefficients α1(i), (1 ≤ i ≤ p1). Here, p1 is the filter order number of the inverse filter 3.
[0037] The input voice x(n) is input into the inverse filter 3 inside the separating part 20 constructed by the abovementioned determined inverse filter coefficients α1(i), so that a residual signal r(n), (0 ≤ n < N). As a result, the input voice can be separated into the residual signal r(n) constituting sound source characteristics, and the spectrum sp1(1) constituting vocal tract characteristics.
[0038] The residual signal r(n) is input into a pitch enhancement part 4, and a residual signal s(n) in which the pitch periodicity is enhanced is determined.
[0039] Meanwhile, the spectrum sp1(1) constituting vocal tract characteristics is input into a formant estimating part 5 used as a characteristic extraction part, and the formant frequency fp(k), (1 ≤ k ≤ kmax) and formant amplitude amp(k), (1 ≤ k ≤ kmax) are estimated. Here, kmax is the number of formants estimated. The value of kmax is arbitrary; however, for a voice with a sampling frequency of 8 kHz, kmax can be set at 4 or 5.
[0040] Then, the spectrum sp1(1), formant frequency fp(k) and formant amplitude amp(k) are input into the amplification factor calculating part 6, and the amplification factor β(1) for the spectrum sp1(1) is calculated.
[0041] The spectrum sp1(1) and amplification factor β(1) are input into the spectrum enhancement part 7, so that the enhanced spectrum sp2(1) is determined. This enhanced spectrum sp2(1) is input into a second filter coefficient calculating part 8 which determines the coefficients of the synthesizing filter 9 that constitutes the synthesizing part 21, so that synthesizing filter coefficients α2(i), (1 ≤ i ≤ p2). Here, p2 is the filter order number of the synthesizing filter 9.
[0042] The residual signal s(n) following pitch enhancement by the abovementioned pitch enhancement part 4 is input into the synthesizing filter 9 constructed by the synthesizing filter coefficients α2(i), so that the output voice y(n), (0 ≤ n < N) is determined. As a result, the sound source characteristics and vocal tract characteristics that have been subjected to enhancement processing are synthesized.
[0043] In the present invention, since the input voice is separated into sound source characteristics (residual signal) and vocal tract characteristics (spectrum envelope) as described above, enhancement processing suited to the respective characteristics can be performed. Specifically, the voice clarity can be improved by enhancing the pitch periodicity in the case of the sound source characteristics, and enhancing the formants in the case of the vocal tract characteristics.
[0044] Furthermore, since long-term voice characteristics are used as the vocal tract characteristics, abrupt variations in the amplification factor between frames are reduced; accordingly, a good voice quality with little feeling of noise can be realized. In particular, average spectral characteristics with little fluctuation over time can be obtained without increasing the delay time by using a weighted average of the self-correlation calculated from the input signal of the current frame and the self-correlation calculated from the input signal of a past frame. Accordingly, abrupt variations in the amplification factor used for spectrum enhancement can be suppressed, so that the feeling of noise caused by voice enhancement can be suppressed.
[0045] Next, an embodiment applying the principle of the present invention shown in Fig. 9 will be described below.
[0046] Fig. 10 is a block diagram of the construction of a first embodiment according to the present invention.
[0047] In this figure, the pitch enhancement part 4 is omitted (compared to the principle diagram shown in Fig. 9).
[0048] Furthermore, in regard to the embodied construction of the separating part 20, the average spectrum calculating part 1 inside the separating part 29 is split between the front and back of the filter coefficient calculating part 2; in the pre-stage of the filter coefficient calculating part 2, the input voice signal x(n), (0 ≤ n < N) of the current frame is inoput into the self-correlation calculating part 10; here, the self-correlation function ac(m)(i), (0 ≤ i ≤ p1) of the current frame is determined by part of Equation
(1). Here, N is the frame length. Furthermore, m is the frame number of the current
frame, and p1 is the order number of the inverse filter described later.
[0049] Furthermore, in the separating part 20, the self-correlation function ac (m - j) (i), (1 ≤ j ≤ L, 0 ≤ i ≤ p1) in the immediately preceding L frame is output from the buffer part 11. Next, the average self-correlation acAVE(i) is determined by the average self-correlation calculating part 12 from the self-correlation function ac(m)(i) of the current frame determined by the self-correlation calculating part 10 and the past self-correlation from the abovementioned buffer part 11.
[0050] Here, the method used to determine the average self-correlation acAVE(i) is arbitrary; however, for example, the weighted average of Equation (2) can be used. Here, wj is a weighting coefficient.
[0051] Here, updating of the state of the buffer part 11 is performed as follows. First, the oldest ac(m - L)(i) (in terms of time) among the past self-correlation functions stored in the buffer part 11 is discarded. Next, the ac(m)(i) calculated in the current frame is stored in the buffer part 11.
[0052] Furthermore, in the separating part 20, the inverse filter coefficients α1(i), (1 ≤ i ≤ p1) are determined in the first filter coefficient calculating part 2 by a universally known method such as a Levinson algorithm or the like from the average self-correlation acAVE(i) determined by the average self-correlation calculating part 12.
[0053] The input voice x(n) is input into the inverse filter 3 constructed by the filter coefficients α1(i), and a residual signal r(n), (0 ≤ n < N) is determined as sound source characteristics by Equation (3).
[0054] Meanwhile, in the separating part 20, the coefficients α1(i) determined by the filter coefficient calculating part 2 are subjected to a Fourier transform by part of the following Equation (4) in a spectrum calculating part 1-2 disposed in the after-stage of the filter coefficient calculating part 2, so that the LPC spectrum sp1(1) is determined as vocal tract characteristics.
[0055] Here, NF is the number of data points of the spectrum. If the sampling frequency is Fs, then the frequency resolution of the LPC spectrum sp1(1) is Fs/NF. The variable 1 is a spectrum index, and indicates the discrete frequency. If 1 is converted into a frequency [Hz], then int[1 × FS/NF] [Hz] is obtained. Furthermore, int[x] indicates the conversion of the variable x into an integer (the same is true in the description that follows).
[0056] As was described above, the input voice can be separated into a sound source signal (residual signal r(n), (0 ≤ n < N) and vocal tract characteristics (LPC spectrum sp1(1)) by the separating part 20.
[0057] Next, as was described in Fig. 9, the spectrum sp1(1) is input into the formant estimating part 5 as one example of the characteristic extraction part, and the formant frequency fp(k), (1 ≤ k ≤ kmax) and formant amplitude amp(k), (1 ≤ k ≤ kmax) are estimated. Here, kmax is the number of formants estimated. The value of kmax is arbitrary; however, in the case of a voice with a sampling frequency of 8 kHz, kmax can be set at 4 or 5.
[0058] A universally known method such as a method in which the formants are determined from the roots of higher order equations using the inverse filter coefficients α1(i) are used as coefficients, or a peak picking method in which the formants are estimated from the peaks of the frequency spectrum, can be used as the formant estimating method. The formant frequencies are designated (in order from the lowest frequency) as fp(1), fp(2), K, fp(kmax). Furthermore, a threshold value may be set for the formant band width, and the system may be devised so that only frequencies with a band width equal to or less than this threshold value are taken as formant frequencies.
[0059] Furthermore, in the formant estimating part 5, the formant frequencies fp(k) are converted into discrete forman frequencies fpl(k) = int [fp(k) × NF/FS] . Furthermore, the spectrum sp1(fpl(k)) is taken as the formant amplitude amp(k).
[0060] Such a spectrum sp1(1), discrete formant frequencies fpl(k) and formant amplitudes amp(k) are input into the amplification factor calculating part 6, and the amplification factor β(1) for the spectrum sp1(1) is calculated.
[0061] In regard to the processing of the amplification factor calculating part 6, as is shown in the processing flow of Fig. 11, processing is performed in the order of calculation of the reference power (processing step P1), calculation of the formant amplification factor (processing step P2), and interpolation of the amplification factor (processing step P3). Below, the respective processing steps will be described in order.
[0062] Processing step P1: The reference power Pow_ref is calculated from the spectrum sp1(1). The calculation method is arbitrary; however, for example, the average power for all frequency bands or the average power for lower frequencies can be used as the reference power. In cases where the average power for all frequency bands is used as the reference power, Pow_ref is expressed by the following Equation (5).
[0063] Processing step P2: The amplification factor G(k) that is used to match the amplitude of the formants F(k) to the reference power Pow_ref is determined by the following Equation (6).
[0064] Fig. 12 shows how the amplitude of the formants F(k) is matched to the reference power Pow_ref. Furthermore, in Fig. 12, the amplification factor β(1) at frequencies between formants is determined using the interpolation curve R(k, 1). The shape of the interpolation curve R(k, 1) is arbitrary; for example, however, a first-order function or second-order function can be used. Fig. 13 shows an example of a case in which a second-order curve is used as the interpolation curve R(k, 1). The interpolation curve R(k, 1) is defined as shown in Equation (7). Here, a, b and c are parameters that determine the shape of the interpolation curve.
[0065] As is shown in Fig. 13, minimum points of the amplification factor are set between adjacent formants F(k) and F(k + 1) inn such an interpolation curve. Here, the method used to set the minimum points is arbitrary; however, for example, the frequency (fpl(k) + fpl(k + 1))/2 can be set as a minimum point, and the amplification factor in this case is set as γ × G(k). Here, γ is a constant, and 0 < γ < 1.
[0066] Assuming that the interpolation curve R(k, 1) passes through the formants F(k) and F(k + 1) and minimum points, then the following Equations (8), (9) and (10) hold true.
[0067] If Equations (8), (9) and (10) are solved as simultaneous equations, the parameters a, b and c are determined, and the interpolation curve R(k, 1) is determined. Then, the amplification factor β(1) for the spectrum between F(k) and F(k + 1) is determined on the basis of the interpolation curve R(k, 1).
[0068] Furthermore, the determination of the interpolation curve R(k, 1) between the abovementioned adjacent formants and the processing that determines the amplification factor β(1) for the spectrum between adjacent formants are performed for all of the formants.
[0069] Moreover, in Fig. 12, the amplification factor G(1) for the first formant is used for frequencies lower than the first formant F(1). Furthermore, the amplification factor G(kmax) for the highest formant is used for frequencies higher than the highest formant. The above may be summarized as shown in Equation (11).
[0070] Returning to Fig. 10, the spectrum sp1(1) and the amplification factor β(1) are input into the spectrum enhancement part 7, and the enhanced spectrum sp2(1) is determined using Equation (12).
[0071] Next, the enhanced spectrum sp2(1) is input into the second filter coefficient calculating part 8. In the second filter coefficient calculating part 8, the self-correlation function ac2(i) is determined from the inverse Fourier transform of the enhanced spectrum sp2(1), and the synthesizing filter coefficients α2(i), (1 ≤ i ≤ p2) are determined from ac2(i) by a universally known method such as a Levinson algorithm or the like. Here, p2 is the synthesizing filter order number.
[0072] Furthermore, the residual signal r(n) which is the output of the inverse filter 3 is input into the synthesizing filter 9 constructed by the coefficients a2(i), and the output voice y(n), (0 ≤ n < N) is determined as shown in Equation (13).
[0073] In the embodiment shown in Fig. 10, as was described above, the input voice can be separated into sound source characteristics and vocal tract characteristics, and the system can be devised so that only the vocal tract characteristics are enhanced. As a result, the spectrum distortion occurring in cases where the vocal tract characteristics and sound source characteristics are simultaneously enhanced, which is a problem in conventional techniques, can be suppressed, and the clarity can be improved. Furthermore, in the embodiment shown in Fig. 10, the pitch enhancement part 4 is omitted; however, in accordance with the principle diagram shown in Fig. 9, it would also be possible to install a pitch enhancement part 4 on the output side of the inverse filter 3, and to perform pitch enhancement processing on the residual signal r(n).
[0074] Furthermore, in the present embodiment, the amplification factor for the spectrum sp1(1) is determined in units of 1 spectrum point number; however, it would also be possible to split the spectrum into a plurality of frequency bands, and to establish a separate amplification factor for each band.
[0075] Fig. 14 shows a block diagram of the construction of a second embodiment of the present invention. This embodiment differs from the first embodiment shown in Fig. 10 in that the LPC coefficients determined from the input voice of the current frame are inverse filter coefficients; in all other respects, this embodiment is the same as the first embodiment.
[0076] Generally, in cases where a residual signal r(n) is determined from the input signal x(n) of the current frame, the predicted gain is higher in cases where LPC coefficients determined from the input signal of the current frame are used as the coefficients of the inverse filter 3 than it is in cases where LPC coefficients that have average frequency characteristics (as in the first embodiment) are used, so that the vocal tract characteristics and sound source characteristics can be separated with good precision.
[0077] Accordingly, in this second embodiment, the input voice of the current frame is subjected to an LPC analysis by part of an LPC analysis part 13, and the LPC coefficients α1(i), (1 ≤ i ≤ p1) that are thus obtained are used as the coefficients of the inverse filter 3.
[0078] The spectrum sp1(1) is determined from the LPC coefficients α1(i) by the second spectrum calculating part 1-2B. The method used to calculate the spectrum sp1(1) is the same as that of Equation (4) in the first embodiment.
[0079] Next, the average spectrum is determined by the first spectrum calculating part, and the formant frequencies fp(k) and formant amplitudes amp(k) are determined in the formant estimating part 5 from this average spectrum.
[0080] Next, as in the previous embodiment, the amplification rate β(1) is determined by the amplification rate calculating part 6 from the spectrum sp1(1), formant frequencies fp(k) and formant amplitudes amp(k), and spectrum emphasis is performed by the spectrum emphasizing part 7 on the basis of this amplification rate so that an emphasized spectrum sp2(1) is determined. The synthesizing filter coefficients α2(i) that are set in the synthesizing filter 9 are determined from the emphasized spectrum sp2(l), and the output voice y(n) is obtained by inputting the residual difference signal r(n) into this synthesizing filter 9.
[0081] As was described above with reference to the second embodiment, the voice path characteristics and sound source characteristics of the current frame can be separated with good precision, and the clarity can be improved by smoothly performing emphasis processing of the voice path characteristics on the basis of the average spectrum in the present embodiment in the same manner as in the preceding embodiments.
[0082] Next, a third embodiment of the present invention will be described with reference to Fig. 15. This third embodiment differs from the first embodiment in that an automatic gain control part (AGC part) 14 is installed, and the amplitude of the synthesized output y(n) of the synthesizing filter 9 is controlled; in all other respects, this construction is the same as the first embodiment.
[0083] The gain is adjusted by the AGC part 14 so that the power ratio of the final output voice signal z(n) to the input voice signal x(n) is 1. An arbitrary method can be used for the AGC part 14; for example, however, the following method can be used.
[0084] First, the amplitude ratio go is determined by Equation (14) from the input voice signal x(n) and the synthesized output y(n). Here, N is the frame length.
[0085] The automatic gain control value Gain(n) is determined by the following Equation (15). Here, λ is a constant.
[0087] In the present embodiment as well, as was described above, the input voice x(n) can be separated into sound source characteristics and voice path characteristics, and the system can be devised so that only the voice path characteristics are emphasized. As a result, distortion of the spectrum that occurs when the voice path characteristics and sound source characteristics are simultaneously emphasized, which is a problem in conventional techniques, can be suppressed, and the clarity can be improved.
[0088] Furthermore, by adjusting the gain so that the amplitude of the output voice is not excessively increased compared to the input signal as a result of spectrum emphasis, it is possible to obtain a smooth and highly natural output voice.
[0089] Fig. 16 shows a block diagram of a fourth embodiment of the present invention. This embodiment differs from the first embodiment in that pitch emphasis processing is applied to the residual difference signal r(n) constituting the output of the reverse filter 3 in accordance with the principle diagram shown in Fig. 9; in all other respects, this construction is the same as the first embodiment.
[0090] The method of pitch emphasis performed by the pitch emphasizing filter 4 is arbitrary; for example, a pitch coefficient calculating part 4-1 can be installed, and the following method can be used.
[0091] First, the self-correlation rscor(i) of the residual difference signal of the current frame is determined by Equation (17), and the pitch lag T at which the self-correlation rscor(i) shows a maximum value is determined. Here, Lagmin and Lagmax are respectively the lower limit and upper limit of the pitch lag.
[0092] Next, pitch prediction coefficients pc(i), (i = -1, 0, 1) are determined by the self-correlation method from the residual difference signals rscor(T - 1), rscor(T) and rscor(T + 1) in the vicinity of the pitch lag T. In regard to the method used to calculate the pitch prediction coefficients, these coefficients can be determined by a universally known method such as a Levinson algorithm or the like.
[0093] Next, the reverse filter output r(n) is input into the pitch emphasizing filter 4, and a voice y(n) with an emphasized pitch periodicity is determined. A filter expressed by the transfer function of Equation (18) can be used as the pitch emphasizing filter 4. Here, gp is a weighting coefficient.
[0094] Here, furthermore, an IIR filter was used as the pitch emphasizing filter 4; however, it would also be possible to use an arbitrary filter such as an FIR filter or the like.
[0095] In the fourth embodiment, pitch period components contained in the residual difference signal can be emphasized by adding a pitch emphasizing filter as was described above, and the voice clarity can be improved even further than in the first embodiment.
[0096] Fig. 17 shows a block diagram of the construction of a fifth embodiment of the present invention. This embodiment differs from the first embodiment in that a second buffer part 15 that holds the amplification rate of the preceding frame is provided; in all other respects, this embodiment is the same as the first embodiment.
[0097] In this embodiment, a tentative amplification rate βpsu(1) is determined in the amplification rate calculating part 6 from the formant frequencies fp(k) and amplitudes amp(k) and the spectrum sp1(1) from the spectrum calculating part 1-2.
[0098] The method used to calculate the tentative amplification rate βpsu(1) is the same as the method used to calculate the amplification rate β(1) in the first embodiment. Next, the amplification rate β(1) of the current frame is determined from the tentative amplification rate βpsu(1) and the amplification rate β_old(1) of the preceding frame output from the buffer part 15. Here, the amplification rate β_old(1) of the preceding frame is the final amplification rate calculated in the preceding frame.
[0099] The procedure used to determine the amplification rate β(1) is as follows:
(1) The difference between the tentative amplification rate βpsu(1) and preceding frame amplification rate β_old(1), i. e., Δβ = βpsu(1) - β_old(1), is calculated.
(2) In cases where the difference Δβ is greater than a predetermined threshold value ΔTH, β(1) is taken to be equal to β_old(1) + ΔTH.
(3) In cases where the difference Δβ is smaller than the threshold value ΔTH, β(1) is taken to be equal to βpsu (1).
(4) The β(1) that is finally determined is input ito the buffer part 15, and the preceding frame amplification rate f_old(l) is updated.
[0100] In the fifth embodiment, since the procedure is the same as that of the first embodiment except for the part in which the amplification rate β(l) is determined with reference to the preceding frame amplification rate β_old(l), further description of the operation of the fifth embodiment will be omitted.
[0101] In the present embodiment, as was described above, abrupt variation of the amplification rate between frames is prevented by selectively using the amplification rate in the preceding frame when the amplification rate used in spectrum emphasis is determined; accordingly, the clarity can be improved while suppressing an increase in the feeling of noise caused by spectrum emphasis.
[0102] Fig. 18 shows a block diagram of the construction of a sixth embodiment of the present invention. This embodiment shows a construction combining the abovementioned first and third through fifth embodiments. Since duplicated parts are the same as in the other embodiments, a description of such parts will be omitted.
[0103] Fig. 19 is a diagram showing the voice spectrum emphasized by the abovementioned embodiment. The effect of the present invention is clear when the spectrum shown in Fig. 19 is compared with the input voice spectrum (prior to emphasis) shown in Fig. 7 and the spectrum emphasized in frame units shown in Fig. 8.
[0104] Specifically, in Fig. 8 in which the higher formants are emphasized, discontinuities are generated in the emphasized spectrum at around 0.95 seconds and at around 1.03 seconds; however, in the voice spectrum shown in Fig. 19, it is seen that peak fluctuation is suppressed, so that these discontinuities are ameliorated. As a result, there is no generation of a feeling of noise due to discontinuities in the formants when the processed voice is actually heard.
[0105] Here, in the abovementioned first through sixth embodiments, the input voice can be separated into sound source characteristics and voice path characteristics, and these voice path characteristics and sound source characteristics can be separately emphasized, on the basis of the principle diagram of the present invention shown in Fig. 9. Accordingly, distortion of the spectrum which has been a problem in conventional techniques in which the voice itself is emphasized can be suppressed, so that the clarity can be improved.
[0106] However, the following problems may arise in common in the respective embodiments described above. Specifically, in the respective embodiments described above, in cases where the voice spectrum is emphasized, the problem of an increase in noise arises if there is a great fluctuation in the amplification rate between frames. On the other hand, if the system is controlled so that fluctuations in the amplification rate are reduced in order to suppress the feeling of noise, the degree of spectrum emphasis becomes insufficient, so that the improvement in clarity is insufficient.
[0107] Accordingly, in order to further eliminate such trouble, the construction based on the principle of the present invention shown in Figs. 20 and 21 is applied. The construction based on the principle of the present invention shown in Figs. 20 and 21 is characterized by the fact that a two-stage construction consisting of a dynamic filter I and a fixed filter II is used.
[0108] Furthermore, in the construction shown in Fig. 20, a principle diagram illustrating a case in which a fixed filter II is disposed after a dynamic filter I; however, it would also be possible to dispose a fixed filter II as the pre-stage if a dynamic filter I as shown in the construction illustrate in Fig. 21. However, in the case of the construction shown in Fig. 21, the parameters used in the dynamic filter I are calculated by analyzing the input voice.
[0109] As was described above, the dynamic filter I uses a construction based on the principle shown in Fig. 9. Figs. 20 and 21 show an outline of the principle construction shown in Fig. 9. Specifically, the dynamic filter I comprises a separating functional part 20 which separates the input voice into sound source characteristics and voice path characteristics, a characteristic extraction functional part 5 which extracts formant characteristics from the voice path characteristics, an amplification rate calculating functional part 6 which calculates the amplification rate on the basis of formant characteristics obtained from the characteristic extraction functional part 5, a spectrum functional part 7 which emphasizes the spectrum of the voice path characteristics in accordance with the calculated amplification rate, and a synthesizing functional part 21 which synthesizes the sound source characteristics and the voice path characteristics whose spectrum has been emphasized.
[0110] The fixed filter II has filter characteristics that have a fixed pass band in the frequency width of a specified range. The frequency band that is emphasized by the fixed filter II is arbitrary; however, for example, a band emphasizing filter that emphasizes a higher frequency band of 2 kHz or greater or an intermediate frequency band of 1 kHz to 3 kHz can be sued.
[0111] A portion of the frequency band is emphasized by the fixed filter II, and the formants are emphasized by the dynamic filter I. Since the amplification rate of the fixed filter II is fixed, there is no fluctuation in the amplification rate between frames. By using such a construction, it is possible to prevent excessive emphasis by the dynamic filter I, and to improve the clarity.
[0112] Fig. 22 is a block diagram of a further embodiment of the present invention based on the principle diagram shown in Fig. 20. This embodiment uses the construction of the third embodiment described previously as the dynamic filter I. Accordingly, a duplicate description is omitted.
[0113] In this embodiment, the input voice is separated into sound source characteristics and voice path characteristics by the dynamic filter I, and only the voice path characteristics are emphasized. As a result, the spectrum distortion that occurs when the voice path characteristics and sound source characteristics are simultaneously emphasized, which has been a problem in conventional techniques, can be suppressed, and the clarity can be improved. Furthermore, the gain is adjusted by the AGC part 14 so that the amplitude of the output voice is not excessively increased compared to the input signal as a result of emphasis of the spectrum; accordingly, a smooth and highly natural output voice can be obtained.
[0114] Furthermore, since a portion of the frequency band is amplified at a fixed rate by the fixed filter II, the feeling of noise is small, so that a voice with a high clarity can be obtained.
INDUSTRIAL APPLICABILITY
[0115] As was described above with reference to the figures, the present invention makes it possible to emphasize the voice path characteristics and sound source characteristics separately. As a result, the spectrum distortion that has been a problem in conventional techniques in which the voice itself is emphasized can be suppressed, so that the clarity can be improved.
[0116] Furthermore, since emphasis is performed on the basis of an average spectrum when the voice path characteristics are emphasized, the abrupt variation of the amplification rate between frames is ameliorated, so that a good sound quality with little feeling of noise can be obtained.
[0117] In view of such points, the present invention allows desirable voice communication in portable telephones, and therefore makes a further contribution to the popularization of portable telephones.
[0118] Furthermore, the present invention was described in terms of the abovementioned embodiments. However, such embodiments are used to facilitate understanding of the present invention; the protected scope of the present invention is not limited to these embodiments. Specifically, cases falling within a scope that is equivalent to the conditions described in the claims are also included in the protected scope of the present invention.
a signal separating part which separates an input voice signal into sound source characteristics and vocal tract characteristics;
a characteristic extraction part which extracts characteristic information from said vocal tract
characteristics;a vocal tract characteristic correction part which corrects said vocal tract characteristics from said vocal tract characteristics and said characteristic information; and
a signal synthesizing part for synthesizing said sound source characteristics and said corrected vocal tract characteristics from said vocal tract characteristic correction part;
wherein a voice synthesized by said signal synthesizing part is output.a signal separating part which separates the input voice signal into sound source characteristics and vocal tract characteristics;
a characteristic extraction part which extracts characteristic information from said vocal tract
characteristics;a corrected vocal tract characteristic calculating part which determines vocal tract characteristic correction information from said vocal tract characteristics and said characteristic information;
a vocal tract characteristic correction part which corrects said vocal tract characteristics using said vocal tract characteristic correction information; and
signal synthesizing part for synthesizing said sound source characteristics and said corrected vocal tract characteristics from said vocal tract characteristic correction part;
wherein a voice synthesized by said signal synthesizing part is output.wherein said signal separating part are a filter constructed by linear prediction (LPC) coefficients obtained by subjecting the input voice to linear prediction analysis.
wherein said linear prediction coefficients are determined from an average of self-correlation functions calculated from the input voice.
wherein said linear prediction coefficients are determined from a weighted average of a self-correlation function calculated from the input voice of the current frame, and a self-correlation function calculated from the input voice of a past frame.
wherein said linear prediction coefficients are determined from a weighted average of linear prediction coefficients calculated from the input voice of the current frame and linear prediction coefficients calculated from the input voice of a past frame.
wherein said vocal tract characteristics is a.linear prediction spectrum calculated from linear prediction coefficients obtained by subjecting said input voice to a linear prediction analysis, or a power spectrum determined by a Fourier transform of the input voice.
wherein said characteristic extraction part determines the pole placement from linear prediction coefficients obtained by subjecting said input voice to a linear prediction analysis, and determines the formant frequency and formant amplitude or formant band width from said pole placement.
wherein said characteristic extraction part determines the formant frequency and formant amplitude or formant band width from the linear prediction spectrum or said power spectrum.
wherein the amplitude of said output voice from said synthesizing part is controlled by an automatic gain control part.
wherein said vocal tract characteristic correction part has a calculating part that determines the tentative amplification factor in the current frame, the difference or ratio of the amplification factor of the preceding frame and the tentative amplification factor of the current frame is determined, and in cases where said difference or ratio is greater than a predetermined threshold value, the amplification factor determined from said threshold value and the amplification factor of the preceding frame is taken as the amplification factor of the current frame, while in cases where said difference or ratio is smaller than said threshold value, said tentative amplification factor is taken as the amplification factor of the current frame.
a self-correlation calculating part that determines the self-correlation function from the input voice of the current frame;
a buffer part which stores the self-correlation of said current frame, and which outputs the self-correlation function of a past frame;
an average self-correlation calculating part which determines a weighted average of the self-correlation of said current frame and the self-correlation function of said past frame;
a first filter coefficient calculating part which calculates inverse filter coefficients from the weighted average of said self-correlation functions;
an inverse filter which is constructed by said inverse filter coefficients;
a spectrum calculating part which calculates a frequency spectrum from said inverse filter coefficients;
a formant estimating part which estimates the formant frequency and formant amplitude from said calculated frequency spectrum;
an amplitude factor calculating part which determines the amplitude factor from said calculated frequency spectrum, said estimated formant frequency and said estimated formant amplitude;
a spectrum enhancement part which varies said calculated frequency spectrum on the basis of said amplitude factor, and determines the varied frequency spectrum;
a second filter coefficient calculating part which calculates the synthesizing filter coefficients from said varied frequency spectrum; and
a synthesizing filter which is constructed from said synthesizing filter coefficients;
wherein a residual signal is determined by inputting said input voice into said inverse filter, and the output voice is determined by inputting said residual signal into said synthesizing filter.a linear prediction coefficient analysis part which determines a self-correlation function and linear prediction coefficients by subjecting the input voice signal of the current frame to a linear prediction coefficient analysis;
an inverse filter that is constructed by said coefficients;
a first spectrum calculating part which determines the frequency spectrum from said linear prediction coefficients;
a buffer part which stores the self-correlation of said current frame, and outputs the self-correlation function of a past frame;
an average self-correlation calculating part which determines a weighted average of the self-correlation of said current frame and the self-correlation function of said past frame;
a first filter coefficient calculating part which calculates average filter coefficients from the weighted average of said self-correlation functions;
a second spectrum calculating part which determines an average frequency spectrum from said average filter coefficients;
a formant estimating part which determines the formant frequency and formant amplitude from said average spectrum;
an amplitude factor calculating part which determines the amplitude factor from said average spectrum, said formant frequency and said formant amplitude;
a spectrum enhancement part which varies the frequency spectrum calculated by said first spectrum calculating part on the basis of said amplitude factor, and determines the varied frequency spectrum;
a second filter coefficient calculating part which calculates the synthesizing filter coefficients from said varied frequency spectrum; and
a synthesizing filter which is constructed from said synthesizing filter coefficients;
wherein a residual signal is determined by inputting said input signal into said inverse filter, and the output voice is determined by inputting said residual signal into said synthesizing filter.wherein a residual signal is determined by inputting said input voice into said inverse filter, a playback voice is determined by inputting said residual signal into said synthesizing filter, and the output voice is determined by inputting said playback voice into said automatic gain control part.
a pitch enhancement coefficient calculating part which calculates pitch enhancement coefficients from said residual signal; and
a pitch enhancement filter which is constructed by said pitch enhancement coefficients;
wherein a residual signal whose pitch periodicity is enhanced is determined by inputting into said pitch enhancement filter a residual signal determined by inputting said input voice into said inverse filter, and the output voice is determined by inputting said residual signal whose pitch periodicity has been enhanced into said synthesizing filter.wherein said amplification factor calculating part comprises:
a tentative amplification factor calculating part which determines the tentative amplification factor of the current frame from the frequency spectrum calculated from said inverse filter coefficients by said spectrum calculating part, said formant frequency and said formant amplitude;
a difference calculating part which calculates the difference between said tentative amplification factor and the amplification factor of the preceding frame; and
an amplification factor judgment part which takes the amplification factor determined from a predetermined threshold value and the amplification factor of the preceding frame in cases where said difference is greater than this threshold value, and which takes said tentative amplification factor as the amplification factor of the current frame in cases where said difference is smaller than said threshold value.
a self-correlation calculating part which determines the self-correlation function from the input voice of the current frame;
a buffer part which stores the self-correlation of said current frame, and outputs the self-correlation function of a past frame;
an average self-correlation calculating part which determines a weighted average of the self-correlation of said current frame and the self-correlation function of said past frame;
a first filter coefficient calculating part which calculates inverse filter coefficients from the weighted average of said self-correlation functions;
an inverse filter which is constructed by said inverse filter coefficients;
a spectrum calculating part which calculates the frequency spectrum from said inverse filter coefficients;
a formant estimating part which estimates the formant frequency and formant amplitude from said frequency spectrum;
a tentative amplification factor calculating part which determines the tentative amplification factor of the current frame from said frequency spectrum, said formant frequency and said formant amplitude;
a difference calculating part which calculates the difference amplification factor from said tentative amplification factor and the amplification factor of the preceding frame; and
an amplification factor judgment part which takes the amplification factor determined from a predetermined threshold value and the amplification factor of the preceding frame as the amplification factor of the current frame in cases where said difference is greater than this threshold value, and which takes said tentative amplification factor as the amplification factor of the current frame in cases where said difference is smaller than said threshold value;
this voice enhancement device further comprising:
a spectrum enhancement part which varies said frequency spectrum on the basis of the amplification factor of said current frame, and which determines the varied frequency spectrum;
a second filter coefficient calculating part which calculates synthesizing filter coefficients from said varied frequency spectrum;
a synthesizing filter which is constructed from said synthesizing filter coefficients;
a pitch enhancement coefficient calculating part which calculates pitch enhancement coefficients from said residual signal; and
a pitch enhancement filter which is constructed by said pitch enhancement coefficients;
wherein a residual signal is determined by inputting said input voice into said inverse filter, a residual signal whose pitch periodicity is enhanced is determined by inputting said residual signal into said pitch enhancement filter, and the output voice is determined by inputting said residual signal whose pitch periodicity has been enhanced into said synthesizing filter.an enhancement filter which enhances some of the frequency bands of the input voice signal;
a signal separating part which separates the input voice signal that has been enhanced by said enhancement filter into sound source characteristics and vocal tract characteristics;
a characteristic extraction part which extracts characteristic information from said vocal tract characteristics;
a corrected vocal tract characteristic calculating part which determines vocal tract characteristic correction information from said vocal tract characteristics and said characteristic information;
a vocal tract characteristic correction part which corrects said vocal tract characteristics using said vocal tract characteristic correction information; and
signal synthesizing part for synthesizing said sound source characteristics and the corrected vocal tract characteristics from said vocal tract characteristic correction part;
wherein a voice synthesized by said signal synthesizing part is output.a signal separating part which separates the input voice signal into sound source characteristics and vocal tract characteristics;
a characteristic extraction part which extracts characteristic information from said vocal tract characteristics;
a corrected vocal tract characteristic calculating part which determines vocal tract characteristic correction information from said vocal tract characteristics and said characteristic information;
a vocal tract characteristic correction part which corrects said vocal tract characteristics using said vocal tract characteristic correction information;
a signal synthesizing part which synthesizes said sound source characteristics and the corrected vocal tract characteristics from said vocal tract characteristic correction part; and
a filter which enhances some of the frequency bands of said signal synthesized by said signal synthesizing part.