[0001] The present disclosure relates to a hearing device and a method of operating a hearing
device. In particular, the present disclosure relates to a hearing device with position
data and related method for improving the correspondence of the visual and the auditory
cues of a hearing aid user in a crowded environment.
BACKGROUND
[0002] It is known to stream audio to hearing devices via a telecoil solution having a limited
bandwidth with limited possibilities of separating different audio streams. Further,
wireless communication to and from hearing devices has been increasing in continuation
of the developments within wireless communication technology. In an environment where
audio is distributed to the crowd via a number of external microphones or other audio
sources the present technology provides limited possibilities of separating audio
signals from different positions.
SUMMARY
[0003] There is a need for a hearing device that improves separation of audio signals from
different audio sources in an audio system.
[0004] Despite the known solutions there is still a need for improved user experience in
a crowded area with multiple microphones/audio sources.
[0005] Accordingly, a hearing device is provided, the hearing device comprising a first
antenna, a first transceiver coupled to the first antenna and configured to wirelessly
receive one or more audio streams from an audio system, the one or more audio streams
including a first audio stream; a primary processing unit adapted for processing an
input signal according to a hearing prescription in order to alleviate a hearing loss;
an acoustic output transducer coupled to an output of the primary processing unit
for conversion of an output signal from the primary processing unit into an audio
output signal; at least one microphone; a secondary processing unit with a first input
coupled to an output of the first transceiver for receiving a first wireless input
signal representative of the first audio stream from the first transceiver; and a
position controller for detecting position data of the hearing device, the position
controller having an output coupled to a position input of the secondary processing
unit for sending a position control signal to the secondary processing unit; wherein
the secondary processing unit is configured to process the first wireless input signal
from the first transceiver based on the position control signal.
[0006] Also disclosed is a method for operating a hearing device, the method comprising:
receiving a first audio stream; converting the first audio stream to a first wireless
input signal; determining position data of the hearing device; processing the first
wireless audio signal based on the position data of the hearing device to form an
output signal; and converting the output signal to an audio output signal.
[0007] It is an advantage of the present invention that processing of wireless input signal(s)
in the hearing device is based on the position (direction and/or distance) of the
hearing device, thereby improving the user experience of the hearing device. Thus,
the position (distance and/or orientation) of the hearing device may provide prioritization
of input signals.
[0008] Further, the disclosed hearing aid and methods improve the correspondence of the
visual and the auditory cues of the listener, otherwise lost in crowd amplification.
[0009] The primary processing unit and/or the secondary processing unit of the hearing device
may be configured to compensate for hearing loss or hearing disability of the user
of the hearing device. The primary processing unit and/or the secondary processing
unit of the hearing device may be configured to alter a received audio stream, e.g.
the first audio stream, a wireless input signal, e.g. the first wireless input signal,
and/or the input signal to compensate for hearing loss or hearing disability of the
user of the hearing device.
[0010] The hearing device comprises a secondary processing unit and a primary processing
unit. The secondary processing unit and the primary processing unit may be embedded
as a single processing unit performing the tasks of both the secondary processing
unit and the primary processing unit.
BRIEF DESCRIPTION OF THE DRAWINGS
[0011] The above and other features and advantages of the present invention will become
readily apparent to those skilled in the art by the following detailed description
of exemplary embodiments thereof with reference to the attached drawings, in which:
Fig. 1 schematically illustrates an exemplary hearing device,
Fig. 2 schematically illustrates an exemplary hearing device,
Fig. 3 schematically illustrates an exemplary position controller,
Fig. 4 schematically illustrates an exemplary secondary processing unit, and
Fig. 5 is a flow diagram for an exemplary method for operating a hearing device.
[0012] Various embodiments are described hereinafter with reference to the figures. It should
be noted that the figures are not necessarily drawn to scale and that elements of
similar structures or functions are represented by like reference numerals throughout
the figures. It should also be noted that the figures are only intended to facilitate
the description of the embodiments. They are not intended as an exhaustive description
of the claimed invention or as a limitation on the scope of the claimed invention.
In addition, an illustrated embodiment needs not have all the aspects or advantages
shown. An aspect or an advantage described in conjunction with a particular embodiment
is not necessarily limited to that embodiment and can be practiced in any other embodiments
even if not so illustrated, or if not so explicitly described.
DETAILED DESCRIPTION
[0013] The present invention relates to a hearing device and a method enabling adaptation
of signal processing in the hearing device based on position data of the hearing device
and/or position data of an audio system comprising one or more audio sources.
[0014] The hearing device comprises a first transceiver coupled to the first antenna and
configured to wirelessly receive one or more audio streams from an audio system, the
one or more audio streams including a first audio stream. The first transceiver may
be configured to receive and/or sent position data of the audio system and/or the
hearing device.
[0015] The hearing device comprises a position controller for detecting position data of
the hearing device. The position controller has an output coupled to a position input
of the secondary processing unit for sending a position control signal to the secondary
processing unit. The position controller may comprise a motion detector and a position
processing unit connected to the motion detector. The position processing unit is
configured to estimate position data of the hearing device based on motion sensor
output. The motion detector may comprise one or a plurality of sensors e.g. one or
more gyroscopes and/or one or more accelerometers.
[0016] The position controller may be configured for determining a position control signal
based on the position data of the hearing device. The position controller may comprise
a position port and may be configured to receive audio system position data and/or
send hearing device position data via the position port. Accordingly, the position
controller may be configured for receiving audio system position data, and the position
control signal may be based on the audio system position data. The position port may
be coupled to the first transceiver and/or second transceiver. Thus, the position
controller may be configured to determine and send position control signal based on
audio system position data received via the position port. The position controller
may comprise a control port for coupling to the primary processing unit for exchange
of control signals.
[0017] The position data of the hearing device may comprise angular position data of the
hearing device, and the position control signal is based on angular position data
of the hearing device.
[0018] For example, the position data may comprise information of the azimuth angle of the
hearing device. The azimuth angle may be indicative of the looking direction of the
user wearing the hearing device. Alternatively, or additionally, the position data
may comprise information of the altitude angle.
[0019] The position data may comprise distance position data of the hearing device. For
example, the position data may comprise information of the distance of the hearing
device relative to an audio source and/or a reference point.
[0020] The secondary processing unit is configured to process input signal(s) such as audio
input signal and/or wireless input signal(s) depending on the position control signal.
[0021] The position control signal may select the value(s) of gain(s) applied to input signal(s)
to the secondary processing unit. Thus the position control signal may be indicative
of gain(s) to be applied to input signal(s) to the secondary processing unit. Accordingly,
the position control signal may select a value of a first gain to be applied to the
first wireless input signal based on the position data of the hearing device.
[0022] The one or more audio streams may include a second audio stream that is converted
to a second wireless input signal in the first transceiver. The secondary processing
unit may be configured to process the second wireless input signal from the first
transceiver based on the position control signal. The position control signal may
select a value of a second gain to be applied to the second wireless input signal
based on the position data of the hearing device. The secondary processing unit may
apply a second gain to the second wireless input signal based on the position control
signal from the position controller.
[0023] The hearing device may comprise a second antenna and/or a second transceiver connected
to the position controller for receiving and/or sending position data from/to an audio
system.
[0024] The at least one microphone may include a first microphone for receiving an acoustic
audio signal and converting the acoustic audio signal to an audio input signal. The
first microphone may have an output coupled to a second input of the secondary processing
unit for feeding the audio input signal to the secondary processing unit. The secondary
processing unit may be configured to process the audio input signal based on the position
control signal. For example, the position control signal may select a value of a microphone
gain to be applied to the audio input signal from the first microphone based on the
position data of the hearing device.
[0025] The method for operating a hearing device comprises receiving a first audio stream
and converting the first audio stream to a first wireless input signal. A first audio
stream may be converted into a first and a second wireless input signal.
[0026] The method comprises determining position data of the hearing device and processing
the first wireless audio signal based on the position data of the hearing device to
form an output signal. The method may comprise obtaining position data of an audio
system and processing the first wireless audio signal based on the position data of
the hearing device and the position data of the audio system to form an output signal;
and converting the output signal to an audio output signal.
[0027] In an audio system, one or more transceivers or transmitter units comprising transceivers
are configured for broadcasting or transmitting audio track(s) and/or audio stream(s),
e.g. to one or more hearing devices. The audio system may comprise a first transceiver
and optionally a second transceiver. A transceiver may transmit one or more audio
streams. A transceiver may be identified by a transceiver address. A transmitter unit
may be configured to wirelessly transmit audio track(s) and/or audio stream(s).
[0028] An audio track is an audible signal. Exemplary audible signals are speech, music,
an airport call, a movie sound track or a combination thereof.
[0029] An audio stream is an electromagnetic signal representative of an audio track. An
audio stream is represented by a number of audio blocks each comprising one or more
audio packets. An audio packet comprises a finite part of an audio stream.
[0030] An audio packet may comprise an audio stream identifier, which may comprise one or
more elements such as audio track identification, transceiver address or identification,
audio group identification, audio source identification, etc. Audio track identification
may enable selection of audio streams representative of the same audio track, and
audio group identification may identify a certain group of audio tracks or audio streams
e.g. an audio group may be audio tracks in the same or similar language, e.g. English,
Danish or Chinese.
[0031] An audio packet may comprise transceiver address of the transceiver transmitting
the audio packet, thus enabling the hearing device to sort out or separate audio packets
sent from other transceivers.
[0032] Transmitting and receiving the wireless audio stream(s) may be achieved by using
wireless technology, thus transmitting/receiving audio blocks at one or more frequencies,
e.g. in the range from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in
the range from 3.6 GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz.
[0033] In the hearing device, the primary processing unit may be configured to control the
first transceiver. The first transceiver and/or the second transceiver may be configured
to receive and/or send audio streams and/or position data at frequencies in the range
from 2.4 GHz to 2.5 GHz, in the range from 800 MHz to 1 GHz, in the range from 3.6
GHz to 3.7 GHz, and/or in the range from 4.9 GHz to 5.9 GHz. The first transceiver
and/or the second transceiver may be configured to receive audio streams at frequencies
in the range from 169 MHz to 218 MHz and/or in the range from 480 MHz to 520 MHz.
[0034] The first and/or second transceiver may be configured to transmit and/or receive
wirelessly from/to an audio system with one or more audio sources or other external
devices, such as other hearing devices, mobile phone.
[0035] The hearing device may be configured for pairing the hearing device with an audio
system, e.g. with one or more audio sources of the audio system. Pairing may comprise
transmitting hearing device information from the hearing device to the audio system.
The hearing device information may comprise one or more of hearing device idenfication,
hearing device manufacturer, hearing device model, and/or hearing device configuration
data. Pairing of the hearing device with the audio system may additionally or alternatively
comprise transmitting audio system information from the audio system to the hearing
device and/or receiving audio system information from the audio system. The audio
system information may comprise one or more of audio system identification, audio
source identification(s), transceiver identification(s) and/or audio stream configuration
data. The audio system may be configured to adapt the format of the first audio stream
to be sent to the hearing device based on hearing device information received from
the hearing device, e.g. model and/or manufacturer, data encoding format etc. Furthermore,
pairing of the hearing device with the audio system may comprise exchanging an encryption
key, such as to enable encryption of an audio stream, such as the first audio stream,
before sending from the audio system, and decryption of the received wireless input
signal, e.g. the first wireless input signal, in the hearing device.
[0036] Pairing of the hearing device with the audio system may initiate sending of an audio
stream, e.g. the first audio stream, from the audio system.
[0037] Pairing of the hearing device with the audio system may cause the hearing device
to inititate receiving audio stream(s), which is/are sent by the audio system.
[0038] The secondary processing unit is configured to process input signal(s) from microphone(s)
and/or transceiver(s) to form an input signal to the primary processing unit. The
secondary processing unit may apply gain(s) to the input signal(s) and subsequently
mix the amplified input signals to form the input signal to the primary processing
unit, wherein the gain(s) are controlled by the position controller with the position
control signal.
[0039] The position controller may be configured to determine a gain or a vector of gains
based on position data of the hearing device and/or position data of the audio system.
[0040] The first gain G
1 may be given by:

where P
HD is position data for the hearing device.
[0041] In a hearing device with a plurality of input signals, processing of the input signals
may comprise applying a vector of gains. The vector of gains may comprise a gain for
each of the input signals. The vector of gains
G may be given by:

[0042] The plurality of gains and/or the first gain may comprise further inputs, such as
position data of the audio system:

[0043] Where P
HD is position data for the hearing device, and P
AS is position data for the audio system. P
AS may be a vector with position data of the audio system.
[0044] The position controller may be configured to set the first gain to a first value
if a first field of listening (FIL) criterion is fulfilled, i.e. if the position of
the hearing aid indicates that the hearing aid user wishes to listen to a first audio
source of the audio system. The position controller may be configured to set the first
gain to a second value if the first FIL criterion is not fulfilled or if a secondary
first FIL criterion is fulfilled. The first value may be larger than the second value.
[0045] The first FIL criterion may be based on the first view angle being the angle between
the users direction of view and the direction from the hearing device to the first
audio source. The first FIL criterion may be given by:

where α
1 is the first view angle and T
1,1 is a first threshold angle for the first audio source. The first threshold angle
T
1,1 may be in the range from 15 to 60 degrees.
[0046] The position controller may be configured to set the second gain to a first value
if a second field of listening (FIL) criterion is fulfilled, i.e. if the position
of the hearing aid indicates that the hearing aid user wishes to listen to a second
audio source of the audio system. The position controller may be configured to set
the second gain to a second value if the second FIL criterion is not fulfilled or
if a secondary second FIL criterion is fulfilled. The first value may be larger than
the second value.
[0047] The second FIL criterion may be based on the second view angle being the angle between
the users direction of view and the direction from the hearing device to the second
audio source. The second FIL criterion may be given by:

where α
2 is the second view angle and T
2,1 is a first threshold angle for the second audio source. The first threshold angle
T
2,1 may be in the range from 15 to 60 degrees.
[0048] The position controller may be configured to set the microphone gain to a first value
if a criterion, such as the first FIL criterion and/or the second FIL criterion, is
fulfilled. The position controller may be configured to set the microphone gain to
a second value if a criterion, such as the first FIL criterion and/or the second FIL
criterion, is not fulfilled. The first value may be less than the second value.
[0049] The position controller may be configured to determine a gain or a vector of gains
based on an audio input signal from a microphone. Thus, the position controller may
be coupled to an output of the first microphone. Accordingly, the gains applied to
the input signals may be given by:

[0050] Where
G is a vector with gains for the wireless input signal(s) and/or the audio input signal,
P
HD is position data for the hearing device, P
AS is position data from the audio system, and S
mic is a control signal received by the microphone. The control signal S received by
the microphone may be within a selected frequency range outside the audible range.
P
AS and/or S
mic may be omitted.
[0051] Fig. 1 schematically illustrates an exemplary hearing device. The hearing device
1 comprises a first antenna 4 and a first transceiver 6 coupled to the first antenna
4. The first transceiver 6 is configured to wirelessly receive one or more audio streams
54 from an audio system, the one or more audio streams including a first audio stream.
Further, the hearing device 1 comprises a primary processing unit 8 adapted for processing
an input signal 60 according to a hearing prescription in order to alleviate a hearing
loss, an acoustic output transducer 10 coupled to an output of the primary processing
unit 8 for conversion of an output signal 62 from the primary processing unit 8 into
an audio output signal 64, and at least one microphone including a first microphone
14. The hearing device 1 comprises a secondary processing unit 16 with a first input
18 coupled to an output of the first transceiver 6 for receiving a first wireless
input signal 56 representative of the first audio stream from the first transceiver
6, and a position controller 12 for detecting position data of the hearing device,
the position controller 12 having an output coupled to a position input of the secondary
processing unit for sending a position control signal 66 to the secondary processing
unit 16. The secondary processing unit 16 is configured to process the first wireless
input signal 56 from the first transceiver 6 based on the position control signal
66. The primary processor 8 may be coupled to the first transceiver 6, e.g. for sending
and/or receiving pairing information to/from an audio system.The secondary processing
unit 16 has a second input 20 coupled to an output of the first microphone 14 for
receiving an audio input signal 58.
[0052] The hearing device 1 is configured to pair with an audio system including one or
more audio sources. For example, pairing of the hearing device 1 with the one or more
audio sources is achieved by pairing the hearing device 1 with the audio system.
[0053] The secondary processing unit 16 is configured to process wireless input signal(s)
including the first wireless input signal 56 and optionally the audio input signal
58 to form the input signal 60 on an output of the secondary processing unit 16.
[0054] The primary processing unit 8 may perform signal processing such as noise reduction,
filtering, amplification, etc. of the input signal 60. The primary processing unit
8 may perform signal processing of the input signal 60 to account for hearing disability
of the user of the hearing device 1.
[0055] The secondary processing unit 16 and the primary processing unit 8 may be embedded
as a single processing unit as also indicated with the dotted box in Fig. 2.
[0056] The position controller 12 is configured for detecting position data of the hearing
device. Based on the position data of the hearing device, the position controller
12 determines gain(s) to be applied to the respective input signals to the secondary
processing unit 16 and sends position control signal 66 indicative thereof to the
secondary processing unit 16. The secondary processing unit processes the input signal(s)
including the first wireless input signal from the first transceiver based on the
position control signal 66 from the position controller 12. The first transceiver
6 may be coupled to the position controller 12 for receiving audio system position
signal 68 indicative of position data of an audio system and/or sending position data
of the hearing device to an audio system.
[0057] Fig. 2 schematically illustrates an exemplary hearing device. The hearing device
1 comprises a second antenna 26 and a second transceiver 28 coupled to the position
controller 12 for receiving audio system position signal 68 indicative of position
data of an audio system and/or sending position data of the hearing device to an audio
system.
[0058] Fig. 3 schematically illustrates an exemplary position controller 12. The position
controller 12 is configured for detecting position data of the hearing device 1 and
has an output 30 coupled to a position input of the secondary processing unit 16 for
sending a position control signal 66 to the secondary processing unit. The position
controller 12 comprises a motion detector 22 and a position processing unit 24 configured
for estimating position data of the hearing device based on an output of the motion
detector 22 and determining a position control signal 66 based on the position data
of the hearing device. Optionally, the position controller may be configured to receive
audio system position data and/or send hearing device position data via position port
32. The position port 32 may be coupled to the first transceiver 6 and/or second transceiver
28. The position controller 12 may be configured to determine and send position control
signal 66 based on audio system position data from first transceiver 6 and/or second
transceiver 28. Optionally, the position controller comprises a control port 34 for
coupling to the primary processing unit 8 for exchange of control signals.
[0059] Fig. 4 illustrates an exemplary secondary processing unit. The secondary processing
unit 16 comprises a number of gain units including a first gain unit with adjustable
first gain G
1 and a microphone gain unit with adjustable microphone gain G
MIC. The first gain G
1 applied to the input signal on the first input 18 is controlled by the position control
signal 66. The microphone gain G
MIC applied to the audio input signal on the second input 20 is also controlled by the
position control signal 66. The amplified/attenuated signals from the gain units are
summed in summation unit to form an input signal 60 to the primary processing unit.
[0060] Fig. 5 is a flow diagram of an exemplary method for operating a hearing device. The
method 100 comprises receiving 102 a first audio stream; converting 104 the first
audio stream to a first wireless input signal; determining 106 position data of the
hearing device; processing 108 the first wireless audio signal based on the position
data of the hearing device to form an output signal; and converting 110 the output
signal to an audio output signal.
LIST OF REFERENCES
[0061]
- 1
- hearing device
- 4
- first antenna
- 6
- first transceiver
- 8
- primary processing unit
- 10
- acoustic output transducer
- 12
- position controller
- 14
- first microphone
- 16
- secondary processing unit
- 18
- first input
- 20
- second input
- 22
- motion detector
- 24
- position processing unit
- 26
- second antenna
- 28
- second transceiver
- 30
- position controller output(s)
- 32
- position port
- 54
- audio stream
- 56
- first wireless input signal
- 57
- second wireless input signal
- 58
- audio input signal
- 60
- input signal
- 62
- output signal
- 64
- audio output signal
- 66
- position control signal
- 68
- audio system position signal
- 100
- method for operating a hearing device
- 102
- receiving audio stream(s)
- 104
- converting audio stream(s) to wireless input signal(s)
- 106
- determining position data of hearing device
- 108
- processing wireless input signal(s) based on position data
- 110
- converting output signal to audio output signal
1. Hearing device comprising
- a first antenna;
- a first transceiver coupled to the first antenna and configured to wirelessly receive
one or more audio streams from an audio system, the one or more audio streams including
a first audio stream;
- a primary processing unit adapted for processing an input signal according to a
hearing prescription in order to alleviate a hearing loss;
- an acoustic output transducer coupled to an output of the primary processing unit
for conversion of an output signal from the primary processing unit into an audio
output signal;
- at least one microphone;
- a secondary processing unit with a first input coupled to an output of the first
transceiver for receiving a first wireless input signal representative of the first
audio stream from the first transceiver; and
- a position controller for detecting position data of the hearing device, the position
controller having an output coupled to a position input of the secondary processing
unit for sending a position control signal to the secondary processing unit;
wherein the secondary processing unit is configured to process the first wireless
input signal from the first transceiver based on the position control signal.
2. Hearing device according to claim 1, wherein the position controller comprises a motion
detector and a position processing unit connected to the motion detector and configured
to estimate position data of the hearing device based on motion sensor output.
3. Hearing device according to any of claims 1-2, wherein the position data comprises
angular position data of the hearing device, and wherein the position control signal
is based on angular position data of the hearing device.
4. Hearing device according to any of the preceding claims, wherein a first gain signal
is applied to the first wireless input signal based on the position data of the hearing
device.
5. Hearing device according to any of the preceding claims, wherein the one or more audio
streams includes a second audio stream converted to a second wireless input signal
in the first transceiver, and wherein the secondary processing unit is configured
to process the second wireless input signal from the first transceiver based on the
position control signal.
6. Hearing device according to claim 4, wherein a second gain signal is applied to the
second wireless input signal based on the position data of the hearing device.
7. Hearing device according to any of the preceding claims, wherein the hearing device
comprises a second antenna connected to the position controller for receiving and/or
sending position data from/to an audio system.
8. Hearing device according to any of the preceding claims, wherein the position controller
is configured for receiving audio system position data, and wherein the position control
signal is based on the audio system position data.
9. Hearing device according to any of the preceding claims, wherein the at least one
microphone includes a first microphone for receiving an acoustic audio signal and
converting the acoustic audio signal to an audio input signal, the first microphone
having an output coupled to a second input of the secondary processing unit for feeding
the audio input signal to the secondary processing unit, and wherein the secondary
processing unit is configured to process the audio input signal based on the position
control signal.
10. Method for operating a hearing device, the method comprising:
- receiving a first audio stream;
- converting the first audio stream to a first wireless input signal;
- determining position data of the hearing device;
- processing the first wireless audio signal based on the position data of the hearing
device to form an output signal; and
- converting the output signal to an audio output signal.
11. Method according to claim 10, the method comprising
- receiving an acoustic audio signal;
- converting the acoustic audio signal to an audio input signal; and
- processing the audio input signal and the first wireless audio signal based on the
position data of the hearing device to form the output signal.