(19)
(11)EP 3 346 730 A1

(12)EUROPEAN PATENT APPLICATION

(43)Date of publication:
11.07.2018 Bulletin 2018/28

(21)Application number: 17209911.1

(22)Date of filing:  22.12.2017
(51)International Patent Classification (IPC): 
H04R 5/02(2006.01)
G02B 27/01(2006.01)
H04R 5/033(2006.01)
(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR
Designated Extension States:
BA ME
Designated Validation States:
MA MD TN

(30)Priority: 04.01.2017 EP 17150264

(71)Applicant: Harman Becker Automotive Systems GmbH
76307 Karlsbad (DE)

(72)Inventor:
  • WOELFL, Genaro
    94330 Salching (DE)

(74)Representative: Westphal, Mussgnug & Partner Patentanwälte mbB 
Werinherstrasse 79
81541 München
81541 München (DE)

  


(54)HEADSET FOR 3D AUDIO GENERATION


(57) A headset arrangement for virtual reality, augmented reality or mixed reality applications is configured to induce natural directional pinna cues. The arrangement comprises a support structure configured to be arranged on a user's head and to hold a display in front of the user's eyes. For each ear, the support structure comprises at least a first sound source and a second sound source, wherein, when the support structure is arranged on a user's head, the first sound source and the second sound source are arranged such that at the concha of the user a primary sound incidence direction of sound emitted by the first sound source is essentially opposing to a primary sound incidence direction of sound emitted by the second sound source. The primary sound incidence direction is the direction from which the sound emitted by a sound source reaches the concha for the first time.




Description

TECHNICAL FIELD



[0001] The disclosure relates to arrangements and methods for 3D audio generation, in particular for 3D audio generation for virtual and augmented reality applications.

BACKGROUND



[0002] Virtual reality (VR) and augmented reality (AR) applications have become more and more popular. Virtual reality typically refers to computer technologies that use software to generate realistic images, sounds and other sensations that replicate a real environment, or create an imaginary setting, and simulate a user's physical presence in this environment, by enabling the user to interact with this space and any objects depicted therein using specialized display screens or projectors and other devices. Virtual reality equipment usually includes a headset that may be arranged on the user's head. The headset holds a display in position in front of the user's eyes and in some cases provides loudspeakers for generating a suitable sound experience. Often, VR headsets are combined with standard headphones. Most headphones available on the market today produce an in-head sound image when driven by a conventionally mixed stereo signal. "In-head sound image" in this context means that the predominant part of the sound image is perceived as being originated inside the user's head, usually on an axis between the ears. If sound is externalized by suitable signal processing methods (externalizing in this context means the manipulation of the spatial representation in a way such that the predominant part of the sound image is perceived as being originated outside the user's head), the center image tends to move mainly upwards instead of moving towards the front of the user. While especially binaural techniques based on HRTF filtering are very effective in externalizing the sound image and even positioning virtual sound sources on most positions around the user's head, such techniques usually fail to position virtual sources correctly on a frontal part of the median plane (in front of the user).

[0003] This means that acoustic events from the front, which is arguably the most important direction for VR environments and AR applications, currently cannot be reliably reproduced at the correct position when played over commercially available headphones. Generally, the visual content of VR or AR applications may help to improve frontal localization. However, visible sound sources for all sounds in front of the user are not necessarily present in VR and AR applications. In some embodiments of the present invention the localization of sound sources in front of the user may be improved if combined with suitable signal processing. Besides the optimization of spatial sound aspects for VR and AR applications, ease of use and wearing comfort are further important factors for VR and AR headsets. Loudspeakers that are integrated into VR and AR headsets generally help to prevent the clutter that may result when two devices are worn on top of each other (VR/AR headset and headphones). Current arrangements that try to integrate loudspeakers into the VR/AR headsets suffer from a degradation of special sound aspects, especially perceived source direction and limited low frequency output. In order to avoid the degradation of localization performance, an individual compensation of the transfer functions between the loudspeakers and the ears may be used for each user. The proposed sound source arrangements do not require individual transfer function compensation and, therefore, can avoid the corresponding measurement procedure as well as measurement hardware.

SUMMARY



[0004] A headset arrangement for virtual reality, augmented reality or mixed reality applications is configured to induce natural directional pinna cues. The arrangement comprises a support structure configured to be arranged on a user's head and to hold a display in front of the user's eyes. For each ear, the support structure comprises at least a first sound source and a second sound source, wherein, when the support structure is arranged on a user's head, the first sound source and the second sound source are arranged such that at the concha of the user a primary sound incidence direction of sound emitted by the first sound source is essentially opposing to a primary sound incidence direction of sound emitted by the second sound source. The primary sound incidence direction is the direction from which the sound emitted by a sound source reaches the concha for the first time.

[0005] Other systems, methods, features and advantages will be or will become apparent to one with skill in the art upon examination of the following detailed description and figures. It is intended that all such additional systems, methods, features and advantages be included within this description, be within the scope of the invention and be protected by the following claims.

BRIEF DESCRIPTION OF THE DRAWINGS



[0006] The method may be better understood with reference to the following description and drawings. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention. Moreover, in the figures, like referenced numerals designate corresponding parts throughout the different views.

Figure 1, schematically illustrates different planes and angles for source localization.

Figure 2, including Figures 2A and 2B, schematically illustrates a typical path of virtual sources positioned around a user's head.

Figure 3 schematically illustrates a possible path of virtual sources positioned around a user's head.

Figure 4, including Figures 4A to 4C, schematically illustrates virtual reality headset arrangements with integrated sound sources.

Figure 5 schematically illustrates a further virtual reality headset arrangement.

Figure 6 schematically illustrates a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 7 schematically illustrates a further virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 8, including Figures 8A to 8C, schematically illustrates a further example of a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 9 schematically illustrates a further example of a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 10, including Figures 10A to 10D, schematically illustrates a further example of a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 11 schematically illustrates a further example of a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 12 schematically illustrates possible regions for sound source arrangement.

Figure 13 schematically illustrates examples of sound source positioning with respect to the user's ear.

Figure 14, including Figures 14A to 14D, schematically illustrates further examples of sound source positioning with respect to the user's ear.

Figure 15, including Figures 15A to 15D, schematically illustrates further examples of sound source positioning with respect to the user's ear.

Figure 16, including Figures 16A to 16D, schematically illustrates further examples of sound source positioning with respect to the user's ear.

Figure 17 schematically illustrates possible positions of sound sources with respect to the user's ear.

Figure 18 schematically illustrates sound emitted by a point source and by an extended sound source.

Figure 19, including Figures 19A and 19B, schematically illustrates a further example of a virtual reality headset arrangement and possible positions of sound sources with respect to the user's ear.

Figure 20, including Figures 20A to 20C, schematically illustrates further examples of sound source positioning with respect to the user's ear.


DETAILED DESCRIPTION



[0007] Many virtual reality (VR) and augmented reality (AR) headsets today rely on additional conventional headphones to generate sound for VR and AR applications. Only few VR and AR headsets have loudspeakers directly integrated into the support structure of the headset that is worn on the head to hold the display in place in front of the user's eyes. Usually, an additional headphone has to be worn by the user.

[0008] Sound source positions in the space surrounding the user can be described by means of an azimuth angle ϕ (position left to right), an elevation angle υ (position up and down) and a distance measure (distance of the sound source from the user). The azimuth and the elevation angle are usually sufficient to describe the direction of a sound source. The human auditory system uses several cues for sound source localization, including interaural time difference (ITD), interaural level difference (ILD), and pinna resonance and cancellation effects, that are all combined within the head related transfer function (HRTF). Figure 1 illustrates the planes of source localization, namely a horizontal plane (also called transverse plane) which is generally parallel to the ground surface and which divides the user's head in an upper part and a lower part, a median plane (also called midsagittal plane) which is perpendicular to the horizontal plane and, therefore, to the ground surface and which crosses the user's head midway between the user's ears, thereby dividing the head in a left side and a right side, and a frontal plane (also called coronal plane) which equally divides anterior aspects and posterior aspects and which lies at right angles to both the horizontal plane and the median plane. Azimuth angle ϕ and elevation angle υ are also illustrated in Figure 1 as well as a first axis x (parallel to the horizontal plane and perpendicular to the median plane), a second axis y (parallel to the median plane and perpendicular to the horizontal plane), and a third axis z (parallel to the median plane and perpendicular to the frontal plane).

[0009] If sound in conventional headphone arrangements is externalized by suitable signal processing methods (externalizing in this context means that at least the predominant part of the sound image is perceived as being originated outside the user's head), the center channel image tends to move mainly upwards instead of to the front. This is exemplarily illustrated in Figure 2A, wherein SR identifies the surround rear image location, R identifies the front right image location and C identifies the center channel image location. Virtual sound sources may, for example, be located somewhere on and travel along the path of possible source locations as is indicated in Figure 2A if the azimuth angle ϕ (see Figure 1) is incrementally shifted from 0° to 360° for binaural synthesis, based on generalized head related transfer functions (HRTF) from the horizontal plane. While especially binaural techniques based on HRTF filtering are very effective in externalizing the sound image and even positioning virtual sound sources on most positions around the user's head, such techniques usually fail to position sources correctly on a frontal part of the median plane. A further problem that may occur is the so-called front-back confusion, as is illustrated in Figure 2B. Front-back confusion means that the user 2 is not able to locate the image reliably in the front of his head, but anywhere above or even behind his head. This means that neither the center sound image of conventional stereo systems nor the center channel sound image of common surround sound formats can be reproduced at the correct position when played over commercially available headphones, although those positions are the most important positions for stereo and surround sound presentation as well as for VR and AR applications.

[0010] Sound sources that are arranged on the median plane (azimuth angle ϕ = 0°) lack interaural differences in time (ITD) and level (ILD) which could be used to position virtual sources. If a sound source is located on the median plane, the distance between the sound source and the ear as well as the shading of the ear through the head are the same to both the right ear and the left ear. Therefore, the time the sound needs to travel from the sound source to the right ear is the same as the time the sound needs to travel from the sound source to the left ear and the amplitude response alteration caused by the shading of the ear through parts of the head is also equal for both ears. The human auditory system analyzes cancellation and resonance magnification effects that are produced by the pinnae, referred to as pinna resonances in the following, to determine the elevation angle on the median plane. Each source elevation angle and each pinna generally provokes very specific and distinct pinna resonances.

[0011] Pinna resonances may be applied to a signal by means of filters derived from HRTF measurements. However, attempts to apply foreign (e.g., from another human individual), generalized (e.g., averaged over a representative group of individuals), or simplified HRTF filters usually fail to deliver a stable location of the source in the front, due to strong deviations between the individual pinnae. Only individual HRTF filters are usually able to generate stable frontal images on the median plane if applied in combination with individual headphone equalizing. However, such a degree of individualization of signal processing is almost impossible for the consumer mass market.

[0012] The present invention discloses VR and AR headset arrangements that are capable of individually generating directional pinna cues associated with at least two approximately opposing directions. Some of the proposed headset arrangements support the generation of an improved centered frontal sound image and embodiments of the invention are further capable of positioning virtual sound sources all around the user's head 2 if combined with appropriate signal processing. This is exemplarily illustrated in Figure 3, where the center channel image C is located at a desired position in front of the user's head 2. If directional pinna cues associated with the frontal and rear hemisphere are available and can be individually controlled, for example if they are produced by separate loudspeakers, it is possible to position virtual sources all around the user's head if, in addition, suitable signal processing is applied. Additionally, directional pinna cues from above and below the user 2 may be induced to improve the placement of the virtual sources in the respective hemisphere.

[0013] Some of the VR headsets available today provide integrated solutions for audio playback. One example of such a VR headset 100 is schematically illustrated in Figure 4A. The headset 100 includes a support unit 120. The support unit 120 is generally configured to hold the headset 100 on the user's head. A display 140 is coupled to the support unit 120. The display 140 is arranged on the support unit 120 such that it is held in front of the user's eyes. The headset 100 of Figure 4A is designed in the shape of eyeglasses. The support unit 120 is designed as a ring that surrounds the user's head and the display 140 is designed as eyeglass lenses. A sound source 160 is integrated into the support unit 120. As the earpieces 120 are arranged above the user's ears, the sound source 160 is arranged above the user's ears when the headset 100 is worn by the user. The sound, therefore, is provided from above the user's ears (main direction of sound propagation essentially perpendicular to the horizontal plane).

[0014] Figure 4B schematically illustrates a further prior art example of a headset 100. In this example the support unit 120 includes several straps that are arranged such that the headset 100 is held on the user's head. For example, one strap may run along each side of the user's head above the ear and one strap may run along the top of the user's head. The straps may be joined at the back of the user's head. The display 140 may be coupled to the straps such that it is held in front of the user's eyes when the headset 100 is worn by the user. The sound sources 160 are designed as some kind of on-ear headphone that are placed on the ears of the user 2 when the headset 100 is worn by the user 2. The sound, therefore, is provided in the same way as in standard headphones. The on-ear headphones of the headset 100 in Figure 4B block the ears from the acoustic environment and may put physical pressure on the ears which might me unpleasant for the user.

[0015] A third example of a prior art headset 100 is schematically illustrated in Figure 4C. The sound sources 160 are designed as closed-back over the ear headphones. The support unit 120 includes some kind of headband which, however, is not worn over the head, but in front of the head. The display 140 is integrated in the support unit 120. When worn by the user, the headset 100 is held in place by the closed-back headphones arranged on the ears of the user 2 and by the headband which runs in front of the user's head and may rest on the user's nose, for example. The sound, therefore, is provided in the same way as in standard headphones. The arrangement, therefore, has similar drawbacks as standard headphones and as the arrangement of Figure 4B. None of the headset arrangements 100 of Figure 4 is able to reliably place stable virtual sound sources directly in front of the user's head without additional signal processing, wherein the signal processing includes individual HRTF filters for the respective user.

[0016] Figure 5 schematically illustrates a simplified version of the headset arrangement 100 of Figure 4A. A sound source 160 is integrated into the support unit 120 and emits sound directly from above the user's ear. The sound source 160, therefore, is arranged in relative proximity of the user's ear, however, positioning a single sound source above the user's ear is detrimental for the generation of a frontal sound image because it induces a directional cue associated with directions above the user, which contradicts the desired directional perception in front of the user. This may generally be overcome by compensation filters that equalize the speaker to ear transfer function to be approximately equal over frequency.

[0017] Most VR headsets today, however, do not have any integrated audio sources, but have to be combined with standard headphones. The spatial characteristics of typical headphones are usually less important than general sound quality attributes such as tonal balance, a wide working frequency range and low distortion. If the general sound quality is inferior to typical headphone standards, spatial effects are usually rejected by users, especially for stereo playback. Embodiments of the proposed headset arrangement may not be substantially worse in general sound quality aspects than typical headphones that are available today. Especially the playback of low frequencies usually requires physical structures of considerable size to be positioned around the user's ear. The reduction of negative effects of such structures on the controlled induction of natural directional pinna cues is one aspect of the proposed headset arrangement. Controlled induction of natural directional pinna cues can serve multiple purposes. As has been described before, the localization accuracy of virtual sources on the median plane can be improved by inducing suitable directional pinna cues. Another advantage over conventional binaural synthesis based on generalized HRTFs is the improved tonality, because the user is presented with his own spectral shape cues which are, in contrast to foreign spectral shape cues, not perceived as disturbing tonality alterations. On the other hand, directional pinna cues may also be suppressed in a controlled way by superposition of multiple essentially contradicting directional cues as provided by the proposed headset arrangements. This provides an ideal basis for conventional binaural synthesis based on generalized or individual HRTFs, because no disturbing directional pinna cues are generated by the headset arrangement.

[0018] Conventional binaural synthesis that is based on generalized or individual HRTFs is currently the de facto standard for virtual and augmented reality applications which often only provide a binaural (2 channel) signal. Finally, even normal stereo playback without any spatial processing may benefit from headset arrangements that do not produce uncontrolled comb filtering effects which may result from reflections inside a headphone structure and disturb the tonality of reproduced sound. In some of the proposed headset arrangements, which include measures for reducing reflections within the headset structure, the natural sound field may reach the ear of the user virtually unaltered. Furthermore, the proposed headset arrangement solves problems of conventional headphones such as unwanted pressure on the ears or heat built up inside the ear cups, for example.

[0019] Within this document, the terms pinna cues and pinna resonances are used to denominate the frequency and phase response alterations imposed by the pinna and possibly also the ear canal in response to the direction of arrival of sound. The terms directional pinna cues and directional pinna resonances within this document have the same meaning as the terms pinna cues and pinna resonances, but are used to emphasize the directional aspect of the frequency and phase response alterations produced by the pinna. Furthermore, the terms natural pinna cues, natural directional pinna cues and natural pinna resonances are used to point out that these resonances are actually generated by the user's pinna in response to a sound field in contrast to signal processing that emulates the effects of the pinna. Generally, pinna resonances that carry distinct directional cues are excited if the pinna is subjected to a direct, approximately unidirectional sound field from the desired direction. This means that sound waves emanating from a source from a certain direction hit the pinna without the addition of very early reflected sounds of the same sound source from different directions. While humans are generally able to determine the direction of a sound source in the presence of typical early room reflections, reflections that arrive within a too short time window after the direct sound will alter the perceived sound direction. Therefore, some embodiments of the headset arrangement according to the present invention send direct sound to the pinna while suppressing, or at least reducing, reflections from surfaces close to the pinna and, therefore, are able to induce strong directional cues.

[0020] Known stereo headphones generally can be grouped into in-ear, over-ear and around-ear types. Around-ear types are commonly available as so-called closed-back headphones with a closed back-chamber behind the loudspeaker or as so-called open-back headphones with an open back-chamber behind the loudspeaker. Headphones may have a single or multiple drivers (loudspeakers). Besides high quality in-ear headphones, specific multi-way surround sound headphones exist that utilize multiple loudspeakers aiming on generation of directional effects.

[0021] In-ear headphones are generally not able to generate natural pinna cues, due to the fact that the sound does not pass the pinna at all and is directly emitted into the ear canal. Within a fairly large frequency range, on-ear and around-ear headphones having a closed back produce a pressure chamber around the ear that usually either completely avoids pinna resonances or at least alters them in an unnatural way. In addition, this pressure chamber is directly coupled to the ear canal which alters ear canal resonances as compared to an open sound-field, thereby further obscuring natural directional cues. At higher frequencies, elements of the ear cups reflect sound, whereby a diffuse sound field is produced that cannot induce pinna resonances associated with a single direction. The headset according to the present invention includes an open sound structure and, therefore, avoids such drawbacks.

[0022] Typical open-back headphones as well as most closed-back around-ear and on-ear headphones that are available on the market today utilize large diameter loudspeakers. Such large diameter loudspeakers are often almost as big as the pinna itself, thereby producing a large plane sound wave from the side of the head that is not appropriate to generate consistent pinna resonances as would result from a directional sound field from the front. Additionally, the relatively large size of such loudspeakers as compared to the pinna, as well as the close distance between the loudspeaker and the pinna and the large reflective surface of such loudspeakers result in an acoustic situation which resembles a pressure chamber for low to medium frequencies and a reflective environment for high frequencies. Both situations are detrimental to the induction of natural directional pinna cues associated with a single direction.

[0023] Surround sound headphones with multiple loudspeakers usually combine loudspeaker positions on the side of the pinna with a pressure chamber effect and reflective environments. Such headphones are usually not able to generate consistent directional pinna cues, especially not for the frontal hemisphere.

[0024] Generally all kinds of objects that cover the pinna, such as back covers of headphones or large loudspeakers themselves may cause multiple reflections within the chamber around the ear which generates a diffused sound field that is detrimental for natural pinna effects as caused by directional sound fields.

[0025] Therefore, the present invention provides an optimized headset arrangement that allows to send direct sound towards the pinna from all desired directions while minimizing reflections, in particular reflections from the headset arrangement itself into the region of the pinna or the concha of the user. While pinna resonances are widely accepted to be effective above frequencies of about 2kHz, real world loudspeakers usually produce various kinds of noise and distortion that will allow the localization of the loudspeaker even for substantially lower frequencies. The user may also notice differences in distortion, temporal characteristics (e.g., decay time) and directivity between different speakers used within the frequency spectrum of the human voice. Therefore, a lower frequency limit in the order of about 200Hz or lower may be chosen for the loudspeakers that are used to induce directional cues with natural pinna resonances, while reflections may be controlled at least for higher frequencies (e.g., above 2 - 4 kHz).

[0026] Generating a stable frontal image on the median plane presents the presumably highest challenge as compared to generating a stable image from other directions. Generally, the generation of individual directional pinna cues is more important for the frontal hemisphere (in front of the user) than for the rear hemisphere (behind the user). Effective natural directional pinna cues are easier to induce for the rear hemisphere for which the replacement with generalized cues is generally possible with good effects at least for standard headphones which place loudspeakers at the side of the pinna. Therefore, some of the proposed headset arrangements focus on optimization of frontal hemisphere cues while providing weaker, but still adequate, directional cues for the rear hemisphere. Other arrangements may provide equally good directional cues for each of the front and rear direction. To achieve strong natural directional pinna cues, the headset arrangements are configured such that the sound waves emanated by one or more sound sources mainly pass the pinna, or at least the concha, once from the desired direction with reduced energy in reflections that may occur from other directions. Some arrangements focus on the reduction of reflections for sound sources in the frontal part of the sound structure, while other arrangements minimize reflections independent from the position of the sound source. The sound structure of a VR or AR headset according to the present invention maycomprise such parts of the headset, which contribute to the generation or control of sound. Such parts may, for example, comprise sound sources, waveguides, sound tubes, reflectors, and any support structure for any of these components. The sound structure may be partly or completely integrated into a larger support structure of the headset. The sound structure may encircle the ear of the user partly or completely... The present invention generally avoids putting the ear into a pressure chamber, at least above 2kHz, and in some embodiments reduces reflections into the pinnae which tend to cause a diffuse sound field. To avoid reflections, the at least two sound sources may be positioned on the headset such that it results in the desired directions of the respective sound fields. The support structure is arranged such that reflections are avoided or minimized.

[0027] Most VR and AR headsets today include solid structures that are arranged almost all around the user's head to comfortably support the weight of the display that is arranged in front of the user's eyes. The display usually forms a mass center that is arranged at a comparably large distance in front of the user's head. In many cases such solid structures generally allow an integration of loudspeakers or, more generally speaking, sound sources. An integration of sound sources usually only causes a moderate increase of the external dimensions of the headset. In any case, most of the headset structures today are strong enough to carry additional sound sources. Most headset structures also allow to place the sound sources at clearly defined positions with respect to the user's ears. Some headset structures already offer an advantageous design that allows to place the sound sources at positions which are advantageous for generation of natural directional pinna cues associated with the preferred directions for improvement of virtual sound source positioning (e.g., front and back). Furthermore, an uneven mass distribution caused by the display arranged at the front of the headset structure allows for the addition of a certain weight along the middle and rear parts of the headset structure.

[0028] Therefore, according to some embodiments of the present invention, loudspeakers or sound sources are integrated into headset structures that are similar to known VR headset designs. These embodiments illustrate the principles of sound source integration into VR headsets, although sound sources generally may be integrated into any VR headset design. Generally, loudspeakers may be arranged anywhere on the headset structure. In some examples, the loudspeakers radiate sound directly in a desired direction. In other examples, however, one or more loudspeakers radiate sound into a sound control unit such as a sound canal, sound tube, wave guide, reflector or the like. The sound control unit may be configured to control the direction of the sound field that arrives at the ear of the user or, in particular at the pinna of the user's ear. For example, a loudspeaker may be arranged at a first end of a sound canal and the sound outlet at the other end of this sound canal may be arranged such that sound is emitted in a desired direction and/or from a desired position with respect to the pinna when exiting the sound canal. The respective loudspeakers, however, do not necessarily have to be arranged in proximity to the user's ear and/or emit sound in a desired direction. For example, a loudspeaker may be arranged within a sound canal, sound tube or wave guide of which separate sections attach to the front and respectively back of the loudspeaker, guiding sound from one side of the loudspeaker towards a pinna of the user while guiding sound from the other side of the loudspeaker away from the pinna or towards the second pinna. The Figures exemplarily illustrate loudspeakers and loudspeaker arrangements. However, it should be noted that the loudspeakers illustrated in the Figures merely represent sound sources, e.g., sound outlets of sound control units, and the sound may be generated at different locations within the headset structure. In those examples where the loudspeakers are arranged at or close to the positions illustrated in the Figures, they should not necessarily be understood as a single loudspeaker. One of the exemplarily illustrated sound sources may include more than one loudspeaker or more than one other sound generating device. In any case, it may be assumed that sound sources direct at least a part of their radiated sound towards the pinna. Furthermore, most of the Figures illustrate a headset structure only for the right side of a user's head. It should be noted that the same applies for the other ear (e.g., left ear) which is not illustrated in the Figures.

[0029] One example of a headset 100 is illustrated in Figure 6. The headset 100 includes a support unit 120. A display 140 may be integrated into the support unit 120. The display 140, however, may be a separate display 140 that may be separably mounted to the support unit 120. The support unit 120 forms at least one sound structure 14. The sound structure 14 comprises a frame that is configured to form an open structure around the ear. The frame of the sound structure 14 may be arranged to partly or entirely encircle the ear of the user 2. In the example of Figure 6, the frame only partly encircles the user's ear, e.g., half of the ear. This is, however, only an example. In other examples, the frame may encircle the ear to a higher (e.g., completely) or a lesser extent (e.g., a quarter of the ear or even less).The frame may be a continuous frame that partly or completely encircles the ear in one continuous piece and without any breaks, or it may be a broken frame, meaning that it includes at least one break within its circumference. The frame may define an open volume about the ear of the user 2, when the headset is worn by the user 2. In particular, the open volume may be essentially open to a side that faces away from the head of the user 2. The support unit 120 is configured to hold the sound structure 14 in place about the ear of the user 2. At least two sound sources 20, 30, 40 are arranged along the frame of the sound structure 14. For example, one front sound source 20 may be arranged at the front of the user's ear, one rear sound source 30 may be arranged behind the user's ear and one top sound source 40 may be arranged above the user's ear.

[0030] The frame of the sound structure 14 may be at least partially hollow inside. One or more walls may separate one or more cavities inside the frame from the surrounding air on the outside. At least one of the sound sources 20, 30, 40 may be a loudspeaker, wherein a first side of the loudspeaker faces the outside and a second side of the loudspeaker faces one of the at least one cavities inside the frame. In this way the one or more cavities provide a back volume for at least one loudspeaker. The at least two sound sources 20, 30, 40 are configured to emit sound to the ear from a desired direction (e.g., from the front, rear or top). One of the at least two sound sources 20, 30, 40 may be positioned on the frontal half of the sound structure 14 to support the induction of natural directional cues as associated with the frontal hemisphere. At least one sound source 30 may be arranged behind the ear on the rear half of the sound structure 14 to support the induction of natural directional cues as associated with the rear hemisphere. When arranging the at least one sound source 20 on the frontal half of the sound structure 14, the sound source position with respect to the horizontal plane through the ear canal does not necessarily have to match the elevation angle υ of the resulting sound image. An optional sound source 40 above the user's ear, or user's pinna, may improve sound source locations above the user 2.

[0031] Figure 7 illustrates a further example of a headset 100. Whereas the support structure 120 illustrated in Figure 6 is a comparably large structure with a comparably large surface area which covers the user's head to a large extent, the support structure 120 of Figure 7 resembles eyeglasses with an a ring-shaped structure 120 that is arranged around the user's head and a display 140 that is held in position in front of the user's eyes. The frame of the sound structure 14 may include extensions 200, 300 that are coupled to the support structure 120, wherein a first extension 200 extends from the ring-shaped support structure in front of the user's ear and a second extension 300 extends from the ring-shaped support structure behind the user's ear. A section of the ring-shaped support structure may form a top part of the frame. One sound source 20 may be arranged in the first extension 200 to provide sound to the user's ear from the front. A second sound source 30 may be arranged in the second extension 300 to provide sound to the user's ear from the rear. The headset 100 in Figure 7 does not include a top sound source that is arranged to emit sound from above the user's ear. However, such a top sound source may optionally be included into the headset 100 of Figure 7. Further, the sound sources 30, 40 that are arranged in the extensions 200, 300 may be sound outlets of a sound control unit that may extend into the support structure 120 and may be acoustically coupled to at least one loudspeaker to provide a sound input into the sound control unit.

[0032] Figure 8 illustrates a further example of a headset 100. The arrangement illustrated in Figure 8A is equivalent to the arrangement of Figure 7. As can be seen, the first extension 200 and, therefore, the first sound source 20 is arranged relatively close to the user's pinna and emits sound essentially parallel to the horizontal plane (main direction of sound propagation essentially parallel to the horizontal plane). The first sound source 20 is arranged at a first distance d1 in front of the user's pinna. In one example, the first distance d1 may be shorter than 3cm or shorter than 5cm. As is illustrated in Figure 8B, the first sound source 20 in front of the user's ear may be moved further away from the pinna. In one example, the first distance d1 may be shorter than 8 cm or shorter than 10cm, for example. This means that the first sound source 20 may be arranged essentially at ear height anywhere along the support structure 120 between the display 140 and the pinna. For example, the first sound source 20 may be arranged essentially at ear height at the level of the user's cheek or at the level of the user's eye. In the example illustrated in Figure 8C, an additional third sound source 40 is arranged above the user's ear. The third sound source 40 above the user's ear mainly supports the generation of virtual sound sources above the user, while the first sound source 20 and the second sound source 30 support virtual sound source generation in front or behind the user 2. If combined with suitable signal processing, the first sound source 20 and the second sound source 30 may support the generation of sound sources in the entire horizontal plane or even all around the user. The third sound source 40 above the user's ear may additionally or exclusively support the low frequency range, e.g., frequencies below 2kHz or frequencies below 100Hz.

[0033] A similar arrangement is illustrated by means of Figure 9. The support structure 120 is similar to the support structure that has been described referring to Figure 4B. When worn by the user 2, first and second straps are arranged at the sides of the user's head above the user's ears. A third strap runs on the top of the user's head from the front of the support structure 120 to the back. At the back of the user's head, the first, second and third straps are interconnected. The support structure 120 in Figure 9 includes a first extension 200 and a second extension 300. The first extension 200 and the second extension 300 together with a part of the support structure form the sound structure of the headset arrangement 100. As has been described referring to Figure 7 above, the first extension 200 extends from the support structure 120 in front of the user's ear and the second extension extends 300 from the support structure 120 behind the user's ear. A first sound source 20 is arranged on the first extension 200 to emit sound from the front of the user's ear and a second sound source 30 is arranged on the second extension 300 to emit sound from behind the user's ear. The first extension 200 may be arranged at the level of the user's cheek or at the level of the user's eye, for example. The position of the first extension 200 may be defined by the position of the display 140 or a display holder of the support structure 120, for example.

[0034] As is illustrated in Figure 10A, the first extension 200 may be arranged almost directly in front of the user's ear. This means that the first distance d1 between the ear canal and the first extension 200 is rather short. For example, the first distance d1 may be shorter than 3cm or shorter than 5cm. However, as has been described by means of Figures 8B, 8C and 9 before and as is illustrated in Figure 10B, the first distance d1 may be shorter than 8cm or shorter than 10cm, for example. As is illustrated by means of Figure 10C, the first extension 200 may be omitted. Instead of arranging the first sound source 20 on a first extension 200, it may be arranged somewhere on the display 140, for example. In this way, the first sound source 20 may be arranged essentially at ear level at the level of the user's nose or even in front of the user's head, for example. The first distance d1 may be greater than 8cm or greater than 10cm, for example.

[0035] A third sound source 40 may be arranged on the support structure 120 essentially above the user's ear. The main direction of sound propagation of the third sound source 40 may be directed essentially towards the user's ear canal. However, the main direction of sound propagation of the third sound source 40 does not necessarily have to be perpendicular to the horizontal plane (sound source 40 arranged directly above the ear canal of the user 2). The third sound source 40 may be arranged such that its main direction of sound propagation is at an angle between about 45° and about 90°, between about 60° and 90° or between 75° and 90° with respect to the horizontal plane.

[0036] The second extension 300 may be an essentially straight extension passing behind the user's ear. This is, however, only an example. The second extension 300 may include an appendix which passes below the user's ear. In one example, the second extension 300 is essentially L-shaped. A fourth sound source 50 may be arranged on the appendix of the second extension 300 such that it emits sound from essentially below the user's ear (main direction of sound propagation perpendicular to the horizontal plane from below). It is also possible that the first extension 200 is an essentially L-shaped extension and includes a sound source which emits sound from essentially below the user's ear, for example.

[0037] Referring to Figure 11, a similar headset 100 is illustrated. The headset 100 includes a support structure 120, a display 140 and first, second and third sound sources 20, 30, 40 that are configured to emit sound from the front, the rear and from above the user's ear. The support structure 120 is somewhat different to the support structures 120 illustrated in Figures 6 to 10. The shape of the support structure 120 is such that no extensions are needed for arranging sound sources around the user's ear. The support structure 120 itself forms a sound structure at least partially around the user's ear, or, in other words, the sound structure is integrated into the support structure 120.

[0038] Generally, sound sources that are arranged essentially at ear level in front of the user's ear are suited particularly well for generating virtual sound sources in front of the user 2. However, there is a wide range of locations at which sound sources may be positioned around the ear or, in particular, around the pinna of the user 2. As has already been described above, the term "sound source" as used herein, may refer to a loudspeaker or to a sound outlet of a sound control unit which directs sound of a remote loudspeaker or any other remote sound generation unit in a desired direction. The general principle of the present invention is described in more detail referring to Figure 12. Examples a) and b) of Figure 12 illustrate an essentially oval shape about the ear of the user 2. The essentially oval shape is illustrated as a shaded area in examples a) and b). The oval shape about the user's ear represents a first region X2 which may be preferred for sound sources that are configured for low frequency playback, e.g., below 100 - 200Hz, according to one example. The first region X2 represented by the oval shape may also be an important region for the generation of natural directional pinna cues, e.g., above 2kHz. It should be noted that the distance between a low frequency sound source and the user's pinna is generally uncritical, as long as such sound sources do not interact with other sound sources that are used for the stimulation of pinna resonances (e.g., cause detrimental reflections). Due to the close proximity of the ear canal, typical sound pressure levels (SPL) for listening are not required for the far field of the associated sound source, which reduces the requirements concerning a maximum possible SPL of the sound source. It should be noted that the near field SPL requirements are extended towards the position of a sound outlet if a loudspeaker associated with a sound source emits sound into a canal, tube or waveguide whose sound outlet is arranged close to the ear canal of the user 2. This is exemplarily illustrated in Figure 19B. The headset arrangement 100 in Figure 19B comprises a sound canal 60. One or more third sound sources 40 may be arranged on the support structure 120 such that they emit sound into the sound canal 60. The sound canal comprises an outlet. The outlet faces in the direction of the open volume around the user's ear. Therefore, sound that is generated by at least one loudspeaker is emitted into the sound canal 60 and exits the sound canal 60 through the outlet into the open volume around the user's ear. The one or more loudspeakers together with the sound canal 60 form the third sound source 40. For example, sound sources that are configured for low frequency playback, e.g., below 100 - 200Hz, which may therefore have a larger physical size than loudspeakers for frequencies above 100 - 200Hz, may be placed further away from the ear canal to allow a better integration into predetermined or generally desired structures of VR or AR headsets.

[0039] The examples of Figure 19 are similar to the examples that are illustrated in Figure 10. The support structure 120 is similarly attached to the user's head as compared to the support structure in Figure 10. The frame of the sound structure 14 in Figure 19, however, includes only one extension coupled to the support structure 120. This extension extends from the support structure 120 behind the user's ear. The sound structure 14 in Figure 19 does not include a second extension which extends from the support structure 120 in front of the user's ear. A first sound source 20 that is arranged in front of the user's ear to emit sound from the front may be coupled to the display 140, for example. The display 140 is generally held in front of the user's eyes by a kind of display support structure which may further shield the user's eyes from the surroundings and any disturbing lights, for example. A sound source 20 may, for example, be arranged on or integrated into such a display support structure. Figure 19A illustrates an example that includes sound sources 20, 30 only at the front and behind the user's ear. The example in Figure 19B further includes a sound source 40 above the user's ear that includes loudspeakers which emit sound into a sound canal 60, as has been described above. The outlet of the sound canal 60 may be arranged such that sound emitted from the third sound source 40 reaches the user's ear from above, from the front or any direction in between.

[0040] Examples a) and b) of Figure 12 also illustrate a second region X4. The second region X4 represents a region in which sound sources may be arranged remote from the first region X2. Such remote positions are often available for sound source integration in many VR headsets. Sound source positions within the second region X4 are often very well suited for the purpose of controlled stimulation of natural directional pinna cues. Generally, the second region X4 may at least partly overlap with the side profile of a user's head, as is illustrated in Figure 12. It is, however, possible that parts of the second region X4 extend beyond the side profile of the user's head in a frontal direction, as is illustrated in examples b) and e), for example. If a sound source is arranged comparatively close to the user's pinna, direct sound reaches the respective ear on that side of the user's head at which the sound source is located. Direct sound to the other side of the user's head, however, may be blocked by the user's head. If a sound source is arranged comparatively far away from the user's pinna, as illustrated in examples b) and e) of Figure 12, for example, direct sound reaches the respective ear on that side of the user's head at which the sound source is located. Direct sound to the other side of the user's head, however, may be blocked by the support structure or the display in front of the user's head. Examples c) and d) of Figure 12 illustrate further shapes of the second region X4 within which the sound sources may be arranged.

[0041] For natural pinna resonance stimulation above about 2kHz a sound source that is arranged approximately in front of the pinna can be used to improve stability and accuracy of virtual sound sources in front of the user. A definition of directions with respect to the pinna, e.g., front, rear, left, right, is given by means of Figure 17 further below. If virtual sound sources are only required in the frontal hemisphere, a single sound source in front of the pinna may be sufficient. However, this is usually not the case for VR or AR applications. Similarly, a single sound source behind the pinna may be sufficient if only virtual sound sources from the back are needed. Single sound sources above or below the pinna are similarly restricted in the supported field of possible virtual source positions. The further the sound source position moves towards the side of the pinna, the less pronounced are the directional cues from the pinna and the less restriction applies to the field of possible virtual source positions. If a single sound source is arranged on the side of the pinna (position designated with "S" in Figure 17), this situation resembles that of a conventional open-back headphone for which virtual sound sources in front of the user are very complex to generate. In all cases that require full 2D or 3D audio support, the headset arrangement may comprise a first sound source and a second sound source, wherein the first sound source is configured to generate directional pinna cues in form of natural pinna resonances and the second sound source is configured to provide pinna resonances that are associated with a direction that essentially opposes the direction associated with the pinna resonances generated by the first sound source. Strong natural directional pinna cues especially from the median plane usually cannot be reliably outweighed by binaural signal processing, unless the transfer function from the sound source producing the natural pinna cues to the input of the respective ear canal is compensated. This results in the already mentioned problem of unknown individual pinna resonances.

[0042] Therefore, the proposed headset aims at essentially neutralizing natural directional cues in form of pinna resonances for those cases in which the desired virtual sound source direction does not match the available directional cue from any individual or combined sound sources. Therefore, sound fields from opposing directions are superimposed in the area of the pinna. This requires respective sound sources arranged at largely opposing directions with respect to the pinna or concha region. If a sound source is arranged in front of the pinna, another sound source behind the pinna may be added to complement the sound source in front of the pinna with a sound field from an opposing direction. This is exemplarily illustrated in Figure 13. In example a) of Figure 13, a first sound source 21 is arranged in front of the user's pinna or concha. A relevant direction of sound propagation of the first sound source 21 in example a) is essentially parallel to the horizontal plane. A second sound source 22 is arranged behind the user's pinna or concha. A relevant direction of sound propagation of the second sound source 22 is also essentially parallel to the horizontal plane, but in an opposing direction as compared to the main direction of sound propagation of the first sound source 21. The relevant direction of sound propagation of a sound source is the direction of sound emitted by the respective sound source towards the ear canal of the user. The relevant direction of sound propagation of a sound source is a result of the position of the sound source relative to the concha of the user 2. It is not a feature of the sound source alone. The relevant direction of sound propagation may coincide with the direction of the main radiation lobe of the loudspeaker if the loudspeaker is oriented with its main radiation lobe pointed towards the concha of the user 2. If, however, the main radiation lobe is not angled towards the concha, the direction of the main radiation lobe does not equal the relevant direction of sound propagation. The relevant direction of sound propagation is illustrated by means of arrows in examples a) and b) of Figure 13. In the example a) of Figure 13, a resulting angle between the relevant directions of sound propagation of the two sound sources 21, 22 is 180°. However, the term "essentially opposing" may also refer to angles of 180° ± 5°, 180° ± 10°, 180° ± 15°, 180° ± 20°, 180° ± 30°, 180° ± 40°, 180° ± 50° or 180° ± 90°, for example.

[0043] In example b) of Figure 13 the relevant direction of sound propagation of the second sound source 22 is essentially the same as in example a) (parallel to the horizontal plane). The first sound source 21, however, is arranged at an angle below the horizontal plane. The first sound source 21 as well as its relevant direction of sound propagation are directed in an upwards direction towards the horizontal plane (indicated with an arrow), in particular towards the concha of the user. An angle ψ between the relevant direction of sound propagation of the first sound source 21 and the relevant direction of sound propagation of the second sound source 22 may be between about 170° and about 180°, between about 150° and about 180°, between about 140° and about 180° or between about 130° and about 180°. Any other angle between 90° and 180° is also possible. The first sound source 21 and the second sound source 22 may emit the same signal towards the concha area, at least for frequencies between about 4 and about 15 kHz. A section around the ear canal in the example b) of Figure 13 is illustrated in an enlarged manner below the Figure to more clearly illustrate the angle ψ between the relevant direction of sound propagation of the first sound source 21 and the relevant direction of sound propagation of the second sound source 22. In this example the relevant direction of sound propagation of the second sound source 22 falls onto the horizontal plane. In one example, the angle Φ between the relevant direction of sound propagation of the first sound source 21 and the horizontal plane may be between 10° and 50°. In other examples, different angles are possible. The relevant direction of sound propagation of the first sound source 21 and the horizontal plane may intersect within the concha of the user's ear. The first sound source 21 may be arranged below the horizontal plane and the relevant direction of sound propagation of the first sound source 21 may be directed towards the horizontal plane from below.

[0044] Instead of arranging a first sound source 21 in front of the user's pinna or concha and a second sound source 22 behind the user's pinna or concha, it is also possible, for example, to arrange one sound source above the user's pinna or concha and one sound source below the user's pinna or concha. In the second case, the relevant directions of sound propagation of the sound sources are essentially perpendicular to the horizontal plane. These are, however, only examples. Any other angles between the relevant direction of sound propagation of a sound source and the horizontal plane are possible, the relevant directions of the sound sources being essentially opposing with respect to the sound radiated towards the pinna or concha area. Possible angles ψ between the relevant directions of sound propagations of two essentially opposing sound sources have already been described above with respect to examples a) and b) of Figure 13. Any number of additional sound sources may be added to the opposing first and second sound sources. Additional sound sources may or may not complement the first or second sound source from an opposing direction. If, for example, a pair of complementing sound sources above and below the pinna is utilized, one additional sound source in front of the pinna may be sufficient, even if virtual sound sources behind the user are required. Virtual sound sources behind the user generally may be reliably generated by appropriate signal processing, if sound fields that are essentially free of clear natural directional cues can be applied to the respective ear.

[0045] Example c) of Figure 13 schematically illustrates a further example of sound source positioning. The arrangement in example c) of Figure 13 comprises a first sound source 21 and a second sound source 22 as has already been described with respect to example b) of Figure 13. The arrangement may further comprise a third sound source 23. The third sound source 23 may be arranged above the horizontal plane. An angle λ between the relevant direction of sound propagation of the third sound source 23 and the horizontal plane may be between 10° and 50°. In other examples, different angles are possible. The relevant direction of sound propagation of the third sound source 23 and the horizontal plane may intersect at the concha of the user's ear. The third sound source 23 may be arranged above the horizontal plane and the relevant direction of sound propagation of the third sound source 23 may be directed towards the horizontal plane from above. In the enlarged section of example c), a further angle Φ is illustrated between the relevant direction of sound propagation of the first sound source 21 and the horizontal plane. The horizontal plane is illustrated in a dashed line.

[0046] The three sound sources 21, 22, 23 may be arranged at the corners of an isosceles triangle, wherein the symmetry axis S1 of the triangle runs across the pinna or concha, or the ear canal. In example c), the second sound source 22 is arranged behind the pinna such that its relevant direction of sound propagation is essentially parallel to the horizontal plane. The first and third sound sources 21, 23 are arranged in front of the pinna, with the first sound source 21 being arranged below the horizontal plane and the third sound source 23 arranged above the horizontal plane. The relevant directions of sound propagation of the first and third sound sources 21, 23 arranged in front of the pinna are directed upwards or downwards, respectively, towards the horizontal plane and, in particular, towards the concha. The symmetry axis S1 in example c) is essentially parallel to the horizontal plane. This is, however, only an example. The symmetry axis S1 may be arranged at any angle with regard to the horizontal plane. In order to provide a signal to the user that is essentially neutral with regard to directional pinna cues induced at the user's ear, the first sound source 21, the second sound source 22 and the third sound source 23 may emit the same signal towards the concha of the user's ear, at least for frequencies between about 4 and about 15 kHz, whereas the signal level of the first sound source 21 and the third sound source 23 may be reduced by approximately 6dB as compared to the signal of the second sound source 22, because the total SPL of the first and third sound source 21, 23 adds up and, therefore, needs to be reduced for an equal weighting of frontal and rear directional pinna cues as induced by the frontal and rear sound sources, respectively.

[0047] Figures 14, 15 and 16 schematically illustrate further examples of sound source positioning. Sound sources, generally, may be positioned all around the pinna, with two or more pairs of sound sources opposing each other, as is illustrated in Figure 14A. In another example, three sound sources may be arranged at the corners of an isosceles triangle, as has been described with respect to Figure 13 before, and further sound sources may be added in different locations around the pinna, as is illustrated in Figure 14B. Sound sources may be arranged comparably close to the pinna or at a comparably large distance from the pinna, e.g., at the height of the user's cheeks or eyes. Figure 14C illustrates opposing sound sources above and below the user's pinna and further sound sources in front and behind the user's pinna. The example illustrated in Figure 14D also comprises pairs of opposing sound sources as well as additional sound sources without an opposing counterpart. The examples illustrated in Figures 15A to 15D and 16A to 16D also each comprise at least one pair of essentially opposing sound sources, with or without additional sound sources arranged at any location around the user's pinna.

[0048] Figures 15D and 16A, for example, schematically illustrate further examples of sound source positioning. The arrangements in Figures 15D and 16A each comprise a first sound source 21, a second sound source 22 and a third sound source 23. The positions of the first and third sound source 21, 23 and their relevant directions of sound propagation have already been described with respect to example c) of Figure 13. The second sound source 22 in the examples of Figures 15D and 16A, however, is arranged below the horizontal plane. An angle β between the relevant direction of sound propagation of the second sound source 22 and the horizontal plane may be between 10° and 50°. In other examples, different angles are possible. The relevant direction of sound propagation of the second sound source 22 and the horizontal plane may intersect at the concha of the user's ear. The second sound source 22 may be arranged below the horizontal plane and the relevant direction of sound propagation of the second sound source 22 may be directed towards the horizontal plane from below. The arrangements may further comprise a fourth sound source 24. The fourth sound source 24 may be arranged above the horizontal plane. An angle ε between the relevant direction of sound propagation of the fourth sound source 24 and the horizontal plane may be between 10° and 50°. In other examples, different angles are possible. The relevant direction of sound propagation of the fourth sound source 24 and the horizontal plane may intersect at the concha of the user's ear. The fourth sound source 24 may be arranged above the horizontal plane and the relevant direction of sound propagation of the fourth sound source 24 may be directed towards the horizontal plane from above. The example in Figure 15D differs from the example in Figure 16A in that the first and third sound sources 21, 23 are arranged further away from the ear and, therefore, also the pinna and concha.

[0049] Other arrangement, such as the arrangements that are illustrated by means of Figures 14A, 14C, 14D, 15A, 15C and 16C, for example, are similar to the arrangements of Figures 15D and 16A but include even more than the four sound sources. Further sound sources may be arranged above or below the user's ear, for example.

[0050] Figure 17 schematically illustrates different sound source locations or sound directions with respect to the user's ear. A sound source that is arranged in front of the user's ear (or pinna/concha), frontal direction F, is arranged in front of the frontal plane (also called coronal plane) which equally divides anterior aspects and posterior aspects of the user's head and which lies at right angles to both the horizontal plane and the median plane (see Figure 1). A frontal sound source may be arranged on a plane which runs through the user's ear and which is essentially parallel to the median plane (also called midsagittal plane) which is perpendicular to the ground surface and which crosses the user's head midway between the user's ears, thereby dividing the head in a left side and a right side. The relevant direction of sound propagation towards the concha from a sound source that is arranged on this plane (running through the user's ear parallel to the median plane) is essentially parallel to the median plane and essentially perpendicular to the frontal plane. It is, however, also possible, that a frontal sound source is not arranged on this plane (running through the user's ear essentially parallel to the median plane). A frontal sound source may be shifted with respect to such a plane such that its relevant direction of sound propagation towards the concha is at an angle α with respect to the median plane. The relevant direction of sound propagation from the sound source to the concha may be directed towards or away from the median plane. In any case, depending on the orientation and the position of the sound source with respect to the concha, the relevant direction of sound propagation of the respective sound source may or may not be identical with the direction of sound propagating towards the pinna/concha.

[0051] The same applies for a rear sound source which is arranged behind the frontal plane, rear direction R. A top sound source is arranged above the horizontal plane, which divides the user's head in an upper part and a lower part, top direction T, and a bottom sound source is arranged below the horizontal plane, bottom direction B. Top and bottom sound sources may be arranged on a plane which runs essentially parallel to the median plane such that their relevant direction of sound propagation towards the concha is essentially parallel to the median plane. It is, however, also possible that top and bottom sound sources are arranged such that their relevant direction of sound propagation towards the concha is at an angle α with respect to the median plane. The relevant direction of sound propagation towards the concha may be directed towards or away from the median plane. A sound source that is arranged on the side of the user's head, side direction S, may be arranged on the horizontal plane such that its relevant direction of sound propagation towards the concha is essentially parallel to the horizontal plane and the frontal plane and essentially perpendicular to the median plane.

[0052] Besides the above mentioned directions (front direction F, rear direction R, top direction T and bottom direction B), sound sources may be placed all around the ear with an angle α between their respective relevant direction of sound propagation towards the concha and a plane through the ear parallel to the median plane. Generally there are no restrictions for the angle α. However, it should be considered that especially virtual sound sources on the median plane, in particular sound sources in front of the user, are often subject to false localization due to the lack of interaural differences, as has already been mentioned before. Sound source positions that very closely mimic the incidence direction of sound of sound sources that are arranged on the median plane, are often very well suited for the induction of natural pinna resonances supporting specific directions on the median plane. Therefore, deviations of the angle α from the plane parallel to the median plane, as illustrated in Figure 17 in dashed lines (F, R, T and B fall into this plane), may be chosen between about 0° and 40° for such cases in which the sound source arrangement is not limited in any way by the user's head.

[0053] As has already been described above, very early reflections of sound that is emitted by a sound source that is used for generating directional pinna resonances may be caused by objects close to the pinna. Such very early reflections are detrimental to the introduction of strong natural directional pinna cues if they reach the pinna from considerably different directions than the direct sound. Therefore, such reflections should be avoided or at least reduced as far as possible. Measures that may be taken in order to reduce reflections that are directed towards the pinna include the avoidance of surface area orientations around the pinna that re-direct sound from any sound source towards the pinna, concealing any mechanical structures that are arranged behind the user's ear behind the pinna to shade them against direct sound, application of sound absorbing or low reflective material to structures that are prone to directing reflections at the pinna, and controlling sound source radiation patterns, thereby reducing sound radiation towards obstacles that would reflect sound towards the pinna. If reflections which cannot be avoided result in a small shift of the direction associated with the generated pinna cues from the intended direction, the position of the sound source may be shifted in order to compensate for the deviation from the desired direction associated with the pinna cues. If, for example, the elevation angle of a source direction associated with pinna cues induced by a frontal sound source is higher than desired, the position of the physical sound source may be shifted to a lower elevation angle to compensate for the deviation.

[0054] There are several parameters that can alter directional pinna cues. These parameters include the individual perception characteristics of the user which may lead to variations of the perceived image elevation angle, and reflections on parts of the headset arrangement. Generally, individual directional pinna resonance cues from the front support and improve the generation of sound images in the frontal hemisphere of the user and thereby also the generation of sound images at a centered position in front of the user, even if the incidence angle at which the sound source is positioned does not exactly match the elevation angle of the desired sound image.

[0055] The frame of the sound structure may have an essentially rounded or essentially oval shape. The rounded or oval shape, however, is only an example. Generally, the sound structure may have any suitable form, e.g., circular, rectangular or any other regular or irregular form. The form of the sound structure in combination with the sound source arrangement may be chosen such that reflections of the sound on the sides of the sound structure opposite to the sound sources are reduced. The form of the sound structure may be chosen such that the pinna is kept essentially open and such that it allows the sound sources to be positioned at effective angles with respect to the horizontal plane to obtain the desired sound direction. However, there are usually constraints when choosing an optimum shape of the sound structures. Such constraints may be given by the shape of the support structure. The desired target sound field is unidirectional, meaning that reflections into the pinna or at least the concha region are altogether avoided. If a direct sound emanated from the frontal part of the sound structure reaches the concha region and is accompanied by a reflection into the concha region from above or behind the pinna, a directional cue may be weakened or be destroyed altogether. The more or the stronger the reflections, the less clear directional pinna cues will be left. Therefore, reflections may be reduced in order to be able to provide strong directional pinna cues.

[0056] A possibility to reduce reflections into regions of the pinna or especially the concha, is to direct the reflections away from the pinna or concha. The external surface of sound structures or support structures may comprise a plurality of external surface sections. These external surface sections may for example be so small that their surface area is approximately plain (e.g. less than 1° variation in the direction of the vertical on any part of the surface area). External surface sections of a sound structure or support structure arranged around the ear may either be angled such that the verticals of these surface sections point in a direction towards the pinna or concha or in a direction that does not point towards the pinna or concha. In order to minimize reflections into the concha region, external surface sections that point towards the pinna or concha may be avoided or their surface area minimized. This is of particular importance for surface sections with a direct line of sight towards the pinna or especially the concha, or, in other words, from which a straight line can be drawn towards a part of the pinna or concha without intersection of other objects in between. External surface sections around the pinna may, for example, be angled at an angle <90°, <70° or <50° with respect to the median plane in order to direct reflections away from the pinna. For example more than 30%, more than 50% or more than 70% of the surface sections with a direct line of sight towards the pinna or concha may be angled at an angle <90°, <70° or <50° to the median plane such that their vertical does not point towards the pinna or concha. Generally the sound intensity of reflections when they reach the concha will be lower the more distant the surface section is, which directed the reflection towards the concha. In another example, more than 30%, more than 50% or more than 70% of the surface sections with a direct line of sight towards the pinna or concha may be angled at an angle <90°, <70° or <50° to the median plane such that their vertical does not point towards the pinna or concha only if these surface sections fall into a radius of, e.g., 10cm or 15cm around the concha.

[0057] A further possibility is to arrange at least one sound source that comprises surface sections with a direct line of sight towards the pinna or concha such that these surface sections face away from the pinna or concha. If, for example, the sound source is a loudspeaker with a membrane for sound radiation, the loudspeaker may be oriented such that the loudspeaker membrane and/or the main sound radiating lobe of the loudspeaker are tilted away from the pinna or concha. Loudspeakers may be arranged such that the loudspeaker membrane is arranged at an angle ≠ 90° with respect to the median plane. Loudspeakers generally radiate sound essentially uniformly at low frequencies and merely focus sound into a main radiation lobe at high frequencies. This may result in an amplitude response at the pinna, with falling levels towards high frequencies, which may simply be compensated by suitable equalizing filters that boost high frequencies for which loudspeakers usually provide enough headroom in the available sound pressure level.

[0058] An additional or alternative possibility for reducing reflections is the use of sound damping or sound absorbing materials. For example, highly sound absorbing foam materials exist that may be applied to any surface on the sound structure or support structure, most effectively on any surfaces facing the pinna. For example, sound absorbing materials based on glass mineral wool or cotton may be used. The so-called sound absorption coefficient, which describes the fraction of sound energy absorbed by a material, is known as a performance metric for sound absorbing materials. The sound absorption coefficient generally ranges between 0 (no absorption) and 1 (full absorption), although some measurement methods for determining the sound absorption coefficient may result in values >1. Usually the sound absorption coefficient is frequency-dependent and often tends to increase from low to high frequencies. For the application of sound absorbing materials within the proposed headset arrangements the sound absorption coefficient may be greater than 0.5 for frequencies between 2kHz and 15kHz or greater than 0.3 for frequencies between 4kHz and 10kHz. However, it should be noted that the absorption coefficient generally depends on the thickness of the sound absorbing material, the incident and reflection angles as well as the measurement method that is used to determine the absorption coefficient. For some materials the maximum sound absorption is reached at an intermediate frequency, while sound absorption decreases for lower and higher frequencies. Therefore, the sound absorption may vary over the surface of the headphone arrangement that is covered with sound absorbing material as well as with the frequency content of the sound.

[0059] A single loudspeaker or sound source generally resembles a point source, as is schematically illustrated in Figure 18, example a). A point source generally generates a spherical sound wave if the point source is arranged relatively close to the ear. When the point source is arranged comparatively far away from the ear, as is illustrated in example b), the sound wave is relatively plane. A larger (extended) sound source, as is schematically illustrated in Figure 18, example c), radiates an approximately plane sound wave. In one embodiment, the headset arrangement comprises an extended sound source. The extended sound source may provide large radiating membrane dimensions compared to the size of the pinna, which increases the directivity of the sound source and generates an approximately plane sound wave. Sound source directivity may be controlled by adapting the loudspeaker membrane dimensions, for example. The larger the size of the loudspeaker membrane, or more specifically the sound emitting part of the membrane in a certain dimension, the more focused the sound beam emitted by the loudspeaker in the corresponding direction. Focused sound sources usually cause fewer reflections than omni-directional sound sources. As the directivity of loudspeakers depends on the size of the sound radiating surface (membrane) relative to the wavelength of the emitted signal, especially higher frequencies (e.g., above 4kHz) benefit from increased directionality of the loudspeaker. Loudspeakers that are large as compared to the size of the pinna (or concha), generally better resemble the situation in the far field of a source. In such situations the sound wave within the dimensions of the pinna is predominantly travelling in one direction instead of expanding in all directions. Figure 18 demonstrates the differences between small sound sources (approximated by a point source in example a) and an extended sound source which has equal vertical dimensions as the pinna (see example c). As the curvature of the sound field arriving at the ear is an indicator of the distance between the source and the ear and changes drastically in the near field of the source, a sound field with an approximately flat wave front may be used to support the generation of distant virtual sources. A large vertical radiation area may be obtained by arranging two or more loudspeakers in proximity to each other and perform parallel playback on these two or more loudspeakers.

[0060] Remaining reflections may still adversely bias the perceived source localization, especially the elevation angle of the sound image. An additional or alternative possibility is to shift the sound source position along the opposing boundaries of the sound structure to compensate for the elevation bias. Users generally tend to locate frontal sound sources above the head or in front of the forehead when headphone playback with HRTF-based filtering is implemented. A comparable effect can be observed with normal stereo loudspeaker playback where the phantom image between the loudspeakers is often perceived above the physical loudspeaker position. One possibility to compensate for such phantom image or virtual source elevation effects for playback over the proposed headphone arrangements is to position the sound sources that are intended for generating frontal directional pinna cues associated with an elevation angle of 0°, below the horizontal plane through the ear canal to compensate for the tendency of increased elevation angle perception.

[0061] For example, one or more sound sources may be arranged below the horizontal plane on a frontal part of the sound structure such that they provide sound to the ear of the user from a lower frontal direction. If only one sound source is arranged below the horizontal plane on a frontal part of the sound structure, its relevant direction of sound propagation towards the concha may be angled with respect to the horizontal plane. In one example, its relevant direction of sound propagation towards the concha may be angled at an angle of about 10° to about 40° with respect to the horizontal plane. If two or more sound sources are arranged on the frontal part of the frame below the horizontal plane, the relevant direction of sound propagation towards the concha of each individual sound source may be angled with respect to the horizontal plane, and an average angle of the respective relevant directions of sound propagation may be between about 10° and about 40°.

[0062] Figure 20 schematically illustrates further examples of sound source positioning. Sound sources, generally, may be positioned all around the pinna, with two or more pairs of sound sources opposing each other, as has been described before and as is illustrated in Figure 14A. However, as is illustrated in Figure 20A, sound sources may, for example, only be positioned in front of the user's ear and behind the user's ear. Several sound sources that are positioned close to each other may optionally form a larger (extended) sound source, as has been described with respect to Figure 18, example c) before. In the arrangement of Figure 20A, a first sound source 21, a third sound source 23 and a fifth sound source 25 are arranged in front of the user's ear and, therefore, the user's pinna. A second sound source 22, a fourth sound source 24 and a sixth sound source 26 are arranged behind the user's ear and, therefore, the user's pinna. Neighboring sound sources may be arranged such that an angle σ between their relevant directions of sound propagations is between 10° and 50°. For example, a first angle σ1 between the relevant direction of sound propagation of the first sound source 21 and the relevant direction of sound propagation of the fifth sound source 25 may be between 10° and 50°. The same applies for the angles σ2, σ3 and σ4 between the relevant directions of sound propagation of other neighboring sound sources. As is illustrated in the example of Figure 20B, further sound sources may be arranged above the user's ear and optionally form one or more extended sound sources. The arrangement illustrated in Figure 20C is similar to the arrangement of Figure 16A. The externalization of the sound image may be further improved by additional signal processing in combination with the headset arrangements disclosed herein. Furthermore, signal processing may be applied to control the azimuth and elevation angles of virtual sources, as well as the distance of the virtual sources from the user. However, even without additional signal processing, partial externalization of the sound image may be achieved with the sound source arrangements as disclosed herein and, even more importantly, when using the sound source arrangement according to the present invention, a user may distinguish the different directions of sound sources in the front, the back, above or below that are associated with the different sound sources.

[0063] It should be noted that the proposed headset arrangements may include multiple sound sources that may be individually controlled by individual electrical sound signals. Furthermore, the voice coil impedance and/or efficiency of loudspeakers of the sound sources may not be compatible with standard headphone amplifiers, as, for example, headphone amplifiers as provided in many smart phones today. Therefore, the headset arrangement may include at least one electronic driving unit that is configured to receive an input signal and to apply the conditioned input signal as a driving signal to a single or multiple loudspeakers. Furthermore, the processing of the electrical sound signals may be required in some applications in order to achieve certain sound quality or sound spatiality characteristics. Therefore, the headset arrangement may include at least one signal processing unit that is configured to receive at least one input signal, to process the at least one input signal and to emit at least one processed input signal to at least one electronic driving unit.

[0064] According to one example, a headset arrangement for virtual reality or augmented reality applications is configured to generate natural directional pinna cues. The arrangement comprises a support structure configured to be arranged on a user's head and to hold a display in front of the user's eyes. The support structure comprises at least one ear cup comprising a frame that is configured to be arranged to at least partially encircle the ear of the user, thereby defining an open volume about the ear of the user, at least a first sound source and a second sound source arranged within the frame of the ear cup, wherein the first and the second sound source are arranged such that their main directions of sound propagation are directed in essentially opposing directions.

[0065] According to a further example, the first sound source and the second sound source emit the same content for frequencies between about 4 and about 15 kHz.

[0066] According to a further example, an angle ψ between the main direction of sound propagation of the first sound source and the main direction of propagation of the second sound source is between about 0° and about 10°, between about 0° and about 30°, between about 0° and about 50°, or between about 0° and about 90°.

[0067] According to a further example, the arrangement further comprisees a third sound source arranged within the frame of the ear cup, wherein the first, second and third sound sources are arranged at the corners of an isosceles triangle, and wherein a symmetry axis of the isosceles triangle runs across the pinna or the concha of the user.

[0068] According to a further example, the at least one ear cup is integrated into the support structure.

[0069] According to a further example, the ear cup comprises at least one extension that is connected to the support structure, wherein the at least one extension and at least a section of the support structure form the frame of the ear cup.

[0070] According to a further example, the first sound source and the second sound source comprise at least one of a loudspeaker, a sound canal, a sound tube, a wave guide and a reflector.

[0071] According to a further example, at least one of the first sound source and the second sound source comprises a loudspeaker that is arranged at a first end of a sound canal, and wherein a sound outlet at a second end of the sound canal is configured to emit sound into the open volume about the ear of the user.

[0072] According to a further example, the ear cup comprises surfaces that are oriented essentially towards the pinna and surfaces that are oriented essentially away from the pinna, wherein at least parts of the surfaces oriented essentially towards the pinna comprise a sound absorbing material, the sound absorbing material being configured to reduce the intensity of sound that is emitted by the sound sources and reflected towards the pinna of the user.

[0073] According to a further example, the frame comprises a plurality of sections, and wherein at least one section is arranged behind the pinna such that it is shaded from direct sound emitted by a sound source arranged on the frontal part of the ear cup.

[0074] According to a further example, the inner walls of the frame comprise a plurality of sections, wherein the inner walls of the frame are walls that are essentially facing the open volume within the frame, and at least sections that are arranged opposite to a sound source are at least partially beveled at an angle > 20° and < 90° with respect to a median plane to direct reflections away from the user's head, wherein the median plane crosses the user's head midway between the user's ears, thereby dividing the head exactly in a left side and a right side.

[0075] According to a further example, at least two sound sources are arranged adjacent to each other to form an extended sound source that is configured to emit an approximately plane sound wave.

[0076] While various embodiments of the invention have been described, it will be apparent to those of ordinary skill in the art that many more embodiments and implementations are possible within the scope of the invention. Accordingly, the invention is not to be restricted except in light of the attached claims and their equivalents.


Claims

1. A headset arrangement for virtual reality, augmented reality or mixed reality applications that is configured to induce natural directional pinna cues, the arrangement comprising a support structure (120) configured to be arranged on a user's head and to hold a display (140) in front of the user's eyes, the support structure (120) comprising for each ear:

at least a first sound source (21) and a second sound source (22), wherein, when the support structure (120) is arranged on a user's head, the first sound source (21) and the second sound source (22) are arranged such that at the concha of the user a primary sound incidence direction of sound emitted by the first sound source (21) is essentially opposing to a primary sound incidence direction of sound emitted by the second sound source (22),

wherein the primary sound incidence direction is the direction from which the sound emitted by a sound source reaches the concha for the first time.


 
2. The arrangement of claim 1, wherein, when the support structure (120) is arranged on a user's head, an angle ψ between the primary sound incidence direction of the first sound source (21) and the primary sound incidence direction of the second sound source (22) is between about 90° and 180°, between about 120° and 180°, between about 135° and 180° or between about 150° and 180°.
 
3. The arrangement of claim 1 or 2, wherein, when the support structure (120) is arranged on a user's head, the first sound source (21) is arranged in front of the user's pinna and the second sound source (22) is arranged behind the user's pinna, and wherein the first sound source (21) and the second sound source (22) each comprise at least one of:

one or more loudspeakers, one or more sound canal outlets, one or more sound tube outlets, one or more wave guide outlets, and one or more reflectors.


 
4. The arrangement of claim 3, wherein, when the support structure (120) is arranged on a user's head,
an angle Φ between the primary sound incidence direction of the first sound source (21) and the horizontal plane is between 0° and 50°,
the horizontal plane runs horizontally through the geometric center of the concha of the user, and
the angle Φ opens towards a frontal direction.
 
5. The arrangement of claim 3 or 4, further comprising a third sound source (23), wherein, when the support structure (120) is arranged on a user's head,
the third sound source (23) is arranged in front of the user's pinna,
an angle λ between the primary sound incidence direction of the third sound source (23) and the horizontal plane is between 10° and 50°,
the primary sound incidence direction of the third sound source (23) and the horizontal plane intersect at the geometric center of the user's concha, and
the primary sound incidence direction of the third sound source (21) is directed towards the horizontal plane from above the horizontal plane.
 
6. The arrangement of claim 5, further comprising a fourth sound source (24), wherein, when the support structure (120) is arranged on a user's head,
the fourth sound source (24) is arranged behind the user's pinna,
an angle ε between the primary sound incidence direction of the fourth sound source (24) and the horizontal plane is between 10° and 50°,
the primary sound incidence direction of the fourth sound source (24) and the horizontal plane intersect at the geometric center of the user's concha,
the primary sound incidence direction of the fourth sound source (24) is directed towards the horizontal plane from above the horizontal plane,
an angle β between the primary sound incidence direction of the second sound source (22) and the horizontal plane is between 10° and 50°,
the primary sound incidence direction of the second sound source (22) and the horizontal plane intersect at the geometric center of the user's concha,
the primary sound incidence direction of the second sound source (22) is directed towards the horizontal plane from below the horizontal plane.
 
7. The arrangement of claim 6, further comprising a fifth sound source (25) and a sixth sound source (26), wherein, when the support structure (120) is arranged on a user's head,
the first sound source (21), the third sound source (23) and the fifth sound source (25) are arranged in front of the user's pinna,
an angle between the primary sound incidence directions of two neighboring sound sources arranged in front of the user's pinna is between 10° and 50°,
the second sound source (22), the fourth sound source (24) and the sixth sound source (26) are arranged behind the user's pinna, and
an angle between the primary sound incidence directions of two neighboring sound sources arranged behind the user's pinna is between 10° and 50°.
 
8. The arrangement of any of claims 1 to 7,
wherein the sound sources (21, 22, 23, 24, 25, 26) are arranged distant to a first plane such that their primary sound incidence directions towards the geometric center of the user's concha are at an angle α with respect to the first plane,
wherein the first plane runs through the user's ear and is essentially parallel to a median plane, wherein the median plane crosses the user's head midway between the user's ears, thereby dividing the head into an essentially mirror-symmetrical left half side and right half side, and
wherein the angle α is between 0° and 45° for all sound sources (21, 22, 23, 24, 25, 26).
 
9. The arrangement of any of the preceding claims, wherein at least one of:

at least two sound sources are configured to direct essentially the same sound signal towards the geometric center of the user's concha for frequencies of between about 4kHz and about 15kHz; and

at least two sound sources are controlled by the same signal or an identical signal.


 
10. The arrangement of any of the preceding claims, wherein the sound sources (21, 22, 23, 24, 25, 26) comprise at least one of at least one loudspeaker, at least one sound canal outlet, at least one sound tube outlet, at least one wave guide outlet and at least one reflector.
 
11. The arrangement of any of the preceding claims, wherein at least one of the sound sources (21, 22, 23, 24, 25, 26) comprises a loudspeaker that is arranged at a first end or at an intermediate section of a sound canal, sound tube or wave guide, and wherein a sound outlet at a second end of the sound canal, sound tube or wave guide is configured to emit sound into the open volume about the ear of the user (2).
 
12. The arrangement of any of the preceding claims, wherein the support structure (120) comprises first surface sections that, when the support structure (120) is arranged on a user's head, are oriented essentially towards the user's pinna and second surface sections that are oriented essentially away from the pinna, and wherein at least parts of the first surface sections oriented essentially towards the pinna comprise a sound absorbing material, the sound absorbing material being configured to reduce the intensity of sound that is reflected towards the pinna by the first surface sections.
 
13. The arrangement of any of the preceding claims, wherein the support structure (120) comprises surface sections that are oriented essentially towards the user's pinna, wherein the support structure (120) comprises a plurality of sections, and wherein at least one section is arranged behind the pinna such that surface sections of that section which are oriented essentially towards the user's pinna are shaded from direct sound emitted by a sound source arranged in front of the user's pinna.
 
14. The arrangement of any of the preceding claims, wherein the support structure (120) comprises surface sections that are oriented essentially towards a pinna of the user and that have a direct line of sight towards the pinna or the concha of the user, and surface sections that are oriented essentially away from the pinna of the user, and wherein more than 30%, more than 50% or more than 70% of the surface sections with a direct line of sight towards the pinna or the concha of the user are angled at an angle < 90°, < 70° or < 50° towards the median plane such that their vertical points away from the pinna or concha of the user if these surface sections fall within a radius of about 10 cm around the concha of the user.
 
15. The arrangement of any of the preceding claims, wherein
at least one of the sound sources (21, 22, 23, 24, 25, 26) is a loudspeaker, the loudspeaker being arranged such that at least one of:
its main direction of sound radiation is essentially parallel to or is directed away from the median plane, and
a first side of a membrane of the loudspeaker is facing a direction that is essentially parallel to the median plane or facing away from the median plane.
 




Drawing

























Search report









Search report