Graphical user interface for audio driver

Abstract

 The invention provides a device, e.g. a handheld device such as a smartphone, with an audio output (A_O) to output an audio signal to an audio reproduction device (ARD), e.g. a headphone or a portable loudspeaker system or the like. A detector (D) detects connection of the audio reproduction device (ARD) to the audio output (A_0). A user interface (UI), e.g. a graphical user interface (G), requests a user to enter one (DT) of a plurality of preselected audio reproduction device types (AT), connection of an audio reproduction device (ARD) is detected. The corresponding one of prestored audio processing settings (PP1, PP2, PP3, PP4) is then select for processing of an audio signal (AS) to be output. In this way, the user can easily indicate the type of audio reproduction device (ARD) connected, and the relevant audio processing can be set up for optimal sound quality performance with the specific type of reproduction device (ARD).

Description

FIELD OF THE INVENTION

[0001] The present invention relates to the field of audio, audio signal processing, and audio applications. More specifically, the invention provides a method and a device which allows a user to easily set up an audio processing to fit the audio properties for optimal sound quality with a specific audio output device.

BACKGROUND OF THE INVENTION

[0002] Many multi-purpose devices, e.g. smartphones and the like, have the properties to form a centre for various types of audio playback. This means that the device is used with different types of audio reproduction devices which have very different electro-acoustical properties. Examples of different audio reproduction devices to be used e.g. with a smartphone are: in-ear earphones, small portable loudspeakers, mid-sized hi-fi docking station, hi-fi system with floor standing loudspeakers. Audio playback from e.g. a smartphone to these devices with optimum sound quality requires significantly different audio outputs from the smartphone.

[0003] In-ear earphones may be used outdoors and thus also in noisy environment, why a limited dynamic range is preferred, and further a spectral equalizing to compensate for a non-linear frequency response can be required. Small portable loudspeakers may profit from a bass enhancement combined with a sharp cut off below a lower limit frequency, and possibly the user may prefer to switch on a spatial enhancement or virtual surround feature with such small closely spaced stereo loudspeakers. On the other hand, streaming to a high-end hi-fi system, normally it is desired to have a full dynamic range and also a full frequency range without equalizing.

SUMMARY OF THE INVENTION

[0004] Thus, according to the above description, it is an object of the present invention to provide a device, e.g. a handheld streaming device, which allows the user to switch between different audio reproduction devices in an easy manner, and still be able to profit from optimum sound quality with all types of reproduction devices taking into account various on-board audio processing capabilities in the streaming device.

[0005] In a first aspect, the invention provides a device comprising

• an audio output arranged to output an audio output signal to an associated audio reproduction device when connected to the audio output,
• a detector arranged to detect connection of the associated audio reproduction device to the audio output,
• a user interface, such as a graphical user interface, arranged to request an input from a user upon the detector detecting connection of an audio reproduction device to the audio output, wherein the user interface requests the user to enter one of a plurality of preselected audio reproduction device types, and
• an audio processing unit arranged to select one of a plurality of prestored audio processing settings for processing of an audio signal to be output by the audio output, wherein the one prestored audio processing setting is selected in accordance with the audio reproduction device type entered by the user.

[0006] Such a device, e.g. in the form of a handheld device such as a smartphone, is advantageous, since it allows the user to connect acoustically different types of audio output devices to the device for music or speech reproduction. Such output device can be various types of headphones, small portable loudspeakers or large hi-fi loudspeaker, and the device according to the invention is capable of adapting its audio processing such that an optimal sound quality can be obtained for the selected device in an easy manner with a minimum of user involvement.

[0007] For example, the prestored settings can include a set of default settings from the manufacturer of the device which may include standard predefined parameters, e.g. a standard equalizing function, which is found to provide a good result with a typical type of reproduction device, e.g. in-ear earphones. However, the invention also allows a more specific approach, where a product specific prestored audio processing setting can be selected, thus allowing e.g. a more optimal equalizing for a specific in-ear earphone, or the like.

[0008] The user interface may comprise a graphical interface programmend such that the user is presented by a selection of icons on the display of the device, where each icon represents an audio reproduction device type using a symbol and/or text. In case of a device with a touch screen, the user can ensure, by a single touch on the icon corresponding to the connected reproduction device, that an audio processing is selected to match the reproduction device for optimal sound quality.

[0009] By means of the detector, it is ensured that the user request can be automatically triggered, thus the user is automatically requested to select the relevant option when connecting an audio reproduction device. This serve to ensure that optimum sound quality can be provided with a minimum of user involvement, and further it is ensured that the right volume is set up, thus preventing a too high level being applied which may be annoying or even dangerous for the user's hearing.

[0010] In case a user always uses the same reproduction device, the user interface may be programmed to allow the user to skip the selection request popping up every time the reproduction device is connected, and the user interface may further be user-programmable so as to allow the user to limit the possible selection types to the two or three most frequently used reproduction devices. Especially, the device may be programmed to allow a ranking of the reproduction device types to be displayed to the user, such as displaying the types in order of how frequently the user selects them, e.g. with the most frequently selected type presented on top of other types, or the most frequently selected type(s) may be presented with a larger icon than less frequently selected types etc., so as to facilitate the choice of the user.

[0011] In addition, the user may prestore one or more preferred audio parameters together with a general audio setting for the actucal reproduction device, so as to adapt the resulting sound to the user's prefererences.

[0012] E.g. it is normally desired to cut off low frequency output for small portable loudspeakers in order not to overload such small loudspeakers, and special spectral equalizings can be stored to match various types of earphones so as to ensure a resulting acceptable frequency response. In this way, it is possible to obtain a good sound quality with a given type of reproduction device, even though the reproduction device is not known in details. However, it is to be understood that the invention can also be used to match more product specific electro-acoustical properties based on measurements and corresponding prestored audio processing parameters for a specific product. This can be obtained e.g. by downloading audio processing parameters for one or more specific products, e.g. via the internet or another wireless network, if the user wants to apply a product specific processing. Especially, an audio reproduction device may be sold with a QR code on its package which the user can scan in order to link to an internet address with the specific audio processing settings for the audio reproduction device inside the package, e.g. when purchasing a new reproduction device, such as an in-ear headphone or the like. Either, by scanning the QR code, the corresponding specific audio processing settings are automatically downloaded in the device, e.g. mobile phone, and/or also automatically applied, or the user is asked to initiate downloading/applying the settings. This allows the user to get easy access to the desired audio processing settings for the specific reproduction device, and thus provides an easy way of obtaining an optimal sound quality by merely scanning a QR code.

[0013] In case the audio output of the device is in the form of an analog audio output socket, e.g. a stereo mini-jack socket, the device can by no means automatically detect the type of reproduction device connected, since this is merely a cable with a socket. The same applies to wireless connections, e.g. Bluetooth, where the connected device type may not be automatically identified by the device. In such cases, the user interface may be adapted to request the user input about the connected type of reproduction device after or at the same time as informing the user that a connection has been established, but before audio streaming to the connected reproduction device is initiated.

[0014] Preferably, the user interface comprises a graphical user interface using a display of the device. It is to be understood that alternatively or additionally, an audio interface with speech input/output may be used to request the input from the user. Especially, the plurality of preselected audio reproduction device types may be graphically presented to the user as respective different icons, e.g. icons with symbols allowing identification of each type without text, or text may be used instead or in addition. As mentioned, the user may be allowed to alter the user interface to the actual need, e.g. limiting the options to select from in order to limit the options to the types of reproduction devices the user normally chooses from.

[0015] The plurality of preselected audio reproduction device types may comprise a plurality of the types: over-ear headphone, earphone, in-ear earphone, one-ear headphone, portable audio device, hi-fi device, and TV set. However, as indicated, the user interface may be programmed to have a main menu where the user can select a type of reproduction device, e.g. 3-10 types, and after this selection, if the user desires so, one or more sub menus may be used to allow a more detailed or even product specific input which is used to select a more specific prestored audio processing setting which can provide an even higher sound quality. E.g. such more product specific processing can include spectral filters with compensation of rather narrow peaks and dips in specific earphones, and further this allows matching of volume setting by taking into account product specitic electro-acoustic sensitivities.

[0016] The user interface may be arranged to request the user to enter one from a list of a plurality of specific audio reproduction devices belonging to the entered audio reproduction device type, and to select a specific audio processing setting or to modify the selected prestored audio processing setting in accordance with the entered specific audio reproduction device. This allows a better individual matching of specific audio processing parameters to fit to the electro-acoustical design of a specific product.

[0017] The device may be programmed to update the list of specific audio reproduction devices, such as by automatically downloading data for new specific audio reproduction device via the internet. Hereby, the device can be kept up to date with new audio reproduction products which may have specific individual audio processing parameters assigned thereto for optimal acoustic performance.

[0018] The prestored audio processing settings may be designed to match acoustical properties of the respective audio reproduction device types. As already mentioned, this may be in the form of rather general matching filters or other processing parameters which provides good performance with a generic type of audio reproduction device. It may also be specific filtering parameters to fit a specific product. Still further, the settings may include user designed properties or user selected properties according to preferences - e.g. it can be part of a prestored setting that surround sound should be "on" when the audio reproduction type "in-ear earphones" is selected.

[0019] The prestored audio processing settings may comprise parameters affecting audio processing with respect to at least one of: spectral filtering, dynamic limiting, dynamic enhancement, spatial enhancement, and volume adjustment. However, it is to be understood that a variety of other known audio processing parameters can be prestored as part of the prestored audio processing settings.

[0020] The prestored audio processing settings may be stored as parameter values in one or more XML type files. However, the settings may alternatively or additionally be stored in RAM og ROM memory or on a memory card or memory stick or the like.

[0021] The audio output may comprise an audio output connector, such as a mini-Jack output connector or a digital audio connector output, with a switching function to allow the detector to detect connection of an associated audio reproduction device to thte audio output connector. In this way, the detector can be implemented by a simple electric circuit detecting if an audio output connector is connected or not, and if it is detected, the user interface is triggered to request an input from the user, e.g. in the form of a pop-up menu or the like.

[0022] The audio output may comprises a wireless audio output, such as a Bluethooth connection, wherein the detector is functionally connected to the wireless audio output, so as to allow detection of an associated audio reproduction device being connected to the wireless audio output. E.g. a pop-up menu requesting the user intput can be combined with the normal menu of the device informing the user that a wireless audio reproduction device has been detected and connected via the wireless connection, e.g. a Bluetooth device.

[0023] The user interface may allow the user to enter one or more preferred audio processing parameters, such as related to a preferred timbre e.g. "bass +6 dB" or related to spatial enhancement "on" or "off", for a specific type of reproduction device, and to apply an audio processing according to the entered preferred audio processing parameters. Hereby, the user can design the sound according to preferences for the normally used audio reproduction types, and access the corresponding audio processing easily. The device may especially be programmed to allow the user to copy an existing prestored audio processing setting for a reproduction device type, thus allowing the user to easily create a number of personalized audio processing settings for one device types, thus copying personalized settings for bass, treble, surround sound settings etc. Otherwise, the user may add a copy of one setting for a type of reproduction device, where the user can change settings for bass, treble, surround settings etc., and e.g. name the settings according to different situations, such as "In-ear earphone - running" and "In-ear earphone - relaxing", since the user may prefer different user settings in these situations of using the in-ear headphone. For a smart phone with a built-in camera, the QR code scanning can thus be used to easily update the audio settings of the smart phone for use with a new specific reproduction device, such as small loudspeakers, or different types of earphones or headphones etc.

[0024] The device may be a handheld device, such as one of: a mobile phone, a tablet, and a laptop computer. Especially, the invention is relevant to implement in a smartphone. However, the device may also be an audio module or info-tainment module in a car, which may also be used to output audio for various types of audio reproduction devices such as headphones or earphones.

[0025] In a second aspect, the invention provides a method for adating audio properties of a device, the method comprising

• detecting connection of an associated audio reproduction device to an audio output of the device,
• requesting a user to enter one of a plurality of preselected audio reproduction device types, such as a by displaying a graphical representation of different audio reproduction device types, upon detecting connection of an associated audio reproduction device, and
• selecting one of a plurality of prestored audio processing settings in accordance with the audio reproduction device type entered by the user, and processing in the device an audio signal to be output by the audio output with the selected prestored audio processing setting.

[0026] In a third aspect, the invention provides a computer executable program code arranged to perform the method according to the second aspect, such as a computer executable program code stored on a data carrier. The program code may be implemented on any type of audio processing platform, e.g. a sound card in a computer, a general processor in a mobile device e.g.

[0027] It is appreciated that the same advantages and embodiments described for the first aspect apply as well for the second and third aspects. Further, it is appreciated that the described embodiments can be intermixed in any way between all the mentioned aspects.

BRIEF DESCRIPTION OF THE FIGURES

[0028] The invention will now be described in more detail with regard to the accompanying figures of which

Fig. 1 illustrates a diagram of an embodiment,

Fig. 2 illustrates a layout of an example of a first level pop-up menu for user selection of various audio reproduction device types, and

Fig. 3 illustrates a layout of an example of a second level optional pop-up menu where the user can select preferred audio parameters.

[0029] The figures illustrate specific ways of implementing the present invention and are not to be construed as being limiting to other possible embodiments falling within the scope of the attached claim set.

DETAILED DESCRIPTION OF EMBODIMENTS

[0030] Fig. 1 illustrates a block diagram showing basic elements of a device embodiment with an audio output A_O arranged to output an audio signal - in analog or digital format, using a wired or a wireless connection, to an associated audio reproduction device ARD, e.g. a headphone, a portable loudspeaker or the like. A detector D is functionally connected to the audio output A_O and triggers the user interface UI when it detects that the audio reproduction device ARD is connected to the audio output A_O of the device. When the detector D detects connection of the audio reproduction device ARD, the user interface requests the user to input the which type of reproduction device has been connected by generating a graphical output G, e.g. in the form of a pop-up menu on the display screen of the device, a pop-up menu listing the possible type options which the user can select between. Optionally, the user may select a sub menu to be able to enter a specific product.

[0031] The user then enters the relevant audio reproduction device type DT, e.g. by pressing the corresponding symbol or icon on a touch screen, or pressing a button etc. Optionally, the user can enter a sub menu to enter preferred audio parameters PP, such as "high bass level", "spatial enhancement on", and "dynamic compression off". In response to the entered audio reproduction device type DT, the device is programmed to select the corresponding one of a set of prestored audio parameter settings P1, P2, P3, P4 corresponding to settings defining one or more audio processing parameter values to be applied to an audio signal AS to be processed by an audio processor AP of the device, before being applied to the audio output A_O.

[0032] In case the user has entered preferred parameters PP, the audio processor AP applies a further processing PPR according to these preferred parameters. The device may be programmed such that the user can store such preferred parameters PP in the device together with the type of audio reproduction device, such that these parameters PP are automatically applied, the next time the user selects that type of audio reproduction device type DT.

[0033] The device may be a handheld device, such as a smartphone, but the invention may be implemented also in other type of devices, e.g. a TV or an info-tainment system of a car, where different types of audio reproduction devices can be used for reproducing audio based on an audio signal received from the audio output of the device.

[0034] The audio processor AP may be a dedicated audio processor, or the audio processing tasks may be performed by the main processor of the device. The prestored audio processing settings P1, P2, P3, P4 may be in the form of simple values to be applied in a specific library of audio processing algorithms implementd in the device. E.g. such algorithms may include effects such as surround sound in the form of stereo enhancement, 3D audio effects using binaural technology, and various enhancements such as bass enhancement, dynamic enhancement etc. The values may be stored in the device, e.g. in an XML type file format. Alternatively or additionally, the settings may be downloaded by the device from an internet connection.

[0035] Fig. 2 shows an example of a menu suitable for a popping-up e.g. on a smartphone, when the smartphone detects that an audio reproduction device has connected thereto, e.g. via a mini-jack output socket. As seen, 7 icons are listed each representing an audio reproduction device type which is illustrated with a graphical symbol and a corresponding text. Hereby, the user is allowed to select the one that best fits the audio reproduction device type which has actually been connected. As seen in the top part of the pop-up menu, the user can also select to always used the selected device, a feature which is relevant to select, if the user always connects the same specific reproduction device type. The user may also be allowed to specify, in a set-up menu, which icons to appear on the pop-up menu, thus avoiding a large list of device to select from, if in practice the user has only two or three types of audio reproduction devices.

[0036] In case the device has a touch screen, the user may enter the selected device type by pressing the icon, otherwise the user may need to one or more buttons or other means for manoeuvring a cursor etc. The device may alternatively or additionally accept the user to enter the device type by means of a speech input.

[0037] Fig. 3 shows a possible layout of a sub-menu to be used as a sub-menu for the , in case "Earphones" has been selected on the first menu shown in Fig. 2. Thus, this sub-menu can be made device type dependent, and in the illustrated case, the user can select between different levels of bass, treble, and to enable a surround sound effect as well as an equalizing. The icon with the v-shaped symbol in the lower right corner may be used by the user to trigger a pop-up where it is possible to select between different equalizing options.

[0038] It is appreciated that the invention in general can be used to provide the user with a higher sound quality even in the simplest cases where the user merely selects a device type from a list of e.g. 3-7 options. In such simple cases, a generic spectral shaping with shallow filters can be implemented to match the overall of products within the device type. In more complex implementations, more specific products can be selected by the user, thereby allowing a higher degree of matching the audio processing parameters specifically to the electro-acoustical properties of the product. In some implementations, it may be preferred that the device automatically updates settings provided by the manufacturer of audio reproduction devices with new products, such that the device is prepared with prestored audio processing settings already when the use purchases the new products, e.g. a new headphone, and connects it for the first time. In this way, manufacturers of audio reproduction devices can also claim to obtain better sound quality in practical use, if they provide such prestored audio processing parameters for their products, matching the electro-acoustical properties of the products, e.g. based on measured data.

To sum up: the invention provides

[0039] Although the present invention has been described in connection with the specified embodiments, it should not be construed as being in any way limited to the presented examples. The scope of the present invention is to be interpreted in the light of the accompanying claim set. In the context of the claims, the terms "including" or "includes" do not exclude other possible elements or steps. Also, the mentioning of references such as "a" or "an" etc. should not be construed as excluding a plurality. The use of reference signs in the claims with respect to elements indicated in the figures shall also not be construed as limiting the scope of the invention. Furthermore, individual features mentioned in different claims, may possibly be advantageously combined, and the mentioning of these features in different claims does not exclude that a combination of features is not possible and advantageous.

Claims

1. A device comprising

- an audio output (A_O) arranged to output an audio output signal to an associated audio reproduction device (ARD) when connected to the audio output (A_O),

- a detector (D) arranged to detect connection of the associated audio reproduction device (ARD) to the audio output (A_O),

- a user interface (UI), such as a graphical user interface (G), arranged to request an input (DT, PP) from a user upon the detector (D) detecting connection of an audio reproduction device (ARD) to the audio output (A_O), wherein the user interface (UI) requests the user to enter one (DT) of a plurality of preselected audio reproduction device types (AT), and

- an audio processing unit (AP) arranged to select one of a plurality of prestored audio processing settings (PP1, PP2, PP3, PP4) for processing of an audio signal (AS) to be output by the audio output (A_O), wherein the one prestored audio processing setting (PP1, PP2, PP3, PP4) is selected in accordance with the audio reproduction device type (DT) entered by the user.

2. Device according to claim 1, wherein the user interface (UI) comprises a graphical user interface (G) using a display of the device.

3. Device according to claim 2, wherein the plurality of preselected audio reproduction device types (AT) are graphically presented to the user as respective different icons.

4. Device according to any of the preceding claims, wherein the plurality of preselected audio reproduction device types (AT) comprises a plurality of the types: over-ear headphone, earphone, in-ear earphone, one-ear headphone, portable audio device, hi-fi device, and TV set.

5. Device according to any of the preceding claims, wherein the user interface (UI) is arranged to request the user to enter one from a list of a plurality of specific audio reproduction devices belonging to the entered audio reproduction device type (DT), and to select a specific audio processing setting or to modify the selected prestored audio processing setting in accordance with the entered specific audio reproduction device.

6. Device according to any of the preceding claims, wherein the device is programmed to update the list of specific audio reproduction devices, such as by automatically downloading data for new specific audio reproduction devices via the internet, such as by downloading data for new specific audio reproduction devices by scanning of a QR code linking to audio processing settings for the specific audio reproduction device.

7. Device according to any of the preceding claims, wherein the prestored audio processing settings (PP1, PP2, PP3, PP4) are designed to match acoustical properties of the respective audio reproduction device types (AT).

8. Device according to any of the preceding claims, wherein the prestored audio processing settings (PP1, PP2, PP3, PP4) comprises parameters affecting audio processing with respect to at least one of: spectral filtering, dynamic limiting, dynamic enhancement, spatial enhancement, and volume adjustment.

9. Device according to any of the preceding claims, wherein the prestored audio processing settings (PP1, PP2, PP3, PP4) are stored as parameter values in one or more XML type files.

10. Device according to any of the preceding claims, wherein the audio output (A_O) comprises an audio output connector, such as a mini-Jack output connector, with a switching function to allow the detector (D) to detect connection of an associated audio reproduction device to thte audio output connector.

11. Device according to any of the preceding claims, wherein the audio output (A_O) comprises a wireless audio output, such as a Bluethooth connection, wherein the detector (D) is functionally connected to the wireless audio output, so as to allow detection of an associated audio reproduction device being connected to the wireless audio output.

12. Device according to any of the preceding claims, wherein the user interface (UI) allows the user to enter one or more preferred audio processing parameters (PP), such as related to a preferred timbre, and to apply an audio processing (PPR) according to the entered preferred audio processing parameters (PP).

13. Device according to any of the preceding claims, wherein the device is a handheld device, such as one of: a mobile phone, a tablet, and a laptop computer.

14. Method for adating audio properties of a device, the method comprising

- detecting connection of an associated audio reproduction device to an audio output of the device,

- requesting a user to enter one of a plurality of preselected audio reproduction device types, such as a by displaying a graphical representation of different audio reproduction device types, upon detecting connection of an associated audio reproduction device, and

- selecting one of a plurality of prestored audio processing settings in accordance with the audio reproduction device type entered by the user, and

- processing in the device an audio signal to be output by the audio output with the selected prestored audio processing setting.

15. Processor executable program code arranged to perform the method according to claim 14, such as a digital processor executable program code stored on a data carrier.

Drawing