(19)
(11)EP 2 705 444 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
29.07.2020 Bulletin 2020/31

(21)Application number: 12780055.5

(22)Date of filing:  04.05.2012
(51)International Patent Classification (IPC): 
G06F 40/58(2020.01)
(86)International application number:
PCT/US2012/036500
(87)International publication number:
WO 2012/151479 (08.11.2012 Gazette  2012/45)

(54)

CROSS-LANGUAGE COMMUNICATION BETWEEN PROXIMATE MOBILE DEVICES

SPRACHÜBERGREIFENDE KOMMUNIKATION ZWISCHEN BENACHBARTEN MOBILVORRICHTUNGEN

COMMUNICATION INTERLINGUALE ENTRE DISPOSITIFS MOBILES PROCHES


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 05.05.2011 US 201161482958 P

(43)Date of publication of application:
12.03.2014 Bulletin 2014/11

(73)Proprietor: YAPPN CANADA INC.
Toronto, Ontario M2J 4Z8 (CA)

(72)Inventor:
  • ZIVKOVIC, Aleksandar
    North York, ON M2R 1J8 (CA)

(74)Representative: Garcia González, Sergio 
Bird & Bird International LLP Paseo de la Castellana 7, 7° Planta
28046 Madrid
28046 Madrid (ES)


(56)References cited: : 
US-A1- 2001 029 455
US-A1- 2005 261 890
US-A1- 2007 255 554
US-A1- 2007 287 484
US-A1- 2005 177 614
US-A1- 2005 261 890
US-A1- 2007 255 554
US-A1- 2009 125 295
  
  • Anonymous: "Bump Technologies, Inc.", , 10 February 2010 (2010-02-10), XP055277950, Retrieved from the Internet: URL:http://web.archive.org/web/20100210190 127/http://bu.mp/faq.html [retrieved on 2016-06-06]
  • Anonymous: "Bump, Throw, and Catch Files Between Mobile Devices | PCWorld", , 30 April 2011 (2011-04-30), XP055277953, Retrieved from the Internet: URL:http://www.pcworld.com/article/226776/ bump_hoccer_gesture_transfers.html [retrieved on 2016-06-06]
  
Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


Description

CROSS REFERENCE TO RELATED APPLICATIONS



[0001] This application claims the benefit of U.S. Provisional Patent Application No. 61/482,958, filed May 5, 2011, titled "System for enabling cross-language communication between mobile devices that are in proximity to each other,"

TECHNICAL FIELD



[0002] The present invention relates to natural language translation devices and method and, more particularly, to such devices and methods that facilitate cross-language communication among users of respective wireless communication devices.

BACKGROUND ART



[0003] Users of wireless mobile communication devices often find themselves in situations where they would like to communicate with other people in their immediate vicinity, but they are prevented from doing so by a language barrier. That is, the users do not speak or understand a language spoken by the people near them. This situation is common when people travel outside their native countries or sometimes even within their own countries.

[0004] Systems that translate text into other languages are known. For example, Google SMS (short message service) translation and currency conversion service translates text sent to a particular SMS address and returns translated text to the sender.

[0005] Some application programs designed for execution by smart phones also provide translation services. For example, the SMS Speaker Translating application for Android mobile telephones translates incoming SMS messages and, using a synthetic voice, speaks the translated messages. Lingtastic announced a service named mobile.lingtastic.com, which translates and delivers SMS messages to other users' devices. Kwintessential's SMS Translation Service also allows users to send SMS messages to other user and have the messages translated before display on the recipients' devices.

[0006] Google has demonstrated a conversation mode of Google Translate for Android mobile telephones. This product includes speech recognition, translation and speech synthesis. Inputs and outputs are handled by a single mobile device. However, spoken conversations suffer from privacy issues in public places and are difficult to conduct in noisy environments.

[0007] While some of these and other prior art systems translate text messages, the user of such a system must show translated text displayed (in the case of Google SMS translation service) on the user's device to a person with whom the user wishes to communicate or, if the other person has a mobile device, the user must know the other person's mobile device address or telephone number to take advantage of an SMS message translation and forwarding service, such as mobile.lingtastic.com. or US2001/0029455. Most people are, however, reluctant to disclose their mobile devices' addresses or telephone numbers to complete strangers. Thus, prior art systems for translating text have limited utility. The following web pages: "http://web.archive.org/web/20100210190127/bu.mp/faq.html", "https://www.pcworld.com/article/226776/bump_hoccer_gesture_transfers.html", and "https://www.youtube.com/watch?v=niJguU7r-bs" are relative to a file sharing application called Bump™ which uses the phone's GPS location to detect the proximity of the two phones running the app, and the accelerometer to detect the bumping or throwing/catching motions.

SUMMARY OF EMBODIMENTS



[0008] An embodiment of the present invention provides a computer-implemented method for facilitating cross-language communication among users of respective wireless communication devices. The method includes receiving a first user input at a first of the wireless communication devices. The first user input indicates willingness to participate in a cross-language communication session with a second of the wireless communication devices. The method also includes receiving a second user input at the second wireless communication device. The second user input indicates willingness to participate in the cross-language communication session with the first wireless communication device. The method also includes receiving, at the first wireless communication device, a first signal from a first sensor of the first wireless communication device and receiving, at the second wireless communication device, a second signal from a second sensor of the second wireless communication device. The method also includes automatically comparing the first signal to the second signal to determine whether the first and the second signal satisfy a similarity criterion. The criterion includes similarity of sounds received by the respective first and second wireless communication devices. Optionally or alternatively the criterion includes similarity of images captured by the respective first and second wireless communication devices. If the first and second signals satisfy the similarity criterion, the method includes automatically establishing the cross-language communication session. If the cross-language communication session is established, after receiving the first and second user inputs, the method includes receiving a first user message entered on the first wireless communication device in a first natural language. A translated first user message is automatically generated, including translating the first user message into a second natural language, different than the first natural language. The translated first user message is output on the second wireless communication device.

[0009] As part of the cross-language communication session, after outputting the translated first user message on the second wireless communication device, a second user message maybe entered on the second wireless communication device and the second user message may be received. A translated second user message may be automatically generated, including translating the second user message into the first natural language. The translated second user message may be output on the first wireless communication device.

[0010] During the cross-language communication session, subsequent first user messages may be entered on the first wireless communication device, and the subsequent first user messages may be received. For each subsequent first user message, a corresponding translated first user message may be automatically generated, including translating the subsequent first user message into the second natural language. The corresponding translated first user message may be output on the second wireless communication device. In addition, subsequent second user messages may be entered on the second wireless communication device, and the subsequent second user messages may be received. For each subsequent second user message, a corresponding translated second user message may be automatically generated, including translating the subsequent second user message into the first natural language. The corresponding translated second user message may be output on the first wireless communication device.

[0011] Automatically generating the translated first user message may include translating the first user message into the second natural language within the first wireless communication device or within the second wireless communication device or within a server, distinct from the first and second wireless communication devices. Automatically generating the translated first user message may include sending a request to the server to translate the first user message receiving, from the server, a translation of the first user message into the second natural language.

[0012] Receiving the first user input may include receiving text characters entered upon a keyboard of the first wireless communication device. Optionally or alternatively, receiving the first user input may include receiving an audio signal corresponding to an utterance and automatically recognizing the utterance.

[0013] Optionally, before receiving the first and second user inputs indicating willingness to participate in the cross-language communication session, the method may include receiving, by the first or second wireless communication device, a user input identifying the first natural language. Responsive to receiving the user input identifying the first natural language, the method may include storing an indication of the first natural language. The indication may be stored by the first and/or second wireless communication device.

[0014] Optionally, the first user message or the translated first user message may be wirelessly communicated from the first wireless communication device directly to the second wireless communication device. Here, "directly" means a wireless signal travels from the first wireless communication device directly to the second wireless communication device, not via an intermediate device, i.e., not via a server, cellular tower, repeater, wireless switch or router, etc.

[0015] Optionally, the first user message or the translated first user message may be wirelessly communicated from the first wireless communication device to the second wireless communication device via a wireless communication network, such as a cellular telephone network, short message service (SMS) network, wireless computer network, etc. In this case, the translated first user message is generated within the first or second wireless communication device.

[0016] Optionally, the method may include automatically coordinating establishment of the cross-language communication session by a server, distinct from, and wirelessly communicatively coupled to, the first and second wireless communication devices. In this case, information about the first and second user inputs indicating willingness to participate in the cross-language communication session may be received at the server, and the first wireless communication device may be automatically associated with the second wireless communication device.

[0017] Associating the first with the second wireless communication device may include automatically selecting the first and second wireless communication devices from among a plurality of wireless communication devices. The selection may be based on a criterion that involves the first and second wireless communication devices. For example, the criterion may include physical proximity of the first wireless communication device to the second wireless communication device or distance between the first and second wireless communication devices being less than a threshold value. The threshold value may be automatically calculated, based on a number of wireless communication devices physically proximate the first wireless communication device. Here, "based" means based at least in part, not necessarily based entirely on.

[0018] The criterion may include similarity of at least a portion of respective network addresses of the first and second wireless communication devices.

[0019] The criterion may include proximity in time of receipt of the first and second user inputs indicating willingness to participate in a cross-language communication session, proximity in time of receipt by the server of respective messages from the first and second wireless communication devices or similarity of respective physical properties measured by the respective first and second wireless communication devices. The criterion may include similarity of sounds received by the respective first and second wireless communication devices or similarity of images captured by the respective first and second wireless communication devices.

[0020] Optionally, the method may include receiving a first user input including information about the second wireless communication device. The input may be received at the first wireless communication device. In this case, associating the first with the second wireless communication device may include associating the first with the second wireless communication device, based on the received information about the second wireless communication device.

[0021] Automatically generating the translated first user message may include translating the first user message into the second natural language by the server.

[0022] The first user input indicating willingness to participate in a cross-language communication session may include a button press or data indicating orientation of the first wireless communication device or data indicating acceleration of the first wireless communication device. A "user input" may include accelerometer and clock inputs indicating the first and second wireless devices are bumped together or tilted similarly or in a complementary fashion.

[0023] Optionally, the method may include receiving, at the first wireless communication device, a first user input instruction and, responsive to receipt of the first user input instruction, ending the cross-language communication session. Optionally or alternatively, the method may include automatically ending the cross-language communication session, based on a criterion that involves physical proximity of the first wireless communication device to the second wireless communication device.

[0024] The method may include wirelessly communicating the first user message or the translated first user message from the first wireless communication device, via a wireless communication network, to the second wireless communication device, without translating the first user message into the second natural language en route.

[0025] The method may include wirelessly communicating the first user message or the translated first user message from the first wireless communication device, via a wireless communication network, and generating the translated first user message may occur within the first or second wireless communication device.

[0026] Another aspect of the present invention relates to a system for facilitating cross-language communication among users of respective wireless communication devices. The system may include first and second wireless communication devices. Each wireless communication device includes a respective first user interface configured to receive a respective user input indicating willingness to participate in a cross-language communication session with the other wireless communication device. The indication may, but need not, identify a user of the first wireless communication device. Similarly, the indication may, but need not, identify the second wireless communication device or a user of the second wireless communication device. Each wireless communication device includes a second user interface configured to receive a respective user message, after receipt of the user inputs indicating willingness to participate in the cross-language communication session. Each wireless communication device includes a third user interface configured to output a respective translated user message. The system also includes a first automatic translation module configured to generate the translated user message by translating the user message received by the first wireless communication device from a first natural language to a second natural language. The system also includes a first transmitter module configured to wirelessly send the user message received by the first wireless communication device or the translated user message, from the first wireless communication device to the second wireless communication device.

[0027] Optionally, the system includes a second automatic translation module and a second transmitter module. The second automatic translation module is configured to generate, as part of the cross-language communication session, a second translated user message by translating the user message received by the second wireless communication device to the first natural language. The second transmitter module is configured to wirelessly send, from the second wireless communication device to the first wireless communication device, the user message received by the second wireless communication device or the second translated user message. The first and second transmitter modules may be implemented by separate component. Optionally, the first and second transmitter modules may be implemented by a single component. For example, if a server or wireless communication network is involved, a single component may, but need not, implement both the first and second transmitter modules. Similarly, the first and second translation modules can, but need not, be implemented by a common component, even though different first and second natural languages are used.

[0028] The first and/or second wireless communication device may include the first automatic translation module. The system may include a server, distinct from the first and second wireless communication devices, that includes the first automatic translation module.

[0029] Each second user interface may include a keyboard of the respective wireless communication device. Each second user interface may include a microphone, and the system may include an automatic speech recognizer configured to convert an audio signal from the microphone to corresponding text of the respective user message.

[0030] The first and/or second wireless communication device may include a fourth user interface configured to receive an identification of the first natural language. The wireless communication device may include a memory configured to store an indication of the first natural language.

[0031] The first transmitter module may be configured to send the user message received by the first wireless communication device and/or the translated user message directly to the second wireless communication device or via a wireless communication network. In the latter case, the first and/or second wireless communication device includes the first automatic translation module.

[0032] Yet another aspect of the present invention relates to a system for facilitating cross-language communication among users of respective first and second wireless communication devices. The system includes a server configured to automatically coordinate establishment of a cross-language communication session including the first and second wireless communication devices. The server includes a session initiation receiver and a coordination module. The session initiation receiver is configured to receive information about first and second user inputs, received by the respective first and second wireless communication devices. The first and second user inputs indicate willingness to participate in the cross-language communication session. The coordination module is configured to automatically associate the first wireless communication device with the second wireless communication device.

[0033] The coordination module may be configured to select the first and second wireless communication devices from among a plurality of wireless communication devices to associate the first wireless communication device with the second wireless communication device. The selection may be based on a criterion that involves the first and second wireless communication devices. The criterion may include physical proximity of the first wireless communication device to the second wireless communication device. The criterion may include distance between the first and second wireless communication devices being less than a threshold value. The coordination module may be configured to automatically calculate the threshold value, based on a number of wireless communication devices physically proximate the first wireless communication device. The criterion may include similarity of at least a portion of respective network addresses of the first and second wireless communication devices. The criterion may include proximity in time of receipt of the first and second user inputs indicating willingness to participate in a cross-language communication session. The criterion may include proximity in time of receipt by the server of respective messages from the first and second wireless communication devices. The criterion may include similarity of sounds received by the respective first and second wireless communication devices or similarity of images captured by the respective first and second wireless communication devices or similarity of respective physical properties measured by the respective first and second wireless communication devices.

[0034] The coordination module may be configured to automatically associate the first wireless communication device with the second wireless communication device, based on information about the second wireless communication device. The information about the second wireless communication device may be received at the first wireless communication device.

[0035] The server may include a translation module configured to automatically generate a translated first user message, including translating a first user message from a first natural language into a second natural language.

[0036] The first user input indicating willingness to participate in the cross-language communication session may include a button press or data indicating orientation of the first wireless communication device or data indicating acceleration of the first wireless communication device.

[0037] The server may be configured to automatically end the cross-language communication session, based on a criterion that involves physical proximity of the first wireless communication device to the second wireless communication device.

[0038] An aspect of the present invention relates to a computer program product for facilitating cross-language communication among users of respective wireless communication devices. The computer program product includes a non-transitory computer-readable medium having computer readable program code stored thereon. The computer readable program code is configured to receive, at a first of the wireless communication devices, a first user input indicating willingness to participate in a cross-language communication session with a second of the wireless communication devices. The computer readable program code is also configured to receive, at the second wireless communication device, a second user input indicating willingness to participate in the cross-language communication session with the first wireless communication device. After receiving the first and second user inputs, the computer readable program code is configured to receive a first user message entered on the first wireless communication device in a first natural language and automatically generate a translated first user message, including translating the first user message into a second natural language, different than the first natural language. The computer readable program code is also configured to output the translated first user message on the second wireless communication device.

BRIEF DESCRIPTION OF THE DRAWINGS



[0039] The invention will be more fully understood by referring to the following Detailed Description of Specific Embodiments in conjunction with the Drawings, of which:

Fig. 1 is a schematic block diagram of direct wireless communication between devices, relating to an embodiment of the present invention.

Fig. 2 is a schematic block diagram of indirect wireless communication between devices, relating to an embodiment of the present invention.

Fig. 3 is a schematic block diagram of a wireless cross-language communication session, relating to an embodiment of the present invention.

Fig. 4 is a schematic block diagram relating to an embodiment of the present invention.

Fig. 5 is a schematic block diagram relating to another embodiment of the present invention.

Fig. 6 contains a flowchart illustrating operation of an embodiment of the present invention.


DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS



[0040] In accordance with embodiments of the present invention, computer-implemented methods and apparatus, as well as software-containing computer-readable media, are disclosed for facilitating cross-language communication among users of respective wireless communication devices. These embodiments enable two or more mutually-agreeing users to establish and participate in a cross-language communication session, without revealing private information, such as their telephone numbers. Once the session has been established, each user enters text into her wireless communication device, and a translated version of the entered text is displayed on a screen of the other user's wireless communication device. The text may be entered, such as by typing on a keyboard on the wireless communication device or by speaking inputs into a microphone and automatically recognizing the speech. Optionally, the translated text may be spoken by a speech synthesizer. No permanent information about the participants need be stored in the respective wireless communication devices, so once the communication session ends, no further communication between or among the participants is possible, without establishing another session, thereby preserving each user's privacy.

[0041] As illustrated schematically in Fig. 1, in some embodiments, the wireless communication occurs directly between wireless devices 101 and 103 of the respective users 106 and 109. "Directly" means a wireless communication signal travels from a sending device, such as device 101, to a receiving device, such as device 103, without traveling through an intermediate device, such as a repeater, mobile telephone cell tower, server, etc. (not shown). The wireless communication may be implemented via radio frequency (RF) transceivers, infrared (IR) transceivers, ultrasonic transceivers or any other suitable wireless transceivers. Bluetooth transceivers provide an exemplary direct wireless communication path between the wireless communication devices 101 and 103. Although, in the interest of simplicity of explanation, only two users 106 and 109 and two wireless communication devices 101 and 103 are shown in Fig. 1 and in other drawings, two or more such users and devices may participate in this and other embodiments described herein.

[0042] In some other embodiments, exemplified schematically in Fig. 2, the wireless communication devices 201 and 203 communicate indirectly, i.e., via a wireless communication network 206, such as a cellular telephone network, an SMS network, a wireless computer network or the like, rather than directly. A server 209 may be used to manage the wireless communication network 206. The management server 209 is distinct from each of the wireless communication devices 201 and 203.

[0043] In yet other embodiments, exemplified schematically in Fig. 3, although the wireless communication devices 301 and 203 communicate directly with each other, one or both of the wireless communication devices 301 and/or 303 also wirelessly communicates with a translation server 306 via a wireless network 309. The translation server 306 is distinct from each of the wireless communication devices 301 and 303. In some embodiments, the translation server 306, or a separate server (not shown), is instrumental in establishing a cross-language communication session between the wireless communication devices 301 and 303, as described below.

[0044] Other embodiments (not shown) involve other combinations of direct or indirect wireless communication between the wireless communication devices and presence or absence of a remote translation server and/or a wireless network management server.

[0045] Typically, each of the wireless communication devices 301 and 303 (using Fig. 3 as an example) has an application program 312 or 315 installed therein, and a processor in the wireless communication device 301 or 303 executes instructions of the application program to perform some or all of the functions described herein. Similarly, any server includes a processor executing instructions stored in a memory to perform functions attributed to the server.

[0046] The application program 312 and 315 may be installed in any suitable manner, such as from an external memory device, such as a memory stick, or downloaded from a web site or an "application store," such as a store operated by a wireless communication service provider. The application program 312 or 315 may interact with the user 318 or 321 via a display screen, touch screen, real or virtual keyboard, microphone, speaker and/or other input/output devices of the wireless communication device 301 or 303, as is well known in the art.

[0047] The user 318 or 321 of each wireless device 301 or 303 may configure her respective application program 312 or 315 via a suitable user interface. This configuration may include the user 318 or 321 identifying the user's preferred language, such as French, German, Hebrew or English, i.e., the language in which the user 318 or 321 prefers text from others to be translated into for outputting to the user. The user interface may facilitate identification by the user 318 or 321 of her preferred language by displaying national flags or other suitable icons for available languages and prompting the use 318 or 321to select one of the icons. The application program 312 or 315 stores an indication of the user's preferred language, such as in a memory of the wireless communication device 301 or 303 or in a remote server 306, as discussed in more detail below. The user 318 or 321 may identify the preferred language before or after a cross-language communication session is initiated.

[0048] As noted, an application program 301 or 315 needs to be executed by each of the wireless communication devices that are to participate in a cross-language communication session. If a user 318 wishes to use the system to converse with another user 321, but the other user's wireless communication device 303 does not have the application program 315 installed thereon, the first user 318 may urge the other user 321 to download, install and run the application program 315, such as by gesturing, demonstrating or miming the process of installing and running the application program, etc. For example, the first user 318 might show the application program's initial user interface or a Quick Response Code (QR code) mixed bar code, displayed on her wireless communication device 301, to the other user 321 and point to the other user's wireless communication device 303. The other use 321 may use a camera in her wireless communication device 303 to invoke the QR code, which may be configured to cause the application program to be downloaded to the other user's wireless communication device 303.

[0049] Even if both wireless devices 301 and 303 have the application program 301 and 303 installed, before the system translates any text, a cross-language communication session needs to be established between the two wireless communication devices 301 and 303. Establishment of the session may involve a separate server 306, or the application programs 312 and 315 may establish the session without assistance from a separate server.

[0050] Session initiation involves both users 318 and 321 performing actions with or on their respective devices 301 and 303. For example, both users 318 and 321 may launch their respective application programs 312 and 315, or both users 318 and 321 may invoke "Start" buttons displayed by the application programs' user interfaces. In some embodiments, the actions by both users 318 and 321 need to be performed within a predetermined amount of time, such as 0.5 seconds or 30 seconds, to initiate the session. In the case of line-of-sight communication technologies, such as IR communication directly between the wireless devices 301 and 303, the users 318 and 321 may initiate a session by pointing their devices 301 and 303 at each other and activating the IR beams. These and other user actions provide user inputs into the wireless communication devices 301 and 303 indicating willingness to participate in the cross-language communication session.

[0051] If a remote server 306 is involved in establishing the cross-language communication session, and the server 306 handles or potentially handles many other wireless communication devices (not shown), it may be necessary to provide the server 306 with information about the wireless communication devices 301 and 303 that are to participate in a particular cross-language communication session, so the server 306 can distinguish the participating wireless communication devices 301 and 303 from other wireless communication devices handled by the server 306 and associate the participating wireless communication devices 301 and 303 with each other for the duration of the session.

[0052] In some embodiments, information about the users' session-initiation actions is sent to the server 306, and the server 306 selects the participating wireless communication devices 301 and 303, from among the wireless communication devices the server handles, based on a criterion that involves the participating devices 301 and 303. ("Based on" means based at least in part on, not necessarily based exclusively on. Furthermore, a criterion may include several criteria.) The server 306 then associates the selected wireless communication devices 301 and 303 with each other.

[0053] In some embodiments, the server 306 sends information to the associated wireless communication devices 301 and 303 sufficient to enable the devices 301 and 303 to communicate directly with each other. In other embodiments, the server 306 acts as an intermediary, and communications between the wireless communications devices 301 and 303 flow through the server 306. In yet other embodiments, the server 306 sends the information to another intermediary, such as a management server for the wireless communication network 309, and the intermediary establishes a communication channel between the wireless communication devices 301 and 303.

[0054] The criterion may include proximity in time of the users' session-initiation actions. For example, in some embodiments, the application program 312 or 315 sends a message to the server 306 when the application is launched or when the "Start" button is invoked. The message includes an identification of the wireless communication device 301 or 303, at least sufficient for the server 306 to communicate with the wireless communication device 301 or 303 and, in particular, with the application program 312 or 315. If the server 306 receives two messages from respective wireless communication devices 301 and 303, and both messages are received by the server 306 within a predetermined window of time, such as about 0.5 seconds or about 30 seconds, the server 306 may assume the respective users 318 and 321 attempted to approximately simultaneously perform session-initiation activities and, therefore, indicate willingness to participate in a cross-language communication session with each other.

[0055] Optionally or alternatively, the application programs 312 and 315 may include, in the messages, times at which the users' session-initiation actions occurred, and the server 306 may compare these times to ascertain if the users' actions occurred within the predetermined window of time and, therefore, indicate willingness to participate in a cross-language communication session. The server 306 may dynamically adjust the size of the time window, such as based on the number of wireless communication devices the server 306 is handling or based on the rate at which the server 306 is receiving messages from application programs to initiate sessions. For example, during times the server 306 is busy with many wireless communication devices or many messages, the server 306 may decrease the size of the time window, so as to decrease the likelihood of mistakenly associating two wireless communication devices with each other. Conversely, during less busy times, the server 306 may increase the size of the time window, so as to impose less stringent requirements of nearly simultaneous session-initiation actions by the users.

[0056] Many different user actions may be used to initiate a session. Many wireless communication devices 301 and 303 include accelerometers or gyroscopes or other sensors that enable the application programs 312 and 315 to ascertain orientation, movement or acceleration of the wireless communication devices 301 and 303. In one example the users indicate willingness to participate in a cross-language communication session by lightly bumping their devices 301 and 303 together. The application programs 312 and 315 detect movement prior to the bump, and then rapid deceleration at the time of the bump. Information about the users' activities, i.e., bumping, as well as the time of the bump, may be sent to the server 306. In embodiments that do not utilize a remote server to initiate the session, the bump may indicate to the respective application programs 312 and 315 willingness by the users 318 and 321 to participate in a session, and the application programs 312 and 315 may, in response, establish the session between the devices 301 and 303.

[0057] Other physical activities may be used and sensed to indicate willingness to participate in a session. Examples include: shaking or otherwise similarly moving the wireless communication devices 301 and 303 and similarly orienting the devices 301 and 303 or orienting the devices in a complementary manner.

[0058] Instead of, or in addition to, proximity in time, proximity in space may be used to ascertain whether two wireless communication devices 301 and 303 should be associated with each other and, therefore, participate in a cross-language communication session. Generally, users who wish to communicate with each other are located within unaided speaking distance of each other. Embodiments of the present invention may require users' wireless communication devices to be within such as distance of each other to establish a cross-language communication session between the devices. However, some embodiments may require smaller, such as on the order of centimeters, or allow greater distances, such as within unaided visible distance, of each other. Locations of the wireless devices 301 and 303 may be ascertained using global positioning system (GPS) data, location data provided by wireless communication networks (such as cell identification or cellular triangulation data) or WiFi hotspots, or any other suitable data or combination of data, for which methods for obtaining are well known in the art.

[0059] Proximity may also be inferred from network addresses of the wireless communication devices 301 and 303. For example, multiple wireless communication devices that concurrently access a common WiFi hotspot may all have identical Internet protocol (IP) addresses, because their communications are routed by a common router that employs network address translation (NAT). Thus, wireless communication devices that have identical IP address may be inferred to be proximate each other.

[0060] In some embodiments, wireless communication devices that are within a predetermined distance of each other are candidates for a session. The server 306 may receive location information from the wireless communication devices 301 and 303, such as from the application programs 312 and 315, or from the wireless communication network 309. In some embodiments, only wireless communication devices that are within a predetermined distance, such as about 1 meter or 10 meters or 100 meters, of each other when the session-initiation actions are performed are associated with each other for a session.

[0061] The server 306 may dynamically adjust the predetermined distance, based on proximity of other wireless mobile devices or on the number of wireless mobile devices that are proximate a wireless mobile device that has sent a session initiation message. If many wireless communication devices are located in a relatively small area, the server 306 may reduce the predetermined distance, and if few wireless communication devices are located in the area, the server 306 may increase the predetermined distance.

[0062] In some embodiments, the criterion used to select wireless communication devices for participation in a cross-language communication session includes similarity of at least a portion of network addresses of the wireless communication devices. For example, two network addresses may be similar to each other, because they both begin with identical digits, indicating identical network prefixes.

[0063] Other criteria include similarity of sounds, images or video sequences captured by the respective wireless communication devices 301 and 303. "Similarity" means identical or identical within a tolerance or meeting some similarity criterion. Most wireless communication devices include microphones. In some embodiments, each application program 312 and 315 records a short audio signal of ambient sounds and sends the audio signal to the server 306, and the server 306 compares the audio signals for similarity, within a predefined tolerance, such as may be measured using mel-frequency cepstrum (MFC) analysis. Wireless communication devices in relatively close proximity of each other are likely to receive similar or identical ambient sounds. It should be noted that sounds captured by two spaced-apart communication devices may be similar, although time-shifted, with respect to each other.

[0064] In other embodiments, digitized images or video sequences captured by the wireless communication devices 301 and 303 may be compared by the server 306 for similarity to each other, as determined using various well-known image or video similarity metrics. In these embodiments, the users 318 and 321 may aim cameras in their respective wireless communication devices 301 and 303 at a common scene to indicate willingness to participate in a cross-language communication session. Physical properties, such as strength of the gravitational field at the wireless communication devices 301 and 303 may also be compared. The server 306 may use a combination of the techniques disclosed herein, or other techniques, to infer appropriateness of the wireless communication devices to be associated with each other.

[0065] If the wireless communication devices 301 and 303 include short-range wireless communication capabilities, such as Bluetooth transceivers, information obtained from these transceivers when the devices 301 and 303 come within range of each other may be used to infer physical proximity of the devices 301 and 303.

[0066] Furthermore, Bluetooth and other technologies enable devices to advertise services the devices provide, such as by using service discovery protocol (SDP). Each service is identified by a universal unique identifier (UUID). An appropriate UUID may be allocated for cross-language communication service. In some embodiments, the application programs 312 and 315 advertise cross-language communication service. The advertisements may include the respective users' preferred languages. When two such suitably equipped and enabled wireless communication devices are within range of each other, the application programs 312 and 315 may be configured to automatically alert the respective users 318 and 321 of the availability of a potential participant in a cross-language communication session, such as by sounding an alarm or activating a vibrator in the communication device. The alert may depend on whether the potential participant speaks a language (such as the local language) selected by the user of the other wireless communication device.

[0067] Thus, the wireless communication devices 301 and 303, or more specifically the application programs 312 and 315, may automatically discover each other and prompt one or both the respective users 318 and 312. In response to the prompt(s), the user(s) may indicate willingness to participate in a cross-language communication session. Such an embodiment need not necessarily employ a server to associate the wireless communication devices 301 and 303 with each other.

[0068] Although it may be desirable to avoid disclosing network addresses or telephone numbers of the wireless communication device 301 to the user 321 of the other device 303, the application program 312 may be configured to display a random, pseudo-random, arbitrary or predefined number or other string that may be disclosed to the user 321 of the other wireless communication device 303 as a temporary identification. The user 321 of the other wireless communication device 303 may then enter the temporary identification into the application program 315 to indicate willingness to participate in a cross-language communication session with the user 318 of the first wireless communication device 301. In embodiments that involve a server 306 for associating wireless communication devices with each other, the application programs 312 and 315 send any such entered temporary identifications to the server 306. The server 306 then uses the received temporary identifications to associate the corresponding wireless communication devices 301 and 303 with each other.

[0069] Regardless of whether the wireless communication devices 301 and 303 are associated with each other by the server 306 or solely by the application programs 312 and 315, once the devices 301 and 303 are associated with each other, the cross-language communication session is established. As noted, the associated wireless communication devices 301 and 303 communicate with each other, either directly or via an intermediary, such as an intermediary in the wireless network 309 or the server 306.

[0070] Once a cross-language communication session is established between the wireless communication devices 301 and 303, the users 318 and 321 may enter text into their respective devices, and translated versions of the text is output on the other user's device. The translation may be performed on the wireless communication device on which the text was entered, on the server 306, another server (not shown) or on the wireless communication device of the other user. Thus, the entered text or the translated version of the translated text is sent wirelessly to the wireless communication device of the other user, either directly or via an intermediary, such as the server 306 or an intermediary in the wireless communication network 309. The users 318 and 321 can continue entering text into their respective wireless communication devices 301 and 303, and translated versions of the text are displayed on the other user's device.

[0071] The translation of each user's input (message) may be performed after each user indicates her input is complete. For example, the user may press a "Translate" button or a "Return" key on the user interface provided by the application program to signal the end of a message. In this manner, the user may make corrections to her input, such as by deleting text or inserting text, before the input text is translated. All the users may enter text simultaneously or in an overlapping manner in their respective wireless communication devices, and the translations may be performed as each user indicates completeness of her input. Thus, more than one translation may occur at a time. Furthermore, each user may input several messages in sequence, and these messages may be translated in sequence. The users' inputs may be interleaved, such as a result of a conversation between the users, each entering a message in turn, all during a single cross-language communication session.

[0072] Optionally or alternatively, the translation and display of the translated text may be performed as each word or sentence is entered, without necessarily requiring the user to invoke a "Translate" button or the like. In this case, as a user types and possibly revises text, translated and possibly revised translated text is displayed on the other user's wireless communication device.
Depending on the language in which the user enters text and the language into which the entered text is being translated, the translator may delay generating translated text until sufficient input text (such as a verb near the end of a German sentence) has been entered. Optionally or alternatively, the translator may generate refined translations as the user enters text, and the refined translations may be displayed on the other user's wireless communication device, such as by deleting an earlier translation of a partial sentence and displaying the refined translation. Semantic and grammar prediction acquired through machine learning (ML) methods may be used to deal with ambiguities in a user's partial inputs to improve the translations. Thus, the system may provide essentially real-time translation of user inputs.

[0073] As used herein, a "message" or a "user message entered on the first wireless communication device in a first natural language" means a unit of text that is to be translated. In some embodiments, the user indicates the end of a message, while in other embodiments the system automatically determines the extent of each message, such as at the end of each word, sentence or other group of text.

[0074] The cross-language communication session may be ended when either user 318 or 321 activates an "End" button on a user interface displayed by the application program 312 or 315. Optionally or alternatively, the cross-language communication session may be ended when either wireless communication device 301 or 303 is no longer proximate the other device. Lack of proximity may be automatically determined, such as by the server 306 or by either application program 312 or 315, by distance between the wireless communication devices 301 and 303, as discussed above. Optionally or alternatively, lack of proximity may be determined by loss or degradation of the wireless signal from one of the wireless communication devices 301 or 303.

[0075] Fig. 4 is a schematic block diagram relating to an embodiment of the present invention. A wireless communication device 400 (such as one of the wireless communication devices 301 or 303 of Fig. 3) includes four user interfaces 403, 406, 409 and 412. The first user interface 403 is configured to receive a user input indicating willingness to participate in a cross-language communication session with another wireless communication device. As noted, to preserve privacy of the users, the identity of the other wireless communication device or user may not be known or made available. Thus, "with another wireless communication device" does not necessarily require the identity of the other device to be entered via the first user interface 403. The first user interface 403 may be implemented by a real or virtual button, accelerometer or other hardware or software device or combination thereof.

[0076] The second user interface 406 is configured to receive a user message, such as text entered via a real or virtual keyboard, microphone and automatic speech recognizer, etc. The third user interface 409 is configured to output a translated user message, such as via a display screen or speech synthesizer.

[0077] The embodiment includes a first automatic translation module 415 configured to generate the translated user message that is output by the third user interface 406. The first translation module 415 translates a user message received by one of the wireless communication devices from a first natural language, such as French, to a second natural language, such as English. In some embodiments, the first translation module 415 is within one of the wireless communication devices, such as device 301 (Fig. 3). In other embodiments, the first translation module 415 is with another of the wireless communication devices, such as device 303 (Fig. 3). In yet other embodiments, the first translation module 415 is within a server 306 (Fig. 3).

[0078] Fig. 1 also shows a first transmitter module 418 configured to wirelessly send the user message received by the first wireless communication device, or the translated user message, from the first wireless communication device to the second wireless communication device. In some embodiments, such as embodiments that involve direct wireless communication between the two wireless communication devices, the first transmitter module 418 is within the first wireless communication device 301 (Fig. 3). In some other embodiments, such as embodiments in which communications between the wireless communication devices travels via a wireless communication network or a server, the first transmitter module 418 may be within the first wireless communication device or within the wireless communication network or server.

[0079] A second automatic translation module 421 is configured to generate a second translated user message by translating a user message received by the second wireless communication device 303 (Fig. 1) to the first natural language. The second automatic translation module 421may be within the first or second wireless communication device 301 or 303 (Fig. 3) or within the server 306.

[0080] A second transmitter module 424 is configured to wirelessly send the user message received by the second wireless communication device 303 (Fig. 1), or the second translated user message, from the second wireless communication device to the first wireless communication device. In some embodiments, such as embodiments that involve direct wireless communication between the two wireless communication devices, the second transmitter module 424 is within the second wireless communication device 303 (Fig. 3). In some other embodiments, such as embodiments in which communications between the wireless communication devices travels via a wireless communication network or a server, the second transmitter module 424 may be within the second wireless communication device or within the wireless communication network or server.

[0081] The fourth user interface 412 is configured to receive an identification of the first natural language, i.e., the user's preferred language. The application program (not shown) stores an indication of the first natural language in a memory 427.

[0082] Fig. 5 is a schematic block diagram relating to another embodiment of the present invention. A server 500 (such as the server 306 of Fig. 3) is configured to automatically coordinate establishment of a cross-language communication session that includes two or more wireless communication devices. The server 500 includes a session initiation receiver 503 configured to receive information about user inputs received by respective ones of the wireless communication devices. The user inputs indicate willingness to participate in the cross-language communication session. A coordination module 506 is configured to automatically associate the wireless communication devices (of a session) with each other. The coordination module 506 may be configured to select the wireless communication devices for a session, from among a plurality of wireless communication devices, based on a criterion that involves the wireless communication devices. The selected wireless communication devices are associated with each other. The criterion may include physical proximity of the wireless communication devices to each other. Other possible criteria are discussed elsewhere herein.

[0083] As noted above, with respect to Fig. 4, the first and/or second translation modules 414 and/or 421 may be included in the server 500. Furthermore, the server 500 may include a memory 512, and the server 500 may store indications of the language preferences of the users, instead of or in addition to storing these indications in respective memories of the wireless communication devices.

[0084] Fig. 6 contains a flowchart illustrating operation of an embodiment of the present invention. At 600, a first user input indicating willingness to participate in a cross-language communication session with a second wireless communication device is received at a first wireless communication device. At 603, a second user input indicating willingness to participate in the cross-language communication session with the first wireless communication device is received at the second wireless communication device. At 606, after receiving the first and second user inputs, a first user message entered on the first wireless communication device in a first natural language is received. It should be noted that the first user message is entered on the first wireless communication device, not received by the first wireless communication device from some other device, ex. an SMS message. At 609, a translated first user message is automatically generated, including translating the first user message into a second natural language, different than the first natural language. The translation may be performed on the first or second wireless communication device. Optionally or alternatively, a request may be sent to a server, distinct from the first and second wireless communication devices, to translate the first user message, and a translation of the first user message into the second natural language may be received from the server. At 612, the translated first user message is output on the second wireless communication device.

[0085] The cross-language communication session may optionally be continued. At 615, after outputting the translated first user message on the second wireless communication device, a second user message, entered on the second wireless communication device, is received. At 618, a translated second user message is automatically generated, including translating the second user message into the first natural language. At 621, the translated second user message is output on the first wireless communication device.

[0086] While the invention is described through the above-described exemplary embodiments, modifications to, and variations of, the illustrated embodiments may be made without departing from the inventive concepts disclosed herein. Furthermore, disclosed aspects, or portions thereof, may be combined in ways not listed above and/or not explicitly claimed. Accordingly, the invention should not be viewed as being limited to the disclosed embodiments.

[0087] Although aspects of embodiments may be described with reference to flowcharts and/or block diagrams, functions, operations, decisions, etc. of all or a portion of each block, or a combination of blocks, may be combined, separated into separate operations or performed in other orders. All or a portion of each block, or a combination of blocks, may be implemented as computer program instructions (such as software), hardware (such as combinatorial logic, Application Specific Integrated Circuits (ASICs), Field-Programmable Gate Arrays (FPGAs) or other hardware), firmware or combinations thereof. Embodiments may be implemented by a processor executing, or controlled by, instructions stored in a memory. The memory may be random access memory (RAM), read-only memory (ROM), flash memory or any other memory, or combination thereof, suitable for storing control software or other instructions and data. Instructions defining the functions of the present invention may be delivered to a processor in many forms, including, but not limited to, information permanently stored on tangible non-writable storage media (e.g., read-only memory devices within a computer, such as ROM, or devices readable by a computer I/O attachment, such as CD-ROM or DVD disks), information alterably stored on tangible writable storage media (e.g., floppy disks, removable flash memory and hard drives) or information conveyed to a computer through a communication medium, including wired or wireless computer networks. Moreover, while embodiments may be described in connection with various illustrative data structures, systems may be embodied using a variety of data structures.


Claims

1. A computer-implemented method for facilitating cross-language communication among users of respective wireless communication devices (101, 103; 201, 203; 301, 303; 400), the method comprising:

- receiving (600), at a first of the wireless communication devices (101; 201; 301), a first user input indicating willingness to participate in a cross-language communication session with a second of the wireless communication devices;

- receiving (603), at the second wireless communication device (103; 203; 303), a second user input indicating willingness to participate in the cross-language communication session with the first wireless communication device (101; 201; 301);

- receiving, at the first wireless communication device (101; 201; 301), a first signal from a first sensor of the first wireless communication device;

- receiving, at the second wireless communication device (103; 203; 303), a second signal from a second sensor of the second wireless communication device;

- automatically comparing the first signal to the second signal to determine whether the first and the second signal satisfy a similarity criterion;

- automatically establishing the cross-language communication session; and

- if the cross-language communication session is established:

- after receiving (600, 603) the first and second user inputs, receiving (606) a first user message entered on the first wireless communication device (101; 201; 301) in a first natural language;

- automatically generating (609) a translated first user message, including translating the first user message into a second natural language, different than the first natural language; and

- outputting (612) the translated first user message on the second wireless communication device (103; 203; 303);

- characterized in that the similarity criterion includes similarity of sounds received by the respective first and second wireless communication devices (101, 103; 201, 203; 301, 303; 400) and/or the similarity criterion includes similarity of images captured by the respective first and second wireless communication devices;

- and in that automatically establishing the cross-language communication session is performed if the first and second signals satisfy the similarity criterion.


 
2. A method according to claim 1, further comprising, as part of the cross-language communication session:

- after outputting (612) the translated first user message on the second wireless communication device, receiving (615) a second user message entered on the second wireless communication device (103; 203; 303);

- automatically generating (618) a translated second user message, including translating the second user message into the first natural language; and

- outputting (621) the translated second user message on the first wireless communication device (101; 201; 301).


 
3. A method according to claim 1, further comprising, during the cross-language communication session:

- receiving subsequent first user messages entered on the first wireless communication device (101; 201; 301);

- for each subsequent first user message:

- automatically generating a corresponding translated first user message, including translating the subsequent first user message into the second natural language; and

- outputting the corresponding translated first user message on the second wireless communication device (103; 203; 303);

- receiving subsequent second user messages entered on the second wireless communication device (103; 203; 303); and

- for each subsequent second user message:

- automatically generating a corresponding translated second user message, including translating the subsequent second user message into the first natural language; and

- outputting the corresponding translated second user message on the first wireless communication device (101; 201; 301).


 
4. A method according to claim 1, wherein automatically generating (618) the translated first user message comprises at least one of:

- (a) translating the first user message into the second natural language within the first wireless communication device (101; 201; 301);

- (b) translating the first user message into the second natural language within the second wireless communication device (103; 203; 303); and

- (c) a combination of:

- (c1) sending a request to a server (209; 306; 500), distinct from the first and second wireless communication devices, to translate the first user message; and

- (c2) receiving, from the server (209; 306; 500), a translation of the first user message into the second natural language.


 
5. A method according to claim 1, further comprising:

- before receiving (600, 603) the first and second user inputs indicating willingness to participate in the cross-language communication session, receiving, by at least one of the first and second wireless communication device, a user input identifying the first natural language; and

- responsive to receiving the user input identifying the first natural language, storing, by at least one of the first and second wireless communication device, an indication of the first natural language.


 
6. A method according to claim 1, further comprising wirelessly communicating at least one of the first user message and the translated first user message from the first wireless communication device (101; 201; 301) directly to the second wireless communication device (103; 203; 303).
 
7. A method according to claim 1, further comprising:

- wirelessly communicating at least one of the first user message and the translated first user message from the first wireless communication device (101; 201; 301), via a wireless communication network (206; 309), to the second wireless communication device (103; 203; 303); and

- wherein generating (618) the translated first user message occurs within at least one of the first and second wireless communication devices.


 
8. A method according to claim 1, further comprising automatically coordinating establishment of the cross-language communication session by a server (209; 306; 500), distinct from and wirelessly communicatively coupled to the first and second wireless communication devices, including:

- receiving, at the server (209; 306; 500), information about the first and second user inputs indicating willingness to participate in the cross-language communication session; and

- automatically associating the first wireless communication device (101; 201; 301) with the second wireless communication device (103; 203; 303), based on the similarity of the first and second signals.


 
9. A method according to claim 8, wherein associating the first with the second wireless communication device comprises automatically selecting the first and second wireless communication devices from among a plurality of wireless communication devices, based on the similarity of the first and second signals.
 
10. A method according to claim 9, wherein at least one of:

- automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if the first wireless communication device (101; 201; 301) is physically proximate the second wireless communication device (103; 203; 303);

- automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if distance between the first and second wireless communication devices is less than a threshold value;

- automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if at least a portion of respective network addresses of the first and second wireless communication devices are similar;

- automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if the first and second user inputs indicating willingness to participate in a cross-language communication session are received proximate in time;

- automatically establishing the cross-language communication session comprises establishing the cross-language communication session only if the server (209; 306; 500) receives respective messages from the first and second wireless communication devices proximate in time;

- the similarity of the first and second signals comprises similarity of sounds received by the respective first and second wireless communication devices;

- the similarity of the first and second signals comprises similarity of images captured by the respective first and second wireless communication devices; and

- the similarity of the first and second signals comprises similarity of respective physical properties measured by the respective first and second wireless communication devices.


 
11. A method according to claim 9, further comprising automatically calculating the threshold value, based on a number of wireless communication devices physically proximate the first wireless communication device (101; 201; 301).
 
12. A method according to claim 8, further comprising:

- receiving, at the first wireless communication device (101; 201; 301), a third user input including information about the second wireless communication device (103; 203; 303); and wherein

- associating the first with the second wireless communication device comprises associating the first with the second wireless communication device, based on the received information about the second wireless communication device.


 
13. A method according to claim 8, wherein automatically generating (618) the translated first user message comprises translating the first user message into the second natural language by the server (209; 306; 500).
 
14. A method according to claim 1, wherein the first user input indicating willingness to participate in a cross-language communication session comprises at least one of:

- a button press;

- data indicating orientation of the first wireless communication device (101; 201; 301); and

- data indicating acceleration of the first wireless communication device (101; 201; 301).


 


Ansprüche

1. Computerimplementiertes Verfahren zum Ermöglichen von sprachübergreifender Kommunikation zwischen Benutzern entsprechender Drahtloskommunikationsgeräte (101, 103; 201, 203; 301, 303; 400), wobei das Verfahren Folgendes umfasst:

- Empfangen (600), an einem ersten der Drahtloskommunikationsgeräte (101; 201; 301), einer ersten Benutzereingabe, die Bereitschaft angibt, an einer sprachübergreifenden Kommunikationssitzung mit einem zweiten der Drahtloskommunikationsgeräte teilzunehmen;

- Empfangen (603), an einem zweiten Drahtloskommunikationsgerät (103; 203; 303), einer zweiten Benutzereingabe, die Bereitschaft angibt, an der sprachübergreifenden Kommunikationssitzung mit dem ersten Drahtloskommunikationsgerät (101; 201; 301) teilzunehmen;

- Empfangen, an dem ersten Drahtloskommunikationsgerät (101; 201; 301), eines ersten Signals von einem ersten Sensor des ersten Drahtloskommunikationsgeräts;

- Empfangen, an dem zweiten Drahtloskommunikationsgerät (103; 203; 303), eines zweiten Signals von einem zweiten Sensor des zweiten Drahtloskommunikationsgeräts;

- automatisches Vergleichen des ersten Signals mit dem zweiten Signal, um zu bestimmen, ob das erste und das zweite Signal ein Ähnlichkeitskriterium erfüllen;

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung; und

- wenn die sprachübergreifende Kommunikationssitzung hergestellt ist:

- nach dem Empfangen (600, 603) der ersten und der zweiten Benutzereingabe, Empfangen (606) einer ersten Benutzernachricht, die an dem ersten Drahtloskommunikationsgerät (101; 201; 301) in einer ersten natürlichen Sprache eingetragen worden ist;

- automatisches Erzeugen (609) einer übersetzten ersten Benutzernachricht, einschließlich des Übersetzens der ersten Benutzernachricht in eine zweite natürliche Sprache, die anders als die erste natürliche Sprache ist; und

- Ausgeben (612) der übersetzten ersten Benutzernachricht auf dem zweiten Drahtloskommunikationsgerät (103; 203; 303);

- dadurch gekennzeichnet, dass das Ähnlichkeitskriterium die Ähnlichkeit von Tönen einschließt, die jeweils von dem ersten und dem zweiten Drahtloskommunikationsgerät (101, 103; 201, 203; 301, 303; 400) empfangen werden, und/oder das Ähnlichkeitskriterium die Ähnlichkeit von Bildern einschließt, die jeweils von dem ersten und dem zweiten Drahtloskommunikationsgerät erfasst worden sind;

- und dadurch, dass die sprachübergreifende Kommunikationssitzung automatisch hergestellt wird, wenn das erste und das zweite Signal das Ähnlichkeitskriterium erfüllen.


 
2. Verfahren nach Anspruch 1, das als Teil der sprachübergreifenden Kommunikationssitzung ferner Folgendes umfasst:

- nach dem Ausgeben (612) der übersetzten ersten Benutzernachricht auf dem zweiten Drahtloskommunikationsgerät, Empfangen (615) einer zweiten Benutzernachricht, die auf dem zweiten Drahtloskommunikationsgerät (103; 203; 303) eingetragen worden ist;

- automatisches Erzeugen (618) einer übersetzten zweiten Benutzernachricht, einschließlich des Übersetzens der zweiten Benutzernachricht in die erste natürliche Sprache; und

- Ausgeben (621) der übersetzten zweiten Benutzernachricht auf dem ersten Drahtloskommunikationsgerät (101; 201; 301).


 
3. Verfahren nach Anspruch 1, das während der sprachübergreifenden Kommunikationssitzung ferner Folgendes umfasst:

- Empfangen von nachfolgenden ersten Benutzernachrichten, die auf dem ersten Drahtloskommunikationsgerät (101; 201; 301) eingetragen worden sind;

- für jede nachfolgende erste Benutzernachricht:

- automatisches Erzeugen einer entsprechenden übersetzten ersten Benutzernachricht, einschließlich des Übersetzens der nachfolgenden ersten Benutzernachricht in die zweite natürliche Sprache; und

- Ausgeben der entsprechenden übersetzten ersten Benutzernachricht auf dem zweiten Drahtloskommunikationsgerät (103; 203; 303);

- Empfangen von nachfolgenden zweiten Benutzernachrichten, die auf dem zweiten Drahtloskommunikationsgerät (103; 203; 303) eingetragen worden sind; und

- für jede nachfolgende zweite Benutzernachricht:

- automatisches Erzeugen einer entsprechenden übersetzten zweiten Benutzernachricht, einschließlich des Übersetzens der nachfolgenden zweiten Benutzernachricht in die erste natürliche Sprache; und

- Ausgeben der entsprechenden übersetzten zweiten Benutzernachricht auf dem ersten Drahtloskommunikationsgerät (101; 201; 301).


 
4. Verfahren nach Anspruch 1, wobei das automatische Erzeugen (618) der übersetzten ersten Benutzernachricht mindestens eines der Folgenden umfasst:

- (a) Übersetzen der ersten Benutzernachricht in die zweite natürliche Sprache innerhalb des ersten Drahtloskommunikationsgeräts (101; 201; 301);

- (b) Übersetzen der ersten Benutzernachricht in die zweite natürliche Sprache innerhalb des zweiten Drahtloskommunikationsgeräts (103; 203; 303); und

- (c) eine Kombination aus:

- (c1) Senden einer Anforderung an einen Server (209; 306; 500), der sich vom ersten und vom zweiten Drahtloskommunikationsgerät unterscheidet, um die erste Benutzernachricht zu übersetzen; und

- (c2) Empfangen, vom Server (209; 306; 500), einer Übersetzung der ersten Benutzernachricht in die zweite natürliche Sprache.


 
5. Verfahren nach Anspruch 1, das ferner Folgendes umfasst:

- vor dem Empfangen (600, 603) der ersten und der zweiten Benutzereingabe, die die Bereitschaft zur Teilnahme an der sprachübergreifenden Kommunikationssitzung angeben, Empfangen, durch das mindestens eine des ersten und des zweiten Drahtloskommunikationsgeräts, einer Benutzereingabe, die die erste natürliche Sprache identifiziert; und

- als Reaktion auf das Empfangen der Benutzereingabe, die die erste natürliche Sprache identifiziert, Speichern, durch das mindestens eine des ersten und des zweiten Drahtloskommunikationsgeräts, einer Angabe der ersten natürlichen Sprache.


 
6. Verfahren nach Anspruch 1, das ferner das drahtlose Kommunizieren midestens einer der Benutzernachricht und der übersetzten ersten Benutzernachricht von dem ersten Drahtloskommunikationsgerät (101; 201; 301) direkt mit dem zweiten Drahtloskommunikationsgerät (103 203; 303) umfasst.
 
7. Verfahren nach Anspruch 1, das ferner Folgendes umfasst:

- drahtloses Kommunizieren mindestens einer der ersten Benutzernachricht und der übersetzten ersten Benutzernachricht von dem ersten Drahtloskommunikationsgerät (101; 201; 301) mit dem zweiten Drahtloskommunikationsgerät (103 203; 303) über ein Drahtloskommunikationsnetz (206; 309); und

- wobei das Erzeugen (618) der übersetzten ersten Benutzernachricht innerhalb mindestens eines des ersten und des zweiten Drahtloskommunikationsgeräts erfolgt.


 
8. Verfahren nach Anspruch 1, das ferner das automatische Koordinieren des Herstellens der sprachübergreifenden Kommunikationssitzung durch einen Server (209; 306; 500) umfasst, der sich von dem ersten und dem zweiten Drahtloskommunikationsgerät unterscheidet und mit diesen drahtlos kommunikativ gekoppelt ist, einschließlich:

- Empfangen, am Server (209; 306; 500), von Informationen zu der ersten und der zweiten Benutzereingabe, die die Bereitschaft zur Teilnahme an der sprachübergreifenden Kommunikationssitzung angeben; und

- automatisches Zuordnen des ersten Drahtloskommunikationsgeräts (101; 201; 301) zum zweiten Drahtloskommunikationsgerät (103; 203; 303) basierend auf der Ähnlichkeit des ersten und des zweiten Signals.


 
9. Verfahren nach Anspruch 8, wobei das Zuordnen des ersten mit dem zweiten Drahtloskommunikationsgerät, das automatische Auswählen des ersten und des zweiten Drahtloskommunikationsgeräts aus mehreren Drahtloskommunikationsgeräten basierend auf der Ähnlichkeit des ersten und des zweiten Signals umfasst.
 
10. Verfahren nach Anspruch 9, wobei mindestens eines der Folgenden gilt:

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung umfasst das Herstellen der sprachübergreifenden Kommunikationssitzung nur dann, wenn sich das erste Drahtloskommunikationsgerät (101; 201; 301) physisch in der Nähe des zweiten Drahtloskommunikationsgeräts (103; 203; 303) befindet;

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung umfasst das Herstellen der sprachübergreifenden Kommunikationssitzung nur dann, wenn der Abstand zwischen dem ersten und dem zweiten Drahtloskommunikationsgerät kleiner als ein Schwellenwert ist;

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung umfasst das Herstellen der sprachübergreifenden Kommunikationssitzung nur dann, wenn mindestens ein Abschnitt entsprechender Netzwerkadressen des ersten und des zweiten Drahtloskommunikationsgeräts ähnlich ist;

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung umfasst das Herstellen der sprachübergreifenden Kommunikationssitzung nur dann, wenn die ersten und zweiten Benutzereingaben, die die Bereitschaft zur Teilnahme an einer sprachenübergreifenden Kommunikationssitzung angeben, zeitnah empfangen werden;

- automatisches Herstellen der sprachübergreifenden Kommunikationssitzung umfasst das Herstellen der sprachübergreifenden Kommunikationssitzung nur dann, wenn der Server (209; 306; 500) entsprechende Nachrichten von dem ersten und dem zweiten Drahtloskommunikationsgerät zeitnah empfängt;

- die Ähnlichkeit zwischen dem ersten und dem zweiten Signal umfasst eine Ähnlichkeit von Tönen, die von dem entsprechenden ersten und dem zweiten Drahtloskommunikationsgerät empfangen werden;

- die Ähnlichkeit zwischen dem ersten und dem zweiten Signal umfasst eine Ähnlichkeit von Bildern, die von dem entsprechenden ersten und dem zweiten Drahtloskommunikationsgerät erfasst werden; und

- die Ähnlichkeit zwischen dem ersten und dem zweiten Signal umfasst eine Ähnlichkeit von entsprechenden physischen Merkmalen, die von dem entsprechenden erstenund dem zweiten Drahtloskommunikationsgerät gemessen werden.


 
11. Verfahren nach Anspruch 9, das ferner das automatische Berechnen des Schwellenwerts, basierend auf einer Anzahl von Drahtloskommunikationsgeräten, die sich physisch in der Nähe des ersten Drahtloskommunikationsgeräts (101; 201; 301) befinden.
 
12. Verfahren nach Anspruch 8, das ferner Folgendes umfasst:

- Empfangen, an dem ersten Drahtloskommunikationsgerät (101; 201; 301), einer dritten Benutzereingabe einschließlichlnformationen zu dem zweiten Drahtloskommunikationsgerät (103; 203; 303); und wobei

- Zuordnen des ersten dem zweiten Drahtloskommunikationsgerät, das das Zuordnen des ersten dem zweiten Drahtloskommunikationsgerät umfasst, basierend auf den empfangenen Informationen zu dem zweiten Drahtloskommunikationsgerät.


 
13. Verfahren nach Anspruch 8, wobei das automatische Erzeugen (618) der übersetzten ersten Benutzernachricht das Übersetzen der ersten Benutzernachricht durch den Server (209; 306; 500) in die zweite natürliche Sprache umfasst.
 
14. Verfahren nach Anspruch 1, wobei die erste Benutzereingabe, die die Bereitschaft an einer sprachübergreifenden Kommunikationssitzung teilzunehmen angibt, mindestens eines der Folgenden umfasst:

- einen Tastendruck;

- Daten, die die Ausrichtung des ersten Drahtloskommunikationsgeräts (101; 201; 301) angeben; und

- Daten, die die Beschleunigung des ersten Drahtloskommunikationsgeräts (101; 201; 301) angeben.


 


Revendications

1. Procédé mis en Ĺ“uvre par ordinateur destiné à faciliter la communication translinguistique entre les utilisateurs de dispositifs de communication sans fil respectifs (101, 103 ; 201, 203 ; 301, 303 ; 400), le procédé comprenant :

- la réception (600), au niveau d'un premier des dispositifs de communication sans fil (101; 201; 301), d'une première entrée d'utilisateur indiquant la volonté de participer à une session de communication translinguistique avec un second des dispositifs de communication sans fil ;

- la réception (603), au niveau d'un second dispositif de communication sans fil (103; 203; 303), d'une deuxième entrée d'utilisateur indiquant la volonté de participer à la session de communication translinguistique avec le premier dispositif de communication sans fil (101; 201; 301) ;

- la réception, au niveau du premier dispositif de communication sans fil (101; 201; 301), d'un premier signal provenant d'un premier capteur du premier dispositif de communication sans fil ;

- la réception, au niveau du second dispositif de communication sans fil (103; 203; 303), d'un second signal provenant d'un second capteur du second dispositif de communication sans fil ;

- la comparaison de façon automatique du premier signal au second signal pour déterminer si le premier et le second signal répondent à un critère de similarité ;

- l'établissement de façon automatique de la session de communication translinguistique ; et

- si la session de communication translinguistique est établie :

- après la réception (600, 603) des première et deuxième entrées d'utilisateur, la réception (606) d'un premier message d'utilisateur saisi sur le premier dispositif de communication sans fil (101 ; 201 ; 301) dans une première langue naturelle ;

- la génération de façon automatique (609) d'un premier message d'utilisateur traduit, comportant la traduction du premier message d'utilisateur dans une seconde langue naturelle, différente de la première langue naturelle ; et

- la sortie (612) du premier message d'utilisateur traduit sur le second dispositif de communication sans fil (103 ; 203 ; 303) ;
caractérisé en ce que le critère de similarité comprend la similarité des sons reçus par les premier et second dispositifs de communication sans fil respectifs (101, 103 ; 201, 203 ; 301, 303 ; 400) et/ou le critère de similarité inclut la similarité des images capturées par les premier et second dispositifs de communication sans fil respectifs ;
et en ce que l'établissement de façon automatique de la session de communication translinguistique est effectué si les premier et second signaux satisfont au critère de similarité.


 
2. Procédé selon la revendication 1, comprenant en outre, dans le cadre de la session de communication translinguistique :

- après la sortie (612) du premier message d'utilisateur traduit sur le second dispositif de communication sans fil, la réception (615) d'un second message d'utilisateur saisi sur le second dispositif de communication sans fil (103 ; 203 ; 303) ;

- la génération de façon automatique (618) d'un second message d'utilisateur traduit, comportant la traduction du second message d'utilisateur dans la première langue naturelle ;
et

- la sortie (621) du second message d'utilisateur traduit sur le premier dispositif de communication sans fil (101 ; 201 ; 301).


 
3. Procédé selon la revendication 1, comprenant en outre pendant la session de communication translinguistique :

- la réception des premiers messages d'utilisateur ultérieurs saisis sur le premier dispositif de communication sans fil (101 ; 201 ; 301) ;

- pour chaque premier message d'utilisateur ultérieur :

- la génération de façon automatique d'un premier message d'utilisateur traduit correspondant, comportant la traduction du premier message d'utilisateur ultérieur dans la seconde langue naturelle ; et

- la sortie du premier message d'utilisateur traduit correspondant sur le second dispositif de communication sans fil (103 ; 203 ; 303) ;

- la réception des seconds messages d'utilisateur ultérieurs saisis sur le second dispositif de communication sans fil (103 ; 203 ; 303) ; et

- pour chaque second message d'utilisateur ultérieur :

- la génération de façon automatique d'un second message d'utilisateur traduit correspondant, comportant la traduction du second message d'utilisateur ultérieur dans la première langue naturelle ; et

- la sortie du second message d'utilisateur traduit correspondant sur le premier dispositif de communication sans fil (101 ; 201 ; 301).


 
4. Procédé selon la revendication 1, dans lequel la génération de façon automatique (618) du premier message d'utilisateur traduit comprend au moins l'un des éléments suivants :

(a) la traduction du premier message d'utilisateur dans la seconde langue naturelle au sein du premier dispositif de communication sans fil (101 ; 201 ; 301) ;

(b) la traduction du premier message d'utilisateur dans la seconde langue naturelle au sein du second dispositif de communication sans fil (103 ; 203 ; 303) ; et

(c) une combinaison de :

(c1) l'envoi d'une demande à un serveur (209 ; 306 ; 500), distinct des premier et second dispositifs de communication sans fil, pour traduire le premier message d'utilisateur ; et

(c2) la réception, depuis le serveur (209; 306; 500), d'une traduction du premier message d'utilisateur dans la seconde langue naturelle.


 
5. Procédé selon la revendication 1 comprenant en outre :

- avant la réception (600, 603) des première et deuxième entrées d'utilisateur indiquant la volonté de participer à la session de communication translinguistique, la réception, par au moins un parmi le premier et le second dispositif de communication sans fil, d'une entrée d'utilisateur identifiant la première langue naturelle ; et

- en réponse à la réception de l'entrée d'utilisateur identifiant la première langue naturelle, la mémorisation, par au moins un parmi le premier et le second dispositif de communication sans fil, d'une indication de la première langue naturelle.


 
6. Procédé selon la revendication 1, comprenant en outre la communication sans fil d'au moins un parmi le premier message d'utilisateur et le premier message d'utilisateur traduit à partir du premier dispositif de communication sans fil (101 ; 201 ; 301) directement au second dispositif de communication sans fil (103 ; 203 ; 303).
 
7. Procédé selon la revendication 1 comprenant en outre :

- la communication sans fil d'au moins un parmi le premier message d'utilisateur et le premier message d'utilisateur traduit à partir du premier dispositif de communication sans fil (101 ; 201 ; 301), par l'intermédiaire d'un réseau de communication sans fil (206 ; 309), vers le second dispositif de communication sans fil (103 ; 203 ; 303) ; et

- dans lequel la génération (618) du premier message d'utilisateur traduit se produit au sein d'au moins un parmi les premier et second dispositifs de communication sans fil.


 
8. Procédé selon la revendication 1, comprenant en outre la coordination de façon automatique de l'établissement de la session de communication translinguistique par un serveur (209 ; 306 ; 500), distinct des premier et second dispositifs de communication sans fil et couplé de façon à communiquer sans fil, comportant :

- la réception, au niveau du serveur (209; 306; 500), des informations sur les première et deuxième entrées d'utilisateur indiquant la volonté de participer à la session de communication translinguistique ; et

- l'association de façon automatique du premier dispositif de communication sans fil (101 ; 201 ; 301) au second dispositif de communication sans fil (103 ; 203 ; 303), sur la base de la similarité des premier et second signaux.


 
9. Procédé selon la revendication 8, dans lequel l'association du premier au second dispositif de communication sans fil comprend la sélection de façon automatique des premier et second dispositifs de communication sans fil parmi une pluralité de dispositifs de communication sans fil, sur la base de la similarité des premier et second signaux.
 
10. Procédé selon la revendication 9, dans lequel au moins un parmi :

- l'établissement de façon automatique de la session de communication translinguistique comprend l'établissement de la session de communication translinguistique uniquement si le premier dispositif de communication sans fil (101 ; 201 ; 301) est physiquement à proximité du second dispositif de communication sans fil (103 ; 203 ; 303) ;

- l'établissement de façon automatique de la session de communication translinguistique comprend l'établissement de la session de communication translinguistique uniquement si la distance entre les premier et second dispositifs de communication sans fil est inférieure à une valeur de seuil ;

- l'établissement de façon automatique de la session de communication translinguistique comprend l'établissement de la session de communication translinguistique uniquement si au moins une partie des adresses de réseau respectives des premier et second dispositifs de communication sans fil est similaire ;

- l'établissement de façon automatique de la session de communication translinguistique comprend l'établissement de la session de communication translinguistique uniquement si les première et deuxième entrées d'utilisateur indiquant la volonté de participer à une session de communication translinguistique sont reçus à peu près au même moment ;

- l'établissement de façon automatique de la session de communication translinguistique comprend l'établissement de la session de communication translinguistique uniquement si le serveur (209 ; 306 ; 500) reçoit des messages respectifs provenant des premier et second dispositifs de communication sans fil à peu près au même moment ;

- la similarité des premier et second signaux comprend la similarité des sons reçus par les premier et second dispositifs de communication sans fil respectifs ;

- la similarité des premier et second signaux comprend la similarité des images capturées par les premier et second dispositifs de communication sans fil respectifs ; et

- la similarité des premier et second signaux comprend la similarité des propriétés physiques respectives mesurées par les premier et second dispositifs de communication sans fil respectifs.


 
11. Procédé selon la revendication 9, comprenant en outre le calcul de façon automatique de la valeur de seuil, sur la base d'un certain nombre de dispositifs de communication sans fil se trouvant physiquement à proximité du premier dispositif de communication sans fil (101 ; 201 ; 301).
 
12. Procédé selon la revendication 8 comprenant en outre :

- la réception, au niveau du premier dispositif de communication sans fil (101 ; 201 ; 301), d'une troisième entrée d'utilisateur comportant des informations sur le second dispositif de communication sans fil (103 ; 203 ; 303) ; et dans lequel

- l'association du premier au second dispositif de communication sans fil comprend l'association du premier au second dispositif de communication sans fil, sur la base des informations reçues sur le second dispositif de communication sans fil.


 
13. Procédé selon la revendication 8, dans lequel la génération de façon automatique (618) du premier message d'utilisateur traduit comprend la traduction du premier message d'utilisateur dans la seconde langue naturelle par le serveur (209 ; 306 ; 500).
 
14. Procédé selon la revendication 1, dans lequel la première entrée d'utilisateur indiquant la volonté de participer à une session de communication translinguistique comprend au moins l'un des éléments suivants :

- une pression sur un bouton ;

- des données indiquant l'orientation du premier dispositif de communication sans fil (101 ; 201 ; 301) ; et

- des données indiquant l'accélération du premier dispositif de communication sans fil (101 ; 201 ; 301).


 




Drawing




















Cited references

REFERENCES CITED IN THE DESCRIPTION



This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

Patent documents cited in the description