(19)
(11)EP 3 324 581 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
04.11.2020 Bulletin 2020/45

(21)Application number: 16842321.8

(22)Date of filing:  01.09.2016
(51)International Patent Classification (IPC): 
G06F 3/0488(2013.01)
G06F 40/137(2020.01)
G06F 40/30(2020.01)
H04L 12/58(2006.01)
G06F 3/0481(2013.01)
G06F 40/295(2020.01)
G06F 40/56(2020.01)
(86)International application number:
PCT/KR2016/009796
(87)International publication number:
WO 2017/039355 (09.03.2017 Gazette  2017/10)

(54)

ANSWER MESSAGE RECOMMENDATION METHOD AND DEVICE THEREFOR

ANTWORTNACHRICHTENEMPFEHLUNGSVERFAHREN UND VORRICHTUNG DAFÜR

PROCÉDÉ DE RECOMMANDATION DE MESSAGE DE RÉPONSE ET DISPOSITIF ASSOCIÉ


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 01.09.2015 KR 20150123491
16.08.2016 KR 20160103550

(43)Date of publication of application:
23.05.2018 Bulletin 2018/21

(60)Divisional application:
20192717.5

(73)Proprietor: Samsung Electronics Co., Ltd.
Suwon-si, Gyeonggi-do 16677 (KR)

(72)Inventors:
  • YU, Seung-hak
    Yongin-si Gyeonggi-do 17084 (KR)
  • KO, Eun-jeong
    Seoul 06501 (KR)
  • KIM, Deok-ho
    Seoul 06762 (KR)
  • LEE, Hae-jun
    Suwon-si Gyeonggi-do 16513 (KR)

(74)Representative: Gulde & Partner 
Patent- und Rechtsanwaltskanzlei mbB Wallstraße 58/59
10179 Berlin
10179 Berlin (DE)


(56)References cited: : 
WO-A1-2015/073565
CN-A- 103 079 008
KR-A- 20140 122 801
US-A1- 2010 332 218
US-A1- 2014 344 749
WO-A1-2015/102125
KR-A- 20140 026 932
KR-A- 20150 055 448
US-A1- 2013 297 317
US-A1- 2015 113 435
  
      
    Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


    Description

    Field of the Invention



    [0001] Devices and methods consistent with what is disclosed herein relate to a method for providing user interface for analyzing a received message and creating an answer message based the analyzed message or a recommendation answer message and a device thereof.

    Description of the Related Art



    [0002] With the development of natural language processing technology, a device analyzes the meaning of a message exchanged between users. The natural language processing technology includes a technique that allows a computer to understand human language, or a technique that expresses information processed by a computer in human language for communication.

    [0003] Following a trend for mobilization and slimming of a device, a use may easily carry around a device, but it becomes increasingly difficult for the user to input letters into a device. Therefore, there is an increasing need to send a correct answer message in response to a received message with minimal input.

    [0004] US 2014/0344749 A1 discloses a mobile terminal which includes a wireless communication unit, a display unit and a controller, wherein the display unit is configured to display a first content including one or more constituent units that contain at least one respective semantic component and the controller is configured to analyze the one or more constituent units and respective semantic components. Furthermore, the controller is configured to display icons corresponding to the respective constituent units of the first content and to display text related to the content on the display unit responsive to a touch input applied to an icon from among the icons corresponding to the respective constituent units of the first content.

    [0005] US 2013/0297317 A1 discloses a method for offering suggestion during conversation comprising the steps of: listening to a conversation on a first electronic device and a second electronic device; determining whether the conversation satisfies a recommendation criterion; determining whether at least one suggestion information exists in a database if the conversation satisfies the recommendation criterion; and displaying at least one suggestion option related to the at least one suggestion information on the first electronic device if the at least one suggestion information exists in the database.

    SUMMARY



    [0006] The invention is defined by the independent claims. Further aspects of the invention are outlined in the dependent claims. Embodiments which do not fall within the scope of the claims do not describe part of the present invention. An aspect of the embodiments relates to a user interface required for creating an answer message and an answer message recommendation method.

    [0007] According to an embodiment, there is provided a device for transmitting an answer message including a display configured to display information, a communicator configured to receive a question message from another device, a processor configured to analyze the question message and to control the display to display graphics representing a plurality of pieces of recommendation information which are includable in an answer message for the received question message and relations between the plurality of pieces of recommendation information, wherein the graphics representing the plurality of pieces of recommendation information are indicated by nodes and the relations between the plurality of pieces of recommendation information have a tree structure or a radial structure with at least two levels, and a user input unit configured to receive a user input that selects at least one of the plurality of pieces of recommendation information, wherein the processor is further configured to, when the at least one of the plurality of pieces of recommendation information is selected by the user, generate an answer message including the selected recommendation information, wherein the communicator is further configured to transmit the generated answer message including the selected recommendation information to the another device according to the user input, wherein the plurality of pieces of recommendation information are connected to one another based on weight values regarding at least one attribute among preference, importance, location, time and atmosphere of the plurality of pieces of recommendation information.

    [0008] The graphics representing the relations between the plurality of pieces of recommendation information have a tree structure or a radial structure.

    [0009] The plurality of pieces of recommendation information is connected to one another based on weight values regarding at least one attribute among preference, importance, location, time and atmosphere of the plurality of pieces of recommendation information.

    [0010] The plurality of pieces of recommendation information may be generated based on a content registered by a user.

    [0011] The plurality of pieces of recommendation information may be generated based on tag information and importance of the registered content.

    [0012] The plurality of pieces of recommendation information may be generated based on data retrieved, captured, photographed or noted by a user.

    [0013] In response to the plurality of pieces of recommendation information being images, the answer message may include a keyword obtained from at least one image selected from the images.

    [0014] In response to the plurality of pieces of recommendation information being images, the answer message may include at least one image selected from the images.

    [0015] In response to receiving a second question message from yet another device while the question message received from the another device is displayed on a dialog window, the processor may be further configured to control the display to automatically display identification information of the yet another device on an input field of the dialog window according to a user input that inputs tag information on the input field of the dialog window.

    [0016] In response to receiving a second question message from yet another device while the question message received from the another device is displayed on a dialog window, the communicator may be further configured to transmit a second answer message to the yet another device according to an user input that inputs tag information, identification information of the yet another device, and the second answer message for the second question message on an input field of the dialog window.

    [0017] According to an embodiment, there is provided a method for transmitting an answer message of a device that transmits an answer message including receiving a question message from another device, analyzing the question message, displaying graphics representing a plurality of pieces of recommendation information which are includable in an answer message for the received question message and relations between the plurality of pieces of recommendation information, wherein the graphics representing the plurality of recommendation information are indicated by nodes and the relations between the plurality of pieces of recommendation information have a tree structure or a radial structure with at least two levels, and in response to a user input that selects at least one of the plurality of pieces of recommendation information, generating an answer message including the selected recommendation information and transmitting the generated answer message including the selected recommendation information to the another device, wherein the plurality of pieces of recommendation information are connected to one another based on weight values regarding at least one attribute among preference, importance, location, time and atmosphere of the plurality of pieces of recommendation information.

    [0018] According to an embodiment, a device provides a user interface for inputting an answer message as receiving a message from another device.

    BRIEF DESCRIPTION OF THE DRAWINGS



    [0019] 

    FIGS. 1A and 1B are views provided to explain a method for providing necessary information for a user to input an answer message by a device in response to receiving a message according to an embodiment of the present disclosure;

    FIG. 2 is a schematic block diagram illustrating a device according to an embodiment of the present disclosure;

    FIG. 3 is a view illustrating an engine that generates an answer message according to an embodiment of the present disclosure;

    FIG. 4 is a view provided to explain a process of generating keywords from an image according to an embodiment of the present disclosure;

    FIGS. 5A to 5C are views illustrating recommendation information and relations between the recommendation information according to an embodiment of the present disclosure;

    FIGS. 6A and 6B are views illustrating recommendation information for an answer message according to an embodiment of the present disclosure;

    FIG. 7 is a view illustrating recommendation information for an answer message according to another embodiment of the present disclosure;

    FIGS. 8A and 8B are views illustrating recommendation information for an answer message according to another embodiment of the present disclosure;

    FIGS. 9A and 9B are views illustrating relations between recommendation information according to an embodiment of the present disclosure;

    FIGS. 10A to 10C are flowcharts provided to explain a method for providing a recommendation answer message by using a communication device and a wearable device according to an embodiment of the present disclosure;

    FIGS. 11A and 11B are views illustrating a process of determining data to be used for generating an answer message according to an embodiment of the present disclosure;

    FIGS. 12A and 13B are concept views provided to explain a process of providing an answer message according to another embodiment of the present disclosure;

    FIGS. 14A to 15D are views illustrating screens for providing images as recommendation information according to another embodiment of the present disclosure;

    FIGS. 16A to 16D are views illustrating screens for providing an answer message to a plurality of devices according to another embodiment of the present disclosure;

    FIG. 17 is a block diagram illustrating configuration of a device according to another embodiment of the present disclosure;

    FIG. 18 is a view illustrating a system for controlling an external device by using recommendation information according to another embodiment of the present disclosure;

    FIGS. 19 and 20 are in-use views provided to explain a method for controlling an external device by using recommendation information according to an embodiment of the present disclosure; and

    FIGS. 21 to 24 are flowcharts provided to explain a method for providing recommendation information which is includable in an answer message by a device according to an embodiment of the present disclosure.


    DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS



    [0020] Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood, however, that it is not intended to limit the techniques described in this disclosure to the specific embodiments, but includes various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. Like reference numerals in the drawings denote like elements.

    [0021] It will be further understood that terms such as "including", "including", "including", "having," etc., are intended to indicate the existence of the features (e.g. numbers, function, operations, components, or the like) disclosed in the specification, and are not intended to preclude the possibility that one or more other features may exist or may be added.

    [0022] In an embodiment, the expressions "A or B," "at least one of A and/or B," or "one or more of A and/or B," and the like include all possible combinations of the listed components. For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) at least one B, and (3) at least one A and at least one B.

    [0023] The term such as "first" and "second" used in various example embodiments may modify various elements regardless of an order and/or importance of the corresponding elements, and does not limit the corresponding elements.

    [0024] When it is mentioned that any element (e.g., a first element) may be "operatively or communicatively coupled with/to" another element (e.g., a second element), it is to be understood that any such element may be directly connected to the other element or may be connected via another element (e.g., a third element) . On the other hand, when it is mentioned that an element (e.g., a first element) is "directly connected" or "directly contacted" to another element (e.g., a second element), it can be understood that there is no other element (e.g., a third element) between the element and another element.

    [0025] The phrase "configured to" as used in an embodiment can be replaced by "suitable for", "having the capacity to", "designed to", "adapted to", "made to" or " capable of". The "configured to" may not necessarily mean "specifically designed to" in hardware. Instead, in some circumstances, the expression "a device configured to" may mean that the device is "capable of ∼" with other devices or components. For example, the expression "a sub-processor configured to execute A, B, and C" may be implemented as a processor dedicated to performing the operation (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or an application processor) that perform the corresponding operations by executing one or more software programs stored in a memory device.

    [0026] The terms used in an embodiment are used only to describe certain embodiments and may not be intended to limit the scope of other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art having the benefit of the present disclosure. General predefined terms used in the present disclosure may be interpreted in the same or similar sense as the contextual meanings of the related art and, unless explicitly defined in the present disclosure, include ideally or in excessively formal sense. Optionally, terms defined in the present disclosure cannot be construed to exclude embodiments of the present disclosure.

    [0027] FIGS. 1A and 1B are views provided to explain a method for providing necessary information for a user to input an answer message by a device 100 in response to receiving a message according to an embodiment of the present disclosure.

    [0028] Referring to (a) of FIG. 1A, the device 100 may provide a user interface required for inputting an answer message in response to receiving a message from another device.

    [0029] For example, in response to receiving a message "where shall we meet?", the device 100 may display an answer message for the received message. For example, in response to receiving the message "where shall we meet?", the device 100 may analyze that a sender intends to ask about a place to meet and recommend candidate messages for answering such as "I do not know 102", "well", "why?", "anywhere", or the like.

    [0030] The device 100 may provide a user interface 10 "view recommendation information" for providing recommendation information to be included in an answer message. The device 100 may receive a user input that selects the user interface 10 "view recommendation information".

    [0031] As shown in (b) of FIG. 1A, according to the user input that selects the user interface 10, the device 100 may display graphics 112,113,114,115 and 116 representing a plurality of pieces of recommendation information 101,102,103,104,105 and 106 which are includable in an answer message and relations between the plurality of pieces of recommendation information. The graphics may have a tree structure, and the examples of the tree structure include a node structure, a hierarchy structure, and the like.

    [0032] According to a user input that selects a recommendation information "food talk" 105 as one of the plurality of pieces of recommendation information 101 to 106, As shown in (c) of FIG. 1B, the device 100 may generate an answer message "let's go to a hot place near Gangnam station on the Wednesday food talk 11" including the recommendation information 105 selected by the user. For another example, the device 100 may generate an answer message including part of the recommendation information 105 selected by the user. For example, the device 100 may generate an answer message including "Wednesfood", "Wednesday food", etc. which are abbreviations of "Wednesday food talk".

    [0033] According to a user input that selects the answer message 11, as shown in (d) of FIG. 1B, the device 100 may display the answer message 11 on a message input window.

    [0034] According to a user input that selects a send button 30, the device 100 may transmit the answer message 11 displayed on the message input window to another device.

    [0035] Displaying graphics representing the recommendation information and the relations between the recommendation information may enhance visibility of a user that generates an answer message and the ease of retrieval may be enhanced.

    [0036] FIG. 2 is a schematic block diagram illustrating a device according to an embodiment of the present disclosure.

    [0037] As shown in FIG. 2, the device 100 according to an embodiment may include a communicator 130, a user input unit 145, a display 110 and a processor 170. However, all the illustrated elements are not essential. The device 100 may be embodied with more or less than the illustrated elements.

    [0038] In addition, an engine 200 shown in FIG. 3 may be embodied with the elements shown in FIG. 2. For example, the engine 200 shown in FIG. 3 may be embodied when a program stored in a memory (not shown) is executed by the processor 170.

    [0039] The communicator 130 may receive a message from another device. The communicator 130 may transmit an answer message to another device.

    [0040] The processor 170 may determine a plurality of pieces of recommendation information which are includable in an answer message for the received question message and relations between the plurality of pieces of recommendation information.

    [0041] The display 110 may display the plurality of pieces of recommendation information to be included in the answer message for the received question message, which are determined by the processor 170, and the relations between the plurality of pieces of recommendation information.

    [0042] The user input unit 145 may receive a user input that selects information to be included in an answer message. The user input unit 145 may receive a user input that selects a menu. According to the user input that selects the menu, the processor 170 may execute a function corresponding to the selected menu.

    [0043] FIG. 3 is a view illustrating an engine that generates an answer message according to an embodiment of the present disclosure.

    [0044] The device 100 may include the engine 200 that generates an answer message.

    [0045] Referring to FIG. 3, the engine 200 that generates an answer message may include a message analyzer module 210 for determining the sender's intention of the received message and a candidate reply generator module 230 for generating a recommendation answer message based on the analyzed sender's intention.

    [0046] The message analyzer module 210 may determine the sender's intention of the received message. The message analyzer module 210 may include a normalize module 121, a morphologic/syntactic analyzer module 214 and a semantic analyzer module 216.

    [0047] The normalize module 212 may restore slangs or abbreviations included in the received message into standard words.

    [0048] The normalize module 212 may restore slangs or abbreviations into standard words based on a predetermined formula. Based on the dictionary containing the slangs or abbreviations matched with the standard words, the normalize module 212 may restore the slangs or abbreviations included in the message into the standard words. The dictionary containing the slangs or abbreviations matched with the standard words may be shown as table 1 below.
    [Table 1]
    Slang/abbreviation - standard wordstandard wordfrequency


     


     
    87


     


     
    81


     


     
    77


     


     
    71


     


     
    53


     


     
    52


     


     
    47


     


     
    42


     


     
    37


     


     
    35


     


     
    33


     


     
    30


     


     
    28


     


     
    27


     


     
    23


     


     
    22


     


     
    21


     


     
    21


     


     
    20


     


     
    20


     


     
    20


    [0049] For example, in response to receiving a message "lol it is freaking funny", the normalize module 212 may determine "lol" and "freaking" as slang and change the "lol" into an exclamation "ah" and the "freaking" into "really". For example, in response to receiving a message "Gil-dong, where shall we meet for dinner L8ER? lol", the normalize module 212 may determine "L8ER" as a non-grammatical word and change the "L8ER" to "later".

    [0050] In addition, the device 100 may store the words, the expressions, or the way of talking in the messages exchanged between the message sender and the user corresponding to the message sender. Accordingly, the normalize module 212 may restore the slangs and abbreviations included in the received message into the standard words based on the words, the expressions, or the way of talking included in the messages exchanged between the message sender and the user.

    [0051] In addition, the normalize module 212 may analyze conversations the user had with an acquaintance in the past and store the words, the way of talking, the expressions of the acquaintance. Accordingly, the normalize module 212 may restore the slangs and abbreviations included in the text message sent from a message sender into the standard words based on the words, the expressions, or the way of talking of the message sender.

    [0052] The morphologic/syntactic analyzer module 214 may determine morphemes contained in a message and sentence components of the determined morphemes.

    [0053] For example, the morphologic/syntactic analyzer module 214 may determine morphemes "meeting" "now" "come to" "please" included in a message "please come to the meeting now". The morphologic/syntactic analyzer module 214 may determine sentence component "now" as adverb, "come" as descriptive word, and "please" as honorific form.

    [0054] The morphologic/syntactic analyzer module 214 may determine the verb, the sender's intention of the received message and the presence of the honorific form in the message based on the determined sentence components. For example, the morphologic/syntactic analyzer module 214 may determine "come to" as the verb contained in the message "please come to the meeting now", the sender's intention of the received message as an order to come to the meeting, and the received message as the message in the honorific form.

    [0055] The semantic analyzer module 216 may determine the named entity, the sender's intention, the presence of the honorific form and the emotion of the sender based on the morphemes and sentence components analyzed by the morphologic/syntactic analyzer module 214 and determine a response type.

    [0056] The semantic analyzer module 216 may include a named entity recognizer module 216A, an intention recognizer module 216B, a honorific recognizer 216C, an emotion recognizer 216D, and a reply type determiner 216E.

    [0057] The named entity recognizer module 216A may recognize the named entity contained in the received message. The named entity may refer to a noun or a number that has a unique meaning in the document. The named entity name may be categorized into name expression such as a person name, a place name, an organization name, etc., time expression such as date or time and numeral expression such as amount or percentage. The named entity recognition may refer to recognizing the named entity included in the message and determining the type of recognized named entity.

    [0058] For example, in response to receiving a message "Mr. Gil-dong, where shall we meet for dinner later?", the named entity recognizer module 216A may recognize "Mr. Gil-dong" and "dinner" as named entities and recognize the "Mr. Gil-dong" as a person name and the "dinner" as a meal in the evening. For example, the named entity recognizer module 216A may determine "Mr. Gil-dong" as a person name based on the phone book stored in the device 100 and if the relationship with the "Mr. Gil-dong" is listed in the phone book, obtain the relationship between the "Mr. Gil-dong" and the user. The named entity recognizer module 216A may determine "dinner" as a meal in the evening based on the pre-stored named entity dictionary.

    [0059] The intention recognizer module 216B may determine the sender's intention expressed in the message. The sender's intention may include greetings, questions, commands, requests, suggestions, emotional expressions or information delivery, but the present disclosure is not limited thereto.

    [0060] The intention recognizer module 216B may determine the sender's intention of the received message based on the analyzed morpheme, entity name, sentence component, or type of word.

    [0061] For example, the intention recognizer module 216B may determine that the sender's intention of the received message is an order if the message is in English and the first word of the message is a "Be" verb or a verb prototype. Also, if the message is in English and the first word of the message includes a word for asking a favor such as "would you" or "please", the intention recognizer module 216B may determine that the sender's intention is a request.

    [0062] If the sender' intention of the received message is a question, the intention recognizer module 216B may determine whether the intention of the received message is a yes or no question, a question for asking to select at least one of a plurality of choices, a question to agree or disagree, or a question for asking one of the Five W's and One H rules (5W1H). For example, if the received message is "Mr. Gil-dong, where shall we meet for a dinner today?", the intention recognizer module 216B may determine that the message is a question for asking about a place in the Five W's and One H rules based on the sentence component "where" of the morphemes of the message and the question mark "?".

    [0063] The intention recognizer module 216B may categorize the sender's intention of the message into a plurality of categories as shown in Table 2, and may classify the categories into a plurality of lower categories.

    [0064] 
    [Table 2]
    The sender's intention
    Level1Level2
    greeting meet
    farewell
    new year
    christmas
      morning
    night
    ask after
    question location
    time
    age
    price
    count
    person
    activity
    confirm
    reason
    simple answer yes_no
    agreement
    command/request/suggest/help move
    work
    meet
    invite
    express emotion irritated
    happy
      surprised
    worried
    sad
    angry
    inform location
    time
    age
    price
    count
    person
    activity
    confirm
    reason
    thanks to user
    to third person
    appologies to user
    to third person
    sympathy condolences
    congratulations
    compliment
    blame to user
    to third person
    complaint to user
    to third person
    call to user
    to third person


    [0065] For example, if it is determined that the sender's intention of the received message is a question, the intention recognizer module 216B may determine which is questioned among of location, time, age, price, the number of times, person, activity, reason by the received message.

    [0066] The honorific recognizer module 216C may determine whether a message is in the honorific form. For example, if the message includes the morpheme in the honorific form such as "please", "would", "could" or the like, the honorific recognizer 216C may determine that the received message is in the honorific form.

    [0067] The emotion recognizer module 216D may recognize the emotion of the sender expressed in the message. The sender's feelings may include happiness, fun, sadness, fear, surprise, anger, or the like, but the present disclosure is not limited thereto.

    [0068] The emotion recognizer module 216D may recognize the emotion of the sender based on the exclamation, slang, or emoticon included in the message. For example, if the received message is "I am late -.,-;" and the emoticon "-.,-'" indicates unhappy, the emotion recognizer module 216D may determine that the emotion of the sender is unhappy.

    [0069] The reply type determiner module 216E may determine the type of received message. For example, the reply type determiner module 216E may determine the type of message based on the sender's intention of the message determined by the intention recognizer module 216B. For example, if the intention of the received message is a yes or no question, an instruction, a request, or a suggestion, the reply type determiner module 216E may determine the type of message as the yes or no question. Further, when the sender's intention of the received message is a question for asking data belonging to a specific category, the reply type determiner module 216E may determine the type of message as a short answer type. The question for asking the data belonging to a specific category may include, for example, a question for asking specific information (e.g. "What is the Hae Jun's number?"), and a question for asking what the sender and the user want to do together, time, place, and way (e.g. "what time shall we meet at night?"). The reply type determiner module 216E may classify the message type into a plurality of categories as shown in Table 3.
    [Table 3]
    Message type
    Level1Level2Level3
    yes no yes n/a
    no n/a
    short answer person relation
        phone number
    job
    age
    location home
    office
    school
    subway
    gps value
    date/time relative
    day of week
    hour
    number count
    date
    activity exercising
    size
    price
    age
    studying
    I working
    relaxing
        cooking
      cleaning
      traveling
      car driving
      watching tv
      breakfast
      lunch
      dinner
      snack
      food bibimbap
      bulgogi
      spaghetti
      risotto
      pizza
      sushi
      ramen
    choose one A or B n/a
    A or B or C n/a
    a plurality of n/a
    custom greeting How_are you
        How_are_you _doing
    What_are_you_doing
    weather Nice_weather
    good-bye Have_a_nice_day
    Have_a_nice_dinner
    Have_a_nice_weekend
    Good_night


    [0070] As shown in Table 3, the message type may include a yes or no type, a short answer type, a type for selecting one of a plurality of given items, etc., and one message type may be classified into a plurality of lower categories. For example, in the case of the short answer type, the short answer type may be classified into a specific person-based answer type, a specific location-based answer type, a specific number-based answer type, and the like. Table 3 is merely an example of an answer type, and the answer type may be designated corresponding to the sender's intention of each received message.

    [0071] The candidate reply generator module 230 may generate at least one recommendation answer message to be provided to the user. The candidate reply generator module 230 may include a reply searcher module 232, a reply sentence generator module 234, and a corpus database 236.

    [0072] The corpus database 236 may store a response intention corresponding to the sender's intention. For example, the corpus database 236 may store positive, negative, and unknown answers as a response intention to the yes or no question. For example, the corpus database 236 may store a suggestion or an advice based on data selected by the user as a response to a question (HOW_WILL_WE_DO_QUESTION) asking about what the sender and the user want to do together, time, place, way, etc.
    [Table 4]
    The sender's intentionThe response intention
    YES_OR_NO_QUESTION ANSWER_POSITIVE
    ANSWER_NEGATIVE
    ANSWER_NOT_SURE
    INFORMATION_QUESTION ANSWER_XX
    ANSER_DO_NOT_KNOW
    HOW_WILL_WE_DO_QUESTION SUGGEST_XX
    LETS_XX
    ANSER_DO_NOT_KNOW
    SUGGESTION ANSWER_AGREE
    ANSWER_DISAGREE
    ANSER_DO_NOT_KNOW
    congratulations ANSWER_THANKYOU
    HAVE_A_NICE_WEEDEND HAVE_A_NICE_WEEDEND


    [0073] The corpus database 236 may store a recommendation answer message corresponding to a response intention. For example, referring to Table 5, the corpus database 236 may be store "have a nice dinner," "enjoy your dinner," and "enjoy your meal" corresponding to the response intention to have a nice dinner (HAVE_A_NICE_DINNER).
    [Table 5]
    Response intention (Corpus ID)The presence of honorific formRecommendation answer message (Corpus)
    HAVE_A_NICE_DINNER Non-honorific form

    .


    .
    Honorific form

    .
    HAVE_A_NICE_WEEDEND Honorific form

    .


    .
    Non-honorific form

    .


     
    ASK_WHO Non-honorific form

     


     
    Honorific form

     
    ANSWER_LOCATION_XX Honorific form XX

    .
    Non-honorific form XX

    .
    X

    SUGGEST_XX Honorific form XX

    Non-honorific form XX



    [0074] The reply searcher module 232 may determine a response intention based on the sender's intention of the received message. For example, the reply searcher module 232 may obtain a response intention corresponding to the sender's intention from the corpus database 236.

    [0075] The reply searcher module 232 may determine the recommendation information selected by the user as the response intention. For example, in response to a receiving a simple question for asking about a place, the reply searcher module 232 may provide a plurality of pieces of selectable recommendation information and determine recommendation information selected by the user as the response intention.

    [0076] For example, when the received message is "Mr. Gil-dong, where shall we meet for a dinner today?", the semantic analyzer module 216 may determine that the sender's intention of the received message is for asking about a place to meet for dinner. When the sender's intention of the message is for asking about a place to meet for dinner, the reply searcher module 232 may display a plurality of places or a map and in response to receiving a user input that selects at least one of the plurality of places or a point of the map, determine a suggestion to meet at the selected place as a response intention.

    [0077] In response to determining at least one response intention, the reply searcher module 232 may obtain a recommendation answer message corresponding to the determined response intention from the corpus database 236. The reply searcher module 232 may determine whether to use the honorific form to the answer message based on the presence of the honorific form in the received message and the relationships between the sender and the user, and if the honorific form is used, the reply searcher module 232 may obtain other recommendation information.

    [0078] The reply sentence generator module 234 may change the obtained recommendation information into the words, the expressions, or the way of talking in the message exchanged between the user and the sender. The device 100 may store the words, the expressions, or the way of talking in the message exchanged between the user and the sender corresponding to the sender. Accordingly, the reply sentence generator module 234 may obtain at least one message corresponding to the response intention and change the words, the expressions, or the way of talking in the obtained message into the words, the expressions, or the way of talking corresponding to the sender.

    [0079] For example, if the user used to add "ooo" to the end of the sentence of the message to be addressed to the sender, and the obtained recommendation answer message is "how about Garosu-gil?", the reply sentence generator module 234 may change "how about the Garosu-gil ?" to "Hooow about the Garosu-gil?".

    [0080] The device 10 may analyze the conversations exchanged between the user and an acquaintance and store the words, the way of talking, and the expression used by the acquaintance. The reply sentence generator module 234 may generate a recommendation answer message according to the words, the way of talking or the expressions of the sender.

    [0081] Accordingly, the device 100 may automatically generate an answer message reflecting intimacy with the sender.

    [0082] A tree generation module 235 may determine a plurality of pieces of recommendation information based on the obtained data and generate relations between the plurality of pieces of recommendation information. For example, the tree generation module 235 may provide a tree structure that represents the relations between the plurality of pieces of recommendation information to the user and transmit at least one of recommendation information selected from the plurality of pieces of recommendation information by the user to the reply searcher module 232. The reply searcher module 232 may determine at least one of recommendation information obtained from the tree generation module 235 as a response intention. In the tree structure, the plurality of pieces of recommendation information may be arranged or grouped based on the information, use frequency, similarity between words of the recommendation information.

    [0083] The tree generation module 235 may collect data required for generating the recommendation information. For example, the tree generation module 235 may collect data from the corpus database 236. The tree generation module 235 may obtain user context from a context framework 300. The tree generation module 235 may collect data from a camera, an application that stores images, a memo application, a web paging application, a message application, etc.

    [0084] The tree generation module 235 may be necessary for generating a plurality of pieces of recommendation information and use data registered by the user. For example, the user may execute a data registration mode (or, an auto thinking mode). In response to the data registration mode being executed, the data retrieved, captured, and noted by the user may be determined to be necessary for generating recommendation information having a high priority. In response to a content is being provided, the user may select a data registration menu and register the content being provided as data necessary for generating recommendation information. The user may register the tag and importance of the content. The example of the case of determining data to be used for recommendation information by a user through a data registration mode will be described in detail with reference to FIGS. 11A and FIG. 11B.

    [0085] The tree generation module 235 may generate keywords based on the collected data. For example, the tree generation module 235 may extract texts from the content, the link information, and the like to generate keywords. The tree generation module 235 may generate keywords using the metadata, the tag or the importance of the content input by the user. When the content is an image or a video, the tree generation module 235 may analyze the image or the video to generate keywords. For example, from an image 401 of FIG. 4, the tree generation module 235 may generate keywords such as the "chicken", "Hongdae area", "outchicken", "chips", "hot place", "spicy chicken', "beer", "chicken and beer", and the like

    [0086] The tree generation module 235 may categorize the generated keywords. The plurality of keywords may be included in the group of a representative keyword. For example, "spicy chicken", "outchicken" and "chicken" may be included a representative keyword group of "chicken".

    [0087] The tree generation module 235 may determine keywords or a representative keyword as recommendation information corresponding to a response intention and provide the recommendation information in a tree structure to the user. For example, a plurality of pieces of recommendation information may correspond to respective nodes in a node structure.

    [0088] FIGS. 5A to 5C are views illustrating recommendation information and relations between the recommendation information according to an embodiment of the present disclosure.

    [0089] Referring to FIG. 5A, the tree generation module 235 may classify recommendation information according to specific objects or conditions required for an event and a purpose and define relations between the recommendation information. For example, the recommendation information may be classified into categories of "date", "family", or "travel destination" depending on the purpose. In this case, the recommendation information related to "date" may be, for example, "movie", "activity" and "hot place". The "hot place' may relate to other recommendation information such as "Gangnam", "formal', or the like. In addition, other recommendation information may continue to relate to another recommendation information. For example, "Gangnam" may further have a relationship with "food talk hot place".

    [0090] The plurality of pieces of recommendation information may be linked to one another based on weight values regarding various attributes such as at least one of preference, importance, location, time, and atmosphere of the plurality of pieces of recommendation information. For example, "movie", "hot place A", and "travel" associated with "date" may be connected to one another based on a preference weight (e.g. good for (w)). In addition, the "hot place A" may be connected to the "Gangnam" based on a location weight (e.g. located in (w)). In addition, the "formal" may be connected to the "hot place A" based on an equality/inclusion weight (e.g. is a (w)). In addition, the "food talk hot place" may be connected to the "Gangnam" based on the location weight and the equality/inclusion weight.

    [0091] The recommendation information may be grouped by category, and the representative recommendation information may be defined as a node of the tree structure. For example, the representative recommendation information may be a "hot place", which is the representative of "hot place A", " hot place B" and "hot place C". The representative recommendation information may be "movie", "sports", and "travel", which are representative keywords in the specific field.

    [0092] The tree generation module 235 may determine recommendation information having a high weight relating to the sender based on the sender's intention of the received message.

    [0093] For example, in FIG. 5B, when the sender is "person B", the tree generation module 235 may obtain "date" as recommendation information having a high weight relating to the "person B". The tree generation module 235 may obtain "hot place A" as recommendation information having a high weight relating to the "date" and obtain "Gangnam" as recommendation information having a high weight relating to the "hot place A".

    [0094] Referring to FIG. 5C, the recommendation information based on the sender's intention of the "person B" may be provided in the form of tree structure. For example, the recommendation information and the relations between the recommendation information may be indicated by nodes and arrows connecting the nodes as shown in FIG. 5C, but the present disclosure is not limited thereto. The relations between the recommendation information may be provided in various structures.

    [0095] Based on the recommendation information and the relations between the recommendation information, when a user determine at least one recommendation information, the tree generation module 235 may transmit the determined recommendation information to the reply searcher module 232. The reply searcher module 232 may determine the received recommendation information as a response intention.

    [0096] Referring to FIG. 3, the device 100 may include the context framework 300.

    [0097] The context framework 300 may obtain the context of the user at the particular period of time. Examples of the context of the user may include the time, day, date, schedule of the user, location of the user, activity of the user, but the present disclosure is not limited thereto. For example, the context framework 300 may obtain the schedule information of the user at the particular period of time based on the schedule information of the user which is stored in the device 100. The context framework 300 may obtain the location information of the user by using a location sensor (e.g. GPS) provided in the device 100. The context framework 300 may detect the activity of the user by using a camera, a position sensor or a motion sensor provided in the device 100.

    [0098] The candidate reply generator module 230 may determine a recommendation answer message based on the sender's intention of the received message and the context of the user obtained through the context framework 300.

    [0099] For example, the reply searcher module 232 may obtain the context of the user from the context framework 300. The reply searcher module 232 may determine a recommendation answer message based on the sender's intention and the obtained context of the user.

    [0100] The corpus database 236 may store the sender's intention and a response intention corresponding to the context. For example, as shown in FIG. 6, at least on answer intonation corresponding to the sender's intention and the context may be stored.
    [Table 6]
    Type of the received messageContextResponse intention
    Send er's intenti on (Iv1)Send er's intenti on (Iv2)Mess age type (Iv1)Messag e type (Iv2)The presence of honorific formTimeDateContact registrati on 
    Greeti ng Night custo m Good_ night Honorific form Evenin 9 Monda y Register ed HAVE_A_NIC E_DINNER
    Greeti ng Night custo m Good_ night Non-honorific form Evenin 9 Friday Register ed HAVE_A_NIC E_WEEDEND
    Greeti ng Night custo m Good_ night Non-honorific form Evenin g Tuesda y Non-registere d ASK_WHOHA VE_A_NICE_ DINNER
    Quest Locati Short Locatio Honorific Noon/af Wedne Register ANSWER_LO
    ion on Answ er n form ternoon sday ed CATION_OFF ICE ANSWER_LO CATION_HO ME
    Quest ion Locati on Short Answ er Locatio n Non-honorific form Night Thursd ay Register ed ANSWER_LO CATION_ HOMEANSW ER_LOCATIO N_OFFICE


    [0101] Accordingly, the reply searcher module 232 may obtain a response intention corresponding to the sender's intention and the context.

    [0102] For example, in response to receiving a message "good evening" at night, the reply searcher module 232 may determine whether the time when the message was received, the day when the message was received, and the contact information of the sender are stored in the device 100. The reply searcher module 232 may determine that the intention of the message "good evening" as a greeting at night, the time when the message was received as evening, the day when the message was received as Wednesday, and the contact information of the sender as being stored in the device 100. Accordingly, the reply searcher module 232 may obtain a response intention to have a nice dinner (HAVE_A_NICE_DINNER) from the corpus database 236 corresponding to the case where the intention of the sender is a greeting at night, the context is Wednesday evening, and the contact information of the sender is stored in the device 100.

    [0103] Accordingly, the device 100 may provide a different recommendation answer message depending on the context of the user although the same message is received.

    [0104] The corpus database 236 may store a different recommendation answer message depending on whether the horrific form is used and whether the contact information of the sender is stored in the device 100 in addition to the sender's intention and the context of the user.

    [0105] The reply searcher module 232 may determine a relationship between the sender and the user based on the presence of the telephone number of the sender in the device 100 and the name corresponding to the telephone number of the sender. For example, when the name corresponding to the telephone number stored in the device 100 is "mommy" or "mom", the reply searcher module 232 may determine that the sender is the user's mother. The reply searcher module 232 may determine the relationship between the sender and the user based on the contact information group including the telephone number of the sender. The examples of the contact information group may include family, company, school, social club, and the like.

    [0106] The reply searcher module 232 may determine whether to use the horrific form in the answer message based on the relationship between the sender and the user. Accordingly, the reply searcher module 232 may determine a recommendation answer message based on the relationship between the sender and the user in addition to the sender's intention and the context of the user.

    [0107] For example, the device 100 may receive a message "what are you doing?' at 9:30 am, on March 30, 2015 from the user's mother. In response to the message, the device 100 may determine one of the messages "why?", "I am working", "I am busy right now", "what happened?" and "I don't know" in the honorific form as a recommendation answer message.

    [0108] In response to receiving the same message at the same time from a guy at the blind date, the reply searcher module 232 may determine one of the messages "why?", "I am working", "I am busy right now", "what happened?" and "I don't know", as a recommendation answer message.

    [0109] FIGS. 6A and 6B are views illustrating recommendation information for an answer message according to an embodiment of the present disclosure.

    [0110] Referring to (a) of FIG. 6A, the device 100 may be a wearable watch. The communicator 130 may receive a message "where shall we meet?". In response to the received message, the user input unit 145 may receive a user input that selects an ok button 601.

    [0111] In response to receiving a user input, as shown in FIG. (b-1) or (b-2) of FIG. 6A, the processor 170 may display the display 110 to display a plurality of user interfaces 602, 603 and 604 for determining an answer message.

    [0112] According to an embodiment, as shown in (b-1) of FIG. 6A, the processor 170 may divide a screen area into a central area and outer areas and control the display 110 to display the received message on the central area and the plurality of user interfaces 602, 603 and 604 on the outer areas.

    [0113] The processor 170 may control the display 110 to display the user interface 602 "well" as a recommendation answer message for the received message.

    [0114] When the sender's intention of the message is to ask about a place, the processor 170 may control the display 110 to display the user interface 603 for the user to select a place.

    [0115] The processor 170 may control the display 110 to display the user interface 604 to show the recommendation information.

    [0116] A whirl may be provided in a bezel area of the device 100. The processor 170 may control the display 110 to display the user interface selected by the user to be differentiated from the interface of another user. For example, the processor 170 may control the display 110 so that the selected user interface has a different color or pattern from another area.

    [0117] In response to a user input that rolls the whirl of the device 100, the processor 170 may sequentially select the user interfaces 602,603 and 604 in a direction of rolling the whirl. In response to receiving a user input that rolls the whirl at a predetermined angle or more, the processor 170 may control the display 110 to remove the displayed user interface and display a new user interface.

    [0118] According to another embodiment, as shown in (b-2) of FIG. 6A, the processor 170 may display the display 110 so that a screen is divided into a plurality of areas by lines or colors, the received message is displayed on the top area of the plurality of areas, and the plurality of interfaces 602,603 and 604 are displayed on the bottom area.

    [0119] In response to receiving a user input that rolls the whirl, the processor 170 may sequentially select the user interfaces 602,603 and 604 in the direction of rolling the whirl. In response to a user input that rolls a whirl at a predetermined angle or more, the processor 170 may control the display to remove the displayed user interface and to display a new user interface while being scrolled.

    [0120] In (b-1) or (b-2) of FIG. 6A, the user input unit 145 may receive a user input that selects the user interface 604 for showing the recommendation information.

    [0121] As shown in (b-1) or (b-2) of FIG. 6A, according to the user input that selects the user interface 604 for showing recommendation information, as shown in (c) of FIG. 6B, the processor 170 may control the display 110 to display graphics representing recommendation information and relations between the recommendation information. In this case, the recommendation information may be indicated by the nodes, and the relations between the recommendation information may be indicated by arrows connecting the nodes. Specifically, when a sending message is "where shall we meet?", the processor 170 may generate recommendation information based on the sender's intention of the sending message. The recommendation information may be linked in the order of "sender", "date", "hot place", "ever been", "Hongdae area", "chicken" and "cold noodle". The user may select one of recommendation information from the plurality of pieces of recommendation information. In (c) of FIG. 6, the user input unit 145 may receive a user input that selects "chicken 611".

    [0122] Receiving a user input, as shown in (d) of FIG. 6B, the processor 170 may generate an answer message including recommendation information and control the display 110 to display the generated answer message. For example, the processor 170 may generate a sending message "Do you want to eat chicken?" using recommendation information "chicken". The processor 170 may generate an answer message using not only the recommendation information selected by the user but also other recommendation information linked to the recommendation information. For example, various types of answer messages having a response intention corresponding to the sender's intention may be generated by the operation of each module of the engine 200 of FIG. 3.

    [0123] Although not shown, various types of answer messages using the recommendation information may be generated and displayed. In response to a user input that selects one of a plurality of answer messages, the processor 170 may determine the selected answer message as a message to be transmitted to the sender.

    [0124] FIG. 7 is a view illustrating recommendation information for an answer message according to another embodiment of the present disclosure.

    [0125] In (b-1) or (b-2) of FIG. 6A, in response to a user input that selects the user interface 604 for showing the recommendation information, as shown in (a) of FIG. 7, the processor 170 may control the display 110 to display graphics representing recommendation information and relations between the recommendation information. The user input unit 145 may receive a user input that selects plural recommend information "food talk 711" and "chicken 611". The user input that selects the plurality of pieces of recommendation information may be made sequentially, simultaneously or within a predetermined time (e.g. within a one second) using multi-touch gesture, etc.

    [0126] As shown in (b) of FIG. 7, according to a user input, the processor 170 may generate an answer message including the plurality of pieces of recommendation information and control the display 110 to display the generated answer message. For example, the processor 170 may generate an answer message "shall we go to the chicken restaurant on the food talk?" based on the recommendation information "chicken 611" and "food talk 711". The processor 170 may generate an answer message by using not only the recommendation information selected by the user but also other recommendation information linked to the recommendation information. For example, various types of the answer messages having a response intention corresponding to the sender's intention may be generated by the operation of each module of the engine 200 of FIG. 3.

    [0127] Although not shown, various types of answer messages using the plurality of pieces of recommendation information may be generated and displayed. According to the user input that selects one of the plurality of answer messages, the processor 170 may determine the selected answer message as a message to be transmitted to the sender.

    [0128] FIGS. 8A and 8B are views illustrating recommendation information for an answer message according to another embodiment of the present disclosure.

    [0129] As shown in (b-1) or (b-2) of FIG. 6A, in response to a user input that selects the user interface 604 for showing the recommendation information, as shown in (a) of FIG. 8A, the processor 170 may control the display 110 to display graphics representing recommendation information and relations between the recommendation information. The user input unit 145 may receive a user input that selects "date 801". The user input may be for different recommendation information connected to the "date 801". Accordingly, a user input that determines the "date 801" as the recommendation information and a user input that represents other recommendation information connected to the "date 801" may be different from each other. For example, a user input that determines the "date 801" as recommendation information may be a tab gesture, and a user input that represents other recommendation information connected to the "date 801" may be a touch and hold gesture.

    [0130] Referring to (b) of FIG. 8A, according to a user input, the processor 170 may control the display 110 to display first recommendation information connected to the "date 801" and relations between the first recommendation information on the basis of the "date 801". In response that there are other pieces of recommendation information on the basis of the "date 801", the processor 170 may control the display 110 to display a user interface 811 for showing another recommendation information. The processor 170 may receive a user input that selects the user interface 811.

    [0131] Referring to (c) of FIG. 8B, according to a user input, the processor 170 may control the display 110 to display graphics representing second recommendation information connected to the "date 801" and relations between the second recommendation information on the basis of the "date 801". The user input unit 145 may receive a user input that selects "bicycle 821" as one of the second recommendation information.

    [0132] According to a user input, the processor 170 may generate an answer message including the "bicycle 821" and control the display 110 to display the generated answer message.

    [0133] Referring to (c) of FIG. 8B, according to a user input that selects a user interface 812, the processor 170 may control the display 110 to display graphics representing other recommendation information and relations between the other recommendation information on the basis of the "date 801". When other recommendation information based on "date 801" is not longer present, the processor 170 may control the display 110 to display the screen that reverts to the screen of (b) of FIG. 8A.

    [0134] FIGS. 9A and 9B are views illustrating relations between recommendation information according to an embodiment of the present disclosure.

    [0135] The recommendation information and the relations between the recommendation information may be displayed in various forms. For example, the recommendation information and the relations between the recommendation information may be displayed in the form of a tree structure including nodes and arrows as described above. Alternatively, as shown in FIGS. 9A and 9B, other recommendation information linked to one recommendation information may be displayed in a radial form around the center of the one recommendation information. The relations between the recommendation information may be indicated by arrows or lines as shown in (a) of FIG. 9A, or alternatively, the relations between recommendation information may be displayed by positions where the pieces of recommendation information are displayed without arrows or lines. For example, in (b) of FIG. 9AB, the plural pieces of recommendation information adjacent to one piece of the recommendation information may be regarded to be relevant to the one piece of recommendation information.

    [0136] Alternatively, recommendation information and the relations between the recommendation information may be defined with reference to the positions of the divided areas as shown in (c) of FIG. 9. For example, when the screen is divided into a plurality of areas, the information at the center of the screen may become a reference information as being toward the central area of the screen, and a recommendation information having relations with a plurality of pieces of recommendation information may be displayed. Other recommendation information branched from the recommendation information at the center of the screen may be displayed as being toward the outer area of the screen.

    [0137] FIGS. 10A to 10C are flowcharts provided to explain a method for providing a recommendation answer message by using a communication device and a wearable device according to an embodiment of the present disclosure.

    [0138] A communication device 100A and a wearable device 100B may include at least one element of the engine 200 of FIG. 2. For example, the elements of the engine 200 of FIG. 2 may belong to either the communication device 100A or the wearable device 100B. The wearable device 100B may be disposed outside the communication device 100A and refer to the device 100 attached to part of the body of the user. The wearable device 100B may perform long-distance wireless communication in addition to short-distance wireless communication. The communication device 100A and the wearable device 100B may be connected via short-distance wireless communication. For example, the communication device 100A and the wearable device 100B may be paired via Bluetooth. Accordingly, when the wearable device 100B and the communication device 100A are located within a reference distance, the communication device 100A and the wearable device 100B may be automatically connected via short-distance wireless communication.

    [0139] According to an embodiment, at step S1001 of FIG. 10A, the communication device 100A may receive a message.

    [0140] As step S1003, the communication device 100A may determine a sender's intention of the received message or a message type, and based on the determined sender's intention or the message type, determine at least one recommendation answer message. The communication device 100A may store the elements shown in FIG. 2.

    [0141] At step S1005, the communication device 100A may transmit at least one determined recommendation answer message to the wearable device 100B.

    [0142] At step S1007, the wearable device 100B may display the received recommendation answer message. The wearable device 100B may display a user interface for showing recommendation information necessary for generating an answer message.

    [0143] At step S1009, in response to the user interface for showing the recommendation information being selected by a user, the wearable device 100B may transmit information indicating that the user interface for showing the recommendation information is selected to the communication device 100A.

    [0144] At step S1011, the communication device 100A may determine a plurality of piece of recommendation information and relations between the plurality of piece of recommendation information.

    [0145] At step S1013, the communication device 100A may transmit information indicating the plurality of piece of recommendation information and the relations between the plurality of piece of recommendation information to the wearable device 100B.

    [0146] At step S1015, the wearable device 100B may display graphics representing the plurality of piece of recommendation information and the relations between the plurality of piece of recommendation information.

    [0147] As step S1017, in response to one of the plurality of piece of recommendation information being selected by the user, the wearable device 100B may transmit the selected recommendation information to the communication device 100A.

    [0148] At step S1019, the communication device 100A may generate an answer message including recommendation information based on the selected recommendation information, the sender's intention and the message type.

    [0149] At step S1021, the communication device 100A may transmit the generated answer message to the sender. The communication device 100A may transmit the generated answer message to the wearable device 100B, and upon user confirmation, transmit the generated answer message to the sender.

    [0150] According to another embodiment, at step S1031 of FIG. 10B, the wearable device 100B may receive a message.

    [0151] At step S1033, the wearable device 100B may transmit the received message to the communication device 100A.

    [0152] At step S1035, the communication device 100A may determine at least one recommendation answer message based on the sender's intention or the message type.

    [0153] At step S1037, the communication device 100A may transmit at least one determined recommendation answer message to the wearable device 100B.

    [0154] At step S1039, the wearable device 100B may display the received recommendation answer message. The wearable device 100B may display a user interface for showing recommendation information necessary for generating an answer message.

    [0155] At step S1041, in response to the user interface for showing the recommendation information being selected by the user, the wearable device 100B may transmit the information indicating that the user interface for showing the recommendation information is selected to the communication device 100A.

    [0156] At step S1043, the communication device 100A may determine the plurality of piece of recommendation information and relations between the plurality of piece of recommendation information.

    [0157] At step S1045, the communication device 100A may display graphics representing the plurality of piece of recommendation information and the relations between the plurality of piece of recommendation information.

    [0158] At step S1047, in response to one of the plurality of piece of recommendation information being selected by the user, the communication device 100A may generate an answer message including recommendation information based on the selected recommendation information, the sender's intention, and the message type.

    [0159] At step S1049, the communication device 100A may transmit the generated answer message to the wearable device 100B.

    [0160] At step S1051, the wearable device 100B may transmit the received answer message to the sender.

    [0161] According to another embodiment, as step S1061 of FIG. 10C, the wearable device 100B may receive a message.

    [0162] At step S1063, the wearable device 100B may determine at least one recommendation answer message based on the sender's intention or the message type.

    [0163] At step S1065, the wearable device 100B may display the received recommendation answer message. The wearable device 100B may display a user interface for showing the recommendation information for generating an answer message.

    [0164] At step S1067, in response to the user interface for showing the recommendation information being selected by the user, the wearable device 100B may transmit the information indicating that the user interface for showing the recommendation information is selected to the communication device 100A.

    [0165] At steps S1069 to S1077, the wearable device 100B may transmit the answer message generated based on the plurality of piece of recommendation information selected by the user to the sender. Steps S1069 to S1077 correspond to steps S1043 to S1051 of FIG. 10B, respectively. Therefore, the detailed description will be omitted.

    [0166] FIGS. 11A and 11B are views illustrating a process of determining data to be used for generating an answer message according to an embodiment of the present disclosure.

    [0167] Referring to (a) of FIG. 11A, in response to a user input switching a data registration mode to an on-state through a data registration mode user interface 1101 on a setup screen, the processor 170 may execute a data registration mode.

    [0168] Accordingly, when a content is provided or displayed as an example of data, the processor 170, as shown in (b) of FIG. 11A, may control the display 110 to display a data registration menu 1102 for registering the content as data to be used for generating an answer message. The content may include various types of information such as video, image, text, audio or webpage.

    [0169] The user input unit 145 may receive a user input for selecting the data registration menu 1102 to register the content being provided as data to be used for generating an answer message.

    [0170] According to a user input, as shown in (c) of FIG. 11, the processor 170 may control the display 110 to display a pop-up screen 1103 confirming that the content being provided is registered as data to be used for generating an answer message. The pop-up screen 1103 may include a tag input screen 1103-1 and an importance selection user interface 1103-2. According to a user input provided through the tag input screen 1103-1, the processor 170 may receive tag information of the content being provided. The tag information, for example, may be the description of the content, the availability of the content or the source of the content. According to a user input provided through the importance selection user interface 1103-2, the processor 170 may receive the importance of the content. The importance of the content may be one of very important, moderate important, and slightly important.

    [0171] The processor 170 may generate recommendation information or an answer message based on the metadata, tag information and importance of a registered content and registered content as related information of the registered content.

    [0172] For example, the processor 170 may store the registered content and the content related information in a user registration data area of the context framework 300. In response to a recommendation answer message or recommendation information to be used for the recommendation answer message being generated, the processor 170 may preferentially use the content and the content related information stored in the user registration data area.

    [0173] As a recommendation answer message or recommendation information is generated using data directly registered by a user, satisfaction and convenience of a user who uses a message function may be enhanced.

    [0174] FIGS. 12A and 13B are concept views provided to explain a process of providing an answer message according to another embodiment of the present disclosure.

    [0175] Referring to (a) of FIG. 12A, the processor 170 may control the display 110 to display a content 1201 registered at a social server. For example, when a user accesses the social server and retrieve a content registered by a third person, the processor 170 may control the display 110 to display the content 1201. The user input unit 145 may receive a user input for registering an answer message (e.g. comments, etc.) for the content 1201 registered at the social server.

    [0176] The processor 170 may generate keywords from the content 1201 registered by the third party. As shown in (b) of FIG. 12A, the processor 170 may generate keywords such as "Hongdae area", "outchicken" "chicken", "chick and beer" "beer" "spicy chicken", "foodstagram", "instrafood", "instasize", and the like. Generating keywords from a content by the processor 170 may include obtaining keywords from the tags registered by the third person or the metadata of the content in addition to generating keywords by analyzing an image itself. The processor 170 may obtain keywords related to an image by using a search engine of an external server. For example, when the image is a food image, the processor 170 may retrieve restaurants offering food images, latest issues related to the food images, target customer of the food images from the external server and obtain a keyword accordingly.

    [0177] As shown in (C) of FIG. 12A, the processor 170 may determine keywords or processed or categorized keywords as recommendation information and control the display 110 to display graphics representing the determined recommendation information and the relations between the recommendation information. The user input unit 145 may receive a user input that selects at least one recommendation information 1202 among the plurality of recommendation information.

    [0178] According to a user input, as shown in (d) of FIG. 12B, the processor 170 may generate candidate answer messages 1204 based on the recommendation information 1202 selected by the user and a template 1203 available for an answer message. The processor 170 may determine a template according to an attribute of the recommendation information 1202 selected by the user. For example, when the attribute of the recommendation information 1202 selected by the user is food, the processor 170 may select a template for generating an answer message including the food image and generate an answer message based on the template. For example, the processor 170 may generate an answer message "let's go eat chicken with me next time" by combing recommendation information "chicken" and a template "let's go eat #food with me next time". When "chicken" and "beer" are selected as plural pieces of recommendation information, the processor 170 may generate an answer message "the chicken and beer here are really great" by combining the plurality of pieces of recommendation information and a template "#food here is really great".

    [0179] In response to a plurality of candidate answer messages being generated, the processor 170 may control the display 110 to display a user interface for a user to select one of the plurality of candidate answer messages. Accordingly, in response to one answer message being selected by the user, the processor 170 may register one selected answer message at a social server. For example, the processor 170 may register the selected answer message selected as a comment to the content registered by the third person at the social server.

    [0180] According to another embodiment, as shown in (a) of FIG.13A, the processor 170 may control the display 110 to display a content 1301 registered at the social server. The user input unit 145 may receive a user input for registering an answer message for the content 1301 registered at the social server.

    [0181] As shown in (b) of FIG. 13A, the processor 170 may generate keywords such as "Hongdae area", "outchicken", "foodstagram", "chicken", "smartphone", "cheesestick", "sweetphotatostick", "daily life", "foodtrip", etc.

    [0182] As shown in (c) of FIG. 13A, the processor 170 may determine recommendation information based on the generated keywords and control the display 110 to display graphics representing the determined recommendation information and the relations between the recommendation information. The user input unit 145 may receive a user input for selecting a recommendation information 1302 from the recommendation information.

    [0183] According to a user input, as shown in (d) of FIG. 13B, the processor 170 may generate candidate answer messages 1304 based on the recommendation information 1302 selected by the user and a template 1303 available for an answer message. The processor 170 may determine a template according to an attribute of the recommendation information 1302 selected by the user. For example, when the attribute of the selected recommendation information is an activity, the processor 170 may select a template for generating an answer message including the activity and generate an answer message based on the template. For example, the processor 170 may generate an answer message "let's go grab a bite with me" by combining recommendation information "go grab a bite" with a template "let's #activity with me". When the plurality of recommendation information are selected and attributes of respective recommendation information are different, the processor 170 may select a template for generating an answer message by using the plurality of recommendation information with different attributes. For example, when "chicken" and "Hongdae area" are selected as the plurality of recommendation information with different attributes, the processor 170 may generate an answer message "let's go to the Hongdae area to eat chicken for a change" by combining the plurality of recommendation information with a template "let's go to #place to eat #food for a change".

    [0184] FIGS. 14A to 15D are views illustrating screens for providing images as recommendation information according to another embodiment of the present disclosure.

    [0185] When the device 100 provides an image or a video, the image or video may be used for recommendation information to be included in an answer message. The device 100 may understand a dialog intention of a sender or a user based on message history between the sender and the user and automatically provide an image or a video to be included in an answer message based on the dialog intention. As an image or a video which is to be included in an answer message is provided, a user may create an answer message more conveniently.

    [0186] According to an embodiment, referring to (a) of FIG. 14A, in response to receiving a message from a device of a sender, the processor 170 may control the display 110 to display a message between the sender and user on a screen. For example,
    the processor 170 may control the display 110 to display messages "what did you with your girlfriend over the weekend?" received from the device of the sender, "we went to the Olympic park" input by the user as a response, and "how was it?" received from the device of the sender as a response. The processor 170 may control the display 110 to display a user interface 1401 for providing recommendation information to be included in an answer message.

    [0187] According to a user input that selects the user interface 1401, as shown in (b) of FIG. 14A, the processor 170 may control the display 110 to display representative images 1402,1403,1404 and 1405 as recommendation information.

    [0188] The processor 170 may obtain at least one keyword from the messages between the sender and user and determine images to be recommended based on the obtained keyword. For example, as shown in (b) of FIG. 14A, the processor 170 may obtain keywords "girlfriend" and "weekend" from the message "what did you do with your girlfriend over the weekend?' from the sender and obtain a keyword "Olympic park" from the message "we went to the Olympic park" of the user. The processor 170 may generate a search keyword to retrieve an image to be recommended based on the combination of the obtained keywords. For example, the processor 170 may define images retrieved by using the keywords "girlfriend", "weekend" and "Olympic park" as a first image group. The processor 170 may define images retrieved based on the keywords "girlfriend" and "Olympic park" as a second image group. The processor 170 may define images retrieved based on the keywords "girlfriend" and "weekend" as a third image group. As shown in (b) of FIG. 12A, the processor 170 may control the display 110 to display the representative images 1402 to 1405 of respective image groups. The user input unit 145 may receive a user input that selects the representative image 1402 among the representative images 1402 to 1405.

    [0189] According to a user input, the processor 170 may obtain the representative image 1402 and other images included in the group of the representative image 1402 and control the display 110 to display the obtained images as in (d) of FIG. 14B. As shown in (c) of FIG. 14B, the processor 170 may control the display 110 to display a visual effect in which images included in the group of the representative image 1402 are retrieved or collected around the representative image 1402.

    [0190] As shown in (d) of FIG. 14B, the processor 170 may control the display 110 to display the retrieved images to be arranged (according to the order of relevance with keywords, the order of image generation time, the order of image size) in one area 1411 of the screen (e.g. a top screen). The processor 170 may control the display 110 to display the images which are not included in the representative image group to be arranged (e.g. the order of image generation time, the order of image size, etc.) in another area (e.g. a bottom screen) 1412.

    [0191] As shown in (e) of FIG. 14C, the user input unit 145 may receive a user input that selects at least one of first, second, third and fourth images 1421,1422,1423 and 1424 to be used for an answer message among the retrieved images. In response to the user input, the processor 170 may control the display 110 to display the first to fourth images 1421 to 1424 selected by the user so that the first to fourth images 1421 to 1424 selected by the user are highlighted to be distinguished from the other images.

    [0192] As shown in (f) of FIG. 14C, the processor 170 may obtain keywords from the first to fourth images 1421 to 1424 selected by the user. For example, the processor 170 may generate keywords by analyzing the first to fourth images 1421 to 1424 selected by the user. The processor 170 may generate keywords by analyzing the first to fourth images 1421 to 1424 selected by the user using a Natural Language Generation (NLG) function.

    [0193] The processor 170 may obtain keywords from metadata, tag, user log of the first to fourth images 1421 to 1424 selected by the user. For example, the processor 170 may obtain a place keyword "Olympic park" from the first image 1421, a date keyword "8.10. 2015" from the second image 1422, and a person keyword "girlfriend' from the third image 1423.

    [0194] As shown in (g) of FIG. 14C, the processor 170 may determine a template available for an answer message from a plurality of templates based on the obtained keywords. For example, when attributes of the keywords corresponding to the selected image relate to place and person, the processor 170 may determine a template 1431 including place and person as a template for generating an answer message.

    [0195] As shown in (h) of FIG. 14D, the processor 170 may control the display 110 to display an answer message including a text-based answer message containing a keyword according to the determined template and images 1441 and 1442 related to the generated keyword. The images 1441 and 1442 related to the obtained keyword may be images selected by the user in (e) of FIG. 14C, or representative images of the images retrieved again related to the keyword obtained in (f) of FIG. 14C.

    [0196] As shown in (h) of FIG. 14D, when an answer message includes the images 1441 and 1442 of "Olympic park" and "girlfriend", the user input unit 145 may receive user a input that selects the image 1442 of "girlfriend" between the images 1441 and 1442.

    [0197] According to a user input, as shown in (i) of FIG. 14D, the processor 170 may control the display 110 to display other images related to the image 1442 selected by the user. The other images may be images retrieved again by using the keyword related to the image 1442 selected by the user, and when the image 1442 selected by the user is a representative image, may be images included in the group of the representative image. The other images related to the image 1442 selected by the user may be images by newly retrieved using the newly obtained keyword from the image 1442 selected by the user. Such images may be provided in the form of thumbnail, image list, or album to slide over time. Alternatively, only the specific number of images may be displayed, and the other images may be sequentially displayed according to a user input of selecting left/right buttons or up/down buttons.

    [0198] According to another embodiment, referring to (a) of FIG. 15A, in response to receiving a message from a device of a sender, the processor 170 may control the display 110 to display a message between the sender and the user on a screen. For example, the processor 170 may control the display 110 to display a message "what do you want to eat?" received from the device of the sender. The processor 170 may control the display 110 to display a user interface 1501 for selecting recommendation information to be included in an answer message input by the user.

    [0199] According to a user input that selects the user interface 1501, as shown in (b) of FIG.15A, the processor 170 may control the display 110 to display representative images 1501,1502,1503 and 1504 as recommendation information. The processor 170 may obtain at least one keyword from the messages between the sender and the user and determine images to be recommended based on the obtained keyword. For example, the processor 170 may obtain keywords "what", "eat" and "want to" from the message "what do you want to eat?" from the sender in (b) of FIG. 15A. The processor 170 may generate a search keyword for retrieving images to be recommended based on the combination of the obtained keywords. For example, the processor 170 may determine that the sender intends to ask about food and generate new keywords related to food based on dialog history between the sender and the user, search history of the user and images stored in the device 100. The combination of newly generated keywords may be, for example, "roll cake", "soju", "beef", "chicken", and "beer". The processor 170 may retrieve and group images related to the combination of keywords obtained from the images which are stored in the device 100 or a server linked to the device 100. As shown in (b) of FIG. 15A, the processor 170 may control the display 110 to display representative images 1502, 1503, 1504, and 1505 of respective image groups. The user input unit 145 may receive a user input for selecting the representative image 1502 from the plurality of representative images 1502 to 1505.

    [0200] According to a user input, the processor 170 may obtain the representative image 1502 selected by the user and other images included in the group of the representative image 1502 selected by the user and control the display 110 to display the obtained images. Referring to (c) of FIG. 15B, the processor 170 may control the display 110 to display a visual effect where images included in the group of the representative image 1502 are retrieved or collected around the representative image 1502. As shown in (d) of FIG. 15B, the processor 170 may control the display 110 to display the retrieved images to be arranged and displayed in one area (e.g. a top screen) 1511 of the screen. In addition, the processor 170 may control the display 110 to display images which are not included in the group of the representative image to be arranged an displayed in another area (e.g. a bottom screen) 1512 of the screen.

    [0201] As shown in (e) of FIG. 15C, the user input unit 145 may receive a user input for selecting at least one of first, second, third and fourth images 1521, 1522, 1523 and 1524 to be used for an answer message among the retrieved images. In response to a user input, the processor 170 may control the display 110 to display the first to fourth images 1521 to 1524 selected by the user so that the first to fourth images 1521 to 1524 selected by the user are highlighted to be distinguished from the other images.

    [0202] As shown in (f) of FIG. 15C, the processor 170 may obtain keywords from the first to fourth images 1521 to 1524 selected by the user. For example, the processor 170 may analyze the first to fourth images 1521 to 1524 selected by the user to generate keywords. The processor 170 may obtain keywords from metadata, tag, and user log of the first to fourth images 1521 to 1524 selected by the user. For example, the processor 170 may obtain a food keyword "chicken" from the first image 1521, the second image 1522 and the third image 1523 and obtain a keyword "draft beer" from the fourth image 1524.

    [0203] As shown in (g) of FIG. 15C, the processor 170 may determine a template available for an answer message from a plurality of templates based on the obtained keyword. For example, when the attribute of keywords corresponding to the selected image is food, the processor 170 may determine a template 1531 including a plurality of food images as a template for generating an answer message.

    [0204] As shown in (h) of FIG. 15D, the processor 170 may control the display 110 to display a text-based answer message including a keyword according to the determined template and images 1551 and 1552 related to the generated keyword. The images 1551 and 1552 related to the obtained keyword may be the images selected by the user in (e) of FIG. 15C, or may be representative images retrieved again in relation to the obtained keyword in (f) of FIG. 15C.

    [0205] As to (h) of FIG. 15D, when the answer message includes the images 1551 and 1552 of "chicken" and "draft beer", the user input unit 145 may receive a user input for selecting the image 1552 of "chicken" as one of the images.

    [0206] According to a user input, as shown in (i) of FIG. 15D, the processor 170 may control the display 110 to display other images related to the image 1552 of "chicken" selected by the user. The other images may be images retrieved again using the keyword related to the image 1552 selected by the user or, when the image 1552 selected by the user is a representative image, the other images may be images included in the group of the representative image. The other images may be images newly retrieved by using the newly obtained keyword from the image 1552 selected by the user. The other images may be provided in the form of a thumbnail image, an image list, or an album to slide over time. Alternatively, only the certain number of images may be displayed, and the other images may be sequentially displayed according to a user input that selects left/right buttons or up/down buttons.

    [0207] FIGS. 16A to 16D are views illustrating screens for providing an answer message to a plurality of devices according to another embodiment of the present disclosure.

    [0208] When a user receives and transmits a message from and to a plurality of senders through a plurality of dialog windows, it is inconvenient for user to frequently come in and out of the dialog window. Accordingly, a technique for receiving and transmitting a message from and to a second user without changing a dialog window while receiving and transmitting a message from and to a first sender in high demand to reduce inconvenience of the user.

    [0209] Referring to (a) of FIG. 16A, the processor 170 may control the display 110 to display a first question message 1601 received from a first device of a first sender and a first answer message 1602 of a user on the dialog window.

    [0210] As shown in (b) of FIG. 16A, in response to receiving a second question message 1611 from a second device of a second sender, the processor 170 may control the display 110 to display at least part of the second question message 1611 on a screen.

    [0211] The user input unit 145 may receive a user input that inputs tag information 1621 through an input filed of the dialog window. In response to a user input that inputs the tag information 1621, as shown in (c) of FIG. 16B, the processor 170 may control the display 110 to display the tag information 1621 on the input field of the dialog window and automatically display identification information 1622 of the second device. The identification information 1622 of the second device may be obtained from additional information or header information which is transmitted along with the second question message 1611. The examples of the identification information 1622 of the second device may include ID, phone number, or nickname of the second sender.

    [0212] In response to the tag information 1621 and the identification information 1622 of the second device being displayed, the user input unit 145 may receive a user input that inputs a second answer message 1623 for the second question message 1601. According to a user input that inputs the second answer message 1623, as shown in (d) of FIG. 16B, the processor 170 may control the display 110 to display the tag information 1621, the identification information 1622 of the second device and the second answer message 1623 on the input field of the dialog window.

    [0213] Referring to (b) of FIG. 16A, the user input unit 145 may directly receive the tag information 1621, the identification information 1622 of the second device and the second question message 1623 through the input field of the dialog window. As shown in (d) of FIG. 16B, the processor 170 may control the display 110 to display the tag information 1621, the identification information 1622 of the second device and the second answer message 1623 on the input field of the dialog window.

    [0214] According to a user input that selects a send button 1624, the processor 170 may control the communicator 130 so that the second question message 1623 may be transmitted to the second device. As shown in (e) of FIG. 16C, the processor 170 may control the display 110 to display the second answer message 1623 transmitted to the second device on the dialog window. For example, the processor 170 may control the display 110 to make an area of the dialog window to be divided into areas 1631 and 1632 by colors or lines, an answer message transmitted to the second device may be displayed on the area 16331 and an answer message transmitted to the first device may be displayed on the area 1632. According to another embodiment, the processor 170 may control the display 110 to display the answer message transmitted to the second device at a state bar of the screen or at an outside of the dialog window.

    [0215] FIG. 17 is a block diagram illustrating configuration of a device according to another embodiment of the present disclosure.

    [0216] As shown in FIG. 17, examples of the device 100 may include a mobile phone, a tablet PC, a PDA, an MP3 player, a kiosk, an electronic frame, a navigation device, a digital TV, a smart watch, a wrist watch, and a wearable device such as a smart glass, a Head-Mounted Display (HMD), etc.

    [0217] Referring to FIG. 17, the device 100 may include at least one of a display 110, a processor 170, a memory 120, a GPS chip 125, a communicator 130, a video processor 135, an audio processor 140, a user input unit 145, a microphone unit 150, a capturer 155, a speaker 160 and a motion detector 165.

    [0218] The display 110 may include a display panel 111 and a controller (not shown) for controlling the display panel 111. The display panel 111 may be embodied with various types of displays such as a Liquid Crystal Display (LCD), an Organic Light Emitting Diodes (OLED) display, an Active-Matrix Organic Light-Emitting Diode (AM-OLED), a Plasma Display Panel, etc. The display panel 111 may be flexible, transparent or wearable. The display 110 may be connected to a touch panel 147 of the user input unit 145 and provided as a touch screen (not shown). For example, the touch screen (not shown) may include a unitary module in which the display panel 111 and the touch panel 147 are stacked.

    [0219] The memory 120 may include at least one of an internal memory (not shown) and an external memory (not shown).

    [0220] The internal memory may include at least one of a volatile memory (e.g. a Dynamic RAM) (DRAM), a Static RAM (SRAM), a Synchronous Dynamic RAM (SDRAM)), a non-volatile memory (e.g. One Time Programmable ROM (OTPROM), Programmable ROM (PROM), Erasable and Programmable ROM (EPROM), Electrically Erasable and Programmable ROM (EEPROM), Mask ROM, Flash ROM, etc.), a Hard Disk Drive (HDD), or a Solid State Drive (SSD). According to an embodiment, the processor 170 may load and process instructions or data received from at least one of the non-volatile memory or other components into the volatile memory. In addition, the processor 170 may retain data received or generated from other components in the non-volatile memory.

    [0221] The external memory may include at least one of Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), a Mini Secure Digital (Mini-SD), extreme Digital (xD), and Memory Stick.

    [0222] The memory 120 may store various programs and data for operations of the device 100.

    [0223] The processor 170 may control the display 110 to display graphics representing a plurality of piece of recommendation information which are includable in an answer message for the received message and relations between the plurality of piece of recommendation information on the display 110. The processor 170 may display part of the contents stored in the memory 120 on the display 110. The processor 170 may perform a control operation corresponding to a user input in response to a user input being received in one area.

    [0224] The processor 170 may include at least one of a RAM 171, a ROM 172, a CPU 173, a Graphic Processing Unit (GPU) 174 and a bus 175. The RAM 171, the ROM 172, the CPU 173, and the GPU 174 may be interconnected via the bus 175.

    [0225] The CPU 173 may access the memory 120 and perform booting by using an operation system (O/S) stored in the memory 120. The CPU 173 may perform various operations by using various programs, contents, data stored in the memory 120.

    [0226] The ROM 172 may store a command set for booting a system. For example, when a turn-on command is input and power is supplied to the device 100, the CPU 173 may copy the operation system stored in the memory 120 to the RAM 171 according to the command stored the ROM 172 and perform booting of the system by executing the operation system. When the booting is completed, the CPU 173 may copy various programs stored in the memory 120 to the RAM 171, execute the program copied to the RAM 171 and perform various operations. When the booting of the device 100 is completed, the GPU 174 may display a Ul screen on an area of the display 110. Specifically, the GPU 174 may generate a screen displaying an electronic document including various objects such as contents, icons, menus, and the like. The GPU 174 may calculate attribute values such as coordinate values, shapes, sizes, and colors of respective objects according to the layout of the screen. The GPU 174 may then generate the screens of various layouts including the objects based on the calculated attribute values. The screens generated by the GPU 174 may be provided to the display 110 and displayed in respective areas of the display 110.

    [0227] The GPS chip 125 may receive a GPS signal from a Global Positioning System (GPS) satellite and calculate the current position of the device 100. The processor 170 may calculate a user location using the GPS chip 125 when a navigation program is used or otherwise the current location of the user is required.

    [0228] The communicator 130 may perform communication with various types of external devices according to various types of communication methods. The communicator 130 may include at least one of a Wi-Fi chip 131, a Bluetooth chip 132, a wireless communication chip 133, and an NFC chip 134. The processor 170 may communicate with various external devices using the communicator 130. The communicator 130 may receive a question message from another device or may transmit an answer message for the received question message to another device.

    [0229] The Wi-Fi chip 131 and the Bluetooth chip 132 may perform communication using a WiFi method and a Bluetooth method, respectively. When the WiFi chip 131 or the Bluetooth chip 132 is used, various connection information such as an SSID and a session key may be transmitted and received first, communication connection may be established, and communication information may be transmitted and received. The wireless communication chip 133 may refer to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), Long Term Evolution (LTE), and the like. The NFC chip 134 may refer to a chip operating in an Near Field Communication (NFC) mode using 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz and 2.45 GHz.

    [0230] The video processor 135 may process video data include in contents received through the communicator 130 or contents stored in the memory 120. The video processor 135 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, resolution conversion, etc. of the video data.

    [0231] The audio processor 140 may process audio data included in the contents received through the communicator 130 or the contents stored in the memory 120. The audio processor 140 may perform various operations such as decoding, amplification, or noise filtering of the audio data.

    [0232] The processor 170 may reply contents by deriving the video processor 135 and the audio processor 140 in response to a replay program for multimedia contents being executed. The speaker 160 may output audio data generated by the audio processor 140.

    [0233] The user input unit 145 may receive various commands from a user. The user input unit 145 may include at least one of a key 146, a touch panel 147 and a pen recognition panel 148.

    [0234] The key 146 may include various types of keys such as mechanical buttons, whirl, etc. formed in various areas such as the front surface, the side surface, or the rear surface of the device 100.

    [0235] The touch panel 147 may sense a touch input of the user and output a touch event value corresponding to the sensed touch signal. When a touch screen (not shown) is embodied with the touch panel 147 and the display panel 111, the touch screen may be embodied as various types of touch sensors such as a capacitive touch sensor, a resistive touch sensor, a piezoelectric touch sensor, etc. The capacitive touch sensor may calculate touch coordinates by sensing micro electricity generated when part of the user's body touches the surface of the touch screen using a dielectric coated on the surface of the touch screen. The resistive touch sensor may include two electrode substrates provided in the touch screen and calculate touch coordinates by sensing that the upper and lower substrates at the touched point contact to each other and a current flows when the user touches the screen. A touch event may occur on a touch screen when the touch screen is touched by a finger, but may also be generated by an object formed of a conductive material that applies a variation in capacitance.

    [0236] The pen recognition panel 148 may detect a proximity input or a touch input of a touch pen (e.g. a stylus pen, a digitizer pen, etc.) when the user uses the pen and output the detected pen proximity event or the detected pen touch event. The pen recognition panel 148 may be implemented in an EMR manner and may detect a touch input or a proximity input according to change of the intensity of an electromagnetic field due to the approach or touch of the pen. More specifically, the pen recognition panel 148 may include an electromagnetic induction coil sensor (not shown) having a grid structure and an electronic signal processor (not shown) for sequentially providing AC signals having a predetermined frequency to respective loop coils of the electromagnetic induction coil sensor. In response to a pen containing a resonant circuit in the vicinity of the loop coil of the pen recognition panel 148, a magnetic field transmitted from the loop coil may generate a current to the resonant circuit of the pen based on mutual electromagnetic induction. Based on this current, an induction magnetic field may be generated from the coil that forms the resonance circuit in the pen, and the pen recognition panel 148 may detect the induction magnetic field from the loop coil in a signal reception state, so that the proximity position or the touch position of the pen may be sensed. The pen recognition panel 148 may be provided under the display panel 111 in a predetermined area, for example, an area that covers the display area of the display panel 111.

    [0237] The microphone unit 150 may receive user voice or other sounds and convert the user voice or other sounds into audio data. The processor 170 may use the user voice input through the microphone unit 150 in a call operation or convert the user voice into audio data and store the audio data in the memory 120.

    [0238] The capturer 155 may capture a still image or a video according to a control of the user. The capturer 155 may be embodied with a plurality of cameras including a front camera and a rear camera.

    [0239] When the capturer 155 and the microphone unit 150 are provided, the processor 170 may perform a control operation according to the user voice input through the microphone unit 150 and user motion recognized by the capturer 155. For example, the device 100 may operate in a motion control mode or a voice control mode. When the device 100 operates in the motion control mode, the processor 170 may activate the capturer 155 and capture a user, trace the change of user motion and perform a control operation accordingly. When the device 100 operates in the voice control mode, the processor 170 may analyze the user voice input through the microphone unit 150 and operate in the voice recognition mode for performing a control operation according to the analyzed user voice.

    [0240] The motion sensor 165 may sense motion of the main body of the device 100. The device 100 may be rotated or tilted in various directions. The motion sensor 165 may sense motion characteristics such as direction and angle of rotation, slope, etc. using at least one of various sensors such as a geomagnetism sensor, a gyro sensor, an acceleration sensor, and the like.

    [0241] Although not shown in FIG. 17, according to an embodiment, a USB port to which a USB connector is connected to the device 100, various external input ports for connecting to various external terminals such as headset, mouse, LAN, etc., a DMB chip for receiving and processing a Digital Multimedia Broadcasting (DMB) signal, and various sensors may be further provided..

    [0242] FIG. 18 is a view illustrating a system for controlling an external device by using recommendation information according to another embodiment of the present disclosure.

    [0243] Referring to FIG. 18, a system 1800 may include a device 100, an external device 1810 and a hub device 1820.

    [0244] The external device 1810 may be, for example, an loT device. The loT device may be various kinds of home appliances. The home appliances may include at least one of a washing machine 1811, a refrigerator 1812, an air conditioner 1813, a smart TV, a digital video disk (DVD) player, an audio device, a vacuum cleaner, an oven, a microwave oven, an air conditioner, a set-top box, a home automation control panel, a security control panel, a TV box (e.g. HomeSync™ of Samsung, Apple TV™, or Google TV™), a game console (e.g. Xbox™ and PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic frame. In addition, the loT device may be a sensor for detecting a state in the home. The sensor may be embodied as various sensors such as a motion sensor, a temperature sensor, a humidity sensor, an illuminance sensor, and the like.

    [0245] The hub device 1820 may be an additional device such as a home gateway, a home server, etc. and one of the loT devices described above may operate as the hub device 1820.

    [0246] When a user inputs a message for controlling the external device 1810 on a message screen provided by the device 100, the device 100 may obtain a plurality of piece of recommendation information corresponding to the input message and relations between the plurality of pieces of recommendation information.

    [0247] The tree generation module 235 may generate relation information indicating the plurality of pieces of recommendation information and the relations between the plurality of pieces of recommendation information. The tree generation module 235 may be included in the device 100, the external device 1810, or the hub device 1820. The recommendation information and the relation information may be selected and generated based on the use history of the external device 1810 and the preset information.

    [0248] According to an embodiment, when the tree generation module 235 is provided in the hub device 1820, the hub device 1820 may receive the message input by the user from the device 100. The hub device 1820 that receives the message may analyze the input message, select recommendation information having a higher weight value in connection with the external device 1810 and generate relation information representing the relations between the recommendation information. The hub device 1820 may transmit the generated recommendation information and relation information to the device 100.

    [0249] According to another embodiment, when the tree generation module 325 is included in the external device 1810, the external device 1810 may receive the message input by the user via the hub device 1820 or directly receive the message. The external device 1810 may analyze the received message and generate recommendation information and the relation information between the recommendation information. The external device 1810 may transmit the generated recommendation information and relation information to the device 100 via the hub device 1820 or directly transmit the information to the device 100.

    [0250] In response to the device 100 obtaining relation information indicating the plurality of pieces of recommendation information and the relations between the plurality of pieced of recommendation information, the device 100 may display graphics representing the plurality of pieces of recommendation information and the relations between the plurality of pieces of recommendation information.

    [0251] A user may select one of the plurality of piece of recommendation information based on the graphics representing the plurality of pieces of recommendation information and the relations between the plurality of pieces of recommendation information.

    [0252] According to a user input, the device 100 may transmit a control command related to the selected recommendation information to the external device 1810 via the hub device 1820 or directly transmit the control command to the external device 1810.

    [0253] The external device 1810 may perform an operation according to the received control command.

    [0254] FIG. 19 is an in-use view provided to explain a method for controlling an external device by using recommendation information according to an embodiment of the present disclosure.

    [0255] Referring to (a) of FIG. 19, a user may select identification information 1911 of the external device 1810 to which a message is transmitted from a contact information list 1910 for the shake of control, and the identification information of the external device 1810 may be, for example, identification information of a washing machine 1811.

    [0256] In response to the identification information of the external device 1810 being selected, as shown in (b) of FIG. 19, the device 100 may provide a message screen 1920 for displaying a message related to the external device 1810 or receiving an input related to the external device 1810.

    [0257] In response to the message screen 1920 being provided, the user may input a message 1920 for asking about a state of the external device 1810. For example, the user may input a message 1921 "please let me know the state of laundry".

    [0258] The device 100 may directly transmit a command asking a state of the external device 1810 to the external device 1810, or transmit the command to the external device 1810 via the hub device 1820 as a result of analyzing the message 1921.

    [0259] In response to the received command, the external device 1810 may directly transmit state information to the device 100, or transmit the information to the device 100 via the hub device 1820.

    [0260] The state information of the external device 1810 may be, for example, at least one of an operation state of the external device 1810, a state of an object to be processed by the external device 1810, and a state of the periphery of the external device 1810. For example, when the external device 1810 is the washing machine 1811, the state information of the external device 1810 may be at least one of the amount of laundry, the smell of the laundry, the amount of detergent and fabric softener put into the external device 1810. The above information may be sensed using a camera, an odor sensor, a pressure sensor, etc. provided in the washing machine 1811.

    [0261] When the state information of the external device 1810 is obtained in response to the message 1921 asking the state of the external device 1810, the device 100 may convert the state information of the external device 1810 into a message 1923 and display the message 1923 on the message screen 1920. For example, the device 100 may display the message 1923 of "the amount of laundry (1kg), the laundry odor (strong), the amount of detergent (large) and the amount of fabric softener (small)" as the state of the laundry on the screen.

    [0262] In response to the message 1923 related to the state information of the external device 1810 being displayed on the message screen 1920, a user may input a message 1925 for controlling the external device 1810 based on the state information of the external device 1810. For example, the user may input the message 1925 "please start the washing machine".

    [0263] As shown in (c) of FIG. 19, the device 100 may analyze the message 1925 and display graphics representing the plurality of pieces of recommendation information and relations between the plurality of pieces of recommendation information. The graphic for connecting the plurality of pieces of recommendation information may have a tree structure, a node structure, or hierarchy structure.

    [0264] When the external device 1810 is a washing machine, the graphics representing the plurality of pieces of recommendation information and the relations between the plurality of pieces of recommendation information may indicate the type of laundry course, the type of washing temperature, the number of times of rinsing and the relations therebetween.

    [0265] When the user selects a recommendation information 1931 "rinse once" from a plurality of pieces of recommendation information 1931, 1933 and 1935 at the lowest nodes, the device 100 may generate a message "the course (standard), the washing temperature (40 degrees), the number of rinsing times (once)' as a message including the recommendation information 1931 selected by the user and the recommendation information at the upper nodes 1937, 1939 and 1941 related to the recommendation information 1931 selected by the user.

    [0266] As shown in (d) of FIG. 19, the device 100 may display the message 1927 on a message input window 1920-1.

    [0267] According to a user input for selecting a send button 1920-2, the device 100 may transmit the message 1927 displayed on the message input window 1920-1 to the external device 1810 via the hub device 1820 or directly transmit the message 1927 to the external device 1810. Transmitting the message 1927 may comprise converting the message 1927 into a control command interpreted by the external device 1810 and transmitting the control command.

    [0268] As another example, when a user selects the recommendation information 1931 at the lowest node, the device 100 may transmit the message 1927 including the recommendation information at the upper nodes 1937, 1939 and 1941 related to the recommendation information 1931 at the lowest node to the external device 1810 without displaying on the message input window 1920-1. As a result of transmission, the message transmitted to the external device 1810 may be displayed on the message screen 1920.

    [0269] FIG. 20 is an in-use view provided to explain a method for controlling an external device by using recommendation information according to an embodiment of the present disclosure

    [0270] As shown in (a) of FIG. 20, graphics representing a plurality of pieces of recommendation information and relations between the plurality of pieces of recommendation information may be displayed. The example of (a) of FIG. 20 may be the same as an example of (c) of FIG. 19B.

    [0271] In this case, a user wishes to change the recommendation information of one node among the plurality of pieces of recommendation information and select a recommendation information 2011 at a middle node that a user wants to change, among the plurality of pieces of recommendation information.

    [0272] In response to the recommendation information 2011 at the intermediate node being selected, as shown in (b) of FIG. 20, the device 100 may display graphics representing the plurality of pieces of recommendation information and the relations between the plurality of pieces of recommendation information on the basis of the middle node.

    [0273] When the user selects a recommendation information 2015 "rinse three times" as one of the plurality of pieces of recommendation information 2013, 2015 and 2017 at the lowest node, the device 100 may generate a message "the course (stains), the mode (soaking), the washing temperature (60 degrees), the number of rinsing times (three times)" as a message including the selected recommendation information 2015 and recommendation information related to the selected recommendation information 2015 at the upper nodes 2019, 2021 and 2011. As shown in (c) of FIG. 20, the device 100 may display the message 1923 on the message input window 1920-1.

    [0274] According to a user input for selecting a send button 1920-2, the device 100 may transmit the message 1923 displayed on the message input window 1920-1 to the external device 1810 via the hub device 1820 or directly transmit the message 1923 to the external device 1810.

    [0275] FIG. 21 is a flowchart provided to explain a method for providing recommendation information which is includable in an answer message by a device according to an embodiment of the present disclosure.

    [0276] At step S2101, the device 100 may receive a question message from another device.

    [0277] At step S2103, the device 100 may display graphic representing a plurality of pieces of recommendation information which are includable in an answer message for the received question message and relations between the plurality of pieces of recommendation information. The graphic representing the relations between the plurality of pieces of recommendation information may have a tree structure or a radial structure. The plurality of pieces of recommendation information may be connected to one another based on weighted values regarding attributes such as preference, importance, location, time or atmosphere of the plurality of pieces of recommendation information.

    [0278] At step S2105, the device 100 may determine whether a user input that selects at least one of the plurality of pieces of recommendation information is received.

    [0279] In response to the user input, at step S2107, the device 100 may generate and display an answer message including the selected recommendation information. According to the user input that selects a send button, the device 100 may transmit the answer message including the selected recommendation information to another device.

    [0280] FIG. 22 is a flowchart provided to explain a method for providing recommendation information which is includable in an answer message by a device according to an embodiment of the present disclosure.

    [0281] At step S2210, the device 100 may store data a user registered. The data that the user registered may be, for example, a content registered as data to be used for generating an answer message through a data registration menu by a user. The data registered by the user may be data retrieved, captured, or noted by the user.

    [0282] At step S2203, the device 100 may receive a question message from another device.

    [0283] At step S2205, the device 100 may display graphics representing a plurality of pieces of recommendation information included in an answer message and relations between the plurality of pieces of recommendation information based on the data registered by the user.

    [0284] At step S2207, the device 100 may determine whether a user input that selects at least one of the plurality of pieces of recommendation information is received.

    [0285] In response to the user input being received, at step S2209, the device 100 may generate and display an answer message including the selected recommendation information. According to the user input that selects a send button, the device 100 may transmit an answer message including the selected recommendation information to another device.

    [0286] FIG. 23 is a flowchart provided to explain a method for providing recommendation information which is includable in an answer message by a device according to an embodiment of the present disclosure.

    [0287] At step S2301, the device 100 may receive a question message from another device.

    [0288] At step S2303, the device 100 may display a plurality of pieces of recommendation images included in the answer message for the received question message.

    [0289] At step S2305, the device 100 may determine whether a user input that selects at least one of the plurality of pieces of recommendation information is received.

    [0290] In response to the user input being received, at step S2307, the device 100 may obtain a keyword from the selected recommendation image, and generate and display an answer message including the obtained keyword. The device 100 may generate and display an answer message including the selected recommendation image. According to the user input that selects a send button, the device 100 may transmit an answer message including the obtained keyword to another device. The device 100 may transmit the answer message including the selected recommendation image to another device.

    [0291] FIG. 24 is a flowchart provided to explain a method for providing recommendation information which is includable in an answer message by a device according to an embodiment of the present disclosure.

    [0292] At step S2401, the device 100 may receive a question message from a first device.

    [0293] At step S2403, the device 100 may display the received question message on a dialog window.

    [0294] At step S2405, the device 100 may receive a question message from a second device.

    [0295] At step S2407, the device 100 may determine whether a user input that inputs tag information is received through an input filed of the dialog window.

    [0296] In response to the user input being received, at step S2409, the device 100 may display identification information of the second device on the input filed of the dialog window.

    [0297] At step S2411, the device 100 may determine whether a user input that inputs an answer message is received though the input field of the dialog window.

    [0298] In response to the user input being received, the device 100 may display the received answer message on the input filed of the dialog window. According to the user input that selects a send button, at step S2413, the device 100 may transmit the displayed answer message to the second device.

    [0299] The components of the device 100 described above may be differently named. Further, the device 100 according to the present disclosure may include at least one of the above-described components. Some components may be omitted or other additional components may be further included.

    [0300] An embodiment of the present disclosure may also be embodied in the form of a recording medium including instructions executable by a computer such as a program module executed by a computer. Computer readable medium can be any available medium that can be accessed by a computer and includes both volatile and nonvolatile media and both removable and non-removable media. The computer-readable medium may also include both computer storage medium and communication medium. Computer storage medium may include both volatile and nonvolatile media and removable and non-removable media implemented by any method or technology for storage of information such as computer readable commands, data structures, program modules or other data. Communication media may typically include computer readable commands, data structures, program modules, or other data in a modulated data signal such as a carrier wave, other transmission mechanism or arbitrary information transmission medium.

    [0301] Embodiments are provided to more sincerely and fully disclose the invention to those skilled in the art to which the invention pertains, and the scope of the invention should be understood by the claims of the invention. Accordingly, it will be understood by those of skill in the art that various changes in form and details may be made without departing from the scope of the invention as set forth in the following claims. For example, each component described as a single entity may be distributed and implemented, and components described as being distributed may also be implemented in a combined form.

    [0302] Although embodiments have been shown and described, it will be appreciated by those skilled in the art that changes may be made to these embodiments. Accordingly, the scope of the present disclosure is not construed as being limited to the described embodiments, but is defined by the appended claims.


    Claims

    1. A device (100) for transmitting an answer message (1602), comprising:

    a display (110) configured to display information;

    a communicator (130) configured to receive a question message (1601) from another device;

    a processor (170) configured to analyze the question message (1601) and to control the display (110) to display graphics representing a plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) which are includable in an answer message (1602) for the received question message (1601) and relations between the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017), wherein the graphics representing the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are indicated by nodes and the graphics representing the relations between the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) have a tree structure or a radial structure with at least two levels; and

    a user input unit (145) configured to receive a user input that selects at least one of the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017),

    wherein the processor (170) is further configured to, when the at least one of the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) is selected by the user, generate an answer message (1602) including the selected recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) and other recommendation information linked to the selected recommendation information according to the displayed graphics,

    wherein the communicator (130) is further configured to transmit the generated answer message (1602) including the selected recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) to the another device according to the user input,

    wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are connected to one another based on weight values regarding at least one attribute among preference, importance, location, time and atmosphere of the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017).


     
    2. The device (100) as claimed in claim 1, wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are generated based on a content registered by a user.
     
    3. The device (100) as claimed in claim 2, wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are generated based on tag information and importance of the registered content.
     
    4. The device (100) as claimed in claim 1, wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are generated based on data retrieved, captured, photographed or noted by a user.
     
    5. The device (100) as claimed in claim 1, wherein in response to the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) being images, the answer message (1602) includes a keyword obtained from at least one image selected from the images.
     
    6. The device (100) as claimed in claim 1, wherein in response to the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) being images, the answer message (1602) includes at least one image selected from the images.
     
    7. The device (100) as claimed in claim 1, wherein in response to receiving a second question message from yet another device while the question message received from the another device is displayed on a dialog window, the processor (170) is further configured to control the display (110) to automatically display identification information (1622) of the yet another device on an input field of the dialog window according to a user input that inputs tag information (1621) on the input field of the dialog window.
     
    8. The device (100) as claimed in claim 1, wherein in response to receiving a second question message from yet another device while the question message received from the another device is displayed on a dialog window, the communicator (130) is further configured to transmit a second answer message (1623) to the yet another device according to a user input that inputs tag information (1621), identification information (1622) of the yet another device, and the second answer message (1623) for the second question message on an input field of the dialog window.
     
    9. A method for transmitting an answer message (1602) performed by a device (100), the method comprising:

    receiving a question message (1601) from another device;

    analyzing the question message (1601);

    displaying graphics representing a plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) which are includable in an answer message (1602) for the received question message (1601) and relations between the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017), wherein the graphics representing the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are indicated by nodes and the graphics representing the relations between the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) have a tree structure or a radial structure with at least two levels; and

    in response to a user input that selects at least one of the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017), generating an answer message (1602) including the selected recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) and other recommendation information linked to the selected recommendation information according to the displayed graphics, and transmitting the generated answer message (1602) including the selected recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) to the another device,

    wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are connected to one another based on weight values regarding at least one attribute among preference, importance, location, time and atmosphere of the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017).


     
    10. The method as claimed in claim 9, wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are generated based on a content registered by a user.
     
    11. The method as claimed in claim 10, wherein the plurality of pieces of recommendation information (101-106, 1202, 1302, 1931-1935, 2011-2017) are generated based on tag information and importance of the registered content.
     


    Ansprüche

    1. Vorrichtung (100) zur Übermittlung einer Antwortnachricht (1602), umfassend:

    eine Anzeige (110), die dazu ausgestaltet ist, Informationen anzuzeigen;

    einen Kommunikator (130), der dazu ausgestaltet ist, eine Fragenachricht (1601) von einer anderen Vorrichtung zu empfangen;

    einen Prozessor (170), der dazu ausgestaltet ist, die Fragenachricht (1601) zu analysieren und die Anzeige (110) derart zu steuern, dass sie Grafiken anzeigt, die eine Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017), die in einer Antwortnachricht (1602) zu der empfangenen Fragenachricht (1601) aufgenommen werden können, und Beziehungen zwischen der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, wobei die Grafiken, die die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, von Knoten dargestellt werden, und die Grafiken, die die Beziehungen zwischen der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, eine Baumstruktur oder eine radiale Struktur mit mindestens zwei Ebenen aufweisen; und

    eine Benutzereingabeeinheit (145), die dazu ausgestaltet ist, eine Benutzereingabe zu empfangen, die mindestens eine der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) auswählt,

    wobei der Prozessor (170) ferner dazu ausgestaltet ist, eine Antwortnachricht (1602) zu generieren, die die ausgewählten Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) und andere Empfehlungsinformationen beinhaltet, die gemäß den angezeigten Grafiken mit den ausgewählten Empfehlungsinformationen verknüpft sind, wenn die mindestens eine der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) von dem Benutzer ausgewählt wird,

    wobei der Kommunikator (130) ferner dazu ausgestaltet ist, die generierte Antwortnachricht (1602), die die ausgewählten Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) beinhaltet, gemäß der Benutzereingabe zu der anderen Vorrichtung zu übermitteln,

    wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf Gewichtungswerten hinsichtlich mindestens eines Attributs aus Präferenz, Wichtigkeit, Ort, Zeit und Atmosphäre der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) miteinander verbunden sind.


     
    2. Vorrichtung (100) nach Anspruch 1, wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf einem Inhalt generiert werden, der von einem Benutzer eingetragen wird.
     
    3. Vorrichtung (100) nach Anspruch 2, wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf Tag-Informationen und Wichtigkeit des eingetragenen Inhalts generiert werden.
     
    4. Vorrichtung (100) nach Anspruch 1, wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf Daten generiert werden, die von einem Benutzer abgerufen, erfasst, fotografiert oder notiert werden.
     
    5. Vorrichtung (100) nach Anspruch 1, wobei in Reaktion darauf, dass die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) Bilder sind, die Antwortnachricht (1602) ein Schlüsselwort beinhaltet, das aus mindestens einem Bild erhalten wurde, das aus den Bildern ausgewählt wurde.
     
    6. Vorrichtung (100) nach Anspruch 1, wobei in Reaktion darauf, dass die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) Bilder sind, die Antwortnachricht (1602) mindestens ein Bild beinhaltet, das aus den Bildern ausgewählt wurde.
     
    7. Vorrichtung (100) nach Anspruch 1, wobei in Reaktion darauf, dass eine zweite Fragenachricht von noch einer anderen Vorrichtung empfangen wird, während die Fragenachricht, die von der anderen Vorrichtung empfangen wird, auf einem Dialogfenster angezeigt wird, der Prozessor (170) ferner dazu ausgestaltet ist, die Anzeige (110) derart zu steuern, dass sie gemäß einer Benutzereingabe, die auf einem Eingabefeld des Dialogfensters Tag-Informationen (1621) eingibt, automatisch Identifikationsinformationen (1622) der anderen Vorrichtung auf dem Eingabefeld des Dialogfensters anzeigt.
     
    8. Vorrichtung (100) nach Anspruch 1, wobei in Reaktion darauf, dass eine zweite Fragenachricht von noch einer anderen Vorrichtung empfangen wird, während die Fragenachricht, die von der anderen Vorrichtung empfangen wird, auf einem Dialogfenster angezeigt wird, der Kommunikator (130) ferner dazu ausgestaltet ist, gemäß einer Benutzereingabe, die Tag-Informationen (1621), Identifikationsinformationen (1622) der anderen Vorrichtung und eine zweite Antwortnachricht (1623) zu der zweiten Fragenachricht auf einem Eingabefeld des Dialogfensters eingibt, die zweite Antwortnachricht (1623) zu der anderen Vorrichtung zu übermitteln.
     
    9. Verfahren zur Übermittlung einer Antwortnachricht (1602), durchgeführt von einer Vorrichtung (100), wobei das Verfahren Folgendes umfasst:

    Empfangen einer Fragenachricht (1601) von einer anderen Vorrichtung;

    Analysieren der Fragenachricht (1601);

    Anzeigen von Grafiken, die eine Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017), die in einer Antwortnachricht (1602) zu der empfangenen Fragenachricht (1601) aufgenommen werden können, und Beziehungen zwischen der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, wobei die Grafiken, die die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, von Knoten dargestellt werden, und die Grafiken, die die Beziehungen zwischen der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) darstellen, eine Baumstruktur oder eine radiale Struktur mit mindestens zwei Ebenen aufweisen; und

    in Reaktion auf eine Benutzereingabe, die mindestens eine der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) auswählt, Generieren einer Antwortnachricht (1602), die die ausgewählten Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) und andere Empfehlungsinformationen beinhaltet, die gemäß den angezeigten Grafiken mit den ausgewählten Empfehlungsinformationen verknüpft sind, und Übermitteln der generierten Antwortnachricht (1602), die die ausgewählten Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) beinhaltet, an die andere Vorrichtung,

    wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf Gewichtungswerten hinsichtlich mindestens eines Attributs aus Präferenz, Wichtigkeit, Ort, Zeit und Atmosphäre der Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) miteinander verbunden sind.


     
    10. Verfahren nach Anspruch 9, wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf einem Inhalt generiert werden, der von einem Benutzer eingetragen wird.
     
    11. Verfahren nach Anspruch 10, wobei die Mehrzahl von Empfehlungsinformationen (101-106, 1202, 1302, 1931-1935, 2011-2017) basierend auf Tag-Informationen und Wichtigkeit des eingetragenen Inhalts generiert werden.
     


    Revendications

    1. Dispositif (100) pour transmettre un message de réponse (1602), comprenant :

    un écran (110) configuré pour afficher des informations ;

    un communicateur (130) conçu pour recevoir un message de question (1601) d'un autre dispositif ;

    un processeur (170) conçu pour analyser le message de question (1601) et pour commander à l'écran (110) d'afficher des graphiques représentant une pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) qui peuvent être comprises dans un message de réponse (1602) pour le message de question (1601) reçu et des relations entre la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017), les graphiques représentant la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant indiqués par des noeuds et les graphiques représentant les relations entre la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) ayant une structure arborescente ou une structure radiale avec au moins deux niveaux ; et

    une unité d'entrée d'utilisateur (145) conçue pour recevoir une entrée d'utilisateur qui sélectionne au moins une pièce parmi la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017),

    le processeur (170) étant en outre conçu pour générer un message de réponse (1602) comprenant les informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) sélectionnées et d'autres informations de recommandation liées aux informations de recommandation sélectionnées conformément aux graphiques affichés, lorsque l'au moins une pièce parmi la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) est sélectionnée par l'utilisateur,

    le communicateur (130) étant en outre conçu pour transmettre le message de réponse (1602) généré comprenant les informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) sélectionnées à un autre dispositif conformément à l'entrée d'utilisateur,

    la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant connectées entre elles basé sur des valeurs pondérées concernant au moins un attribut parmi le groupe se composant de la préférence, l'importance, le lieu, la date et l'atmosphère de la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017).


     
    2. Dispositif (100) selon la revendication 1, la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant générée basé sur un contenu enregistré par un utilisateur.
     
    3. Dispositif (100) selon la revendication 2, la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant générée basé sur une information d'étiquette et sur une importance du contenu enregistré.
     
    4. Dispositif (100) selon la revendication 1, la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant générée basé sur des données collectées, capturées, photographiées ou notées par un utilisateur.
     
    5. Dispositif (100) selon la revendication 1, le message de réponse (1602) comprenant un mot-clé obtenu de l'au moins une image sélectionnée parmi les images, en réponse à la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant des images.
     
    6. Dispositif (100) selon la revendication 1, le message de réponse (1602) comprenant au moins une image sélectionnée parmi les images, en réponse à la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant des images.
     
    7. Dispositif (100) selon la revendication 1, le processeur (170) étant en outre conçu, en réponse à la réception d'un deuxième message de question d'un troisième dispositif pendant que le message de question reçu de l'autre dispositif est affiché dans une fenêtre de dialogue, pour commander à l'écran (110) d'afficher automatiquement des informations d'identification (1622) du troisième dispositif dans un champ d'entrée de la fenêtre de dialogue conformément à une entrée d'utilisateur qui entre des informations d'étiquette (1621) dans le champ d'entrée de la fenêtre de dialogue.
     
    8. Dispositif (100) selon la revendication 1, le communicateur (130) étant en outre conçu, en réponse à la réception d'un deuxième message de question d'un troisième dispositif pendant que le message de question reçu du troisième dispositif est affiché dans une fenêtre de dialogue, pour transmettre un deuxième message de réponse (1623) au troisième dispositif conformément à une entrée d'utilisateur qui entre des informations d'étiquette (1621), des informations d'identification (1622) du troisième dispositif, et le deuxième message de réponse (1623) pour le deuxième message de question dans un champ d'entrée de la fenêtre de dialogue.
     
    9. Procédé pour transmettre un message de réponse (1602) exécuté par un dispositif (100), le procédé comprenant :

    recevoir un message de question (1601) d'un autre dispositif ;

    analyser le message de question (1601) ;

    afficher des graphiques représentant une pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) qui peuvent être comprises dans un message de réponse (1602) pour le message de question (1601) reçu et des relations entre la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017), les graphiques représentant la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant indiqués par des nÅ“uds et les graphiques représentant les relations entre la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) ayant une structure arborescente ou une structure radiale avec au moins deux niveaux ; et

    en réponse à une entrée d'utilisateur qui sélectionne au moins une pièce parmi la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017), générer un message de réponse (1602) comprenant les informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) sélectionnées et d'autres informations de recommandation liées aux informations de recommandation sélectionnées conformément aux graphiques affichés,

    et transmettre le message de réponse (1602) généré comprenant les informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) sélectionnées à un autre dispositif,

    la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant connectées entre elles basé sur des valeurs pondérées concernant au moins un attribut parmi le groupe se composant de la préférence, l'importance, le lieu, la date et l'atmosphère de la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017).


     
    10. Procédé selon la revendication 9, la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant générée basé sur un contenu enregistré par un utilisateur.
     
    11. Procédé selon la revendication 10, la pluralité de pièces d'informations de recommandation (101-106, 1202, 1302, 1931-1935, 2011-2017) étant générée basé sur des informations d'étiquette et sur une importance du contenu enregistré.
     




    Drawing






































































































































    Cited references

    REFERENCES CITED IN THE DESCRIPTION



    This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

    Patent documents cited in the description