Automated generation of recommended response messages

0001This is a reissue application of U.S. Pat. No. 9,832,619, which was filed as U.S. patent application Ser. No. 14/815,420 on Jul. 31, 2015 and issued on Nov. 28, 2017, the disclosure of which is incorporated herein by reference in its entirety.

CROSS-REFERENCE TO RELATED APPLICATIONS

0002This application claims priority from Korean Patent Application No. 10-2015-0026750, filed on Feb. 25, 2015, and 10-2014-0098634, filed on Jul. 31, 2014 in the Korean Intellectual Property Office, the disclosures of which are incorporated herein in their entireties by reference.

BACKGROUND

00031. Field

0004Apparatuses and methods consistent with exemplary embodiments relate to providing content to a user during a conversation by using an electronic device.

00052. Description of the Related Art

0006As the distribution rate of portable terminals has been rapidly increased in recent times, portable terminals have become a daily necessity for contemporary people. The portable terminals provide various functions including not only a voice call service, which is its primary function, but also various kinds of additional services, such as data transferring, etc.

0007In particular, communication between users has been actively performed by using a smart terminal. With this trend, various technologies configured to provide more convenient environments for such communication have been developed.

SUMMARY

0008One or more exemplary embodiments provide a method of providing convenient communication environments by using various electronic devices.

0009According to an aspect of an exemplary embodiment, there is provided an electronic device providing a message service including: a communication unit configured to exchange a message with another device; a display configured to display a message received from the another device, a message input by the electronic device, and at least one response message generated by the electronic device, all together on a message service screen of the display; and a processor configured to determine whether the received message includes an inquiry, and provide at least one piece of recommended content based on the inquiry in response to the received message being determined as including the inquiry, and transmit the at least one response message comprising the at least one piece of recommended content to the other device.

0010The processor may be further configured to determine whether the electronic device stores data used to generate the at least one piece of recommended comment, and obtain the data based on a result of the determination.

0011The processor may be further configured to determine a keyword associated with the at least one piece of recommended content, and obtain content corresponding to the keyword.

0012The processor may be further configured to obtain the at least one piece of recommended content based on relational data between a user of the other device and a user of the electronic device.

0013The relational data may include at least one of data stored in the electronic device, data stored in a server communicating with the electronic device, and data stored in the other device.

0014The display may be further configured to display the at least one piece of recommended content based on a user input requesting the at least one piece of recommended content in response to a settings menu being set to manually recommend the at least one piece of recommended content, display the at least one piece of recommended content based on a user input indicated in the received message in response to the settings menu being set to semi-automatically recommend the at least one piece of recommended content, and display the at least one piece of recommended content without a user input when the electronic device obtains the at least one piece of content by recognizing the received message in response to the settings menu being set to automatically recommend the at least one piece of recommended content.

0015The processor may be further configured to obtain the at least one piece of recommended content based on types of words included in the message, relations among the words, and meanings of the words.

0016The processor may be further configured to obtain the at least one piece of recommended content based on a relation between a user of the electronic device and a user of the other device, which is set based on a user input.

0017The at least one piece of recommended content may be obtained from an application installed in the electronic device.

0018The processor may be further configured to extract at least one keyword from the received message to determine whether the received message includes an inquiry.

0019According to an aspect of another exemplary embodiment, there is provided a method of providing content to another device, via an electronic device providing a message service including: receiving a message from the other device; displaying the received message on a message service screen; determining whether the received message includes an inquiry; providing at least one piece of recommended content based on the received message; and transmitting a response message comprising the at least one piece of recommended content to the other device.

0020The providing the at least one piece of recommended content may include determining whether the electronic device stores data used to generate the at least one piece of recommended comment, and obtaining the data based on a result of the determination.

0021The providing the at least one piece of recommended content may include determining a keyword associated with the at least one piece of recommended content and obtaining content corresponding to the keyword.

0022The providing the at least one piece of recommended content may include obtaining the at least one piece of recommended content based on relational data between a user of the electronic device and a user of the other device.

0023The relational data may include at least one of data stored in the electronic device, data stored in a server communicating with the electronic device, and data stored in the other device.

0024The providing the at least one piece of recommended content may include: displaying the at least one piece of recommended content based on a user input requesting the at least one piece of content in response to a settings menu being set to manually recommend the at least one piece of recommended content; displaying the at least one piece of recommended content based on a user input indicated in the received message in response to the settings menu being set to semi-automatically recommend the at least one piece of recommended content; and displaying the at least one piece of recommended content without a user input when the electronic device obtains the at least one piece of content by recognizing the received message in response to the settings menu being set to automatically recommend the at least one piece of recommended content.

0025The providing the at least one piece of recommended content may include obtaining the at least one piece of recommended content based on types of words included in the message, relations among the words, and meanings of the words.

0026The providing the at least one piece of recommended content may include obtaining the at least one piece of recommended content based on a relation between a user of the electronic device and a user of the other device, which is set based on a user input.

0027The at least one piece of recommended content may be obtained from an application installed in the electronic device.

0028The providing the at least one piece of recommended content includes: extracting at least one keyword from the received message to determine whether the received message includes an inquiry.

0029According to an aspect of an exemplary embodiment, there is provided a method of providing a social networking service by a server including: displaying a message posted by a first device through an application or a website; recognizing a user input from a second device that activates an input field displayed on the application or the website; determining whether the posted message includes an inquiry; generating a recommended response based on information of relationship between a user of the first device and a user of the second device in response to the posted message including the inquiry; and providing the recommended response to the second device.

0030The determining whether the posted message may include the inquiry includes determining whether a sentence of the message starts with an interrogative adverb, determining whether a subject and a verb of the sentence are inversed, and determining whether the sentence includes a question mark.

0031The recommended response may include a plurality of contents that belong to at least two different categories, and the at least two different categories include an application and a picture.

0032The method may further include determining user preference of the at least two different categories based on the number of times that each of the categories is selected by the second device, and displaying the plurality of contents in the order of the user preference.

BRIEF DESCRIPTION OF THE DRAWINGS

0033The above and/or other aspects will be more apparent by describing certain exemplary embodiments, with reference to the accompanying drawings, in which:

0034<figref idref="DRAWINGS">FIG. <b>1</b></figref> is a diagram for describing a content providing system according to an exemplary embodiment;

0035<figref idref="DRAWINGS">FIG. <b>2</b></figref> is a view of a user interface (UI) of an electronic device, according to an exemplary embodiment;

0036<figref idref="DRAWINGS">FIG. <b>3</b></figref> is a flowchart for describing a method of providing content via an electronic device, according to an exemplary embodiment;

0037<figref idref="DRAWINGS">FIGS. <b>4</b> through <b>7</b></figref> are views for describing a method of providing content according to an exemplary embodiment;

0038<figref idref="DRAWINGS">FIG. <b>8</b></figref> is a view for describing various types of electronic devices and various chatting methods, which apply a method of providing content according to exemplary embodiments;

0039<figref idref="DRAWINGS">FIG. <b>9</b>A</figref> is a view for describing a knowledge framework configured to provide response related content, which is included in an electronic device;

0040<figref idref="DRAWINGS">FIG. <b>9</b>B</figref> is a view for describing an operation of each of components of an electronic device according to an exemplary embodiment;

0041<figref idref="DRAWINGS">FIGS. <b>10</b>A through <b>10</b>D</figref> are views of an environment setting user interface which is provided by an electronic device according to an exemplary embodiment;

0042<figref idref="DRAWINGS">FIGS. <b>11</b>A through <b>11</b>D</figref> are views for describing a method of providing response related content via an electronic device;

0043<figref idref="DRAWINGS">FIG. <b>12</b>A</figref> is a flowchart for describing a method of providing response related content via an electronic device;

0044<figref idref="DRAWINGS">FIG. <b>12</b>B</figref> is a view of a module included in each of an electronic device and a server;

0045<figref idref="DRAWINGS">FIG. <b>13</b>A</figref> is a flowchart for describing a method of providing response related content via an electronic device;

0046<figref idref="DRAWINGS">FIG. <b>13</b>B</figref> is a view of a module included in each of an electronic device and a server;

0047<figref idref="DRAWINGS">FIG. <b>14</b>A</figref> is a flowchart for describing a method of providing response related content via an electronic device;

0048<figref idref="DRAWINGS">FIG. <b>14</b>B</figref> is a view of a module included in each of an electronic device and a server;

0049<figref idref="DRAWINGS">FIG. <b>15</b></figref> is a view for describing a method of utilizing content stored in a database of a server to understand a relationship between users;

0050<figref idref="DRAWINGS">FIG. <b>16</b></figref> is a view for describing a method of utilizing content stored in a database of an electronic device to understand a relationship between users;

0051<figref idref="DRAWINGS">FIG. <b>17</b></figref> is a view for describing a method of utilizing content stored in a database of an electronic device and content stored in a database of a server, in order to understand a relationship between a user of the electronic device and a user of a device of another user;

0052<figref idref="DRAWINGS">FIGS. <b>18</b>, <b>19</b>A through <b>19</b>D, <b>20</b>A through <b>20</b>D, <b>21</b>, <b>22</b>A, <b>22</b>B, <b>23</b>A through <b>23</b>C, and <b>24</b>A through <b>24</b>E</figref> are views for describing a method of providing content according to an exemplary embodiment;

0053<figref idref="DRAWINGS">FIGS. <b>25</b>A through <b>25</b>E</figref> are views of content providing screens, when content which may be used for a response is provided, according to an exemplary embodiment;

0054<figref idref="DRAWINGS">FIG. <b>26</b></figref> is a view of an electronic device providing an interface via which a content providing layout is changed;

0055<figref idref="DRAWINGS">FIGS. <b>27</b> through <b>37</b></figref> are views for describing a method of providing content according to an exemplary embodiment;

0056<figref idref="DRAWINGS">FIGS. <b>38</b> through <b>42</b>, <b>43</b>A, <b>43</b>B, <b>44</b>, <b>45</b>, <b>46</b>A, <b>46</b>B, <b>47</b>, and <b>48</b></figref> are views for describing a method of providing content according to an exemplary embodiment;

0057<figref idref="DRAWINGS">FIG. <b>49</b>A through <b>49</b>D</figref> are block diagrams of components of a user's terminal according to an exemplary embodiment, wherein the user's terminal may be the electronic device of <figref idref="DRAWINGS">FIG. <b>1</b></figref>;

0058<figref idref="DRAWINGS">FIGS. <b>50</b>A through <b>50</b>D, <b>51</b>A through <b>51</b>D, <b>52</b>A through <b>52</b>D, and <b>53</b>A through <b>53</b>C</figref>, <b>53</b>D<b>1</b>, and <b>53</b>D<b>2</b> are views for describing an overall method of providing content according to an exemplary embodiment;

0059<figref idref="DRAWINGS">FIGS. <b>54</b>A through <b>54</b>D</figref> are views for describing a method of providing content according to an exemplary embodiment;

0060<figref idref="DRAWINGS">FIGS. <b>55</b>A through <b>55</b>D</figref> are views for describing a method of providing content according to an exemplary embodiment;

0061<figref idref="DRAWINGS">FIG. <b>56</b></figref> is a block diagram of software components of a user's terminal according to an exemplary embodiment;

0062<figref idref="DRAWINGS">FIG. <b>57</b></figref> is a view of a user interface (UI) of an electronic device according to an exemplary embodiment; and

0063<figref idref="DRAWINGS">FIG. <b>58</b></figref> is a view of a user interface (UI) of an electronic device according to an exemplary embodiment.

DETAILED DESCRIPTION

0064Exemplary embodiments are described in greater detail below with reference to the accompanying drawings.

0065In the following description, like drawing reference numerals are used for like elements, even in different drawings. The matters defined in the description, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. Also, well-known functions or constructions are not described in detail since they would obscure the description with unnecessary detail.

0066When a part “includes” or “comprises” an element, unless there is a particular description contrary thereto, the part can further include other elements, not excluding the other elements. Throughout the specification, it will be understood that when an element is referred to as being “connected” to another element, it may be “directly connected” to the other element or “electrically connected” to the other element with intervening elements therebetween. In addition, terms such as “ . . . unit,” “ . . . module,” or the like refer to units that perform at least one function or operation, and the units may be implemented as hardware or software or as a combination of hardware and software.

0067Throughout the specification, a term such as “user” may refer to a user of an electronic device. Throughout the specification, a term such as “message service” may refer to a one to one, one to many, or many to many service via which users may easily exchange messages, such as a conversation of the users.

0068Throughout the specification, a term “application” refers to a set of a series of computer programs designed to execute specific tasks. The application in this specification may vary. The application may include a game application, a video playing application, a map application, a memo application, a calendar application, a phone book application, a broadcasting application, a sport support application, a payment application, a picture folder application, etc. However, the application is not limited thereto. The application may also be referred to as an App.

0069Expressions such as “at least one of,” when preceding a list of elements, modify the entire list of elements and do not modify the individual elements of the list.

0070In this specification, a term “message” may refer to a group of text units or a group of sound units including at least one selected from one or more words, one or more phrases, and one or more clauses, as part of a conversation exchanged between users.

0071In this specification, a term “keyword” may refer to a word, a phrase, and a clause related to a meaning of a message, the meaning being obtained by performing a natural language analysis with respect to the message. The keyword may refer to not only the word, the phrase, and the clause included in the message, but also a word, a phrase, and a clause which are not included in the message.

0072In this specification, a term “content” may refer to data, files, software, and information including a video, a sound, and a text transferring information via an electronic device. For example, the image content may refer to image data transferred via the electronic device. For example, the content may include text responses including a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, and various languages, and content related to various application services.

0073<figref idref="DRAWINGS">FIG. <b>1</b></figref> is a diagram for describing a content providing system <b>10</b> according to an exemplary embodiment.

0074As illustrated in <figref idref="DRAWINGS">FIG. <b>1</b></figref>, the content providing system <b>10</b> may include an electronic device <b>100</b>, a device of another user <b>200</b>, and a server <b>300</b>.

0075The electronic device <b>100</b> according to an exemplary embodiment may exchange a text message or a voice message with the device of another user <b>200</b>. Also, the electronic device <b>100</b> may exchange the text message or the voice message with the device of another user <b>200</b> via the server <b>300</b>.

0076In addition, the electronic device <b>100</b> may request and obtain various types of data from the server <b>300</b> and may transmit various types of data to the server <b>300</b>. For example, the data that the electronic device <b>100</b> obtains from the server <b>300</b> may be data that is exchanged between the device of another user <b>200</b> and the server <b>300</b>.

0077The content providing system <b>10</b> may be embodied by more or less components than the illustrated components. For example, according to another exemplary embodiment, the server <b>300</b> may not be included in the content providing system <b>10</b>.

0078Hereinafter, the electronic device <b>100</b>, the device of another user <b>200</b>, and the server <b>300</b> will be described in greater detail.

0079The electronic device <b>100</b> according to an exemplary embodiment may exchange a message with the device of another user <b>200</b>.

0080In this specification, the electronic device <b>100</b> may be realized as smart phones, tablets, personal computers (PCs), wearable devices, personal digital assistants (PDAs), laptop computers, cell phones, mobile phones, enterprise digital assistants (EDAs), portable multimedia players (PMPs), personal navigation devices or portable navigation devices (PNDs), handheld game consoles, mobile Internet devices (MIDs), or electronic books (e-books).

0081The wearable device may include a head mounted display (HMD) (hereinafter, referred to as “HMD”) which may be worn at a head portion. For example, the HMD may include glasses, helmets, hats, etc., but it is not limited thereto. The wearable device may also be realized as a ring, a necklace, a bracelet, shoes, earrings, a hair band, clothes, gloves, a thimble, etc.

0082The device of another user <b>200</b> may be a device which receives a first message generated in the electronic device <b>100</b> and displays the first message in an output interface. Also, the device of another user <b>200</b> may generate a second message according to a user input and transmit the second message to the electronic device <b>100</b>.

0083According to an exemplary embodiment, the device of another user <b>200</b> may receive the first message from the electronic device <b>100</b> via the server <b>300</b>, and may transmit the second message to the electronic device <b>100</b> via the server <b>300</b>. According to another exemplary embodiment, the device of another user <b>200</b> may directly receive the first message from the electronic device <b>100</b> without the server <b>300</b>, and may directly transmit the second message to the electronic device <b>100</b> without the server <b>300</b>. According to another exemplary embodiment, the device of another user <b>200</b> may be a single device or a plurality of devices.

0084The device of another user <b>200</b> according to exemplary embodiments may be realized as various types. For example, the device of another user <b>200</b> may be realized as smart phones, tablet PCs, wearable devices, personal digital assistants (PDAs), laptop computers, cell phones, mobile phones, enterprise digital assistants (EDAs), portable multimedia players (PMPs), personal navigation devices or portable navigation devices (PNDs), handheld game consoles, mobile Internet devices (MIDs), or electronic books (e-books).

0085The server <b>300</b> may perform communication with the electronic device <b>100</b> or the device of another user <b>200</b>. For example, the server <b>300</b> may receive the first message generated in the electronic device <b>100</b> from the electronic device <b>100</b>, and may receive the second message generated in the device of another device <b>200</b> from the device of another device <b>200</b>. Also, the server <b>300</b> may transmit the first message to the device of another user <b>200</b> and transmit the second message to the electronic device <b>100</b>.

0086The server <b>300</b> may manage the message received from the electronic device <b>100</b> or the device of another user <b>200</b>. For example, the server <b>300</b> may store the exchanged message in a message database (DB) of each device. Also, the server <b>300</b> may renew the message DB. The server <b>300</b> may renew the message DB according to a cycle time period, or may renew the message DB whenever a new message is received from the electronic device <b>100</b> or the device of another user <b>200</b>.

0087<figref idref="DRAWINGS">FIG. <b>2</b></figref> is a view illustrating a user interface (UI) of the electronic device <b>100</b> according to an exemplary embodiment.

0088Referring to <figref idref="DRAWINGS">FIG. <b>2</b></figref>, the electronic device <b>100</b> according to an exemplary embodiment may extract a keyword from the message received from the device of another user <b>200</b>. Also, based on the keyword, the electronic device <b>100</b> may obtain at least one piece of content which may be used when responding to the message. Also, the electronic device <b>100</b> may display the at least one piece of content that is obtained.

0089The electronic device <b>100</b> may provide an interface, such as a conversation window including a back button <b>20</b>, a call button <b>30</b>, a user name box <b>40</b>, and messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b>. The back button <b>20</b> and the call button <b>30</b> may be displayed on the user name box <b>40</b>.

0090The user may touch or double tap the back button <b>20</b> to go back to a previous menu. The user may touch or double tap the call button <b>30</b> to execute a voice chatting or a voice call. The user name box <b>40</b> may display a name or a nickname of a conversation partner. Also, the user name box <b>40</b> may display a name or a nickname of the user of the electronic device <b>100</b>. The conversation window may display the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> exchanged between the user of the electronic device and the conversation partner.

0091The electronic device <b>100</b> may determine whether each message <b>50</b>, <b>51</b>, <b>52</b>, or <b>53</b> is a question or not. The electronic device <b>100</b> may extract a keyword from the message <b>50</b>, <b>51</b>, <b>52</b>, or <b>53</b>, when any of the messages <b>50</b>, <b>51</b>, <b>52</b>, <b>53</b> is a question. Based on the extracted keyword, the electronic device <b>100</b> may obtain the content which may be used when responding to the message.

0092Via a pop-up window <b>60</b>, the electronic device <b>100</b> may receive a user input regarding whether to display the content obtained with respect to each keyword. The electronic device <b>100</b> may display the obtained content, when the user touches or taps a first response button <b>61</b>. The electronic device <b>100</b> may not display the obtained content, when the user touches or taps a second response button <b>62</b>.

0093When any of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> is a question, the electronic device <b>100</b> may obtain the content which may be used in responding to the question, before activating the pop-up window <b>60</b>. Alternatively, when any of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> is a question, the electronic device <b>100</b> may obtain the content which may be used in responding to the question, after activating the pop-up window <b>60</b>. Alternatively, when any of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> is a question, the electronic device <b>100</b> may obtain the content which may be used in responding to the message after the user touches the first response button <b>61</b>, after the pop-up window <b>60</b> is activated.

0094<figref idref="DRAWINGS">FIG. <b>3</b></figref> is a flowchart for describing a method of providing content via the electronic device <b>100</b> according to an exemplary embodiment.

1.1. Message Reception

0095Referring to <figref idref="DRAWINGS">FIG. <b>3</b></figref>, the electronic device <b>100</b> may receive a message from the device of another user <b>200</b> in operation S<b>110</b>.

0096The electronic device <b>100</b> may receive the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> from the device of another user <b>200</b>. Alternatively, the electronic device <b>100</b> may receive the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> from the device of another user <b>200</b> via the server <b>300</b>.

0097The electronic device <b>100</b> may determine whether each of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> includes a question. The electronic device <b>100</b> may determine whether each of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> includes a question by using a semantic analysis method and a statistical analysis method which will be described later.

1.2. Keyword Extraction

0098The electronic device <b>100</b> may extract a keyword from the message received from the device of another user <b>200</b> in operation S<b>130</b>.

0099The electronic device <b>100</b> may extract the keyword from the message by using the semantic analysis method and the statistical analysis method.

0100The electronic device <b>100</b> may extract the keyword by using the semantic analysis. The electronic device <b>100</b> may determine whether a given sentence is demanding an answer or is providing some information. The electronic device <b>100</b> may analyze the sentence to determine whether the sentence starts with interrogative adverbs (e.g., who, what, when, where, why, which, how) or helping verb (e.g., is, are, can, could, did, does, or do, have, has, may, might, shall, should, will, would), whether the subject and the verb of the sentence are inversed, and whether the sentence includes a question mark to determine whether the sentence is an interrogative sentence.

0101For example, the electronic device <b>100</b> may receive the message <b>53</b> “where are you?” from the device of another user <b>200</b>. The electronic device <b>100</b> may determine the meaning of the message <b>53</b> and extract “where” as the keyword. Also, the electronic device may extract “where” as the keyword by further considering conversation content between the users and user-related data. The user-related data may include at least one of content that is input by the user and recorded data regarding the user. The user-related data may denote content related to only one user or content related to two or more users.

0102The electronic device <b>100</b> may extract “where” as the keyword based on at least one selected from the meaning of the message, the content that is input by the user, and the recorded data regarding the user.

0103The electronic device <b>100</b> may perform a natural language analysis with respect to the meaning of the message to extract the keyword. For example, the electronic device <b>100</b> may extract “where” as the keyword. The electronic device <b>100</b> may analyze and determine the meaning of the message included in the conversation between the users, and may predict content for a response message, based on the meaning of the message. For example, the electronic device <b>100</b> may analyze the meaning of the message as a question that is put by the user of the device of another user <b>200</b> to ask about a location of the user of the electronic device <b>100</b>. Based on this meaning, the electronic device <b>100</b> may predict that the user of the electronic device <b>100</b> may need to provide a response regarding his/her own location to the user of the device of another user <b>200</b>, and may extract “where” as the keyword.

0104Also, when the electronic device <b>100</b> extracts the keyword based on the meaning of the message, the electronic device <b>100</b> may consider the content that is input by the user. For example, the content that is input by the user may include a home address of the user, a company address of the user, a movement path record of the user, and a place according to a schedule of the user. For example, when the user records a business trip plan via a scheduler application, and the content of the message exchanged with the device of another user <b>200</b> is related to a business trip location, the electronic device <b>100</b> may extract “where” as the keyword.

0105Also, when the electronic device <b>100</b> extracts the keyword based on the meaning of the message, the electronic device <b>100</b> may consider the recorded content regarding the user. For example, the recorded content regarding the user may denote a record about the user which is written in the electronic device <b>100</b> and the server <b>300</b>. Also, the record about the user may include a record that is written by the user while the user uses the electronic device <b>100</b> and a record that is written in the server while the user users an App service. Also, the record about the user may include a record that is written indirectly rather than directly by the user while the user uses the electronic device <b>100</b> or the server <b>300</b>.

0106For example, the record about the user may include content of a call of the user, content of payment of the user via a credit card, and content written by the user via a social network service (SNS).

0107The electronic device <b>100</b> may extract the keyword by figuring out the meaning of the message by the statistical analysis.

0108For example, the electronic device <b>100</b> may determine a priority order among predicted situations of the user. For example, the electronic device <b>100</b> may determine that any of one or more predicted situations is more likely to happen than the other situations. For example, the electronic device <b>100</b> may determine that any of one or more keywords is more likely to happen than the other keywords.

0109The electronic device may extract “where” as the keyword in the above-described method by the statistical analysis and the semantic analysis.

1.3. Content Obtainment

0110The electronic device <b>100</b> may obtain content which may be used in responding to the message, based on the extracted keyword, in operation S<b>170</b>.

0111The electronic device <b>100</b> may obtain the content by performing various searches based on the extracted keyword. The content that the electronic device <b>100</b> obtains may include a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text reply formed of various languages, content of various fields, and content related to applications providing various services.

0112The electronic device <b>100</b> according to an exemplary embodiment may obtain the content related to the keyword from an external search server.

0113For example, the electronic device <b>100</b> may obtain the content related to the application service related to the keyword.

0114For example, when the received message is a question type message, the electronic device <b>100</b> may analyze the message and obtain the content related to a weather application service.

0115For example, when although the received message is not a question type, it is recognized as a result of the semantic analysis that the message requires a response, the electronic device <b>100</b> may obtain the content by using a matching table or a predetermined rule.

0116For example, the electronic device <b>100</b> may determine an application service which the user may use in responding to the message according to the keyword, by considering the conversation content and the user-related data.

0117For example, when the user is located in Korea, the electronic device <b>100</b> may select an application service related to maps which is provided by a service provider of Korean nationality. When the user is located in Japan, the electronic device <b>100</b> may select an application service related to maps which is provided by a service provider of Japanese nationality.

0118Also, for example, the electronic device <b>100</b> may select a map application service which is frequently used by the user of the electronic device <b>100</b>, by referring to an application use frequency of the user.

0119Also, for example, the electronic device <b>100</b> may select an application service suitable to a current situation from among application services which are pre-selected by the user.

0120For example, the electronic device <b>100</b> may select a first application service suitable to the current situation of the user, from among first through fifth application services which are pre-selected by the user. For example, when there are first through fifth restaurant application services which are pre-selected by the user, the electronic device <b>100</b> may select at least one restaurant application service suitable to the current situation of the user, from among the first through fifth restaurant application services.

0121Also, the electronic device <b>100</b> may obtain the content by using an internet search service. For example, the electronic device <b>100</b> may obtain the content by performing various searches based on the keyword, after determining the interest search service. For example, the internet search service may be search services which are capable of being accessed by only authorized persons, such as a university library, a thesis search site, and a database of a research institute.

0122For example, the electronic device <b>100</b> may obtain a two-dimensional image corresponding to the keyword, through the search service. For example, the electronic device <b>100</b> may obtain the content of various fields by inputting the keyword in the search service as an input value.

0123According to another exemplary embodiment, the electronic device <b>100</b> may obtain the related content stored in the electronic device <b>100</b>.

0124For example, the electronic device <b>100</b> may obtain a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, a text reply formed of various languages, data about the content of various fields, which are stored in the electronic device <b>100</b>.

1.4. Content Provision

0125The electronic device <b>100</b> may provide at least one piece of obtained content in operation S<b>190</b>.

0126The electronic device <b>100</b> may provide the content obtained based on the keyword to the user by various methods.

0127For example, the electronic device <b>100</b> may provide the obtained content to the user by using at least one of a sound, an image, and a text. For example, the method by which the electronic device <b>100</b> provides the obtained content may vary according to types of electronic devices <b>100</b>. For example, the electronic device <b>100</b> may display the obtained content by a screen division method and a screen transformation method, and when the electronic device <b>100</b> is a wearable device such as a smart watch, the electronic device <b>100</b> may display the content by summarizing the content. For example, the electronic device <b>100</b> may display the content in a sound and an image via an avatar, and when the electronic device <b>100</b> is a wearable device such as a smart watch, the electronic device <b>100</b> may display the summary of the content.

0128For example, the electronic device <b>100</b> may obtain a two-dimensional image corresponding to the keyword, by using the search service. For example, the electronic device <b>100</b> may obtain the content of various fields by inputting the keyword in the search service as an input value.

2. Scenario 1

0129<figref idref="DRAWINGS">FIGS. <b>4</b> through <b>7</b></figref> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>4</b> through <b>7</b></figref> are views of a user interface according to steps of a scenario in which the electronic device <b>100</b> provides a text chatting service and provides an image stored in the electronic device <b>100</b> to a user as response related content.

0130Referring to <figref idref="DRAWINGS">FIG. <b>4</b></figref>, Chris, the user of the electronic device <b>100</b> is performing a text chatting with Hyunjin, a user of the device of another user <b>200</b>.

0131The electronic device <b>100</b> displays the name of the user of the electronic device <b>100</b> in the user name box <b>40</b>. According to another exemplary embodiment, the electronic device <b>100</b> may display the name of the user of the device of another user <b>200</b> in the user name box <b>40</b>.

0132The electronic device <b>100</b> receives the message <b>50</b> “Hi” from the device of another user <b>200</b> at 8:26 on Aug. 6, 2013. The electronic device <b>100</b> sends the message <b>51</b> to the device of another user <b>200</b> and receives the message <b>52</b> from the device of another user <b>200</b>. The user of the electronic device <b>100</b> receives the message “where are you?” from Hyunjin.

0133The electronic device <b>100</b> may determine whether each of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> includes a question. For example, the electronic device <b>100</b> may determine that each of the messages <b>50</b>, <b>51</b>, and <b>52</b> is not a question, and the message <b>53</b> is a question.

0134For example, the electronic device <b>100</b> may mark the message which is determined as a question to distinguish the question message from the other messages. For example, the electronic device <b>100</b> may mark the message which the electronic device <b>100</b> determines as the question in a different color (for example, a fluorescent yellow color) so as to be distinguished from the other messages.

0135The electronic device <b>100</b> may extract a keyword with respect to the message <b>53</b>. For example, the electronic device <b>100</b> may extract “a current location” as the keyword with respect to the message <b>53</b>. Alternatively, for example, the electronic device <b>100</b> may extract “where are you?” and convert it to “where am I?” as the keyword with respect to the message <b>53</b>. Alternatively, for example, the electronic device <b>100</b> may extract “England” or “Seoul” as the keyword with respect to the message <b>53</b> by further considering user-related data.

0136Referring to <figref idref="DRAWINGS">FIG. <b>5</b></figref>, the electronic device <b>100</b> may display images <b>71</b>, <b>72</b>, and <b>73</b> related to the message <b>53</b>. The electronic device <b>100</b> may display the image stored in the electronic device <b>100</b> or the image stored in a server connected to the electronic device <b>100</b>. When the electronic device <b>100</b> determines the message <b>53</b> as a question, the electronic device <b>100</b> may display the related images <b>71</b>, <b>72</b>, and <b>73</b> without an additional input of the user. Alternatively, when the electronic device <b>100</b> determines the message <b>53</b> as a question, the electronic device <b>100</b> may display the related images <b>71</b>, <b>72</b>, and <b>73</b> as the content which may be used in responding, by considering an input value of the user in the settings.

0137Referring to <figref idref="DRAWINGS">FIG. <b>6</b></figref>, the electronic device <b>100</b> may select one of the displayed images, by a user's touch input or tap input.

0138Referring to <figref idref="DRAWINGS">FIG. <b>7</b></figref>, the electronic device <b>100</b> may send as a response the image <b>72</b> selected by the user's touch or tap input, to the device of another user <b>200</b>, via the message <b>54</b>.

2.1. Device and Application Capable of Applying the Method

0139<figref idref="DRAWINGS">FIG. <b>8</b></figref> is a view for describing various types of electronic devices and various chatting methods, which are capable of applying a method of providing content according to exemplary embodiments

0140Referring to <figref idref="DRAWINGS">FIG. <b>8</b></figref>, the method of providing content according to exemplary embodiments may be performed during a communication process via a voice chatting or a text chatting between the electronic device <b>100</b> and the device of another user <b>200</b>. Also, the method of providing content according to the exemplary embodiments may be performed during a communication process via a voice chatting accompanied by a speech to text (STT) function between the electronic device <b>100</b> and the device of another user <b>200</b>. Also, the electronic device <b>100</b> may be realized as a smart phone, a tablet PC, a wearable device, etc. Also, even if it is not the types above, any electronic device that may realize a message service may apply the method of providing content according to the exemplary embodiments.

2.2. Specific Components of the Device

0141<figref idref="DRAWINGS">FIG. <b>9</b>A</figref> is a view for describing a knowledge framework <b>120</b> configured to provide response related content, which is included in the electronic device <b>100</b>.

0142The electronic device <b>100</b> may realize the knowledge framework <b>120</b>, a first application <b>141</b>, and a second application <b>143</b>, and may store a web content list <b>145</b> and a device list <b>147</b>.

0143The knowledge framework <b>120</b> may include a natural language processing unit (NLU) <b>121</b>, a session manager <b>122</b>, a profiler <b>123</b>, a context analyzer <b>124</b>, a response generator <b>125</b>, a content metadata storage <b>126</b>, and an App register <b>127</b>.

0144The NLU <b>121</b> may analyze a meaning of each message received by the electronic device <b>100</b>. The NLU <b>121</b> may analyze the meaning of each message by a statistical method. The NLU <b>121</b> may analyze each message by the statistical method and the semantic method and may transmit the analyzed message to the context analyzer <b>124</b>.

0145The session manager <b>122</b> may check a conversation partner, conversation date and time, conversation content, and a conversation environment with respect to the messages exchanged by the electronic device <b>100</b> and may analyze the exchanged message in a group unit. The session manager <b>122</b> may analyze the one or more messages exchanged by the electronic device <b>100</b> to define the messages as a session.

0146The profiler <b>123</b> may collect and store content about the user of the electronic device or a user who exchanged messages with the user of the electronic device. The profiler <b>123</b> may keep, process, and store content written by the user of the electronic device or the user who exchanged messages with the user of the electronic device.

0147The context analyzer <b>124</b> may analyze and determine a meaning of each of messages exchanged by the electronic device, based on meanings of the messages exchanged by the electronic device. The context analyzer <b>124</b> may analyze and determine the meaning of each of messages exchanged by the electronic device in a unit of one or more message, the unit being defined by the session manager <b>122</b>.

0148The response generator <b>125</b> may generate a response with respect to the message. The response generator <b>125</b> may generate the content which may be used in responding to the message. The response generator <b>125</b> may generate various possible responses and provide the generated responses to the user via an interface screen.

0149The content metadata storage <b>126</b> may include metadata about content. For example, the content metadata storage <b>126</b> may include content about an application. For example, the content metadata storage <b>126</b> may include the metadata regarding whether the application is a sport-related application or a movie-related application. Also, for example, the content metadata storage <b>126</b> may include the metadata about an image. The content metadata storage <b>126</b> may include content, such as names of persons appearing in the image, and a relation between the persons and the user of the electronic device.

0150For example, the content metadata storage <b>126</b> may continuously collect content about a web content list <b>145</b> on the internet. For example, the content metadata storage <b>126</b> may continuously collect data about a device content list <b>147</b> of the electronic device.

0151The App register <b>127</b> may include content about various applications. For example, the App register <b>127</b> may include data about applications included in the electronic device <b>100</b>. For example, the App register <b>127</b> may include data about applications not included in the electronic device <b>100</b>. The App register <b>127</b> may frequently update the data about applications. The response generator <b>125</b> may generate a response related to the applications by referring to the data about the applications of the App register <b>127</b>.

0152For example, the App register <b>127</b> may store data about at least one of the first application <b>141</b> and the second application <b>142</b>. For example, the first application <b>141</b> may be an application installed in the electronic device <b>100</b>. For example, the second application <b>143</b> may be an application that is not installed in the electronic device <b>100</b>.

0153<figref idref="DRAWINGS">FIG. <b>9</b>B</figref> is a view for describing an operation of each of components of the electronic device <b>100</b>, according to an exemplary embodiment.

0154Referring to <figref idref="DRAWINGS">FIG. <b>9</b>B</figref>, the electronic device <b>100</b> may include the session manager <b>122</b>, the profiler <b>123</b>, the context analyzer <b>124</b>, the content metadata storage <b>126</b>, the App register <b>127</b>, a response recommender <b>128</b>, and a web search engine <b>129</b>.

0155The response recommender <b>128</b> may include the natural language processing unit NLU <b>121</b> and the response generator <b>125</b>.

0156The session manager <b>122</b> may transmit a message um[n] to the response recommender <b>128</b>. The response recommender <b>128</b> may receive the message um[n] from the session manager <b>122</b> and the natural language processing unit <b>121</b> may generate a keyword kw[m] from the message um[n]. For example, the session manager <b>122</b> may transmit the message um[n] “where are you?” to the response recommender <b>128</b>, and the natural language processing unit <b>121</b> may generate “location” or “information” as the keyword kw[m].

0157The response recommender <b>128</b> may receive user information usr.info from the profiler <b>123</b>. For example, with respect to the message um[n] “where are you?”, the response recommender <b>128</b> may receive user information in an external service account, information about a user's home or company or about a place that the user frequently visits, as the user information usr.info. When the response recommender <b>128</b> generates the keyword kw[m], the response recommender <b>128</b> may refer to the user information usr.info received from the profiler <b>123</b>.

0158The response recommender <b>128</b> may receive context information cnt.info from the context analyzer <b>124</b>. For example, the context information cnt.info about the message um[n] “where are you?” may include time information, global positioning system (GPS) information, weather information, analyzed user activity information, and recent logs.

0159For example, the user activity information may include information such as a fact that the user stayed in a restaurant for one hour, and a fact that the user continuously ran for one minute. For example, the recent logs may include networking information such as information of a base station accessed by the electronic device <b>100</b>. The response recommender <b>128</b> may consider the context information cnt.info, when generating a recommended response rcm.ans by using the keyword kw[m].

0160The response recommender <b>128</b> may receive application related information ap.info by transmitting the keyword kw[m] to the App register <b>127</b>. For example, the application related information ap.info may include metadata of applications or information about a map-related application.

0161The response recommender <b>128</b> may receive content information cm.info corresponding to the keyword kw[m] from the content metadata storage <b>126</b>. For example, the content information cm.info may include specific information of an image. For example, the specific image information may include a location (latitude and longitude) in which the image is generated or tag information.

0162The response recommender <b>128</b> may receive a search result value srch.rst by transmitting the keyword kw[m] to the web search engine <b>129</b>. For example, the search result value srch.rst may include an image of Boston, an address of a company, and a map application.

0163The response recommender <b>128</b> may receive at least one of the application related information ap.info, the content information cm.info, and the search result value srch.rst, and may generate the recommended response rcm.ans corresponding to the message um[n] by referring to the user information usr.info and the context information cnt.info.

2.3. Environment Settings

0164<figref idref="DRAWINGS">FIGS. <b>10</b>A through <b>10</b>D</figref> are views of an environment setting user interface which is provided by the electronic device <b>100</b> according to an exemplary embodiment.

0165A term “setting” may denote pre-determining an operation method of the electronic device <b>100</b> by a user's setting or a user's input to set a use environment of the electronic device <b>100</b>.

0166Referring to <figref idref="DRAWINGS">FIG. <b>10</b>A</figref>, the electronic device <b>100</b> may not provide the response related content or may provide the response related content to the user visually or auditorily according to the settings. When the electronic device <b>100</b> provides the response related content according to the settings, the electronic device <b>100</b> may provide the response related content automatically, semi-automatically, and manually.

0167That the electronic device <b>100</b> provides the response related content automatically according to the settings may denote that when the electronic device <b>100</b> determines that an exchanged message includes a question, the electronic device <b>100</b> provides the response related content with respect to the message without receiving an additional user input.

0168That the electronic device <b>100</b> provides the response related content semi-automatically according to the settings may denote that when the electronic device <b>100</b> determines that an exchanged message includes a question, the electronic device <b>100</b> provides the response related content with respect to the message if the electronic device <b>100</b> receives a user's simple input (a touch or tap input) with respect to the message.

0169For example, when the electronic device <b>100</b> provides the response related content semi-automatically, the electronic device <b>100</b> may display the message corresponding to the question so as to be distinguished from other messages. For example, the electronic device <b>100</b> may display a background color of the message corresponding to the question differently from other messages. For example, the electronic device <b>100</b> may display the message corresponding to the question by using an underline and/or a conspicuous color so as to be distinguished from other messages.

0170The user of the electronic device <b>100</b> may receive the content by touching or tapping the message marked by using one of the above methods. The electronic device <b>100</b> may obtain the response related content by receiving the touch or tap input of the user. The electronic device <b>100</b> may obtain and store the content related to a predicted response before the electronic device <b>100</b> receives the touch or tap input of the user, and then, may provide the response related content when receiving the touch or tap input of the user.

0171When the electronic device <b>100</b> is set to manually provide the response related content, the electronic device <b>100</b> provides the response related content with respect to the message, if the electronic device <b>100</b> determines an exchanged message as a question and identifies whether the user will receive the response related content by using the user input indicating that the user will receive the response related content.

0172Referring to <figref idref="DRAWINGS">FIG. <b>10</b>B</figref>, the electronic device <b>100</b> may provide the response related content by considering user-related conditions which are set in the settings.

0173For example, the electronic device <b>100</b> may provide the response related content by considering content related to a first user User<b>1</b> set in the settings. Also, for example, the electronic device <b>100</b> may provide the response related content with respect to a message exchanged by a second user User<b>2</b>. Also, for example, the electronic device <b>100</b> may provide the response related content only with respect to a message input by a third user User<b>3</b>.

0174Referring to <figref idref="DRAWINGS">FIG. <b>10</b>C</figref>, the electronic device <b>100</b> may provide the response related content by considering time related conditions which are set in the settings.

0175For example, when it is set in the settings to semi-automatically provide the response related content as illustrated in <figref idref="DRAWINGS">FIG. <b>10</b>A</figref>, the electronic device <b>100</b> may restrict the time period in which the message corresponding to a question is displayed such that the message corresponding to a question is distinguished from other messages. For example, the electronic device <b>100</b> may restrict the time period in which the message corresponding to a question is displayed so as to be distinguished from other messages to 10 seconds, 20 seconds, 30 seconds, or 1 minute. When the time period exceeds, the electronic device <b>100</b> may not any more display the message corresponding to a question so as to be distinguished from other messages.

0176Referring to <figref idref="DRAWINGS">FIG. <b>10</b>D</figref>, the electronic device <b>100</b> may provide the response related content by considering data conditions in the settings.

0177For example, the electronic device <b>100</b> may determine content of the question by referring to only data stored in the electronic device <b>100</b>. For example, the electronic device <b>100</b> may determine the content of the question by referring to only data stored in the electronic device <b>100</b> and the server <b>300</b>.

0178For example, the electronic device <b>100</b> may provide the response related content by referring to only the data stored in the electronic device <b>100</b>. For example, the electronic device <b>100</b> may provide the response related content by referring to only the data stored in the electronic device <b>100</b> and the server <b>300</b>.

0179In addition to the manners illustrated in <figref idref="DRAWINGS">FIGS. <b>10</b>A through <b>10</b>D</figref>, the electronic device <b>100</b> may operate in various manners, according to the settings. For example, the user of the electronic device <b>100</b> may set the settings such that the response related content is provided as a text, a sound, an image, etc. For example, the user of the electronic device <b>100</b> may set an interest area for which content needs to be provided. For example, the user of the electronic device <b>100</b> may set the interest area as items, such as sports, weather, politics, movies, economics, life, etc.

2.4. Service Provision Based on the Terminal

0180<figref idref="DRAWINGS">FIG. <b>11</b>A</figref> illustrates a method of providing the response related content via the electronic device <b>100</b>.

0181Referring to <figref idref="DRAWINGS">FIG. <b>11</b>A</figref>, the electronic device <b>100</b> may receive a message from the device of another user <b>200</b> in operation S<b>210</b>. The electronic device <b>100</b> may continuously receive the message from the device of another user <b>200</b>. The electronic device <b>100</b> may receive the message from the device of another user <b>200</b> via the server <b>300</b>.

0182The electronic device <b>100</b> may determine whether the message received from the device of another user <b>200</b> includes a question in operation S<b>220</b>. The electronic device <b>100</b> may divide a sentence used in the message into grammatical units and extract the relationship among the grammatical units. The electronic device <b>100</b> may determine whether the received message is a question based on a result of this operation.

0183The electronic device <b>100</b> may extract a keyword from the message received from the device of another user <b>200</b> in operation S<b>230</b>. The electronic device <b>100</b> may extract the keyword from the received message by performing a natural language analysis. When the electronic device <b>100</b> extracts the keyword, the electronic device <b>100</b> may extract the keyword by referring to data that is input by the user or recorded data regarding the user.

0184The electronic device <b>100</b> may obtain the content which may be used in responding to the message based on the keyword in operation S<b>250</b>. The electronic device <b>100</b> may obtain the content by performing various searches based on the extracted keyword. The content that the electronic device <b>100</b> obtains may include a two-dimensional image, a three-dimensional image, a two-dimensional video, a three-dimensional video, text replies including various languages, content of various fields, and content regarding application services providing various services.

0185The electronic device <b>100</b> may provide at least one piece of obtained content in operation S<b>270</b>. For example, the electronic device <b>100</b> may provide the at least one piece of obtained content to the user via at least one of a sound, an image, and a text.

0186<figref idref="DRAWINGS">FIG. <b>11</b>B</figref> illustrates a method of providing the response related content via the electronic device <b>100</b>.

0187Referring to <figref idref="DRAWINGS">FIG. <b>11</b>B</figref>, the electronic device <b>100</b> may receive a message from the device of another user <b>200</b> in operation S<b>310</b>.

0188The electronic device <b>100</b> may determine whether to receive the content which may be used in responding to the message received from the device of another user <b>200</b>, in operation S<b>320</b>. For example, the electronic device <b>100</b> may determine whether to receive the content which may be used in responding to the received message, based on user configurations which are set via settings.

0189The electronic device <b>100</b> may extract a keyword from the message received from the device of another user <b>200</b> in operation S<b>330</b>. The electronic device <b>100</b> may extract the keyword by performing a natural language analysis to determine a meaning of the message.

0190The electronic device <b>100</b> may obtain the content which may be used in responding to the message, based on the keyword, in operation S<b>350</b>. The electronic device <b>100</b> may obtain the content related to the keyword from an external search server. The electronic device <b>100</b> may obtain the content via an Internet search service. The electronic device <b>100</b> may obtain the related content stored in the electronic device <b>100</b>.

0191The electronic device <b>100</b> may provide a list of the obtained content in operation <b>5370</b>. The electronic device <b>100</b> may provide the content obtained based on the keyword to the user via various methods.

0192<figref idref="DRAWINGS">FIG. <b>11</b>C</figref> illustrates a method of providing the response related content via the electronic device <b>100</b>.

0193Referring to <figref idref="DRAWINGS">FIG. <b>11</b>C</figref>, the electronic device <b>100</b> may receive a message from the device of another user <b>200</b> in operation S<b>410</b>. The electronic device <b>100</b> may extract one or more keywords from the message received from the device of another user <b>200</b> in operation S<b>430</b>.

0194The electronic device <b>100</b> may set a priority order among the one or more keywords based on internal data of the electronic device <b>100</b> or an input by the user, in operation S<b>440</b>. The electronic device <b>100</b> may set the priority order among the keywords, which may be referred to for obtaining the content. For example, when the electronic device <b>100</b> may obtain the content based on the plurality of keywords, the electronic device <b>100</b> may first obtain the content based on the keyword which has a high priority order, and may later obtain the content based on the keyword which has a low priority order. For example, when the electronic device <b>100</b> may obtain the content based on the plurality of keywords, the electronic device <b>100</b> may first display the content based on the keyword which has a high priority order, and may later display the content based on the keyword which has a low priority order.

0195The electronic device <b>100</b> may obtain the content which may be used in responding to the message, based on the keyword, in operation S<b>450</b>, and may provide at least one piece of content via one or more methods, in operation S<b>470</b>.

0196<figref idref="DRAWINGS">FIG. <b>11</b>D</figref> illustrates a method of providing the response related content via the electronic device <b>100</b>.

0197Referring to <figref idref="DRAWINGS">FIG. <b>11</b>D</figref>, the electronic device <b>100</b> may receive a message from the device of another user <b>200</b> in operation S<b>510</b>.

0198The electronic device <b>100</b> may extract a keyword from the message received from the device of another user <b>200</b> in operation S<b>530</b>.

0199The electronic device <b>100</b> may analyze relational data between a user of the device of another user <b>200</b> and a user of the electronic device <b>100</b>, in operation S<b>540</b>. The relational data between the user of the other device <b>200</b> and the user of the electronic device <b>100</b> may refer to data stored in the electronic device <b>100</b> or the server <b>300</b>.

0200The electronic device <b>100</b> may obtain the content which may be used in responding to the message based on the analyzed relational data between the users or the keyword, in operation S<b>550</b>. Also, the electronic device <b>100</b> may provide at least one piece of content via one or more methods in operation S<b>570</b>.

0201<figref idref="DRAWINGS">FIG. <b>12</b>A</figref> is a flowchart for describing a method of providing the response related content via the electronic device <b>100</b>.

0202The electronic device <b>100</b> may receive a first message from the device of another user <b>200</b> in operation S<b>1005</b>. The electronic device <b>100</b> may receive the first message from the device of another user <b>200</b> via the server <b>300</b>.

0203The electronic device <b>100</b> may determine whether the first message received from the device of another user <b>200</b> includes a question in operation S<b>1010</b>. The electronic device <b>100</b> may determine whether the received first message includes a question by performing a natural language analysis.

0204When the received first message includes a question, the electronic device <b>100</b> may extract a keyword from the message in operation S<b>1020</b>.

0205The electronic device <b>100</b> may request the server <b>300</b> to obtain the content based on the keyword in operation S<b>1020</b>. The server <b>300</b> may obtain the content which may be used in responding to the message based on the keyword in operation S<b>1030</b>.

0206The server <b>300</b> may provide the content obtained based on the keyword to the electronic device <b>100</b> in operation S<b>1035</b>. The electronic device <b>100</b> may provide the obtained content in operation S<b>1040</b>.

0207The electronic device <b>100</b> may transmit a second message to the device of another user <b>200</b> in operation S<b>1045</b>. For example, the electronic device <b>100</b> may transmit the second message to the device of another user <b>200</b> by including at least one piece of the obtained content in the second message.

0208<figref idref="DRAWINGS">FIG. <b>12</b>B</figref> is a view of a module included in each of the electronic device <b>100</b> and the server <b>300</b>.

0209<figref idref="DRAWINGS">FIG. <b>12</b>B</figref> is an exemplary view for describing a method of obtaining the response related content via the electronic device <b>100</b>. Specific components included in the electronic device <b>100</b> and specific components included in the server <b>300</b> may be adjusted in one or more ways.

0210Referring to <figref idref="DRAWINGS">FIG. <b>12</b>B</figref>, the electronic device <b>100</b> may include the session manager <b>122</b>, the profiler <b>123</b>, the context analyzer <b>124</b>, and the response recommender <b>128</b>. The response recommender <b>128</b> may include the natural language processing unit (NLU) <b>121</b> and the response generator <b>125</b>.

0211The server <b>300</b> may include a content metadata storage <b>326</b> and an App register <b>327</b>.

0212The NLU <b>121</b> may analyze a meaning of the message received by the electronic device <b>100</b>. The NLU <b>121</b> may analyze the message via a statistical analysis method and a semantic analysis method, and transmit the analyzed message to the context analyzer <b>124</b>.

0213The session manager <b>122</b> may analyze the messages exchanged by the electronic device <b>100</b> in a group unit by checking and using a conversation partner, date and time at which the conversation takes place, conversation content, and a conversation environment with respect to the exchanged messages. The session manager <b>122</b> may group one or more messages exchanged by the electronic device <b>100</b> and define the group as a session. For example, the session manager <b>122</b> may transmit, for example, a message um[n] “where are you going in this afternoon?” to the response recommender <b>128</b>.

0214The response recommender <b>128</b> may receive the message um[n] from the session manager <b>122</b>, and the NLU <b>121</b> may generate a keyword kw[m] from the message um[n]. For example, the session manager <b>12</b> may transmit the message “where are you going in this afternoon?” to the response recommender <b>128</b>, and the NLU <b>121</b> may generate a schedule, an event, a location, a destination, or time as the keyword kw[m].

0215The profiler <b>123</b> may continuously collect, process, and store content regarding the user of the electronic device <b>100</b> and persons related to the user of the electronic device <b>100</b>. When the keyword kw[m] is generated, the response recommender <b>128</b> may receive user information usr.info related to the keyword kw[m] from the profiler <b>123</b> and refer to the user information usr.info. For example, the user information usr.info with respect to the message um[n] “where are you going in this afternoon?” may include the user information in an external service accountant and information about a user's home or company or places frequently visited by the user.

0216The context analyzer <b>124</b> may determine a meaning of each of messages exchanged by the electronic device <b>100</b>, based on meanings of the messages exchanged by the electronic device <b>100</b>. The context analyzer <b>124</b> may determine the meaning of each of messages exchanged by the electronic device <b>100</b> in a unit of one or more messages, the unit being defined by the session manager <b>122</b>. The response recommender <b>128</b> may receive the context information cnt.info from the context analyzer <b>124</b>.

0217For example, the context information cnt.info regarding the message um[n] “where are you going in this afternoon?” may include time information, GPS information, analyzed user schedule information, and recent logs. For example, the response recommender <b>128</b> may consider the context information cnt.info when the response recommender <b>128</b> generates a recommended response rcm.ans by using the keyword kw[m].

0218The electronic device <b>100</b> may receive application related information ap.info by transmitting the keyword kw[m] to the App register <b>327</b>. For example, the application related information ap.info with respect to the message um[n] “where are you going in this afternoon?” may include scheduler application related information, social network service application related information, and chatting application related information. For example, a first application may be a weather-related application installed in the electronic device <b>100</b>. For example, a second application may be a news related application which is not installed in the electronic device <b>100</b>.

0219The electronic device <b>100</b> may receive content information cm.info by transmitting the keyword kw[m] to the content metadata storage <b>326</b>. For example, the response recommender <b>128</b> may receive data about the weather related application and the news related application from the content metadata storage <b>326</b>. For example, the content information cm.info regarding the message um[n] “where are you going in this afternoon?” may include image specific information or schedule related information. For example, the image specific information may include a location (latitude, longitude) in which an image is generated.

0220The response recommender <b>128</b> of the electronic device <b>100</b> may receive at least one of the application related information ap.info and the content information cm.info from the server <b>300</b> and refer to the user information usr.info and the context information cnt.info to generate the recommended response rcm.ans corresponding to the message um[n].

0221The response generator <b>125</b> may generate the response related content with respect to the message. The response generator <b>125</b> may generate the content which may be used in responding to the message. The response generator <b>125</b> may provide the generated content to the user via an interface screen.

2.5. Service Provision Based on the Server

0222<figref idref="DRAWINGS">FIG. <b>13</b>A</figref> is a flowchart for describing a method of providing the response related content via the electronic device <b>100</b>.

0223The server <b>300</b> may receive a first message from the device of another user <b>200</b> in operation S<b>2010</b>. The server <b>300</b> may transmit the first message received from the device of another user <b>200</b> to the electronic device <b>100</b> in operation S<b>2020</b>.

0224The server <b>300</b> may determine whether the first message received from the device of another user <b>200</b> includes a question in operation S<b>2030</b>.

0225When the received first message includes a question, the server <b>300</b> may extract a keyword from the message in operation S<b>2040</b>.

0226The server <b>300</b> may obtain the content which may be used in responding to the message, based on the keyword, in operation S<b>2050</b>.

0227The server <b>300</b> may provide the content obtained based on the keyword to the electronic device <b>100</b>. The electronic device <b>100</b> may provide the obtained content in operation S<b>2060</b>.

0228The electronic device <b>100</b> may transmit a second message to the server <b>300</b> in operation S<b>2070</b>. For example, the electronic device <b>100</b> may transmit the second message to the server <b>300</b> by including at least one piece of obtained content in the second message. The server <b>300</b> may transmit the second message to the device of another user <b>200</b> in operation S<b>2080</b>.

0229In <figref idref="DRAWINGS">FIG. <b>13</b>A</figref>, operations S<b>2030</b>, S<b>2040</b>, and S<b>2050</b> are illustrated as being performed after the first message is transmitted to the electronic device <b>100</b> through operation S<b>2020</b>. However, the present embodiment is not limited thereto, and operations S<b>2030</b>, S<b>2040</b>, and S<b>2050</b> may be performed before the server <b>200</b> transmits the first message to the electronic device <b>100</b>. For example, the first message may be transmitted together with the content obtained in operation <b>2050</b>,

0230Alternatively, the device of anther user <b>200</b> may directly transmit the first message to the electronic device <b>100</b> before, at, or after the device of another user <b>200</b> transmits the first message to the server <b>300</b>. In that case, the server <b>200</b> may omit operation S<b>2020</b>.

0231According to another exemplary embodiment, the server <b>300</b> may provide online social networking services through a website or a mobile application. In that case, the server <b>300</b> may display the first message received from the device of another user <b>200</b> on the website or the mobile application rather than directly forwarding the first message to the electronic device <b>100</b> (operation S<b>2020</b>). The first message may be one of threaded comments posted by the device of another user <b>200</b> and/or other users. When the user of the electronic device <b>100</b> activates a comment input field by placing a cursor in the input field or touching the input field with his/her finger, the server <b>300</b> may perform operations S<b>2030</b>, S<b>2040</b>, and S<b>2050</b> with one of the comments posted on the website or the mobile application. For example, the server <b>300</b> may perform operations S<b>2030</b>, S<b>2040</b>, and S<b>2050</b> on comments which are posted most recently or selected by a user input.

0232<figref idref="DRAWINGS">FIG. <b>13</b>B</figref> is a view of a module included in each of the electronic device <b>100</b> and the server <b>300</b>.

0233<figref idref="DRAWINGS">FIG. <b>13</b>B</figref> is an exemplary view for describing a method of obtaining the response related content based on the server <b>300</b>. Specific components included in the electronic device <b>100</b> and specific components included in the server <b>300</b> may be adjusted via one or more methods.

0234Referring to <figref idref="DRAWINGS">FIG. <b>13</b>B</figref>, the electronic device <b>100</b> may include the profiler <b>123</b> and the context analyzer <b>124</b>.

0235The profiler <b>123</b> may continuously retain, process, and store content written by the user of the electronic device <b>100</b> or other users. The profiler <b>123</b> may transmit user information usr.info to the server <b>300</b> by receiving a request of the server <b>300</b>.

0236The context analyzer <b>124</b> may determine a meaning of each of messages exchanged by the electronic device <b>100</b>, based on meanings of the messages exchanged by the electronic device <b>100</b>. The context analyzer <b>124</b> may transmit context information cnt.info to the server <b>300</b> by receiving a request of the server <b>300</b>.

0237The server <b>300</b> may include a session manager <b>322</b>, the content metadata storage <b>326</b>, the App register <b>327</b>, and a response recommender <b>328</b>. The response recommender <b>328</b> may include the natural language processing unit NLU <b>321</b> and a response generator <b>325</b>.

0238The session manager <b>322</b> may determine a conversation partner, date and time in which the conversation takes place, conversation content, and conversation environments with respect to the messages exchanged by the electronic device <b>100</b> and may determine the messages exchanged by the electronic device <b>100</b> via the server <b>300</b> in a group unit. The session manager <b>322</b> may gather one or more messages exchanged by the electronic device <b>100</b> and define the gathered messages as a session. For example, the session manager <b>322</b> may transmit the received message um[n] to the response recommender <b>328</b>.

0239The response recommender <b>328</b> may receive the message um[n] from the session manager <b>322</b> and the NLU <b>321</b> may generate a keyword kw[m] from the message um[n]. For example, the session manager <b>322</b> may transmit a message “Is there a hot issue in Boston?” to the response recommender <b>328</b>, and the NLU <b>321</b> may generate news, issues, topic, and location as the keyword kw[m].

0240The response recommender <b>328</b> may receive user information usr.info from the profiler <b>123</b>. For example, when the keyword kw[m] is generated, the response recommender <b>328</b> may refer to the user information usr.info received from the profiler <b>123</b>. For example, the user information usr.info may include an age and a preference of the user. For example, the user information usr.info may include user information in an external service accountant.

0241The response recommender <b>328</b> may receive context information cnt.info from the context analyzer <b>124</b>. For example, the response recommender <b>328</b> may consider the context information cnt.info, when the response recommender <b>328</b> generates a recommended response rcm.ans by using the keyword kw[m]. The context information cnt.info may include time, an analyzed user schedule, and recent logs.

0242The response recommender <b>328</b> may receive at least one of application related information ap.info and content information cm.info and may refer to the user information usr.info and the context information cnt.info received from the electronic device <b>100</b>, to generate the recommended response rcm.ans corresponding to the message um[n]. For example, the application related information ap.info may include information of applications providing news, magazines, articles. For example, the content information cm.info may include articles, and images of Boston.

0243The response generator <b>325</b> may generate the response related content with respect to the message. The response generator <b>325</b> may generate the content which may be used in responding to the message. The response generator <b>325</b> may transmit the generated content to the electronic device <b>100</b>.

2.6. Service Provision Based on the Terminal and the Server

0244<figref idref="DRAWINGS">FIG. <b>14</b>A</figref> is a flowchart for describing a method of providing the response related content via the electronic device <b>100</b>.

0245The server <b>300</b> may receive a first message from the device of another user <b>200</b> in operation S<b>3010</b>. The server <b>300</b> may transmit the first message received from the device of another user <b>200</b> to the electronic device <b>100</b> in operation S<b>3020</b>.

0246The server <b>300</b> may determine whether the first message received from the device of another user <b>200</b> includes a question in operation S<b>3030</b>. The server <b>300</b> may determine whether the first message includes a question after transmitting the first message to the electronic device <b>100</b>, and may determine whether the first message includes a question before transmitting the first message to the electronic device <b>100</b>.

0247When the received first message includes a question, the server <b>300</b> may extract a keyword from the message in operation S<b>3040</b>. The server <b>300</b> may transmit the keyword to the electronic device <b>100</b> in operation S<b>3045</b>.

0248The electronic device <b>100</b> may obtain the content which may be used in responding to the message based on the keyword, in operation S<b>3050</b>. The electronic device <b>100</b> may display the content obtained based on the keyword.

0249The electronic device <b>100</b> may transmit a second message to the server <b>300</b> in operation S<b>3060</b>. For example, the electronic device <b>100</b> may transmit the second message to the server <b>300</b> by including at least one piece of obtained content in the second message. The server <b>300</b> may transmit the second message to the device of another user <b>200</b> in operation S<b>3070</b>.

0250The sever <b>300</b> may perform operations S<b>3030</b> and S<b>3040</b> before transmitting the first message, and may transmit the first message and the keyword to the electronic device <b>100</b> at substantially the same time. Alternatively, the device of anther user <b>200</b> may directly transmit the first message to the electronic device <b>100</b> before, at, or after the device of another user <b>200</b> transmits the first message to the server <b>300</b>. In that case, the server <b>300</b> may omit operation S<b>3020</b>.

0251<figref idref="DRAWINGS">FIG. <b>14</b>B</figref> is a view of a module included in each of the electronic device <b>100</b> and the server <b>300</b>.

0252<figref idref="DRAWINGS">FIG. <b>14</b>B</figref> is an exemplary view for describing a method of obtaining the response related content, based on the server <b>300</b>. Specific components included in the electronic device <b>100</b> and specific components included in the server <b>300</b> may be adjusted in one or more ways.

0253Referring to <figref idref="DRAWINGS">FIG. <b>14</b>B</figref>, the electronic device <b>100</b> may include the first profiler <b>123</b>, the content metadata storage <b>126</b>, and the App register <b>127</b>.

0254The first profiler <b>123</b> may collect and store data regarding a user of the electronic device <b>100</b> or another user. The data regarding the user may include a name, a job, a telephone number, an interest field, a friend relationship, and a movement record of the user. The first profiler <b>123</b> may keep, process, and store content written by the user of the electronic device <b>100</b>. The content written by the user of the electronic device <b>100</b> may include a message, a memo, a reply, and a comment written by the user.

0255The content metadata storage <b>126</b> may include various types of data with respect to the content. For example, the content metadata storage <b>126</b> may include data regarding types of an application. Also, for example, the content metadata storage <b>126</b> may include metadata, such as a date of image generation, and a place of image generation.

0256Also, for example, the content metadata storage <b>126</b> may continuously collect and store data with respect to various types of web content on the Internet and data with respect to various types of content of the electronic device <b>100</b>.

0257The App register <b>127</b> may include data regarding various applications. For example, the App register <b>127</b> may store data regarding at least one of a first application installed in the electronic device <b>100</b> and a second application not installed in the electronic device <b>100</b>.

0258The server <b>300</b> may include the NLU <b>321</b>, the session manager <b>322</b>, a second profiler <b>323</b>, the context analyzer <b>324</b>, and the response generator <b>325</b>.

0259The session manager <b>322</b> may analyze messages exchanged by the server <b>300</b> in a group unit by checking and using conversation participants, date and time of conversation, conversation content, and conversation environments of the messages exchanged by the server <b>300</b>. The session manager <b>322</b> may gather one or more messages exchanged by the server <b>300</b> and define the gathered messages as a session.

0260The NLU <b>321</b> may analyze a meaning of a first message received by the server <b>300</b>. The NLU <b>321</b> may analyze the first message by a statistical analysis method and a semantic analysis method and transmit the analyzed meaning to the context analyzer <b>324</b>.

0261The context analyzer <b>324</b> may determine a meaning of each of messages exchanged by the electronic device <b>100</b> based on meanings of the messages exchanged by the electronic device <b>100</b>. The context analyzer <b>324</b> may determine the meaning of each of messages exchanged by the electronic device <b>100</b> in a unit of one or more messages, the unit being defined by the session manager <b>322</b>.

0262The response recommender <b>328</b> may receive at least one of user information usr.info[p] and context information cnt.info and may refer to the user information usr.info[p], application related information ap.info, and content information cm.info received from the electronic device <b>100</b>, to generate a recommended response rcm.ans corresponding to the message um[n]. The server <b>300</b> may transmit the recommended response rcm.ans to the electronic device <b>100</b>.

2.7. Analysis of the Relationship of Conversation Participants

0263<figref idref="DRAWINGS">FIG. <b>15</b></figref> is a view for describing a method of utilizing information stored in a database <b>370</b> of the server <b>300</b> to figure a relationship between users.

0264Referring to <figref idref="DRAWINGS">FIG. <b>15</b></figref>, the server <b>300</b> may collect, manage, and analyze information of the users via the database <b>370</b> and a database manager <b>360</b>.

0265The database <b>370</b> may include data with respect to various users. For example, the database <b>370</b> may store information regarding a user related to the user of the electronic device <b>100</b>. For example, the database <b>370</b> may include data regarding a level of intimacy between a user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>.

0266The database manager <b>360</b> may manage the database <b>370</b>. The database manager <b>360</b> may manage various types of data recorded in the database <b>370</b>, and may provide the data managed by the database manager <b>360</b> to the electronic device <b>100</b> in response to a request of the electronic device <b>100</b>.

0267The database manager <b>360</b> may manage records for each user written in the database <b>370</b>. Also, the database manager <b>360</b> may manage records for each group written in the database <b>370</b>. The database manager <b>360</b> may transmit the data requested by the electronic device <b>100</b> to the electronic device <b>100</b>.

0268The electronic device <b>100</b> may edit and manage information stored in the server <b>300</b> via a relationship finder <b>140</b>, an intimacy analyzer <b>150</b>, and a friend list database <b>190</b>.

0269The relationship finder <b>140</b> may determine a relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. The relationship finder <b>140</b> may receive the information about the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by requesting the information from the database manager <b>360</b> included in the server <b>300</b>, and may determine the relationship between the users. The relationship finder <b>140</b> may determine the relationship between the users by analyzing previous call records and conversation content between the users.

0270The intimacy analyzer <b>150</b> may analyze the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. For example, the intimacy analyzer <b>150</b> may calculate the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> as quantified data (for example, data such as 1, 2, 3, and 10, or data such as a first level, a second level, and a third level). For example, the intimacy analyzer <b>150</b> may determine which of one or more predetermined categories the intimacy level between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> belongs to. For example, the intimacy analyzer <b>150</b> may analyze the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> in such a way that the intimacy analyzer <b>150</b> selects the intimacy level from among categories, such as a “family,” a “friend,” a “colleague,” or a “school mate.”

0271The friend list database <b>190</b> may store data analyzed by the relationship finder <b>140</b> and the intimacy analyzer <b>150</b>, based on a relationship that a user has with respect to the user of the electronic device <b>100</b>. Here, information included in the friend list database <b>190</b> may correspond to not only information about friends of the user of the electronic device <b>100</b>, the friends as in a social context, but also information about all persons who may be accessed by the electronic device <b>100</b>, such as families, alumni, colleagues, and relatives.

0272For example, the friend list database <b>190</b> may store information that the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> are friends in a social network service (SNS). For example, the friend list database <b>190</b> may store information that the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> are family members or relatives. For example, the friend list database <b>190</b> may store information that the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> are an employee and an employer of a company. For example, the friend list database <b>190</b> may store information that the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> are school alumni.

0273<figref idref="DRAWINGS">FIG. <b>16</b></figref> is a view for describing a method of utilizing information stored in the database <b>170</b> of the electronic device <b>100</b> to determine a relationship between users.

0274Referring to <figref idref="DRAWINGS">FIG. <b>16</b></figref>, the electronic device <b>100</b> may collect, manage, and analyze information about the users via the database <b>170</b>, a database analyzer <b>160</b>, the relationship finder <b>140</b>, the intimacy analyzer <b>150</b>, and the friend list database <b>190</b>.

0275The database <b>170</b> may include data corresponding to phone records between the user of the electronic device <b>100</b> and various users. For example, the database <b>170</b> may store information about phone records between the user of the electronic device <b>100</b> and other users, in real time. For example, the phone records may include calling time, calling places, calling start time, calling end time, and calling methods (voice or message).

0276Also, the database <b>170</b> may include data written in an address book or a contact list of the user of the electronic device <b>100</b>. For example, the database <b>170</b> may include information, such as a company name, a job, and a family relation of a friend.

0277The database analyzer <b>160</b> may analyze and manage data such as the phone records or the address list included in the database <b>170</b>. The database analyzer <b>160</b> may analyze various types of data written in the database <b>170</b> and may provide a result of the analysis of the data, in response to a request of the relationship finder <b>140</b> or the intimacy analyzer <b>150</b>.

0278The database analyzer <b>160</b> may manage the record written in the database <b>170</b> for each individual. Also, the database analyzer <b>160</b> may manage the record written in the database <b>170</b> for each group. The database analyzer <b>160</b> may transmit the data requested by the relationship finder <b>140</b> or the intimacy analyzer <b>150</b> to the electronic device <b>100</b>.

0279The relationship finder <b>140</b> may determine a relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by requesting the database analyzer <b>160</b>. The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by analyzing previous call records between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>.

0280The intimacy analyzer <b>150</b> may analyze a level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. For example, the intimacy analyzer <b>150</b> may calculate the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> as quantified data (for example, data such as 1, 2, 3, and 10, or data such as a first level, a second level, and a third level). For example, the intimacy analyzer <b>150</b> may analyze the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> in such a way that the intimacy analyzer <b>150</b> selects the level of intimacy from among categories, such as a “family,” a “friend,” a “colleague,” or a “school mate.”

0281The friend list database <b>190</b> may store the data analyzed by the relationship finder <b>140</b> and the intimacy analyzer <b>150</b>, based on a relationship that a user has with respect to the user of the electronic device <b>100</b>. The friend list database <b>190</b> of <figref idref="DRAWINGS">FIG. <b>16</b></figref> is similar to the friend list database <b>190</b> of <figref idref="DRAWINGS">FIG. <b>15</b></figref>.

0282<figref idref="DRAWINGS">FIG. <b>17</b></figref> is a view for describing a method of utilizing information stored in the database <b>170</b> of the electronic device <b>100</b> and information stored in a database <b>370</b> of the server <b>300</b>, to determine a relationship between a user of the electronic device <b>100</b> and a user of the device of another user <b>200</b>.

0283Referring to <figref idref="DRAWINGS">FIG. <b>17</b></figref>, the electronic device <b>100</b> may collect, manage, and analyze information related to the users via the database <b>170</b>, the database analyzer <b>160</b>, the relationship finder <b>140</b>, the intimacy analyzer <b>150</b>, and the friend list database <b>190</b>. The database <b>170</b> and the database analyzer <b>160</b> of <figref idref="DRAWINGS">FIG. <b>17</b></figref> are similar to the database <b>170</b> and the database analyzer <b>160</b> of <figref idref="DRAWINGS">FIG. <b>16</b></figref>. Hereinafter, repeated descriptions will be omitted.

0284The server <b>300</b> may include the database <b>370</b> and the database manager <b>360</b>. The database <b>370</b> and the database manager <b>360</b> of <figref idref="DRAWINGS">FIG. <b>17</b></figref> are similar to the database <b>370</b> and the database manager <b>360</b> of <figref idref="DRAWINGS">FIG. <b>15</b></figref>. Hereinafter, repeated descriptions will be omitted.

0285The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by requesting at least one of the database analyzer <b>160</b> and the database manager <b>360</b>. The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by analyzing previous phone records between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. The relationship finder <b>140</b> may determine the relationship between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by analyzing conversation content between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>.

0286The intimacy analyzer <b>150</b> may analyze a level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b>. The intimacy analyzer <b>150</b> may analyze the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> by requesting at least one of the database analyzer <b>160</b> and the database manager <b>360</b>.

0287For example, the intimacy analyzer <b>150</b> may calculate the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> as quantified data (for example, data such as 1, 2, 3, and 10, or data such as a first level, a second level, and a third level). For example, the intimacy analyzer <b>150</b> may determine which of one or more predetermined categories the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> belongs to. For example, the intimacy analyzer <b>150</b> may analyze the level of intimacy between the user of the device of another user <b>200</b> and the user of the electronic device <b>100</b> in such a way that the intimacy analyzer <b>150</b> selects the level of intimacy from among categories, such as a “family,” a “friend,” a “colleague,” or a “school mate.”

0288The friend list database <b>190</b> may store the data analyzed in the relationship finder <b>140</b> and the intimacy analyzer <b>150</b>, based on a relationship that a user has with respect to the user of the electronic device <b>100</b>.

0289Also, according to another exemplary embodiment, at least one of the relationship finder <b>140</b>, the intimacy analyzer <b>150</b>, and the friend list database <b>190</b> may be included in the server <b>300</b>.

3. Scenario 2

3.1. Identification with Respect to Content Obtainment

0290<figref idref="DRAWINGS">FIGS. <b>18</b>, <b>19</b>A through <b>19</b>D, <b>20</b>A through <b>20</b>D, <b>21</b>, <b>22</b>A, <b>22</b>B, <b>23</b>A through <b>23</b>C, and <b>23</b>A through <b>24</b>E</figref> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>18</b>, <b>19</b>A through <b>19</b>D, <b>20</b>A through <b>20</b>D, <b>21</b>, <b>22</b>A, <b>22</b>B, <b>23</b>A through <b>23</b>C, and <b>23</b>A through <b>24</b>E</figref> are views of a user interface according to steps of a scenario in which the electronic device <b>100</b> provides a text chatting service, and directly provides to a user an image and a recommended application, as response related content.

0291Referring to <figref idref="DRAWINGS">FIG. <b>18</b></figref>, Chris, the user of the electronic device <b>100</b> is performing a text chatting with Hyunjin, the user of the device of another user <b>200</b>.

0292The electronic device <b>100</b> displays the name of the user of the electronic device <b>100</b> via the user name box <b>40</b>. According to another exemplary embodiment, the electronic device <b>100</b> may display the name of the user of the device of another user <b>200</b> via the user name box <b>40</b>.<b>0</b>

0293The electronic device <b>100</b> receives the message <b>50</b> “Hi” from the device of another user <b>200</b> at 8:26 on Aug. 6, 2013. The electronic device <b>100</b> transmits the message <b>51</b> to the device of another user <b>200</b> and receives the message <b>52</b> from the device of another user <b>200</b>. The user of the electronic device <b>100</b> receives the message “where are you?” from Hyunjin.

0294The electronic device <b>100</b> may determine whether each of the messages <b>50</b>, <b>51</b>, <b>52</b>, and <b>53</b> includes a question. For example, the electronic device <b>100</b> may determine that the messages <b>50</b>, <b>51</b>, and <b>52</b> do not include questions, and the message <b>53</b> includes a question.

0295For example, the electronic device <b>100</b> may mark the message which is determined as a question such that the message determined as a question is distinguished from other messages, as illustrated in <figref idref="DRAWINGS">FIGS. <b>19</b>A through <b>19</b>C</figref>. For example, the electronic device <b>100</b> may mark the message corresponding to the question by using an underline as illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>A</figref>. For example, the electronic device <b>100</b> may mark the message corresponding to the question by using a shadow for the text, as illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>B</figref>. For example, the electronic device <b>100</b> may mark the message corresponding to the question by using a shadow for a speech bubble, as illustrated in <figref idref="DRAWINGS">FIG. <b>190</b></figref>.

0296When the electronic device <b>100</b> receives a user input corresponding to the portion marked so as to be distinguished from other messages, the electronic device <b>100</b> may display content which may be used in responding to the message.

0297For example, when the message <b>53</b> is determined as the question, the electronic device <b>100</b> may receive a user input indicating whether a recommended response is required, via the pop-up window <b>60</b>, as illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>D</figref>.

3.2. Proposal of Content

0298Referring to <figref idref="DRAWINGS">FIGS. <b>20</b>A through <b>20</b>D</figref>, the electronic device <b>100</b> may display the content which may be used in responding to the message <b>53</b>, in response to the user input.

0299Referring to <figref idref="DRAWINGS">FIG. <b>20</b>A</figref>, the electronic device <b>100</b> may recommend an application related to the message corresponding to the question, when the electronic device <b>100</b> receives a user input (for example, a touch) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>C</figref>. For example, the electronic device <b>100</b> may recommend a map application or a navigation application when the message corresponding to the question is related to a location.

0300Referring to <figref idref="DRAWINGS">FIG. <b>20</b>B</figref>, the electronic device <b>100</b> may recommend an application related to the message corresponding to the question, when the electronic device <b>100</b> receives a user input (for example, a user input touching a YES button) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>D</figref>. For example, when the message corresponding to the question is related to a location, the electronic device <b>100</b> may recommend a map application or a navigation application.

0301Referring to <figref idref="DRAWINGS">FIG. <b>20</b>C</figref>, the electronic device <b>100</b> may recommend at least one of an application and an image related to the message corresponding to the question, when the electronic device <b>100</b> receives a user input (for example, a user input touching a YES button) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>D</figref>.

0302The electronic device <b>100</b> may recommend at least one of the application and the image which may be used in responding to the message, by considering the relationship between the user of the electronic device <b>100</b> and the user of the device of another user <b>200</b>, according to the exemplary method described by referring to <figref idref="DRAWINGS">FIGS. <b>15</b> through <b>17</b></figref>.

0303For example, the electronic device <b>100</b> may recommend at least one of the application and the image, except a personal picture of the user of the electronic device <b>100</b>, when the electronic device <b>100</b> determines that the user of the electronic device <b>100</b> and the user of the device of another user <b>200</b> have a relationship that is an employer and an employee. For example, if the user of the electronic device <b>100</b> takes a vacation in London now, the electronic device <b>100</b> may not recommend a picture taken in the vacation as the response, by considering that the relationship between conversation participants is business-related. The electronic device <b>100</b> may classify the vacation picture as personal data and store the classification information in connection with the vacation picture. The electronic device <b>100</b> may not suggest any data classified as personal data when the level of intimacy (e.g., level <b>2</b>) of the user of another device <b>200</b> is lower than a predetermined level (e.g., level <b>7</b>).

0304Referring to <figref idref="DRAWINGS">FIG. <b>20</b>D</figref>, the electronic device <b>100</b> may recommend at least one of an application, a direct response, and an image, which are related to the message corresponding to the question, when the electronic device <b>100</b> receives a user input (for example, a user input touching a YES button) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>19</b>D</figref>.

0305The electronic device <b>100</b> may recommend at least one of the application, the direct response, and the image which may be used in responding to the message, by considering the relationship between the user of the electronic device <b>100</b> and the user of the device of another user <b>200</b>, according to the exemplary method described with reference to <figref idref="DRAWINGS">FIGS. <b>15</b> through <b>17</b></figref>. In this specification, the direct response may denote a sentence, a phrase, a word, etc. which may become a response with respect to the message, without an additional search.

0306For example, when the electronic device <b>100</b> determines that the user of the electronic device <b>100</b> and the user of the device of another user <b>200</b> have a relationship that has a high level of intimacy, such as families or friends, the electronic device <b>100</b> may provide the content which may be used in responding to the message, the content including an personal picture of the user of the electronic device <b>100</b>. For example, if the user of the electronic device <b>100</b> currently takes a vacation in London, the electronic device <b>100</b> may recommend a picture taken in the vacation as the response, by considering that the conversation participants have a personal relationship.

3.3. Specific Response Situation

0307<figref idref="DRAWINGS">FIGS. <b>21</b>, <b>22</b>A, <b>22</b>B, <b>23</b>A through <b>23</b>C, and <b>23</b>A through <b>24</b>E</figref> are views illustrating a process in which a user selects response related content proposed by the electronic device <b>100</b> and provides the response related content to the device of another user <b>200</b>.

0308Referring to <figref idref="DRAWINGS">FIG. <b>21</b></figref>, the user of the electronic device <b>100</b> may select a map application from among the recommended response related content illustrated in <figref idref="DRAWINGS">FIG. <b>20</b>D</figref>.

0309Referring to <figref idref="DRAWINGS">FIG. <b>22</b>A</figref>, the electronic device <b>100</b> may request the user to identify whether to edit the content, via a pop-up window <b>70</b>. For example, when the user wants to use the content provided by the application without an additional edit thereof, the user may select a response indicating no edit of the content.

0310Referring to <figref idref="DRAWINGS">FIG. <b>22</b>B</figref>, when the electronic device <b>100</b> identifies that the user does not want to edit the selected content, the electronic device <b>100</b> may provide a screen indicating a current location of the user in the map application selected in <figref idref="DRAWINGS">FIG. <b>21</b></figref> to the device of another user <b>200</b> via a message, without an additional edit of the screen.

0311Referring to <figref idref="DRAWINGS">FIG. <b>23</b>A</figref>, the electronic device <b>100</b> may request the user to identify whether to edit the content, via the pop-up window <b>70</b>. For example, when the user wants to make a response by editing the content provided by the application, the user may select a response indicating an edit of the content.

0312Referring to <figref idref="DRAWINGS">FIG. <b>23</b>B</figref>, when the electronic device <b>100</b> identifies that the user wants to edit the selected content, the electronic device <b>100</b> may search the current location of the user in the map application selected in <figref idref="DRAWINGS">FIG. <b>21</b></figref> for the user to edit a screen indicating the current location of the user, and may display a screen corresponding to a search result.

0313Referring to <figref idref="DRAWINGS">FIG. <b>23</b>C</figref>, the electronic device <b>100</b> may transmit a screen which is the result of editing the search result provided by the map application, via the user, to the device of another user <b>200</b>, via a message.

3.4. Feedback Situation

0314<figref idref="DRAWINGS">FIGS. <b>24</b>A through <b>24</b>E</figref> are views of a user interface via which a user feedback is received with respect to the provision of content which may be used in responses, according to an exemplary embodiment.

0315Referring to <figref idref="DRAWINGS">FIG. <b>24</b>A</figref>, the electronic device <b>100</b> may ask the user whether the user is satisfied with the providing of the content which may be used in responses, via a pop-up window <b>80</b>.

0316Referring to <figref idref="DRAWINGS">FIGS. <b>24</b>B through <b>24</b>D</figref>, when the user has answered via the pop-up window <b>80</b> that the user was not satisfied with the providing of the content, the electronic device <b>100</b> may provide pop-up windows <b>81</b>, <b>82</b>, <b>83</b>, <b>84</b>, and <b>85</b> via which the user may select categories which the user wants to add or exclude for the later providing of the content which may be used in responses.

0317Referring to <figref idref="DRAWINGS">FIG. <b>24</b>E</figref>, when the user has answered via the pop-up window <b>80</b> that the user was not satisfied with the providing of the content, the electronic device <b>100</b> may provide pop-up windows <b>86</b> and <b>87</b> via which the user may select an environment setting which the user wants to adjust with respect to the later providing of the content which may be used in responses.

0318According to another exemplary embodiment, the electronic device <b>100</b> may determine user's category preference without using the survey pop-up windows <b>81</b>, <b>82</b>, <b>83</b>, <b>53</b>, and <b>85</b>, To this end, the electronic device <b>100</b> may automatically store category information of content selected by the user every time a selection is made, and count the number of times that each category is selected. Recommended response may be displayed in the order of category preference.

3.5. Layout of the Proposed Response

0319<figref idref="DRAWINGS">FIGS. <b>25</b>A through <b>25</b>E</figref> are views of a content providing screen, when content which may be used in responses is provided, according to an exemplary embodiment.

0320Referring to <figref idref="DRAWINGS">FIG. <b>25</b>A</figref>, the electronic device <b>100</b> may provide the content by a screen division method. The electronic device <b>100</b> may display a recommended content list <b>90</b>, a recommended content list <b>91</b>, and a recommended application list <b>92</b>. For example, when a user touches the recommended content list <b>90</b> in a first scene Scene #1, the electronic device <b>100</b> is transformed into a second scene Scene #2 to transmit the recommended content list <b>90</b> to a device of another user. For example, the electronic device <b>100</b> may transmit the recommended content list <b>90</b> to the device of another user via a message.

0321Referring to <figref idref="DRAWINGS">FIG. <b>25</b>B</figref>, the electronic device <b>100</b> may provide the content by a screen transformation method. The electronic device <b>100</b> may display summarized response related content <b>92</b> in a third scene Scene #3, and may display specific response related content <b>93</b>, <b>94</b>, and <b>95</b> in a fourth scene Scene #4. The electronic device <b>100</b> may display the fourth scene Scene #4 when the user touches or taps the third scene Scene #3.

0322Referring to <figref idref="DRAWINGS">FIG. <b>25</b>C</figref>, the electronic device <b>100</b> may display an image, an application, or a direct possible response. The electronic device <b>100</b> may display the content which may be used in responses by one or more methods and arrangements.

0323Referring to <figref idref="DRAWINGS">FIG. <b>25</b>D</figref>, the electronic device <b>100</b> may provide the content which may be used in responses via a voice of an avatar.

0324Referring to <figref idref="DRAWINGS">FIG. <b>25</b>E</figref>, when the electronic device <b>100</b> is a smart watch, the electronic device <b>100</b> may provide the recommended content via a summary screen <b>97</b>. When a user touches or taps a move button <b>98</b>, the electronic device <b>100</b> may display another summary screen.

0325<figref idref="DRAWINGS">FIG. <b>26</b></figref> is a view of the electronic device <b>100</b> providing an interface via which a content providing layout is adjusted.

0326Referring to <figref idref="DRAWINGS">FIG. <b>26</b></figref>, the electronic device <b>100</b> may receive a user feedback regarding whether to change a layout of the content provision, via a pop-up window <b>99</b>, and may select various content providing layouts according to a selection of the user.

4. Scenario 3

4.1. Identification with Respect to Content Obtainment

0327<figref idref="DRAWINGS">FIGS. <b>27</b> through <b>37</b></figref> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>27</b> through <b>37</b></figref> are views of a user interface according to operations of a scenario in which the electronic device <b>100</b> provides a voice chatting service, and provides an image, a recommended application, and a direct response, to a user, as the response related content.

0328Referring to <figref idref="DRAWINGS">FIG. <b>27</b></figref>, Chris, the user of the electronic device <b>100</b>, is performing a voice chatting with Hyunjin, the user of the device of another user <b>200</b>. The electronic device <b>100</b> and the device of another user <b>200</b> may divide the conversation in a message unit.

0329Referring to <figref idref="DRAWINGS">FIG. <b>28</b></figref>, the electronic device <b>100</b> may receive each of voice messages and perform a speech to text (STT) transformation with respect to the message according to illustrated orders.

0330The electronic device <b>100</b> may identify which language each voice message is formed of in operation S<b>4010</b>. For example, the electronic device <b>100</b> may identify whether each voice message is formed of the English language or the Korean language.

0331The electronic device <b>100</b> may transform each voice message into a text of the identified language in operation S<b>4030</b>. For example, when the electronic device <b>100</b> determines that a first voice message is formed of the English language, the electronic device <b>100</b> may transform the first voice message into an English text.

0332The electronic device <b>100</b> may display the transformed text in operation S<b>4050</b>. For example, the electronic device <b>100</b> may transform the first voice message into the English text and may display the English text via a display unit (or an output interface).

0333Referring to <figref idref="DRAWINGS">FIG. <b>29</b></figref>, the electronic device of Chris receives the message <b>55</b> “Where is he?” from the electronic device of Hyunjin. The electronic device <b>100</b> may determine whether each of messages is a question. For example, the electronic device <b>100</b> may determine whether the message <b>55</b> is a question. The electronic device <b>100</b> may determine who “he” included in the message <b>55</b> “Where is he?” refers to, by performing a natural language analysis.

4.2. User Input Reception

0334Referring to <figref idref="DRAWINGS">FIG. <b>30</b></figref>, when the electronic device <b>100</b> determines that the message includes a question, the electronic device <b>100</b> may receive a user input indicating whether the user needs a recommended response.

0335For example, when the electronic device <b>100</b> determines that the message <b>55</b> “Where is he?” is a question, the electronic device <b>100</b> may check whether the user needs a recommended response, via the pop-up window <b>63</b>, as illustrated in <figref idref="DRAWINGS">FIG. <b>30</b></figref>. When the user touches a “Yes” button indicating that the user wants to receive content which may be used in responses, in correspondence to the pop-up window <b>63</b>, the electronic device <b>100</b> may display various types of obtained content. Alternatively, the electronic device <b>100</b> may omit to display the pop-up window <b>63</b> according to a user setting, and may provide a recommended response once the message <b>55</b> is determined as an inquiry message.

4.3. Specific Proposal Situations

0336Referring to <figref idref="DRAWINGS">FIG. <b>31</b></figref>, the electronic device <b>100</b> may provide images <b>74</b>_a, <b>74</b>_b, and <b>74</b>_c, applications <b>75</b>_a, <b>75</b>_b, and <b>75</b>_c, and a possible direct answer <b>76</b>.

0337Referring to <figref idref="DRAWINGS">FIG. <b>32</b></figref>, the user may select the image <b>74</b>_b from among the content which may be used in responses. The electronic device <b>100</b> may receive a user input. For example, the user input may be a touch input selecting the image <b>74</b>_b.

0338Referring to <figref idref="DRAWINGS">FIG. <b>33</b></figref>, the electronic device <b>100</b> may identify whether to edit the selected content, via the pop-up window <b>64</b>. The user may touch a “No” button indicating that the user wants to use the selected content as the response without editing the selected content, via the pop-up window <b>64</b>.

0339Referring to <figref idref="DRAWINGS">FIG. <b>34</b></figref>, when the user checks that the user wants to use the selected content without editing the content via the pop-up window <b>64</b>, the electronic device <b>100</b> may transmit the image <b>74</b>_b to the conversation partner, via the message <b>56</b>.

0340Referring to <figref idref="DRAWINGS">FIG. <b>35</b></figref>, the electronic device <b>100</b> may identify whether to edit the selected content via the pop-up window <b>64</b>. The user may touch a “Yes” button indicating that the user wants to use the selected content as the response by editing the content, via the pop-up window <b>64</b>.

0341Referring to <figref idref="DRAWINGS">FIG. <b>36</b></figref>, when the user touches the “Yes” button indicating that the user wants to use the selected content as the response by editing the content, via the pop-up window <b>64</b>, the electronic device <b>100</b> may provide the user with an image edition environment <b>65</b>. The user may edit the image <b>74</b>_b via the image edit environment <b>65</b>.

0342Referring to <figref idref="DRAWINGS">FIG. <b>37</b></figref>, when the user finishes editing the image <b>74</b>_b, the electronic device <b>100</b> may provide the image <b>74</b>_b to the user of the electronic device, the user of the device of another user, or a third user, via a mailing service or a social network service, according to a selection of the user of the electronic device <b>100</b>. Also, the electronic device <b>100</b> may provide the image <b>74</b>_b to the user of the electronic device, the user of the device of another user, or the third user, regardless of the selection of the user.

5. Scenario 4

5.1. Identification with Respect to Content Obtainment

0343<figref idref="DRAWINGS">FIGS. <b>38</b>, <b>42</b>, <b>43</b>A, <b>43</b>B, <b>44</b>, <b>45</b>, <b>46</b>A, <b>46</b>B, <b>47</b>, <b>48</b>, <b>50</b>A through <b>50</b>D, <b>51</b>A through <b>51</b>D, <b>52</b>A through <b>52</b>D, and <b>53</b>A through <b>53</b>C</figref>, <b>53</b>D<b>1</b>, <b>53</b>D<b>2</b>, <b>54</b>A through <b>54</b>D, <b>55</b>A through <b>55</b>D, and <b>56</b> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>38</b>, <b>42</b>, <b>43</b>A, <b>43</b>B, <b>44</b>, <b>45</b>, <b>46</b>A, <b>46</b>B, <b>47</b>, <b>48</b>, <b>50</b>A through <b>50</b>D, <b>51</b>A through <b>51</b>D, <b>52</b>A through <b>52</b>D, <b>53</b>A through <b>53</b>C</figref>, <b>53</b>D<b>1</b>, and <b>53</b>D<b>2</b>, <b>54</b>A through <b>54</b>D, <b>55</b>A through <b>55</b>D, and <b>56</b> are views of a user interface according to operations of a scenario in which the electronic device <b>100</b> provides a video call service and provides to a user at least one of an image, a recommended application, and a possible direct answer, as the response related content.

0344Referring to <figref idref="DRAWINGS">FIG. <b>38</b></figref>, Sunny, the user of the electronic device <b>100</b>, is performing the video call service with John, the user of the device of another user. The electronic device <b>100</b> may display appearances of the user of the electronic device and the user of the device of another user in real time. The electronic device may display content of conversation between the user of the electronic device and the user of the device of another user in real time. For example, the electronic device <b>100</b> may display the content of conversation between the users of the electronic device <b>100</b> and the device of another user <b>200</b> as a speech bubble shape via the STT function.

0345The electronic device receives the message <b>57</b> “Where are you?” from the device of another user <b>200</b>, which is the device of John. The electronic device <b>100</b> and the device of another user <b>200</b> may display exchanged messages via the STT function. The electronic device <b>100</b> continuously transmits messages to the device of another user, and receives messages from the device of another user <b>200</b>. The electronic device <b>100</b> may determine whether the continuously received messages are questions. The user of the electronic device <b>100</b> receives the message <b>57</b> “where are you?” from John.

0346Referring to <figref idref="DRAWINGS">FIG. <b>39</b></figref>, when the electronic device <b>100</b> determines that the message <b>37</b> is a question, the electronic device <b>100</b> may check whether the user needs to be provided with content which may be used in responding to the message <b>37</b>, via the pop-up window <b>65</b>.

5.2. Proposal of Content

0347Referring to <figref idref="DRAWINGS">FIGS. <b>40</b> through <b>42</b></figref>, the electronic device <b>100</b> may display the content which may be used in responding to the message <b>57</b>, in correspondence to a user input.

0348Referring to <figref idref="DRAWINGS">FIG. <b>40</b></figref>, when the electronic device <b>100</b> receives the message <b>57</b> illustrated in <figref idref="DRAWINGS">FIG. <b>38</b></figref>, the electronic device <b>100</b> may recommend an application related to the message <b>57</b>. For example, when content of the message <b>57</b> is related to a location, the electronic device <b>100</b> may recommend a map application or a navigation application.

0349Referring to <figref idref="DRAWINGS">FIG. <b>41</b></figref>, when the electronic device <b>100</b> receives a user input (for example, a user input touching a Yes button) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>39</b></figref>, the electronic device <b>100</b> may recommend an application related to the message <b>57</b>. For example, when the message corresponding to the question is related to a location, the electronic device <b>100</b> may recommend a map application or a navigation application.

0350Referring to <figref idref="DRAWINGS">FIG. <b>42</b></figref>, when the electronic device <b>100</b> receives a user input (for example, a user input touching a Yes button) corresponding to the mark illustrated in <figref idref="DRAWINGS">FIG. <b>39</b></figref>, the electronic device may recommend at least one of an image, an application, and a direct response related to the message <b>57</b>.

5.3. Specific Proposal Situation (1)

0351Referring to <figref idref="DRAWINGS">FIG. <b>43</b>A</figref>, the electronic device <b>100</b> may provide images to the user when the user requests for the content which may be used in responses.

0352Referring to <figref idref="DRAWINGS">FIG. <b>43</b>B</figref>, when the user wants to receive the content which may be used in responding to the message, the electronic device <b>100</b> may provide images to the user without additionally identifying whether to provide the content which may be used in responses.

0353Referring to <figref idref="DRAWINGS">FIG. <b>44</b></figref>, the user may select the image <b>77</b>_a from among the content which may be used in responses. The electronic device <b>100</b> may receive a user input selecting the content. For example, the user input may be a touch input selecting the image <b>77</b>_a.

0354The electronic device <b>100</b> may provide a response edit window to the user. The user may edit the selected image <b>77</b>_b via the response edit window.

0355Referring to <figref idref="DRAWINGS">FIG. <b>45</b></figref>, when the user touches the image <b>77</b>_b which the user has finished editing, the edited selected image <b>77</b>_b may be provided to the conversation partner. For example, when the user touches the selected image <b>77</b>_b which the user has finished editing, the electronic device <b>100</b> may transmit the edited selected image <b>77</b>_b to the conversation partner. The electronic device <b>100</b> may transmit the edited selected image <b>77</b>_b via a portion displaying the appearance of the user.

0356When the user finishes editing the selected image, the electronic device may provide the image <b>77</b>_b to the user of the electronic device <b>100</b>, the user of the device of another user <b>200</b>, or a third user, via a mailing service or an SNS, according to a selection of the user. Also, the electronic device <b>100</b> may provide the image <b>77</b>_b to the user of the electronic device <b>100</b>, the user of the device of another user <b>200</b>, or the third user, via one or more services, regardless of the selection of the user.

5.4. Specific Proposal Situation (2)

0357Referring to <figref idref="DRAWINGS">FIG. <b>46</b>A</figref>, when the user requests for the content which may be used in responses, the electronic device <b>100</b> may provide an image, an application, and a possible direct answer.

0358Referring to <figref idref="DRAWINGS">FIG. <b>46</b>B</figref>, the electronic device may provide the image, the application and the possible direct answer, without additionally identifying whether to provide the content which may be used in responding to the message.

0359Referring to <figref idref="DRAWINGS">FIG. <b>47</b></figref>, the user may select a map application <b>78</b>_a from among the content which may be used in responses. The electronic device <b>100</b> may receive a user input. For example, the user input may be a touch input selecting the application <b>78</b>_a.

0360The electronic device <b>100</b> may provide a response edit window to the user, in correspondence to a user input. The electronic device <b>100</b> may display, via the response edit window, a result of inputting a keyword extracted from the message in the application <b>78</b>_a as an input value. For example, as illustrated in <figref idref="DRAWINGS">FIG. <b>47</b></figref>, the electronic device <b>100</b> may display, via the response edit window, the image <b>78</b>_b, which is the result of inputting the keyword “a current location” in the map application.

0361The electronic device <b>100</b> may provide an editing environment via the response edit window, via which the user may emit the result image <b>78</b>_b. For example, the user may enlarge or reduce the result image <b>78</b>_b via the response edit window, and may select a portion of the result image <b>78</b>_b.

0362Referring to <figref idref="DRAWINGS">FIG. <b>48</b></figref>, when the user selects the result image <b>78</b>_b which has been edited, the result image <b>78</b>_b may be provided to the conversation partner. For example, when the user touches the result image <b>78</b>_b which has been edited, the electronic device <b>100</b> may transmit the edited result image <b>78</b>_b to the conversation partner. The electronic device <b>100</b> may transmit the edited result image <b>78</b>_b via a portion displaying the appearance of the user.

6. Scenario 5

0363<figref idref="DRAWINGS">FIGS. <b>50</b>A through <b>50</b>D, <b>51</b>A through <b>51</b>D, <b>52</b>A through <b>52</b>D, and <b>53</b>A through <b>53</b>C</figref>, <b>53</b>D<b>1</b>, and <b>53</b>D<b>2</b> are views for generally describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>49</b>A through <b>49</b>D, <b>50</b>A through <b>50</b>D, <b>51</b>A through <b>51</b>D, <b>52</b>A through <b>52</b>D, and <b>53</b>A through <b>53</b>C</figref>, <b>53</b>D<b>1</b>, and <b>53</b>D<b>2</b> are views of a user interface according to operations of a scenario in which the electronic device <b>100</b> and the device of another user <b>200</b> recommend to the users a possible direct answer, a restaurant application, a response-related image, a map application, and a news application, as the response related content, while the electronic device <b>100</b> and the device of another user <b>200</b> provide a text message service.

6.1. Proposal of a Direct Response

0364Referring to <figref idref="DRAWINGS">FIGS. <b>49</b>A and <b>49</b>B</figref>, John, the user of the electronic device <b>100</b> is conversing with Mike, the user of the device of another user <b>200</b>, via a text message service. John receives a message <b>111</b> “Where are you going in this afternoon?” from Mike. The electronic device <b>100</b> and the device of another user <b>200</b> may display exchanged messages. The electronic device <b>100</b> may determine whether continuously received messages are questions.

0365Referring to <figref idref="DRAWINGS">FIG. <b>49</b>A</figref>, when the electronic device <b>100</b> determines that the message <b>111</b> is a question, the electronic device <b>100</b> may provide direct answer candidates <b>111</b>_a, <b>111</b>_b, and <b>111</b>_c to the user. John, the user of the electronic device <b>100</b> may click one direct answer candidate <b>111</b>_b to transmit the direct answer candidate <b>111</b>_b to the conversation partner, Mike.

0366Referring to <figref idref="DRAWINGS">FIGS. <b>49</b>C and <b>49</b>D</figref>, John and Mike may identify exchanged messages <b>111</b>, <b>112</b>, <b>211</b>, and <b>212</b> via each of the devices.

6.2. Proposal of a Restaurant Via a Restaurant Application

0367Referring to <figref idref="DRAWINGS">FIGS. <b>50</b>A and <b>50</b>B</figref>, Mike may transmit a message <b>213</b> “Really? I was there for one month” to John. The electronic device <b>100</b> may display a message <b>113</b> received from the device of another user <b>200</b>. John may transmit a message <b>114</b> “Do you know a good restaurant near the Fenway Park?” to Mike. The device <b>200</b> of another user may display a message <b>214</b> received from the electronic device <b>100</b>.

0368Referring to <figref idref="DRAWINGS">FIGS. <b>50</b>C and <b>50</b>D</figref>, the device of another user <b>200</b> may recommend an application <b>214</b>_a related to various restaurants, in correspondence to the received message, and may recommend menu content. Mike may touch the menu content to transmit a message <b>115</b> including the menu content, to John.

6.3. Proposal of the Response Via an Image

0369Referring to <figref idref="DRAWINGS">FIGS. <b>51</b>A and <b>51</b>B</figref>, John, the user of the electronic device <b>100</b> may transmit a message <b>116</b> “Do you have a picture?” to Mike, the user of the device of another user <b>200</b>. The device of another user <b>200</b> may display a message <b>216</b> received from John.

0370Referring to <figref idref="DRAWINGS">FIGS. <b>51</b>C and <b>51</b>D</figref>, the device of another user <b>200</b> may recommend an image <b>216</b>a in correspondence to the received message. Mike may touch the recommended food image to transmit a message <b>118</b> including the menu content, to John.

6.4. Transmission of its Own Location Via a Map Application

0371Referring to <figref idref="DRAWINGS">FIGS. <b>52</b>A and <b>52</b>B</figref>, Mike may transmit a message <b>219</b> “Where do you depart from?” to John. The electronic device <b>100</b> may display a message <b>119</b> received from Mike.

0372Referring to <figref idref="DRAWINGS">FIGS. <b>52</b>C and <b>52</b>D</figref>, the electronic device <b>100</b> may recommend a map application <b>119</b>_a in correspondence to the received message <b>119</b>. John may transmit his location via the recommended map application, to Mike, via a message <b>220</b>.

6.5. Transmission of an Article Via a News Application

0373Referring to <figref idref="DRAWINGS">FIGS. <b>53</b>A and <b>53</b>B</figref>, John may transmit a message <b>121</b> “Is there a hot issue in Boston?” to Mike.

0374Referring to <figref idref="DRAWINGS">FIGS. <b>53</b>C</figref>, <b>53</b>D<b>1</b>, and <b>53</b>D<b>2</b>, the device of another user <b>200</b> may display a message <b>221</b> received from John. The device of another user <b>200</b> may recommend a news application <b>221</b>_a in correspondence to the received message <b>221</b>. When Mike selects the recommended news application <b>221</b>_a, the device of another user <b>200</b> may display a news article via a screen transformation as illustrated in FIG. <b>53</b>D<b>2</b>, and Mike may select the news article to transmit the related article to the electronic device <b>100</b> of John. The electronic device <b>100</b> may display a message <b>122</b> including a link of the related article and an article summary screen.

7. Scenario 6

0375<figref idref="DRAWINGS">FIGS. <b>54</b>A through <b>54</b>D</figref> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>54</b>A through <b>54</b>D</figref> are a view of a user interface according to operations of a scenario in which the electronic device <b>100</b> and the device of another user <b>200</b> provide a text message service during a voice call, and recommend to the users a response via a map application, as the response related content.

0376Referring to <figref idref="DRAWINGS">FIG. <b>54</b>A</figref>, the electronic device <b>100</b> may receive a voice message <b>131</b> “Where is the accident point?” during the voice call. Referring to <figref idref="DRAWINGS">FIG. <b>54</b>B</figref>, the electronic device may identify whether the user wants a recommended response via a pop-up screen <b>132</b>. Referring to <figref idref="DRAWINGS">FIG. <b>54</b>C</figref>, the user of the electronic device <b>100</b> may select a map application by a touch input. Referring to <figref idref="DRAWINGS">FIG. <b>54</b>D</figref>, the device of another user <b>200</b> may receive a message <b>232</b> indicating a location of the user of the electronic device <b>100</b> from the electronic device <b>100</b>.

8. Scenario 7

0377<figref idref="DRAWINGS">FIGS. <b>55</b>A through <b>55</b>D</figref> are views for describing a method of providing content according to an exemplary embodiment. <figref idref="DRAWINGS">FIGS. <b>55</b>A through <b>55</b>D</figref> are a view of a user interface according to operations of a scenario in which the electronic device <b>100</b> and the device of another user <b>200</b> recommend to the users different response candidates as the response related content, while the electronic device <b>100</b> and the device of another user <b>200</b> provide a text message service.

0378Referring to <figref idref="DRAWINGS">FIG. <b>55</b>A</figref>, John may receive a message <b>141</b> “Where are you going in this afternoon?” from his boss. In response to this, the electronic device <b>100</b> may propose direct responses, such as “13:00 Lunch meeting” <b>141</b>_a, “15:00 Business trip” <b>141</b>_b, or “18:00 conference meeting” <b>141</b>_c, and a related application <b>141</b>_d.

0379Referring to <figref idref="DRAWINGS">FIG. <b>55</b>B</figref>, John may receive a message <b>151</b> “Where are you going in this afternoon?” from a friend. In response to this, the electronic device <b>100</b> may propose direct responses, such as “13:00 Lunch meeting” <b>151</b>_a, “14:00 Coffee time with Peter” <b>151</b>_b, or “18:00 Conference meeting” <b>151</b>_c, and a related application <b>151</b>_d.

0380Referring to <figref idref="DRAWINGS">FIGS. <b>55</b>A and <b>55</b>B</figref>, in response to the same question, the electronic device <b>100</b> or the device of another user <b>200</b> may recommend different responses according to the relationship between the user of the electronic device <b>100</b> or the user of the device of another user <b>200</b>, and the conversation partner. For example, when the electronic device <b>100</b> receives the message <b>141</b> from the boss, the response “15:00 Business trip” <b>141</b>_b may be recommended, and when the electronic device receives the message <b>151</b> from the friend, the response “14:00 Coffee time with Peter” <b>151</b>_b may be recommended rather than the response “15:00 business trip” <b>141</b>_b.

0381Referring to <figref idref="DRAWINGS">FIG. <b>55</b>C</figref>, John may receive a message <b>142</b> “How about buying a nice car?” from a salesperson. In response to this, the electronic device <b>100</b> may recommend direct responses, such as “No, I don't need to buy a car” <b>142</b>_a or “Never call me” <b>142</b>_b, and a related application <b>142</b>_c.

0382Referring to <figref idref="DRAWINGS">FIG. <b>55</b>D</figref>, John may receive a message <b>152</b> “How about buying a nice car?” from a friend. In response to this, the electronic device <b>100</b> may propose direct responses, such as “If you give it to me, I'll be so happy” <b>151</b>_a or “I dream about it every day” <b>152</b>_b, and a related application <b>151</b>_c.

0383Referring to <figref idref="DRAWINGS">FIGS. <b>55</b>C and <b>55</b>D</figref>, in response to the same question, the electronic device <b>100</b> or the device of another user <b>200</b> may recommend different responses according to the relationship between the user of the electronic device <b>100</b> or the user of the device of another user <b>200</b>, and the conversation partner. For example, when the electronic device <b>100</b> receives the message <b>142</b> from the salesperson, the electronic device <b>100</b> may recommend the direct response “Never call me” <b>142</b>_b, and when the electronic device <b>100</b> receives the message <b>152</b> from the friend, the electronic device <b>100</b> may recommend the direct response “I dream about it every day” <b>152</b>_b.

9. Components of the Electronic Device

0384<figref idref="DRAWINGS">FIG. <b>56</b></figref> is a block diagram illustrating a structure of a user terminal device <b>1000</b> according to an exemplary embodiment. The user terminal device <b>1000</b> illustrated in <figref idref="DRAWINGS">FIG. <b>56</b></figref> may be the electronic device <b>100</b> of <figref idref="DRAWINGS">FIG. <b>1</b></figref>.

0385Referring to <figref idref="DRAWINGS">FIG. <b>56</b></figref>, the user terminal device <b>1000</b> may include at least one selected from a display unit <b>1100</b>, a control unit (e.g., controller) <b>1700</b>, a memory <b>1200</b>, a global positioning system (GPS) chip <b>1250</b>, a communication unit <b>1300</b>, a video processor <b>1350</b>, an audio processor <b>1400</b>, a user input unit <b>1450</b>, a microphone unit <b>1500</b>, a photographing unit (e.g., camera) <b>1550</b>, a speaker unit <b>1600</b>, and a motion detection unit (e.g., motion detector) <b>1650</b>.

0386The display unit <b>1100</b> may include a display panel <b>1110</b> and a controller for controlling the display panel <b>1110</b>. The display panel <b>1110</b> may be realized as various types of displays, such as liquid crystal displays (LCD), organic light-emitting diodes (OLED), active-matrix organic light-emitting diodes (AM-OLED), and plasma display panels (PDP). The display panel <b>1110</b> may be realized to be flexible, transparent, and wearable. The display unit <b>1100</b> may be combined with a touch panel <b>1470</b> of the user input unit <b>1450</b> to be provided as a touch screen. For example, the touch screen may include an integral module in which the display panel <b>1110</b> and the touch panel <b>1470</b> are stacked. The memory <b>1200</b> may include at least one of an internal memory and an external memory.

0387The internal memory may include at least one selected from, for example, volatile memories (for example, dynamic RAM (DRAM), static RAM (SRAM), and synchronous dynamic RMA (SDRAM), non-volatile memories (for example, one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, and flash ROM), hard disk drive (HDD), and solid state drive (SSD). According to an exemplary embodiment, the control unit <b>1700</b> may process a command or data received from the non-volatile memory or from at least one of other components by loading the command or the data in the volatile memory. Also, the control unit <b>1700</b> may retain the data received or generated from other components in the non-volatile memory.

0388The external memories may include at least one selected from, for example, compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), and memory stick.

0389The memory <b>1200</b> may store various programs and data used for an operation of the user terminal device <b>1000</b>. For example, the memory <b>1200</b> may temporarily or semi-permanently store at least a portion of content that is to be displayed on a lock screen.

0390The control unit <b>1700</b> may control the display unit <b>1100</b> such that a portion of the content stored in the memory <b>1200</b> is displayed in the display unit <b>1100</b>. In other words, the control unit <b>1700</b> may display a portion of the content stored in the memory <b>1200</b> in the display unit <b>1100</b>. Alternatively, the control unit <b>1700</b> may perform a control operation corresponding to a user's gesture, when the user's gesture is generated in a portion of the display unit <b>1100</b>.

0391The control unit <b>1700</b> may include at least one of the natural language processing unit (NLU) <b>121</b>, the session manager <b>122</b>, the profiler <b>123</b>, the context analyzer <b>124</b>, the response generator <b>125</b>, the content metadata storage <b>126</b>, and the App register <b>127</b> of the knowledge framework <b>120</b> as illustrated in <figref idref="DRAWINGS">FIG. <b>9</b>A</figref>. For example, the control unit <b>170</b> of the user terminal device <b>1000</b> may include the natural language processing unit (NLU) <b>121</b>, the session manager <b>122</b>, the profiler <b>123</b>, the context analyzer <b>124</b>, and the response generator <b>125</b>, and the server <b>300</b> may include the App register <b>327</b> and the content metadata storage <b>326</b> as shown in <figref idref="DRAWINGS">FIG. <b>12</b>B</figref>. According to another exemplary embodiment, the control unit <b>1700</b> may include the profiler <b>123</b> and the context analyzer <b>124</b>, and the server <b>300</b> may include the natural language processing unit (NLU) <b>321</b>, the session manager <b>322</b>, the response generator <b>325</b>, the content metadata storage <b>326</b>, and the App register <b>327</b> with reference to <figref idref="DRAWINGS">FIG. <b>13</b>B</figref>. Alternatively, the control unit <b>1700</b> of the user terminal device <b>1000</b> may include the profiler <b>123</b>, the App register <b>127</b>, and the content metadata storage <b>126</b>, and the server <b>300</b> may include the natural language processing unit (NLU) <b>321</b>, the session manager <b>322</b>, the response generator <b>325</b>, the context analyzer <b>324</b> and a profiler <b>323</b> as shown in <figref idref="DRAWINGS">FIG. <b>14</b>B</figref>.

0392The control unit <b>1700</b> may include at least one selected from random access memory (RAM) <b>1710</b>, read-only memory (ROM) <b>1720</b>, a central processing unit (CPU) <b>1730</b>, a graphic processing unit (GPU) <b>1740</b>, and a bus <b>1750</b>. The RAM <b>1710</b>, the ROM <b>1720</b>, the CPU <b>1730</b>, and the GPU <b>1740</b> may be connected with one another via the bus <b>1750</b>.

0393The CPU <b>1730</b> accesses the memory <b>1200</b> and performs a boot operation by using O/S stored in the memory <b>1200</b>. Also, the CPU <b>1730</b> performs various operations by using various programs, content, and data stored in the memory <b>1200</b>.

0394A set of command languages for a system boot operation is stored in the ROM <b>1720</b>. For example, when a turn-on command is input in a portable terminal <b>1000</b> and a power is supplied, the CPU <b>1730</b> may copy the O/S stored in the memory <b>1200</b> in the RAM <b>1710</b>, according to the command language stored in the ROM <b>1720</b>, and may execute the O/S to boot the system. When the booting is completed, the CPU <b>1730</b> may copy various programs stored in the memory <b>1200</b> in the RAM <b>1710</b> and execute the programs copied in the RAM <b>1710</b> to perform various operations. The GPU <b>1740</b> displays a UI screen on a portion of the display unit <b>1100</b>, when the booting of the user terminal device <b>1000</b> is completed. In detail, the GPU <b>1740</b> may generate a screen in which electronic files including various objects, such as content, icons, and menus are displayed. The GPU <b>1740</b> may calculate feature values, such as coordinate values, shapes, sizes, and colors of displayed objects in correspondence to a layout of the screen. Also, the GPU <b>1740</b> may generate screens of various layouts including objects, based on the calculated feature values. The screens generated by the GPU <b>1740</b> may be provided to the display unit <b>1100</b> and may be each displayed in each portion of the display unit <b>1100</b>.

0395The GPS chip <b>1250</b> may receive a global positioning system (GPS) signal from a GPS satellite to calculate a current location of the user terminal device <b>1000</b>. The control unit <b>1700</b> may calculate a user location by using the GPS chip <b>1250</b>, when a navigation program is used or on other occasions when a current user location is needed.

0396The communication unit <b>1300</b> may perform communication with various types of devices of another user, according to various types of communication methods. The communication unit <b>1300</b> may include at least one selected from a WiFi chip <b>1310</b>, a bluetooth chip <b>1320</b>, a wireless communication chip <b>1330</b>, and an NFC chip <b>1340</b>. The control unit <b>1700</b> may perform communication with various types of devices of another user by using the communication unit <b>1300</b>.

0397The WiFi chip <b>1310</b> and the bluetooth chip <b>1320</b> may perform communication by respectively using a WiFi method and a bluetooth method. When the WiFi chip <b>1310</b> or the bluetooth chip <b>1320</b> is used, various connection content such as SSID and a session key is firstly transmitted and received, and then, communication is connected by using the various connection content, to transmit and receive various information. The wireless communication chip <b>1330</b> refers to a chip performing communication according to various communication standards, such as IEEE, Zigbee, 3^rdgeneration (3G), 3^rdgeneration partnership project (3GPP), and long term evolution (LTE). The NFC chip <b>1340</b> refers to a chip operating in a near field communication (NFC) method using 13.56 MHz zone from among various RF-ID frequency zones, including 135 kHz, 13.56 MHz, 433 MHz, 860-960 MHz, and 2.45 GHz.

0398The video processor <b>1350</b> may process content received via the communication unit <b>1300</b> or video data included in content stored in the memory <b>1200</b>. The video processor <b>1350</b> may perform various image processing with respect to the video data, such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion.

0399The audio processor <b>1400</b> may process content received via the communication unit <b>1300</b> or audio data included in the content stored in the memory <b>1200</b>. The audio processor <b>1400</b> may perform various processing with respect to the audio data, such as decoding, amplification, and noise filtering.

0400The control unit <b>1700</b> may drive the video processor <b>1350</b> and the audio processor <b>1400</b> when a reproducing program with respect to multimedia content is executed, to reproduce corresponding content. The speaker unit <b>1600</b> may output audio data generated by the audio processor <b>1400</b>.

0401The user input unit <b>1450</b> may receive an input of various command languages from a user. The user input unit <b>1450</b> may include at least one selected from a key <b>1460</b>, a touch panel <b>1470</b>, and a pen recognition panel <b>1480</b>.

0402The key <b>1460</b> may include various types of keys, such as a mechanical button and a wheel, formed in various portions of an external body of the user terminal device <b>1000</b>, such as a front portion, a side portion, and a rear portion.

0403The touch panel <b>1470</b> may sense a touch input of a user and may output a touch event value corresponding to the sensed touch signal. When the touch panel <b>1470</b> is formed as the touch screen by being combined with the display panel <b>1110</b>, the touch screen may be realized as various types of touch sensors, such as a capacitive type, a decompression type, and a piezoelectric type. The capacitive type uses a method of calculating a touch coordinate by sensing fine electricity caused by a human body of a user when a part of the human body of the user touches a surface of the touch screen, by using a dielectric coated on the surface of the touch screen. The decompression type uses a method of including two electrode plates equipped in the touch screen and calculating a touch coordinate by sensing a current flow due to the upper and bottom plates contacting each other at a touched point, when a user touches a screen. The touch event occurring in the touch screen may be generated mainly by a finger of a human being, but may also be generated by an object of a conductive material which may cause a change in a capacitance.

0404The pen recognition panel <b>1480</b> may sense a proximate input of a pen or a touch input of a pen according to an operation of a touch pen (for example, a stylus pen) or a digitizer pen by a user, and may output a pen proximate event or a pen touch event that is sensed. The pen recognition panel <b>1480</b> may be realized for example as an EMR method and may sense a touch or proximate input, according to a change in a strength of an electromagnetic field due to approaching or a touch of a pen. In detail, the pen recognition panel <b>1480</b> may be formed by including an electronic induction coil sensor having a grid structure, and an electronic signal processing unit sequentially providing indirect signals having pre-determined frequencies in each loop coil of the electronic induction coil sensor. If there is a pen in which a resonator circuit is equipped, around the loop coil of the pen recognition panel <b>1480</b>, the magnetic field transmitted from the corresponding loop coil may generate a current based on mutual electromagnetic induction, in the resonator circuit in the pen. Based on the current, an inductive magnetic field is generated from a coil forming the resonator circuit in the pen, and the pen recognition panel <b>1480</b> may detect the inductive magnetic field in the loop coil in a state of signal reception, so that an approaching or a touch location of the pen may be sensed. The pen recognition panel <b>1480</b> may be provided below the display panel <b>1110</b>, by having a pre-determined area, for example, an area which may cover a display portion of the display panel <b>1110</b>.

0405The microphone unit <b>1500</b> may receive an input of a user's voice or other noises and convert the input into audio data. The control unit <b>1700</b> may use the user's voice input through the microphone unit <b>1500</b> in a calling operation or may convert the user's voice into audio data to store the audio data in the memory <b>1200</b>.

0406The photographing unit <b>1550</b> may photograph a still image or a video according to a control of a user. The photographing unit <b>1550</b> may be realized in a multiple number, for example including a front camera and a rear camera.

0407When the photographing unit <b>1550</b> and the microphone unit <b>1500</b> are provided, the control unit <b>1700</b> may perform a control operation according to a user's voice input through the microphone unit <b>1500</b> or a user's motion recognized by the photographing unit <b>1550</b>. For example, the user terminal device <b>1000</b> may operate in a motion control mode or a sound control mode. When the user terminal device <b>1000</b> operates in the motion control mode, the control unit <b>1700</b> may active the photographing unit <b>1550</b> to photograph the user and may track the motion change of the user to perform a control operation corresponding to the motion change of the user. When the user terminal device <b>1000</b> operates in the sound control mode, the control unit <b>1700</b> may analyze the user's voice input through the microphone unit <b>1500</b> and may operate in a sound recognition mode that performs a control operation according to the analyzed user's voice.

0408The motion detection unit <b>1650</b> may sense a motion of a body of the user terminal device <b>1000</b>. The user terminal device <b>1000</b> may rotate or may tilt in various directions. Here, the motion detection unit <b>1650</b> may detect characteristics of the motion, such as a direction and angle of the rotation, and a tilting degree, by using at least one of various sensors, such as an earth magnetic sensor, a gyro sensor, and an acceleration sensor.

0409In addition, the user terminal device <b>1000</b> may further include a USB port to which a USB connector may be connected, various external input ports for connections with various external terminals, such as a headset, a mouse, and LAN, a DMB chip receiving and processing a digital multimedia broadcasting (DMB) signal, and various sensors.

0410Names of the above-described components of the user terminal device <b>1000</b> may vary. Also, the user terminal device <b>1000</b> may be formed by including one of the above-described components, by omitting some of the above-described components, or by further including additional components.

0411<figref idref="DRAWINGS">FIG. <b>57</b></figref> is a block diagram of a software structure of the user terminal device <b>1000</b>.

0412Referring to <figref idref="DRAWINGS">FIG. <b>57</b></figref>, the memory <b>1200</b> may store an operating system for controlling a resource of the user terminal device <b>1000</b>, and an application program for operating an application. The operating system may include a kernel <b>1210</b>, middleware, an application program interface (API), etc. The operating system may include, for example, Android, iOS, Windows, Symbian, Tizen, Bada, etc.

0413The kernel <b>1210</b> may include at least one of a device driver <b>1210</b>-<b>1</b> for managing the resource and a system resource manager <b>1210</b>-<b>2</b>. The device driver <b>1210</b>-<b>1</b> may access and control hardware of the user terminal device <b>1000</b> like the software. To this end, the device driver <b>1201</b>-<b>1</b> may divided into an interface and a separate driver module provided by each hardware company. The device driver <b>1210</b>-<b>1</b> may include, for example, at least one selected from a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a Wi-Fi driver, an audio driver, and an inter-process communication (IPC) driver. The system resource manager <b>1210</b>-<b>2</b> may include at least one of a process managing unit, a memory managing unit, and a file system managing unit. The system resource manager <b>1210</b>-<b>2</b> may control, allocate, and retrieve the system resource.

0414The middleware <b>1220</b> may include a plurality of modules which are realized in advance to provide common features of various applications. The middleware <b>1220</b> may provide the function via the API <b>1230</b> so that an application <b>1240</b> may efficiently use the resource in the user terminal device <b>1000</b>. The middleware <b>1220</b> may include at least one selected from a plurality of modules including, for example, an application manager <b>1220</b>-<b>1</b>, a windows manager <b>1220</b>-<b>2</b>, a multimedia manager <b>1220</b>-<b>3</b>, a resource manager <b>1220</b>-<b>4</b>, a power manager <b>1220</b>-<b>5</b>, a database manager <b>1220</b>-<b>6</b>, a package manager <b>1220</b>-<b>7</b>, a connection manager <b>1220</b>-<b>8</b>, a notification manager <b>1220</b>-<b>9</b>, a location manager <b>1220</b>-<b>10</b>, a graphic manager <b>1220</b>-<b>11</b>, and a security manager <b>1220</b>-<b>12</b>.

0415The application manager <b>1220</b>-<b>1</b> may manage a life cycle of at least one application of the applications <b>1240</b>. The windows manager <b>1220</b>-<b>2</b> may manage a graphic user interface (GUI) resource used in a screen. The multimedia manager <b>1220</b>-<b>3</b> may check a format for reproducing various media files, and may encode or decode the media files by using a codec corresponding to a corresponding format. The resource manager <b>1220</b>-<b>4</b> may manage a resource of at least one application of the applications <b>1240</b>, such as a source code, memory, and a storage space. The power manager <b>1220</b>-<b>5</b> may manage a battery or power by operating together with BIOS, and provide power information for operation. The database manager <b>1220</b>-<b>6</b> may generate, search, and change a database to be used in at least one application of the applications <b>1240</b>. The package manger <b>1220</b>-<b>7</b> may install or update an application distributed in a package file format. The connection manager <b>1220</b>-<b>8</b> may manage wireless connection, such as Wifi or Bluetooth. The inform manager <b>1220</b>-<b>9</b> may display to the user or inform user of events, such as a message arrival, an appointment, and a proximity inform, by a method which is not disturbing to the user. The location manager <b>1220</b>-<b>10</b> may manage location information of the user terminal device <b>1000</b>. The graphics manager <b>1220</b>-<b>11</b> may manage graphics effects which are provided to the user and a user interface related thereto. The security manager <b>1220</b>-<b>12</b> may provide various security functions required for a system security or a user authentication. When the user terminal device <b>1000</b> includes a call function, the middleware <b>1220</b> may further include a call manager for managing a voice or a video call function of the user.

0416The middleware <b>1220</b> may further include a runtime library <b>1220</b>-<b>13</b> or other library modules. The runtime library <b>1220</b>-<b>13</b> is a library module which is used by a compiler for adding a new function via a programming language while an application is executed. For example, the runtime library <b>1220</b>-<b>13</b> may perform a function related to an input and output, a memory management, or an arithmetic function. The middleware <b>1220</b> may generate a new middleware module by combining various functions of the above described internal modules. The middleware <b>1220</b> may provide a specialized module according to a type of an operating system, to provide differentiated functions. The middleware <b>1220</b> may partially omit previous components dynamically or add new components. The middleware <b>1220</b> may be formed by partially omitting the components in the present exemplary embodiment, by further adding other components, or by replacing the components with other components performing substantially the same functions with different names.

0417The API <b>1230</b> is a set of API programming functions, and may be formed of different components, according to operating systems. In the case of Android or iOS, for example, one API set may be provided per platform, and in the case of Tizen, for example, two or more API sets may be provided.

0418The application <b>1240</b> may include a preloaded application which is installed as default or a third party application which a user may install and use during a process of using. The application <b>1240</b> may include, for example, at least one selected from a home application <b>1240</b>-<b>1</b> for going back to a home screen, a dialer application <b>1240</b>-<b>2</b> for making a call with a partner, a text message application <b>1240</b>-<b>3</b> for receiving a message from a partner identified by a telephone number, an instant message (IM) application <b>1240</b>-<b>4</b>, a browser application <b>1240</b>-<b>5</b>, a camera application <b>1240</b>-<b>6</b>, an alarm application <b>1240</b>-<b>7</b>, a phone book application <b>1240</b>-<b>8</b> for managing a telephone number or an address of a partner, a call log application <b>1240</b>-<b>9</b> for managing a call log of a user, a text message receiving or sending log, or an absence call log, an email application <b>1240</b>-<b>10</b> for receiving a message from a partner identified by an email, a calendar application <b>1240</b>-<b>11</b>, a medical player application <b>1240</b>-<b>12</b>, an album application <b>1240</b>-<b>13</b>, and a watch application <b>1240</b>-<b>14</b>. Names of the described components of the software in the present exemplary embodiment may vary according to types of operating systems. Also, the software according to the present exemplary embodiment may include at least one of the above-described components, omit some of the above-described components, or may further include other additional components.

0419<figref idref="DRAWINGS">FIG. <b>58</b></figref> is a view of a user interface (UI) of an electronic device <b>2000</b> according to an exemplary embodiment. The electronic device <b>2000</b> may be the electronic device <b>100</b> of <figref idref="DRAWINGS">FIG. <b>1</b></figref>.

0420The electronic device <b>2000</b> may include a processor <b>2700</b>, an input interface <b>2400</b>, and an output interface <b>2100</b>.

0421The processor <b>2700</b> may include a mobile application processor or a central processing unit. The processor <b>2700</b> may be referred to as a controller and a control unit. The term “processor” may be used to denote a core, a display controller, and an image signal processor (ISP). The processor <b>2700</b> may include at least one of the components <b>121</b>-<b>126</b>, <b>1710</b>, <b>1720</b>, <b>1730</b>, and <b>1740</b>, of the control unit <b>1700</b> with reference to <figref idref="DRAWINGS">FIG. <b>56</b></figref>.

0422The processor <b>2700</b> according to an exemplary embodiment may extract at least one keyword from a message displayed on a screen via a message service. Also, the processor <b>2700</b> according to an exemplary embodiment may newly generate a keyword related to the keyword. Also, the processor <b>2700</b> according to an exemplary embodiment may obtain content based on the newly generated keyword and location information of the electronic device <b>2000</b>.

0423The input interface <b>2400</b> may denote a device used by a user to input data to control the electronic device <b>1000</b>. For example, the input interface <b>2400</b> may be a key pad, a dome switch, a touch pad (using a touch-type capacitance method, a pressure-type resistive method, an infrared sensing method, a surface ultrasonic conductive method, an integral tension measuring method, a piezo effect method, etc.), a jog wheel, or a jog switch. Also, the input interface <b>2400</b> may include a touch screen, a touch panel, a microphone, and a keyboard.

0424Also, the input interface <b>2400</b> may include at least one module for receiving data from the user. For example, the input interface <b>2400</b> may include a motion recognition module, a touch recognition module, a voice recognition module, etc.

0425The touch recognition module sense a touch gesture on a touch screen of the user and transmit content related to the touch gesture to the processor. The sound recognition module may recognize a voice of the user by using a voice recognition engine and transmit the recognized voice to the processor. The motion recognition module may recognize motion of an object and transmit content related to the motion of the object to the processor.

0426Throughout the specification, an “input” made by the user via the input interface <b>2400</b> of the electronic device <b>2000</b> may include at least one selected from a touch input, a bending input, a voice input, a key input, and a multimodal input. However, it is not limited thereto.

0427A “touch input” may signify a gesture performed by a user on a touch screen to control the electronic device <b>100</b>. The touch gesture stated in the present specification may include tapping, touching &amp; holding, double tapping, dragging, panning, flicking, dragging &amp; dropping, etc.

0428“Tapping” is a user's motion of touching a screen by using a finger or a touch tool such as an electronic pen (e.g., stylus) and then instantly lifting the finger or touch tool from the screen without moving.

0429“Touching &amp; holding” is a user's motion of touching a screen by using a finger or a touch tool such as an electronic pen and then maintaining the above touching motion over a critical time, for example, 2 seconds, after touching the screen. In other words, a time difference between a touch-in time and a touch-out time is greater than or equal to the critical time, for example, 2 seconds. When a touch input lasts over the critical time, to remind the user whether the touch input is tapping or touching &amp; holding, a feedback signal may be provided in a visual, acoustic, or tactile manner. The critical time may vary according to an exemplary embodiment.

0430“Double tapping” is a user's motion of touching the screen twice by using the finger or touch tool.

0431“Dragging” is a user's motion of touching the screen by using the finger or touch tool and moving the finger or touch tool to another position on the screen while keeping the touching motion. The dragging motion may enable the moving or panning motion of an object.

0432“Panning” is a user's motion of performing a dragging motion without selecting an object. Since no object is selected in the panning motion, no object is moved in a page but the page itself is moved on the screen or a group of objects may be moved within a page.

0433“Flicking” is a user's motion of performing a dragging motion over a critical speed, for example, 100 pixel/s, by using the finger or touch tool. The dragging (panning) motion or the flicking motion may be distinguished based on whether the moving speed of the finger or touch tool is over the critical speed, for example, 100 pixel/s, or not.

0434“Dragging &amp; Dropping” is a user's motion of dragging an object to a predetermine position on the screen by using the finger or touch tool and then dropping the object at that position.

0435“Pinching” is a user's motion of moving two fingers touching on the screen in opposite directions. The pinching motion is a gesture to magnify (open pinch) or contract (close pinch) an object or a page. A magnification value or a contraction value is determined according to the distance between the two fingers.

0436“Swiping” is a user's motion of touching an object on the screen by using the finger or touch tool and simultaneously moving the object horizontally or vertically by a predetermine distance. A swiping motion in a diagonal direction may not be recognized as a swiping event.

0437“A motion input” refers to motion that a user applies to the electronic device <b>100</b> to control the electronic device <b>100</b>. For example, the motion input may include the user's rotating the electronic device <b>100</b>, the user's titling the electronic device <b>100</b>, and the user's moving the electronic device <b>2000</b> in up, down, left, and right directions. The electronic device <b>2000</b> may detect a motion which is predetermined by the user, by using an acceleration sensor, a tilt sensor, a gyro sensor, and a 3-axis magnetic sensor.

0438Throughout the specification, the “bending input” refers to a user input of bending the entire electronic device <b>2000</b> or a portion of the electronic device <b>2000</b> to control the electronic device <b>2000</b>, when the electronic device <b>100</b> is a flexible display device. According to an exemplary embodiment, the electronic device <b>2000</b> may sense a bending location (a coordinate value), a bending direction, a bending angle, a bending speed, the number of times of bending, an occurrence point in time of a bending operation, a period of time for which the bending operation retains, etc. by using a bending sensor.

0439Throughout the specification, the term “key input” refers to a user input of controlling the electronic device <b>2000</b> by using a physical key attached to the electronic device <b>2000</b> or a virtual key provided by the electronic device <b>2000</b>.

0440An output interface is configured to output an audio signal, a video signal, or an alarm signal, and may include a display module, a sound input module, etc. Also, the output interface may include a flat display device which may display a two-dimensional image, and a flat display device which may display a three-dimensional image. The output interface may include a device which may output a three-dimensional hologram.

0441The electronic device <b>2000</b> may exchange information with a search server via communication. For example, the electronic device <b>2000</b> may communicate with the search server via at least one protocol. For example, the electronic device <b>2000</b> may communicate with the search server via at least one protocol selected from a trivial file transfer protocol (TFTP), a simple network management protocol (SNMP), a simple mail transfer protocol (SMTP), a post office protocol (POP), an internet control message protocol (ICMP), a serial line interface protocol (SLIP), a point to point protocol (PPP), a dynamic host control protocol (DHCP), a network basic input output system (NETBIOS), an internetwork packet excharge (IPX/SPX), an internet control manage protocol (ICMP), an Internet protocol (IP), an address resolution protocol (ARP), a transmission control protocol (TCP), a user datagram protocol (UDP), winsock, a dynamic host configuration protocol (DHCP), and a routing information protocol (RIP). However, it is not limited thereto.

0442The electronic device <b>2000</b> may perform near field communication via a near field communication module. The near field communication technology may include wireless LAN (WiFi), Bluetooth, Zigbee, WiFi Direct (WFD), ultra wideband (UWB), infrared data association (IrDA), etc. However, it is not limited thereto.

0443While not restricted thereto, an exemplary embodiment can be embodied as computer-readable code on a computer-readable recording medium. The computer-readable recording medium is any data storage device that can store data that can be thereafter read by a computer system. Examples of the computer-readable recording medium include read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer-readable recording medium can also be distributed over network-coupled computer systems so that the computer-readable code is stored and executed in a distributed fashion. Also, an exemplary embodiment may be written as a computer program transmitted over a computer-readable transmission medium, such as a carrier wave, and received and implemented in general-use or special-purpose digital computers that execute the programs. Moreover, it is understood that in exemplary embodiments, one or more units of the above-described apparatuses and devices can include circuitry, a processor, a microprocessor, etc., and may execute a computer program stored in a computer-readable medium.

0444The foregoing exemplary embodiments are merely exemplary and are not to be construed as limiting. The present teaching can be readily applied to other types of apparatuses. Also, the description of the exemplary embodiments is intended to be illustrative, and not to limit the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.