Method for providing voice call using text data and electronic device thereof
9 claims: 2 independent, 7 dependent
- 1A method in an electronic device, the method comprising:converting detected text data into audio data when an input of the text data is detected during call connection;generating first information notifying that text data are being entered when the input of the text data is detected during call connection;generating and transmitting second information notifying that entered text data are being converted into audio data;converting the converted audio data into a digital signal to transmit the converted digital signal to another party;and converting audio data received from the other party during call connection into text data, and outputting the converted text data;wherein the generated first information is transmitted to the other party before the detected text data are converted into audio data.
- 5An electronic device, the device comprising:at least one processor;a memory;and at least one program stored in the memory and configured to be executed by the at least one processor, wherein the at least one program comprises an instruction that, when an input of text data is detected during call connection, converts the detected text data into audio data and converts the converted audio data into a digital signal to transmit the converted digital signal to another party, an instruction that, when an input of text data is detected during call connection, generates first information notifying that text data are being entered and transmits the generated first information to the other party before converting the detected text data into audio data, generates and transmits second information notifying that entered text data are being converted into audio data and an instruction for converting audio data received from the other party during call connection into text data, and for outputting the converted text data.
Independent claims2
176 paragraphs in 3 sections, as filed
BACKGROUND OF THE INVENTION
<i>1. Field of the Invention:</i>
0001The present invention relates to a method of providing a voice call using text data in an electronic device and the electronic device thereof.
<i>2. Description of the Related Art:</i>
0002With the recent rapid development of electronic devices, electronic devices capable of providing wireless voice calls and information exchanges have become necessities of life. When the electronic devices were initially spread, it was recognized that the electronic devices were easy to carry and to use for wireless calls. However, as this technology is developed further and as the wireless internet further improves, the application range of electronic devices has become more extensive (for example, games, remote controllers using short range communication, and image capture using a mounted digital camera in addition to the purpose of simple phone calls or scheduling, and the like), and thus the needs of users have been satisfied.
0003Manufacturers offer electronic devices with more add-on functions and attempt to improve the convenience to users using the wireless call function, that is, one of the original features of the electronic devices.
0004The recently released electronic devices provide Text To Speech (TTS) technology.
0005TTS is a technology that converts text data into voice data. By using the TTS function, for example, an electronic device may output the contents of text data received, and may output the contents of an e-book, as voice data, or may guide the function items of the electronic device as voice data.
0006In addition, upon receiving a call, an electronic device can convert a caller's information into voice data and then output the converted voice data using the TTS function. Since this also converts caller's information displayed on an output screen of the electronic device into voice data, and also provides the converted voice data, when a user cannot directly control the electronic device in a certain situation (for example, while driving), such a TTS function utilization increases.
0007However, existing electronic devices cannot take advantage of the TTS function during call connection, and thus, can convert only text data outputted on a display screen thereof into voice data.
0008For example, after refusing to receive an incoming call when a voice call is unavailable, a user may notify the other party using text data that the voice call is unavailable, and an electronic device receiving the text data may output the contents of the received text data as voice data through the TTS function. However, a voice received from the other party during call connection cannot be outputted as text.
0009Furthermore, since an electronic device can receive a user's voice data and provide it to the other party, personal information may be exposed to others when voice data occurs.
0010Therefore, a need exits for an electronic device and related method capable of making a voice call using text data.
0011The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with regard to the present invention.
0012<patcit id="pcit0001" dnum="US20100111805A1"><text>US 2010/0111805 A1</text></patcit> discloses a communication device that establishes an audio connection with a far-end user via a network connection, receives a text input from a near-end user, converts the text input into speech signals and transmits the speech signals to the far-end user using the established audio connection wherein the near-end user may select a pre-recorded message to inform the far-end user that the text-to speech feature is to be activated
SUMMARY OF THE INVENTION
0013Aspects of the present invention are to address at least the above-mentioned problems and/or disadvantages and to provide at least the advantages described below. Accordingly, an aspect of the present invention is to provide a device and method of making a voice call using text data input by a user in an electronic device.
0014Another aspect of the present invention is to provide a device and method for notifying another party about the user's text input start and end in the electronic device.
0015Another aspect of the present invention is to provide a device and method for converting text data inputted during a call connection into audio data in the electronic device.
0016Another aspect of the present invention is to provide a device and method for converting audio data received from another party into text data in the electronic device.
0017In accordance with an aspect of the present invention, a method for providing a voice call in an electronic device is provided. The method includes converting the detected text data into audio data when an input of text data is detected during call connection, and converting the converted audio data into a digital signal to transmit the converted digital signal to another party.
0018The method may further include generating first information notifying that text data are being entered and transmitting the generated first information to the other party before the detected text data are converted into audio data when the input of text data is detected during call connection. The method may further include generating and transmitting second information notifying that entered text data are being converted into audio data.
0019The information notifying that text data are being entered may use at least one of audio data, video data, and icons.
0020The method may further include converting audio data received from the other party during call connection into text data and outputting the converted text data.
0021The converting of the detected text data into the audio data when the input of the text data is detected during the call connection may include activating a text data input mode when an instruction for converting text data into audio data is detected during the call connection.
0022In accordance with another aspect of the present invention, a device for providing a voice call in an electronic device is provided. The device includes at least one processor, a memory, and at least one program stored in the memory and configured to be executed by the at least one processor, wherein the at least one program includes an instruction that, when an input of text data is detected during call connection, converts the detected text data into audio data and converting the converted audio data into a digital signal to transmit the converted digital signal to the other party.
0023The at least one program may include an instruction that, when an input of text data is detected during call connection, generates information notifying that text data are being entered and transmits the generated information to the other party before converting the detected text data into audio data.
0024The at least one program may include an instruction using the information notifying that the text data are being entered using at least one of audio data, video data, and icons.
0025The at least one program may include an instruction for converting audio data received from the other party during call connection into text data, and for outputting the converted text data.
0026The at least one program may include an instruction that, when an instruction that converting text data into audio data during the call connection is detected, activates a text data input mode.
0027In accordance with another aspect of the present invention, a non-transitory computer readable recording medium having at least one program with instructions recorded thereon, which, when executed by an electronic device, implement the method is provided.
0028Other aspects, advantages, and salient features of the invention will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses exemplary embodiments of the invention.
BRIEF DESCRIPTION OF THE DRAWINGS
0029The above and other aspects, features, and advantages of certain exemplary embodiments of the present invention will be more apparent from the following description taken in conjunction with the accompanying drawings, in which: <ul id="ul0001" list-style="none" compact="compact"><li><figref idref="f0001">FIG. 1</figref> is a block diagram illustrating a configuration of an electronic device performing a voice call using text data according to an exemplary embodiment of the present invention;</li><li><figref idref="f0002">FIG. 2</figref> is a view illustrating components of a processor unit for providing a voice call function using text data according to an exemplary embodiment of the present invention;</li><li><figref idref="f0003">FIG. 3</figref> is a flowchart illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention;</li><li><figref idref="f0004">FIG. 4</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention;</li><li><figref idref="f0005">FIG. 5</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention;</li><li><figref idref="f0006">FIG. 6</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention;</li><li><figref idref="f0007 f0008">FIGS. 7A to 7D</figref> are views illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention;</li><li><figref idref="f0009">FIG. 8</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention;</li><li><figref idref="f0010">FIG. 9A</figref> is a flowchart illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention; and</li><li><figref idref="f0010">FIG. 9B</figref> is a view illustrating a configuration of an electronic device providing a voice call function using text data according to an exemplary embodiment of the present invention.</li></ul>
0030Throughout the drawings, it should be noted that like reference numbers are used to depict the same or similar elements, features, and structures.
DETAILED DESCRIPTION OF exemplary EMBODIMENTS
0031The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of exemplary embodiments of the invention as defined by the claims and their equivalents. It includes various specific details to assist in that understanding but these are to be regarded as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. In addition, descriptions of well-known functions and constructions may be omitted for clarity and conciseness.
0032The terms and words used in the following description and claims are not limited to the bibliographical meanings, but, are merely used by the inventor to enable a clear and consistent understanding of the invention. Accordingly, it should be apparent to those skilled in the art that the following description of exemplary embodiments of the present invention is provided for illustration purpose only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
0033It is to be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.
0034In the following description, a device and method for allowing a voice call using text data in an electronic device according to embodiments of the present invention will be described. In embodiments, the voice call using text data outputs audio data received from the other party as text data, and also converts text data inputted by a user into audio data and then transmits the converted audio data to the other party.
0035The voice call using text data outputs audio data received from the other party through a speaker if necessary, and also converts text data inputted by a user into audio data and then transmits the converted audio data to the other party.
0036That is, the voice call using text data is employed by a user that communicates with the other party using text data in a place in which a voice call is unavailable. At this point, at least the other party transmits/receives audio data as if making a voice call. Furthermore, the electronic device may transmit to the other party audio data notifying that text is being entered.
0037In embodiments, the electronic device may be a portable electronic device, and also may be a device such as a portable terminal, a mobile phone, a media player, a tablet computer, a handheld computer, or a Personal Digital Assistant (PDA). Additionally, the electronic device may be an arbitrary portable electronic device combining at least two functions among such devices. In embodiments, the text data may be a message that is to be delivered to the other party using an input device. According to an exemplary embodiment of the present invention, the electronic device may include any kind of an electronic device including a display and an input means. For example, the electronic device may include a desktop computer, a refrigerator, a multi-function peripheral, a video game console, a digital camera, a Mobile Internet Device (MID), an Ultra Mobile PC (UMPC), a navigation device, a smart TV, a digital watch, and an MP3 player.
0038Exemplary embodiments below relating to an electronic device including a touch screen are described. However, it is apparent to those of ordinary skill in the art that exemplary embodiments in this specification may be appropriately applied to an electronic device or a computing device having another input means different from a display, even if not including a touch screen.
0039<figref idref="f0001">FIG. 1</figref> is a block diagram illustrating a configuration of an electronic device performing a voice call using text data according to an exemplary embodiment of the present invention.
0040Referring to <figref idref="f0001">FIG. 1</figref>, the electronic device 100 may include a memory 110, a processor unit 120, an audio processing unit 130, a communication system 140, an input/output control unit 150, a touch screen 160, and an input device 170. In embodiments, at least one component of the mentioned configuration may include two or more components. For example, the electronic device 100 may include one or more memories 110 and communication systems 140.
0041Various components will be described as follows.
0042The memory 110 may include a program storage unit 111 storing a program for controlling an operation of the electronic device 100 and a data storage unit 112 storing data generated during program execution. For example, the data storage unit 112 may store updatable various data for storage such as phone books, outgoing messages and incoming messages, and also may store audio data corresponding to words and sentences inputted by a user according to embodiments of the present invention. In embodiments, the audio data corresponding to words and sentences may be vocalization data for sentences or words representing an input unit supporting numbers, English alphabet, and Korean alphabet. For example, the audio data may be vocalization data for English word "school" and also may be vocalization data for Korean word "Hak Kyo".
0043Additionally, the program storage unit 111 may include an Operating System (OS) program 113, a data conversion program 114, a coder-decoder (CODEC) program 115, and at least one application program 116. In embodiments, a program included in the program storage unit 111 may be expressed in an instruction set as a set of instructions. In embodiments, a program included in the program storage unit 111 may be expressed in a hardware configuration. For example, the electronic device 100 may include an OS module, a data conversion module, and a CODEC module.
0044The OS program 113 may include various software components controlling general system operations. Controlling such a general system operation may, for example, mean memory management and control, storage hardware (device) control and management, and power control and management, and the like. The OS program 113 may serve to allow smooth communication between hardware (e.g., devices) and program components (e.g., modules).
0045The data conversion program 114 may include at least one software component processing and converting text data inputted by a user into audio data during call connection. That is, the data conversion program 114 may convert the contents of text data as if voice data occurred by a user. For example, the data conversion program 114 may analyze text data inputted by a user and may obtain vocalization data corresponding to the text data from the memory 110.
0046The data conversion program 114 may be a TTS program.
0047In embodiments, the data conversion program 114 may generate information indicating that text is being entered when confirming that a user inputs text data during call connection.
0048The data conversion program 114 may convert audio data received from the other party into text data so as to output the contents of audio data to be displayed on the display unit 162.
0049The CODEC program 115 may include at least one software component processing and converting transmitted/received data to perform a voice call.
0050In embodiments, the CODEC program 115 may convert received digital data into analog voice signals, and then provide them to the audio processing unit 130, and may also convert audio data from a user into digital data, and then provide them to the audio processing unit 130.
0051Additionally, the CODEC program 115 may process and convert audio data converted by the data conversion program 114 (that is, audio data in which the contents of text data inputted by a user are converted) into digital data.
0052As well, the CODEC program 115 may process and convert information notifying that text data converted by the data conversion program 114 are being converted into digital signals.
0053The application program 116 may include a software component for at least one application program installed in the electronic device 100. The application program 116 may include a program allowing a voice call using text data according to embodiments of the present invention.
0054The processor unit 120 may include at least one processor 122 and interface 124. In embodiments, the processor 122 and the interface 124 may be integrated as one circuit or may be implemented using an additional component.
0055The interface 124 may serve as a memory interface controlling access of the processor 122 and the memory 110.
0056Also, the interface 124 may serve as a peripheral interface controlling connection between an input/output peripheral device and the processor 122 of the electronic device 100.
0057The processor 122 may control the electronic device 100 to provide a voice call function using text data through at least one software program. In embodiments, the processor 122 may execute at least one program stored in the memory 110 to process and convert audio data received from the other party into text data, and also convert text data inputted by a user into audio data and then provide them to the other party. For example, the processor 122 may include a data conversion engine 210 of <figref idref="f0002">FIG. 2</figref> converting transmission data. That is, a voice call using text data in the electronic device may be performed using software such as a program stored in the memory 110 and hardware such as the data conversion engine 210.
0058The processor 122 may generate information notifying that a user currently enters text through the data conversion program 114. However, according to embodiments of the present invention, the processor 122 may transmit to the other party various data such as video data and icons that are pre-stored to notify that text data are being entered. In embodiments, since the video data and icons that are pre-stored to notify that text data are being entered do not need to be converted into digital data, the processor 122 may provide the video data and icons to the other party immediately through the communication system 140.
0059The audio processing unit 130 may provide an audio interface between a user and the electronic device 100 through a speaker 131 and a microphone 132.
0060The communication system 140 may perform a communication function for voice communication and for data communication of the electronic device 100. In embodiments, the communication system may include more than one communication sub module, each supporting different communication networks. For example, a communication network is not limited to the above, and may include Global System for Mobile Communication (GSM) network, Enhanced Data GSM Environment (EDGE) network, Code Division Multiple Access (CDMA) network, W-Code Division Multiple Access (W-CDMA) network, Long Term Evolution (LTE) network, Orthogonal Frequency Division Multiple Access (OFDMA) network, wireless LAN, Bluetooth network, and Near Field Communication (NFC). That is, the communication system 140 may transmit/receive data (for example, information notifying that text data are being entered and audio data including the contents of text data) necessary for a voice call using text data according to embodiments of the present invention.
0061The input/output control unit 150 may provide an interface between an input/output device such as a touch screen 160 and an input device 170 and an interface.
0062The touch screen 160, as an input/output device for outputting/inputting information, may include a touch input unit 161 and a display unit 162.
0063The touch input unit 161 may provide touch information obtained through a touch panel to the processor unit 120 through the input/output control unit 150. In embodiments, the touch input unit 161 may change touch information into an instruction structure such as a touch_down, a touch_move, and a touch_up, and then may provide it to the processor unit 120.
0064The display unit 162 may display state information of the electronic device 100, of text entered by a user, of moving pictures, and of still pictures. For example, the display unit 162 may output the contents of audio data received from the other party as text data. In embodiments, the display unit 162 may output contents to be transmitted to the other party as text data.
0065The touch input unit 170 may provide input data generated by a user's selection to the processor unit 120 through the input/output control unit 150. For example, the input device 170 may be configured including only a control button for controlling the electronic device 100. As another example, the input device 170 may be configured with a keypad for receiving input data from a user. Such an input device 170 may generate an input on contents to be transmitted to the other party according to embodiments of the present invention.
0066Although not shown, the electronic device 100 may further include components for providing additional functions such as a cameral module capturing an image or moving picture, a broadcast receiving module receiving a broadcast, a digital music playing module such as an MP3 module, a short-range wireless communication module for short-range wireless communication, and a proximity sensor module for proximity sensing and also, software for operations thereof.
0067<figref idref="f0002">FIG. 2</figref> is a view illustrating components of the processor unit 120 for providing a voice call function using text data according to an exemplary embodiment of the present invention.
0068Referring to <figref idref="f0002">FIG. 2</figref>, the processor unit 200 may be configured including a data conversion engine 210, a processor 220, a CODEC 230, and a peripheral device interface 240. In embodiments, in the CODEC 230, a function of the CODEC program 115 stored in the memory 110 is configured by hardware. In embodiments, the data conversion engine 210 configures the data conversion program 114 stored in the memory 110 of <figref idref="f0001">FIG. 1</figref> by hardware.
0069That is, an electronic device according to embodiments of the present invention may provide a voice call function using text data through the stored program of <figref idref="f0001">FIG. 1</figref>. In embodiments, a voice call function using text data may be provided using the processor unit 200 configured by hardware shown in <figref idref="f0002">FIG. 2</figref>.
0070The processor 220 of the processor unit 200 may perform a method according to an exemplary embodiment of the present invention in linkage with the data conversion engine 210, the CODEC 230, and at least one program stored in the memory 110. According to an exemplary embodiment of the present invention, the processor 220 processes and converts text data inputted by a user into audio data during call connection in linkage with the data conversion engine 210. At this point, the data conversion engine 210 may convert text data into audio data through a TTS program.
0071In embodiments, when it is confirmed that a user inputs text data, the processor 220 may generate information indicating that text is being entered in linkage with the data conversion engine 210.
0072The processor 220 may convert audio data received from the other party into text data in linkage with the data conversion engine 210 so as to output the contents of the audio data to be displayed on the display unit 162.
0073Additionally, the processor 220 may process and convert transmission data to perform a voice call in linkage with the CODEC 230. That is, the processor 220 may process and convert digital data of the other party received through the communication system 140 and the peripheral interface 240 into analog voice signals through the CODEC 230.
0074Additionally, the processor 220 may convert audio data converted by the data conversion engine 210 (that is, audio data in which the contents of text data inputted by a user are converted) into digital data using the CODEC 230, and then may process and transmit the converted digital data to the other party through the peripheral interface 240 and the communication system 140.
0075In embodiments, the processor 220 may convert information notifying that text data converted by the data conversion program 114 are being entered into digital data using the CODEC 230, and then may process and transmit the converted information to the other party through the peripheral interface 240 and the communication system 140.
0076<figref idref="f0003">FIG. 3</figref> is a flowchart illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention.
0077Referring to <figref idref="f0003">FIG. 3</figref>, the electronic device outputs audio data received from the other party as text data, converts text data inputted by a user into audio data, and transmits the converted audio data to the other party so that a voice call using text data is possible. In embodiments, the electronic device may transmit to the other party audio data notifying that text is being entered.
0078That is, the electronic device allows a voice call with the other party in a place in which a voice call is unavailable.
0079In order to perform the above operation, the electronic device performs a call connection with the other party in step 301 and proceeds to step 303 to confirm whether to transmit data to the other party. In step 303, it is confirmed whether to transmit audio data to the other party or whether to receive audio data from the other party.
0080When audio data are received from the other party in step 303, the electronic device proceeds to step 319 to generate the received audio data as text data, and then proceeds to step 321 to process and output the generated text data. That is, the electronic device may output the contents of audio data as text data. This is to maintain a call connection with the other party even when a user is in a voice call unavailable area (for example, meeting rooms and theaters). For example, the electronic device may convert a voice received from the other party into text data and outputs the converted text data to a screen, without outputting the voice to a speaker. Of course, the electronic device may allow a voice call using text data while outputting audio data received from the other party through a speaker. This will be further described below with reference to <figref idref="f0004">FIG. 4</figref>.
0081Moreover, when data are transmitted to the other party in step 303, the electronic device proceeds to step 305 to activate a text data input mode and then receive text data from a user. This means writing contents to be delivered to the other party as text, instead of inputting the contents as voice.
0082Then, the electronic device proceeds to step 307 to generate audio data (hereinafter, referred to as first audio data) notifying that text data are being entered by a user, and then proceeds to step 309 to transmit the generated audio data to the other party. Due to this, the other party receiving the first audio data confirms that since a user of the electronic device is in a meeting room or theater, a voice call is unavailable and thus is performed using text data. Then, the other party may wait until audio data obtained by converting text data are received. At this point, the electronic device may use typing sound as the first audio data. Of course, the electronic device may provide various audio data notifying that text data are being entered so that a user may select preferred audio data. In embodiments, the electronic device may notify to the other party that text data are being entered using various kinds of data such as video data, image data, and icons.
0083As mentioned above, in a normal voice call, after the voice of the other party is received, the voice of the user is instantly delivered to the other party. However, when a voice call is performed using text data according to embodiments of the present invention, until a text input of a user is completed after a voice is received from the other party, the other party may not confirm which situation the user is in. Accordingly, the electronic device may provide to the other party information notifying the other party of a situation in which the user inputs the contents to be delivered as voice as text data.
0084Then, the electronic device proceeds to step 311 to confirm whether text data input is completed. This is to confirm whether voice contents to be delivered to the other party are written as text data. For example, the electronic device determines that text input is completed when a completion button (or a send button) of a text data input function is inputted.
0085If it is determined that text data input is not completed in step 311, the electronic device proceeds to step 305 to provide to the other party audio data notifying that text data are being entered until the text data input is completed.
0086When it is confirmed that text data input is completed in step 311, the electronic device proceeds to step 313 to generate audio data (hereinafter, referred to as second audio data) on the inputted text data. At this point, the electronic device may convert text data inputted by a user into audio data through a TTS technique.
0087Then, the electronic device proceeds to step 315 to convert the audio data generated in step 313 into digital signals and then transmit the converted digital signals to the other party, and proceeds to step 317 to confirm whether a call connection with the other party is terminated.
0088If it is confirmed that a call connection with the other party is not terminated in step 317, the electronic device performs step 303 again.
0089If it is confirmed that a call connection with the other party is terminated in step 317, the electronic device terminates an algorithm of embodiments of the present invention.
0090In <figref idref="f0003">FIG. 3</figref>, when text data input occurs during call connection, operations of an electronic device related to notifying the other party of the text data input are described.
0091However, a user of the electronic device may also execute a text input available application during a call connection with the other party. For example, the electronic device may save call contents as a memo file by executing a memo application during call connection.
0092In this case, since it is not a situation in which contents to be delivered as voice are inputted as text data, the electronic device does not need to notify to a user about a situation in which text data are being entered.
0093Accordingly, the electronic device defines an instruction (or a menu) for performing a voice call using text data due to an unavailable voice call, and activates the function for performing a voice call using text data. Only when the function is activated, the electronic device may notify the other party about a situation in which text data are being entered.
0094<figref idref="f0004">FIG. 4</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention.
0095Referring to <figref idref="f0004">FIG. 4</figref>, the electronic device controls a processor unit 400 configured with a processor 401 and a CODEC 403 to perform a voice call. The electronic device may also include an input unit 405, and may be coupled with a speaker 407 and a communication system 409.
0096That is, the processor unit 400 of the electronic device decodes voice data of the other party received through a communication system to output the decoded voice data through a speaker 407. The processor unit may output voice data of the other party using a headset, a headphone, an earphone, or an ear set besides the speaker. In the drawing, an RX signal received from the other party is converted into an analog signal through the CODEC 403 and the converted analog signal is output through a speaker.
0097In general, the electronic device converts audio data of a user inputted through a microphone into digital data using the CODEC, and delivers the converted digital data to the other party through a communication system.
0098Generating voice data by a user to deliver them to the other party means exposing delivery contents to other users around the user.
0099This is, private contents between a user and the other party may be exposed to other people and voice data occurrence may provide discomfort to others in a public place.
0100In order to solve the above problems, a processor unit of an electronic device according to embodiments of the present invention may provide a voice call function using text data.
0101In order to use the above function, a user inputs contents to be transmitted as voice data as text data instead of delivering contents to the other party using voice data.
0102Accordingly, the processor unit converts text data inputted by a user into voice data and then, provides the converted voice data to the other party through the CODEC and the communication system.
0103A TX signal shown in <figref idref="f0004">FIG. 4</figref> means that text data inputted by a user are converted into audio data.
0104That is, the processor unit may output data received from the other party as audio signals, and may generate contents to be delivered to the other party through text data input.
0105Although an example of text data inputted by a user converted into audio data and transmitted is described in <figref idref="f0004">FIG. 4</figref>, the processor unit of the electronic device may provide only information notifying that text data are being entered until input text data are completed. This is to notify the other party about text data input before text data inputted by a user are converted into audio data and transmitted, in order to stop a call connection before the other party receives audio data. That is, a user may stop a voice call in advance before audio data are received by confirming a call connection available state of the other party through information notifying text data input.
0106In this case, a TX signal of <figref idref="f0005">FIG. 5</figref> may be information notifying that a user inputs text data currently.
0107<figref idref="f0005">FIG. 5</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention.
0108Referring to <figref idref="f0005">FIG. 5</figref>, the electronic device controls a processor unit 500 configured with a processor 501 and a CODEC 503 to perform a voice call. The electronic device may also include an input unit 505, and may be coupled with a speaker 507 and a communication system 509.
0109That is, the processor unit of the electronic device may decode voice data of the other party received through a communication system to output the decoded voice data through a speaker. The processor unit may output voice data of the other party using a headset, a headphone, an earphone, or an ear set besides the speaker. In the drawing, an RX signal received from the other party is converted into an analog signal through the CODEC and the converted analog signal is output through a speaker.
0110In general, the electronic device converts audio data of a user inputted through a microphone into digital data using the CODEC, and delivers the converted digital data to the other party through a communication system.
0111Generating voice data by a user to deliver them to the other party means exposing delivery contents to other users around the user.
0112This is, private contents between a user and the other party may be exposed to other people and voice data occurrence may provide discomfort to others in a public place.
0113In order to address the above problems, an electronic device according to embodiments of the present invention may provide a voice call function using text data.
0114In order to use the above function, a user inputs contents to be transmitted as voice data as text data instead of delivering contents to the other party using voice data.
0115Accordingly, the processor unit of the electronic device may convert text data inputted by a user into voice data and then provide the converted voice data to the other party through the CODEC and the communication system.
0116However, it takes a predetermined time required for converting text data inputted by a user into audio data into audio data and transmitting the converted audio data to the other party. Due to this, the other party may determine that a call connection is terminated because no information is provided from the user. In order to solve the above problems, a processor unit according to embodiments of the present invention may notify the other party that data for voice call are being inputted while text data are inputted by a user.
0117In <figref idref="f0005">FIG. 5</figref>, a TX1 signal means that a user inputs text data, and a TX2 signal means that text data inputted by a user are converted into audio data.
0118That is, the processor unit may output data received from the other party as audio signals, and may generate contents to be delivered to the other party through text data input.
0119In embodiments, the processor unit may confirm that an input unit is controlled by a user and may generate an audio signal notifying the other party of this situation through the CODEC and the communication system.
0120<figref idref="f0006">FIG. 6</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention.
0121Referring to <figref idref="f0006">FIG. 6</figref>, the electronic device controls a processor unit 601 configured with a processor 603 and a CODEC 605 to perform a voice call. The electronic device may also include an input unit 607, an output unit 609, and may be coupled with a communication system 611.
0122In general, the processor unit of the electronic device decodes voice data of the other party received through a communication system to output the decoded voice data through a speaker. The processor unit may output voice data of the other party using a headset, a headphone, an earphone, or an ear set besides the speaker.
0123In embodiments, the processor unit converts audio data of a user inputted through a microphone into digital data using the CODEC, and delivers the converted digital data to the other party through a communication system.
0124The above voice call may need to be limited in specific places such as meeting places and theaters.
0125In order to address the above problems, a processor unit of an electronic device according to embodiments of the present invention may provide a voice call function using text data.
0126In order to use the above function, an electronic device converts data (for example, audio data) into text data and outputs the converted text data instead of outputting audio data received from the other party through a speaker.
0127In embodiments, the processor unit receives contents to be transmitted as voice data as text data instead of delivering call contents to the other party using voice data.
0128That is, the processor unit outputs data (for example, audio data) received from the other party as text data and receives contents to be delivered to the other party as text data through an input unit.
0129In embodiments, the processor unit confirms an input unit is controlled by a user and generates an audio signal notifying this situation to provide it to the other party through the CODEC and the communication system.
0130In the drawing, an RX signal received from the other party is converted into an analog signal through the CODEC and then, the converted analog signal is converted into text data by the processor and is displayed on an output unit.
0131In embodiments, in <figref idref="f0006">FIG. 6</figref>, a TX1 signal means that a user inputs text data, and a TX2 signal means that text data inputted by a user are converted into audio data.
0132<figref idref="f0007">FIGS. 7A and 7B</figref> are views illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention.
0133For example, <figref idref="f0007">FIG. 7A</figref> illustrates a screen responding to the other party using text data in an electronic device.
0134Referring to <figref idref="f0007">FIG. 7A</figref>, as shown in <figref idref="f0007">FIG. 7A</figref>, an electronic device of a user 1 may perform a call connection with an electronic device of a user 2. At this point, the electronic device of the user 1 receives audio data of the user 1 through a microphone and then transmits the received audio data to the electronic device of the user 2. Accordingly, the audio data inputted by the user 1 are outputted through a speaker equipped in the electronic device of the user 2. That is, as shown in <figref idref="f0007">FIG. 7A</figref>, when the user 1 says "Hello" to the microphone of the electronic device of the user 1, the "Hello" is outputted through a speaker of the electronic device of the user 2.
0135In general, the user 2 transmits voice data to the user 1 through the above method so that a voice call is performed.
0136As shown in <figref idref="f0007">FIG. 7B</figref>, an electronic device according to embodiments of the present invention may process and transmit audio data to the other party using text data.
0137That is, when the user 2 does not generate audio data, as shown in <figref idref="f0007">FIG. 7B</figref>, contents (for example, contents indicating that the user 2 is in a meeting) to be delivered to the user 1 are inputted as text data.
0138In embodiments, the electronic device of the user 2 provides information indicating that the user 2 currently inputs text data to the electronic device of the user 1, and thus, as shown in the drawing, the electronic device of the user 1 outputs audio data of "Tap-Tap-Tap", so that it indicates that the other party inputs text data currently.
0139<figref idref="f0007">FIG. 7B</figref> illustrates a screen configured to perform a voice call using text data in an electronic device.
0140Referring to <figref idref="f0007">FIG. 7B</figref>, an electronic device of a user 1 and an electronic device of a user 2 communicate with each other, and the user 2 writes contents to be transmitted to the user 1 as text data as shown in <figref idref="f0008">FIG. 7C</figref>.
0141As shown in <figref idref="f0008">FIG. 7D</figref>, when the user 2 completes an input of data to be transmitted to the user 1, the electronic device of the user 2 may convert text inputted by the user 2 into audio data, and then transmit the converted audio data to the user 1.
0142That is, since the user 2 inputs contents to be transmitted as text data but the electronic device of the user 2 converts the text data into audio data, the user 1 may receive the audio data from the user 2.
0143Due to this, the electronic device of the user 1 outputs the received audio data through a speaker so that a voice call with the user 2 may be maintained.
0144That is, as shown in <figref idref="f0008">FIG. 7D</figref>, the electronic device of the user 2 may convert text data inputted by the user 2 into audio data, and then transmit the converted audio data to the electronic device of the user 1 so that the electronic device of the user 1 may output the received audio data through a speaker.
0145<figref idref="f0009">FIG. 8</figref> is a view illustrating operations of an electronic device providing a voice call function according to an exemplary embodiment of the present invention.
0146Referring to <figref idref="f0009">FIG. 8</figref>, the electronic device controls a processor unit 800 configured with a processor 801 and a CODEC 803 to perform a voice call. The electronic device may also include an input unit 805, and may be coupled with a communication system 809.
0147In general, the processor unit 800 of the electronic device decodes voice data of the other party received through a communication system and outputs the decoded voice data through a speaker. The processor unit 800 may output voice data of the other party using a headset, a headphone, an earphone, or an ear set besides the speaker.
0148In embodiments, the processor unit may convert voice data of the other party received according to embodiments of the present invention into text data and then may output the converted text data.
0149In embodiments, the processor unit may receive contents to be transmitted as voice data as text data instead of delivering call contents to the other party using voice data.
0150In embodiments, the processor unit may confirm that an input unit is controlled by a user and may generate an audio signal notifying the other party of this situation through the CODEC and the communication system.
0151Such an operation may be confirmed through what is described in connection with <figref idref="f0004 f0005 f0006">FIGS. 4 to 6</figref>.
0152In embodiments, the process unit may process and transmit various data such as video data and icons that are pre-stored to notify that text data are being entered to the other party.
0153In embodiments, since the video data and icons that are pre-stored to notify that text data are being entered do not need to be converted into digital data, the processor unit may provide the video data and icons to the other party immediately through the communication system. That is, when an icon indicating that a user is in a meeting is selected, the processor unit detecting a text data input of a user may transmit the icon to the other party.
0154In <figref idref="f0009">FIG. 8</figref>, a TX1 signal means that text data inputted by a user are converted into audio data and transmitted to the other party, and a TX2 signal means information indicating that a user inputs text data currently. That is, the TX2 signal may be directly transmitted to the other party through inter-process communication (IPC) between the processor and the communication system, without passing through the CODEC.
0155<figref idref="f0010">FIG. 9A</figref> is a flowchart illustrating an operation of performing a voice call using text data in an electronic device according to an exemplary embodiment of the present invention.
0156Referring to <figref idref="f0010">FIG. 9A</figref>, when the electronic device detects an input of text data during call connection, step 901 for converting the detected text data into audio data and step 903 for converting the audio data into digital signals and transmitting the converted digital signals to the other party may be performed.
0157When an input of text data is detected during the call connection, step 901 for converting the detected text data into audio data includes confirming whether a user writes voice contents to be delivered to the other party as text data and converting the contents to be written as text data into audio data.
0158This is to receive contents to be provided to the other party using text input when a user may not generate audio data. That is, this means that a user of the electronic device may write contents to be delivered to the other party as text instead of inputting the contents as voice.
0159In embodiments, the electronic device may receive text data from a user after activating a text data input mode during call connection. Accordingly, the electronic device may determine that text data input is completed when a completion button (or a send button) of a text data input function is inputted.
0160Step 903 for converting the audio data into digital signals and transmitting the converted digital signals to the other party may include converting audio data including the contents of the text data into digital signals and transmitting the converted digital signals to the other party.
0161An instruction set for each step of <figref idref="f0010">FIG. 9A</figref> may be included in the data conversion program 114 and in the CODEC program 115 of the memory 110 of <figref idref="f0001">FIG. 1</figref>, and the programs 114 and 115 may be executed by at least one processor.
0162In embodiments, the electronic device may generate information notifying that a user writes voice contents to be delivered to the other party as text data, if necessary. When an input of text data is detected during the call connection, such a step may be included in step 901 for converting the detected text data into audio data.
0163In embodiments, the electronic device may convert audio data from the other party into text data and then, may output the converted text data, if necessary.
0164<figref idref="f0010">FIG. 9B</figref> is a view illustrating a configuration of an electronic device providing a voice call function using text data according to an exemplary embodiment of the present invention.
0165Referring to <figref idref="f0010">FIG. 9B</figref>, when the electronic device detects an input of text data during call connection, embodiments include a means 911 for converting the detected text data into audio data, and a means 913 for converting the converted audio data into digital signals and for transmitting the converted digital signals to the other party.
0166When an input of text data is detected during the call connection, the means 911 for converting the detected text data into audio data confirms whether a user writes voice contents to be delivered to the other party as text data and converts the contents written as text data into audio data.
0167This is to receive contents to be provided to the other party using text input when a user may not generate audio data. That is, a user of the electronic device may write contents to be delivered to the other party as text instead of inputting the contents as voice.
0168The means 911 may receive text data from a user after activating a text data input mode during call connection. Accordingly, the means 911 determines that text data input is completed when a completion button (or a send button) of a text data input function is inputted.
0169The means 913 for converting the converted audio data into digital signals and transmitting the converted digital signals to the other party may convert audio data including the contents of the text data into digital signals and then, transmits the converted digital signals to the other party.
0170Each means may be configured with separate hardware or with one hardware.
0171According to an electronic device and method for allowing a voice call with the other party using text input, a user performs a voice call with the other party through text input and notifies the other party that text is being entered, so that a smooth voice call may be performed with the other party in a voice call unavailable environment.
0172At this point it should be noted that the various embodiments of the present disclosure as described above typically involve the processing of input data and the generation of output data to some extent. This input data processing and output data generation may be implemented in hardware or software in combination with hardware. For example, specific electronic components may be employed in a mobile device or similar or related circuitry for implementing the functions associated with the various embodiments of the present disclosure as described above. Alternatively, one or more processors operating in accordance with stored instructions may implement the functions associated with the various embodiments of the present disclosure as described above. If such is the case, it is within the scope of the present disclosure that such instructions may be stored on one or more non-transitory processor readable mediums. Examples of the processor readable mediums include Read-Only Memory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The processor readable mediums can also be distributed over network coupled computer systems so that the instructions are stored and executed in a distributed fashion. Also, functional computer programs, instructions, and instruction segments for accomplishing the present disclosure can be easily construed by programmers skilled in the art to which the present disclosure pertains.
0173While the invention has been shown and described with reference to certain exemplary embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention as defined by the appended claims and their equivalents.
Contents3
10 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2008201438A1 | Cites | United States of America | Examiner |
| WO2007048727A1 | Cites | World Intellectual Property Organization (WIPO) | – |
| US2008201438A1 | Cites | United States of America | – |
| US2011111805A1 | Cites | United States of America | – |
9 members in 4 offices; this record represents the family
Priority claims5
| Document | Office | Kind | Date |
|---|---|---|---|
| 20120089696 | Republic of Korea | A | |
| 20120089696 | Republic of Korea | A | |
| 20120089696 | Republic of Korea | – | |
| 20120089696 | – | – | – |
| KR20120089696 | – | – | – |
Members9
| Document | Office | Kind | |
|---|---|---|---|
| CN103596155A | China | A | |
| EP2698787A2 | European Patent Office (EPO) | A2 | |
| US2014051410A1 | United States of America | A1 | |
| EP2698787A3 | European Patent Office (EPO) | A3 | |
| KR20140023080A | Republic of Korea | A | |
| US9078111B2 | United States of America | B2 | |
| EP2698787B1This record | European Patent Office (EPO) | B1 | |
| CN108430043A | China | A | |
| KR101954774B1 | Republic of Korea | B1 |
73 legal events, as 9 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent lapsedLapsedMM4A | MM4A | IE | |
| Notification of lapseLapsedST | ST | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filed against granted patent, or epo opposition proceedings concluded without decisionGrantedR097 | R097 | DE | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Deletion acc. to par. 5 (withdrawal of the translation of the ep patent)MK05 | MK05 | AT | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Invalidated european patentMG4D | MG4D | LT | |
| Patent invalid in the netherlands as no translation has been filedMP | MP | NL | |
| Dpma publication of mentioned ep patent grantGrantedR096 | R096 | DE | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| Reference to at number (ep patent validated in austria)REF | REF | AT | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Intention to grant announcedINTG | INTG | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | EP |
Numbers
- Publication
- 2698787
- Publication, DOCDB
- 2698787
- Publication, EPODOC
- EP2698787
- Application
- 131807216
- Application, DOCDB
- 13180721
- Application, EPODOC
- EP20130180721
Titles3
- German
- Verfahren zur Bereitstellung eines Sprachanrufs unter Verwendung von Textdaten und elektronische Vorrichtung dafür
- English
- Method for providing voice call using text data and electronic device thereof
- French
- Procédé pour assurer un appel téléphonique à l'aide des données de texte et dispositif électronique correspondant
Classification
- CPC, 6
- H04W4/16
- H04W4/12
- G10L13/00
- H04M1/72433
- H04M1/72436
- H04W4/18
- IPC, 5
- G10L13 04
- H04M1 725
- G10L15 26
- H04M1 72433
- H04M1 72436
Designated states1
- Contracting states, 1
- Türkiye
