Mobile terminal and method of controlling operation of the mobile terminal
Claim Score by NHIP
Abstract
A mobile terminal and a method of controlling the operation of the mobile terminal are provided. The method according to one embodiment includes connecting a call between the mobile terminal and a counterpart mobile terminal; preparing a brain wave sensor and determining a state of mind of a user based on brain wave measurements obtained from the user by the brain wave sensor module; and performing a control operation relevant to the call according to the determined state of mind of the user.

Term
Projected expiry 23 September 2032.
- Priority
- Filed
- Published
- Today
- Projected expiry
20 claims: 6 independent, 14 dependent
- 1A method of controlling the operation of a mobile terminal, the method comprising:establishing, by the mobile terminal, a call between the mobile terminal and a counterpart mobile terminal;determining, by the mobile terminal, a state of mind of a user of the mobile terminal based on at least one brain wave measurement obtained from the user by at least one brain wave sensor associated with the mobile terminal;and performing, by the mobile terminal, a control operation relevant to the call according to the determined state of mind of the user.
- 6A mobile terminal, comprising:a wireless communication unit configured to establish a call between the mobile terminal and a counterpart mobile terminal;an interface unit connected to at least one brain wave sensor and configured to receive brain waves of a user of the mobile terminal during the call from the brain wave sensor;and a controller operatively connected to the wireless communication unit and the interface unit, the controller configured to determine a state of mind of the user based on the received brain waves, and perform a control operation associated with the call according to the determined state of mind of the user.
- 9A method of controlling the operation of a mobile terminal, the method comprising:establishing, by the mobile terminal, a connection to at least one brain wave sensor;when a mobile terminal communication event occurs, determining, by the mobile terminal, a state of mind of a user of the mobile terminal based on at least one brain wave measurement obtained from the user by the brain wave sensor ;and outputting, by the mobile terminal, no alarm signal when the determined state of mind is a first state of mind.
- 14Broadest claimClaim Score 77, broad(NHIP)A mobile terminal, comprising:an input unit connected to a brain wave sensor configured to measure brain waves of a user of the mobile terminal;and a controller operatively connected to the input unit and configured to determine a state of mind of the user based on the measured brain waves when a communication event occurs, and output no alarm if the determined state of mind is a first state of mind.
- 16A method of controlling the operation of a mobile terminal, the method comprising:setting, by the mobile terminal, an alarm time;outputting, by the mobile terminal, an alarm signal at the alarm time;determining, by the mobile terminal, a state of mind of a user of the mobile terminal based on brain wave measurements obtained from the user via a brain wave sensor associated with the mobile terminal;and varying, by the mobile terminal, at least one of a magnitude of the alarm signal and a type of the alarm signal if the determined state of mind is a first state of mind.
- 19A mobile terminal, comprising:an interface unit connected to a brain wave sensor configured to measure brain waves of a user of the mobile terminal;and a controller operatively connected to the interface unit and configured to set an alarm time, output an alarm signal at the alarm time, determine a state of mind of the user based on the measured brain waves received via the interface unit, and vary at least one of a magnitude of the alarm signal and a type of the alarm signal if the determined state of mind is a first state of mind.
Independent claims6
138 paragraphs in 5 sections, as filed
CROSS-REFERENCE TO RELATED APPLICATION
p-0002This application claims the priority benefit of Korean Patent Application No. 10-2010-0082138, filed on Aug. 24, 2010 in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference.
BACKGROUND OF THE INVENTION
p-00031. Field of the Invention
p-0004The present invention relates to a mobile terminal and a method of controlling the operation of the mobile terminal, and more particularly, to a mobile terminal and a method of controlling the operation of the mobile terminal, in which various operations performed by the mobile terminal can be effectively controlled according to the state of mind of a user.
p-00052. Description of the Related Art
p-0006Mobile terminals are portable devices, which can provide users with various services such as a voice calling service, a video calling service, an information input/output service, and a data storage service.
p-0007As the types of services provided by mobile terminals diversify, an increasing number of mobile terminals have been equipped with various complicated functions such as capturing photos or moving pictures, playing music files or moving image files, providing game programs, receiving broadcast programs and providing wireless internet services and have thus evolved into multimedia players.
p-0008Various attempts have been made to realize such complicated functions as hardware devices or software programs. For example, various user interface (UI) environments, in which users are allowed to easily search for and choose desired functions, have been developed. In addition, the demand for various designs for mobile terminals has steadily grown due to a growing tendency of considering mobile terminals as personal items that can represent personal individuality.
p-0009In the meantime, research has been conducted on various interfaces using facial expressions or motions of the human body or the eyes, and particularly, on a brain computer interface (BCI) technique, which uses brain waves to determine the intention of a user. The BCI technique has expanded its application to various fields as one of the most prominent next-generation computing techniques.
p-0010Therefore, a method is needed to determine the state of mind of a user using the BCI technique and control the operation of a mobile terminal according to the results of the determination.
SUMMARY OF THE INVENTION
p-0011The present invention provides a mobile terminal and a method of controlling the operation of the mobile terminal, in which various operations performed by the mobile terminal can be effectively controlled according to the state of mind of a user through the measurement of brain waves.
p-0012According to an aspect of the present invention, there is provided a method of controlling the operation of a mobile terminal, the method including connecting a call between the mobile terminal and a counterpart mobile terminal; preparing a brain wave sensor module and determining a state of mind of a user based on brain wave measurements obtained from the user by the brain wave sensor module; and performing a control operation relevant to the call according to the determined state of mind of the user.
p-0013According to another aspect of the present invention, there is provided a mobile terminal including a wireless communication unit configured to connect a call between the mobile terminal and a counterpart mobile terminal; a brain wave sensor module configured to measure brain waves of a user during the call; and a controller configured to determine a state of mind of a user based on the measured brain waves and perform a control operation relevant to the call according to the determined state of mind of the user.
p-0014According to another aspect of the present invention, there is provided a method of controlling the operation of a mobile terminal, the method including preparing a brain wave sensor module; determining a state of mind of a user based on brain wave measurements obtained from the user by the brain wave sensor module when a communication event occurs; and if the determined state of mind is a first state of mind, outputting no alarm signal when the determined state of mind is a first state of mind.
p-0015According to another aspect of the present invention, there is provided a mobile terminal including a brain wave sensor module configured to measure brain waves of a user; and a controller configured to determine a state of mind of a user based on the measured brain waves when a communication event occurs, wherein, if the determined state of mind is a first state of mind, the controller outputs no alarm signal.
p-0016According to another aspect of the present invention, there is provided a method of controlling the operation of a mobile terminal, the method including setting an alarm time; outputting an alarm signal upon the arrival of the alarm time; preparing a brain wave sensor module and determining a state of mind of a user based on brain wave measurements obtained from the user by the brain wave sensor module; and if the determined state of mind is a first state of mind, varying at least one of the magnitude and the type of the alarm signal.
p-0017According to another aspect of the present invention, there is provided a mobile terminal including a brain wave sensor module configured to measure brain waves of a user; and a controller configured to set an alarm time, output an alarm signal upon the arrival of the alarm time, and determine a state of mind of a user based on the measured brain waves, wherein, if the determined state of mind is a first state of mind, the controller varies at least one of the magnitude and the type of the alarm signal.
BRIEF DESCRIPTION OF THE DRAWINGS
p-0018The above and other features and advantages of the present invention will become more apparent by describing in detail preferred embodiments thereof with reference to the attached drawings in which:
p-0019<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram of a mobile terminal according to an exemplary embodiment of the present invention;
p-0020<figref idrefs="DRAWINGS">FIG. 2</figref> is a front perspective view of the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 1</figref>;
p-0021<figref idrefs="DRAWINGS">FIG. 3</figref> is a rear perspective view of the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 2</figref>;
p-0022<figref idrefs="DRAWINGS">FIG. 4</figref> is a diagram illustrating an audio output device according to an embodiment of the invention that can be connected to the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 1</figref>;
p-0023<figref idrefs="DRAWINGS">FIGS. 5(</figref><i>a</i>)-<b>5</b>(<i>b</i>) are diagrams illustrating how to connect the audio output device shown in <figref idrefs="DRAWINGS">FIG. 4</figref> to the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 1</figref> according to an embodiment of the invention;
p-0024<figref idrefs="DRAWINGS">FIGS. 6(</figref><i>a</i>)-<b>6</b>(<i>b</i>) and <b>7</b> are diagrams illustrating the arrangement of a brain wave sensor module according to an embodiment of the invention in the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 1</figref>;
p-0025<figref idrefs="DRAWINGS">FIG. 8</figref> is a diagram illustrating the operation of the mobile terminal shown in <figref idrefs="DRAWINGS">FIG. 1</figref> according to an embodiment of the invention;
p-0026<figref idrefs="DRAWINGS">FIG. 9</figref> is a diagram illustrating a table showing the correspondence between brain wave frequency bands and human states of mind according to an embodiment of the invention;
p-0027<figref idrefs="DRAWINGS">FIG. 10</figref> is a flowchart illustrating a method of controlling the operation of a mobile terminal, according to an exemplary embodiment of the present invention;
p-0028<figref idrefs="DRAWINGS">FIG. 11</figref> is a flowchart illustrating a method of controlling the operation of a mobile terminal, according to another exemplary embodiment of the present invention;
p-0029<figref idrefs="DRAWINGS">FIG. 12</figref> is a flowchart illustrating a method of controlling the operation of a mobile terminal, according to another exemplary embodiment of the present invention;
p-0030<figref idrefs="DRAWINGS">FIGS. 13 through 15(</figref><i>b</i>) are diagrams illustrating the exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 10</figref>;
p-0031<figref idrefs="DRAWINGS">FIGS. 16(</figref><i>a</i>) through <b>17</b> are diagrams illustrating the exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 11</figref>;
p-0032<figref idrefs="DRAWINGS">FIGS. 18(</figref><i>a</i>) and <b>18</b>(<i>b</i>) are diagrams illustrating the exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 12</figref>;
p-0033<figref idrefs="DRAWINGS">FIGS. 19(</figref><i>a</i>) through <b>20</b>(<i>b</i>) are diagrams illustrating how to control a navigation function according to the state of mind of a user according to an embodiment of the invention;
p-0034<figref idrefs="DRAWINGS">FIGS. 21(</figref><i>a</i>) and <b>21</b>(<i>b</i>) are diagrams illustrating how to control a short-range communication function according to the state of mind of a user according to an embodiment of the invention; and
p-0035<figref idrefs="DRAWINGS">FIGS. 22(</figref><i>a</i>) and <b>22</b>(<i>b</i>) are diagrams illustrating how to control a multimedia player function according to the state of mind of a user according to an embodiment of the invention.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
p-0036The embodiments of the present invention will hereinafter be described in detail with reference to the accompanying drawings in which exemplary embodiments of the invention are shown.
p-0037The term ‘mobile terminal’, as used herein, may indicate a mobile phone, a smart phone, a laptop computer, a digital broadcast receiver, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a tablet computer, or an electronic book (e-book) reader. In this disclosure, the terms ‘module’ and ‘unit’ can be used interchangeably.
p-0038<figref idrefs="DRAWINGS">FIG. 1</figref> is a block diagram of a mobile terminal <b>100</b> according to an embodiment of the present invention. Referring to <figref idrefs="DRAWINGS">FIG. 1</figref>, the mobile terminal <b>100</b> may include a wireless communication unit <b>110</b>, an audio/video (A/V) input unit <b>120</b>, a user input unit <b>130</b>, a sensing unit <b>140</b>, an output unit <b>150</b>, a memory <b>160</b>, an interface unit <b>170</b>, a controller <b>180</b>, and a power supply unit <b>190</b>. Two or more of the wireless communication unit <b>110</b>, the A/V input unit <b>120</b>, the user input unit <b>130</b>, the sensing unit <b>140</b>, the output unit <b>150</b>, the memory <b>160</b>, the interface unit <b>170</b>, the controller <b>180</b>, and the power supply unit <b>190</b> may be incorporated into a single unit, or some of the wireless communication unit <b>110</b>, the A/V input unit <b>120</b>, the user input unit <b>130</b>, the sensing unit <b>140</b>, the output unit <b>150</b>, the memory <b>160</b>, the interface unit <b>170</b>, the controller <b>180</b>, and the power supply unit <b>190</b> may be divided into two or more smaller units. All components of the mobile terminal are operatively coupled and connected.
p-0039The wireless communication unit <b>110</b> may include a broadcast reception module <b>111</b>, a mobile communication module <b>113</b>, a wireless interne module <b>115</b>, a short-range communication module <b>117</b>, and a global positioning system (GPS) module <b>119</b>.
p-0040The broadcast reception module <b>111</b> may receive a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may be a satellite channel or a terrestrial channel. The broadcast management server may be a server which generates broadcast signals and/or broadcast-related information and transmits the generated broadcast signals and/or the generated broadcast-related information or may be a server which receives and then transmits previously-generated broadcast signals and/or previously-generated broadcast-related information.
p-0041The broadcast-related information may include broadcast channel information, broadcast program information and/or broadcast service provider information. The broadcast signal may be a TV broadcast signal, a radio broadcast signal, a data broadcast signal, the combination of a data broadcast signal and a TV broadcast signal or the combination of a data broadcast signal and a radio broadcast signal. The broadcast-related information may be provided to the mobile terminal <b>100</b> through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module <b>113</b>, rather than by the broadcast reception module <b>111</b>. The broadcast-related information may come in various forms. For example, the broadcast-related information may be electronic program guide (EPG) of digital multimedia broadcasting (DMB) or may be electronic service guide (ESG) of digital video broadcast-handheld (DVB-H).
p-0042The broadcast reception module <b>111</b> may receive the broadcast signal using various broadcasting systems such as digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), media forward link only (MediaFLO), DVB-H, and integrated services digital broadcast-terrestrial (ISDB-T). In addition, the broadcast reception module <b>111</b> may be configured to be suitable for nearly all types of broadcasting systems other than those set forth herein. The broadcast signal and/or the broadcast-related information received by the broadcast reception module <b>111</b> may be stored in the memory <b>160</b> or in another storage unit.
p-0043The mobile communication module <b>113</b> may transmit wireless signals to or receives wireless signals from at least one of a base station, an external terminal, and a server through a mobile communication network. The wireless signals may include various types of data according to whether the mobile terminal <b>100</b> transmits/receives voice call signals, video call signals, or text/multimedia messages.
p-0044The wireless internet module <b>115</b> may be a module for wirelessly accessing the Internet or another network. The wireless internet module <b>115</b> may be embedded in the mobile terminal <b>100</b> or may be installed in an external device. The wireless internet module <b>115</b> may be embedded in the mobile terminal <b>100</b> or may be installed in an external device. The wireless internet module <b>115</b> may use various wireless internet technologies such as wireless local area network (WLAN), Wireless Broadband (WiBro), World Interoperability for Microwave Access (Wimax), and High Speed Downlink Packet Access (HSDPA).
p-0045The short-range communication module <b>117</b> may be a module for short-range communication. The short-range communication module <b>117</b> may use various short-range communication techniques such as Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), and ZigBee.
p-0046The GPS module <b>119</b> may receive position information from a plurality of GPS satellites.
p-0047The A/V input unit <b>120</b> may be used to receive audio signals or video signals. The A/V input unit <b>120</b> may include at least one camera <b>121</b> and/or at least one microphone <b>123</b>. The camera <b>121</b> may process various image frames such as still images or moving images captured by an image sensor during a video call mode or an image capturing mode. The image frames processed by the camera <b>121</b> may be displayed by a display module <b>151</b>.
p-0048The image frames processed by the camera <b>121</b> may be stored in the memory <b>160</b> or may be transmitted to an external device through the wireless communication unit <b>110</b>. The mobile terminal <b>100</b> may include two or more cameras <b>121</b>.
p-0049The microphone <b>123</b> may receive external sound signals during a call mode, a recording mode, or a voice recognition mode with the use of a microphone and may convert the sound signals into electrical sound data. In the call mode, the mobile communication module <b>113</b> may convert the electrical sound data into data that can be readily transmitted to a mobile communication base station and then output the data obtained by the conversion. The microphone <b>123</b> may use various noise removal algorithms to remove noise that may be generated during the reception of external sound signals.
p-0050The user input unit <b>130</b> may generate key input data based on user input for controlling the operation of the mobile terminal <b>100</b>. The user input unit <b>130</b> may be implemented as a keypad, a dome switch, or a static pressure or capacitive touch pad which is capable of receiving a command or information by being pushed or touched by a user. Alternatively, the user input unit <b>130</b> may be implemented as a wheel, a jog dial or wheel, or a joystick capable of receiving a command or information by being rotated. Still alternatively, the user input unit <b>130</b> may be implemented as a finger mouse. In particular, if the user input unit <b>130</b> is implemented as a touch pad and forms a mutual layer structure with the display module <b>151</b>, the user input unit <b>130</b> and the display module <b>151</b> may be collectively referred to as a touch screen.
p-0051The sensing unit <b>140</b> determines a current state of the mobile terminal <b>100</b> such as whether the mobile terminal <b>100</b> is opened up or closed, the position of the mobile terminal <b>100</b> and whether the mobile terminal <b>100</b> is placed in contact with a user, and generates a sensing signal for controlling the operation of the mobile terminal <b>100</b>. For example, when the mobile terminal <b>100</b> is a slider-type mobile phone, the sensing unit <b>140</b> may determine whether the mobile terminal <b>100</b> is opened up or closed. In addition, the sensing unit <b>140</b> may determine whether the mobile terminal <b>100</b> is powered by the power supply unit <b>190</b> and whether the interface unit <b>170</b> is connected to an external device.
p-0052The sensing unit <b>140</b> may include a detection sensor module <b>141</b>, a pressure sensor module <b>143</b>, a motion sensor module <b>145</b> and a brain wave sensor module <b>147</b>. The detection sensor module <b>141</b> may determine whether there is an object nearby and approaching the mobile terminal <b>100</b> without any mechanical contact with the entity. More specifically, the detection sensor module <b>141</b> may detect an object that is nearby and approaching by detecting a change in an alternating magnetic field or the rate of change of static capacitance. The sensing unit <b>140</b> may include two or more detection sensors <b>141</b>.
p-0053The pressure sensor module <b>143</b> may determine whether pressure is being applied to the mobile terminal <b>100</b> or may measure the level of pressure, if any, applied to the mobile terminal <b>100</b>. The pressure sensor module <b>143</b> may be installed in a certain part of the mobile terminal <b>100</b> where the detection of pressure is necessary. For example, the pressure sensor module <b>143</b> may be installed in the display module <b>151</b>. In this case, it is possible to differentiate a typical touch input from a pressure touch input, which is generated using a higher pressure level than that used to generate a typical touch input, based on data provided by the pressure sensor module <b>143</b>. In addition, when a pressure touch input is received through the display module <b>151</b>, it is possible to determine the level of pressure applied to the display module <b>151</b> upon the detection of a pressure touch input based on data provided by the pressure sensor module <b>143</b>.
p-0054The motion sensor module <b>145</b> may determine the location and motion of the mobile terminal <b>100</b> using an acceleration sensor or a gyro sensor.
p-0055In the meantime, acceleration sensors are a type of device for converting a vibration in acceleration into an electric signal. With recent developments in micro-electromechanical system (MEMS) technology, acceleration sensors have been widely used in various products for various purposes ranging from detecting large motions such as car collisions as performed in airbag systems for automobiles to detecting minute motions such as the motion of the hand as performed in gaming input devices. In general, one or more acceleration sensors representing two or three axial directions are incorporated into a single package. There are some cases when the detection of only one axial direction, for example, a Z-axis direction, is necessary. Thus, when an X- or Y-axis acceleration sensor, instead of a Z-axis acceleration sensor, is required, the X- or Y-axis acceleration sensor may be mounted on an additional substrate, and the additional substrate may be mounted on a main substrate.
p-0056Gyro sensors are sensors for measuring angular velocity, and may determine the relative direction of the rotation of the mobile terminal <b>100</b> to a reference direction.
p-0057The brain wave sensor module <b>147</b> measures brain waves from the human brain using one or more brain wave sensors. Brain wave measurements may be classified into low pass filtering (LPF) data, electrocorticography (ECoG) data, and electroencephalogram (EEG) data according to which part of the brain they are obtained from. More specifically, the brain wave sensor module <b>147</b> can detect and measure an EEG signal from the scalp.
p-0058The output unit <b>150</b> can output audio signals, video signals and alarm signals. The output unit <b>150</b> can include the display module <b>151</b>, an audio output module <b>153</b>, an alarm module <b>155</b>, and a haptic module <b>157</b>.
p-0059The display module <b>151</b> can display various information processed by the mobile terminal <b>100</b>. For example, if the mobile terminal <b>100</b> is in a call mode, the display module <b>151</b> can display a user interface (UI) or a graphic user interface (GUI) for making or receiving a call. If the mobile terminal <b>100</b> is in a video call mode or an image capturing mode, the display module <b>151</b> can display a UI or a GUI for capturing or receiving images.
p-0060If the display module <b>151</b> and the user input unit <b>130</b> form a layer structure together and are thus implemented as a touch screen, the display module <b>151</b> can be used as both an output device and an input device. If the display module <b>151</b> is implemented as a touch screen, the display module <b>151</b> can also include a touch screen panel and a touch screen panel controller. The touch screen panel is a transparent panel attached onto the exterior of the mobile terminal <b>100</b> and can be connected to an internal bus of the mobile terminal <b>100</b>. The touch screen panel keeps monitoring whether the touch screen panel is being touched by the user. Once a touch input to the touch screen panel is received, the touch screen panel transmits a number of signals corresponding to the touch input to the touch screen panel controller. The touch screen panel controller processes the signals transmitted by the touch screen panel, and transmits the processed signals to the controller <b>180</b>. Then, the controller <b>180</b> determines whether a touch input has been generated and which part of the touch screen panel has been touched based on the processed signals transmitted by the touch screen panel controller.
p-0061The display module <b>151</b> can include electronic paper (e-paper). E-paper is a type of reflective display technology and can provide as high resolution as ordinary ink on paper, wide viewing angles, and excellent visual properties. E-paper can be implemented on various types of substrates such as a plastic, metallic or paper substrate and can display and maintain an image thereon even after power is cut off. In addition, e-paper can reduce the power consumption of the mobile terminal <b>100</b> because it does not require a backlight assembly. The display module <b>151</b> can be implemented as e-paper by using electrostatic-charged hemispherical twist balls, using electrophoretic deposition, or using microcapsules.
p-0062The display module <b>151</b> can include at least one of a liquid crystal display (LCD), a thin film transistor (TFT)-LCD, an organic light-emitting diode (OLED), a flexible display, and a three-dimensional (3D) display. The mobile terminal <b>100</b> can include two or more display modules <b>151</b>. For example, the mobile terminal <b>100</b> can include an external display module (not shown) and an internal display module (not shown).
p-0063The audio output module <b>153</b> can output audio data received by the wireless communication unit <b>110</b> during a call reception mode, a call mode, a recording mode, a voice recognition mode, or a broadcast reception mode or can output audio data present in the memory <b>160</b>. In addition, the audio output module <b>153</b> can output various sound signals associated with the functions of the mobile terminal <b>100</b> such as receiving a call or a message. The audio output module <b>153</b> can include a speaker and a buzzer.
p-0064The alarm module <b>155</b> can output an alarm signal indicating the occurrence of an event in the mobile terminal <b>100</b>. Examples of the event include receiving a call signal, receiving a message, and receiving a key signal. Examples of the alarm signal output by the alarm module <b>155</b> include an audio signal, a video signal and a vibration signal. More specifically, the alarm module <b>155</b> can output an alarm signal upon receiving a call signal or a message. In addition, the alarm module <b>155</b> can receive a key signal and can output an alarm signal as feedback to the key signal. Therefore, the user can be able to easily recognize the occurrence of an event based on an alarm signal output by the alarm module <b>155</b>. An alarm signal for notifying the user of the occurrence of an event can be output not only by the alarm module <b>155</b> but also by the display module <b>151</b> or the audio output module <b>153</b>.
p-0065The haptic module <b>157</b> can provide various haptic effects (such as vibration) that can be perceived by the user. If the haptic module <b>157</b> generates vibration as a haptic effect, the intensity and the pattern of vibration generated by the haptic module <b>157</b> can be altered in various manners. The haptic module <b>157</b> can synthesize different vibration effects and can output the result of the synthesization. Alternatively, the haptic module <b>157</b> can sequentially output different vibration effects.
p-0066The haptic module <b>157</b> can provide various haptic effects, other than vibration, such as a haptic effect obtained using a pin array that moves perpendicularly to a contact skin surface, a haptic effect obtained by injecting or sucking in air through an injection hole or a suction hole, a haptic effect obtained by giving a stimulus to the surface of the skin, a haptic effect obtained through contact with an electrode, a haptic effect obtained using an electrostatic force, and a haptic effect obtained by realizing the sense of heat or cold using a device capable of absorbing heat or generating heat. The haptic module <b>157</b> can be configured to enable the user to recognize a haptic effect using the kinesthetic sense of the fingers or the arms. The mobile terminal <b>100</b> can include two or more haptic modules <b>157</b>.
p-0067The memory <b>160</b> can store various programs necessary for the operation of the controller <b>180</b>. In addition, the memory <b>160</b> can temporarily store various data such as a phonebook, messages, still images, or moving images.
p-0068The memory <b>160</b> can include at least one of a flash memory type storage medium, a hard disk type storage medium, a multimedia card micro type storage medium, a card type memory (e.g., a secure digital (SD) or extreme digital (XD) memory), a random access memory (RAM), and a read-only memory (ROM). The mobile terminal <b>100</b> can operate a web storage, which performs the functions of the memory <b>160</b> on the internet.
p-0069The interface unit <b>170</b> can interface with an external device that can be connected to the mobile terminal <b>100</b>. The interface unit <b>170</b> can be a wired/wireless headset, an external battery charger, a wired/wireless data port, a card socket for, for example, a memory card, a subscriber identification module (SIM) card or a user identity module (UIM) card, an audio input/output (I/O) terminal, a video I/O terminal, or an earphone. The interface unit <b>170</b> can receive data from an external device or can be powered by an external device. The interface unit <b>170</b> can transmit data provided by an external device to other components in the mobile terminal <b>100</b> or can transmit data provided by other components in the mobile terminal <b>100</b> to an external device.
p-0070When the mobile terminal <b>100</b> is connected to an external cradle, the interface unit <b>170</b> can provide a path for supplying power from the external cradle to the mobile terminal <b>100</b> or for transmitting various signals from the external cradle to the mobile terminal <b>100</b>.
p-0071The controller <b>180</b> can control the general operation of the mobile terminal <b>100</b>. For example, the controller <b>180</b> can perform various control operations regarding making/receiving a voice call, transmitting/receiving data, or making/receiving a video call. The controller <b>180</b> can include a multimedia player module <b>181</b>, which plays multimedia data. The multimedia player module <b>181</b> can be implemented as a hardware device and can be installed in the controller <b>180</b>. Alternatively, the multimedia player module <b>181</b> can be implemented as a software program.
p-0072The power supply unit <b>190</b> can be supplied with power by an external power source or an internal power source and can supply power to the other components in the mobile terminal <b>100</b>.
p-0073The mobile terminal <b>100</b> can include a wired/wireless communication system or a satellite communication system and can thus be able to operate in a communication system capable of transmitting data in units of frames or packets.
p-0074The exterior structure of the mobile terminal <b>100</b> will hereinafter be described in detail with reference to <figref idrefs="DRAWINGS">FIGS. 2 and 3</figref>. The present invention can be applied to nearly all types of mobile terminals such as a folder-type, a bar-type, a swing-type and a slider-type mobile terminal. However, for convenience, it is assumed that the mobile terminal <b>100</b> is a bar-type mobile terminal equipped with a full touch screen.
p-0075<figref idrefs="DRAWINGS">FIG. 2</figref> is a front perspective view of the mobile terminal <b>100</b>, and <figref idrefs="DRAWINGS">FIG. 3</figref> is a rear perspective view of the mobile terminal <b>100</b>. Referring to <figref idrefs="DRAWINGS">FIG. 2</figref>, the exterior of the mobile terminal <b>100</b> can be formed by a front case <b>100</b>-<b>1</b> and a rear case <b>100</b>-<b>2</b>. Various electronic devices can be installed in the space formed by the front case <b>100</b>-<b>1</b> and the rear case <b>100</b>-<b>2</b>. The front case <b>100</b>-<b>1</b> and the rear case <b>100</b>-<b>2</b> can be formed of a synthetic resin through injection molding. Alternatively, the front case <b>100</b>-<b>1</b> and the rear case <b>100</b>-<b>2</b> can be formed of a metal such as stainless steel (STS) or titanium (Ti).
p-0076The display module <b>151</b>, a first audio output module <b>153</b><i>a, </i>a first camera <b>121</b><i>a, </i>first and second brain wave sensors <b>147</b><i>a </i>and <b>147</b><i>b </i>and first through third user input modules <b>130</b><i>a </i>through <b>130</b><i>c </i>can be disposed in the main body of the mobile terminal <b>100</b>, and particularly, on the front case <b>100</b>-<b>1</b>. Fourth and fifth user input modules <b>130</b><i>d </i>and <b>130</b><i>e </i>and the microphone <b>123</b> can be disposed on one side of the rear case <b>100</b>-<b>2</b>.
p-0077If a touch pad is configured to overlap the display module <b>151</b> and thus to form a mutual layer structure, the display module <b>151</b> can serve as a touch screen. Thus, the user can enter various information to the mobile terminal <b>100</b> simply by touching the display module <b>151</b>.
p-0078The first audio output module <b>153</b><i>a </i>can be implemented as a receiver or a speaker. The first camera <b>121</b><i>a </i>can be configured to be suitable for capturing a still or moving image of the user. The microphone <b>123</b> can be configured to properly receive the user's voice or other sounds.
p-0079The first and second brain wave sensors <b>147</b><i>a </i>and <b>147</b><i>b </i>can be disposed on various parts of the mobile terminal <b>100</b>, other than the front case <b>100</b>-<b>1</b>, where they can be placed in contact with the user.
p-0080The first through fifth user input modules <b>130</b><i>a </i>through <b>130</b><i>e </i>and sixth and seventh user input modules <b>130</b><i>f </i>and <b>130</b><i>g </i>(<figref idrefs="DRAWINGS">FIG. 3</figref>) can be collectively referred to as the user input unit <b>130</b>, and any means can be employed as the first through seventh user input modules <b>130</b><i>a </i>through <b>130</b><i>g </i>so long as it can operate in a tactile manner. For example, the user input unit <b>130</b> can be implemented as a dome switch or a touch pad that can receive a command or information according to a pressing or a touch operation by the user, or can be implemented as a wheel or jog type for rotating a key or as a joystick. The touch can be a direct contact touch or a proximity non-contact touch, and can be made by a finger or another object. In terms of function, the first through third user input modules <b>130</b><i>a </i>through <b>130</b><i>c </i>can operate as function keys for entering a command such as start, end, or scroll, the fourth user input module <b>130</b><i>d </i>can operate as a function key for selecting an operating mode for the mobile terminal <b>100</b>, and the fifth user input module <b>130</b><i>e </i>can operate as a hot key for activating a special function within the mobile terminal <b>100</b>.
p-0081Referring to <figref idrefs="DRAWINGS">FIG. 3</figref>, a second camera <b>121</b><i>b </i>can be additionally provided at the rear of the rear case <b>100</b>-<b>2</b>, and the sixth and seventh user input modules <b>130</b><i>f </i>and <b>130</b><i>g </i>and the interface unit <b>170</b> can be disposed on one side of the rear case <b>100</b>-<b>2</b>.
p-0082The second camera <b>121</b><i>b </i>can have an image capture direction which is substantially the opposite to that of the first camera <b>121</b><i>a</i>, and can have a different resolution from that of the first camera <b>121</b><i>a. </i>
p-0083A flash and a mirror can be disposed to be adjacent to the second camera <b>121</b><i>b</i>. When an image of a subject is captured with the second camera <b>121</b><i>b, </i>the flash can illuminate the subject. The mirror can allow the user to see him- or herself when he or she wants to capture his or her own image by using the second camera <b>121</b><i>b. </i>
p-0084Another audio output module can be additionally provided on the rear case <b>100</b>-<b>2</b>. The audio output module on the rear case <b>100</b>-<b>2</b> can realize a stereo function along with the audio output module <b>153</b> on the front case <b>100</b>-<b>1</b>. The audio output module on the rear case <b>100</b>-<b>2</b> can also be used in a speaker-phone mode.
p-0085The interface unit <b>170</b> can used as a passage allowing the mobile terminal <b>100</b> to exchange data with an external device either through a fixed line or wirelessly.
p-0086A broadcast signal reception antenna can be disposed at one side of the front or rear case <b>100</b>-<b>1</b> or <b>100</b>-<b>2</b>, in addition to an antenna used for call communication. The broadcast signal reception antenna can be installed such that it can be extended from the front or rear case <b>100</b>-<b>1</b> or <b>100</b>-<b>2</b>.
p-0087The power supply unit <b>190</b> can be mounted on the rear case <b>100</b>-<b>2</b> and can supply power to the mobile terminal <b>100</b>. The power supply unit <b>190</b> can be, for example, a chargeable battery which can be detachably combined to the rear case <b>100</b>-<b>2</b> for being charged.
p-0088The second camera <b>121</b><i>b </i>and the other elements that have been described as being provided on the rear case <b>100</b>-<b>2</b> can be provided on the front case <b>100</b>-<b>1</b>. In addition, the first camera <b>121</b> a can be configured to be rotatable and thus to allow image capturing in various directions. In this case, the second camera <b>121</b><i>b </i>can be optional.
p-0089<figref idrefs="DRAWINGS">FIG. 4</figref> illustrates an audio output device <b>200</b> according to an embodiment that can be connected to the mobile terminal <b>100</b>, and <figref idrefs="DRAWINGS">FIGS. 5(</figref><i>a</i>)-<b>5</b>(<i>b</i>) illustrate how to connect the audio output device <b>200</b> to the mobile terminal <b>100</b>. Referring to <figref idrefs="DRAWINGS">FIG. 4</figref>, the audio output device <b>200</b> includes first and second audio output units <b>201</b> and <b>203</b> and a frame <b>205</b> connecting the first and second audio output units <b>201</b> and <b>203</b>. The audio output device <b>200</b> can be worn on the head of a user. Other types of audio output devices can also be used.
p-0090The audio output device <b>200</b> can be connected to the mobile terminal <b>100</b> via wires or via short-range communication such as Bluetooth. Thus, the audio output device <b>200</b> can receive audio/video (A/V) data from the mobile terminal <b>100</b> and can then output audio signals corresponding to the A/V data directly to the ears of the user.
p-0091One or more brain wave sensors <b>207</b><i>a </i>through <b>207</b><i>d </i>can be disposed in the frame <b>205</b> of the audio output device <b>200</b>, and can measure brain waves from the scalp of the user. Brain wave measurements obtained by the audio output device <b>200</b> can be subject to signal processing, and can then be wirelessly transmitted to the mobile terminal <b>100</b> either directly, as shown in <figref idrefs="DRAWINGS">FIG. 5(</figref><i>a</i>), or via another device <b>250</b>, as shown in <figref idrefs="DRAWINGS">FIG. 5(</figref><i>b</i>). Optionally, a wired connection can be used.
p-0092The brain waves of the user can be measured by the audio output device <b>200</b> (such as a headset or earphones) or the brain wave sensor module <b>147</b> of the mobile terminal <b>100</b>.
p-0093<figref idrefs="DRAWINGS">FIGS. 6(</figref><i>a</i>)-<b>6</b>(<i>b</i>) illustrate an example of the arrangement of the brain wave sensor module <b>147</b> in the mobile terminal <b>100</b>, according to an embodiment of the invention. Referring to <figref idrefs="DRAWINGS">FIGS. 6(</figref><i>a</i>)-<b>6</b>(<i>b</i>), the brain wave sensor module <b>147</b> can be disposed at a location where it can be placed in contact with a user. More specifically, the brain wave sensor module <b>147</b> can be retracted and extended from the mobile terminal <b>100</b> during the use of the mobile terminal <b>100</b>. The brain sensor module <b>147</b> is illustrated in <figref idrefs="DRAWINGS">FIGS. 6(</figref><i>a</i>)-<b>6</b>(<i>b</i>) as having two brain wave sensors (i.e., <b>147</b><i>a </i>and <b>147</b><i>b</i>), but the present invention is not restricted to this. That is, the brain sensor module <b>147</b> can include less than or more than two brain sensors and can be attachable and detachable to and from the mobile terminal <b>100</b>.
p-0094Referring to <figref idrefs="DRAWINGS">FIG. 7</figref>, the brain waves of a user can be measured by retracting and extending the brain wave sensors <b>147</b><i>a </i>and <b>147</b><i>b </i>from the mobile terminal <b>100</b> and appropriately bending the brain wave sensors <b>147</b><i>a </i>and <b>147</b><i>b </i>to be properly attached onto the head of the user.
p-0095Alternatively, one or more wireless brain wave sensors can be attached to a hair accessory or glasses or otherwise placed on or near the head of the user. When worn on the head or the face of the user, the wireless brain sensor modules will detect the brain waves of the user, will process the results of the detection, and will transmit multi-channel EEG signals obtained by the processing to the mobile terminal <b>100</b> either directly or via another device.
p-0096<figref idrefs="DRAWINGS">FIG. 8</figref> illustrates the operation of the mobile terminal <b>100</b> according to an embodiment of the invention, and <figref idrefs="DRAWINGS">FIG. 9</figref> illustrates an example of a table showing the correspondence between brain wave frequency bands and human states of mind according to an embodiment of the invention. Referring to <figref idrefs="DRAWINGS">FIG. 8</figref>, the brain wave sensor module <b>147</b> can include a brain wave sensor <b>147</b>-<b>1</b> and a signal processor <b>147</b>-<b>2</b>. The brain wave sensor <b>147</b>-<b>1</b> measures brain waves from the scalp of a user, and the signal processor <b>147</b>-<b>2</b> converts the measured brain waves from a time domain to a frequency domain, and thus determines the frequency band that the measured brain waves belong to.
p-0097Brain wave signals obtained by the conversion performed by the signal processor <b>147</b>-<b>2</b> are transmitted to the controller <b>180</b>. Then, the controller <b>180</b> can determine the state of mind of the user based on the brain wave signals and the table shown in <figref idrefs="DRAWINGS">FIG. 9</figref>. Brain waves resulting from the electrical activities of neurons in the cerebral cortex are largely classified into delta, theta, alpha, beta and gamma waves. Once the type of brain waves measured from the user is determined through the analysis of the frequency band of the measured brain waves, the state of mind of the user can be determined by the mobile terminal <b>100</b> based on the type of the measured brain waves.
p-0098Once the state of mind of the user is determined, the controller <b>180</b> can control various functions <b>300</b> performed by the mobile terminal <b>100</b> according to the determined state of mind of the user. The various functions <b>300</b> include, but are not limited to, a call-related function <b>300</b><i>a, </i>a communication event processing function <b>300</b><i>b, </i>an alarm output function <b>300</b><i>c, </i>and a multimedia function <b>300</b><i>d. </i>
p-0099<figref idrefs="DRAWINGS">FIG. 10</figref> illustrates a method of controlling the operation of a mobile terminal, according to an exemplary embodiment of the present invention, and particularly, how to control a call operation according to the state of mind of a user. The method in this figure or in other figures herein is implemented by the mobile terminal <b>100</b> of <figref idrefs="DRAWINGS">FIG. 1</figref>, but can be implemented in another suitable device. Referring to <figref idrefs="DRAWINGS">FIG. 10</figref>, if a call request is issued by, for example, entering the phone number of another mobile terminal (hereinafter referred to as the counterpart mobile terminal) and pressing a ‘call’ icon, the controller <b>180</b> the mobile terminal <b>100</b> controls the wireless communication unit <b>110</b> to connect a call to the entered phone number (S<b>400</b>) and thus to perform a call function (S<b>402</b>).
p-0100During the call between the mobile terminal <b>100</b> and the counterpart mobile terminal <b>100</b>, the controller <b>180</b> controls the brain wave sensor module <b>147</b> to measure the brain waves of the user of the mobile terminal <b>100</b> (S<b>404</b>), and determines the state of mind of the user of the mobile terminal <b>100</b> based on the measured brain waves (S<b>406</b>).
p-0101Thereafter, the controller <b>180</b> performs a control operation relevant to the call between the mobile terminal <b>100</b> and the counterpart mobile terminal according to the determined state of mind of the user of the mobile terminal <b>100</b> (S<b>408</b>). For example, the controller <b>180</b> can adjust the volume of sound or replace a current call screen with another call screen during the call between the mobile terminal <b>100</b> and the counterpart mobile terminal or can end the call between the mobile terminal <b>100</b> and the counterpart mobile terminal. The type of the control operation performed in operation S<b>408</b> can vary according to the environment of the use of the mobile terminal <b>100</b> or the settings in the mobile terminal <b>100</b>.
p-0102Operations S<b>402</b> through S<b>408</b> can be repeatedly performed until the user of the mobile terminal <b>100</b> chooses to end the call between the mobile terminal <b>100</b> and the counterpart mobile terminal (S<b>410</b>). Alternatively, operations S<b>402</b> through S<b>408</b> can be performed only once during a call. When the call between the mobile terminal <b>100</b> and the counterpart mobile terminal is ended, the controller <b>180</b> can store both the determined state of mind of the user of the mobile terminal <b>100</b> and information on the ended call in a call log (S<b>412</b>). Alternatively, controller <b>180</b> can store only one of the determined state of mind of the user of the mobile terminal <b>100</b> and information on the ended call in the call log. Other data related to the call can also be stored in the call log.
p-0103Information stored in the call log on the state of mind of the user of the mobile terminal <b>100</b> can be used for various purposes. For example, when an incoming call is received from the counterpart mobile terminal, an icon or information indicating the state of mind of the user of the counterpart mobile terminal can be displayed along with the phone number of the counterpart mobile terminal. In addition, an arbitrary calling function can be provided. Then, when the arbitrary calling function is selected, the user of the mobile terminal <b>100</b> can arbitrarily select one of the calls in a call history that are paired with an icon or information corresponding to a stress-relieved state of mind and can then issue a request for calling a phone number corresponding to the selected call.
p-0104According to this exemplary embodiment, it is possible to effectively control various call-related functions according to the state of mind of a user.
p-0105<figref idrefs="DRAWINGS">FIG. 11</figref> illustrates a method of controlling the operation of a mobile terminal, according to another exemplary embodiment of the present invention, and particularly, how to control the transmission or reception of messages or emails according to the state of mind of a user. Referring to <figref idrefs="DRAWINGS">FIG. 11</figref>, when the mobile terminal <b>100</b> is placed in an idle mode (S<b>430</b>), the controller <b>180</b> can determine whether a communication event such as an incoming call, an incoming message or an incoming email has occurred (S<b>432</b>).
p-0106Thereafter, if it is determined in operation S<b>432</b> that a communication event has occurred, the controller <b>180</b> controls the brain wave sensor module <b>147</b> to measure the brain waves of a user (S<b>434</b>), and determines the state of mind of the user based on the frequency band of the measured brain waves (S<b>436</b>).
p-0107Thereafter, the controller <b>180</b> either outputs an alarm signal indicating the occurrence of a communication event (S<b>440</b>) or outputs no alarm signal (S<b>442</b>) according to the state of mind of the user. More specifically, if the results of the determination of the state of mind of the user indicate that the user is, for example, asleep, is concentrating on something or is excited, the controller <b>180</b> can stop the output of the alarm signal. On the other hand, if the results of the determination of the state of mind of the user indicate that the user is in his or her usual state of mind, the controller <b>180</b> can output the alarm signal.
p-0108According to this exemplary embodiment, it is possible to decide whether to output an alarm signal indicating the occurrence of a communication event according to the state of mind of a user. In addition, it is possible to send a message or email having inserted therein an icon indicating the state of mind of a user as a response to an incoming message or email.
p-0109<figref idrefs="DRAWINGS">FIG. 12</figref> illustrates a method of controlling the operation of a mobile terminal, according to another exemplary embodiment of the present invention, and particularly, how to control an alarm function according to the state of mind of a user. Referring to <figref idrefs="DRAWINGS">FIG. 12</figref>, when an alarm is set by entering alarm information such as an alarm time and pattern (S<b>460</b>), the controller <b>180</b> periodically determines whether the alarm time has arrived (S<b>462</b>). If it is determined in operation S<b>462</b> that the alarm time has arrived, the controller <b>180</b> controls a predefined alarm signal to be output according to the alarm information (S<b>464</b>).
p-0110Thereafter, the controller <b>180</b> controls the brain wave sensor module <b>147</b> to measure the brain waves of a user (S<b>466</b>), and determines the state of mind of the user based on the frequency band of the measured brain waves (S<b>468</b>).
p-0111If the results of the determination of the state of mind of the user indicate that the user is sleepy or asleep (S<b>470</b>), the controller <b>180</b> increases the volume of the predefined alarm signal or outputs another alarm signal, instead of or in addition to the predefined alarm signal (S<b>472</b>), and the method returns to operation S<b>464</b>. For example, when the user is sleepy or asleep, the controller <b>180</b> increases the volume of the predefined alarm signal or outputs a vibration signal or an optical signal along with the predefined alarm signal.
p-0112On the other hand, if the results of the determination of the state of mind of the user indicate that the user is neither sleepy nor asleep (S<b>470</b>), the controller <b>180</b> stops the output of the predefined alarm signal (S<b>474</b>).
p-0113According to this exemplary embodiment, it is possible to control the output or pattern of an alarm signal according to the state of mind of a user.
p-0114Various operations performed by the mobile terminal <b>100</b>, such as a multimedia player function, a GPS navigation function, or a short-range communication function can be effectively controlled according to the state of mind of a user, and this will be described later in further detail with reference to <figref idrefs="DRAWINGS">FIGS. 19(</figref><i>a</i>) through <b>22</b>(<i>b</i>).
p-0115The exemplary embodiments of <figref idrefs="DRAWINGS">FIGS. 10 through 12</figref> and other exemplary embodiments of the present invention will hereinafter be described in further detail with reference to <figref idrefs="DRAWINGS">FIGS. 13 through 22(</figref><i>b</i>).
p-0116More specifically, the exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 10</figref> will hereinafter be described in further detail with reference to <figref idrefs="DRAWINGS">FIGS. 13 through 15(</figref><i>b</i>).
p-0117<figref idrefs="DRAWINGS">FIG. 13</figref> illustrates a display screen <b>500</b> that can be displayed on the display module <b>151</b> when a call is automatically terminated according to the state of mind of a user. Referring to <figref idrefs="DRAWINGS">FIG. 13</figref>, if, during the call, the user is determined to be sleepy or asleep and no audio signal is input to the microphone <b>123</b> for more than a predefined amount of time, the controller <b>180</b> controls the haptic module <b>157</b> to generate vibration for a predetermined time period and increases the volume of the call. If the state of mind of the user still does not change afterwards, a message indicating that the user is no longer available is sent to the other person on the phone, and then, the call is automatically terminated.
p-0118<figref idrefs="DRAWINGS">FIG. 14</figref> illustrates a display screen <b>510</b> that can be displayed on the display module <b>151</b> during a call and can reflect the state of mind of a user. Referring to <figref idrefs="DRAWINGS">FIG. 14</figref>, during a call, a display screen <b>510</b> indicating the state of mind or feeling of the user such as excitement or joy can be displayed. An icon <b>513</b> or an image <b>515</b> indicating the state of mind or feeling of the user can be additionally displayed on the display screen <b>510</b>, and the volume of the call can be increased.
p-0119When the user appears to be distracted during the call, the pitch of the voice of the other person on the phone can be altered into a funny voice, or the volume of the call can be lowered.
p-0120<figref idrefs="DRAWINGS">FIG. 15(</figref><i>a</i>) illustrates a ‘call history’ screen <b>520</b> showing a plurality of calls made or received by the mobile terminal <b>100</b>. Referring to <figref idrefs="DRAWINGS">FIG. 15(</figref><i>a</i>), each of the calls listed on the ‘call history’ screen is paired with an icon or information indicating the state of mind of a user at the time when a corresponding call was made or received. When a request for calling a phone number corresponding to one of the calls listed on the ‘call history’ screen is received, an icon indicating the state of mind of the user at the time when the selected call was made or received and other information on the selected call can be displayed on the display module <b>151</b>.
p-0121<figref idrefs="DRAWINGS">FIG. 15(</figref><i>b</i>) illustrates a display screen <b>530</b> that can be displayed on the display module <b>151</b> when an ‘arbitrary calling’ request is issued. Referring to <figref idrefs="DRAWINGS">FIG. 15(</figref><i>b</i>), when the ‘arbitrary calling’ request is issued, the controller <b>180</b> calls a phone number or contact arbitrarily selected from a group of callers or callees listed in a call log or a contacts list and paired with an icon or information corresponding to a determined state of mind. Then, an icon <b>533</b> indicating the state of mind of the user at the time when a previous call was made or received from the selected phone number or contact can be displayed on the display screen <b>530</b>. In short, when an ‘arbitrary calling’ function is selected, it is possible to arbitrarily select a phone number or contact to call with reference to information included in a call history or a contact's list on the state of mind of a user at the time when a previous call was made to or received from the selected phone number or contact.
p-0122The exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 11</figref> will hereinafter be described in further detail with reference to <figref idrefs="DRAWINGS">FIGS. 16(</figref><i>a</i>) through <b>17</b>.
p-0123<figref idrefs="DRAWINGS">FIG. 16(</figref><i>a</i>) illustrates a display screen <b>540</b> that can be displayed on the display module <b>151</b> upon the receipt of an incoming message when a user is in his or her usual state of mind. Referring to <figref idrefs="DRAWINGS">FIG. 16(</figref><i>a</i>), if the user is in his usual state of mind, an alarm signal can be output upon the receipt of an incoming message or call, and a display screen relevant to the receipt of the incoming message or call can be displayed on the display module <b>151</b>.
p-0124On the other hand, if the user is not in his or her usual state of mind, for example, when the user is excited, the incoming message or call is ignored, and a display screen <b>550</b> relevant to the ignoring of the incoming message or call can be displayed on the display module <b>151</b>, as shown in <figref idrefs="DRAWINGS">FIG. 16(</figref><i>b</i>). That is, it is possible to accept or ignore an incoming short message service (SMS) or multimedia messaging service (MMS) message or an incoming email according to the state of mind of a user.
p-0125<figref idrefs="DRAWINGS">FIG. 16(</figref><i>c</i>) illustrates a message inbox screen <b>560</b> that can be displayed on the display module <b>151</b>. Referring to <figref idrefs="DRAWINGS">FIG. 16(</figref><i>c</i>), each message listed on the inbox screen <b>560</b> is paired with an icon indicating the state of mind of a user at the time when a corresponding message was received. That is, each incoming message can be stored in a message inbox along with the state of mind of a user at the time when a corresponding message was received.
p-0126<figref idrefs="DRAWINGS">FIG. 17</figref> illustrates a ‘new message’ screen <b>570</b> that can be displayed on the display module <b>151</b>. Referring to <figref idrefs="DRAWINGS">FIG. 17</figref>, an icon <b>573</b> indicating the state of mind of a user when writing a new SMS or MMS message or a new email can be displayed on the ‘new message’ screen <b>570</b>. When the writing of the new SMS or MMS message or the new email is complete, the written message or email can be sent along with the icon <b>573</b>.
p-0127The exemplary embodiment of <figref idrefs="DRAWINGS">FIG. 12</figref> will hereinafter be described in further detail with reference to <figref idrefs="DRAWINGS">FIGS. 18(</figref><i>a</i>)-<b>18</b>(<i>b</i>).
p-0128<figref idrefs="DRAWINGS">FIG. 18(</figref><i>a</i>) illustrates a display screen <b>560</b> that can be displayed on the display module <b>151</b> upon the arrival of a predefined alarm time. Referring to <figref idrefs="DRAWINGS">FIG. 18(</figref><i>a</i>), when the predefined alarm time arrives, the display screen <b>560</b> can be displayed on the display module <b>151</b>, and an alarm sound can be output. In this case, if a user is sleepy or asleep, the volume of the alarm sound can be maximized, or the alarm sound can be output along with vibration until the user is awaken from sleep. On the other hand, if the user is neither sleepy nor asleep, the output of the alarm sound can be stopped, and a display screen <b>590</b> showing a message that says “alarm ended” can be displayed on the display module <b>151</b>, as shown in <figref idrefs="DRAWINGS">FIG. 18(</figref><i>b</i>).
p-0129<figref idrefs="DRAWINGS">FIGS. 19(</figref><i>a</i>) through <b>20</b>(<i>b</i>) illustrate how to control a navigation function according to the state of mind of a user. Referring to <figref idrefs="DRAWINGS">FIG. 19(</figref><i>a</i>), an icon <b>603</b> indicating the state of mind of a user can be displayed on a GPS navigation screen <b>600</b> that can be displayed on the display module <b>151</b>. Then, if the user is determined to be about to fall asleep while driving, a screeching sound can be output, and a visual representation of the screeching sound, or another sound or visual effect, can be displayed on a GPS navigation screen <b>610</b>, as shown in <figref idrefs="DRAWINGS">FIG. 19(</figref><i>b</i>).
p-0130If the user is not in his or her usual state of mind when the GPS navigation screen <b>600</b> is displayed, a radio or music player of the mobile terminal <b>100</b> can be turned on.
p-0131Referring to <figref idrefs="DRAWINGS">FIG. 20(</figref><i>a</i>),previously visited locations where a user has been measured as feeling stressful can be recorded. Then, when the user revisits one of the locations, an icon <b>623</b> corresponding to a stressful state of mind can be displayed on a display screen <b>620</b> on the display module <b>151</b>. Afterwards, a multimedia player screen <b>630</b> can be displayed as shown in <figref idrefs="DRAWINGS">FIG. 20(</figref><i>b</i>), instead of the display screen <b>620</b>, and music that can relieve stress can be automatically played.
p-0132A number of locations where the user feels excitement or joy can be recorded along with display screens or operations displayed or performed by the mobile terminal <b>100</b> at the time of the user's visit to the locations. Then, when the user revisits one of the locations, the display screen or the operation that was displayed or performed by the mobile terminal <b>100</b> at the time of the user's first visit to the revisited location can be restored. Accordingly, when a user visits a new place, the state of mind of the user can be determined and recorded for a later use when the user revisits the new place.
p-0133<figref idrefs="DRAWINGS">FIGS. 21(</figref><i>a</i>)-<b>21</b>(<i>b</i>) illustrate how to control a short-range communication function according to the state of mind of a user according to an embodiment of the invention. Referring to <figref idrefs="DRAWINGS">FIG. 21(</figref><i>a</i>), when a request for searching for or connecting the mobile terminal to an external device that can communicate with the mobile terminal <b>100</b> via short-range communication such a Bluetooth, or another form of communication, is received from a user, a display screen <b>640</b> can be displayed on the display module <b>151</b>. The mobile terminal <b>100</b> can be listed in a list of external devices that can communicate via short-range communication in a name reflecting the state of mind of the user, or a message indicating the state of mind of the user can be displayed on the display screen <b>640</b>. In addition, an image <b>653</b> indicating the state of mind of the user can be displayed on a display screen <b>650</b> showing the list of external devices that can communicate via short-range communication, as shown in <figref idrefs="DRAWINGS">FIG. 21(</figref><i>b</i>).
p-0134<figref idrefs="DRAWINGS">FIGS. 22(</figref><i>a</i>)-<b>22</b>(<i>b</i>) illustrates how to control a multimedia player function according to the state of mind of a user according to an embodiment of the invention. Referring to <figref idrefs="DRAWINGS">FIG. 22(</figref><i>a</i>), a play list screen <b>660</b> showing a plurality of music files can be displayed on the display module <b>151</b>. Each of the music files is paired with an icon indicating the state of mind of a user at the time when the user listened to a corresponding music file. Thus, the user can effectively classify the music files and select one of the music files to listen to.
p-0135Referring to <figref idrefs="DRAWINGS">FIG. 22(</figref><i>b</i>), an icon <b>673</b> indicating the state of mind of a user can be displayed on a multimedia player screen <b>670</b> on the display module <b>151</b>. A music file can be automatically selected and played on the multimedia player screen <b>670</b> according to the state of mind of the user. In addition, the volume of a current music file can be automatically adjusted, or various sound effects can be automatically applied to the current music file according to the state of mind of the user.
p-0136The mobile terminal according to the present invention and the method of controlling the operation of the mobile terminal according to the present invention are not restricted to the exemplary embodiments set forth herein. Therefore, variations and combinations of the exemplary embodiments set forth herein may fall within the scope of the present invention.
p-0137The embodiments of the present invention can be realized as code that can be read by a processor included in or downloaded to a mobile terminal and that can be written on one or more computer-readable recording media. The computer-readable recording medium may be any type of recording device in which data is stored in a computer-readable manner. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, and an optical data storage. The computer-readable recording medium can be distributed over a plurality of computer systems connected to a network so that computer-readable code is written thereto and executed therefrom in a decentralized manner. Functional programs, code, and code segments needed for realizing the present invention can be easily construed by one of ordinary skill in the art.
p-0138As described above, according to embodiments of the present invention, it is possible to determine the state of mind of a user based on brain wave measurements obtained from the user and use the results of the determination to control various functions performed by a mobile terminal such as a call-related operation, an alarm function or a communication event function. Therefore, it is possible to effectively control the operation of the mobile terminal according to the state of mind of the user.
p-0139While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.
Contents5
22 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2014206323A1 | Cited by | United States of America | Pre-grant |
| US10405764B2 | Cited by | United States of America | Applicant |
| US11478603B2 | Cited by | United States of America | Applicant |
| WO2022186880A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US11786694B2 | Cited by | United States of America | Applicant |
| US10651668B2 | Cited by | United States of America | Search report |
| WO2014102722A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US11690774B2 | Cited by | United States of America | Applicant |
| US11452839B2 | Cited by | United States of America | Applicant |
| US10345901B2 | Cited by | United States of America | Search report |
| US11184311B2 | Cited by | United States of America | Search report |
| US11723579B2 | Cited by | United States of America | Applicant |
| US11364361B2 | Cited by | United States of America | Applicant |
| US11717686B2 | Cited by | United States of America | Applicant |
| US11318277B2 | Cited by | United States of America | Applicant |
| US2016320840A1 | Cited by | United States of America | Pre-grant |
| US11439340B2 | Cited by | United States of America | Applicant |
| US2016254681A1 | Cited by | United States of America | Search report |
| US10019060B2 | Cited by | United States of America | Search report |
| DK201770369A1 | Cited by | Denmark | Search report |
| US2014277582A1 | Cited by | United States of America | Pre-grant |
| US9148768B2 | Cited by | United States of America | Search report |
| US11273283B2 | Cited by | United States of America | Applicant |
| US9539118B2 | Cited by | United States of America | Search report |
| US9766959B2 | Cited by | United States of America | Applicant |
| US2019310707A1 | Cited by | United States of America | Search report |
| US11534358B2 | Cited by | United States of America | Applicant |
| CN108494421A | Cited by | China | Search report |
| US2015312711A1 | Cited by | United States of America | Pre-grant |
| US2015045007A1 | Cited by | United States of America | Pre-grant |
| US10824232B2 | Cited by | United States of America | Search report |
| US2002082007A1 | Cites | United States of America | Pre-grant |
| US2003003871A1 | Cites | United States of America | Pre-grant |
| US2005163302A1 | Cites | United States of America | Pre-grant |
| US2006098027A1 | Cites | United States of America | Pre-grant |
| US2007161403A1 | Cites | United States of America | Pre-grant |
| US2008171573A1 | Cites | United States of America | Pre-grant |
| US2008177197A1 | Cites | United States of America | Pre-grant |
| US2009002178A1 | Cites | United States of America | Pre-grant |
| US2009112782A1 | Cites | United States of America | Pre-grant |
| US2010035648A1 | Cites | United States of America | Pre-grant |
| US2010041447A1 | Cites | United States of America | Pre-grant |
| US5692517A | Cites | United States of America | Pre-grant |
| US6011991A | Cites | United States of America | Pre-grant |
| US8005766B2 | Cites | United States of America | Pre-grant |
| US8027455B2 | Cites | United States of America | Pre-grant |
| US8260350B2 | Cites | United States of America | Pre-grant |
8 members in 4 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 20100082138 | Republic of Korea | A | |
| 20100082138 | Republic of Korea | A | |
| 1020100082138 | – | – | – |
| KR20100082138 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| EP2423785A2 | European Patent Office (EPO) | A2 | |
| US2012052905A1 | United States of America | A1 | |
| KR20120021987A | Republic of Korea | A | |
| CN102438063A | China | A | |
| EP2423785A3 | European Patent Office (EPO) | A3 | |
| CN102438063B | China | B | |
| US9118775B2 | United States of America | B2 | |
| KR101668249B1 | Republic of Korea | B1 |
73 transactions on the USPTO file
Allowed after 2 non-final rejections, 1 final rejection and 1 RCE.
- Non-final rejections
- 2
- Final rejections
- 1
- RCEs
- 1
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 4th Year, Large EntityM1551 | M1551 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Email NotificationEML_NTR | EML_NTR | |
| Printer Rush- No mailingTCPB | TCPB | |
| Mail Miscellaneous Communication to ApplicantMM327 | MM327 | |
| Miscellaneous Communication to Applicant - No Action CountM327 | M327 | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Pubs Case Remand to TCPUBTC | PUBTC | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Correspondence Address ChangeC.ADB | C.ADB | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Mail Interview Summary - Applicant Initiated - TelephonicMEXAT | MEXAT | |
| Interview Summary- Applicant InitiatedEXIA | EXIA | |
| Interview Summary - Applicant Initiated - TelephonicEXAT | EXAT | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Sent to Classification ContractorPGPC | PGPC | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Request from applicant for the USPTO to retrieve the Priority DocumentPDREQUST | PDREQUST | |
| Initial Exam Team nnIEXX | IEXX |
10 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Lapse for failure to pay maintenance feesLapsedPATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYLAPS | LAPS | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Fee payment procedureMAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Maintenance fee paymentMAFP | MAFP | |
| Fee payment procedurePAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITYFEPP | FEPP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| Notice of allowance mailedORIGINAL CODE: MN/=.ZAAB | ZAAB | |
| Notice of allowance and fees dueORIGINAL CODE: NOAZAAA | ZAAA | |
| AssignmentAS | AS |
Numbers
- Publication
- 20120052905
- Publication, DOCDB
- 2012052905
- Publication, EPODOC
- US2012052905
- Application
- 13169931
- Application, DOCDB
- 201113169931
- Application, EPODOC
- US201113169931
Titles
- English
- MOBILE TERMINAL AND METHOD OF CONTROLLING OPERATION OF THE MOBILE TERMINAL
Patent term adjustment
- A delay
- +466 daysthe office missed an examination deadline
- Applicant delay
- −12 days
- Net adjustment
- 454 days
Classification
- CPC, 11
- G06F3/015
- H04M1/72448
- H04B1/40
- H04M2250/12
- H04W4/12
- H04L51/224
- H04L51/58
- H04W88/02
- H04M1/724
- H04W8/18
- H04M3/537
- IPC, 2
- H04M1 72448
- H04W88 02
- USPC, 1
- 455550100