Mobile terminal and method of controlling the same
Abstract
Mobile terminal (100), comprising: a screen (151); a communication unit (110) configured to receive, from other electronic devices (100a, 100b, 100c), information related to contents that are being executed in the other electronic devices (100a, 100b, 100c); and a controller (180) configured to display widgets (S1, S2, S3) individually corresponding to a respective device among the other electronic devices (100a, 100b, 100c) on the screen (151), representing each of the widgets (S1, S2, S3) information relating to the content that is being executed in a corresponding device among the other electronic devices (100a, 100b, 100c), characterized in that the information related to the content includes video content and an instant of reproduction of the video content, in which the other electronic devices (100a, 100b, 100c) are adapted to reproduce the video content, and in which the mobile terminal (100) is adapted, in response to the user activating the mobile terminal (100), to obtain information regarding the content from a first external electronic device (100a) from among the other electronic devices (100a, 100b, 100c), to reproduce the video content without interruptions starting from the instant of the video content playback which is being played on the first external electronic device (100a).

Term
4.5 yearsto projected expiry
Projected expiry 11 April 2031, counted from filing; an application has no term until it is granted.
- Priority
- Filed
- Published
- Today
- Projected expiry
15 claims: 11 independent, 4 dependent
- 1ES 2 546 232 T3 REIVINDICACIONES 1. Terminal móvil (100), que comprende:una pantalla (151);una unidad de comunicación (110) configurada para recibir, desde otros dispositivos electrónicos (100a, 100b, 100c), una información relacionada con contenidos que están siendo ejecutados en los otros dispositivos electrónicos (100a, 100b, 100c);y un controlador (180) configurado para visualizar unos widgets (S1, S2, S3) correspondientes individualmente a un respectivo dispositivo de entre los otros dispositivos electrónicos (100a, 100b, 100c) en la pantalla (151), representando cada uno de los widgets (S1, S2, S3) una información relativa al contenido que está siendo ejecutado en un dispositivo correspondiente de entre los otros dispositivos electrónicos (100a, 100b, 100c), caracterizado por que la información relacionada con el contenido incluye contenido de vídeo y un instante de reproducción del contenido de vídeo, en el que los otros dispositivos electrónicos (100a, 100b, 100c) están adaptados para reproducir el contenido de vídeo, y en el que el terminal móvil (100) está adaptado, como respuesta a que el usuario accione el terminal móvil (100), para obtener una información relativa al contenido procedente de un primer dispositivo electrónico externo (100a) de entre los otros dispositivos electrónicos (100a, 100b, 100c), para reproducir el contenido de vídeo sin interrupciones empezando a partir del instante de reproducción del contenido de vídeo que está siendo reproducido en el primer dispositivo electrónico externo (100a).
- 2Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que una pantalla de visualización de la pantalla (151) comprende una pantalla táctil, y como respuesta a una entrada táctil, que incluye tocar la pantalla táctil en una posición relativa a un primero de los widgets (S1) y arrastrar desde el primero de los widgets (S1) tocado hasta un segundo de los widgets (S2), se transmite información relacionada con un contenido que está siendo ejecutado en un primero de entre los otros dispositivos electrónicos (100a) correspondiente al primero de los widgets (S1) a un segundo dispositivo de entre los otros dispositivos electrónicos (100b) correspondientes al segundo de los widgets (S2).
- 3Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que la unidad de comunicación (110) se comunica con por lo menos uno de entre los otros dispositivos electrónicos (100a, 100b, 100c) inalámbricamente, y el controlador (180) está configurado asimismo para visualizar un menú cuando se selecciona un primero de los widgets (S1), y el menú comprende un elemento del menú para enviar un mensaje desde el terminal móvil (100) hasta un primero de los otros dispositivos electrónicos (100a) correspondientes al primero de los widgets (S1) seleccionado por medio de la unidad de comunicación (110).
- 4Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que el controlador (180) está configurado asimismo para disponer y visualizar los widgets (S1, S2, S3) en la pantalla (151) basándose en unas posiciones relativas de los dispositivos electrónicos con respecto a una posición del terminal móvil (100) o configurado para disponer los widgets de tal manera que uno de los widgets sea visualizado de forma distintiva con respecto al resto de los widgets (S1, S2, S3), y el widget distintivo de entre los widgets sea visualizado finalmente en toda el área de visualización de la pantalla (151) o configurado para disponer y visualizar los widgets (S1, S2, S3) basándose en una prioridad de la información recibida relacionada con el contenido, y en el que el criterio para determinar la prioridad es preestablecido por un usuario o de forma predeterminada.
- 5Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que el controlador (180) está configurado asimismo para visualizar un icono giratorio (I3) junto con los widgets (S1, S2, S3) en la pantalla (151) de tal manera que una señal operativa para seleccionar un widget específico de entre los widgets (S1, S2, S3) se genera como respuesta a la rotación del icono (I3) visualizado en la pantalla (151).
- 6Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, que comprende asimismo una memoria (160) configurada para almacenar una palabra clave específica que se utiliza para identificar una información de contenido relacionada con la palabra clave específica, en el que el controlador (180) está configurado asimismo para dar salida a una información de alerta al detectar información de contenido relacionada con la palabra clave específica desde por lo menos uno de entre los otros dispositivos electrónicos (100a, 100b, 100c).
- 7Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que el controlador (180) está configurado asimismo para solicitar a un dispositivo electrónico (100a, 100b, 100c) que proporcione un recurso ES 2 546 232 T3 necesario para visualizar el contenido adecuadamente en la pantalla (151), y la pantalla (151) está configurada asimismo para visualizar el contenido tras recibir el recurso desde el dispositivo electrónico.
- 8Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que la información relacionada con el contenido incluye una información complementaria acerca del contenido y una información acerca de una fuente del contenido, comprendiendo la información complementaria por lo menos una descripción, un título o un tiempo de ejecución del contenido, o un nombre o tipo de dispositivo electrónico que proporciona el contenido.
- 9Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que la pantalla (151) comprende una pantalla táctil y está configurada para recibir una entrada táctil para seleccionar uno de los widgets (S1, S2, S3) visualizados en la pantalla táctil, y en el que el controlador (180) está configurado asimismo para visualizar una información de pantalla relacionada con el contenido correspondiente al widget seleccionado de entre los widgets en la pantalla (151) como respuesta a la entrada táctil.
- 10Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que los widgets (S1, S2, S3) son visualizados en la pantalla (151) mientras los contenidos están siendo visualizados en los otros dispositivos electrónicos (100a, 100b, 100c) o son clasificados en por lo menos dos grupos, agrupándose por lo menos un widget de cada grupo basándose en una ubicación, en la que está situado por lo menos un dispositivo electrónico correspondiente a dicho por lo menos un widget, y en el que cada grupo es identificado por un nombre asignado de la ubicación.
- 11Terminal móvil (100) según cualquiera de las reivindicaciones anteriores, en el que el controlador (180) está configurado asimismo para visualizar la información relacionada con el contenido correspondiente a uno de entre los otros dispositivos electrónicos (100a, 100b, 100c) en una primera parte definida de la pantalla, mientras que los widgets (S1, S2, S3) son visualizados en una segunda parte definida de la pantalla.
- 12Método de control de un terminal móvil (100), comprendiendo el método las etapas siguientes:comunicarse con otros dispositivos electrónicos (100a, 100b, 100c), de los cuales un primer dispositivo electrónico externo (100a) está reproduciendo un contenido de vídeo;recibir una información de contenido que incluye un contenido de vídeo y un instante de reproducción del contenido de vídeo desde los otros dispositivos electrónicos (100a, 100b, 100c), siendo la información de contenido información relacionada con un contenido que se está ejecutando en los otros dispositivos electrónicos (100a, 100b, 100c);y visualizar, en una pantalla (151) del terminal móvil (100), unos widgets (S1, S2, S3) correspondientes individualmente a un respectivo dispositivo de entre los otros dispositivos electrónicos (100a, 100b, 100c), representando cada uno de los widgets (S1, S2, S3) una información de contenido de un dispositivo correspondiente de entre los otros dispositivos electrónicos (100a, 100b, 100c), estando el método caracterizado por que comprende asimismo: reproducir sin interrupciones el contenido de vídeo del primer dispositivo electrónico externo (100a) en el terminal móvil (100) empezando a partir del instante de reproducción del contenido de vídeo que está siendo reproducido en el primer dispositivo electrónico externo (100a), como respuesta a que un usuario accione el terminal móvil (100) para obtener información relativa al contenido del primer dispositivo electrónico externo (100a).
- 13Método según la reivindicación 12, en el que los widgets (S1, S2, S3) están dispuestos y son visualizados basándose en las posiciones relativas de los otros dispositivos electrónicos (100a, 100b, 100c) con respecto a una posición del terminal móvil (100), y en el que uno de los widgets es visualizado de manera distintiva con respecto al resto de los widgets como respuesta a una entrada recibida y el widget visualizado de forma distintiva de entre los widgets es finalmente visualizado por sí solo en toda el área de visualización de la pantalla (151) tras ser visualizado de manera distintiva entre los widgets durante un periodo de tiempo preestablecido.
- 14Método según la reivindicación 12 o 13, que comprende asimismo las etapas siguientes:recibir una palabra clave específica para identificar información de contenido relacionada con la palabra clave específica;y dar salida a una información de alerta tras detectar la información de contenido relacionada con la palabra clave específica desde por lo menos uno de entre los otros dispositivos electrónicos (100a, 100b, 100c).
- 15Método según una de las reivindicaciones 12 a 14, en el que el terminal móvil (100) se comunica con por lo menos uno de entre los otros dispositivos electrónicos (100a, 100b, 100c) inalámbricamente, comprendiendo ES 2 546 232 T3 asimismo el método solicitar a un dispositivo electrónico que proporcione un recurso necesario para visualizar el contenido adecuadamente antes de visualizar el contenido en la pantalla (151), en el que la información de contenido comprende una información referente al instante de reproducción del contenido, correspondiendo el instante de reproducción a una posición en el contenido que estaba siendo 5 reproducido en el momento en el que la información de contenido era transmitida al terminal móvil (100), comprendiendo el método asimismo hacer que uno de los otros dispositivos electrónicos (100a, 100b, 100c) que proporciona la información de contenido detenga la visualización del contenido en uno de entre los otros dispositivos electrónicos (100a, 100b, 100c).
Independent claims15
199 paragraphs in 8 sections, as filed
ES 2 546 232 T3
DESCRIPTION
Mobile terminal and its control method.
Cross reference to related requests
As provided in 35 USC § 119 (a), the present application claims the right of the earlier filing date and the right of priority to the Korean patent application No. 10-2010-0042565 filed on May 6, 2010.
Field of the invention
The present invention relates to a mobile terminal and a control method thereof and, more particularly, to a mobile terminal and a control method thereof for displaying widgets that reflect content information received from other electronic devices.
Description of Related Art
Since the functions of terminals such as personal computers, laptops, mobile phones and the like are diversified, the terminals are structured in the form of multimedia players that have various functions, such as capturing images or moving images, playing music. , motion picture files and games and the reception of broadcast programs.
The terminals can be divided into mobile terminals and fixed terminals. Mobile terminals can be classified into portable terminals and vehicle mount terminals according to their modes of mobility. Document WO 01/18691 A2 discloses a method for efficiently transferring data between a client and a server, comprising the steps of providing an application program, providing an application independent client method adopting a plurality of client states, provision of an application independent server method adopting a plurality of server states; transferring data from the server method to the client method in response to an application program, and updating at least one client state in response to the transferred data. A related apparatus is also disclosed.
A variety of recent terminals comprising mobile terminals offers more complex and diverse functions. To enable and improve the functions of a terminal, it is necessary to improve a structural part and / or a software part of the terminal.
Summary of the invention
One aspect of the present specification is to offer a mobile terminal and a control method thereof for displaying widgets that reflect content information received from other electronic devices.
According to an embodiment of the present invention, a mobile terminal according to claim is disclosed
1.
According to another embodiment of the present invention, a method of controlling a mobile terminal according to claim 11 is disclosed.
Brief description of the drawings
The implementation of the present invention will be described in detail with reference to the accompanying drawings, in which like reference numerals are used to refer to like elements.
Figure 1 is a block diagram of a mobile terminal according to an embodiment of the present invention.
Figure 2A is a front perspective view of a mobile terminal according to an embodiment of the present invention.
Figure 2B is a rear perspective view of a mobile terminal according to an embodiment of the present invention.
Figures 2C and 2D illustrate various forms of mobile terminals and display screens according to different embodiments of the present invention.
ES 2 546 232 T3
Figure 3 is a conceptual diagram illustrating a proximity depth of a proximity sensor according to an embodiment of the present invention.
Figure 4 illustrates a configuration of a code division multiple access (CDMA) wireless communication system communicating with a mobile terminal in accordance with an embodiment of the present invention.
Fig. 5 is a flow chart illustrating an operation of a mobile terminal according to an embodiment of the present invention.
Figures 6 and 7 illustrate communication between a mobile terminal and various external electronic devices according to an embodiment of the present invention.
Figures 8 and 9 illustrate how a mobile terminal is used to obtain content information from an external electronic device to output content information in accordance with an embodiment of the present invention.
Figures 10 (a) -12 (b) illustrate the operations of displaying content information obtained by a mobile terminal and manipulating the content information displayed according to various embodiments of the present invention.
Fig. 13 is a flow chart illustrating a reception operation of an operational signal with respect to the output content information according to an embodiment of the present invention.
Figures 14 (a) -19 (b) illustrate the operations intended to output content information received from external electronic devices and control of external electronic devices based on the content information according to various embodiments of the present invention.
Figure 20 illustrates an operation of a mobile terminal to search for a new external device according to an embodiment of the present invention.
Figure 21 illustrates an arrangement of external electronic devices that are searched by a mobile terminal according to an embodiment of the present invention.
Fig. 22 is a flow chart illustrating an operation of a mobile terminal relating to a screen event according to an embodiment of the present invention.
Figure 23 illustrates an operation related to the screen event represented in Figure 22.
Figures 24 and 25 are flowcharts illustrating an operation of a mobile terminal to share a resource for outputting content according to an embodiment of the present invention.
Detailed description of the preferred embodiments
The present invention will now be described in greater detail with reference to the accompanying drawings, in which examples of embodiments of the present invention are shown. However, the present invention can take many different forms and should not be construed as being limited to the embodiments disclosed herein, but rather that these embodiments are provided for the purpose of the present disclosure being more complete and detailed and fully communicate the concept of the present invention to those skilled in the art.
In the following description, the terms module and unit are added to the components of the mobile terminal for the sole purpose of facilitating the description, said terms not having different meanings or functions from one another. The mobile terminal described herein may comprise a mobile phone, a smartphone, a laptop, a digital broadcast terminal, a personal digital assistant (PDA), a portable media player (PMP), a navigation system, etc. .
Figure 1 is a block diagram of a mobile terminal 100 according to an embodiment of the present invention. Other embodiments, configurations, and arrangements may also be provided for the present invention. As shown in Figure 1, the mobile terminal 100 may comprise a wireless communication unit 110, an audio / video (A / V) input unit 120, a user input unit 130, a sensor unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply 190. Not all components depicted in Figure 1 may be essential parts and the number of components comprised in mobile terminal 100 may vary. TO
ES 2 546 232 T3 will now describe the components of the mobile terminal 100.
Wireless communication unit 110 may comprise at least one module that enables wireless communication between mobile terminal 100 and a wireless communication system or between mobile terminal 100 and a network in which mobile terminal 100 is located. For example, the wireless communication unit 110 may comprise a broadcast reception module 111, a mobile communication module 112, a wireless Internet module 113, a local area or short range communication module 114, and a location module position 115.
The broadcast reception module 111 can receive broadcast signals and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may comprise a satellite channel and a terrestrial channel, and the broadcast management server may be a server that generates and transmits broadcast signals and / or broadcast-related information or a server that receives broadcast signals. created previously and / or broadcast-related information and transmits the broadcast signals and / or broadcast-related information to a terminal.
The broadcast signals can comprise not only TV broadcast signals, radio broadcast signals and data broadcast signals, but also signals in the form of a combination of a TV broadcast signal and a radio broadcast signal. The broadcast-related information can be information about a broadcast channel, a broadcast program or a broadcast service provider, and can even be provided through a mobile communication network. In the latter case, the mobile communication module 112 can receive the broadcast related information.
Information related to broadcasting can exist in various forms. For example, broadcasting-related information may exist in the form of an electronic program guide (EPG) of a digital multimedia broadcasting system (DMB) or in the form of an electronic service guide (ESG) of a broadcasting system of portable digital video (DVB-H).
The broadcast reception module 111 can receive broadcast signals by various broadcast systems. More particularly, the broadcast reception module 111 can receive digital broadcast signals by digital broadcast systems such as a terrestrial digital multimedia broadcasting system (DMB-T), a satellite digital multimedia broadcasting system (DMB-S), a MediaFLO (Media Forward Link Only) system, a DVB-H system and an Integrated Services Digital Terrestrial Broadcasting System (ISDB-T). The broadcast reception module 111 can receive signals from broadcast systems that transmit broadcast signals other than the digital broadcast systems described above.
Broadcast signals and / or broadcast related information received through broadcast receiving module 111 may be stored in memory 160. Mobile communication module 112 may transmit / receive a radio signal to / from at least one of a base station, an external terminal and a server of a mobile communication network. The radio signal may comprise a voice call signal, a videotelephony call signal or data in various forms in accordance with the transmission and reception of text / multimedia messages.
The wireless Internet module 113 can correspond to a module for wireless Internet access and can be included in the mobile terminal 100 or it can be externally connected to the mobile terminal 100. As a wireless Internet technique, wireless LAN techniques (WLAN or Wi-Fi), wireless broadband (Wibro), Wimax (World interoperability for microwave access), HSDPA (High Speed Downlink Packet Access), etc.
The short-range communication module 114 may correspond to a module for local area communication. Also, as a local area communication technique, Bluetooth®, radio frequency identification (RFID), infrared data association (IrDA), ultra-wideband (UWB) and / or ZigBee® techniques can be used.
The position location module 115 can confirm or obtain the position of the mobile terminal 100. The position location module 115 can obtain position information by means of a global navigation satellite system (GNSS). The acronym GNSS designates a radio navigation satellite system that revolves around the Earth and transmits reference signals to predetermined types of radio navigation receivers, so that the radio navigation receivers can determine their positions on the surface of the earth. Earth or near the surface of the Earth. GNSS can comprise a global positioning system (GPS) from the United States, Galileo from Europe, GLONASS (Global Orbiting Navigational Satellite System) from Russia, COMPASS from China and QZSS (Quasi-Zenith Satellite System) from Japan among others.
ES 2 546 232 T3
A global positioning system (GPS) module is a representative example of position location module 115. The GPS module can calculate information about distances between a point or object and at least three satellites and information about a time when the distance information is measured and apply the trigonometric calculation to the obtained distance information to obtain three-dimensional position information about the point or object based on latitude, longitude and altitude in a predetermined time.
A method of calculating position and time information by three satellites and correcting the position and time information calculated by another satellite can also be used. In addition, the GPS module can continuously calculate the current position in real time and calculate speed information using the location or position information.
As shown in FIG. 1, the A / V input unit 120 can input an audio signal or a video signal and comprise a camera 121 and a microphone 122. The camera 121 can process image frames from still images or images. motion obtained by an image sensor in a video telephony mode or a photography mode. The processed image frames can be displayed on a display module 151 which can be a touch screen.
Image frames processed by camera 121 can be stored in memory 160 or can be transmitted to an external device through wireless communication unit 110. Mobile terminal 100 can also comprise at least two cameras 121.
The microphone 122 can receive an external audio signal in a call mode, a record mode, or a voice recognition mode and process the received audio signal as electrical audio data. The audio data can then be converted into a form that can be transmitted to a mobile communication base station through the mobile communication module 112 and provided in call mode. Microphone 122 may employ various denoising algorithms (or denoising algorithms) to eliminate or reduce noise generated when the external audio signal is received.
The user input unit 130 may receive input data to control the use of the mobile terminal 100 by a user. User input unit 130 may comprise a keyboard, a dome switch, a touch panel (constant voltage / capacitance), a rocker wheel, a rocker switch, and so on.
The sensor unit 140 can detect a current state of the mobile terminal 100, such as an open / closed state of the mobile terminal 100, a position of the mobile terminal 100, if a user touches the mobile terminal 100, an address of the mobile terminal 100, and a acceleration / deceleration of the mobile terminal 100, and generating a sensor signal to control the operation of the mobile terminal 100. For example, in the case of a slider phone, the sensor unit 140 can detect whether the slider phone is open or closed. In addition, sensor unit 140 can sense whether power supply 190 is supplying power and / or if interface unit 170 is connected to an external device. The detection unit 140 may also comprise a proximity sensor 141 (not shown in the drawings).
Output unit 150 may generate visual, auditory, and / or tactile output and may comprise display module 151, audio output module 152, alarm unit 153, and haptic module 154. Display module 151 may display information processed by mobile terminal 100. The display module 151 can display a user interface (Ul) or a graphical user interface (GUI) related to a telephone call when the mobile terminal 100 is in call mode. The display module 151 can also display a captured and / or received image, an Ul or a GUI when the mobile terminal 100 is in the videotelephony mode or the photography mode.
Furthermore, the display module 151 may comprise at least one of a liquid crystal display, a thin-layer transistor liquid crystal display, an organic light-emitting diode display, a flexible display, and a three-dimensional display. Some of these screens can be of the transparent type or of the translucent type. That is, the display module 151 may comprise a transparent display module.
The transparent display module may comprise a transparent liquid crystal display. The rear structure of the display module 151 can also be of the translucent type. Consequently, a user can view an object located behind the body of the mobile terminal 100 through the transparent area of the body of the mobile terminal 100 that is occupied by the display module 151.
Mobile terminal 100 may also comprise at least two display modules 151. For example, mobile terminal 100 may comprise a plurality of display modules 151 that are arranged on a single surface at a predetermined distance or integrated displays. The plurality of display modules 151 may also be arranged on different sides.
ES 2 546 232 T3
Also, when the display module 151 and a touch detection sensor (hereinafter referred to as a touch sensor) form a layered structure called a touch screen, the display module 151 can be used as an input device in addition to an output device. . The touch sensor can take the form of a touch film, a touch sheet, and a touch panel, for example.
The touch sensor can convert a variation of the pressure applied to a specific part of the display module 151 or a variation of the capacitance generated in a specific part of the display module 151 into an electrical input signal. The touch sensor can detect the pressure of the touch, as well as the position and area of touch.
When the user applies a touch input to the touch sensor, a signal corresponding to the touch input can be transmitted to a touch controller. The touch controller can then process the signal and transmit, to controller 180, data corresponding to the processed signal. Consequently, the controller 180 can detect a touched part of the display module 151.
The proximity sensor 141 of the sensor unit 140 may be in an internal area of the mobile terminal 100 surrounded by the touch screen, or near the touch screen. The proximity sensor 141 can detect an object approaching a predetermined sensing surface or an object near the proximity sensor by electromagnetic force or infrared rays without the need for mechanical contact. Proximity sensor 141 can have a longer lifetime than a contact sensor and, therefore, can have great application in mobile terminal 100.
The proximity sensor 141 may comprise a transmitting photoelectric sensor, a direct reflection photoelectric sensor, a specular reflection photoelectric sensor, a high frequency oscillating proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor and / or an infrared proximity sensor. A capacitive touch screen can be structured in such a way that it detects the proximity of a pointer through a variation of an electric field according to the proximity of the pointer. The touch screen (touch sensor) can be classified as a proximity sensor 141.
For ease of description, an action of bringing the pointer closer to the touch screen without actually touching the touch screen may be referred to as a proximity touch and an action of the pointer to touch the touch screen may be referred to as a contact touch. The proximity touch point of the pointer on the touch screen may correspond to a point on the touch screen where the pointer is perpendicular to the touch screen.
The proximity sensor 141 can detect the proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). The information corresponding to the detected proximity touch action and the proximity touch pattern can then be displayed on the touch screen.
The audio output module 152 can provide audio data received from the wireless communication unit 110 or stored in memory 160 in a call signal reception mode, a telephone call mode or a recording mode, a recording mode. voice recognition and a broadcast reception mode. The audio output module 152 can provide function-related audio signals, such as a call sign input tone and a message input tone, borrowed from the mobile terminal 100. The audio output module 152 can comprise a receiver, a speaker, a buzzer, and the like. The audio output module 152 can output sounds through a headphone jack. The user can hear the sounds by connecting a headphone to the headphone jack.
The alarm unit 153 may output a signal to indicate the generation of an event from the mobile terminal 100. For example, alarms may be generated when a call signal or message is received or a key signal or input touch is entered. The alarm unit 153 can also output signals in ways other than video signals or audio signals, for example, a signal to indicate the generation of an event through vibration. Video signals or audio signals can also be output through display unit 151 or audio output module 152.
The haptic module 154 can generate various haptic effects that the user can perceive. An example of a haptic effect is a vibration. The intensity and / or pattern of vibration generated by haptic module 154 can also be controlled. For example, different vibrations can be combined and emitted or they can be emitted in sequence.
The haptic module 154 can generate a variety of haptic effects comprising a stimulus effect according to an arrangement of pins that move vertically against the surface of the contact skin, a stimulus effect according to a pressure force or air suction force through a pressure hole or hole
ES 2 546 232 T3 of suction, a stimulating effect of rubbing the skin, a stimulating effect according to the contact of an electrode, a stimulating effect by means of an electrostatic force and an effect according to the reproduction of cold and heat by an element capable of absorbing or radiating heat as well as vibrations.
The haptic module 154 can not only transmit haptic effects through direct contact, but can also allow the user to perceive haptic effects through the kinesthetic sense of the user's fingers or arms. Mobile terminal 100 may also comprise a plurality of haptic modules 154.
Memory 160 can store a program for the operation of controller 180 and temporarily store input / output data, such as a phone book, messages, still images, and / or movie clips. Memory 160 can also store data about vibrations and sounds in various patterns that are output from the application of a touch input to the touch screen.
The memory 160 may comprise at least one flash memory, a hard disk memory. a micro multimedia card memory, a card memory, such as an SD or XD memory, a random access memory (RAM), a static RAM (SRAM), a read-only memory (ROM), a programmable and erasable ROM (EEPROM), a programmable ROM magnetic memory (PROM), a magnetic disk, or an optical disk. The mobile terminal 100 may also be operative in connection with a type of web storage that performs the function of storing memory 160 on the Internet.
Interface unit 170 can serve as a path to external devices connected to mobile terminal 100. Interface unit 170 can receive data from external devices or power, and transmit the data or power to internal components of mobile terminal 100 or transmitting data from the mobile terminal 100 to external devices. For example, the interface unit 170 may comprise a wired / wireless handset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device featuring a memory module. user ID, an audio I / O port, a video I / O port, and / or a headphone port.
Interface unit 170 may also interface with a user identification module which is a chip that stores information to authenticate authorization to use mobile terminal 100. For example, the user identification module may be a user identification module ( UIM), a Subscriber Identification Module (SIM), and a Universal Subscriber Identification Module (USIM). An identification device comprising the user identification module can also be manufactured in the form of a smart card. Consequently, the identification device can be connected to the mobile terminal 100 through a port of the interface unit 170.
Interface unit 170 may also be a path through which power is supplied from an external docking station to mobile terminal 100 when mobile terminal 100 is connected to the external docking station or a path through which power is supplied. they transmit, to the mobile terminal 100, various command signals entered by the user through the connection base. The various command signals or power input from the docking station can be used as signals to confirm whether the mobile terminal 100 is properly seated in the docking station.
Controller 180 may control the set of operations of mobile terminal 100. For example, controller 180 may carry out control and processing for voice transmission, data transmission, and / or video telephony. Controller 180 may also comprise a multimedia module 181 for playing multimedia. Multimedia module 181 may be comprised of controller 180, as depicted in FIG. 1, or it may be separate from controller 180.
Controller 180 may execute a pattern recognition method capable of recognizing handwritten input or picture-drawing input applied to the touch screen as characters or images. The power supply 190 can receive external power and internal power and supply the power necessary for the operations of the components of the mobile terminal 100 under control of the controller 180.
Depending on the hardware implementation, the embodiments of the present disclosure may be implemented by at least one of application-specific integrated circuits (ASICs), digital signal processors (DSP), digital signal processing devices ( DSPD), some programmable logic devices (PLD), some in situ programmable gate arrays (FPGA), some processors, some controllers, some microcontrollers, microprocessors and / or electrical units to execute functions. Controller 180 may implement the embodiments.
Depending on the software implementation, embodiments, such as methods or functions, may be implemented with a separate software module executing at least one function or operation. Software codes can be implemented according to a software application written in a suitable software language.
ES 2 546 232 T3
Software codes can be stored in memory 160 and executed by processor 180.
FIG. 2A is a front perspective view of a mobile terminal or a portable terminal 100 according to an embodiment of the present invention. For example, the portable terminal 100 has a bar-shaped terminal body. However, the present invention is not limited to a terminal in the form of a bar and can be applied to terminals of various types, including sliding, folding, tilting and rotating that have at least two bodies in combination of relative movement.
The body of the terminal comprises a housing (a frame, a frame or a cover) that forms the outer part of the terminal 100. In the present embodiment, the housing can be divided into a front housing 101 and a rear housing 102. In the space between the front housing 101 and the rear housing 102 are arranged various electronic components. In addition, at least one intermediate housing may be provided between the front housing 101 and the rear housing 102.
The housings can be made of plastic through injection molding or made of a metallic material, such as stainless steel (STS) or titanium (Ti).
The display module 151, the audio output module 152, the camera 121, the user input unit 130 comprising the operating units 131 and 132, the microphone 122 and the interface unit 170 may be arranged on the body of the terminal and, in particular, on the front casing 101.
The display module 151 occupies most of the main surface of the front housing 101. The audio output module 152 and the camera 121 are arranged in an area close to one of the two ends of the display module 151 and the unit. Operation 131 and microphone 122 are located in an area near the other end of display unit 151. The operating unit 132 and the interface unit 170 are arranged on the sides of the front case 101 and the rear case 102.
The user input unit 130 is operative to receive commands to control the operation of the portable terminal 100 and may comprise a plurality of operating units 131 and 132. The operating units 131 and 132 may be referred to as manipulation parts and employ any touch system used by the user to operate the operating units 131 and 132 while maintaining tactile feel.
The first and second operating units 131 and 132 can receive various inputs. For example, the first operating unit 131 receives commands such as start, end, and scroll and the second operating unit 132 receives commands such as control of the sound volume from the audio output module 152 or conversion from the display module. 151 to a touch recognition mode.
Figure 2B is a rear perspective view of the portable terminal shown in Figure 2A according to an embodiment of the present invention.
With reference to FIG. 2B, a camera 121 'may further be added to the rear side of the body of the terminal, that is, the rear housing 102. The camera 121' has a direction of photography opposite to that of the camera 121 shown in FIG. 2A and may have pixels different from those of the camera 121 shown in FIG. 2A.
For example, it is desirable that the camera 121 has low pixels so that it can capture an image of the user's face and transmit the image to a receiving party in the case of video telephony, while the camera 121 'has high pixels, due to It captures an image of a general object and does not immediately transmit the image in many cases. The chambers 121 and 121 'can be attached to the body of the terminal in such a way that they can rotate or pop out.
A flash 123 and a mirror 124 are further disposed in the vicinity of the camera 121 '. Flash 123 illuminates an object when camera 121 'takes a photo of the object. The mirror 124 is used for the user to observe his face through the mirror when the user wishes to self-photograph by the camera 121 '.
In addition, an audio output module 152 'may be provided on the rear side of the terminal body. The audio output module 152 'can perform a stereo function with the audio output module 152 shown in FIG. 2A and can be used in a speakerphone mode when the mobile terminal 100 is used for a telephone call.
Also, a receiving antenna for broadcasting signals can be added to the side of the body of the terminal in addition to an antenna for telephone calls. The antenna constituting a part of the broadcast reception module 111 shown in FIG. 1 may be installed in the body of the terminal, in such a way that the antenna can be pulled out of the body of the terminal.
ES 2 546 232 T3
The power supply 190 for supplying power to the portable terminal 100 is installed in the body of the terminal. Power supply 190 may be comprised of the body of the terminal or attached to the body of the terminal with a separable type of joint.
A touch panel 135 may further be added to the rear case 102 to allow touch detection. The touch panel 135 may be of a translucent type like the display module 151. In this case, if the display module 151 provides visual information through its two sides, the visual information can be recognized through the touch panel 135. The panel Touch 135 can control the information output through both sides of the display module 151. Otherwise, a screen is further added to the touch panel 135, such that a touch screen can also be provided on the rear case 102.
The touch panel 135 is operative in connection with the display module 151 of the front housing 101. The touch panel 135 may be located in parallel with the display module 151 behind the display module 151. The touch panel 135 may be of a identical or smaller in size to display module 151.
Figures 2C and 2D illustrate mobile terminal 100 and display unit 151 according to different embodiments of the present invention.
Referring to Figure 2C, the display module 151 may comprise a first screen and a second screen that are physically separated from each other. In a folding or sliding mobile terminal that has two bodies connected through a hinge or slide, the first screen (or main screen) can be found on the internal surface or the external surface of one of the bodies and the second screen (or subscreen ) can be found on the inner surface or the outer surface of the other body. The subscreen is separate from the mobile terminal and is combined by a detachable type joint with the body of the mobile terminal through an interface for displaying data from the mobile terminal 100.
The display module 151 may comprise first and second displays that are logically spaced from each other on a display panel, as illustrated in Figure 2D.
Figure 3 is a conceptual diagram illustrating a proximity depth of the proximity sensor 141. As depicted in Figure 3, when a pointer such as a user's finger approaches the touch screen, the proximity sensor 141 positioned inside or near the touch screen detects the approach and outputs a proximity signal. Proximity sensor 141 may be structured such that it outputs a proximity signal based on the distance between the pointer approaching the touch screen and the touch screen (referred to as the proximity depth).
The distance at which the proximity signal is output when the pointer approaches the touch screen is called the sensing distance. The proximity depth can be ascertained by means of a plurality of proximity sensors 141 having different sensing distances and by comparing the proximity signals respectively outputted by the proximity sensors 141.
Figure 3 represents the section of the touch screen where proximity sensors 141 capable of detecting three different proximity depths are arranged. Proximity sensors 141 capable of sensing less than three or more than four proximity depths can be arranged on the touch screen.
In particular, full contact of the pointer with the touch screen (D0) is recognized as a touch touch. The position of the pointer at a distance D1 from the touch screen is recognized as a proximity touch from a first proximity depth. The position of the pointer within a range of distances between distance D1 and distance D2 from the touch screen is recognized as a proximity touch from a second proximity depth. The position of the pointer within a range of distances between distance D2 and distance D3 from the touch screen is recognized as a proximity touch from a third proximity depth. The position of the pointer at a distance greater than the distance D3 from the touch screen is recognized as a proximity touch cancellation.
Accordingly, the controller 180 can recognize the proximity touch as various input signals depending on the proximity distance and the proximity position of the pointer with respect to the touch screen and exert various operational controls according to the input signals.
With reference to Figure 4, a CDMA wireless communication system comprises mobile terminals 100, base stations 270, base station controllers 275, and a mobile switching center 280. The mobile switching center 280 is connected to a telephone network Public Switched (PSTN) 290. Mobile switching center 280 is connected to base station controllers 275. Base station controllers 275 are connected to base stations 270 via return lines. The return lines can be built according to the E1 / T1, ATM, IP, PPP, frame relay, HDSL, ADSL or xDSL formats well known in the world.
ES 2 546 232 T3 field of technology. The CDMA wireless communication system may comprise at least two base station controllers 275.
Each base station 270 may comprise one or more sectors, each sector may comprise an omnidirectional antenna or an antenna adjusted to a specific radiation direction of the base station 270. In other cases, each sector may comprise two diversity receiving antennas. Each base station 270 is structured to present frequency assignments, and the frequency assignments can have specific spectra (eg, 1.25 MHz and 5 MHz). The intersection of sectors and frequency assignments can refer to a CDMA channel.
Base stations 270 may be referred to as base station transceiver subsystems (BTS). The term "base station" can be used as a term to designate the assembly of the base station controller 275 and one or more base stations 270 in various examples. In addition, base stations 270 can be called cell sites. In other cases, the individual sectors of a given base station 270 may be referred to as cell sites.
A terrestrial DMB transmitter 295 can transmit broadcast signals to mobile terminals 100 that are operative in the CDMA wireless communication system. The broadcast reception module 111 of each mobile terminal 100 is structured to receive the broadcast signals transmitted from the DBM transmitter 295. This can be similarly applied to different types of broadcast and multicast signaling as described above.
Figure 4 illustrates global positioning system (GPS) satellites 300. These satellites 300 can track the positions of some or all of the mobile terminals 100. Although two satellites are shown in Figure 4, the position information can be obtained from fewer or more than two satellites. In addition, other position tracking techniques can be used (eg, position tracking techniques that can replace the GPS technique or that can be added to the GPS technique). If required, part or all of the GPS 300 satellites can support DMB satellite transmission separately or additionally.
When the CDMA wireless communication system is operational, base stations 270 receive reverse link signals from mobile terminals 100. Mobile terminals 100 may be in a state where mobile terminals 100 make calls, send messages, or otherwise establish. of communications. Base stations 270 process reverse link signals received by base stations 270. The processed data is transmitted to base station controllers 275 connected to base stations 270. Base station controllers 275 offer mobility and call resource allocation management functions, including transparent handoffs between base stations 270. In addition , the base station controllers 275 transmit the received data to the mobile switching center 280. The mobile switching center 280 offers additional routing services to interface with the PSTN 290. Similarly, the PSTN 290 interfaces with the mobile switching center 280, and the mobile switching center 280 interfaces with the base station controllers 275. Base station controllers 275 control base stations 270 to transmit forward link signals to mobile terminals 100.
FIG. 5 is a flow chart illustrating a method for controlling mobile terminal 100 in accordance with one embodiment of the present invention. Figures 6 and 7 illustrate the connection of the mobile terminal 100 with external electronic devices 100a, 100b and 100c.
Referring to Figures 1, 5, 6, and 7, mobile terminal 100 outputs content information obtained from external devices 100a, 100b, and 100c and controls external electronic devices 100a, 100b, and 100c based on the content information. . During this operation, the mobile terminal 100 can provide a user interface capable of efficiently outputting and controlling content information.
The controller 180 of the mobile terminal 100 can connect the mobile terminal 100 with the external electronic devices 100a, 100b and 100c (S10). For example, external electronic devices are consumer electronic devices such as a TV set 100a, a mobile terminal or tablet computing device 100b, and a computer 100c.
External electronic devices 100a, 100b, and 100c can comprise various electronic devices except for some specific electronic devices. For example, if the user is currently using mobile terminal 100, electronic devices other than mobile terminal 100 can be considered external electronic devices. If the user is currently using the first external electronic device 100a, the mobile terminal 100 and the second and third external electronic devices 100b and 100c can be considered as external electronic devices. That is, the term external electronic device is a relative term. However, hereinafter electronic devices other than mobile terminal 100 will be generally referred to as
ES 2 546 232 T3 external electronic devices 100a, 100b and 100c to facilitate understanding. Also, although the number of external devices 100a, 100b and 100c is three in various drawings and the following description, the number of external electronic devices is not limited to three, but may be less or more than three.
External electronic devices 100a, 100b, and 100c can communicate wired or wirelessly with other electronic devices. The wireless communication method of the external electronic devices 100a, 100b, and 100c may involve communication with the wireless communication unit 110 of the mobile terminal 100, the detailed description thereof being omitted here. The connections between the mobile terminal 100 and the external electronic devices 100a, 100b and 100c will be described in detail later with reference to Figures 6 and 7.
After the connections of the mobile terminal 100 with the external electronic devices 100a, 100b and 100c, the controller 180 can obtain information about the content that has been output by the external electronic devices 100a, 100b and 100c (S20). The external electronic devices 100a, 100b and 100c can provide, respectively, content through the screens 151a, 151b and 151c comprised therein.
Information about content may correspond to the content itself or it may include a description of the content and information about the source of the content. When the first external electronic device 100a outputs the content A, for example, the mobile terminal 100 can obtain the content A from the first external electronic device 100a. Furthermore, the mobile terminal 100 can obtain detailed information comprising the title and the running time of the content A. On the other hand, the mobile terminal 100 can obtain the address of the source of the content A, such as a universal resource locator ( URL). If the mobile terminal 100 obtains the address of the source of the content, the mobile terminal 100 can obtain the content A without directly receiving the content A through communication with the first external electronic device 100a. Accordingly, the controller 180 of the mobile terminal 100 can select one of a path of obtaining content from the address of the content source and a path of obtaining content from the first external electronic device 100a, which results most advantageous in terms of data transmission speed.
When the mobile terminal 100 obtains the content information provided by the external electronic devices 100a, 100b and 100c connected thereto, the controller 180 can output widgets that reflect the content information obtained from the mobile terminal 100 (S30).
The content information may comprise information related to the reproduction of the content. In such cases, understanding can be facilitated if the content is assumed to be a moving image (herein also referred to as video). For example, when the mobile terminal 100 transmits content to at least one of the external electronic devices 100a, 100b, and 100c, information regarding the time of playback of the content that is being played on the mobile terminal 100 can be transmitted, along with the content. .
If the information regarding the time of playback and the content are transmitted together, the external electronic device 100a, 100b and / or 100c that has received the content can play the content continuously without repeating the parts that have already been played on the terminal. mobile 100 or without the user needing to make inquiries. In other words, the information regarding the time of reproduction allows the uniform reproduction of the content, in such a way that a user can view the content by means of the external electronic device 100a, 100b and / or 100c without carrying out any additional control thereof.
Content information can be transmitted from mobile terminal 100 to external electronic devices 100a, 100b and / or 100c in response to a touch and drag input comprising touching a widget and then dragging it to an external electronic device. desired on a display screen of the display module 151. For example, when the widgets corresponding to the external electronic devices 100a, 100b and 100c respectively are displayed on the display module 151 of the mobile terminal 100, the touch and drag input may consist of touching a first widget and then dragging the first widget to a second widget on the display screen. After receiving said touch and drag input, the mobile terminal 100 can transmit the content of a first external electronic device 100a corresponding to the first widget to a second external electronic device 100b corresponding to the second widget and, at the same time, it can also transmit information about content that includes the time of reproduction of the content that is transmitted. Therefore, the second external electronic device 100b that has received the content and / or the content information can play the content continuously from the playback time indicated in the content information.
Also, content and / or content information can be transmitted to a plurality of external electronic devices 100a, 100b, and 100c at the same time. For example, if the user selects a plurality of widgets by means of several touches, the mobile terminal 100 can transmit the content and / or the information of
ES 2 546 232 T3 contained to the plurality of external electronic devices 100a, 100b and 100c at the same time. The transmission of content and / or content information in response to the selection of widgets will be described in more detail later in the corresponding section.
As described above, the content information obtained can be provided in the form of widgets. The widgets corresponding to the content information, respectively, can represent the content information in the form of icons and reflect the status of each of the external electronic devices 100a, 100b and 100c. For example, images that have been outputted by external electronic devices 100a, 100b, and 100c may be displayed in sync with the widgets, or relative positions of external electronic devices 100a, 100b, and 100c may be represented by the relative positions of the widgets displayed on the display module 151.
When the mobile terminal 100 can output the content information obtained in the form of widgets, the user can have content available through various routes. For example, if the first external electronic device 100a corresponds to a TV receiver located in the living room of a house, the user can watch the content A through the TV receiver 100a of the living room. In this case, when the user needs to leave his home, he can transfer the content A and the information about the content A provided by the first external electronic device 100a to the mobile terminal 100. In addition, the user can play the content A on the mobile terminal 100 based on the information about the content A received by the mobile terminal 100. Consequently, the user can continuously view the content A more conveniently.
Another example of receiving content via various routes is described below. The user can view the content A corresponding to a football match through the first external electronic device 100a which is a TV receiver in the living room of the house. The content A obtained through the TV receiver may be a moving image obtained by taking photos with a camera of a football stadium. In this case, the user can use the mobile terminal 100 to obtain information about the content A of the first external electronic device 100a. Furthermore, the user can output an image, for example the football match, photographed with the camera through the mobile terminal 100, based on the information obtained. That is, the user can output the identical content by means of both one of the external electronic devices and another electronic device, in such a way that at least one of the point of view and the time of provision of the content is different from the from image. Through this function, the user can have the desired image of better quality.
Although the mobile terminal 100 outputs the information obtained about the content, the controller 180 can receive an operational signal with respect to the widgets (S40) and control the external electronic devices 100a, 100b and 100c based on the received operational signal (S50 ).
The operating signal can be a user-generated control signal or a control operation of the controller 180. For example, the operating signal can be a signal generated in response to a touch input applied to the display module 151 of the mobile terminal 100. to change the content to be displayed on the screen assembly of the display module 151 or to change the images displayed on the external electronic devices 100a, 100b and 100c.
When the operational signal is generated with respect to the widgets, the controller 180 may provide a control signal to change the operations of the external electronic devices 100a, 100b, and 100c based on the operational signal. For example, controller 180 may output a control signal to provide content A, which is output from the first external electronic device 100a, through the second external electronic device 100b.
Referring to Figure 6, mobile terminal 100 can communicate directly with external electronic devices 100a, 100b, and 100c to obtain content information. The first, second, and third external electronic devices 100a, 100b, and 100c may be located around or near the mobile terminal 100. The first, second and third screens 151a, 151b and 151c provided, respectively, to the first, second and third external electronic devices 100a, 100b and 100c can display, respectively, the contents A, B and C.
The mobile terminal 100 can communicate with the first, second and third external electronic devices 100a, 100b and 100c through WiFi Direct which allows direct peer-to-peer (P2P) communication between electronic devices without having any additional access point (AP) to relay data communication. There is a direct communication method, Ad-hoc, similar to WiFi Direct. While Ad-hoc is used for electronic devices relatively close to each other and has a transmission speed limited to 11 Mb / s, WiFi Direct can be compatible with the 802.11n standard to allow electronic devices that are located far away from each other. communicate with each other at a transmission rate of approximately 300 Mb / s.
The sharing of content information between the mobile terminal 100 and the first, second, and third devices
ES 2 546 232 T3 external electronic 100a, 100b and 100c by means of direct / indirect communication to display content information can be called 3 screens on screens. In this case, the mobile terminal 100 and the first, second and third external electronic devices 100a, 100b and 100c can synchronize their video signals and / or audio signals and output the synchronized signals.
With reference to Figure 7, the mobile terminal 100 can communicate directly or indirectly with the first, second, and third external electronic devices 100a, 100b, and 100c. For example, the mobile terminal 100 can communicate with the third external electronic device 100c by means of a first AP AP1 and communicate with the second external electronic device 100b by means of a second AP AP2. That is, the terminal 100 can indirectly exchange content information with the second and third external electronic devices 100b and 100c via external networks.
On the other hand, the mobile terminal 100 can communicate directly with the first external electronic device 100a via WiFi Direct. The content shared by the mobile terminal 100 and the first external electronic device 100a can be received through a satellite ST. That is, the content information can be stored in an external storage device that is not in the mobile terminal 100 or the first external electronic device 100a. Although the content information is stored in the external storage device and transmitted from the external storage device to the mobile terminal 100 and the first external electronic device 100a through the satellite ST, the mobile terminal 100 can transmit a control signal to the first external electronic device 100a. The control signal transmitted to the first external electronic device 100a can affect the content A provided by the first external electronic device 100a. For example, the control signal may stop outputting content A or change the time and / or point of view of content A.
Figures 8 and 9 illustrate an operation of a mobile terminal 100 according to an embodiment of the present invention to obtain content information from external electronic devices and output content information.
With reference to Figures 1, 8 and 9, the controller 180 of the mobile terminal 100 can display a first, second and third widgets S1, S2 and S3 obtained from the external electronic devices 100a, 100b and 100c on the display module 151. The user can select the desired widget from the first, second and third S1, S2 and S3 and display the selected widget on the entire screen of the display module 151.
The controller 180 may execute a display management mode of the images obtained in the form of thumbnail images. The first, second and third widgets S1, S2 and S3 displayed in the form of thumbnail images may represent positions of the external electronic devices 100a, 100b and 100c relative to the position of the mobile terminal 100. For example, the first widget S1 is obtained from the first external electronic device 100a located in front of the mobile terminal 100, the second widget S2 is obtained from the second external electronic device 100b located to the left of the mobile terminal 100 and the third widget S3 is obtained from the third external electronic device 100c located to the right of the mobile terminal 100. Controller 180 can display the first, second, and third widgets S1, S2, and S3 based on the relative positions.
The user can select the desired widget from among the first, second and third displayed widgets S1, S2 and S3 by touching it with finger F as shown in figure 8. With reference to figure 9, widget S3 selected by the user can be viewed in the display assembly area of the display module 151. Consequently, the user can seamlessly view the third widget S3, which has been displayed on the third external electronic device 100c, through the mobile terminal 100. The display module 151 that displays the third widget S3 may also display a first icon I1. When the first icon I1 is selected, the controller 180 can start the management mode.
Figures 10, 11 and 12 illustrate the operations of displaying content information obtained by the mobile terminal 100 according to an embodiment of the present invention and manipulating the displayed content information. Mobile terminal 100 can change the images displayed through various operations.
With reference to Figure 10 (a), the display module 151 of the mobile terminal 100 can display the first, second and third widgets S1, S2 and S3 obtained, respectively, from the first, second and third external electronic devices 100a, 100b and 100c. The user can select one of the first, second and third widgets S1, S2 and S3 which will then be displayed. For example, the user can place a desired widget in the center of the display module 151. Accordingly, the first widget S1 can be displayed in the screen assembly area of the display module 151 in the case of FIG. 10 (a).
Referring to Fig. 10 (b), the user can touch the display module 151 through a first touch operation T1. When the user performs a drag operation on the display module 151 through the first touch operation T1, the first, second and third widgets S1, S2 and S3 can rotate in the
ES 2 546 232 T3 towing direction.
Referring to Fig. 10 (c), after the first touch operation T1 performed by the user is finished, the arrangement of images displayed on the display module 151 can be changed. When the layout is changed such that the second widget S2 is displayed in the front, as shown in Figure 10 (c), the second widget S2 can be displayed in the whole area of the display module screen. 151.
With reference to Fig. 11 (a), the display module 151 of the mobile terminal 100 can display the first to the fifth widgets S1 to S5 obtained from various electronic devices. The first widget S1 among the displayed widgets S1 to S5 can be displayed in the whole area of the screen of the first display module 151. In this state, the user may want to display another image. Then, the user can touch the display screen of the display module 151 with the finger F through a second touch operation T2 in the horizontal direction. When user touch input is received, the controller 180 may rotate the first through fifth widgets S1 through S5 around a virtual axis.
With reference to Figure 11 (b), the widgets S1 to S5 displayed on the display module 151 rotate in sequence, and a second specific widget, the second widget S2, is displayed in the center of the display module 151. The second Widget S2 displayed in the center of the display module 151 may be displayed in the display assembly area of the display module 151 in response to a control signal from the controller 180.
With reference to Fig. 12 (a), the display module 151 of the mobile terminal 100 can display the first to the fifth widgets S1 to S5 obtained from various electronic devices. With reference to Figures 1 and 12 (b), when the user tilts the mobile terminal 100 to the left or right, the sensor unit 140 of the mobile terminal 100, which may comprise an acceleration sensor, can detect the posture of the terminal. mobile 100. Accordingly, the controller 180 can move the displayed first through fifth widgets S1 through S5 to the left or right according to the direction detected by the acceleration sensor. The user can control the scrolling speed of the first to fifth widgets S1 to S5 by adjusting the tilt of the mobile terminal 100.
Fig. 13 is a flowchart illustrating in detail the step S40 of receiving an operation signal with respect to the output content information described in Fig. 5.
With reference to Figures 1, 6 and 13, the operation S40 of receiving an operation signal with respect to the content information provided by the mobile terminal 100 may comprise the selection of the management mode (S41). The management mode displays the searched external electronic devices, so that the user can use the displayed external electronic devices. When the management mode is selected, the searched external electronic devices can be displayed as thumbnail images. In addition, the display form of the searched external electronic devices can be changed, new external electronic devices can be searched, or the search external electronic devices can be suppressed in the management mode, which will be described in more detail later.
When the management mode is selected, external electronic devices can be viewed based on their relative positions. The relative positions can be positions of the first, second, and third external electronic devices 100a, 100b, and 100c relative to the position of the mobile terminal 100. For example, the positions of the first, second, and third external electronic devices 100a, 100b, and 100c are relative to the mobile terminal 100 which is located in the center of the display module 151.
An operation signal with respect to the displayed screen can be received (S43), and then the displayed screen can be changed in response to the received operation signal (S44). The operational signal with respect to the displayed screen may be a signal generated by a user touch on the images displayed on the display module 151. When the operational signal is generated, the controller 180 may change the display form of the display module 151 in response to the operational signal. For example, controller 180 may change the arrangement of the displayed images or change the images shared by mobile terminal 100 and external electronic devices 100a, 100b, and 100c.
Figures 14 to 19 illustrate the operations of provision of content information received from external electronic devices and of control of external electronic devices based on the content information. In the management mode, the user can use the received content information in various ways to control data communication with external electronic devices 100a, 100b, and 100c.
With reference to Fig. 14 (a), the display module 151 of the mobile terminal 100 can display the first widget S1 received from the first external electronic device 100a. The user can select a second icon I2 displayed in a certain part of the display module 151. The second icon I2 can be a menu for
ES 2 546 232 T3 enter management mode.
With reference to Figure 14 (b), when the mobile terminal 100 enters the management mode, the first, second and third widgets S1, S2 and S3 received, respectively, from the first, second and third external electronic devices 100a, 100b and 100c can be displayed on the display module 151. In addition, a selected screen CS may be displayed in the center of the display module 151.
The selected screen CS may be an image to be displayed in the screen assembly area of the display module 151 when the management mode ends. That is, a selected image of the images of external electronic devices that the user is going to share can be displayed. The selected display CS can display images received from external electronic devices 100a, 100b and 100c continuously or display images received from external electronic devices 100a, 100b and 100c at specified intervals. That is, the selected screen CS can display a video or a still image. In Fig. 14 (b), the first widget S1 received from the first external electronic device 100a is displayed as the selected screen CS.
Referring to Fig. 15 (a), the user can change the display of the selected screen CS. The display of the selected screen CS can be switched through a third touch operation T3 which is started in one of the first, second and third widgets S1, S2 and S3, for example S2, towards the selected screen CS .
Referring to Fig. 15 (b), the second widget S2 is selected instead of the first widget S1 as the selected screen CS according to the third touch operation T3. When selecting an external electronic device that will share the selected screen CS with the mobile terminal 100, the user can select the first icon I1 to display the selected screen CS in the screen assembly area of the display module 151.
Referring to Fig. 15 (c), the second widget S2 selected as the selected screen CS can be displayed on the display module 151. Furthermore, the second icon I2 to enter the management mode can be displayed on a part of the display module 151.
With reference to Figure 16 (a), the user can select the second widget S2 among the images displayed with finger F. With reference to Figure 16 (b), detailed information about of the content information corresponding to the second widget S2 selected by the user. As described above, the content information can be the content, the description of the content, and information about the source of the content. The first popup window P1 can display the content description. In addition, information about the source of the content can be displayed if necessary.
With reference to Figures 1, 6 and 17, the sharing of specific content information may be blocked. For example, the second external electronic device 100b corresponding to the second widget S2 does not allow the sharing of the content information corresponding to the second widget S2 with the mobile terminal 100. Although when the content information sharing with the mobile terminal 100 is blocked, a search is made for an external electronic device corresponding to the content information and this is displayed on the display module 151 of the mobile terminal, the controller 180 can communicate this fact to the user through a specific icon I2.
Referring to FIG. 18 (a), the display module 151 may display a rotation icon I3. The rotation icon I3 can be an object that rotates to the right or to the left in response to a fourth touch operation T4. The rotation icon I3 may have a direction indicator D to indicate the direction in which the rotation icon I3 is currently pointing. In Fig. 18 (a), the rotation icon I3 points to the first widget S1 as indicated by the direction of the direction indicator D. Consequently, the first widget S1 can be displayed on the display screen 151 as a whole when the user selects the first icon I1.
Referring to Fig. 18 (b), the user can rotate the rotation icon I3 to change the image to be displayed on the screen assembly of the display module 151. For example, when the rotation icon is rotated I3, the direction indicator D points to the second widget S2.
With reference to Figure 19 (a), unlike the embodiment shown in Figures 18 (a) and 18 (b), the rotation icon I3 can be fixed. Therefore, the first, second and third widgets S1, S2 and S3 arranged around the rotation icon I3 can be rotated to the right or to the left in the direction of a fifth touch operation T5.
Referring to Figure 19 (b), the user can rotate the first, second and third widgets S1, S2 and S3 in the direction of the fifth touch operation T5 to display the second widget S2 instead of the first widget S1 in
ES 2 546 232 T3 the display assembly of the display module 151.
Figure 20 illustrates an operation of a mobile terminal 100 according to an embodiment of the present invention to search for a new external device. In this embodiment, the mobile terminal 100 can provide a user interface by which the user can manually search for an external electronic device.
Referring to Fig. 20 (a), the user can rotate the rotation icon I3 such that the direction indicator D points in a direction in which no image is currently displayed. When the rotation icon I3 is rotated towards the direction in which no image is currently displayed, the controller 180 can search for a new external electronic device that is present in the pointed direction.
With reference to Fig. 20 (b), if there is a new external electronic device in the direction pointed by the rotated rotation icon I3, the mobile terminal 100 can communicate with the new external electronic device to receive content information from the new device. external electronic. Upon receipt of the content information, the controller 180 may display a fourth image S4 corresponding to the newly received external electronic device at the corresponding position on the display module 151.
Figure 21 illustrates an arrangement diagram of external electronic devices that are searched by a mobile terminal according to an embodiment of the present invention. Mobile terminal 100 can display images received from searched electronic devices in respective spaces.
Referring to Fig. 21, the mobile terminal 100 can receive content information corresponding to the first through fifth widgets S1 through S5. In this case, the external electronic devices corresponding to the first and second widgets S1 and S2, the external electronic device corresponding to the third widget S3 and the external electronic devices corresponding to the fourth and fifth widgets S4 and S5 can be located, respectively, in spaces or different areas. For example, the external electronic devices corresponding to the first and second widgets S1 and S2 may be located in a large room on the second floor, the external electronic device corresponding to the third widget S3 may be located in a small room on the second floor, and the electronic devices External for the fourth and fifth widgets S4 and S5 can be placed in a living room on the first floor.
Controller 180 may divide the display screen of display module 151 into first, second, and third areas A1, A2, and A3 to visually represent external electronic devices arranged in different spaces. The selected screen CS displaying the selected contents to share with the mobile terminal 100 can be displayed in a designated part of the display module 151.
Figure 22 is a flow chart illustrating an operation related to a screen event in a mobile terminal according to an embodiment of the present invention and Figure 23 illustrates the operation related to the screen event shown in Figure 22.
With reference to Figures 22 and 23, the mobile terminal 100 can alert the user in the event of receiving a particular screen event. The display event can be an information display function in which the user is interested. In particular, when content is provided that satisfies a condition set by the user from among the content that has been output by external electronic devices, the screen event displays the desired content on the mobile terminal 100.
To execute the screen event function, the controller 180 determines whether a preset screen event signal has been received (S61), displays the generation of the screen event (S62), and determines whether the mobile terminal 100 is connected to a device. external electronic generating the display event (S63).
The preset screen event signal can be generated only when a specific condition previously set by the user is satisfied. For example, if the user is interested in tropical fish, the user can set cardinal tetra as the keyword. Controller 180 filters content information received from external electronic devices connected to mobile terminal 100 to determine if there is content information that comprises the keyword. If there is content information comprising the keyword, the controller 180 informs the user by displaying the information indicating that there is content information comprising the keyword, on the display module 151 of the mobile terminal 100.
Referring to FIG. 23 (a), the user of the mobile terminal 100 sets a screen event by entering specific keywords that the user is interested in and saving the keywords. Next, although the display module 151 of the mobile terminal 100 displays the first widget S1, as shown in FIG. 23 (b), if the preset display event is generated, a second pop-up window P2 may be displayed, such as is depicted in Figure 23 (c). The second popup window P2 can display the
ES 2 546 232 T3 detailed information about the screen event and the name of the external electronic device that generates the screen event. The second pop-up screen P2 can further display a message asking if it should be connected to the external electronic device.
Figures 24 and 25 are flowcharts illustrating an operation of a mobile terminal according to an embodiment of the present invention to share a content output resource.
With reference to Figures 1, 24 and 25, the mobile terminal 100 can share the content output resource. The content output resource can be an application, a codec or the like that can provide specific content. Although electronic devices share content, shared content cannot be adequately provided if there is no resource capable of facilitating the shared content. Furthermore, although the content may be properly provided from a specific electronic device, the same content may not be properly provided from another electronic device, because the resolution of the content may be different from that of the other electronic device. Mobile terminal 100 can prevent these problems by sharing the content output resource.
For this, the operation S30 of FIG. 5, that is, the provision of content information obtained through the mobile terminal 100, may comprise checking the content output resource (S31). The content output resource checking operation S31 can be performed in the mobile terminal 100 connected to other external electronic devices. In particular, the operation S31 can be performed when the mobile terminal 100 receives content information from the external electronic devices.
The controller 180 can determine whether the content information can be output properly (S32) and obtain the content output resource from an external electronic device connected to the mobile terminal 100 if the content information cannot be output properly (S33 ) or obtain the content output resource from another external electronic device (S34).
It is likely that an external electronic device that transmits content to the mobile terminal 100 may possess the content output resource capable of reproducing the content. Consequently, if the mobile terminal 100 does not present the content output resource, the mobile terminal 100 can receive the content output resource from the external electronic device. If the external electronic device does not present the content output resource, the mobile terminal 100 may receive the content output resource from other external electronic devices. In this case, the other external electronic device may be one of the electronic devices that are currently connected to the mobile terminal 100 and a server connected to a network. Finally, when the content output resource is secured, the obtained content can be provided (S35).
With reference to Figures 1 and 25, the content output resource can be transmitted from the mobile terminal 100 to an external electronic device. To execute this function, the operation S50 of figure 5, that is, the control of the external electronic devices based on the received operating signal, may comprise the generation of a signal to carry out the transmission of content to an electronic device (S51) . The signal for executing content transmission to the external electronic device may be an input signal generated in response to user input or a control signal from controller 180 to transmit specific content from mobile terminal 100 to external electronic device.
After generating the signal to perform content transmission to the external electronic device, the controller 180 can check whether the external electronic device presents the content output resource (S52). That is, the mobile terminal 100 that will transmit the content can check whether the external electronic device presents the content output resource capable of facilitating the content.
When it is determined that the external electronic device does not present any content output resource (S53), the controller 180 can transmit the content output resource (S54) and then transmit the content (S55).
The external electronic device that has received the content may receive user input regarding the processing of the received content along with a screen event alert. For example, the external electronic device may display a pop-up window to receive input for selecting an operation such as displaying, storing, playing, deleting or rejecting the content.
From the operations displayed by the pop-up window available for the content, the user can select the desired operation. After user input has been received, an operation corresponding to user input is executed. Furthermore, the external device that has received the content can generate and display an icon or widget corresponding to the received content, such that operations related to the content can be easily executed in the future.
ES 2 546 232 T3
The mobile terminal 100 transmitting the content may present the content output resource to facilitate the content. Consequently, the mobile terminal 100 can also transmit the content output resource to the external electronic device. When the transmission of the content output resource to the external electronic device has finished and the external electronic device is ready to provide the content, the content can be transmitted to the external electronic device.
Although in the aforementioned embodiments the external electronic devices have been described as fixed devices in specific positions around the mobile terminal, the positions of the external electronic devices can be changed according to the variable position of the mobile terminal. For example, electronic devices capable of communicating with the mobile terminal that travels with the user when the user goes from home to his place of work in a means of transport may correspond to external electronic devices.
The above-described method of controlling the mobile terminal can be written as computer programs and can be implemented in digital microprocessors that execute the programs by means of computer-readable recording means. The control method of the mobile terminal can be executed through software. The software can comprise code segments that perform the necessary tasks. The programs or code segments can also be stored on a processor-readable media or they can be transmitted according to a computer data signal combined with a carrier through a transmission media or a communication network.
Computer-readable recording media can be any data storage device that can store data that can later be read by a computer system. Examples of computer-readable recording media can comprise read-only memory (ROM), random access memory (RAM), CD-ROM, DVD ± ROM, DVD-RAM, magnetic tapes, floppy disks, and optical storage devices of data. Computer-readable media can also be distributed through computer systems attached to a network, such that computer-readable code is stored and executed in a distributed manner.
A mobile terminal may comprise a first touch screen configured to display a first object, a second touch screen configured to display a second object, and a controller configured to receive a first touch input applied to the first object and link the first object with a function corresponding to the second object upon receiving a second touch input applied to the second object while holding the first touch input.
A mobile terminal control method may be offered comprising displaying a first object on the first touch screen, displaying a second object on the second touch screen, receiving a first touch input applied to the first object, and linking of the first object with a function corresponding to the second object upon receiving a second touch input applied to the second object while holding the first touch input.
Herein, any reference to an embodiment, exemplary embodiment, etc., means that a particular device, structure, or feature described in connection with the embodiment is comprised in at least one embodiment of the present document. The presence of these phrases in various places in memory does not imply that they all necessarily refer to the same embodiment. Furthermore, when an element, structure or feature is described in relation to any embodiment, it is considered that the manufacture of such element, structure or characteristic in relation to other of the embodiments is within the competence of those skilled in the art. in the matter.
Although the embodiments have been described with reference to a group of illustrative embodiments, it should be noted that those skilled in the art will envision numerous different modifications and embodiments that will be encompassed within the scope of the present disclosure. More particularly, various variants and modifications of the components and / or arrangements of the arrangement of the disclosed combination are possible within the scope of the disclosure, drawings, and appended claims. Apart from variations and modifications of components and / or arrangements, other alternative uses will be obvious to those skilled in the art.
Contents8
28 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| ES2610504A1 | Cited by | Spain | Search report |
8 members in 5 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 20100042565 | Republic of Korea | A | |
| 20100042565 | Republic of Korea | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| CN102238281A | China | A | |
| EP2385462A1 | European Patent Office (EPO) | A1 | |
| US2011276911A1 | United States of America | A1 | |
| KR20110123099A | Republic of Korea | A | |
| US8990721B2 | United States of America | B2 | |
| EP2385462B1 | European Patent Office (EPO) | B1 | |
| ES2546232T3This record | Spain | T3 | |
| KR101680344B1 | Republic of Korea | B1 |
Numbers
- Publication
- 2546232
- Application
- 11003022
Titles2
- Spanish
- Terminal móvil y método de control del mismo
- English
- Mobile terminal and its control method
Classification
- CPC, 6
- G06F9/452
- H04M1/72403
- H04W8/005
- G06F3/0484
- H04W4/80
- H04W76/14
- IPC, 3
- G06F9 44
- H04M1 72409
- H04M1 7243