Portable device having touch screen display and method for controlling thereof

A portable device having a touch screen display and a control method therefor

The present invention relates to a mobile device, and more particularly, to a mobile device that displays a plurality of work screens through a touch screen display and executes an application according to a user's touch gesture sensed on the plurality of work screens, and a method for controlling the same .

An electronic device directly controlled by a user includes at least one display device, and the user may control the electronic device through an input device while watching an operation of an application executed in the electronic device on the display device. In particular, a portable electronic device (hereinafter referred to as a portable device) manufactured to be carried by a user is often developed to have a display device using a touch screen type user interface due to its limited size.

A graphical user interface (GUI) for use in a touch screen display provides an optimized shape so that a user can intuitively know the operation of a running application, while at the same time allowing a user to use a mobile device and a running application should be easier, faster and more diversely controlled. Accordingly, various user interfaces are being developed depending on the type of application or display device to be applied.

In particular, with the development of CPU (Central Processor Unit) and software technology, a portable device can provide a plurality of task screens displaying one or a plurality of applications. The plurality of work screens may be provided through one or more physically or graphically separated touch screens. Accordingly, there is a need for a graphical user interface for a touch screen to enable a user to use the portable device more intuitively and conveniently in a portable device providing a plurality of work screens.

In addition, more advanced portable devices have made it possible to detect not only hard or soft key input or touch gestures, but also movement or posture of the portable device itself, and movement or shape of a user as input. Therefore, there is also a need for a user interface for more conveniently using a portable device through these various inputs.

<p>The present invention provides a portable device having a touch screen display and a method for controlling the same.</p><p>The present invention provides a portable device having a plurality of touch screen displays that provide a plurality of work screens by one or a plurality of applications, and a method for controlling the same.</p><p>The present invention provides a portable device that detects a user's touch gesture on a plurality of contiguous touch screen displays and displays information in response thereto, and a method for controlling the same.</p><p>The present invention provides a portable device that provides an optimized user interface corresponding to a portrait view mode or a landscape view mode on at least one touch screen display, and a method for controlling the same.</p><p>The present invention provides a mobile device that provides a plurality of applications or a plurality of work screens for one application on at least one touch screen display, and a method for controlling the same.</p><p>The present invention provides a mobile device and a method for controlling the same, which partially cover information of a plurality of applications in the form of a stored card and expand and display more detailed information of the corresponding application according to a user's touch movement.</p><p>The present invention provides a mobile device that displays on a first touch screen display the maps according to a map application, and displays on the second touch screen display at least one image corresponding to a location or route selected by a user's touch gesture on the map; The control method is provided.</p><p>The present invention provides a mobile device that displays a task management area listing shortcut icons of at least one running application at a designated location, and displays an application selected by a user's touch gesture on one of a plurality of touch screen displays, and a control thereof provide a way</p><p>The present invention displays the locations of a plurality of private broadcast casters on a map on a first touch screen display, lists and displays simple information of the private broadcast casters on a second touch screen display, and responds to a user's touch gesture Provided are a mobile device capable of requesting a broadcast from a private broadcaster and a method for controlling the same.</p><p>The present invention provides a portable device for displaying a clipboard in a designated position in response to folding of a dual display coupled by a hinge or bending of a flexible display, and a method for controlling the same.</p><p>The present invention provides a mobile device for setting a bookmark of an e-book displayed on the display or moving and displaying pages in response to folding of a dual display coupled by a hinge or bending of a flexible display, and a control thereof provide a way</p><p>The present invention provides a mobile device for providing a video for a video conference on a first touch screen display, and displaying a document file or a white board shared by participants in a video conference on a second touch screen display, and a method for controlling the same .</p><p>The present invention provides a mobile device that provides a game interface for a first user on a first touch screen display, and displays game information for other users on a second touch screen display, and a method for controlling the same.</p><p>The present invention provides a portable device that provides a user interface for a calendar application through a dual touch screen display and a method for controlling the same. </p><p>The present invention provides a mobile device that provides a user interface for a call application through a dual touch screen display and a method for controlling the same. </p><p>The present invention provides a portable device that provides a user interface for a camera application through a dual touch screen display and a method for controlling the same.</p><p>The present invention provides a mobile device for controlling a viewing mode through movement of the mobile device on a dual touch screen display and a method for controlling the same.</p><p>The present invention provides a portable device for navigating information displayed on two touch screens in a dual touch screen display and a method for controlling the same.</p><p>The present invention provides a mobile device for modifying a home screen using a list displayed on a sub-touch screen in a dual touch screen display and a method for controlling the same.</p><p>The present invention provides a portable device for displaying a virtual keypad using a touch screen located at the bottom in a landscape mode of a dual touch screen display, and a method for controlling the same.</p>

<p>According to various embodiments, a method of controlling a mobile device including a first touch display and a second touch display may include displaying a first page of a home screen on the first touch display, and displaying a second page of the home screen on the first touch display. displaying a page on the second touch display, displaying a first page of the home screen on the first touch display, and displaying the second page of the home screen on the second touch display while receiving a user input for browsing pages of the home screen, and in response to receiving the user input, displaying the first page of the home screen on the first touch display as the home screen and replacing the second page of the home screen with the third page of the home screen on the second touch display, wherein the replacing operation includes: and displaying the second page of the home screen and the third page of the home screen while sliding in a direction from the second touch display to the first touch display, and displaying the second page of the home screen. While displaying a page and the third page of the home screen while sliding in a direction from the second touch display toward the first touch display, the first portion of the second page of the home screen is displayed on the first touch display and a second portion of the second page of the home screen may be displayed on the second touch display.</p><p>According to various embodiments, there is provided a method of controlling a mobile device including a first touch display and a second touch display by displaying a first page of a home screen and a dock area including symbols of one or more predefined applications. Displaying in a predetermined area on the first touch display, displaying application information on the second touch display, displaying the first page of the home screen and the dock area on the first touch display, receiving a user input on the first touch display in a direction away from the second touch display while displaying the information of the application on the second touch display, and in response to receiving the user input , replacing the first page of the home screen with a second page of the home screen on the first touch display, display of the dock area within the predefined area on the first touch display and the application of the application on the second touch display, while replacing the first page of the home screen with the second page of the home screen. The display of information may be maintained.</p><p>According to various embodiments, a mobile device includes a first touch display and a second touch display, and at least one processor, wherein the at least one processor displays a first page of a home screen on the first touch display. display, displaying a second page of the home screen on the second touch display, displaying a first page of the home screen on the first touch display, and displaying the second page of the home screen receiving a user input for browsing pages of the home screen while displaying on a second touch display, and in response to receiving the user input, the display of the home screen on the first touch display replacing the first page with the second page of the home screen; configured to control the first touch display and the second touch display to replace the second page of the home screen with a third page of the home screen on the second touch display, the second page and the third a page is replaced by sliding in a direction from the second touch display toward the first touch display, and the second page of the home screen and the third page of the home screen are transferred from the second touch display to the first During displaying while sliding in a direction toward a touch display, a first portion of the second page of the home screen is displayed on the first touch display, and a second portion of the second page of the home screen is displayed on the second 2 can be displayed on the touch display.</p><p>According to various embodiments, a mobile device includes a first touch display and a second touch display, and at least one processor, wherein the at least one processor includes a first page of a home screen and one or more predefined applications. display a dock area including symbols of the above in a predetermined area on the first touch display, display information of an application on the second touch display, and display the first page of the home screen and the dock area on the second touch display while displaying on the first touch display and displaying the information of the application on the second touch display, receiving a user input on the first touch display in a direction away from the second touch display, and the user In response to receiving input, and control the first touch display and the second touch display to replace the first page of the home screen with a second page of the home screen on the first touch display, and the first page of the home screen while replacing with the second page of the home screen, the display of the dock area within the predefined area on the first touch display and the display of the information of the application on the second touch display may be maintained. .</p>

1 is a block diagram showing a schematic configuration of a portable device according to an embodiment of the present invention; 2 is a perspective view of a portable device according to an embodiment of the present invention; Fig. 3 (including Figs. 3A to 3D) is a diagram illustrating screen modes according to a relative angle between a first panel and a second panel of a portable device; 4 is a perspective view of a portable device according to another embodiment of the present invention; 5 is a perspective view of a portable device according to another embodiment of the present invention; 6 (including FIGS. 6A to 6I) is a diagram illustrating a user interface of a home screen according to an embodiment of the present invention; 7A to 7J are diagrams illustrating a scenario in which an icon of an application is added to a home screen displayed on the first and second touch screens 12 and 14; 8A and 8B are diagrams illustrating a user interface of an application menu according to an embodiment of the present invention; 9 (including FIGS. 9A to 9J) is a diagram illustrating a change of a view mode according to a touch gesture according to an embodiment of the present invention. 10 (including FIGS. 10A to 10H) is a diagram illustrating a user interface of a pocket mode home screen according to an embodiment of the present invention. 11 (including FIGS. 11A to 11F) is a diagram illustrating a user interface of a pocket mode home screen according to another embodiment of the present invention. 12 (including FIGS. 12A to 12I) is a diagram illustrating a user interface of a gallery map application according to an embodiment of the present invention. 13 (including FIGS. 13A to 13J) is a diagram illustrating a user interface of a task manager panel according to an embodiment of the present invention; 14 (including FIGS. 14A to 14L) is a diagram illustrating a user interface of a private broadcasting application according to an embodiment of the present invention. 15 is a diagram for explaining detection of a folding back command according to an embodiment of the present invention; 16 is a diagram for explaining detection of a folding hold command according to an embodiment of the present invention; 17 (including FIGS. 17A-17K ) is a diagram illustrating a user interface for a clipboard function according to an embodiment of the present invention; 18 (including FIGS. 18A to 18P) is a diagram illustrating a user interface for an e-book function according to an embodiment of the present invention. 19 (including FIGS. 19A to 19G) is a diagram illustrating a user interface of a video conferencing application according to an embodiment of the present invention; 20 (including FIGS. 20A to 20H) is a diagram illustrating a user interface of a cooperative game application according to an embodiment of the present invention. 21 ( FIGS. 21A to 21O ) is a diagram illustrating a user interface of a schedule management application according to an embodiment of the present invention. 22 (including FIGS. 22A to 22M) is a diagram illustrating scenarios in which a calendar area is expanded and displayed in a schedule management application according to an embodiment of the present invention. 23 (including FIGS. 23A to 23P) is a diagram illustrating a user interface of a call application according to an embodiment of the present invention. 24 (including FIGS. 24A to 24R) is a diagram illustrating a user interface of a call application according to another embodiment of the present invention. 25 (including FIGS. 25A to 25L) and 26 (including FIGS. 26A to 26K) are diagrams illustrating a user interface of a camera application according to an embodiment of the present invention. 27 (including FIGS. 27A to 27Q) is a diagram illustrating a change in a view mode according to a physical movement of a portable device according to an embodiment of the present invention;

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. And, in describing the present invention, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, the terms described below are terms defined in consideration of functions in the present invention, which may vary according to intentions or customs of users and operators. Therefore, the definition should be made based on the content throughout this specification.

In the present specification, a mobile device includes a display configured with one or more touch screens, and is a device configured to execute an application or display content, for example, a tablet personal computer (PC), It may include a portable multimedia player (PMP), a personal digital assistant (PDA), a smart phone, a mobile phone, a digital picture frame, and the like. Hereinafter, embodiments of the present invention will be described with respect to a portable device configured as a cellular phone or a smart phone, but it should be noted that the present invention is not limited to this configuration.

1 is a block diagram showing a schematic configuration of a portable device according to an embodiment of the present invention. The illustrated portable device 100 may be connected to an external device (not shown) using at least one of the cellular communication module 120 , the sub communication module 130 , and the connector 165 . "External device" may include at least one of other devices, mobile phones, smart phones, tablet PCs (Personal), and computer servers.

Referring to FIG. 1 , a mobile device 100 includes at least one touch screen display 190a and 190b and a touch screen controller 195 . In addition, the mobile device 100 includes a control unit 110 , a cellular communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a Global Positioning System (GPS) module 155 , It includes an input/output module 160 , a sensor module 170 , a storage unit 175 , and a power supply unit 180 . The sub communication module 130 includes at least one of a wireless LAN module 131 and a short-range communication module 132, and the multimedia module 140 includes a broadcast communication module 141, an audio playback module 142, and a video playback module. (143); The camera module 150 includes at least one of a first camera 151 and a second camera 152 , and the input/output module 160 includes a button set 161 , a microphone 162 , and a speaker. 163 , a vibration motor 164 , a connector 165 , and at least one of a keypad 166 .

The controller 110 includes the CPU 111 , a read-only memory (ROM) 112 in which a control program for controlling the mobile device 100 is stored, and signals or data input from the outside of the mobile device 100 . or a random access memory (RAM) 113 used as a storage area for a task performed in the portable device 100 . The CPU 111 may include at least one of a single-core processor, a dual-core processor, a triple-core processor, and a quad-core processor. The CPU 111 , the ROM 112 , and the RAM 113 are interconnected through an internal bus.

The control unit 110 includes a cellular communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , an input/output module 160 , and a sensor module 170 ). , the storage unit 175 , the power supply unit 180 , the touch screens 190a and 190b and the touch screen controller 195 are controlled.

The cellular communication module 120 uses a radio access technology according to a cellular communication protocol under the control of the controller 110 to allow the portable device 100 to communicate with an external device (especially, through at least one or a plurality of antennas (not shown)). to the base station of the cellular system). The cellular communication module 120 is configured to communicate with other communication devices such as mobile phones, smart phones, tablet PCs, or other devices having a phone number input to the mobile device 100, voice calls, video calls, and short messaging services (SMS). ) message or a multimedia (Multimedia Messaging Service: MMS) message is transmitted/received.

The sub communication module 130 may include at least one of a wireless LAN module 131 and a short-range communication module 132 . For example, only the wireless LAN module 131 may be included, only the short-range communication module 132 may be included, or both the wireless LAN module 131 and the short-range communication module 132 may be included.

The wireless LAN module 131 may be connected to the Internet at a place where a wireless access point (AP) (not shown) is installed under the control of the controller 110 . The wireless LAN module 131 supports the wireless LAN standard (IEEE802.11x) of the American Institute of Electrical and Electronics Engineers (IEEE). The short-range communication module 132 may perform wireless short-range communication between the portable device 100 and an external device under the control of the controller 110 . The short-distance communication method may include Bluetooth (bluetooth), infrared data association (IrDA), and the like.

The portable device 100 may include at least one of a cellular communication module 120 , a wireless LAN module 131 , and a short-range communication module 132 according to performance. For example, the portable device 100 may include a combination of the cellular communication module 120 , the wireless LAN module 131 , and the short-range communication module 132 according to performance.

The multimedia module 140 may include at least one of a broadcast communication module 141 , an audio playback module 142 , and a video playback module 143 . The broadcasting communication module 141 includes a broadcasting signal (eg, a TV broadcasting signal, a radio broadcasting signal, or a data broadcasting signal) transmitted from a broadcasting station through a broadcasting communication antenna (not shown) under the control of the control unit 110 and the broadcasting unit information (eg, an Electric Program Guide (EPS) or an Electric Service Guide (ESG)) may be received. The audio reproduction module 142 may reproduce a stored or received digital audio file (eg, a file having a file extension of mp3, wma, ogg, or wav) under the control of the controller 110 . The video playback module 143 may play a stored or received digital video file (eg, a file having a file extension of mpeg, mpg, mp4, avi, mov, or mkv) under the control of the controller 110 . The video reproduction module 143 may reproduce a digital audio file.

The multimedia module 140 may include an audio playback module 142 and a video playback module 143 excluding the broadcast communication module 141 . In addition, the audio reproduction module 142 or the video reproduction module 143 of the multimedia module 140 may be included in the controller 110 .

The camera module 150 may include at least one of a first camera 151 and a second camera 152 for capturing still images or moving images under the control of the controller 110 . The first camera 151 and the second camera 152 may be provided in the housing of the portable device 100 or may be connected to the portable device 100 using a separate connection means. At least one of the first camera 151 and the second camera 152 may include an auxiliary light source (eg, a flash (not shown)) that provides an amount of light required for photographing. As an embodiment, the first camera 151 may be disposed on the front side of the portable device 100 , and the second camera 152 may be disposed on the back side of the portable device 100 . In another embodiment, the first camera 151 and the second camera 152 are adjacent to each other (eg, the distance between the first camera 151 and the second camera 152 is greater than 1 cm and less than 8 cm). arranged so that a three-dimensional still image or a three-dimensional moving image can be taken.

The camera module 150 detects a user's movement or shape through at least one of the first camera 151 and the second camera 152 , and uses this as an input for executing or controlling an application, and the controller 110 ) can be passed on to As an example, the user's movement may mean the movement of the user's hand detected through the first or second camera, and the user's shape may mean the user's face shape detected through the first or second camera. As another embodiment, the mobile device 100 may detect a user's movement using other means such as an infrared detector, and may execute or control an application in response to the movement.

The GPS module 155 receives radio waves from a plurality of GPS satellites (not shown) in Earth's orbit, and a time of arrival from the GPS satellites (not shown) to the portable device 100 . and the GPS parameters may be used to calculate the location of the portable device 100 .

The input/output module 160 may include at least one of at least one physical button 161 , a microphone 162 , a speaker 163 , a vibration motor 164 , a connector 165 , and a keypad 166 . have. The at least one physical button 161 may be formed in a push type or a touch type on the front, side, or rear of the housing of the mobile device 100 , and may include a power/lock button, a volume control button, a menu button, a home button, and a back button. It may include at least one of a back button and a search button. The microphone 162 generates an electrical signal by receiving a voice or sound under the control of the controller 110 .

The speaker 163 includes various signals (eg, wireless signals, broadcast signals, A sound corresponding to a digital audio file, a digital moving picture file, or a photograph) may be output to the outside of the portable device 100 . The speaker 163 may output a sound corresponding to a function performed by the portable device 100 (eg, a button operation sound corresponding to a phone call, or a ring-back sound). One or a plurality of speakers 163 may be formed at an appropriate location or locations in the housing of the portable device 100 . For example, the speaker 163 has an internal speaker module disposed at a position suitable for being close to the user's ear during a call, and a higher output suitable for playing an audio/video file or watching a broadcast, and the portable device 100 ) may be configured to include an external speaker module disposed at an appropriate position in the housing.

The vibration motor 164 may convert an electrical signal into mechanical vibration under the control of the controller 110 . For example, in the mobile device 100 in the vibration mode, when a voice call is received from another device (not shown), the vibration motor 164 operates. One or a plurality of vibration motors 164 may be formed in the housing of the portable device 100 . The vibration motor 164 may operate in response to a user's touch gesture sensed on the touch screens 190a and 190b and continuous movement of the touch sensed on the touch screens 190a and 190b.

The connector 165 may be used as an interface for connecting the portable device 100 and an external device or a power source. According to the control of the controller 110 , data stored in the storage unit 175 of the portable device 100 may be transmitted to or received from an external device through a wired cable connected to the connector 165 . Power may be input from a power source through a wired cable connected to the connector 165 or a battery (not shown) may be charged.

The keypad 166 may receive a key input from a user to control the portable device 100 . The keypad 166 includes a physical keypad provided in or connected to the portable device 100 and/or a virtual keypad that can be displayed on the touch screens 190a and 190b. The physical keypad formed in the portable device 100 may be excluded depending on the performance or structure of the portable device 100 .

The sensor module 170 includes at least one sensor that detects the state of the portable device 100 . For example, the sensor module 170 includes a proximity sensor that detects whether the user approaches the portable device 100 , an illuminance sensor that detects the amount of light around the portable device 100 , and the operation of the portable device 100 . (eg, rotation of the mobile device 100, absolute/relative movement of at least one panel constituting the mobile device 100, acceleration or vibration applied to the mobile device 100) may include Each sensor of the sensor module 170 may detect a state, generate a signal corresponding to the detection, and transmit it to the controller 110 . The sensor of the sensor module 170 may be added or deleted according to the performance of the portable device 100 .

The storage unit 175 includes a cellular communication module 120 , a sub communication module 130 , a multimedia module 140 , a camera module 150 , a GPS module 155 , and an input/output module according to the control of the controller 110 . 160 , the sensor module 170 , and the input/output signals, information, or data corresponding to the operations of the touch screens 190a and 190b may be stored. The storage unit 175 may store control programs and applications for controlling the portable device 100 or the controller 110 . Hereinafter, the term "storage unit" may include the storage unit 175 , the ROM 112 , the RAM 113 , or a memory card (eg, an SD card, a memory stick) detachable/mountable to the portable device 100 . . In addition, the storage unit may include a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD).

The power supply unit 180 may supply power to one or a plurality of batteries disposed in the housing of the portable device 100 under the control of the control unit 110 . One or a plurality of batteries supplies power to the control unit 110 and each component module of the portable device 100 . Also, the power supply unit 180 may supply power input from an external power source to the portable device 100 through a wired cable connected to the connector 165 .

The touch screens 190a and 190b are display devices that display various applications (eg, call, data transmission, broadcast, camera, etc.) that can be executed by the control unit 110 and provide a user interface configured to be adapted thereto. At least one touch gesture may be input through a body (eg, a finger including a thumb) or a detectable input means (eg, a stylus pen). The user interface may include a predetermined touch area, soft keys, and soft menus. The touch screens 190a and 190b may transmit an electronic signal corresponding to at least one touch gesture input through the user interface to the touch screen controller 195 . In addition, the touch screens 190a and 190b may detect a continuous movement of the touch and transmit an electronic signal corresponding to the continuous or discontinuous movement of the touch to the touch screen controller 195 . The touch screens 190a and 190b may be implemented by, for example, a resistive method, a capacitive method, an infrared method, or an acoustic wave method.

The touch screen controller 195 converts the electronic signals received from the touch screens 190a and 190b into digital signals (eg, X and Y coordinates) and transmits them to the controller 110 . The controller 110 may control the touch screens 190a and 190b using a digital signal received from the touch screen controller 195 . For example, the controller 110 may select a soft key displayed on the touch screens 190a and 190b in response to a touch gesture or execute an application corresponding to the soft key. Also, the touch screen controller 195 may be included in the controller 110 .

In the present specification, the touch gesture is not limited to direct contact between the touch screens 190a and 190b and the user's body or touchable input means, and non-contact (eg, the touch screens 190a and 190b and the user's body or touch). It means that the detectable distance between the touchable input means includes 1 mm or less). The detectable intervals on the touch screens 190a and 190b may be changed according to the performance or structure of the portable device 100 .

In an embodiment of the present invention, the touch gesture may include any type of user gesture that the portable device can detect by directly coming into contact with or approaching the touch screen. For example, a touch gesture can be performed using the fingers of the left and right hands (especially the index finger), the thumb, or an object detectable by the touch screen (such as a stylus pen) to place a single position or As a user's operation of selecting a plurality of consecutive locations, touch, contact, release of touch, tap, contact and rotate, pinch, It may include an operation such as a spread and a touch drag. Here, the touch drag is a gesture of moving the finger or thumb in a certain direction while the finger, thumb, or stylus pen is in contact on the touch screen, for example, touch and drag, flick, It may include gestures such as swipe, slide, and sweep. The state in contact with the touch screen may include a state in which a finger, a thumb, or a stylus pen directly touches the touch screen, or approaches the touch screen closely even if it does not actually touch the touch screen.

The mobile device 100 is a device that executes applications, widgets, and functions that are stored in the storage and can be executed by the controller 110 through a touch screen. In general, a touch screen provides applications, widgets, functions, and graphic objects (ie, soft keys or shortcut icons) corresponding to the group through a home screen or an application menu, and the mobile device provides a user's input on each graphic object. A corresponding application, widget or function is executed in response to detection of a touch gesture.

Here, the widget means a mini-application that can be downloaded and used by a user or generated by the user, and includes, for example, a weather widget, a stock widget, a calculator widget, an alarm clock widget, a dictionary widget, and the like. A shortcut icon for executing a widget may provide simple dictionary information through a corresponding widget application. As an example, the icon of the weather widget simply provides the current temperature and weather symbol, and the widget application executed through the touch of the icon provides a greater amount of information, such as weather by period/region. In the present specification, the application includes a widget-based application and a non-widget-based application.

As an embodiment, the touch screen is configured as a single panel (or tablet) and displays one or a plurality of work screens corresponding to one or a plurality of applications under the control of the controller. As another embodiment, the touch screen display includes two panels that are physically separated and interconnected by a predetermined connection part, and the panels may be folded-in or folded by a predetermined angle around the connection part. -out) can be Here, the connection part may be a hinge, a flexible connection part, or a part of a flexible touch screen. As another embodiment, the touch screen display may be configured as a flexible touch screen that can be bent or folded at least once. The touch screen display displays one or a plurality of work screens related to one or a plurality of applications under the control of the controller.

2 is a perspective view illustrating a portable device according to an embodiment of the present invention. Here, a configuration is illustrated in which the portable device includes a display device including two touch screens coupled by a hinge.

Referring to FIG. 2 , the mobile device 100 includes a first panel 2 and a second panel 4 , and the first panel 2 and the second panel 4 are connected by a hinge 6 . It is configured to be relatively movable. A first touch screen display 12 is provided on one surface of the first panel 2 , and at least one physical button 5 may be disposed at the bottom of the first touch screen 12 . . A second touch screen display 14 arranged side by side with the first touch screen 12 is provided on one surface of the second panel 4 , and at least one at the lower end of the second touch screen 14 is provided. A physical button 5' of may be disposed. The physical buttons 5 and 5' include at least one of a push button and a touch button. In one embodiment, a first touch screen 12 disposed on a first panel 2 having a speaker 20 and a microphone 22 serves as the main screen, and disposed on a second panel 4 otherwise. The second touch screen 14 may operate as a sub screen. In one embodiment the first panel 2 has a front camera 24 and the second panel 4 has a rear camera 26 . As another embodiment, the front camera 24 is disposed on the same side as the second touch screen 14 of the second panel 4 , so that the first and second panels 2 and 4 are in an unfolded state. It operates as a camera, and may operate as a rear camera when the first and second panels 2 and 4 are folded.

The mobile device 100 may be any device, such as a mobile phone, a laptop computer, a tablet PC, or a PMP, as long as the first panel 2 and the second panel 4 are connected by a hinge 6 to be movable relative to each other. . Although it has been described above that the first touch screen 12 and the second touch screen 14 are provided on the first panel 2 and the second panel 4, respectively, the following description will be given of any one of the two panels. It is also applicable to devices in which only a panel is provided with a touch screen display. In addition, at least one of the function buttons 5 and 5' at the bottom of each touch screen may be omitted. Furthermore, although the connection between the first panel 2 and the second panel 4 is illustrated by the hinge 6 as an example, the first panel 2 and the second panel 4 can be folded through relative movement. As long as it is configured so that it can be used, it can be replaced by the connection of other components.

The mobile device may include a display device including a first touch screen and a second touch screen that are physically or graphically separated, and may support various screen modes as shown in FIG. 3 by using the two touch screens. .

FIG. 3 (including FIGS. 3A to 3D ) is a diagram illustrating screen modes according to relative angles between the first panel 2 and the second panel 4 of the portable device 100 . The relative angle θ is a rotation angle of the second panel 4 rotated in a predetermined direction (eg, counterclockwise) with respect to the first panel 2 .

3A is a perspective view showing the folded portable device 100, with the touch screens 12 and 14 on the first panel 2 and the second panel 4 facing outward, respectively, and the first panel 2 and the A state in which the second panels 4 are in contact with each other, that is, a state in which they are completely folded outward, is referred to as a dual screen. The relative angle θ at this time is 0 degrees. As an example, when the relative angle between the first and second panels 2 and 4 is between 0 degrees and 60 degrees, the portable device recognizes the dual screen mode. The dual screen mode may be usefully used when the mobile device is in a locked state that is not being used and in a call application. In the dual screen mode, the front touch screen 12 may display a work screen by at least one application, and the rear touch screen 14 may be turned off. Some applications may use an option menu to turn on the rear touch screen 14 .

3B is a state in which the first panel 2 and the second panel 4 are parallel to each other, and the relative angle θ is 180 degrees or close to 180 degrees within a predetermined range, that is, it is unfolded. As such, it is called a double screen. As an example, when the relative angle between the first and second panels 2,4 is in the range of 175 degrees to 185 degrees, the portable device may consider that the first and second panels 2,4 are unfolded. . In the double screen mode, two operation screens for two applications are displayed on the two touch screens 12 and 14, respectively, or two operation screens for one application are displayed on the two touch screens 12 and 14, respectively. Alternatively, various view modes may be provided, such as wide display of one work screen for one application across the two touch screens 12 and 14 . When there is no application executed in any one touch screen, the corresponding touch screen may display the home screen.

3C shows a state in which the relative angle θ of the second panel 4 with respect to the first panel 2 exceeds 180 degrees, that is, the two touch screens 12 and 14 are slightly folded inward. , referred to as an In-Folded Screen. As an example, when the relative angle between the first and second panels 2 and 4 is between 180 degrees and 210 degrees, the in-folded screen mode is recognized. The in-folded screen mode is useful when the mobile device is used in a form similar to a notebook or e-book in a state in which the two touch screens 12 and 14 are slightly folded to face inward. The in-folded screen mode can be used similarly to the double screen mode.

3D shows a state in which the relative angle θ of the second panel 4 with respect to the first panel 2 is less than 180 degrees, that is, the two touch screens 12 and 14 are almost folded outward so that they face in substantially opposite directions to each other. The state is shown as an out-folded screen (Out-Folded Screen). As an example, when the relative angle between the first and second panels 2 and 4 is between 30 and 90 degrees, the portable device recognizes the out-folded screen mode. In the out-folded screen mode, the two touch screens (12, 14) are folded so that they face outward. , can be usefully used when watching personal broadcasts, movies, videos, etc. for a long time. As another embodiment, the out-folded screen mode may be applied to an application requiring cooperation or interaction by two or more users, for example, a video conference, a collaborative game, and the like. Some applications display a work screen only on the front touch screen 12 in the dual screen mode, and may turn off the rear touch screen 14 . Some applications may use an option menu to turn on the rear touch screen 14 .

4 is a perspective view showing a portable device according to another embodiment of the present invention. As shown, the portable device 100 has a display composed of two flexible touch screens 12 and 14 . The two touch screens 12 and 14 are interconnected by a flexible connection part 18 , and can be freely bent or folded by the flexible connection part 20 .

5 is a perspective view showing a portable device according to another embodiment of the present invention. 5 (a), (b), and (c) show cases in which the display device of the portable device 100 has an open configuration, a partially closed configuration, and a closed configuration, respectively. Here, although the portable device 100 is illustrated as having a tri-folded configuration, it is of course possible to have a configuration in which the portable device 100 is folded in two folds, folded in three or more folds, or partially folded. In FIG. 5 , the display device of the portable device 100 is divided by at least one foldable boundary line 12a and 12b and includes two or more foldable touch screens 12 , 14 , 16 .

When the mobile device is powered on and booted up, a home screen is provided through the touch screen. In addition, the mobile device provides a home screen even when there is no running application or when an external home button is input. The home screen is set by default by the manufacturer and editable by the user, and guides the user to easily navigate to various applications, widgets and functions that the mobile device can run.

The mobile device has a home screen function that provides two pages designated as home screens through a touch screen display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, Navigates pages in response to a user's touch gestures on the screen.

6 (including FIGS. 6A to 6I) illustrates a user interface of a home screen according to an embodiment of the present invention.

Referring to FIG. 6A , the first touch screen 12 displays the first page 202 of the home screen, and the second touch screen 14 displays the second page 204 of the home screen. The first and second touch screens 12 and 14 may be physically or graphically distinguished.

The first page 202 of the home screen comprises a first group consisting of at least one widget area 212 and/or at least one shortcut icon 214 designated as the home screen, The second page 204 includes at least one widget area 218 designated as a home screen and/or a second group consisting of at least one shortcut icon. The first page 202 and the second page 204 may display widget areas 212 , 218 and/or shortcut icons 214 on a common or respective background image designated as a background image. As a selectable embodiment, one background image may be displayed across the first and second touch screens 12 and 14 .

Each shortcut icon corresponds to an application or an application group, respectively, and detects a user's touch so that the corresponding application is executed or the shortcut icons included in the corresponding application group are displayed. Each widget area or each shortcut icon may be provided by default when the mobile device is manufactured or may be configured by a user.

Additionally, the first touch screen 12 includes a counter 202a indicating a page of the home screen, along with the first page 202 , frequently used applications, for example, a call application, a contacts application, and a message application. , a dock area (Dock Area) 216 including shortcut icons of an application menu that provides an application list, and signal strength indicator(s) for wireless communication such as cellular or WiFi, Bluetooth connection mode, reception A status bar 206 that provides a message, a battery status indicator, a current time, and the like may be further displayed. The second touch screen 14 may also further display a page counter 204a and a status bar 208 . The status bar on the second touch screen 14 may provide different information than the first touch screen 12 . The status bars 206 and 208 may be displayed or omitted with the home screen or application, and remain within the first and second touch screens 12 and 14 regardless of page transitions. In the following description, a description of whether the status bars 206 and 208 are displayed will be omitted.

The home screen may further provide additional pages consisting of one or more widget areas and/or one or more icons within a predetermined maximum number of pages, the pages being switched by a predetermined touch gesture.

The mobile device detects a touch gesture 200a previously designated for page switching of the home screen on at least one of the first touch screen 12 and the second touch screen 14 , and proceeds to FIG. 6B .

Referring to FIG. 6B , the first and second touch screens 12 and 14 are the next two pages designated as the home screen in response to the detection of the touch gesture 200a, that is, the third and fourth pages 232 and 234 . and page counters 232a and 234a. The third and fourth pages 232 and 234 may include different widget areas and/or icons than the first and second pages 202 and 204 . The third and fourth pages 232 and 234 are displayed while sliding along with the page counters 232a and 234a in the direction of the first touch screen 12 from the second touch screen 14 according to the touch gesture 200a, The third page 232 and the page counter 232a may be displayed on both sides of the first and second touch screens 12 and 14 during sliding. As an embodiment, a dock area 216 that provides a list of frequently used applications may be fixedly displayed at a designated location within the first touch screen 12 irrespective of page transitions (ie independently). have.

As an example, the touch gesture 200a includes a touch drag from a position on the second touch screen 14 to the first touch screen 12 (or in the opposite direction). As another example, the touch gesture 200a includes touch dragging from a location on the second touch screen 14 to a location on the first touch screen 12 (or in the opposite direction). As another example, the touch gesture 200a includes a touch drag through a hinge or connection between the first and second touch screens 12 and 14 . As a selectable embodiment, it is preferable that the touch drag 200a for page switching of the home screen moves more than a predetermined distance. As another example, the touch gesture 200a includes, on the first or second touch screens 12 and 14 , a flick directed from the second touch screen 14 in the direction of the first touch screen 12 .

While the third and fourth pages 232 and 234 are displayed on the first and second touch screens 12 and 14, a touch gesture ( When 200b) is detected, the mobile device proceeds to FIG. 6C .

Referring to FIG. 6C , the first and second touch screens 12 and 14 display the next two pages in response to the touch gesture 200b, namely the fifth and sixth pages 242 and 244 and the page counters 242a. , 244a) respectively. As in FIG. 6B , the fifth and sixth pages 242 and 244 may be displayed while sliding in the direction of the first touch screen 12 from the second touch screen 14 according to the touch gesture 200b, and the dock area 216 is fixed at a designated location within the first touch screen 12 irrespective of the touch gesture 200b.

Although not shown, when a touch drag from one position on the first touch screen 12 to the second touch screen 14 is sensed while the fifth and sixth pages 242 and 244 are displayed, the mobile device 100 displays previous pages, ie, the third page 232 and the fourth page 234, on the first and second touch screens in response to the touch drag. Similarly, the third and fourth pages 232 and 234 may be displayed while sliding across the hinge in the direction of the second touch screen 14 from the first touch screen 12 according to the touch and drag.

When the first and second touch screens 12 and 14 are configured to be connected non-continuously by a hinge or a separate connection part, each page of the home screen is first displayed when slid through the hinge or connection part as shown in FIG. 6C. It may be displayed on both sides of the first and second touch screens 12 and 14 .

The mobile device may switch the home screen in units of one page or units of two pages by two touch gestures defined differently. As an example, in FIG. 6A , the touch gesture 200a is defined as a touch drag that moves over a predetermined distance on the home screen, and the mobile device responds to the detection of the touch drag 200a on the first and second touch screens 12 and 14 . ), the first and second pages 202 and 204 are converted into third and fourth pages 232 and 234 , that is, in units of two pages. In addition, the home screen can be switched in units of one page by a touch gesture moving a short distance. That is, in FIG. 6A , a preset touch gesture for short page switching of the home screen on at least one of the first touch screen 12 and the second touch screen 14 , as an example, the first touch from the second touch screen 14 . When the flick in the direction of the screen 12 is detected, the mobile device proceeds to FIG. 6D .

Referring to FIG. 6D , in response to a flick detected on either one of the first and second touch screens 12 and 14 displaying the first and second pages 202 and 204 , the mobile device displays the first touch screen ( The second page 204 is displayed on 12 ), and the third page 232 is displayed on the second touch screen 14 . The second and third pages 204 and 232 are displayed while sliding in the direction of the first touch screen 12 from the second touch screen 14 according to the flick, and during the sliding, the second pages 202 are displayed as the first and second It can be displayed across both sides of the touch screen (12, 14).

6E to 6G illustrate a scenario in which a page of the home screen is switched while the home screen and other applications are being displayed on the first and second touch screens 12 and 14 .

Referring to FIG. 6E , the first touch screen 12 displays a first page 202 of the home screen, a page counter 202a, and a dock area 216, and the second touch screen 14 displays other applications ( 240) is indicated. In the illustrated example, the application 240 is a music playback application. When a touch gesture 200c previously designated for page switching of the home screen is detected on the first touch screen 12 , the mobile device proceeds to FIG. 6H . As an example, the touch gesture 200c is a flick or touch drag that occurs within the first touch screen 12 and moves from the second touch screen 14 in the direction of the first touch screen 12 .

Referring to FIG. 6F , in response to detecting the touch gesture 200c, the mobile device displays the first page 202 of the first touch screen 12 and the page counter 202a to the second page 204 of the home screen. and the page counter 204a. Here, the dock area 216 of the first touch screen 12 and the application 240 of the second touch screen 14 are maintained despite the touch gesture 200c. As an embodiment, the second page 204 may be displayed while sliding in the direction of the first touch screen 12 from the second touch screen 14 according to the moving direction and speed of the touch gesture 200c.

When the touch gesture 200e in the direction of the second touch screen 14 is detected on the first touch screen 12 displaying the second page 204, the mobile device returns to FIG. The page 202 is displayed on the first touch screen 12 and the dock area 216 of the first touch screen 12 and the application 240 of the second touch screen 14 are maintained. When a touch gesture 200d in a direction from the second touch screen 14 to the first touch screen 12 is detected on the first touch screen 12 displaying the second page 204, the mobile device displays the next page move to FIG. 6g to display .

Referring to FIG. 6G , in response to the detection of the touch gesture 200d, the mobile device displays the second page 204 of the first touch screen 12 and the page counter 204a on the third page 232 of the home screen. and the page counter 232a. Likewise, the dock area 216 of the first touch screen 12 and the application 240 of the second touch screen 14 remain in spite of the touch gesture 200d. When a touch gesture 200f in the direction of the second touch screen 14 is detected on the first touch screen 12 displaying the third page 232, the mobile device returns to FIG. 6F and returns to the second page 204 ) is indicated.

FIG. 7 (including FIGS. 7A to 7J ) illustrates a scenario in which an icon of an application is added to the home screen displayed on the first and second touch screens 12 and 14 .

Referring to FIG. 7A , the first touch screen 12 displays the first page 202 of the home screen, and the second touch screen 14 displays the second page 204 of the home screen. Although not illustrated, even when an application or information other than the home screen is being displayed on the second touch screen 14 , the following icon addition scenario may be similarly applied. Any one of the first and second touch screens 12 and 14 displaying the home screen, in the illustrated example, a predetermined touch gesture 210a on the first touch screen 12, as an example, is maintained for more than a predetermined effective time When a touch to be touched, that is, a long-tap is sensed, the mobile device proceeds to FIG. 7C .

As a selectable embodiment, as shown in FIG. 7B , the icon addition may be executed using the menu button 252 which is one of the physical buttons provided on the first panel provided with the first touch screen 12 . The mobile device detects the input 210b of the menu button 252 provided on the first panel, for example, a tap gesture or touch and hold on the touch-sensitive menu button, and displays the home screen at the bottom of the first touch screen 12 . A menu window 250 for The menu window 250 includes at least one of an icon addition key, a background screen setting key, a search key, a notification setting key, an icon editing key, and a home screen setting key. When a predetermined touch gesture 210c, for example, a tap gesture, is detected on the icon addition key in the menu window 250, the mobile device proceeds to FIG. 7C .

Referring to FIG. 7C , the first touch screen 12 displays an item addition pop-up window 252 for adding an item on the home screen on the first page 202 in response to detection of the touch gestures 210a and 210c. do. The pop-up window 252 includes at least a shortcut icon item, and when a tap gesture 210d is detected on the shortcut icon item, the mobile device proceeds to FIG. 7D .

Referring to FIG. 7D , in response to the detection of the tap gesture 210d, the mobile device replaces the icon addition pop-up window 252 with the shortcut icon selection window 254 and displays it. As another embodiment, the shortcut icon selection window 254 may be overwritten and displayed on the icon addition pop-up window 252 . The shortcut icon selection window 254 includes at least an application menu item, and when a tap gesture 210e is detected on the application menu item, the mobile device proceeds to FIG. 7E .

Referring to FIG. 7E , in response to the detection of the tap gesture 210e, the mobile device displays existing information, that is, the first page 202 of the home screen, on the first touch screen 12, and the second touch screen At 14, the first page 260 of the application menu is displayed. The application menu is configured to provide a list of applications that are stored and executable in the mobile device, and the first page 260 includes at least some of shortcut icons of applications registered in the application menu. When the application menu consists of a plurality of pages, the second touch screen 14 may display the page counter 260a together with the first page 260 .

One of the icons 260b included in the first page 260 of the application menu being displayed on the second touch screen 14, starting on "ICON7" in the example shown and releasing it on the first touch screen 12 When the touch gesture 210d, for example, touch drag and drop is sensed, the mobile device proceeds to FIG. 7F .

Referring to FIG. 7F , the mobile device displays an icon 260c that is a copy of the icon 260b selected by the touch gesture 210d on the first touch screen 12 in response to the detection of the touch gesture 210d. As an example, the icon 260c may be disposed at a position where the touch gesture 210d is released.

While displaying the first page 260 of the application menu on the second touch screen 14, a predetermined touch gesture 210e for page switching, for example, starting from a position on the second touch screen 14 Upon detecting the flick directed in the direction of the first touch screen 12 , the mobile device proceeds to FIG. 7G . Touch gesture 210e initiates and releases within second touch screen 14 .

Referring to FIG. 7G , the mobile device displays the second page 262 of the application menu on the second touch screen 14 in response to the detection of the touch gesture 210e. The second page 262 may be displayed while sliding in the direction of the first touch screen 12 , replacing the first page 260 . When the application menu is composed of a plurality of pages, the second touch screen 14 may display the page counter 262a together with the second page 262 .

One of the icons 262b included in the second page 262 of the application menu being displayed on the second touch screen 14, starting on "ICON23" in the example shown, and releasing it on the first touch screen 12 When a touch gesture 210f, for example, touch drag and drop is sensed, the mobile device proceeds to FIG. 7H .

Referring to FIG. 7H , the mobile device displays an icon 262c that is a copy of the icon 262b selected by the touch gesture 210f on the first touch screen 12 in response to the detection of the touch gesture 210f. As an example, the icon 262c may be disposed at a position where the touch gesture 210f is released.

7f and 7h, while displaying the home screen on the first touch screen 12 and displaying the application list on the second touch screen 14, one of the physical buttons provided on the first panel is When the go button or the home button is input, the mobile device stores the icons displayed on the first touch screen 12 as the home screen and removes the application list from the second touch screen 14 as shown in FIG. 7i . Instead, it displays the next page 204 of the home screen.

As another embodiment, while displaying the home screen on the first touch screen 12 and displaying the application menu for editing the home screen on the second touch screen 14, among the physical buttons provided on the first panel When one menu button is input, the mobile device displays a menu window 256 for completing home screen editing. The menu window 256 includes at least one of a save key and an ignore key. When a tap gesture 210h is detected on the save key in the menu window 256, the mobile device includes the icons 260c and 262c copied from the application list 260 and 262 as shown in FIG. 7j, a first touch The icons displayed on the screen 12 are stored as a home screen, and the previous information, ie, the second page 204 of the home screen, is displayed instead of removing the application menu from the second touch screen 14 .

Although not shown, if a tap gesture is detected on the ignore key in the menu window 256 , the mobile device removes the added icons 260c and 262c from the first touch screen 12 and returns to FIG. 7A .

The dual home screen function described above may be similarly applied to the application menu, which is a basic application of the mobile device. The application menu may be called by an icon or menu displayed on the home screen or by an external button, and provides more application lists, ie, icons, than the home screen. The application menu provides a plurality of pages including a plurality of icon groups designated as the application menu.

The mobile device provides two pages designated as application menus through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, and responds to a user's touch gesture to provide two pages It moves and navigates.

8A and 8B are diagrams illustrating a user interface of an application menu according to an embodiment of the present invention.

Referring to FIG. 8A , when a tap gesture is detected on an icon of an application list provided on the home screen or a home button composed of a physical button is input, an application menu is executed and displayed on the first and second touch screens 12 and 14 . The first and second pages 272 and 274 designated as the application menu are displayed. Each of the pages 272 and 274 includes one or more icons respectively corresponding to an application or an application group. When the application menu is composed of a plurality of pages, the first and second touch screens 12 and 14 may further display page counters 272a and 274a together with the first and second pages 272 and 274 . .

When a predetermined touch gesture 280a directed in the direction of the first touch screen 12 from a position on the second touch screen 14, for example, a flick or a touch drag is detected, as shown in FIG. 8B , the mobile device On the first and second touch screens 12 and 14 in response to the touch gesture 280a, subsequent pages of the application menu, that is, the third page 276 including the third icon group and the fourth icon group, are displayed on the first and second touch screens 12 and 14 in response to the touch gesture 280a. A fourth page 278 containing it is displayed. Here, the third page 276 and the fourth page 276 may be displayed while sliding in the direction of the first touch screen 12 from the second touch screen 14 according to the movement direction and speed of the touch gesture 280a. have. Similarly, first and second touch screens 12 and 14 may further display page counters 276a and 278a along with third page 276 and fourth page 276 .

Although not shown, when a touch gesture in a direction from the first touch screen 12 to the second touch screen 14 is detected on the first or second touch screens 12 and 14, the mobile device responds to the touch gesture to the previous pages of the application menu on the first and second touch screens 12 and 14, that is, the first page 272 including the first icon group and the second page 274 including the second icon group to display Similarly, the first and second pages 272 and 274 may be displayed while sliding in a direction from the first touch screen 12 to the second touch screen 14 according to the touch gesture.

When the first and second touch screens 12 and 14 are configured to be connected non-continuously by a hinge or a separate connection part, each page slides through the hinge or connection part when the first and second touch screens 12 and 14 are slid through the hinge or connection part. 14) can be displayed across both sides. As a selectable embodiment, each icon in each page may not be displayed across both sides of the first and second touch screens 12 and 14, but may be displayed through a hinge or a connection part quickly.

When a plurality of items are displayed over two touch screens in a list or grid form, such as icons on the home screen or application menu or thumbnail images of a photo gallery application, the items are scrolled (or moved in parallel) together by a touch gesture. The touch gesture may be a flick, a sweep, or a touch drag.

In one embodiment, the touch gesture may start at one location within the first touch screen 12 and be released at another location within the first touch screen 12 ( further away from the second touch screen 14 ). In another embodiment, the touch gesture starts at one location within the second touch screen 14 and is released at another location within the second touch screen 14 (closer to the first touch screen 12 ), or 1 Can be released at one location within the touch screen 12 .

When a touch gesture is initiated and released within one of the first and second touch screens 12 and 14, the mobile device displays the items displayed on the first and second touch screens 12 and 14. The two pages are displayed by replacing them with the next or previous two pages according to the movement direction of the touch gesture. As another embodiment, items displayed on the first and second touch screens 12 and 14 may be scrolled according to the movement direction, movement distance, and speed of the touch gesture. As an example, the mobile device scrolls items corresponding to the distance or speed moved by the touch gesture.

As another embodiment, when the touch gesture is a flick that occurs on any one of the first and second touch screens 12 and 14 and moves across the hinge (or connection), the mobile device may display the first and second touch screens 12 and 14. ,14) scrolls to the first or last two pages according to the movement direction of the touch gesture. As another embodiment, when the touch gesture is a sweep that occurs on any one of the first and second touch screens 12 and 14 and moves across the hinge (or connection), the mobile device may display the first and second touch screens ( 12 and 14) are scrolled and displayed by the speed of the touch gesture.

When the items are scrolled, each item is not displayed across the two touch screens. That is, when each item reaches the hinge (or connection part), the hinge is skipped and displayed on the next touch screen.

Touch screens of mobile devices switch to portrait view mode or landscape view mode based on sensing signals received from one or more accelerometers, and then display information according to the switched mode. can do. That is, the accelerometer may be included in the sensor module 170 and detects rotation of the portable device. The accelerometer detects a transition between a portrait mode in which the touch screens of the portable device are disposed on the left and right sides and a landscape mode in which the touch screens are disposed at the top and bottom, and generates a detection signal.

When the mobile device is rotated substantially 90 degrees (right or left) while displaying grid items in portrait mode and switched to landscape mode, items in the grid can be rotated and scrolled in the horizontal direction. have. When the items are laid out horizontally, the items on the grid can be scrolled vertically according to the manufacturer's or user's choice, or they can be scrolled horizontally on both the top screen and the bottom screen at the same time. Similarly, the movement of each grid depends on the movement direction and speed of the touch gesture.

As another selectable embodiment, when the mobile device is in portrait mode, when a list is displayed on one touch screen and the list is not displayed on the other touch screen, if the mobile device is rotated 90 degrees, the The list may be displayed over the two touch screens, or information of another touch screen may be expanded and displayed on the two touch screens.

If the mobile device is rotated 90 degrees to the right or left while displaying the home screen or application menu in portrait mode and is converted to landscape mode, the mobile device displays a search bar or a preset application (eg, Internet It may operate to display a search window of an Internet Browsing application).

8C illustrates an example of a user interface for using a landscape mode of a home screen according to an embodiment of the present invention. Here, the arrangement of the touch screen is illustrated when the mobile device is rotated 90 degrees to the left, but the same description applies even when the mobile device is rotated 90 degrees to the right. In the landscape mode, it will be described that the touch screen located at the top becomes the first touch screen 12 .

Referring to FIG. 8C , while the mobile device is providing pages of the home screen or application menu through the first and second touch screens 12 and 14 as shown in FIG. 6A or 8A in the portrait mode, the mobile device moves horizontally. When the mode is changed, that is, when the mobile device is rotated by about 90 degrees, the first touch screen 12 displays a search window 282 linked to an Internet search application or a predetermined application. As an embodiment, the search window 282 may be displayed together with or on the home screen or the page converted to the landscape mode of the application menu that was previously displayed. As another embodiment, the search window 282 may be displayed at the top of the second touch screen 14 . As a selectable embodiment, a dock area 216 is displayed at a predetermined position of any one of the first and second touch screens 12 and 14 in landscape mode, for example, at the right end of the first touch screen 12, Shortcut icons may be vertically arranged in the dock area.

As a selectable embodiment, when switching to the landscape mode, the second touch screen 14 displays the page of the home screen in advance, including at least one application, as the illustrated example, at least one application 286 running. It is displayed in place of the Task Manager screen. At this time, on the task manager screen of the second touch screen 14, preview windows including simple information about each running application 286 or the most recently executed information are displayed in an inactive state, for example, shaded, or displayed in an inactive state. A shortcut icon of the current application 286 may be displayed in a grid or list form. Also, the preview windows of each running application 286 may be displayed partially overlapping each other or may be displayed in a grid form without overlapping each other. The preview window refers to an area in an inactive state that does not allow a touch input, compared to a work screen in which an application is actually executed and provides a user interface such as a touch input.

As another embodiment, when switching to the landscape mode, the second touch screen 14 displays the page and the search window 282 switched to the landscape mode of the previously displayed home screen or application menu, or a preset application and search window ( 282) is indicated. The predetermined application may be designated by a manufacturer or a user, and may be, for example, a Quick Search application, an Internet search application, a list of recommended applications in landscape mode provided by a mobile device, or another application designated by the user. can

As a selectable embodiment, when a user's touch gesture (for example, a tap gesture) is detected in one of the preview windows (or shortcut icons) of each running application, the second touch screen 14 performs a task by executing the corresponding application. Can display a screen (providing an active user interface).

In the landscape mode in which the first touch screen 12 is located at the top and the second touch screen 14 is located at the bottom, the input area 282a included in the search window 282 displayed on the first touch screen 12 When the user's touch gesture (for example, a tap gesture) is detected in the A virtual keypad for text input, that is, a keypad area is displayed on the whole of the . (not shown) After a keyword to be searched through the keypad area is input by the user, in the search window 282 or in the search window 282 ), when a user's touch gesture (eg, a tap gesture) is detected on the search execution key 282b displayed next to the on (12), or on the second touch screen (14), Alternatively, the display is displayed on the entire area including the first and second touch screens 14 .

The mobile device includes a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, and can display various view modes as follows by utilizing the two touch screens. can support

A multi-mode (or multi-tasking mode) means a mode in which different applications are displayed on two touch screens, respectively, and each application may respond to a touch gesture detected on the corresponding touch screens. For example, the first touch screen displays a photo gallery application, and the second touch screen displays an Internet search application. The mobile device may exchange information on two touch screens by a predetermined touch gesture. As an example, the touch gesture includes two touches that are respectively generated on two touch screens and move to a hinge (or a connection unit). In response to the detection of the two touches, the mobile device may replace the photo gallery application on the first touch screen with an Internet search application and replace the Internet search application on the second touch screen with a photo gallery application.

In the main-sub mode (or split mode), two work screens for one application are displayed on two touch screens, respectively. The two work screens provide work screens of different depths (or levels) for the application, respectively, or provide work screens of different functions. That is, some applications are configured to provide a plurality of work screens, and the work screens may have different depths.

For example, the photo gallery application includes a search screen including a plurality of thumbnail images and a full image screen that displays a photo image for one thumbnail image selected from among the thumbnail images in a larger size, that is, full size. It can be provided through different touch screens. In this case, the full image screen may be designated to have a final depth. As another example, the music playback application provides a music list screen listing a plurality of songs and a music playback screen playing one of the songs through different touch screens, and in this case, the music playback screen has a final depth. can be specified.

In the Full Mode (or Expand mode), one work screen for one application is expanded and displayed on two touch screens regardless of the hinge (or connection part). For example, the first touch screen displays a first page of thumbnail images provided through the photo gallery application, and the second touch screen displays a second page of thumbnail images. As another example, one photo image is displayed to fill the entire first touch screen and the second touch screen. Here, the full display means that the photo image is displayed to fill the width and/or height of the first and second touch screens. As another example, the first touch screen displays a map area of a first scale of the map application, and the second touch screen displays a map area of a more detailed scale.

A change between view modes may be performed according to a sensing of a touch gesture on the first and/or second touch screen, a movement gesture of the mobile device, etc. according to a running application. Movement gestures include, for example, physical movement, such as rotation of a portable device, and bending/folding of the first and/or second touch screen. Here, bending/folding of the touch screens may mean bending/folding within a predetermined relative angle. As a selectable embodiment, changing between view modes is invoked by expanding the settings menu of the mobile device, or by expanding the status bar at the top of the main touch screen or both touch screens, which enables quick control of the state and mode changes of the mobile device. This can be done using the Change View Mode button placed within the quick panel.

9 (including FIGS. 9A to 9J) exemplifies a change of a view mode according to a touch gesture according to an embodiment of the present invention.

As shown in FIG. 9A , the first touch screen 12 displays the first application 302 , and the second touch screen 14 displays the second application 304 . As an example, the first touch screen 12 displays a photo gallery application, and the second touch screen 14 displays an Internet search application.

As shown in FIG. 9B , when the mobile device 100 detects a predetermined touch gesture 306 on the first and/or second touch screens 12 and 14 , the first The application 302 is displayed across the first touch screen 12 and the second touch screen 14 . In this case, as an example, the first application 302 may be displayed on the two touch screens 12 and 14 in the full mode, or divided into two work screens in the main-sub mode and displayed on the two touch screens 12 and 14 as an example. can

As an example, touch gesture 306 includes two or more flicks occurring substantially simultaneously, moving in a direction from first touch screen 12 to second touch screen 14 . As another example, touch gesture 306 includes two or more touch drags occurring substantially simultaneously, moving in a direction from first touch screen 12 to second touch screen 14 . Specifically, the mobile device 100 detects a plurality of touches starting on the first touch screen 12 , and the detected touches are simultaneously directed from the first touch screen 12 to the second touch screen 14 . When continuously moving is detected, the first application 302 is displayed on the first touch screen 12 and the second touch screen 14 . As an example, the flicks or touch drags may move through a hinge or connection between the first and second touch screens 12 and 14 .

Although flicks or touch drags are illustrated as occurring side by side here, it goes without saying that the flicks or touch drags may be irregularly generated. As a selectable embodiment, when the distance between the flicks or the touch drags is less than a predetermined value, for example, 2 cm or less, the mobile device may recognize the touch gesture for changing the view mode. As another selectable embodiment, the positions on the first touch screen 12 at which the touches are first detected may be arranged horizontally or vertically substantially side by side.

As another embodiment, the touch gesture 306 includes a pinch gesture for enlarging a selected area, that is, a pinch zoom-in gesture. As an embodiment two touches of the pinch zoom in gesture are initiated on the first touch screen 12 , the first touch is released within the first touch screen 12 and the second touch is on the second touch screen 14 . is released

In this case, the work screen of the first application 302 may be displayed while sliding in a direction from the first touch screen 12 to the second touch screen 14 according to the movement (and speed) of the touch gesture 306 . When the first and second touch screens 12 and 14 are configured to be non-continuously connected by a hinge or a separate connection part, the operation screen of the first application 302 is displayed when the first and second touch screens are slid through the hinge or connection part. 2 It can be displayed across both sides of the touch screen (12, 14).

Although not shown, the first application 302 expanded to the first and second touch screens 12 and 14 by the touch gesture 306 is reduced into the first touch screen 12 by another predetermined touch gesture. can be As an example, a pinch zoom out gesture including two touches starting on each of the first and second touch screens 12 and 14 and releasing on either touch screen, for example, the second touch screen 14 is Upon detection, the mobile device displays the first application 302 reduced to the second touch screen 14 . In this case, the first touch screen 12 may display the second application 304 or display the home screen.

When the first application 302 is a photo gallery application, the photo gallery application 302 displays a first page of a plurality of thumbnail images on the first touch screen 12 as shown in FIG. 9A . In response to detecting the touch gesture 306 of FIG. 9B , the mobile device displays first and second pages of a plurality of thumbnail images on the first and second touch screens 12 and 14 as shown in FIG. 9C . (302a, 302b) are respectively indicated. At this time, according to the movement of the touch gesture 306, the first page 302b of the thumbnail images displayed on the first touch screen 12 slides to the second touch screen 14, and the second page of thumbnail images ( 302a is slid along the first page 302b to the first touch screen 12 .

When a plurality of items such as thumbnail images are being displayed on the first and second touch screens 12 and 14 in a grid form, the items are displayed and described in Figs. may be scrolled (ie, translated). That is, when a touch gesture such as a flick or a sweep occurs on any one of the first and second touch screens 12 and 14 , the thumbnail images are scrolled according to the movement direction and speed of the touch gesture. In this case, the thumbnail images may be scrolled across a hinge (or a connection part) between the first and second touch screens 12 and 14 .

Referring to FIG. 9D , the mobile device 100 displays a user's touch gesture 310 on a first thumbnail image 306 that is one of the thumbnail images 302a of the first touch screen 12, i. For example, a tap gesture) is detected. Then, as shown in FIG. 9E , the second touch screen 14, in response to the detection of the touch gesture 310 , displays the first page 302b of thumbnail images, and a photo image for the first thumbnail image 306 . (306a) is substituted and indicated. The photo image 306a has a larger size than the first thumbnail image 306 and may be displayed to fill any one of a horizontal width and a vertical height of the second touch screen 14 . As shown in FIG. 9F , when a user's touch gesture 312 (for example, a tap gesture) is detected on the second thumbnail image 308 among the thumbnail images 302a of the first touch screen 12, the touch gesture ( In response to sensing 312 , the photo image 308a for the second thumbnail image 308 is displayed on the second touch screen 14 replacing the photo image 306a for the first thumbnail image 306 . .

Referring to FIG. 9G , the first touch screen 12 displays a plurality of thumbnail images 302a provided through a photo gallery application, and the second touch screen 14 displays a plurality of thumbnail images 302a among the plurality of thumbnail images 302a. In a state in which the first photo image 308a for the selected first thumbnail image is being displayed, the mobile device 100 performs a predetermined touch gesture 320 on the first photo image 308a displayed on the second touch screen 14 . ) is detected. Then, as shown in FIG. 9H , the mobile device 100 expands the first photo image 308a and displays it on the first touch screen 12 and the second touch screen 14 to be filled ( 308b ). The first photo image 308b extends to the first touch screen 12 while covering the thumbnail images 302a of the first touch screen 12 . When the expansion is completed, a part (left half as an example) of the first photo image 308b is displayed on the first touch screen 12, and the remainder (right half as an example) of the first photo image 308b is displayed on the second 2 is displayed on the touch screen 14 . As a selectable embodiment, when the first photo image 308b is an image created in the portrait mode (a vertically long image), the first photo image 308b is displayed on any of the first and second touch screens 12 and 14 . can be displayed in one.

As an embodiment, the touch gesture 320 includes a pinch gesture for enlarging a selected area, that is, a pinch zoom in. The first and second touches of the pinch zoom-in gesture both occur on the second touch screen 14, the first touch is released within the second touch screen 14, and the second touch is the first touch screen ( 12) is released within In another embodiment, the touch gesture 320 includes two touch drags occurring simultaneously on the second touch screen 14 and moving away from each other in approximately opposite directions. As an example, at least one of the touch drags may start at one location on the second touch screen 14 and end at another location on the second touch screen 14 . As another example, at least one of the touch drags may start at a location on the second touch screen 14 and end at a location on the first touch screen 12 .

The portable device 100 detects two touches on the second touch screen 14 substantially simultaneously or in sequence, and substantially simultaneously detects that the detected touches are successively away from each other in opposite or approximately opposite directions. Then, the first photo image 308a is expanded and displayed so as to fill the first touch screen 12 and the second touch screen 14 .

Although not shown, while the first photo image 308a is displayed on the first and second touch screens 12 and 14, starting from each of the first and second touch screens 12 and 14, Upon detecting a pinch zoom out gesture comprising two touches released from a touch screen, for example, first touch screen 12 , the mobile device reduces first photo image 308a to first touch screen 12 . can be displayed in full.

As shown in FIG. 9i , the mobile device 100 performs a touch gesture 322 in a predetermined direction on the first photo image 308c displayed across the first touch screen 12 and the second touch screen 14 , As an example, a flick or touch drag from the second touch screen 14 to the first touch screen 12 (or in the opposite direction) is sensed. Then, as shown in FIG. 9J , the mobile device 100 displays the first photo image 308c displayed on the first touch screen 12 and the second touch screen 14 in response to the touch gesture 322, continuously The second photo image 324 is replaced and displayed. At this time, the first photo image 308c may be removed while sliding in the direction (or in the opposite direction) from the second touch screen 14 to the first touch screen 12 according to the movement direction and speed of the touch drag 322 . have. A second photo image 324 follows the first photo image 308c and is slid into the first touch screen 12 and the second touch screen 14 .

As a selectable embodiment, the touch drag 322 may be performed on any one touch screen. As another selectable embodiment, the touch drag 322 may be made across the two touch screens 12 and 14, ie via a hinge.

The mobile device may provide a familiar and new home user interface such as a foldable wallet or compact powder through a display device comprising a first touch screen and a second touch screen provided on at least one panel configured to be foldable. have. This is referred to as a pocket mode home screen in this specification. The mobile device may provide a home screen as shown in FIG. 6 or a pocket mode home screen to be described later according to a manufacturing setting or a user setting. As an embodiment, the pocket mode home screen may be usefully used in a double screen mode or an in-folded screen mode.

10 (including FIGS. 10A to 10H) is a diagram illustrating a user interface of a pocket mode home screen according to an embodiment of the present invention.

Referring to FIG. 10A , the first touch screen 12 displays regions 402, 404, 406 and 408 in the form of a credit card stored in the wallet, including some information of widgets or applications designated as the home screen, and additionally A dock area 410 including icons of frequently used applications may be further displayed. Each region 402 , 404 , 406 , 408 has the form of a stored card partially obscured by a graphic image in the shape of a slit for accommodating cards in a wallet, and may be arranged side by side in a vertical direction similar to the stored cards. Areas 402-408 display at least one of simple information provided by a widget or an application and a shortcut key for executing a predetermined function. The simple information includes information that the user wants to know first through the application, and may be automatically updated in real time according to the application. For example, in the area related to the message application, whether a newly received message exists may be displayed as a notification such as the flashing phrase "NEW". As a selectable embodiment, the lowermost region 408 may have a shape of a received card partially covered by an oblique hole.

When a predetermined touch gesture, for example, a tap gesture or touch and hold is detected in one of the areas 402, 404, 406, and 408, the mobile device displays an application in the corresponding area on the first touch screen 12 or the second touch screen 12. It is displayed to occupy the entirety or to occupy the entire first touch screen 12 and the second touch screen 12 .

At least some of the regions (eg, 402 , 404 , and 408 ) display simple information provided by a widget or an application, and may be expanded and displayed in response to a predetermined touch gesture. As an example, the area 402 of the schedule widget includes today's date and time and title for N (one or two as an example) schedules, and the area 404 of the weather widget includes the current city and Contains the current temperature and weather icons, and area 408 of the business card widget contains the name of the contact's person, hotkeys for placing a call and/or sending a message, and a photo image. The photo image may be replaced with a default image.

In one embodiment, in response to detecting a predetermined touch gesture, for example, a flick or a touch drag-up, on any one of the regions 402, 404, and 408, the mobile device sets the corresponding region from the hole-shaped graphic image. It expands in the form of a partially drawn card. The extended area includes more information about the corresponding widget or application. The expanded area may be restored to its original size in response to detecting a touch drag-down on the expanded area or a touch gesture on another area.

At least some of the areas (eg, 406 ) display shortcut keys for functions provided by the application while operating in the background. As an example, the area 406 of the music playback application displays a status bar displaying the album image, title, artist, and performance status of the music being played, and additionally a previous song selection key, a stop/playback key, and a next song selection Provides shortcut keys such as keys. When a tap gesture is detected from one of the shortcut keys, the music execution application executes a function corresponding to the shortcut key in the background.

Referring to FIG. 10B , the mobile device detects a predetermined touch gesture 420 on the area 402 of the schedule widget, for example, a flick or touch drag-up in an upward direction. Referring to FIG. 10C , in response to the detection of the touch gesture 420 , the area 402 of the schedule widget is expanded and displayed 402a in an upward direction. The extended area 402a may display time and titles for M schedules more than N (for example, 3 or more), and may further selectively display a weekly schedule according to the extended length. The region 402 may expand upward according to the movement of the touch gesture 420 , and may expand until reaching the terminus of the first touch screen 12 within a predetermined maximum size.

Referring to FIG. 10D , the mobile device detects a predetermined touch gesture 422 , for example, a tap gesture or a touch drag, on one of shortcut keys and a status bar included in the area 406 of the music playback application. Then, in response to the touch gesture 422 , the music playback application performs functions such as playback, playback of the previous song, stop, playback of the next song, and movement of the playback position. The area 406 of the music playback application that operates in the background and does not require area expansion may be shaped and displayed in the form of a stitched label instead of a stored card.

Referring to FIG. 10E , the mobile device detects a predetermined touch gesture 424 on the area 404 of the weather widget, for example, a flick or touch drag-up in an upward direction. In response to detection of the touch gesture 424 , the area 404 of the weather widget is displayed by expanding 404a in an upward direction. The expanded area 404a may further display more detailed information about the weather, for example, additional information about today's weather, weekly weather, and the like. The area 404 of the weather widget may expand upward according to the movement of the touch gesture 424 , and may expand until reaching the end of the first touch screen 12 within a predetermined maximum size. The area 404 of the weather widget may be expanded while covering at least a portion of the area 402 of the schedule widget located at the top. As an embodiment, the region 404 cannot be extended beyond a predetermined maximum range, and when the extended length of the extended region 404a reaches the maximum range, the extended region 404a enters an expanded state. maintained, or restored to the original size area 404 .

Referring to FIG. 10F , the mobile device detects a predetermined touch gesture 426 on the area 408 of the business card widget, for example, a flick or touch drag-up in an upward direction. In response to detection of the touch gesture 426 , the area 408 of the business card widget is displayed by expanding 408a in an upward direction. The expanded area 408a further includes a photo image 408d of a person of the contact, more detailed information 408e than before the expansion, for example, a mobile phone number, office phone number, birthday, address, email address, and the like. can be displayed The region 408 may be expanded in an upward direction according to the movement of the touch gesture 426 while covering the at least one widget 406 , 404 , 402 positioned at the top, and the first touch screen 12 within a predetermined maximum range. ) can be extended until reaching the end of the As an embodiment, the region 408 cannot be extended beyond a predetermined maximum range, and when the extended length of the extended region 408a reaches the maximum range, the extended region 408a enters an expanded state. retain, or automatically return to the area 408 of its original size.

Referring to FIG. 10G , the area 408 and the expanded area 408a of the business card widget display at least one of shortcut keys 408b and 408c for connecting a call and sending a message. When a predetermined touch gesture 428, for example, a tap gesture, is detected on the shortcut key 408b for a call connection, the mobile device proceeds to FIG. 10H .

Referring to FIG. 10H , the mobile device attempts a call connection to a phone number related to the area 408 of the business card widget by a call application, and a portion of the first and second touch screens 12 and 14 . Alternatively, the entire dialing screen 408f of the call application is displayed. The dialing screen 408f may be displayed by replacing at least a portion of the pocket mode home screens of the first and second touch screens 12 and 14 . In the illustrated example, the dialing screen 408f is displayed on the entire first touch screen 12, and includes a caller identification area including a photo image and a phone number of the other party, adding a phone number, calling a dial pad, and ending the call , soft keys for in-call functions such as speakerphone, Mute, Headset, and the like. As an optional embodiment, the second touch screen 14 may provide a prompt screen 408g recommending that the home screen be maintained, turned off, or the portable device is folded for a call. .

Although not shown, when a tap gesture is detected on the shortcut key 408c for sending a message included in the area 408 or the expanded area 408a of the business card widget, a message is displayed on part or all of the first touch screen 12 . A text input area for sending messages provided by the application and a virtual keypad are displayed. In an embodiment, the virtual keypad is displayed while covering a lower portion of the first touch screen 12 . In another embodiment, the virtual keypad is continuously displayed over the lower end of the first touch screen 12 and the lower end of the second touch screen 14 . As a selectable embodiment, the virtual keypad is displayed at the bottom of the first touch screen 12, and is displayed at the bottom of both the first and second touch screens 12 and 14 through an expand button provided in the virtual keypad. can be expanded as much as possible.

11 (including FIGS. 11A to 11F) is a diagram illustrating a user interface of a pocket mode home screen according to another embodiment of the present invention.

Referring to FIG. 11A , the second touch screen 12 displays first areas 412 of applications designated as home screens. The first regions 412 are displayed in the form of a stored card partially covered by a graphic image in the form of a hole for storing the card in the wallet, and simple information (2 to 3 lines as an example) provided by each application and a predetermined and at least one of shortcut keys 416 for executing a function. The simple information may be automatically updated in real time according to an application. As an embodiment, the area of the social networking service (SNS) application may display whether or not there is a recent update and a part of the recently updated message.

As a selectable embodiment, the area 414 of the photo gallery application, which is one of the areas displayed on the second touch screen 12 , may provide a predetermined number of thumbnail images. In one embodiment region 414 further includes a shortcut key for changing the view mode of the thumbnail images. As an example, the shortcut key is configured as a slider switch. In addition, the thumbnail images may be scrolled according to a direction in which the thumbnail images are arranged in the region 414 , for example, a movement direction and speed of a touch gesture in a horizontal direction. As a selectable embodiment, since the area 414 of the photo gallery application does not require area expansion, it may be shaped and displayed in the form of a stitched label instead of the form of a stored card.

The second touch screen 14 displays the first areas 412 including simple information on a predetermined number of, for example, five applications according to the setting of the pocket mode home screen. The first regions 412 are preferably arranged side by side in a vertical direction, similar to the accommodated cards. As an example, each of the first areas 412 includes a name or graphic symbol of an application, one or two lines of information provided by the application, and an indicator indicating an update status of the application. When a predetermined touch gesture (for example, a flick-up or a touch-drag-up) is detected on each of the first regions 412 , the corresponding first region 412 may expand upward within a predetermined maximum size.

Referring to FIG. 11B , when a pinch gesture 430 for region reduction, that is, pinch zoom out, is detected on the first regions 412 , the first regions 412 are each reduced, and Reduced areas for other applications are further displayed in the space in the second touch screen 14 generated by the display ( 412a ). That is, a second area including the reduced first areas 412 and reduced areas of other applications. The regions 412a include more applications (eg, six or more applications) than the first regions 412 , and thus have less information than the first regions 412 , as an example. Only the application name, graphic symbol, and update indicator can be displayed on a single line.

As shown in FIG. 11C , when a touch gesture 432 in a predetermined direction, for example, a flick up/down or a touch drag up/down is detected on the second regions 412a, the mobile device proceeds to FIG. 11D do. Referring to FIG. 11D , in response to a touch gesture 432 , the mobile device displays reduced areas of applications designated as the pocket mode home screen while scrolling in an upper direction or a lower direction ( 412b ).

When a pinch gesture 434 for expanding an area, for example, pinch zoom in, is detected on the reduced areas 412b, the portable device proceeds to FIG. 11E . Referring to FIG. 11E , the reduced regions 412b according to the pinch gesture 434 are expanded to their original size ( 412c ), and reduced regions of some applications (eg, the top and/or the or the lowermost regions) are no longer displayed on the second touch screen 14 . The areas 412c include, for example, five applications according to the basic setting of the pocket mode home screen.

Referring to FIG. 11F , a predetermined touch gesture 436 in any one of the reduced areas 412a and 412b or the original size areas 412 and 412c, for example, a flick or touch drag up in an upward direction. is detected, the corresponding area is displayed (412d) by extending in the upper direction. The expanded area 412d may further display more detailed information of the corresponding application, for example, a recently uploaded image and more information about a recent activity. The extended area 412d is extended in an upward direction according to the movement of the touch gesture 436 , and may be extended until reaching a predetermined maximum range. Depending on the type of application, the extended area 412d may provide at least one of a text input window having a size that can be included in the extended area 412d and soft keys for a predetermined function together with the more detailed information. .

As an example, the received card-shaped area related to the message application may be expanded by the user's touch and drag-up, and a miniaturized text input window and transmission shortcut may be displayed in the area secured through the expansion.

As a selectable embodiment, upon detecting a predetermined touch gesture 436, for example, a tap gesture, in a first region that is any one of regions 412, 412a, 412b, and 412c, the mobile device displays a second touch screen 14 ) to expand and display the first area. In this case, the first area may be expanded to have the same size or similar size to all of the areas 412 , 412a , 412b and 412c , or to occupy the entire second touch screen 14 . As an example, the received card-shaped area related to the social network service application may be expanded by the user's tap gesture, and a predetermined number of recently received messages may be listed and displayed in the area secured through the expansion. The expanded area may include shortcut keys such as forward, reply, copy, and the like, on each message. The expanded area may be restored to its original size by a touch or pinch gesture in another area.

As another selectable embodiment, upon detecting a predetermined touch gesture 436, for example, a tap gesture, in a first region that is any one of regions 412, 412a, 412b, and 412c, the mobile device displays a second touch screen ( 14), the application corresponding to the first area is displayed.

The mobile device may display a gallery map application in which a photo gallery application and a map application are combined through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. The first touch screen and the second touch screen respectively display a map and at least one photo image registered in the map. The gallery map application may register and manage at least one photo image for any one location on the map. As an embodiment, the gallery map application receives a photo image registered in a server located on the Internet and its location information from the server, and manages the photo image by linking it to a location indicated by the location information. The photo image may be taken or generated at the location, or may include content related to the location. As an embodiment, the gallery map application may be usefully used in a double screen mode or an in-folded screen mode.

12 (including FIGS. 12A to 12I) is a diagram illustrating a user interface of a gallery map application according to an embodiment of the present invention.

Referring to FIG. 12A , the first touch screen 12 displays a map area 502 provided by the gallery map application. The map area 502 may include, for example, a geographic area of a predetermined scale including the user's current location or a geographic area of a predetermined scale including a location designated by the user. At least one location indicator 504a , 504b , and 504c indicating a location where a search result, a tourist destination, or a photo image is registered is included on the map area 502 .

The second touch screen 14 displays a gallery area 506a listing thumbnail images of photo images registered at locations included in the map area 502 . The gallery area 506a lists at least some of the thumbnail images of photo images registered for the location indicators 504a, 504b, and 504c included in the map area 502 . When the thumbnail images cannot be displayed all at once in the gallery area 506a, the thumbnail images may be divided and displayed in a plurality of pages, and the second touch screen 14 is displayed according to the sensed touch drag on the gallery area 506a. You can scroll through the thumbnail images. Thumbnail images may be displayed in grid view mode, list view mode, or group view mode according to a basic setting or a user's setting. In the group view mode, thumbnail images of each group may be displayed in a distorted form with at least some overlapping.

When a touch gesture 512, for example, a flick or a touch drag in a predetermined direction, is detected on the map area 502 displayed on the first touch screen 12, as shown in FIG. 12B, from the map area 502 The map area 502a moved according to the movement of the touch gesture 512 is displayed on the first touch screen 12 . Then, the second touch screen 14 displays a gallery area 506b listing at least some of the thumbnail images of photo images registered for the location indicators 504b, 504c, 504d, 504e included in the map area 502a. .

Although not shown, a predetermined touch gesture in one (eg 504c) of the location indicators 504b, 504c, 504d, and 504e displayed on the map area 502a displayed on the first touch screen 12, as an example When the tap gesture is detected, the gallery area of the second touch screen 14 may display at least some of the thumbnail images of the photo images registered for the selected location indicator 504c.

Referring to FIG. 12C , the first touch screen 12 displays the map area 502b, and the gallery area 506c of the second touch screen 14 shows the locations included in the map area 502b. Thumbnail images of registered photo images are displayed. The mobile device performs a predetermined touch gesture 514 in one 504a of the location indicators 504a, 504c, 504d, 504f, 504g displayed on the map area 502b displayed on the first touch screen 12, as an example Detects tap gestures or touch and hold. Then, as shown in FIG. 12D , in response to detection of the touch gesture 514 , the first touch screen 12 displays thumbnail images of images registered for the position indicator 504a in an area adjacent to the position indicator 504a. 520 is indicated. Thumbnail images 520 may be displayed in a group view mode of a grid form or at least partially overlapping a disordered form, and the name 520a of an image group registered for the location indicator 504a together with the thumbnail images 520 . ), as an example, "A Castle" may be displayed together.

Referring to FIG. 12E , the mobile device detects a touch gesture from one of the location indicators 504a , 504c , 504d , 504f and 504g displayed on the map area 502b displayed on the first touch screen 12 . , display thumbnail images 522 of images registered for the location indicator 504g in the vicinity of the location indicator 504g. The thumbnail images 522 may be displayed in a grid form or partially overlapped form, and the name 522b of the image group registered for the location indicator 504g together with the thumbnail images 522, as an example "B Cafe" " may be displayed together.

The second touch screen 14 provides a soft key 530 for selecting a view mode to change the view mode of the gallery area 506c between a group view and a grid view. The soft key 530 is composed of, for example, a slider switch, and when a user's touch is detected on the slider switch and the slider switch moves to an icon indicating a group-type view mode according to the touch, the second touch The gallery area 506e of the screen 14 displays thumbnail images registered for the location indicators 504a, 504c, 504d, 504f, and 504g included in the map area 502b displayed on the first touch screen 12, respectively. Grouped by location and displayed. In the group view mode, thumbnail images of each group may be displayed in a distorted form partially overlapped with each other.

Referring to FIG. 12F , the first touch screen 12 displays a map area 502b provided by the gallery map application. The map area 502b includes location indicators 504a, 504c, 504d, 504f, and 504g indicating a location where a search result, a registered tourist destination, or a photo image is registered. The second touch screen 14 displays a gallery area 506e listing thumbnail images registered in locations included in the map area 502b. The gallery area 506e displays at least some of the thumbnail images registered for the location indicators 504a, 504c, 504d, 504f, and 504g included in the map area 502b in a grid view mode or a group view mode.

A predefined touch gesture 530 in one (eg 504a) of the location indicators 504a, 504c, 504d, 504f, 504g on the map area 502b, such as a tap gesture or a touch and hold (ie long tap) ) is sensed, the first touch screen 12 displays a menu window 530a for path selection in the vicinity of the location indicator 504a. The menu window 530a includes a start key and an arrival key. When the tap gesture 530b is detected on the start key of the menu window 530a, the gallery map application designates the location indicator 504a as the start position in response to the detection of the tap gesture 530b. In this case, the location indicator 504a may be changed to a conspicuous color, for example, red, so as to be visually distinguished from other displayed location indicators 504c, 504d, 504f, and 504g.

Referring to FIG. 12G , a touch gesture predetermined in another one (eg, 504d) of the location indicators 504a, 504c, 504d, 504f, and 504g on the map area 502b displayed on the first touch screen 12 532 , for example, when a tap gesture or touch and hold is sensed, the first touch screen 12 displays a menu window 532a for selecting a path near the location indicator 504d. The menu window 532a includes a start key and an arrival key. When the tap gesture 532b is detected on the arrival key of the menu window 532a, the gallery map application designates the location indicator 504d as the arrival location in response to the detection of the tap gesture 532b. In this case, the location indicator 504d may be changed to another color that is conspicuous, for example, red, so as to be visually distinguished from other location indicators 504c , 504f , and 504g that are being displayed.

The gallery map application displays a slide show control area 542 including information on a route from the start location to the arrival location on the lower part of the first touch screen 12 when registering a starting location or registering an arrival location. . The slide show control area 542 may be displayed while covering a part of the map area 502b.

Referring to FIG. 12H , when the starting location 504a and the arrival location 504d are registered, the gallery map application is displayed from the starting location 504a to the arrival location 504d on the map area 502b of the first touch screen 12 . ) to the path 540 is displayed in the form of a graphic line. The path 540 is indicated along the actual road between the starting location 504a and the arrival location 504d, and intervening at least one location indicator 504c existing between the starting location 504a and the arrival location 504d. It can be included as a location. The slide show control area 542 displayed on the lower part of the first touch screen 12 includes a path tracking bar 544 indicating position indicators belonging to a path from a starting position to an arrival position and a movement status according to the path; It may include a slide show view key 546 that may select to initiate a slide show of the photo images belonging to path 540 . In another embodiment, the slide show control area 542 is displayed in response to the display of the path 540 .

When a predetermined touch gesture, for example, a tap gesture, is detected on the slide show view key 546 , the mobile device removes the map area 502b on the first touch screen 12 and removes the path as shown in FIG. A slide show of photo images registered in locations belonging to 540 is played. According to an embodiment, the photo images are sequentially displayed while filling at least one of a horizontal width and a vertical width of the first touch screen 12 during the slide show. During the slide show, the path tracking bar 544 of the slide show control area 542 includes a current slide indicator indicating the position of the photo image currently being displayed on the first touch screen 12 during the slide show, Control area 542 provides, instead of slide show view key 546 , a slide show stop key 548 that allows you to select to stop the slide show.

As a selectable embodiment, the slide show control area 542 may be hidden on the first touch screen 12 while the slide show is in progress so as not to obstruct viewing of the picture images being slid. The slide show control area 542 may be displayed again by detecting a predetermined touch gesture in a predetermined area on the first touch screen 12, for example, the lower portion of the first touch screen 12 while the slide show is in progress. have.

The portable device may display a task manager area including icons of a plurality of applications being driven through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. As another embodiment, the task manager area may include icons of favorite applications designated by the user. The task manager area may be disposed at a predetermined position on the first touch screen and the second touch screen, for example, below the first touch screen and the second touch screen. That is, some icons of the task manager area are displayed under the first touch screen, and the remaining icons are displayed under the second touch screen. The icons of the task manager area may be continuously disposed below the first and second touch screens.

13 (including FIGS. 13A to 13J) illustrates a user interface of a task manager panel according to an embodiment of the present invention.

Referring to FIG. 13A , the first touch screen 12 displays the work screen 610 of the first application, and the second touch screen 14 displays the work screen 612 of the second application. The work screens 610 and 612 have a size that fills the displayable areas of the first and second touch screens 12 and 14, display information executed by each application, and provide a user interface. Here, the multi-mode is illustrated in which the first and second touch screens 12 and 14 display task screens 610 and 612 of different applications. ) may be similarly applied when a home screen or an application menu is displayed on at least one or the first and second touch screens 12 operate in a main-sub mode or a full mode.

The mobile device detects a predetermined command or user gesture for executing the task manager. The command or user gesture may be, for example, input of a physical button provided in the housing of the mobile device, sensing of a touch on a predetermined area in at least one of the first and second touch screens 12 and 14, and the first and second touch screens. 2 includes at least one of sensing a touch for a soft key provided through at least one of the touch screens 12 and 14 and manipulating a soft menu.

13A illustrates an example of executing the task manager function using one of the physical buttons 600a provided on the second panel including the second touch screen 14 . The button 600a for executing the task manager function may be, for example, a home button that is one of touch-sensitive physical buttons provided on the second panel. When the mobile device detects an input 602 of the home button 600a provided on the second panel, for example, a tap gesture or touch and hold on the home button, proceeds to FIG. 13B .

Referring to FIG. 13B , the mobile device responds to the input 602 at a predetermined position of the first and/or second touch screens 12 and 14 , for example the first and second touch screens 12 , 12 , 14), the task manager panels 604a and 604b are displayed at the bottom, respectively. The task manager panels 604a and 604b constitute the task manager area, and are disposed adjacent to each other while being positioned on different touch screens 12 and 14 to be continuous with each other. In another embodiment, the task manager panels 604a and 604b are a default setting position or a position designated by the user, for example, on top of the first and/or touch screens 12 and 14 , on the first touch screen 12 . It may be disposed at the left end, the right end of the second touch screen 14 , the right end of the first touch screen 12 , and the left end of the second touch screen.

With the display of the task manager panels 604a and 604b, the first and second touch screens 12 and 14 are preview windows 610a and 612a of the first and second applications, and the tasks of the first and second applications are displayed. The screens 610 and 612 are replaced. The preview windows 610a and 612a have a smaller size than the work screens 610 and 612 and may be shaded to indicate that they are in an inactive state that does not allow a user interface such as a touch input.

In the illustrated example, the task manager panels 604a and 604b are displayed separately on the first touch screen 12 and the second touch screen 14, and each includes at least some of icons for running applications. For example, each of the task manager panels 604a and 604b may include up to four non-overlapping icons. That is, the first task manager panel 604a includes icons for the first to fourth applications App#1 to App#4 in operation, and the second task manager panel 604b includes the fifth to sixth applications in operation. Includes icons for applications App#5 to App#8. When the number of running applications exceeds the maximum number of icons displayable on the task manager panels 604a and 604b, that is, 8, the task manager panels 604a and 604b display only 8 icons, and touch Other icons may be further displayed by scrolling the icons being displayed in response to the gesture.

In one embodiment, the order of the applications included in the task manager panels 604a and 604b is based on the last played time. The icons 610b and 612b for the first and second applications that were being displayed on the first and second touch screens 12 and 14 just before the task manager is executed are the first and second icons in the task manager panels 604a and 604b. located in When the number of running applications is less than the maximum number of icons (eg, eight) that can be included in the two task manager panels 604a and 604b, the icons of the running applications are displayed on the first and second touch screens 12 , 14) may be center-aligned between the hinges. The center-aligned icons may be moved into the first task manager panel 604a or the second task manager panel 604b by left-direction or right-direction touch dragging.

An end indicator 606 (eg, an X-shape) for immediately terminating the corresponding running application may be attached to each icon. When a tap gesture is detected on the end indicator 606 attached to App#8, which is one of the displayed icons, the mobile device terminates the application App#8 of the corresponding icon. When the preview screen of the application App#8 is being displayed on the first and/or second touch screens 12 and 14, the preview screen of the App#8 of the corresponding touch screen is replaced with one page of the home screen. When the preview screen of the application App#8 is not displayed on the first and/or second touch screens 12 and 14, the application App#8 is terminated in the background.

Referring to FIG. 13C , the mobile device displays a touch gesture 602a acting parallel to a direction in which icons are arranged on the first and/or second task manager panels 604a and 604b, for example, in a left direction or a right direction. A flick or touch drag is detected, and icons displayed on the first and second task manager panels 604a are scrolled and displayed together according to the touch gesture 602a. Icons stored in the task manager can be scrolled through rotation. Each icon may be displayed across the two touch screens 12 and 14 when passing through the hinge between the first and second touch screens 12 and 14 according to the touch gesture 602a. As another embodiment, when passing through the hinge according to the touch gesture 602a, each icon is not displayed separately on the two touch screens 12 and 14, but is displayed by skipping the hinge.

Referring to FIG. 13D , the mobile device starts from any one of the icons 614b included in the first and/or second task manager panels 604a and 604b, and the first and/or second task manager panel ( 604a, 604b) an outwardly directed predetermined touch gesture 602b, starting from the icon 614b of App#5 as an example, belonging to the first touch screen 12 and in an area other than the first task manager panel 604a Detects a touch drag being released. As shown in FIG. 13E , in response to detection of a touch drag 602b, the first touch screen 12 displays a preview window 610a of the first application displayed on the first touch screen 12, and displays an icon. The preview window 614a of the application App#5 related to 614b is replaced and displayed.

Referring to FIG. 13F , the mobile device moves from an icon 616b of App#11 included in the first task manager panel 604a to an area belonging to the first touch screen 12 and excluding the first task manager panel 604a. Detects a touch drag 602c of Touch drag 602c starts at icon 616b and is released at any point in the area other than the first task manager panel 604a belonging to the first touch screen 12 . As shown in FIG. 13G , in response to the detection of the touch drag 602c, the first touch screen 12 displays the preview window 614a of App#5 and the preview window of the application App#11 related to the icon 616b. (616a) is replaced with (616a).

13D to 13G show only the replacement of the preview window made on the first touch screen 12, but depending on the start and release positions of the touch drag, the preview of the application corresponding to the icon included in the first task manager panel 604a Of course, it is also possible to raise the window to the second touch screen 14 or to raise the preview window of the application corresponding to the icon included in the second task manager panel 604b to the first touch screen 12 .

Referring to FIG. 13G , the mobile device is configured to be directed into the second task manager panel 604b displayed on the second touch screen 14 on the preview window 612a of the second application displayed on the second touch screen 14 . A touch gesture 602d, for example, detects a touch drag that starts at a location on the preview window 612a and is released at any location within the second task manager panel 604b. Then, in response to the detection of the touch drag 602d, the second touch screen 14 converts the preview window 612a into the icon 612b of the second application, and converts the icon 612b according to the touch drag 602d. Move into the second task manager panel 604b. The icon 612b may be disposed in the second task manager panel 604b at a position where the touch drag 602d is released between previously displayed icons.

Referring to FIG. 13H , as the icon 612b enters the area of the second task manager panel 604b following the touch drag 602d, the second task manager panel 604b previously displays the icon 612b. It is displayed together by inserting it between the icons that are being made. Icons displayed in the first and second task manager panels 604a and 604b may be rearranged including the newly entered icon 612b. At this time, the second touch screen 14 replaces the preview window 612a of the second application with the preview window 618a of the other application App#10 being driven and displays it.

After the preview window 612a is removed according to the touch drag 602d, the second touch screen 14 may not display any preview window or work screen other than the second task manager panel 604b. As a selectable embodiment, the second touch screen 14 may display the first page of the home screen after the preview window 612a is removed. Thereafter, when the preview window 616a of the first touch screen 12 is also removed by touch and dragging to the task manager panel 604a or 604b, the mobile device displays the first page of the home screen on the first touch screen 12 and , and display the second page of the home screen on the second touch screen 14 . In this case, the first page of the home screen may be displayed together with the dock area on the first or second touch screens 12 and 14 .

Referring to FIG. 13I , while preview windows 616a and 620a of applications are being displayed on the first and second touch screens 12 and 14, the mobile device receives a predetermined command or user gesture for terminating the task manager. detect The command or user gesture may be, for example, input of a physical button provided in the housing of the portable device, sensing of a touch at a predetermined location in at least one of the first and second touch screens 12 and 14, and the first and second touch screens. 2 includes at least one of sensing a touch for a soft key provided through at least one of the touch screens 12 and 14 and manipulating a soft menu.

13I shows an example of terminating the task manager using one of the physical buttons 600b provided on the second panel including the second touch screen 14 . The button 600b for terminating the task manager panel may be, for example, a back button that is one of touch-sensitive physical buttons provided on the second panel. The mobile device detects an input 602f of the return button 600b provided on the second panel, for example, a tap gesture or a touch and hold on the return button 600b.

Referring to FIG. 13J , in response to the input 602f, the mobile device deletes the first and second task manager panels 604a and 604b on the first and second touch screens 12 and 14, the first and second The preview windows 616a and 620a previously displayed on the second touch screens 12 and 14 are replaced and displayed with the activated work screens 616 and 620 of the corresponding applications.

The portable device may support a personal broadcasting service by a user through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. A user possessing a portable device can become a broadcaster of a private broadcasting service and broadcast an image recorded through a camera of the portable device using a private broadcasting application provided in the portable device.

14 (including FIGS. 14A to 14L) is a diagram illustrating a user interface of a private broadcasting application according to an embodiment of the present invention.

Referring to FIG. 14A , the first touch screen 12 displays a map area 630 provided by a private broadcasting application. The map area 630 may include, for example, a geographic area of a predetermined scale including the user's current location or a geographic area of a predetermined scale including a location selected by the user. At least one caster indicator 634a, 634b, 634c, 634d, 634e, and 634f indicating the position of at least one broadcast caster is included on the map area 630 . The caster indicators 634a-634f are simple information on broadcast content broadcast by a broadcast caster, and may include, for example, at least one of a video capture image, a caster name, and a broadcast title. As a selectable embodiment, the first touch screen 12 displays at least one of a broadcast category to which the broadcast content of the broadcaster displayed in the map area 630 belongs, as an example, at least one of All, Life, Sports, and Entertainment, and also displays a desired broadcast. A category bar 632 that can be changed to a category may be further displayed.

The second touch screen 14 is a broadcast list listing at least some (636a, 636b, 636b, 636c, 636d, 636e) of broadcast items representing broadcast content provided by broadcast casters included in the map area 630 . (636) is indicated. Each broadcast item 636a-636e includes at least one of a video capture image of broadcast content, a broadcast title, a broadcaster's name, broadcast time, and the number of views.

Referring to FIG. 14B , the mobile device detects a touch gesture 640 in a predetermined direction, for example, a flick or a touch drag on the map area 630 displayed on the first touch screen 12 . Referring to FIG. 14C , the first touch screen 12 displays the map area 630a moved from the map area 630 according to the movement direction and speed of the touch gesture 640 . Then, the second touch screen 14 shows the broadcast items 636e, 636f, 636g, A broadcast list 636 listing 636h, 636i, 636h) is displayed.

Referring to FIG. 14C , the second touch screen 14 detects a touch gesture 640a in a predetermined direction, for example, a flick in a vertical direction or a touch drag in a vertical direction on the broadcast list 636 being displayed. do. Then, the second touch screen 14 scrolls and displays broadcast items on the broadcast list 636 according to the touch gesture 640a.

Referring to FIG. 14D , the mobile device performs a predetermined touch gesture 640b on any one (eg, 636g) of the broadcasting items of the broadcasting list 636 being displayed on the second touch screen 14, as an example. Detects tap gestures or touch and hold. Then, as shown in FIG. 14E, the first touch screen 12 displays a broadcast image 638 that reproduces broadcast content corresponding to the broadcast item 636g in response to the detection of the touch gesture 640b, 2 The touch screen 14 displays discussion areas 642 and 644 in which viewers watching the broadcast image 638 can participate. The discussion areas 642 and 644 include a message display window 644 and a message input window 644 , and the message input window 644 includes a message input area 644a and a message transmission key 644b . The message input area 644a receives a message composed of text and/or dialog icons from the user, and when a tap gesture is detected on the message transmission key 644b in a state where an input message exists in the message input area 644a, The message display window 644 displays the input message together with the user's name (real name or nickname registered in the private broadcasting application).

Referring to FIG. 14F , while the broadcast image 638 is displayed on the first touch screen 12 and the discussion areas 642 and 644 are displayed on the second touch screen 14, the mobile device displays the second touch screen ( 14), an input 640c for one of the physical buttons 646a provided on the second panel including, for example, a return button, that is, a tap gesture is sensed. Then, as shown in FIG. 14G, the mobile device displays the broadcast image 638 and the discussion area 642,644 of the first and second touch screens 12 and 14, previously displayed in response to the input 640c, and The existing map area 630a and the broadcast list 636 are replaced and displayed.

When a user cannot find a desired broadcast by moving the map area 630a and searching the broadcast list 636, the user can request a desired broadcast from other users through a broadcast request function provided by a private broadcast application. Hereinafter, a scenario for a broadcast request will be described.

14G to 14I illustrate a user interface for a requester who requests a desired broadcast through a private broadcast application.

Referring to FIG. 14G , the mobile device displays a map area 630a and a broadcast list 636 through the first and second touch screens 12 and 14, or a broadcast image 638 and discussion areas 642 and 644. While displaying , an input 640d for one of the physical buttons 646b provided on the second panel including the second touch screen 14, for example, a menu button, that is, a tap gesture is detected. Then, in response to the input 640d, a menu window 648 for a private broadcasting application is displayed on the lower portion of the second touch screen 14. The menu window 648 includes a Create Broadcast key 648a, a Create Request key 648b, a broadcast item search key 648c, a broadcast item Sorting key 648d, and at least one of a Setting key 648e. When the mobile device detects a predetermined touch gesture 640e, for example, a tap gesture, on the broadcast request key 648b, it proceeds to FIG. 14H .

Referring to FIG. 14H , in response to detection of the tap gesture 640e , a broadcast request window 650 is displayed on the second touch screen 14 in place of the broadcast list 636 or on the broadcast list 636 . . The broadcast request window 650 includes a message input area 650a for receiving a message for a broadcast request, a category selection area 650b for selecting a desired broadcast category, and a completion key 650c and a cancel key 650d. contains at least one. After a message for a broadcast request, for example, "Please show me B-boy events in A park" is input on the message input area 650a, and a desired broadcast category is selected in the category selection area 650b, the mobile device A predetermined touch gesture 640f, for example, a tap gesture, is detected on the completion key 650c.

In response to the detection of the touch gesture 640f, the private broadcasting application provides the input information (request message, category) and optional additional information (requester's name, requester's name) to users of other mobile devices running the private broadcasting application. Send a broadcast request including current location, etc.). The broadcast request may be transmitted through a cellular network or a WiFi network. In a selectable embodiment, the broadcast request is transmitted to other users located within a predetermined range from a current location of the requestor or a location designated by the requester.

14I to 14L illustrate a user interface for a user who receives a broadcast request through a private broadcast application.

Referring to FIG. 14I , in the mobile device, the first touch screen 12 displays a map area 630b that may include at least one caster indicator 652a, 652b, 652c, 652d, 652e, 652f, 652g, 652h. While displaying and displaying the broadcast list related to the caster indicator 652a-652h on the second touch screen 12, the requester's broadcast request is received through a private broadcast application, and a request message according to the broadcast request "Please A request message window 654 including "show me B-boy events in A park" is displayed on the second touch screen 14 . The request message window 654 further includes a View key 654a and an Ignore key 654b together with the request message. As an embodiment, the request message window 654 may be displayed overlapping a broadcast list displayed on the second touch screen 14 or a discussion area displayed on the second touch screen 14 . As another embodiment, the request message window 654 may be displayed overlapping the map area 630b displayed on the first touch screen 12 or the broadcast image.

As a selectable embodiment, the private broadcast application receives the broadcast request, and the broadcast request indicator 652 indicates the location of the requester of the broadcast request on the map area 630b displayed on the first touch screen 12 . can be displayed by inserting When a predetermined touch gesture, for example, a tap gesture or touch and hold is detected on the broadcast request indicator 652 , the second touch screen 14 displays a request message window 654 according to the broadcast request.

The mobile device detects a predetermined touch gesture 640f, eg, a tap gesture, on the view key 654a of the request message window 654 and proceeds to FIG. 14J . Referring to FIG. 14J , the second touch screen 14 displays a broadcast request list including a broadcast request item 656 according to the broadcast request in response to detection of a touch gesture 640f. The broadcast request item 656 includes a response key 656a. The mobile device detects a predetermined touch gesture 640g on the response key 656a in the broadcast request item 656, for example, a tap gesture, and proceeds to FIG. 14K . As another embodiment, the request message window 654 of FIG. 14I may further include a response key, and the first and second touch screens 12 and 14 display a tap gesture detected on the response key in the request message window 654 . In response, the process may proceed to FIG. 14K .

Referring to FIG. 14K , the first and second touch screens 12 and 14 display first and second broadcast generation windows 660 and 662 in response to detection of a touch gesture 640g, respectively. As a selectable embodiment, the first and second broadcast generation windows 660 and 662 may be located on any one of the first and second touch screens 12 and 14 .

The first broadcast creation window 660 displayed on the first touch screen 12 is a mode selection area for selecting any one of a scene mode, a caster mode, and a mixed mode. and 660a, 660b, and 660c. The second broadcast creation window 662 displayed on the second touch screen 14 includes a title input area 662a for receiving a broadcast title, a category selection area 662b for selecting a broadcast category, a completion key 662c and and at least one of a cancel key 662d. Here, the scene mode means a mode for broadcasting a scene image taken through the rear camera 26 of the mobile device, and the caster mode means a mode for broadcasting a caster image shot through the front camera 24 of the mobile device, and , the mixed mode refers to a mode in which a caster image is combined in a scene image in a picture-in-picture (PIP) method and broadcast.

After a broadcast mode, a broadcast title, and a broadcast category are input through the first and second broadcast creation windows 660 , the mobile device detects a predetermined touch gesture 640h, as an example, a tap gesture on the completion key 662c. do. In response to the detection of the touch gesture 640h, the private broadcasting application operates at least one of the front camera 24 and the rear camera 26 according to the selected mode, and displays the activated at least one camera 24 and 26. A broadcast image generated by combining the collected images and the input information (broadcast mode, broadcast title, broadcast category) and optional additional information (name of the caster, current location of the caster, etc.) ) is loaded onto a radio signal according to a pre-specified transmission method and broadcast. The broadcast service data may be transmitted through, for example, a cellular network or WiFi.

Referring to FIG. 14L , in response to detection of a touch gesture 640h, the mobile device captures a broadcast image captured by at least one camera 24 or 26 on the first touch screen 12 and is generated by a private broadcast application. 664 , and discussion areas 666 and 668 in which casters and requesters of the broadcast image 664 and viewers viewing the broadcast image 664 can participate are displayed on the second touch screen 14 . The discussion areas 666 and 668 include a message display window 666 and a message input window 668 , and the message input window 668 includes a message input area 668a and a message transmission key 668b . The message input area 668a receives a message composed of text and/or a conversation icon from the user. When a tap gesture is detected on the message transmission key 668b in a state where an input message exists in the message input area 668a, the message display window 666 registers the message with the user's name (real name or private broadcasting application). marked with a nickname).

Although not shown, when a caster creates a broadcast, a caster indicator instructing broadcast by the caster may appear newly in the requester's map area 630a, and a broadcast item indicating the broadcast may be included in the broadcast list. When a tap gesture is detected on the broadcast item, the requester's first and second touch screens display a broadcast image of the broadcast by the caster and a discussion area.

14M illustrates a request and response of a broadcast through a private broadcast application. As shown, the requestor 670 may request a desired broadcast from other users within a desired area using a private broadcast application executed by his/her portable device 670b. Any one of the other users becomes a caster 672 in response to the request, and the caster 672 generates and transmits the requested broadcast using a private broadcast application executed by its portable device 672b. . The location indicator 670a of the requestor 670 and the location indicator 672a of the caster 672 may be displayed on the map area displayed on the portable devices 670b and 672b of the requestor 670 and the caster 672 .

A portable device comprising: a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, wherein the first touch screen and the second touch screen are connected by a hinge or a flexible connection unit In this case, the mobile device may recognize the movement of the first panel provided with the first touch screen and the second panel provided with the second touch screen as a command input. The movement includes, for example, a folding back and a folding hold. Here, folding includes not only folding of rigid panels, but also bending of flexible panels.

The folding back command refers to a user interface method in which the two panels are folded within the effective angle range and then unfolded again within the effective time to execute a predetermined function in the mobile device. The folding and hold command refers to a user interface method in which a predetermined function is executed in a portable device by folding the two panels within an effective angle range and maintaining them for an effective time. Hereinafter, the folding back command and the falling hold command will be described in detail with reference to the drawings.

15 is a diagram for explaining detection of a folding back command according to an embodiment of the present invention.

15( a ) shows a state before a folding back command is input to the portable device 100 , and the relative angle of the second panel 4 with respect to the first panel 2 is 180 degrees or within a predetermined range. It is close to 180 degrees. Here, for convenience, a state in which the relative angle θ is 180 degrees is illustrated, but any other relative angle may be used. As shown in FIG. 15B , the mobile device 100 has a relative angle within an effective angle range Δα, for example, a relative angle θ within a range of 200 to 210 degrees (for example, 205), it is sensed that the second panel 4 has moved relatively. And, as shown in FIG. 15( c ), the mobile device 100 moves the second panel 4 in the opposite direction to the direction in which it entered the effective angle range within the effective time (for example, 1 second), Detects that the angle is out of the valid angle range.

Then, a folding back command is input to the portable device 100 , and the portable device 100 executes a function according to the folding back command.

As an embodiment, the folding back command may be regarded as input as long as the relative angle between the two panels 2 and 4 is out of the effective angle range in the direction opposite to the entered direction within the effective time. It is not necessary to return the second panel 4 to its original position, i.e., to the state where the relative angle θ is 180 (see Fig. 15(a) ), any value where the relative angle θ is less than 200 degrees. When the second panel 4 is moved so that a folding back command is input. In addition, in FIG. 15( c ), the second panel 4 is moved in the opposite direction to the entered direction to out of the effective angle range, but instead of moving the second panel 4 in the state of FIG. 15( b ) Even if the first panel 2 is moved downward so that the relative angle between the first panel 2 and the second panel 4 becomes an arbitrary value less than 200 degrees, a folding back command can be input. That is, regardless of which panel is moved, if the relative angle of the first panel 2 and the second panel 4 enters the effective angle range and then only deviates in the opposite direction to the entered direction, a folding back command is input. .

Here, the effective angle range means the range of the relative angle between the two panels 2 and 4 preset by the manufacturer to recognize the folding back command. As in this embodiment, the relative angle θ is 200 degrees. It is not limited to having an angular range of 10 degrees between 210 degrees and can be set in various ranges. In addition, the effective angle range may be changed to an angle range designated by the user as necessary. That is, the portable device may allow the user to directly change the effective angle range through the environment setting menu, thereby optimizing the portable device according to the user's usage pattern.

In addition, the effective time is a time interval preset by the manufacturer for recognizing the folding back command, and is calculated from the time when the relative angle between the two panels 2 and 4 enters within the effective angle range. In the present embodiment, the effective time taken to unfold again, counting from when the two panels 2 and 4 are folded within the effective angle range, is exemplified as 1 second, but the effective time can be variously set to be larger or smaller than this. Similarly, the mobile device may be configured to allow the user to set a desired time as the effective time so that the mobile device can be optimized according to the user's usage pattern.

In the above embodiment, the folding back command has been described using parameters such as the effective angle range and the effective time, but the present invention is not limited thereto. In another embodiment, the portable device performs the folding back command without using the effective angle range. can be entered. That is, after changing the relative angle between the two panels by moving at least one of the two panels in a first direction, at least one of the two panels is moved in a second direction substantially opposite to the first direction within a predetermined time. When the relative angle between the two panels is returned to the original angle (or an angle that is close to the original angle within a predetermined range) by moving to , the mobile device may recognize that a folding back command has been input.

The aforementioned folding back command may be subdivided according to the presence or absence of an additional input. As shown in FIG. 15(b'), after the second panel 4 moves in the first direction and the relative angle enters the effective angle range Δα, the first and/or second touch screen is displayed within the effective time. Detects a user's touch gesture or an additional input of pressing at least one physical button 5, 5', and the second panel 4 moves in a second direction opposite to the first direction so that the relative angle is valid If the angle is out of range, the portable device may recognize it as an input of a folding back command in which a function different from the aforementioned folding back command is performed. That is, the folding back command in which the two panels 2 and 4 are folded and unfolded is a single folding back command without additional input by the user within the effective time (Fig. 15a 15b 15c), and the addition by the user within the effective time It is divided into a folding back combination command (FIG. 15a15b'15c) with input (touch on the screen or press of a physical button). Since the portable device is configured to execute different functions for the folding back single command and the folding back combined command, it is possible to perform the subdivided folding back command.

16 is a diagram for explaining detection of a folding hold command according to an embodiment of the present invention.

FIG. 16( a ) shows a state before a folding and hold command is input to the portable device 100 , and the relative angle θ of the second panel 4 with respect to the first panel 2 is 180 degrees or a predetermined It is close to 180 degrees within the range. Here, a state in which the relative angle θ is 180 degrees is illustrated for convenience, but any other relative angle state may be used. As shown in FIG. 16B , the mobile device 100 has a relative angle within an effective angle range Δα, for example, a relative angle θ within a range of 200 to 210 degrees (eg, 205). ), it is sensed that the second panel 4 has moved relatively. And, as shown in FIG. 15( c ), when the relative angle maintains the effective angle range for an effective time (eg, 0.5 seconds), it is determined that the folding hold command has been input, and the folding hold command function according to the

Here, the effective angle range and effective time may be preset by the manufacturer or designated by the user as described above.

Like the folding back command, the folding hold command may be subdivided according to the presence or absence of an additional input. As shown in FIG. 16(b'), after the second panel 4 moves so that the relative angle is within the effective angle range Δα, the first and/or second touch screen is displayed while the relative angle is maintained for the effective time. When a user's touch gesture is detected or an additional input of pressing at least one of the physical buttons 5 and 5' is detected, the mobile device recognizes it as an input of a folding hold command that performs a function different from the aforementioned folding and hold command can do. That is, the folding hold command in which the relative angle after the two panels 2 and 4 is folded is maintained for the effective time within the effective angle range is a single folding hold command without additional input by the user within the effective time (Fig. 16a 16b 16c). ) and a folding hold combination command (FIG. 16a16b'16c) with additional input by the user within the effective time. The portable device is configured such that the folding-and-hold single command and the folding-and-hold combined command execute different functions, so that the subdivided folding-and-hold command can be executed.

The folding-and-hold command may be configured to execute a function in which a continuous operation is performed in a predetermined application, for example, a function such as zoom in/out, fast play, rewind, and the like. When the function by the folding and hold command (single command or combination command) is being executed, as shown in Fig. 16(d), the relative angle between the first panel 2 and the second panel 4 is within the effective angle range. It may be configured to stop the function by the folding hold command when it is out of the . Here, the portable device may be configured to stop the function being executed as long as the relative angle between the two panels is out of the effective angle range in any direction regardless of the direction in which the two panels entered the effective angle range.

The portable device includes a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, and at least one of the first touch screen and the second touch screen can be folded or bent. When provided on the panel of , the clipboard function may be supported by a folding back command input by the touch screen display device. In a portable device having a computing function, objects cut or copied by a copy or copy command (text, image, sound, etc.) are stored in an area called a clipboard. The clipboard stores the objects until a paste command from the clipboard is inputted or deleted from the clipboard, and the objects are visually displayed and provided in response to a predetermined command.

17 (including FIGS. 17A to 17K ) illustrates a user interface for a clipboard function according to an embodiment of the present invention.

Referring to FIG. 17A , the relative angle between the first panel 2 provided with the first touch screen 12 and the second panel 4 provided with the second touch screen 14 is substantially 180 degrees (hereinafter referred to as the second panel 4 ). 1 relative angle), the first touch screen 12 displays the first application 702 , and the second touch screen 14 displays the second application 704 . The first and second applications 702 and 704 may be any one of a home screen, an application menu, a basic application, and an application installed by a user. As an example, the first and second applications 702 and 704 may be configured to display and input an object such as text or an image. In the illustrated example, the first application 702 is a message application such as Short Messaging Service (SMS), e-mail, and Instant Messaging Service (IMS), and the second application 704 is an Internet search application. am.

Referring to FIG. 17B , in the portable device, the second panel 4 moves relative to the first panel 2 , that is, moves in the first direction, so that the first panel 2 and the second panel 4 are It detects that the relative angle between the two is changed. As an example, the second panel 4 is rotated about a hinge between the first panel 2 and the second panel 4 so that the relative angle between the first panel 2 and the second panel 4 is 180 It becomes an angle (hereinafter referred to as a second relative angle) within a predetermined range (200 degrees to 210 degrees as an example) exceeding the degree. In the mobile device, within a predetermined effective time after the relative angle between the first and second panels 2 and 4 becomes the second relative angle, the second panel 4 moves relative to the first panel 2, i.e. It is sensed that the relative angle between the first panel 2 and the second panel 4 becomes the first relative angle (or substantially the first relative angle) by rotating in the second direction opposite to the first direction, and folding back It is determined that the command 700 has been input. As described above, the folding back command 700 is sensed when the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are slightly folded outward and then unfolded again. .

Referring to FIG. 17C , in response to the folding back command 700 , the mobile device moves to a predetermined area of the first and/or second touch screens 12 and 14 , for example, on the right side of the second touch screen 14 . The clipboard 710 is displayed.

The clipboard 710 is an area for storing and displaying objects 710a, 710b, 710c, 710d, and 710e cut or copied by a cut or copy command. The original text, image, and sound of each object 710a to 710e are displayed in the form of a simplified (or miniaturized) image or icon. As an example, each object 710a to 710e in the clipboard 710 may be displayed together with a date and time derived from the original.

Although not shown, if the folding back command is input again while the clipboard 710 is being displayed, the second touch screen 14 may remove the clipboard 710 . The second touch screen 14 then displays the original second application 704 again.

Referring to FIG. 17D , the mobile device displays any one of the objects displayed by the first or second applications 702 and 704 on the first or second touch screens 12 and 14, that is, texts or images ( The touch gesture 700a moving to a position (hereinafter referred to as a first position) in the clipboard 710 on the 706 , as an example, detects a touch drag, and proceeds to FIG. 17E . Referring to FIG. 17E , in response to sensing the touch gesture 700a , an object 710f that is a copy of the object 706 is included in the clipboard 710 . The clipboard 710 may display the object 710f at the first position in the form of a simplified image or a symbol of an icon. As the object 710f newly enters the clipboard 710 , objects displayed in the clipboard 710 may be rearranged including the newly entered object 710f.

Referring to FIG. 17F , the mobile device performs a touch gesture 700b in a direction in which objects 710a , 710b , 710c , 710d and 710e are arranged in the clipboard 710 , as an example, flick up/down or touch drag. Up/down is sensed, and objects included in the clipboard 710 are displayed while scrolling in an upper direction or a lower direction in response to the touch gesture 700b.

Referring to FIG. 17G , the mobile device displays a first or second touch screen ( 12 and 14), a touch gesture 700c moving to a position (hereinafter referred to as a second position), for example, a touch drag is sensed. In the illustrated example, the object 710d is "http://mobile.nytimes.com" which is the text of an Internet address, that is, a Uniform Resource Locator (URL), and an Internet search application ( 704) is dragged to the address input window. As shown in FIG. 17H , the Internet search application 704 receives the text of the object 710d as an Internet address according to a touch gesture 700c, and displays (704a) a web page corresponding to the Internet address.

Referring to FIG. 17H , the mobile device provides an example of a touch gesture 700d directed to the outside of the clipboard 710 on the boundary line between the application 704a and the clipboard 710 being displayed on the second touch screen 14 . to detect a flick or touch drag. As shown in FIG. 17I , the clipboard 710 is expanded 712 within the second touch screen 14 according to the touch gesture 700d. As an example, the touch gesture 700d starts at the border of the clipboard 710 and ends at a location (hereinafter referred to as a third location) on the second touch screen 14 outside the clipboard 710 . am. Then, the extended clipboard 712 has a horizontal length where its boundary meets the third position. As another example, the touch gesture 700d includes a flick that starts at the border of the clipboard 710 and moves in the direction of the first touch screen 12 , and the extended clipboard 712 includes the second touch screen 14 . ) has a predetermined horizontal length within the range. As the extended clipboard 712 is unfolded by the touch gesture 700d, the application 704a being displayed on the second touch screen 14 is partially or almost entirely covered by the extended clipboard 712 . can get

The expanded clipboard 712 may display more objects 712b than the clipboard 710 of its original size. As a selectable embodiment, the expanded clipboard 712 may include a menu window 712a for selecting categories of displayed objects, for example, all, text, images, and sounds. The initially expanded clipboard 712 displays objects 712b of all categories, and when a tap gesture is detected from any one category key in the menu window 712a, only objects of the corresponding category are filtered and displayed.

Although not shown, on the boundary line between the application 704a being displayed on the second touch screen 14 and the extended clipboard 712 , a touch gesture directed inward of the extended clipboard 712 , as an example, a flick Alternatively, when a touch drag is sensed, the second touch screen 14 reduces the expanded clipboard 712 to the original size of the clipboard 710 and displays it.

Also, although not shown, if a folding back command is input while the extended clipboard 712 is being displayed, the second touch screen 14 removes the extended clipboard 712 without further displaying it. Then, the original second application 704a is displayed again on the second touch screen 14 .

Referring to FIG. 17J , the mobile device is positioned on the first or second touch screens 12 and 14 on any one of the objects 712a displayed on the extended clipboard 712 ( 712c ). A touch gesture 700e moving to a fourth position (hereinafter referred to as a fourth position), as an example, senses a touch drag. In the illustrated example, the object 712c is a photo image, and is dragged to the message application 702 displayed on the first touch screen 12 according to the touch gesture 700e. As shown in FIG. 17K , the message application 702 receives a photo image 714b of an object 712c in response to release of the touch gesture 700e, and a message transmission input for transmitting the photo image 714b. A transmission key 714a for executing transmission of the window 714 and the photo image 714b is displayed 702a in the first touch screen 12 . When a tap gesture 700f is detected on the transmission key 714a, the message application 702 transmits the message including the photo image to the destination.

As a selectable embodiment, while the clipboard 710 is being displayed on the second touch screen 14 , a touch gesture directed inward of the clipboard 710 on the border of the clipboard 710 , for example, a flick or When a touch drag reaching the opposite boundary of the clipboard 710 is sensed, the second touch screen 14 removes the clipboard 710 . In other words, the non-expanded clipboard 710 may be removed from the second touch screen 14 by a touch gesture or a folding back command.

A portable device comprising a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, wherein the first touch screen and the second touch screen are at least one foldable or bendable When provided on the panel of , the e-book function may be supported by a folding back command input by the touch screen display device.

18 (including FIGS. 18A to 18P) illustrates a user interface for an e-book function according to an embodiment of the present invention.

Referring to FIG. 18A , the relative angle between the first panel 2 provided with the first touch screen 12 and the second panel 4 provided with the second touch screen 14 is substantially 180 degrees (hereinafter referred to as the second panel 4 ). 1 (referred to as a relative angle), the first touch screen 12 displays the first page 802a provided by the e-book application and the border lines 802 of previous pages, and the second touch screen 14 indicates the border lines 804 of the second page 804a and subsequent pages provided by the e-book application. The first and second pages 802a and 804a include text and/or illustrations of the same e-book content.

As an example, the border lines 802 and 804 may have different widths and intervals according to the amount of previous pages and subsequent pages, respectively. For example, if the currently displayed pages are 20-40% of the e-book content, the border lines 802 of the previous pages are 1 cm, and the border lines 804 of the subsequent pages are 2 cm, and the currently displayed pages are the e-book content. At 40-60% of the point, the border lines 802 of the previous pages are 1.5 cm, the border lines 804 of the subsequent pages are 1.5 cm, and the currently displayed pages are the 60-80% point of the e-book content. In this case, border lines 802 of previous pages are 2 cm, and border lines 804 of subsequent pages are 1 cm. ) is 2.5 cm, and the border lines 804 of subsequent pages are indicated by 0.5 cm.

In another embodiment, in a state in which the first and second panels 2 and 4 are unfolded, border lines 802 and 804 corresponding to previous and subsequent pages are hidden, and one of the first and second panels 2 and 4 is hidden. The corresponding border lines 802 and 804 are displayed when is folded slightly inward and maintained for a predetermined effective time. When the second panel 4 is folded slightly inward as an example, such that the relative angle as an example is greater than or equal to 180 degrees and less than 210 degrees, the second touch screen 14 is displayed on the right side of the second page 804a being displayed. Border lines 804 are displayed on the . When the second panel 4 is folded more, for example, the relative angle is greater than or equal to 210 degrees and less than 230 degrees, the border lines 804 are expanded to have a wider width or spacing corresponding to the relative angle. can Similarly, when the first panel 2 is folded slightly inward, for example, a relative angle of 180 degrees or more and less than 210 degrees, the first touch screen 12 is displayed on the left side of the first page 802a being displayed. Lines 802 are indicated. When the first panel 2 is folded more, for example, so that the relative angle is greater than or equal to 210 degrees and less than 230 degrees, the border lines 802 are expanded and displayed to have a wider width or spacing corresponding to the relative angle. can As a selectable embodiment, when the first and second panels 2 and 4 are unfolded again, the border lines 802 and 804 can be removed from the first and second touch screens 12 and 14 .

When the mobile device detects a predetermined touch gesture 800a directed in the direction of the first touch screen 12 within the second touch screen 14, for example, a flick or a touch drag, proceeds to FIG. 18B .

As shown in FIG. 18B , the first and second touch screens 12 , 14 , in response to sensing the touch gesture 800a , display the third and third subsequent pages 802a , 804a followed by the first and second pages 802a and 804a. 4 pages (802b, 804b) are replaced and displayed. In this case, the third and fourth pages 802b and 804b may be displayed while showing a three-dimensional graphic effect in which the bookshelf of the second page 804a is turned over. After the second page 804a is turned over, the border lines 802 and 804 of the pages before and after the third and fourth pages 802b and 804b are still displayed.

Referring to FIG. 18B , in the mobile device, the second panel 4 is moved relative to the first panel 2 , that is, moved in the first direction, so that a space between the first panel 2 and the second panel 4 is formed. Detect a change in relative angle. As an example, the second panel 4 is rotated about a hinge between the first panel 2 and the second panel 4 so that the relative angle between the first panel 2 and the second panel 4 is 180 It becomes an angle (hereinafter referred to as a second relative angle) within a predetermined range (200 degrees to 210 degrees as an example) exceeding the degree. Thereafter, the mobile device moves the second panel 4 relative to the first panel 2 within a predetermined effective time after the relative angle between the first and second panels 2 and 4 becomes the second relative angle, That is, it moves in a second direction opposite to the first direction, detects that the relative angle between the first panel 2 and the second panel 4 becomes the first relative angle (or substantially the first relative angle) again, and folds. It is determined that the back command 800b has been input.

Referring to FIG. 18C , the mobile device attaches to at least some of the borders 804 of the borders 804 of the pages after the fourth page 804b being displayed on the second touch screen 14 in response to the folding back command 800b. displayed tags 806 . Each tag 806 is positioned on a border line of a page designated by a user or a provider of e-book content, and may have different colors visually differentiated from the pages 802b and 804b and the border lines 804 . As a selectable embodiment, each tag 806 may be attached to a border line of a page including a memo or highlighted item designated by the user or the provider of the e-book content. Although not shown, when a touch gesture, for example, a tap gesture, is detected on the first tag, which is any one of the tags 806 , the mobile device executes a graphic effect in which bookshelves are turned, and the page to which the first tag is attached Two pages including , are displayed on the first and second touch screens 12 and 14 . As an optional embodiment, the tags 806 may be removed when the foldback command is re-entered.

Referring to FIG. 18D , the mobile device performs a predetermined touch gesture ( 800c), as an example, a touch or touch and hold is sensed. The second touch screen 14 changes the first border line 808 to a color (a first color, for example, red) visually distinguishable from other border lines in response to the detection of the touch 800c. In this case, a page indicator 808a indicating "P105", for example, a page number on which the first border line 808 is located, may be displayed on the first edge line 808 .

Referring to FIG. 18E , while the touch 800c is held, it moves in a direction intersecting the edge lines 804 and is released 800d from the second edge line 808b in the edge line area 804 . Accordingly, when touch drags 800c and 800d from the first edge line 808 to the second edge line 808b are sensed, the second touch screen 14 sets the second edge line 808b to the first color. change In this case, a page indicator 808c indicating "P51", for example, a page number at which the second border line 808b is positioned, may be displayed on the second edge line 808b.

Referring to FIG. 18F , the mobile device detects that the touch 800c is released 800d, and the third and fourth pages 802b are displayed on the first and second touch screens 12 and 14, 804b) is replaced with fifth and sixth pages 802c and 804c including pages on which the second border line 808b is positioned and displayed. At this time, the fifth and sixth pages 802c and 804c are displayed while showing a graphic effect in which the bookshelves between the third and fourth pages 802b and 804b and the fifth and sixth pages 802c and 804c are continuously turned over. can Also, border lines 802 and 804 of the pages before and after the fifth and sixth pages 802c and 804c are still displayed.

Referring to FIG. 18F , the second touch screen 14 may highlight and display the first item (text or illustration) 810 among items included in the sixth page 804c. The highlighted first item 810 may be designated by a user or a provider of e-book content, and may be displayed together with an indicator 810a indicating a designated date/time.

Referring to FIG. 18G , the mobile device detects a touch drag 800e moving along the second item 810b among items included in the sixth page 804c on the second touch screen 14, and the touch drag ( 800e), the second item 810b is highlighted and displayed with a specified color.

Referring to FIG. 18H , the mobile device detects that the touch drag 800e is released, and is a menu serving as a soft menu for controlling the highlight function at the position where the touch drag 800e is released, that is, at the end of the second item 810b. A bar 812 is displayed. As an example, the menu bar 812 includes a highlight key 812a for selecting or controlling highlighting, a color key 812b for changing a highlight (or text) color, and a memo key for attaching a memo. (812c). When a predetermined touch gesture 800f, for example, a tap gesture is detected on the memo key 812c, the flow proceeds to FIG. 18I.

Referring to FIG. 18I , the mobile device displays a memo input window 814 on the second touch screen 14 in response to detection of a touch gesture 800f on the memo key 812c. As an example, the memo input window 814 includes at least the contents of the second item 810b selected by the touch and drag 800e and allows an editing function by the user. When a tap gesture is detected on the done key included in the memo window 814 , as shown in FIG. 18J , the second touch screen 14 displays the second item input and edited by the memo input window 814 . A memo window 814a including the contents of 810b is displayed at a predetermined position. The memo window 814a has a smaller size than the memo input window 814 , and includes some or reduced content of the content input through the memo input window 814 , and simplifies the memo input window 814 . It may have one shape. Also, the same tag as the highlight color of the corresponding second item 810b may be attached to the memo window 814a. As a selectable embodiment, when the memo window 814a is displayed, a tag having the same color as that of the memo window 814a may be attached to the border line of a page including the memo window 814a.

Referring to FIG. 18K , the second touch screen 14 displays one or more memo windows 814a and 814b including items selected by the user in the sixth page 804c. Referring to FIG. 18K , the mobile device starts on the memo window 814b and is released from a position (first position) outside the memo window 814b within the first and second touch screens 12 and 14 (800g). ) may be displayed by moving the memo window 814b to the first position. In the illustrated example the first location is located within the first touch screen 12 . Similarly, referring to FIG. 18L , the mobile device moves the memo window 814a to the second position in response to a touch drag 800h directed to a position (second position) outside the memo window 814a on the memo window 814a. can be displayed.

Referring to FIG. 18M , while the mobile device is displaying pages 802c and 804c on the first and second touch screens 12 and 14 , the first and second panels 2 and 4 are folded outward. It senses that the second panel 4 moves relative to the first panel 2, that is, moves in the first direction, so that the relative angle between the first panel 2 and the second panel 4 is changed. . As an example, the second panel 4 is rotated about a hinge between the first panel 2 and the second panel 4 so that the relative angle between the first panel 2 and the second panel 4 is 180 It becomes an angle (hereinafter referred to as a second relative angle) within a predetermined range (200 degrees to 210 degrees as an example) exceeding the degree. When the relative angle between the first and second panels 2 and 4 becomes the second relative angle and the second relative angle is maintained beyond a predetermined effective time, the portable device determines that the folding and hold command 800i has been input. .

In response to the folding-and-hold command 800i, the mobile device has a graphic effect ( 816), that is, displaying a moving image. Here, each bookcase may be displayed across both sides of the first and second touch screens 12 and 14 when moving from the second touch screen 14 to the direction of the first touch screen 12 .

Referring to FIG. 18N , while displaying the graphic effect 816 in which the bookshelves are continuously turned according to the folding and hold command 800i, the portable device causes the second panel 4 to be relatively moved with respect to the first panel 2 Detecting that the relative angle between the first panel 2 and the second panel 4 becomes the first relative angle (or substantially the first relative angle) again by moving, that is, moving in a second direction opposite to the first direction, and , it is determined that the folding-and-hold command 800i is released and the folding-back command 800j is input.

Referring to FIG. 18O , in response to the detection of the folding back command 800j, the mobile device terminates the graphic effect 816 in which the bookshelves are turned, and displays new pages 802d and 804d in which the bookshelf is not turned over first and It is displayed on the second touch screen (12, 14). The aforementioned continuous page turning function may be executed at different speeds depending on the relative angle between the first and second panels 2 and 4 while the folding and hold command 800i is maintained. As an example, the relative angle range is subdivided into four angle ranges, and when the second relative angle is within the first angle range, the 1x speed page turning function is executed backwards, and when the second relative angle is within the second angle range, the second relative angle is within the second angle range. When the 2x speed page turning function is executed, when the second relative angle is within the 3rd angle range, the 1x speed page turning function is executed, and when the second relative angle is within the 4th angle range, the 2x speed page turning function is performed forward is executed

Referring to FIG. 18O , the mobile device performs a predetermined touch gesture 800k, as an example, a touch on any of the current pages 802d and 804d being displayed on the first and second touch screens 12 and 14 . If an and hold is sensed, the flow proceeds to FIG. 18P.

As shown in FIG. 18P , the mobile device displays the e-book setting menu 818 in predetermined areas within the first and second touch screens 12 and 14 in response to the detection of the touch gesture 800k. As an example, the e-book setting menu 818 may be displayed in a translucent state on top of the current pages 802d and 804d, and soft keys 818a and chapter for font change, index, text input, etc. list 818b.

As an example, the chapter list 818b includes chapter numbers constituting the e-book content and a current chapter indicator 820 indicating the position of the current chapter. When a tap gesture 800l is detected on a first chapter number that is any one of the chapter numbers on the chapter list 818b, the mobile device responds to the detection of the tap gesture 800l to the first and second touch screens 12, 14), first pages (not shown) of the first chapter corresponding to the first chapter number may be displayed.

As another embodiment, the chapter list 818b does not require input of a touch gesture, and may always be displayed at the top or bottom of the first and second touch screens 12 and 14 .

The portable device may support a video conference application of a separate work environment through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. Participants in the video conference can join the video conference by connecting a group call.

19 (including FIGS. 19A to 19G) illustrates a user interface of a video conferencing application according to an embodiment of the present invention.

Referring to FIG. 19A , the first touch screen 12 includes an attendee list area 902a related to a first video conference among a plurality of video conferences that may be provided by a video conference application, a basic information area 902b and At least one of a Conference Restart key 902c and a Create New Conference key 902d is indicated. The participant list area 902a includes names (or nicknames) and photo images (which may be thumbnails) of participants including users of mobile devices. The basic information area 902b includes a meeting date, for example "Tuesday 16 Nov 2010", meeting start and end (scheduled) times, for example "15:00" and "16:37", and a document file used for the meeting. name, for example, at least one of "Dual Display.ppt". The conference restart key 902c is a soft key used to request or notify participants to restart the first video conference when the first video conference is temporarily suspended. The new conference creation key 902d is a soft key used to create a new video conference.

The second touch screen 14 displays a video conference list 904 listing at least some of the conference items representing video conferences that may be provided by the video conference application. Each meeting item included in the video conference list 904 includes at least one of a title, a start time, a host, the number of attendees, and a running time of the video conference. In addition, the second touch screen 14 includes a keypad key 904a for calling a virtual keypad, a Favorites key 904b for selecting only frequently visited video conferences, and a contact key 904c for calling a contact. At least one of them may be further displayed. Although not shown, when a tap gesture is detected on the meeting item of the second video conference among the meeting items displayed on the second touch screen 14 , the mobile device displays the first image displayed on the first touch screen 12 . The information related to the conference 902a, 902b is replaced with information related to the second video conference and displayed.

When the mobile device detects a predetermined touch gesture 900a, for example, a tap gesture, on the meeting restart key 902c of the first touch screen 12, it proceeds to FIG. 19B.

Referring to FIG. 19B , in response to detection of the touch gesture 900a , the mobile device displays a participant list area 906 , which expands the participant list area 902a of the first video conference, on the first touch screen 12 . and display a shared board area 908 for the first video conference on the second touch screen 14 . The attendee list area 906 includes the user himself, the names (or nicknames) and photo images of the connected attendees including "ME", each photo image having a larger size than the photo image in the attendee list area 902a. can As a selectable embodiment, attendee list area 906 may provide more information about each attendee than attendee list area 902a.

Additionally, the first touch screen 12 includes a participant add key 906a for adding a new participant, a microphone off key 906b for turning off the microphone, and a call end key 906c for ending the video conference or exiting the video conference. ) and at least one of them. The shared board area 908 displays the contents of a document file registered to be used for the first video conference, for example, "Atomic Structure.ppt" according to a default setting. The second touch screen 14 scrolls up/down the content of the document file being displayed in response to detection of a touch gesture, for example, a flick up/down or a touch drag up/down on the sharing board area 908 . . Additionally, the second touch screen 14 may further display a whiteboard key 908a for selecting the shared board area 908 to be used as the whiteboard area.

When the mobile device detects a tap gesture as a predetermined touch gesture 900b on the attendee add key 906a of the first touch screen 12, it proceeds to FIG. 19C.

Referring to FIG. 19C , in response to detection of the touch gesture 900b , the mobile device displays a contact window 910 including a list of persons on the contact who can participate in the first video conference on the first touch screen 12 . The contact window 910 includes a person list 910a including a person name and check box of each person, an additional key 910b and a cancel key 910c. When a check box for at least one person in the person list 910a, as an example, "Jae" is checked, and a touch gesture 900c, as an example, a tap gesture is detected on the additional key 910b, the mobile device is shown in FIG. 19D proceed with Referring to FIG. 19D , the mobile device includes, as a new participant, the person designated in the contact window 910 , the name of "Jae", and a photo image on the first touch screen 12 in response to the detection of the touch gesture 900c. A participant list area 906d is displayed.

When a predetermined touch gesture 900d, for example, a tap gesture is detected on the whiteboard key 908a displayed on the second touch screen 14, the mobile device proceeds to FIG. 19E.

Referring to FIG. 19E , in response to detecting the touch gesture 900d , the mobile device replaces the document file being displayed on the shared board area 908 of the second touch screen 14 with the whiteboard area 912 . to indicate The white board area 912 allows input of freehand drawing objects by a user's touch, and freehand drawing objects 912a, 912b, and 912c input by each of the participants of the first video conference including the user. ) is indicated. The hand-drawing objects 912a, 912b, and 912c refer to graphic data in the form of text or images input by each participant through a whiteboard area provided to each participant.

Each of the hand-drawn objects 912a, 912b, and 912c preferably has a different color for each participant. While the whiteboard area 912 is displayed, on each photo image included in the attendee list area 906d of the first touch screen 12, a color indicator indicating the color of the corresponding handwriting object 912a, 912b, 912c (912f) is displayed. A color indicator of a participant who is inputting a hand-drawn object in the white board area 912 may be displayed by blinking. Additionally, the whiteboard area 912 may include keys 912d and 912e for inputting and deleting handwriting by the user.

While the white board area 912 is displayed, the second touch screen 14 further displays a document file selection key 908b for displaying a document file in the shared board area. When a tap gesture is detected on the document file selection key 908b, the second touch screen 14 replaces the whiteboard area 912 with a document file and displays it.

When the first touch screen 12 and the second touch screen 14 of the portable device are provided on at least one panel that can be folded or bent, the portable device supports a video conferencing application in an out-folded screen mode. can

Referring to FIG. 19F , while the video conference application is being displayed on the first and second touch screens 12 and 14 , the mobile device displays the first panel 2 provided with the first touch screen 12 as the second By moving relative to the panel 4, it is detected that the relative angle between the first panel 2 and the second panel 4 is less than 180 degrees, and it is determined that the fold-out command 900e has been input. As an example, the first panel 2 is rotated around a hinge between the first panel 2 and the second panel 4 so that the relative angle between the first panel 2 and the second panel 4 is 180 When the angle falls within a predetermined range (for example, 30 degrees to 60 degrees) that is less than degrees, the portable device determines that the fold-out command 900e is input.

In response to detecting the fold-out command 900e, the mobile device displays the information on the second touch screen 14 by replacing it with the attendee list area 906e and the shared board area 912f. At this time, it is preferable that the first touch screen 12 moved backwards is turned off. The attendee list area 906e and the shared board area 912f have smaller sizes than the attendee list area 906d and the shared board area 912 before the fold-out command 900e. Additionally, the second touch screen 14 displays the attendee list selection key 914a, which can enlarge and show the attendee list on the second touch screen 14, and the sharing board area 912f on the second touch screen 14. At least one of a shared board selection key 914b, a microphone off key 914c, and a call end key 914d that can be selected is further displayed. The first touch screen 12 may be turned off in response to the fold-out command 900e, or may display information such as a clock according to an option that may be designated by a user.

When the tap gesture 900f is detected on the participant list selection key 914a, the mobile device proceeds to FIG. 19G .

Referring to FIG. 19G , the mobile device expands and displays the attendee list area 906f on the second touch screen 14 in response to the detection of the tap gesture 900f. The attendee list area 906f includes photographic images of an expanded size than the attendee list area 906e of FIG. 19F . Additionally, the second touch screen 14 further displays at least one of an attendee list selection key 914a, a shared board selection key 914b, a microphone off key 914c, and a call end key 914d.

Although not shown, when a tap gesture is detected on the shared board selection key 914b, the mobile device displays a shared board area including a document file or a whiteboard area on the second touch screen 14, along with the shared board area. A simple participant list may be displayed by listing only names without a photographic image or by listing a smaller photographic image and names as an example.

A mobile device is an application that requires interaction by two or more users through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable, for example, a collaborative game application can be supported. The collaborative game application can be usefully used in an out-folded screen mode in which two panels equipped with two touch screens are almost folded outward so that the two touch screens face each other in almost opposite directions. In other words, the folded-out mobile device is set up in a triangular shape, the front touch screen is used as the main touch screen that provides a user interface for the owner of the mobile device, and the rear touch screen is used as a sub touch screen displayed for other users. can That is, the rear touch screen provides information for owners of other mobile devices running the linked collaborative game application.

20 (including FIGS. 20A to 20H) illustrates a user interface of a cooperative game application according to an embodiment of the present invention. Here, the arrangement of the touch screen when the mobile device is rotated 90 degrees to the left is shown, and the first touch screen 12 located at the bottom before being folded-out provides a user interface for users with the mobile device It will be described that the main touch screen, that is, the front touch screen, and the second touch screen 14 located at the top becomes the sub touch screen, that is, the rear touch screen, shown for other users. Of course, the same description applies even when the mobile device is rotated 90 degrees to the right.

Referring to FIG. 20A , the first touch screen 12 displays a game preparation screen 1002 provided by the collaborative game application, and the second touch screen 14 is turned off or folded-out. out) to display the guide phrase 1000 to request. As an embodiment, when a collaborative game application supporting an out-folded screen mode is executed on a mobile device, the collaborative game application includes panels 2 and 4 provided with first and second touch screens 12 and 14 . Make sure it is folded-out. If it is sensed that the panels 2 and 4 are not folded-out, the collaborative game application prompts the second touch screen 14 to fold-out a guide message 1000 , for example "Please fold" the phone" is displayed.

The game ready screen 1002 displayed on the first touch screen 12 includes participant identification areas 1002a, 1002b, 1002c, 1002d for participants of the game, including a user with a mobile device, for selecting game ready. and a preparation key 1002e for Each participant identification area 1002a, 1002b, 1002c, 1002d includes a photo image, name (or nickname), and possession amount of each participant. As an embodiment, the cooperative game application is a poker game application, and the game preparation screen 1002 has a shape in the shape of a physical table on which a poker game can be played. In addition, the first touch screen 12 may further display a chat area 1004 including a chat input window 1004a for participants and participants. When a tap gesture is detected within the chatting input window 1004a, the second touch screen 14 is located in a predetermined area, for example, a lower part of the chatting area 1004 or a lower part of the second touch screen 14. Display the virtual keypad.

When a predetermined touch gesture 1000a, for example, a tap gesture is detected on the ready key 1002e of the first touch screen 12, the mobile device proceeds to FIG. 20B .

Referring to FIG. 20B , the mobile device determines that the user has become "Ready" in response to the detection of the tap gesture 1000a, and displays a status indicator "Ready" on the user's participant identification area 1002a, , and also notifies the mobile devices of other participants participating in the game that the user has become "Ready" using a predetermined communication means. In other words, the mobile devices of all participants run the poker game application and interwork with each other, notify other participants of information generated by each participant's poker game application, and receive and display information generated from the other participant's poker game application can do. When all participants are in the "Ready" state, the mobile device proceeds to FIG. 20C to start a round of poker game.

As shown in FIG. 20C , when a poker game of one round is started, the mobile device displays a game interface screen 1006 for the user of the mobile device on the first touch screen 12 . As an example, the game interface screen 1006 of the first touch screen 12 includes a chat area 1006a that receives a user's chat message and displays chat messages of the user and other participants, and plays cards given to the user. A holding card area 1006b to show, a betting amount area 1006c displaying the amount bet on the poker game of the current round, a holding amount area 1006d displaying the user's holding amount and not provided to participants and a card slot area 1006e representing a card pool containing cards flipped over.

Also, when a poker game of one round is started, the mobile device displays game information 1008 for other participants on the second touch screen 14 . As an example, the game information 1008 for other participants of the second touch screen 14 includes a user identification area 1008a, a betting display area 1008b displaying a betting term selected by the user, and , an open card area 1008c displaying cards that the user has selected to show to other users, a holding amount area 1008d displaying the user's holding amount, and a card slot area displaying card pools not provided to participants ( 1006e).

As an optional embodiment, the mobile device displays the first and second touch screens 12 and 14 while displaying the announcement 1002a requesting to fold-out on the second touch screen 14 by the poker game application. When the provided panels sense that they are folded outwardly (fold-out) 1000b, game information 1008 for another participant is displayed on the second touch screen 14. That is, the guide phrase 1002a on the second touch screen 14 may be displayed until the fold-out occurs, and the game information 1008 may be displayed after the fold-out occurs.

As another selectable embodiment, the poker game application activates the ready key 1002e only when the panels of the portable device are folded-out. That is, the poker game application can start the poker game only in the folded-out state, and continues to display the guide text 1002a on the second touch screen 14 until the folded-out state.

20D shows a perspective view of a portable device with folded-out panels. As shown, the mobile device is erected in a triangular shape supported by two folded-out panels, and a game interface screen 1006 for a user holding the mobile device on the front first touch screen 12 . is displayed, and game information 1008 for other participants is displayed on the second touch screen 14 on the back side. Here, the other participant means another user who is running a poker game application and has their own mobile device that is linked to the user's mobile device. 20E is a diagram illustrating participants' mobile devices that are linked to each other through a poker game application. As shown, the user's portable device displays the game interface screen 1006 for the user through the first touch screen 12 . Similarly, other participants' portable devices display game information for the corresponding participant through the front touch screen shown to each participant, and display game information 1014 for other participants through the opposite touch screen.

Referring to FIG. 20F , the mobile device sequentially withdraws and holds a predetermined number of cards from the card slot area 1006e of the first touch screen 12 in the user's first turn after a round of poker game starts. It is arranged so that the front side is visible in the card area (1010a). At the same time, the mobile device sequentially draws out the same number of cards from the card slot area 1008e of the second touch screen 14 and arranges them so that the back side is visible in the open card area 1012a. Additionally, the first touch screen 12 may display stacked coins corresponding to the current bet amount in the area 1010b. When a predetermined touch gesture 1000c, for example, a tap gesture or a flick-up, is detected on at least one of the cards disposed in the holding card area 1010a, the mobile device proceeds to FIG. 20G .

Referring to FIG. 20G , the mobile device slightly raises the card selected by the touch gesture 1000c from among the cards arranged so that the front is shown in the holding card area 1010a of the first touch screen 12 in an upward direction, , at the same time, among the cards arranged in the open card area 1012a of the second touch screen 14, a card at a position corresponding to the selected card is turned over to display, that is, open. When an open card is selected by all participants, the mobile device displays a betting command window 1010c in which betting items can be entered on the first touch screen 12 when an order determined according to the rules of the poker game is reached. do. The betting command window 1010c includes at least one of betting items for the poker game, that is, "Check", "Pin", "Call", "Raise", "Half", and "Fold". In this case, bet items that are not selectable in the current order may be displayed in an inactive state, that is, shaded.

Any one of the betting items of the betting command window 1010c displayed on the first touch screen 12, as an example, a predetermined touch gesture 1000d in "Pin", as an example, when a tap gesture is detected, the mobile device updates the game interface screen 1006 according to the bet item selected by the tap gesture 1000d, and at the same time displays the selected bet item, "Pin" in the bet display area 1008b of the second touch screen 14, , and notifies the selected betting items to the mobile devices of other participants. When all participants' bets are complete, the mobile device draws a new card from the card slot area 1006e of the first touch screen 12 and displays the front face in the holding card area 1010a, similar to FIG. 20F . At the same time, after drawing a new card from the card slot area 1008e of the second touch screen 12 and displaying the front face on the open card area 1012a, the order determined according to the rules of the poker game has been reached. When the first touch screen 12 displays a betting command window (1010c).

20H shows screens when a poker game of one round is finished. When one round of poker game is finished, the first touch screen 12 displays the open state 1016a of all the user's cards and the game result 1016b, for example, "Flush" and "Winner", and at the same time 2 The touch screen 14 displays the open state 1018a and the game result 1018b of at least some cards given to the user.

The portable device may provide a more convenient user interface for a schedule management application through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. As an example of an application for schedule management, there is a calendar application.

21 ( FIGS. 21A to 21O ) illustrates a user interface of a schedule management application according to an embodiment of the present invention.

Referring to FIG. 21A , the first touch screen 12 displays a view mode selection area 1102 for selecting a calendar view mode and a calendar area 1102a in a month mode. The schedule management application allows a schedule view mode to be selected through a month mode key, a week mode key, a day mode key, and a list mode key included in the view mode selection area 1102 . In one embodiment, the schedule management application displays the calendar area 1102a in month mode by default at startup, that is, the days of the current month including today's date. The calendar area 1102a in the month mode is composed of day blocks corresponding to days constituting the selected month, and may include some day blocks of the previous month and the following month. As an example, one block constitutes rows corresponding to a week and columns corresponding to a day of the week. Among the blocks, one block corresponding to today's date may be displayed in a predetermined color to be visually distinguished. A date indicator 1106a indicating a date selected by a user is disposed in one of the blocks, and the date indicator 1106a may be, for example, in the form of a rectangle with a thick line surrounding the number of the selected date. At the start of the calendar application, the date indicator 1106a is displayed on the day block of today's date.

While the first touch screen 12 is displaying the calendar area of the month mode, week mode, day mode or list mode, the second touch screen 14 may display other applications according to the setting of the schedule management program or the user's selection. can be displayed, or information of the schedule management program can be displayed. 21A illustrates an example of displaying information provided by the schedule management program on the second touch screen 14 .

Referring to FIG. 21A , the second touch screen 14 displays an event list 1104a including event items registered for the selected date in the calendar area 1102a. Each event item may represent an event registered on the selected date or an event registered in a period including the selected date. As another embodiment, in the month mode, the event list 1104a of the second touch screen 14 may include event items registered for the month of the calendar area 1102a. Each event item includes at least one of an event title, event date(s), event time, and event-related image/icon. In addition, the first or second touch screens 12 and 14 display a new event generating key 1104 for registering a new event at a predetermined position. As an example, the new event creation key 1104 is disposed at the bottom of the event list 1104a of the second touch screen 14 .

When a predetermined touch gesture 1100a, for example, a tap gesture, is detected at any one date, for example, "16", in the calendar area 1102a of the first touch screen 12, the mobile device proceeds to FIG. 21B do.

Referring to FIG. 21B , in response to detecting the tap gesture 1100a , the mobile device displays a date indicator 1106b on the date selected by the touch gesture 1100a in the calendar area 1102a of the first touch screen 12 . and displays an event list 1104b including event items registered for the selected date on the second touch screen 14 .

While the calendar area 1102a is being displayed on the first touch screen 12, a menu button that is one of the physical buttons disposed under the first touch screen 12 is selected, as an example, a touch gesture 1100b ) is detected, the mobile device displays the first menu window 1104c on the lower portion of the first touch screen 12 in response to the detection of the touch gesture 1100b. The first menu window 1104c includes a creation key for creating a new event, a Go to key for moving to a selected date, a today key for moving to today's date, and a search key for searching for a desired event. and at least one of a deletion key for deleting a registered event and a setting key for changing a setting of a schedule management application. The first menu window 1104c may be called by a touch of a menu button while the calendar area of the month mode, the week mode, the day mode, or the list mode is being displayed on the first touch screen 12 .

While the event list 1104b is being displayed on the second touch screen 12, selection of a menu button, which is one of the physical buttons disposed under the second touch screen 14, as an example, a touch gesture 1100d ) is detected, the mobile device displays the second menu window 1104d on the lower portion of the second touch screen 14 in response to the detection of the touch gesture 1100c. The second menu window 1104d includes at least one of a search key for searching for a desired event and a delete key for deleting a registered event. The second menu window 1104d may be called by a touch of a menu button while an event list is being displayed on the second touch screen 14 .

When a tap gesture 1100d is detected on the main mode key included in the view mode selection area 1102 of the first touch screen 12, the mobile device proceeds to FIG. 21C .

Referring to FIG. 21C , in response to the detection of the tap gesture 1100d, the mobile device displays a calendar area 1102c in the main mode including today's date (or the selected date) on the first touch screen 12, An event list 1104e including registered event items for the selected date of the calendar area 1102c or the week of the calendar area 1102c is displayed on the second touch screen 14 . The calendar area 1102c in the week mode includes a week display line indicating the selected week, for example, "3nd week Jan, 2009", and the days of the selected week, for example S11, M12, T13, W14, T15, T16, T17. and hour blocks representing the hourly schedule for each date. That is, the calendar area 1102c in the week mode is composed of columns corresponding to days of the week and rows corresponding to times. The first letter of the alphabet of each day represents the day of the week. Each time block may be displayed with a predetermined color when there is an event registered for that time.

When a tap gesture 1100e is detected on one mode key included in the view mode selection area 1102 of the first touch screen 12 , the mobile device proceeds to FIG. 21D .

Referring to FIG. 21D , in response to the detection of the tap gesture 1100e, the mobile device displays a calendar area 1102d in the work mode including today's date (or the selected date) on the first touch screen 12, An event list 1104f including event items registered for the date of the calendar area 1102d is displayed on the second touch screen 14 . The calendar area 1102d in the work mode includes a date display line indicating the selected date, for example, "Thu, 1/13/2009", and hour lines for the selected date. Each time line includes an event title of the corresponding event when there is an event registered for the corresponding time, and may be displayed in a predetermined color.

When a predetermined touch gesture 1100f, for example, a tap gesture, is detected on any one event item in the event list 1104f of the second touch screen 14, the mobile device proceeds to FIG. 21E .

Referring to FIG. 21E , in response to detection of the tap gesture 1100f, the mobile device displays the calendar area 1102d of the first touch screen 12 as an event list including the event item selected by the tap gesture 1100f ( 1104g), and detailed information 1108 of the event item selected from the event list 1104g is displayed on the second touch screen 14. Detailed information 1108 includes at least one of an event title and date 1108a, the number of days remaining until the event date 1108b, an image registered for the event item 1108c, and a list of parties related to the event item 1108d. includes While the event list 1104g is displayed on the first touch screen 12 , the first touch screen 12 may place a new event creation key 1104 at the bottom of the event list 1104g .

Referring to FIG. 21F , the mobile device detects a tap gesture 1100g on a list mode key included in the view mode selection area 1102 of the first touch screen 12, and responds to the tap gesture 1100g to select A calendar area 1102e listing all registered event items including event items registered on the date (or today's date) is displayed on the first touch screen 12, and the second touch screen 14 has a calendar area ( 1102e), detailed information 1108e, 1108f, 1108g, 1108h of the selected event item is displayed. As an embodiment, the calendar area 1102e in the list mode is composed of event lines corresponding to event items, and each event line may include an event title and event time.

When a touch gesture 1100h is detected on the menu button disposed under the first touch screen 12 while the calendar area 1102e in list mode is displayed on the first touch screen 12, the mobile device displays the touch gesture ( 1100h), a first menu window 1104c is displayed on the lower portion of the first touch screen 12 in response to the detection.

As an event item is selected on the event list 1104g displayed on the first touch screen 12 or a list mode key in the view mode selection area 1102 is selected, details of the event item selected on the second touch screen 14 While the information 1108a-1108h is being displayed, if a touch gesture 1100i is detected on the menu button disposed under the second touch screen 14, the mobile device responds to the detection of the touch gesture 1100i. 2 A third menu window 1104g is displayed on the lower part of the touch screen 14 . The third menu window 1104g includes an edit key for editing the selected event item, a delete key for deleting the selected event item, a transmission key for transmitting the selected event item to a desired recipient, and a search for a desired event item. and at least one of a search key for, a related party transmission key for transmitting the selected event item to related parties, and an export key for transmitting the selected event item to a plurality of recipients.

As a selectable embodiment, when the schedule management application is started, the second touch screen 14 may display another application, for example, a home screen, an application menu, or another application that has been previously executed. This is called a schedule management application operating in multiple modes.

Although not shown, when the mobile device is in landscape mode, the lower touch screen displays a calendar area in the month mode, week mode, day mode, or list mode provided by the scheduling application, and the upper touch screen displays the calendar area You can display the event list related to the selected date or detailed information of the selected event item. As a selectable embodiment, when the mobile device is in landscape mode, the upper touch screen displays a calendar area in the month mode, week mode, day mode, or list mode provided by the schedule management application, and the lower touch screen displays another application information can be displayed.

21G to 21I illustrate scenarios for creating a new event in a schedule management application according to an embodiment of the present invention.

Referring to FIG. 21G , the mobile device displays the view mode selection area 1102 and the calendar area 1102a on the first touch screen 12 , and the selected date of the calendar area 1102a on the second touch screen 14 . An event list 1104a and a new event creation key 1104 are displayed. Although the calendar area 1102a in the month mode is illustrated here, a new event may be generated in a similar manner even in the calendar areas 1102c, 1102d, and 1102e in the week mode, day mode, or list mode. The mobile device may detect a command for generating a new event through the first or second touch screens 12 and 14 or through a menu button at the bottom of the first touch screen 12 . As an example, a touch and hold 1100j-1 is detected on a specific date on the calendar area 1102a of the first touch screen 12, or a tap gesture on the new event creation key 1104 of the second touch screen 14 When (1100j-2) is detected or a tap gesture (1100j-4) is detected on a generation key in the first menu window 1104c called by selection of a menu button (1100j-3), the mobile device recognizes it as a new It is recognized as a generation command for the event and proceeds to FIG. 21H.

Referring to FIG. 21H , the mobile device responds to the creation command 1100j-1,1100j-2,1100j-4 for a new event, the view mode selection area ( 1102), calendar area 1102a, event list 1104a, and first and second event creation windows 1110a and 1110b for receiving event elements of a new event in a new event creation key 1104 replaced by . The first event generation window 1110a displayed on the first touch screen 12 includes an event title input area, a start date selection area, an end date input area, and an all day selection area. The second event generation window 1110b displayed on the second touch screen 14 is at least one of a location input area related to an event, a related person input area, an alarm selection area, a repeat selection area, a description input area, and a save key. includes one Each of the event generating windows 1110a and 1110b may be scrolled in response to detection of a flick up/down or a touch drag up/down within the corresponding window.

When a tap gesture is detected in at least one of the input areas, a virtual keypad is displayed on a predetermined partial area of the touch screen selected by the corresponding tap gesture. As an example, when a tap gesture is detected on the event title input area displayed on the first touch screen 12 , the first touch screen 12 displays a virtual keypad on the lower half and receives an event title through the virtual keypad . In a selectable embodiment, when a tap gesture is detected in any of the input areas, a single virtual keypad is displayed in the lower area of both the first and second touch screens 12 and 14 .

Although not shown, when the mobile device is in the landscape mode, the upper touch screen may display the first event generating window 1110a and the lower touch screen may display the second event generating window 1110b. As an embodiment, when a tap gesture is detected in one of the input areas included in the upper touch screen, a virtual keypad is displayed on at least a part (lower half or all) of the lower touch screen. As an embodiment, when a tap gesture is detected in one of the input areas included in the lower touch screen, a virtual keypad is displayed on a part (eg, the lower half) of the lower touch screen. As an embodiment, when a tap gesture is detected in one of the input areas included in the lower touch screen, the second event generation window 1110b is displayed on the upper touch screen, and a virtual keypad may be displayed on the entire lower touch screen. have.

21I is another view of first and second event generating windows 1110c and 1110d displayed when the touch and hold 1100j-1 is detected on a specific date on the calendar area 1102a of the first touch screen 12 example is shown. As illustrated, the date of the position where the touch and hold 1100j-1 is sensed may be automatically input to the start date selection area and the end date selection area of the first event generation window 1110c. As a selectable embodiment, when the touch and hold 1100j-1 occurs on the time line of the calendar area 1102d of the work mode, the start time and/or the end time are automatically input to the first event creation window 1110c. can

21J to 21L illustrate scenarios for deleting an event registered in a schedule management application according to an embodiment of the present invention.

Referring to FIG. 21J , the mobile device displays the view mode selection area 1102 and the calendar area 1102a on the first touch screen 12 , and the selected date of the calendar area 1102a on the second touch screen 14 . An event list 1104a and a new event creation key 1104 are displayed. Although the calendar area 1102a in the month mode is illustrated here, events may be deleted in a similar manner even in the calendar areas 1102c, 1102d, and 1102e in the week mode, day mode, or list mode. The mobile device may detect an event deletion command through the first or second touch screens 12 and 14 or through a physical button (menu button) at the bottom of the first touch screen 12 . As an example, when a tap gesture 1120a is detected on the delete key in the first menu window 1104c called by the selection 1120 of the menu button, the mobile device recognizes it as a delete command for a registered event, and Proceed to 21k.

Referring to FIG. 21K , in response to the delete command 1120a, the mobile device displays the view mode selection area 1102 and the calendar area 1102a of the first touch screen 12 in the event deletion window 1112a and the delete command. It is displayed by replacing it with the delete key 1112b for execution. The event deletion window 1112a lists event deletion items corresponding to events registered for the month of the calendar area 1102a displayed on the first touch screen 12 . Each event deletion item includes an event name and a check box for each registered event, and an input for selecting an event item to be deleted is detected through the check box. When the calendar area 1102a in the month mode is being displayed on the first touch screen 12 , the event deletion window 1112a includes events registered for the month in the calendar area 1102a . Similarly, when the calendar areas 1102c, 1102d, and 1102e of the week mode, day mode, or list mode are displayed on the first touch screen 12, the event deletion window 1112a is displayed for the corresponding week, day, or list. Includes registered events.

While the event deletion window 1112a is displayed on the first touch screen 12 , the second touch screen 14 may be in an inactive state. In the inactive state, the second touch screen 14 does not respond to touch gestures and is filled with shadows.

When a tap gesture 1120b is detected in at least one check box among event deletion items on the first touch screen 12 and a tap gesture 1120c is detected on the delete key 1112b, the mobile device proceeds to FIG. 21L do.

Referring to FIG. 21L , in response to the detection of the tap gesture 1120c, the mobile device transfers the event deletion window 1112a and the delete key 1112b of the first touch screen 12 to previous information, that is, the view mode selection area. (1102) and the calendar area 1102a are replaced and displayed. When the event deletion window 1112a is removed from the first touch screen 12, the second touch screen 14 comes out of the inactive state, and the event item selected by the tap gesture 1120b in the event deletion window 1112a is deleted. Except, an event list 1104h including registered events is displayed.

21M to 21O illustrate another scenario for deleting an event registered in the schedule management application.

Referring to FIG. 21M , the mobile device displays the view mode selection area 1102 and the calendar area 1102a on the first touch screen 12 , and the selected date of the calendar area 1102a on the second touch screen 14 . An event list 1104a and a new event creation key 1104 are displayed. Although the calendar area 1102a in the month mode is illustrated here, events may be deleted in a similar manner even in the calendar areas 1102c, 1102d, and 1102e in the week mode, day mode, or list mode. In the mobile device, when a tap gesture 1120e is detected on the delete key in the second menu window 1104d called by selection 1120d of the menu button at the bottom of the second touch screen 14, the mobile device registers it It is recognized as a delete command for the event and proceeds to FIG. 21N.

Referring to FIG. 21N , in response to the delete command 1120e, the mobile device sends the event list 1104a and the new event creation key 1104 of the second touch screen 14 to the event deletion window 1112c and the delete command. It is displayed by replacing it with the delete key 1112d for execution. The event deletion window 1112c corresponds to events registered for the event list 1104a being displayed on the second touch screen 14 , that is, events registered for the selected date of the first touch screen 12 . Lists the event deletion items. Each event deletion item includes an event name and a check box for each registered event, and an input for selecting an event item to be deleted is detected through the check box. While the event deletion window 1112c is displayed on the second touch screen 14 , the first touch screen 12 may be in an inactive state. In the inactive state, the first touch screen 12 does not respond to touch gestures and is filled with shadows.

When a tap gesture 1120f is detected in at least one check box among event deletion items on the second touch screen 14 and a tap gesture 1120g is detected on the delete key 1112d, the mobile device proceeds to FIG. 21o do.

Referring to FIG. 21O , in response to the detection of the tap gesture 1120g, the mobile device displays the event delete window 1112c and the delete key 1112d of the second touch screen 14, the event list 1104i and the new event It is displayed by replacing it with the generation key 1104 . Compared to the previous event list 1104a, the event list 1104i includes registered events except for the event item selected by the tap gesture 1120f in the event deletion window 1112c. When the event deletion window 1112c is removed from the second touch screen 14, the first touch screen 12 comes out of the inactive state.

22 (including FIGS. 22A to 22M) illustrates scenarios in which a calendar area is expanded and displayed in a schedule management application according to an embodiment of the present invention.

Referring to FIG. 22A , the mobile device displays the view mode selection area 1202 and the calendar area 1202a on the first touch screen 12 , and the selected date of the calendar area 1202a on the second touch screen 14 . An event list 1206a for 1204a and a new event creation key 1206 are shown. Although the expansion of the calendar area 1202a in the month mode is illustrated here, the calendar areas 1102c, 1102d, and 1102e in the week mode, day mode, or list mode may be expanded in a similar manner. The mobile device detects a touch gesture 1200a for enlarging a selected area on the calendar area 1202a, that is, pinch zoom in. In another embodiment, the touch gesture 1200a includes two touch drags that occur simultaneously and move away from each other in approximately opposite directions. The touch gesture 1200a may start at two locations within the calendar area 1202a , and one of the two touch drags may end on the second touch screen 14 . At least one touch included in the touch gesture 1200a passes through the hinge between the two touch screens 12 and 14 .

As another embodiment, the mobile device may detect a zoom-in command through a menu button at the bottom of the first touch screen 12 . That is, when a menu button that is one of the physical buttons disposed under the first touch screen 12 is selected, for example, when a touch gesture 1200b is detected, the mobile device responds to the detection of the touch gesture 1200b. A first menu window 1202b is displayed on the lower portion of the first touch screen 12 . The first menu window 1202b includes a creation key for creating a new event, a Go to key for moving to the selected date, a today key for moving to today's date, and an enlargement of the displayed calendar area. It includes at least one of a dual zoom key, a search key for searching for a desired event, a delete key for deleting a registered event, and a setting key for changing a setting of a schedule management application. The first menu window 1202b including the dual zoom key may be called by a touch of a menu button while the calendar area of the month mode or the week mode is being displayed on the first touch screen 12 .

When the mobile device detects a touch gesture 1200c, ie, a tap gesture, on the dual zoom key in the first menu window 1202b invoked by selection 1200b of the menu button at the bottom of the first touch screen 12, FIG. 22B proceed with

Referring to FIG. 22B , in response to detection of a pinch zoom-in 1200a on the calendar area 1202a or a tap gesture 1200c on the dual zoom key, the mobile device responds to first and second extensions from the calendar area 1202a. The calendar areas 1208a and 1208b are displayed on the first and second touch screens 12 and 14 . The first and second calendar areas 1208a and 1208b include larger day blocks compared to the calendar area 1202a before expansion, and can display more information about events registered within each day block. have. The first calendar area 1208a includes some of the day blocks among the day blocks corresponding to the month of the calendar area 1202a, and the second calendar area 1208b includes a day block corresponding to the month of the calendar area 1202a. Among them, the remaining one blocks are included. For the continuous arrangement of the first and second calendar areas 1208a and 1208b , a new event creation key 1206 on the second touch screen 14 may be disposed at the top of the second calendar area 1208b. In the first and second calendar areas 1208a and 1208b, the work block 1204b positioned on today's date may be displayed in a predetermined color to be visually distinguished.

As a selectable embodiment, while the first and second calendar areas 1208a, 1208b are being displayed on the first and second touch screens 12 and 14, details of the selected date on the calendar areas 1208a, 1208b The information may be displayed in the form of a pop-up window.

The mobile device detects the touch gesture 1200d for reducing the selected area on the first and second calendar areas 1208a and 1208b, that is, pinch zoom out, and returns to FIG. 22A . In another embodiment, the touch gesture 1200d includes two touch drags that occur simultaneously and approach each other. The touch gesture 1200d may be started on different touch screens 12 and 14, respectively, and may end on any one of the first and second touch screens 12 and 14, respectively. At least one touch included in the touch gesture 1200d passes through the hinge between the two touch screens 12 and 14 .

Referring to FIG. 22C , the mobile device displays a view mode selection area 1202 and a calendar area 1202c in the week mode on the first touch screen 12, and a calendar area 1202c on the second touch screen 14 An event list 1206b and a new event creation key 1206 for the selected date are displayed. The mobile device detects a touch gesture 1200e for enlarging a selected area on the calendar area 1202c, that is, pinch zoom in. In another embodiment, the touch gesture 1200e includes two touch drags that occur simultaneously and move away from each other in approximately opposite directions. The touch gesture 1200e may start at two locations within the calendar area 1202a , and one of the two touch drags may end on the second touch screen 14 . At least one touch included in the touch gesture 1200e passes through the hinge between the two touch screens 12 and 14 . Although not shown, the mobile device may detect a zoom-in command for the calendar area 1202c in the main mode through a menu button at the bottom of the first touch screen 12 .

Referring to FIG. 22D , the mobile device detects a tap gesture on the dual zoom key in the first menu window called by selection of the menu button at the bottom of the first touch screen 12 or pinch zooms in on the calendar area 1202c 1200e is sensed, and the first and second calendar areas 1208c and 1208c extended from the calendar area 1202c are displayed on the first and second touch screens 12 and 14 . The first and second calendar areas 1208c and 1208c include larger hour blocks compared to the calendar area 1202c before expansion, and can display more information about events registered within each time block. have. The first calendar area 1208c includes time blocks for some of the days corresponding to the week of the calendar area 1202c, and the second calendar area 1208d includes days corresponding to the week of the calendar area 1202c. Includes time blocks for the remaining days of the . For the continuous arrangement of the first and second calendar areas 1208c and 1208d, a new event creation key 1206 on the second touch screen 14 may be disposed at the top of the second calendar area 1208d.

As a selectable embodiment, while the first and second calendar areas 1208c and 1208d are being displayed on the first and second touch screens 12 and 14, details of the selected date on the calendar areas 1208c and 1208d are displayed. The information may be displayed in the form of a pop-up window.

The mobile device detects the touch gesture 1200f of reducing the selected area on the first and second calendar areas 1208c and 1208d, that is, pinch zoom out, and returns to FIG. 22C . In another embodiment, the touch gesture 1200f includes two touch drags that occur simultaneously and approach each other. The touch gesture 1200f may start on different touch screens 12 and 14, respectively, and end on either one of the first and second touch screens 12 and 14, respectively. As an embodiment, the calendar area reduced by the touch gesture 1200f may be displayed on one touch screen where the touch gesture 1200f is terminated. At least one touch included in the touch gesture 1200f passes through the hinge between the two touch screens 12 and 14 .

A scenario in the calendar area extended to occupy the first and second touch screens 12 and 14 will be described with reference to FIGS. 22E to 22G .

Referring to FIG. 22E , the mobile device displays first and second calendar areas 1208a and 1208b composed of day blocks corresponding to one month on the first and second touch screens 12 and 14, respectively. . The first calendar area 1208a includes some of the day blocks corresponding to the selected month, and the second calendar area 1208b includes the remaining day blocks. When a predetermined touch gesture 1200g, for example, a tap gesture or a touch and hold, is detected on one of the blocks 1204c included in the first and second calendar areas 1208a and 1208b, the mobile device displays FIG. Proceed to 22f.

Referring to FIG. 22F , the mobile device positions the date indicator 1204e on the date of the block 1204c selected by the touch gesture 1200g, and a pop-up window displaying detailed information of the event registered for the selected date. (1210a) is displayed in the vicinity of the selected date. In the illustrated example, the pop-up window 1210a is detailed information about the event "Alice Birthday" registered for the selected date "15", the time "Tue, 15/01/2009 8:00 AM ~ Tue, 15/01" /2009 3:00 PM", a location, and a map image. While the pop-up window 1210a is being displayed, if an input 1200h for a return button, which is one of the physical buttons located at the bottom of the first touch screen 12, is detected, the mobile device displays the pop-up window 1210a. removed, and the first and second touch screens 12 and 14 are returned to FIG. 22E.

While the pop-up window 1210a is being displayed, a touch gesture 1200i predetermined on the other one 1204d of blocks included in the first and second calendar areas 1208a and 1208b, for example, a tap gesture or When the touch and hold is sensed, the mobile device proceeds to FIG. 22G .

Referring to FIG. 22G , in response to the detection of the touch gesture 1200i, the mobile device positions the date indicator 1204f on the date of a block 1204d selected by the touch gesture 1200i, and The pop-up window 1210a is removed. If there is no event registered for the date of the block 1204d selected by the touch gesture 1200i, a new pop-up window is not displayed.

22H to 22J illustrate scenarios for creating a new event in the extended calendar area of the schedule management application according to an embodiment of the present invention.

Referring to FIG. 22H , the mobile device displays first and second calendar areas 1208a and 1208b composed of day blocks corresponding to a selected month on the first and second touch screens 12 and 14 , respectively. While the calendar area of the month mode or the week mode is being displayed across the two touch screens 12 and 14 , a menu button that is one of the physical buttons disposed at the bottom of the first touch screen 12 is selected, the day For example, when the touch gesture 1200j is detected, the mobile device displays a menu window 1208e for an extended calendar area on the lower portion of the first touch screen 12 in response to the detection of the touch gesture 1200j. The menu window 1208e includes a creation key for creating a new event, a Go to key for moving to a selected date, a today key for moving to today's date, a search key for searching for a desired event, It includes at least one of a deletion key for deleting a registered event and a setting key for changing a setting of a schedule management application.

The mobile device may detect a command for generating a new event through the first or second touch screens 12 and 14 or through a menu button at the bottom of the first touch screen 12 . As an example, the touch and hold 1200k-2 is detected in one of the blocks included in the first and second calendar areas 1208a and 1208b, or the menu button located at the bottom of the first touch screen 12 is displayed. When the tap gesture 1200k-1 is detected on the creation key in the menu window 1208e invoked by the selection 1200j, the mobile device recognizes this as a creation command for a new event and proceeds to FIG. 22I.

Referring to FIG. 22I , the mobile device responds to a creation command 1200k-1 and 1200k-2 for a new event, in response to the first and second calendar areas 1208a of the first and second touch screens 12 and 14. , 1208b) is replaced with the first and second event generating windows 1210a and 1210b and displayed. The first event generation window 1210a displayed on the first touch screen 12 includes an event title input area, a start date selection area, an end date selection area, and an all-day selection area. The second event generation window 1210b displayed on the second touch screen 14 may include at least one of a location input area related to the event, a related person input area, an alarm selection area, a repeat selection area, a description input area, and a save key. includes one When a tap gesture is detected in one of the input areas, a virtual keypad is displayed in the lower area of the corresponding touch screen. As an example, when a tap gesture is detected on the event title input area, the first touch screen 12 displays a virtual keypad on the lower half, and receives an event title through the virtual keypad.

22J illustrates first and second event generating windows 1210c and 1210b displayed when a touch and hold 1200k - 2 is sensed in a specific block on the calendar area 1208a displayed on the first touch screen 12 . ) is another example of As illustrated, the date of the position where the touch and hold 1200k-2 is sensed may be automatically input to the start date selection area and the end date selection area of the first event generation window 1210c. As a selectable embodiment, when the touch and hold 1200k - 2 occurs on the time line of the calendar area of the work mode, the start time and/or end time together with the start/end date are added to the first event creation window 1210c. can be entered.

22K to 22M illustrate scenarios for deleting an event registered in a schedule management application according to an embodiment of the present invention.

Referring to FIG. 22K , the mobile device displays first and second calendar areas 1208a and 1208b including day blocks included in a selected month on the first and second touch screens 12 and 14 . Although the calendar areas 1208a and 1208b in the month mode are illustrated here, events can be deleted in a similar manner even when the calendar areas 1208a and 1208b in the week mode are being displayed across the two touch screens 12 and 14 . The mobile device may detect an event deletion command through the first or second touch screens 12 and 14 or through a menu button that is one of physical buttons at the bottom of the first touch screen 12 . As an example, when a tap gesture 1214b is detected on a delete key in the menu window 1208e called by selection 1214a of the menu button, the mobile device recognizes this as a delete command for a registered event and returns to FIG. 21L proceed

Referring to FIG. 22L , in response to the delete command 1214b, the mobile device displays the calendar area 1208a of the first touch screen 12 as an event delete window 1212a and a delete key 1212b for executing the delete command. replaced by . The event deletion window 1212a lists event deletion items corresponding to events registered for the month of the calendar area 1202a displayed on the first touch screen 12 . Each event deletion item includes an event name and a check box for each registered event, and an input for selecting an event item to be deleted is detected through the check box. When the calendar area 1208a of the month mode is being displayed on the first touch screen 12, the event deletion window 1212a includes events registered for the month of the calendar area 1208a. Similarly, when the calendar area of the week mode is being displayed on the first touch screen 12 , the event deletion window 1212a includes events registered for the corresponding week.

While the event deletion window 1212a is displayed on the first touch screen 12 , the second touch screen 14 may be in an inactive state. In the inactive state, the second touch screen 14 does not respond to touch gestures and is filled with shadows.

Tap on the delete key 1212b after a tap gesture 1214c is detected in the checkbox of at least one of the event delete items on the first touch screen 12, "New year's Day" and "B's Birthday" in the illustrated example If the gesture 1214d is detected, the mobile device proceeds to FIG. 22M .

Referring to FIG. 22M , in response to the detection of the tap gesture 1214d, the mobile device deletes the event deletion window 1212a and the delete key 1212b of the first touch screen 12 as previous information, that is, the calendar area 1208a. ) is replaced with When the event deletion window 1212a is removed from the first touch screen 12, the second touch screen 14 comes out of the inactive state. In the first and second calendar areas 1208a and 1208b of FIG. 22M , the event item selected by the tap gesture 1214c on the event deletion window 1212a, that is, "B's Birthday" is deleted.

The portable device provides a more convenient user interface for a call application through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable.

23 (including FIGS. 23A to 23P) illustrates a user interface of a call application according to an embodiment of the present invention.

23A to 23E illustrate scenarios for processing an outgoing call in a call application according to an embodiment of the present invention.

Referring to FIG. 23A , the first touch screen 12 displays a first page 1302a of the home screen and a dock area 1302 including icons of frequently used applications, and the second touch screen 14 is A application 1302b is displayed. When a predetermined touch gesture 1300a, for example, a tap gesture, is detected on the icon of the call application among the icons of the application menu that provides the call application, the contact application, the message application, and the application list included in the dock area 1302, The mobile device executes the call application and proceeds to FIG. 23B . Here, although the dock area 1302 displayed together with the home screen is exemplified, the following description will be given even when the dock area 1302 is displayed together with other applications or a call application is started by manipulating another menu of the mobile device. Of course, the same applies.

Referring to FIG. 23B , the mobile device starts a call application in response to detection of a touch gesture 1300a and displays an outgoing call screen 1304 provided by the call application on the first touch screen 12 of the home screen. The page 1302a and the dock area 1302 are replaced and displayed. The outgoing call screen 1304 includes a number display area 1304a displaying dialed numbers, a keypad area 1304b, a call key 1304c, a video call key 1304d, and a message outgoing key ( 1304e) and at least one of a function key area 1304f. Here, the function key area 1304f includes soft keys for functions that can be provided by the call application, for example, a keypad selection for selecting whether to display the keypad area 1304b or selecting the type of the keypad area 1304b. It includes at least one of a key, a log key for displaying a call log, and a contact key for calling a contact. As a selectable embodiment, when the call application is displayed on the first touch screen 12, the second touch screen 14 continues to display the A application 1302b.

When a phone number to be dialed is input through the keypad area 1304b, the first touch screen 12 displays the entered phone number in the number display area 1304a, and, if present, a photo image and contact name on the corresponding contact. to display When the input of the phone number is completed on the keypad area 1304b of the first touch screen 12 and the tap gesture 1300b is detected on the call key 1304c, the mobile device proceeds to FIG. 23C .

Referring to FIG. 23C , in response to detecting the tap gesture 1300b , the mobile device displays the dialing screen 1306 on the first touch screen 12 instead of the outgoing call screen 1304 . The dialing screen 1306 includes a caller identification area 1306a and a function key area 1306b. The caller identification area 1306a includes at least one of a name and a photo image of a caller corresponding to the input phone number, and a phone number. The function key area 1306b includes at least one of soft keys for functions during a call, for example, a phone number addition key, a dial pad call key, a call end key, a speaker key, a mute key, and a headset connection key. do. Add phone number key, mute key, and headset connection key that cannot be used during dialing may be deactivated. Here, the speaker key performs a switch between a public mode and a private mode. Here, the public call mode refers to the speakerphone mode in which the speaker volume and microphone sensitivity are relatively increased (or the external speaker is turned on) so that a long-distance call is possible. It refers to a state in which the speaker volume and microphone sensitivity are relatively low (or the external speaker is turned off) so that a call can be carried out in close proximity.

When a call connection is started while the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the second touch screen 14 displays the previously displayed The application A 1302b is continuously displayed, turned off, or a guide message screen 1302c recommending that the portable device be folded for a call is displayed.

As a selectable embodiment, in a state in which the first and second panels 2 and 4 are unfolded, the call application connects a call in the open call mode. Also, if the first and second panels 2 and 4 of the portable device are folded out so that the first touch screen 12 faces the front during dialing, the second touch screen 14 may be turned off.

When the other party responds to the call connection and detects that the call is connected, the mobile device proceeds to FIG. 23D .

Referring to FIG. 23D , in response to detecting a call connection, the mobile device displays a busy screen 1308 on the first touch screen 12 . The busy screen 1308 includes a caller identification area 1308a, a call time 1308b, and a function key area 1308c. The caller identification area 1308a includes at least one of a photo image, a caller's name, and a phone number. The function key area 1308c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

When a call is connected while the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the second touch screen 14 displays a guide message screen 1302c. may be removed and the previously displayed information, that is, application A 1302b, may be displayed. As another embodiment, the second touch screen 14 continuously maintains the guidance message screen 1302c during a call in an unfolded state.

When it detects that the first and second panels 2 and 4 constituting the portable device are folded (folded-out) 1300b during a call in the open call mode, the portable device proceeds to FIG. 23E . Referring to FIG. 23E , the mobile device turns off the second touch screen 14 in response to the fold-out 1300b of the first and second panels 2 and 4, and deactivates the public call mode, that is, the private Switch to call mode. Although not shown, when detecting that the first and second panels 2 and 4 constituting the mobile device are unfolded during a call in the personal call mode, the mobile device displays the second touch screen 14 as shown in FIG. 23D . ), that is, the previously displayed information, that is, the application A 1302b, is displayed again, and the open call mode is activated.

23F to 23J illustrate another scenario for processing an outgoing call in a call application according to an embodiment of the present invention.

Referring to FIG. 23F , the first touch screen 12 displays a first page 1302a and a dock area 1302 of the home screen, and the second touch screen 14 displays a second page 1302d of the home screen. is displaying When a predetermined touch gesture 1300c, for example, a tap gesture, is detected on the icon of the call application included in the dock area 1302, the mobile device executes the call application and proceeds to FIG. 23G. Here, the dock area 1302 displayed together with the home screen is exemplified, but the following description will be given even when the dock area 1302 is displayed together with other applications or a call application is started by manipulating another menu of the mobile device. Of course, the same applies.

Referring to FIG. 23G , the mobile device starts a call application in response to detection of a touch gesture 1300c and an outgoing call screen provided by the call application 1304, that is, a number display area 1304a and a keypad area 1304b. and a call key 1304c, a video call 1304d key, a message sending key 1304e, and a function key area 1304f are displayed on the first touch screen 12 . As an example, the function key area 1304f includes a keypad selection key for selecting whether to display the keypad area 1304b or for selecting the type of the keypad area 1304b, a log key for showing call logs, and a number to call a contact. contains at least one of the contact keys. As a selectable embodiment, when a call application is started on the first touch screen 12 while the second touch screen 14 displays the second page 1302d of the home screen, the dock area 1302 is displayed on the second touch screen. It may be displayed by moving to the lower part of the second page 1302d of (14).

When a phone number to be dialed is input through the keypad area 1304b, the first touch screen 12 displays the entered phone number in the number display area 1304a, and, if present, a photo image and contact name on the corresponding contact. to display When the input of the phone number is completed and a tap gesture 1300d is detected on the call key 1304c, the mobile device proceeds to FIG. 23H .

Referring to FIG. 23H , the mobile device displays a dialing screen 1306 on the first touch screen 12 in response to detecting the tap gesture 1300d. The dialing screen 1306 includes a caller identification area 1306a and a function key area 1306b. The caller identification area 1306a includes at least one of a photo image, a caller's name, and a phone number. The function key area 1306b includes at least one of a phone number add key, a dial pad call key, a call end key, a speaker key, a mute key, and a headset connection key. Add phone number key, mute key, and headset connection key that cannot be used during dialing may be deactivated.

When a call connection is started while the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the second touch screen 14 displays the previously displayed The application A 1302b is continuously displayed, turned off, or a guide message screen 1302c recommending that the portable device be folded for a call is displayed. In this case, the guide message screen 1302c may be overwritten and displayed on the second page 1302d and the dock area 1302e of the previously displayed home screen, for example.

As a selectable embodiment, in a state in which the first and second panels 2 and 4 are unfolded, the call application starts a call connection in the open call mode. Also, if the portable device is folded out during dialing, the second touch screen 14 may be turned off.

When the other party responds to the call connection and detects that the call is connected, the mobile device proceeds to FIG. 23I .

Referring to FIG. 23I , in response to detection of a call connection, the mobile device displays a busy screen 1208 on the first touch screen 12 . The busy screen 1308 includes a caller identification area 1308a, a call time 1308b, and a function key area 1308c.

When a call is connected while the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the second touch screen 14 displays a guide message screen 1302c. may be displayed by replacing the previously displayed information, that is, the second page 1302d of the home screen. As another embodiment, the second touch screen 14 continuously maintains the guidance message screen 1302c during a call in an unfolded state.

When detecting that the first and second panels 2 and 4 constituting the mobile device are folded-out 1300e during a call in the open call mode, the mobile device displays the second touch screen 14 as shown in FIG. 23J . ) to turn off and switch to personal call mode. When a call is terminated while a call is being made in the folded-out state, for example, if a tap gesture 1300f is detected on the call end key, the mobile device moves the call screen 1308 of the second touch screen 12 to , that is, the second page 1302d of the home screen and the dock area 1302e are replaced and displayed.

23K to 23M illustrate scenarios for processing an incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 23K , the first touch screen 12 displays the first application 1322a, and the second touch screen 14 displays the second application 1322b. The first and second applications 1322a and 1322b may be any of a home screen, an application menu, a basic application, and an application installed by a user. In the illustrated example, the first application 1322a is a message application such as Short Messaging Service (SMS), e-mail, and Instant Messaging Service (IMS), and the second application 704 is a photo gallery application. am. As another example, the first and second touch screens 12 and 14 display two work screens for one application in the main-sub mode, or jointly display one work screen for one application in the full mode. can be displayed

When an incoming call occurs while one or more applications 1322a and 1322b are displayed on the first and second touch screens 12 and 14, the mobile device proceeds to FIG. 23L.

Referring to FIG. 23L , the mobile device starts a call application in response to the occurrence of an incoming call, and replaces the incoming call screen 1324 provided by the call application with the first application 1322a on the first touch screen 12 . to indicate The incoming call screen 1324 includes at least one of a caller identification area 1324a, an incoming key area 1324b, and a rejection message key 1324c. The caller identification area 1324a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1324b may include an incoming key and a reject key. The reject key is used to reject an incoming call without sending a message. The reject message key 1324c is used by the message application to automatically send a reject message.

While the incoming call screen 1324 is being displayed on the first touch screen 12, the second touch screen 14 is deactivated, and a guide message screen 1326 recommending that the portable device be folded for a call. to display

When a predetermined touch gesture 1310a, for example, a tap gesture or a touch drag (slide) starting on the incoming key and moving in a predetermined direction, is detected on the incoming key in the incoming key area 1324b, the mobile device Proceed to 23m.

Referring to FIG. 23M , the mobile device connects a call with the other party in response to the detection of the touch gesture 1310a, and displays the call screen 1324 on the first touch screen 12 and the call screen 1324 during the call. displayed instead. The busy screen 1324 includes a caller identification area 1324a, a call time 1324b, and a function key area 1324c. The caller identification area 1324a includes at least one of a photo image, a caller's name, and a phone number. The function key area 1324c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

As a selectable embodiment, when a touch gesture 1310a is detected on an incoming key in a state in which the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, The call application starts a call connection in the open call mode, and the second touch screen 14 is activated again.

When a call is terminated on the screen 1324 during a call, as an example, when a tap gesture 1320b is detected on a call end key in the function key area 1324c, the mobile device returns to FIG. 23K and returns to the first touch screen 12 The screen 1324 during a call is replaced with the previous information, that is, the first application 1322a and displayed.

23N to 23P illustrate another scenario for answering an incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 23N , the first and second touch screens 12 and 14 display first and second work screens 1326a and 1326b of the first application. The first application may be any one of a home screen, an application menu, a basic application, and an application installed by a user. In the illustrated example, the first application is a photo gallery application that provides two work screens of different depths, and the first work screen 1326a of the second touch screen 12 is one page of a plurality of thumbnail images. Including, the second work screen 1326b of the second touch screen 14 displays a photo image of one selected thumbnail image among the thumbnail images in a larger size, that is, a full size.

When an incoming call occurs while the first application's work screens 1326a and 1326b are displayed on the first and second touch screens 12 and 14 , the mobile device proceeds to FIG. 23O .

Referring to FIG. 23O , the mobile device starts a call application in response to the occurrence of an incoming call, displays an incoming call screen 1328 provided by the call application, and displays the first operation of the first application on the first touch screen 12 . The screen 1326a is replaced and displayed. The incoming call screen 1328 includes a caller identification area 1328a, an incoming key area 1328b, and a rejection message key 1328c. The caller identification area 1328a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1328b may include a destination key and a reject key. The reject message key 1328c is used by the messaging application to automatically send a reject message.

While the incoming call screen 1328 is being displayed on the first touch screen 12, the second touch screen 14 is deactivated, and the guide message screen 1330 recommends folding the portable device for a call. to display

When a predetermined touch gesture 1320c, for example, a tap gesture or a touch drag (slide) starting on the incoming key and moving in a predetermined direction, is detected on the incoming key in the incoming key area 1328b, the mobile device Proceed to 23p.

Referring to FIG. 23P , the mobile device connects a call with the other party in response to the detection of the touch gesture 1320c, and displays the call screen 1332 on the first touch screen 12 and the incoming call screen 1328 on the first touch screen 12. displayed instead. The busy screen 1332 includes a caller identification area 1332a, a call time 1332b, and a function key area 1332c. The caller identification area 1332a includes at least one of a photo image, a caller's name, and a phone number. The function key area 1332c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

As a selectable embodiment, when a touch gesture 1320c is detected on an incoming key in a state in which the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, The call application starts a call connection in the open call mode, and the second touch screen 14 is activated again.

When a call is terminated on the screen 1332 during a call, as an example, when a tap gesture 1320d is detected on a call end key in the function key area 1332c, the mobile device returns to FIG. 23N , and the first touch screen 12 ), the screen 1324 during a call is replaced with the previous information, that is, the first work screen 1326a of the first application and displayed.

24 (including FIGS. 24A to 24R) illustrates a user interface of a call application according to another embodiment of the present invention.

24A to 24C illustrate another scenario for answering an incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 24A , the first touch screen 12 displays a text input area (ie, a typing area) 1402a of the first application, and the second touch screen 14 displays additional information 1402d of the first application to display The first application is an application that requires a typing input, and is exemplified here as a message application. The first touch screen 12 further displays a message display area 1402b for displaying a message input through the text input area 1402a and a virtual keypad area 1402c together with the text input area 1402a. As additional information 1402d of the message application, the second touch screen 14 displays messages exchanged with the same counterpart in chronological order, for example.

If an incoming call occurs while the text input area 1402a is displayed on the first touch screen 121, the mobile device proceeds to FIG. 24B.

Referring to FIG. 24B , the mobile device starts a call application in response to the generation of an incoming call, and displays an incoming call screen 1404 provided by the call application on the first touch screen 12, a text input area 1402a and Displayed in place of other information 1402b and 1402c. The incoming call screen 1404 includes a caller identification area 1404a, an incoming key area 1324b, and a rejection message key 1404c. The caller identification area 1404a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1404b may include a destination key and a reject key. The reject message key 1404c is used by the messaging application to automatically send a reject message.

While the incoming call screen 1404 is being displayed on the first touch screen 12, the second touch screen 14 is deactivated, and the guidance message screen 1406 recommends folding the portable device for a call. is displayed by overwriting the previous information 1402d.

When a predetermined touch gesture 1300a, for example, a tap gesture or a touch drag (slide) starting on the incoming key and moving in a predetermined direction is detected on the incoming key in the incoming key region 1404b, the mobile device Proceed to 24c.

Referring to FIG. 24C , the mobile device connects a call with the other party in response to the detection of the touch gesture 1400a, and displays the call screen 1406 on the first touch screen 12 and the incoming call screen 1404 on the first touch screen 12. displayed instead. The busy screen 1406 includes a caller identification area 1406a, a call time 1406b, and a function key area 1406c. The caller identification area 1406a includes at least one of a photo image, a counterpart's name, and a phone number. The function key area 1406c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

When an incoming call occurs while the information 1402a, 1402b, 1402c including the text input area 1402a is displayed on the first touch screen 12, the mobile device displays the call screen ( 1406 , the text input area 1402a and other information 1402b and 1402c previously displayed on the first touch screen 12 are transferred and displayed on the second touch screen 12 . At this time, the text input area 1402a is displayed on the second touch screen 14 including text that was input before the incoming call on the first touch screen 12 .

As a selectable embodiment, in a state in which the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the mobile device performs a call on the first touch screen 12 . A call connection is started in the open call mode through the middle screen 1406 , and the user can continuously input a message through the text input area 1402a of the second touch screen 14 .

When a tap gesture 1400b is detected on the call end key on the function key area 1406c, the mobile device returns to FIG. 24A and displays the busy screen 1406 of the first touch screen 12 as previous information, that is, text. The input area 1402a, the message display area 1402b, and the virtual keypad area 1402c are replaced and displayed, and the information 1402d before the incoming call is displayed on the second touch screen 14 .

24D to 24H illustrate another scenario for answering an incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 24D , the first and second touch screens 12 and 14 display first and second work screens 1410a and 1410b of the first application. The first application may be any one of a home screen, an application menu, a basic application, and an application installed by a user. In the illustrated example, the first application is a photo gallery application that provides two work screens of different depths, and the first work screen 1410a of the second touch screen 12 is one page of a plurality of thumbnail images. and, the second work screen 1410b of the second touch screen 14 displays a photo image of one selected thumbnail image from among the thumbnail images in a larger size, that is, a full size.

When an incoming call occurs while the first application's work screens 1410a and 1410b are displayed on the first and second touch screens 12 and 14 , the mobile device proceeds to FIG. 24E .

Referring to FIG. 24E , the mobile device starts a call application in response to the generation of an incoming call, and displays an incoming call screen 1412 provided by the call application on the first touch screen 12 as a first operation screen of the first application. (1410a) is substituted for and indicated. The incoming call screen 1412 includes a caller identification area 1412a, an incoming key area 1412b, and a rejection message key 1412c. The caller identification area 1412a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1412b may include a destination key and a reject key. The reject message key 1412c is used by the message application to automatically send a reject message.

While the incoming call screen 1412 is being displayed on the first touch screen 12, the second touch screen 14 is deactivated, and the guide message screen 1414 recommends folding the portable device for a call. to display

When a predetermined touch gesture 1400c on the incoming key in the incoming key area 1412b, for example, a tap gesture or a touch drag (slide) starting on the incoming key and moving in a predetermined direction is detected, the mobile device Proceed to 24f.

Referring to FIG. 24F , the mobile device connects a call with the other party in response to the detection of the touch gesture 1400c, and displays the call screen 1416 on the first touch screen 12 and the incoming call screen 1412 on the first touch screen 12. displayed instead. The busy screen 1416 includes a caller identification area 1416a, a call time 1416b, and a function key area 1416c. The caller identification area 1416a includes at least one of a photo image, a caller's name, and a phone number. The function key area 1416c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

As a selectable embodiment, when a touch gesture 1400c is detected on an incoming key in a state in which the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, The call application starts a call connection in the open call mode, and the second touch screen 14 is activated again as shown in FIG. 24F .

While the call screen 1416 is displayed on the first touch screen 12 and the previous work screen 1410b is displayed on the second touch screen 14, the physical When the home button, which is one of the buttons, is selected ( 1400d ), the portable device proceeds to FIG. 23G .

Referring to FIG. 23G , the mobile device displays the first page 1418a of the home screen on the second touch screen 14 in response to the selection 1400d of the home button. At this time, the first touch screen 12 still displays the busy screen 1416, and accordingly, the dock area 1418b is displayed along with the first page 1418a of the home screen under the second touch screen 14. do.

When the tap gesture 1400e is detected on the call end key on the function key area 1416c, the mobile device proceeds to FIG. 24h and displays the busy screen 1406 of the first touch screen 12, information before the incoming call, That is, the work screen 1410b of the first application is replaced and displayed, and the first page 1418a and the dock area 1418b of the home screen of the second touch screen 14 are maintained. In this case, the first touch screen 12 displays a predetermined one of the work screens 1410a and 1410b of the first application, for example, the work screen 1418b of the final depth.

24I and 24J illustrate a scenario for rejecting an incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 24I , the mobile device displays an incoming call screen 1404 provided by the call application in response to the generation of the incoming call. The incoming call screen 1404 includes a caller identification area 1404a, an incoming key area 1404b, and a rejection message key 1404c. The caller identification area 1404a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1404b may include a destination key and a reject key. The reject message key 1404c is used by the messaging application to automatically send a reject message.

While the incoming call screen 1404 is being displayed on the first touch screen 12, the second touch screen 14 is deactivated, and the guidance message screen 1406 recommends folding the portable device for a call. to display

A touch gesture 1400f predetermined on the rejection message key 1404c in the incoming call screen 1404, for example, a tap gesture or a touch drag (slide) starting on the rejection message key 1404c and moving in a predetermined direction When is detected, the mobile device proceeds to FIG. 24J .

Referring to FIG. 24J , the mobile device displays a rejection message screen 1420 on the first touch screen 12 in response to detection of a touch gesture 1400f, and for inputting a rejection message on the second touch screen 14 . A text input area 1422a and a virtual keypad 1422c are displayed. The rejection message screen 1420 includes a plurality of boilerplates preset as a rejection message for rejecting an incoming call and transmission keys for each of the boilerplates. Although not shown, when a tap gesture is detected on a transmission key for one of the boilerplates, the mobile device displays the selected boilerplate, for example, "I'll call later", "I'm in meeting", "I'm" A short message containing one of "in class now", "In a cinema", or "While driving" is automatically sent to the other party of the incoming call.

When a message for rejection, for example "I'm busy", is input through the virtual keypad 1422c and a tap gesture 1422c is detected on the transmission key included in the text input area 1422a, the mobile device Message, a short message including "I'm busy" is automatically sent to the other party of the incoming call by the message application.

Although not shown, after the message is transmitted through the rejection message screen 1420 or the text input area 1422a and the virtual keypad 1422c, the mobile device transmits the incoming calls to the first and second touch screens 12 and 14 . The screen 1404 and the guidance message screen 1406 are replaced and displayed with information displayed before the incoming call.

24K to 24N illustrate another scenario for answering a second incoming call in a call application according to an embodiment of the present invention.

Referring to FIG. 24K , the mobile device displays a busy screen 1406 provided by a call application on the first touch screen 12 and performs a call with the first counterpart, for example, "AAA". , the second touch screen 14 displays the first application 1410b. The first application 1410b refers to an application other than a call application. If a second incoming call from the second party, eg, "BBB", occurs while the screen 1406 is being displayed during a call with the first party, the mobile device proceeds to FIG. 24L.

Referring to FIG. 24L , the mobile device replaces the busy screen 1406 of the first touch screen 12 with the incoming call screen 1426 of the second counterpart while maintaining the call with the first counterpart. indicate The incoming call screen 1426 includes a caller identification area 1426a for the second counterpart "BBB", an incoming key area 1426b and a rejection message key 1426c. While the incoming call screen 1426 with the second counterpart is being displayed on the first touch screen 12 , the second touch screen 14 may continuously display the first application 1410b. As a selectable embodiment, if at least one panel constituting the mobile device is folded while the screen 1426 for an incoming call with the second party is being displayed on the first touch screen 12, the second touch screen ( 14) can be turned off.

When a predetermined touch gesture 1400g on the incoming key in the incoming key area 1426b, for example, a tap gesture or a touch drag (slide) starting on the incoming key and moving in a predetermined direction is detected, the mobile device Proceed to 24m.

Referring to FIG. 24M , in response to the detection of the touch gesture 1400g, the mobile device displays the multi-incoming selection menu 1428 on the incoming call screen 1426 of the first touch screen 12 in the form of a pop-up window. . The multi-call selection menu 1428 includes a standby key 1428a for putting a call with the first counterpart on hold and an end key 1428b for terminating the call. Although not shown, when a tap gesture is detected on the end key 1428b, the mobile device ends the call with the first counterpart and displays a screen during the call with the second counterpart. When the tap gesture 1400h is detected on the standby key 1428a, the mobile device puts the call of the first counterpart on hold and proceeds to FIG. 24N. The microphone and speaker are not connected to a call on hold.

Referring to FIG. 24N , the mobile device connects a call with the second counterpart by means of a call application, and replaces the incoming call screen 1426 of the first touch screen 12 with the multi-call screen 1430. indicate The multi-call screen 1430 includes caller identification areas 1430a and a call swap key 1430b for each of a plurality of counterparts in a call, "AAA" and "BBB", and a simultaneous call (merge) a key 1430c and a function key area 1430d. Each caller identification area 1430a includes at least one of a small photo image, a counterpart's name, and a phone number, and the caller identification area to which a call is connected may be displayed in shade or highlighted. The function key area 1430c includes at least one of a phone number addition key, a dial pad call key, a call end key, a speaker mode switching key, a mute key, and a headset connection key.

The call switch key 1430b is used to switch the current caller. When a tap gesture is detected on the call switch key 1430b while a call is connected to the second counterpart "BBB", the mobile device puts the call of the second counterpart "BBB" on hold, and the first counterpart call Now connect the call to "AAA". Simultaneous call key 1430c is used to connect a call with all other parties on standby at the same time. When a tap gesture is detected on the simultaneous call key 1430c while a call from the first counterpart "AAA" is on standby and a call is connected to the second counterpart "BBB", the mobile device performs the first and second Connect all calls with the other party "AAA" and "BBB". The user may communicate with both the first and second counterparts through the mobile device.

In a state in which the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are unfolded, the multi-call screen 1430 is displayed on the first touch screen 12 In the meantime, the second touch screen 14 may continuously display the first application 1410b.

24O to 24R illustrate another scenario for answering an incoming call by a movement of a mobile device in a call application according to an embodiment of the present invention.

Referring to FIG. 24O , in a state in which the first and second panels 2 and 4 are fully folded so that the first and second touch screens 12 and 14 face outward, the first touch screen 12 is indicates the first application 1432 . In the illustrated example, the first application 1432 is a photo gallery application that displays one page of thumbnail images. In this case, the second touch screen 14 may be turned off. If an incoming call occurs while displaying the first application 1432 in the folded state, the mobile device proceeds to FIG. 24P .

Referring to FIG. 24P , the mobile device starts a call application in response to the generation of an incoming call, and replaces the incoming call screen 1434 provided by the call application to the first touch screen 12 with the first application 1432 to indicate The incoming call screen 1434 includes a caller identification area 1434a, an incoming key area 1434b, and a rejection message key 1434c. The caller identification area 1434a includes at least one of a photo image, a caller's name, and a phone number. The destination key area 1434b may include a destination key and a reject key. The reject message key 1434c is used by the messaging application to automatically send a reject message.

While displaying the incoming call screen 1434 on the first touch screen 12 on the first panel 2 in a state where the first and second panels 2 and 4 are fully folded, the mobile device displays the second touch screen When the overturn 1400i is sensed so that the second panel 4 provided with the 14 is raised to the top, the portable device proceeds to FIG. 24Q .

Referring to FIG. 24Q , in response to detecting the overturning 1400i , the mobile device turns off the first touch screen 12 and displays a rejection message screen 1436 on the second touch screen 14 . It also turns off the ring tone when the mobile device is not in vibrate mode. The rejection message screen 1436 includes a plurality of boilerplates designated in advance for rejecting an incoming call, transmission keys for each of the boilerplates, and a new rejection message generation key that can additionally select input of a new rejection message. Although not shown, when a transmission key for one of the boilerplates is selected, the mobile device displays the selected boilerplate, for example, "I'll call later", "I'm in meeting", "I'm in class now" One of ", "In a cinema", and "While driving" is automatically sent to the other party of the incoming call by the message application. Also, when a tap gesture is detected on the key for generating a new rejection message, the mobile device displays a rejection message input window on the second touch screen 14 .

If the first and second panels 2 and 4 are unfolded 1400j while displaying the rejection message screen 1436 on the second touch screen 14, the portable device proceeds to FIG. 24R.

Referring to FIG. 24R , the mobile device displays a rejection message screen 1436 on the first touch screen 12 in response to detection of the unfolding 1400j, and text for sending a rejection message to the second touch screen 14 An input area 1438a and a virtual keypad 1438b are displayed. When a message for rejection, for example, "I'm busy" is input through the virtual keypad 1438b and a tap gesture is detected on the transmission key included in the text input area 1438a, the mobile device sends the input message, " A short message including "I'm busy" is automatically sent to the other party of the incoming call by the messaging application.

A portable device provides a more convenient user interface for a camera application through a display device including a first touch screen and a second touch screen provided on at least one panel configured to be foldable. As described above, the mobile device drives a camera application, takes a picture through at least one camera module provided in the first and second panels provided with the first and second touch screens, and stores the picture as a picture image.

The positions of the camera modules may be variously determined according to the selection of the manufacturer. As an example, the first camera module is disposed on the top of the front of the first panel 2, and the second camera module is disposed on the top of the rear of the second panel 4, so that the first camera module operates as a front camera and 2 The camera module operates as a rear camera. As another example, one camera module is disposed on the upper front side of the second panel 4 , and the camera module operates as a front camera or a rear camera depending on whether the second panel 4 is folded. As another example, the first and second camera modules are respectively disposed on the upper front and rear upper portions of the second panel 4 , and the first camera module is a front camera or a rear camera depending on whether the second panel 4 is folded. It operates as a camera, and the second camera module operates as a rear camera when the first camera module operates as a front camera.

25 (including FIGS. 25A to 25L) and 26 (including FIGS. 26A to 26K) show a user interface of a camera application according to an embodiment of the present invention.

Here, an embodiment in which the camera module is disposed on the upper front side of the second panel 4 provided with the second touch screen 14 will be described. Although not shown, an additional camera module may be present on the rear side of the second panel 4 . When the mobile device is in the portrait mode, the first touch screen 12 not provided by the camera module becomes the main screen, and the second touch screen 14 including the camera module becomes the sub screen. Although not shown, when the mobile device is in the landscape mode, the upper touch screen may be the main screen, and the lower touch screen may be the sub screen. As another embodiment, the main screen and the sub screen may be determined according to the number and positions of camera modules.

When the first and second panels provided with the first and second touch screens 12 and 14 are unfolded, a shortcut button provided in the housing of the portable device or a soft key provided through the touch screen of the portable device is touched. When the camera application is started, the camera application drives at least one camera module included in the portable device, and displays screens as shown in FIG. 25A on the first and second touch screens 12 and 14, for example.

Referring to FIG. 25A , the first touch screen 12 displays a live view screen 1502a and a camera menu 1502b being photographed by the camera module in the basic camera mode, and the second touch screen ( 14) displays a camera mode menu 1504 for changing a camera mode. The camera mode menu 1504 includes mode buttons 1504a, 1504b, 1504c, and 1504d corresponding to a plurality of camera modes. As an example, a Basic Camera button 1504a for photographing a scene or a model through the camera module 24 in a state in which the first and second panels 2 and 4 are folded, and the first and second panels Shooting through both the Self Camera button 1504b and the first and second touch screens 12 and 14 for taking a picture of the user through the camera module 24 in the folded state (2, 4) A Dual Camera button 1504c that displays an image and a Baby Camera button that displays an image or animation that arouses interest in the subject to be photographed through the second touch screen 14 shown to the object to be photographed ( 1504d) may be included.

When the camera application is started, it is set to operate in the default camera mode, and the button corresponding to the selected camera mode, that is, the default camera button 1504a is highlighted with a bold line or another color to be distinguishable. Also, when a touch gesture, for example, a tap gesture, is detected on the basic camera button 1504a in the camera mode menu 1504 provided through the second touch screen 14, the camera application operates in the basic camera mode.

The camera menu 1502b may be disposed to be included on one side or both sides of the captured image 1502a, and includes a shutter button, a save image load button, a mode selection button and a flash selection button, a timer shooting button, and a white balance. It includes function buttons for shooting, such as a button, a resolution selection button, and the like.

As a selectable embodiment, when the mobile device includes a camera module 24 provided on the front of the first or second panel 2 and 4 and a camera module 26 provided on the rear of the second panel 4 . , the captured image 1502a may be reproduced by combining the images of the front camera module 24 and the rear camera module 26 .

Referring to FIG. 25B , in the mobile device, the first and second panels 2 and 4 are folded within a predetermined effective angle range while the captured image 1502a is displayed on the first touch screen 12 in the basic camera mode. ) (1500a) is detected, and the flow proceeds to FIG. 25C. Referring to FIG. 25C , the portable device turns off the second touch screen 14 in response to detecting that the first and second panels 2 and 4 are folded 1500a. In one embodiment, when the first and second panels 2 and 4 are started to be folded, the second touch screen 14 may ), or when the first and second panels 2 and 4 are fully folded, they may be turned off. The first touch screen 12 maintains the captured image 1502a and the camera menu 1502b even after the folding 1500a.

Referring to FIG. 25D , the first touch screen 12 displays a captured image 1502a and a camera menu 1502b being photographed by the camera module 24 in the self-camera mode, and the second touch screen 14 displays a camera mode menu 1504 for changing a camera mode. The camera mode menu 1504 includes at least one of a basic camera button 1504a, a selfie button 1504b, a dual camera button 1504c, and a baby camera button 1504d. In the selfie mode, the selfie button 1504b is displayed so as to be distinguishable by a bold line or another color.

Referring to FIG. 25E, the mobile device detects that the first and second panels 2 and 4 are folded 1500b while the captured image 1502a is displayed on the first touch screen 12 in the selfie mode, Proceed to Fig. 25F. Referring to FIG. 25F , the mobile device displays the captured image 1502a and the camera menu 1502b in the self-camera mode in response to detecting the folding 1500b of the first and second panels 2 and 4, and the camera module ( 24) is displayed on the second touch screen 14 on the second panel 4 on the front side, and the first touch screen 12 on the first panel 2 without the camera module 24 is turned off. do.

Referring to FIG. 25G , the first touch screen 12 displays a captured image 1502a and a camera menu 1502b being photographed by the camera module 24 in the dual camera mode, and the second touch screen 14 displays a camera mode menu 1504 for changing a camera mode. The camera mode menu 1504 includes at least one of a basic camera button 1504a, a selfie button 1504b, a dual camera button 1504c, and a baby camera button 1504d. In the dual camera mode, the dual camera button 1504c is displayed so as to be distinguishable by a bold line or another color.

25H, the mobile device detects that the first and second panels 2 and 4 are folded 1500c while the captured image 1502a is displayed on the first touch screen 12 in the dual camera mode, Proceed to Fig. 25i. Referring to FIG. 25I , the mobile device displays the captured image 1502c without the camera menu 1502b on the second touch screen 14 in response to detecting the folding 1500c of the first and second panels 2 and 4 . indicate Since the captured image 1502c of the second touch screen 14 is to be displayed to a subject to be photographed, there is no need to include a camera menu. The first touch screen 12 maintains the captured image 1502a and the camera menu 1502b even after the folding 1500c.

Referring to FIG. 25J , the first touch screen 12 displays a photographed image 1502a and a camera menu 1502b being photographed by the camera module 24 in the baby camera mode, and the second touch screen 14 displays a camera mode menu 1504 for changing a camera mode. The camera mode menu 1504 includes at least one of a basic camera button 1504a, a selfie button 1504b, a dual camera button 1504c, and a baby camera button 1504d. In the selfie mode, the selfie button 1504d is displayed so as to be distinguishable by a bold line or another color.

25K, the mobile device detects that the first and second panels 2 and 4 are folded 1500d while the captured image 1502a is displayed on the first touch screen 12 in the dual camera mode, Proceed to Figure 25L. Referring to FIG. 25L , the mobile device displays a pre-stored animation 1502d on the second touch screen 14 in response to detecting the folding 1500d of the first and second panels 2 and 4 . An animation is a moving picture stored in a mobile device by a manufacturer or a user to arouse interest in a subject to be photographed, and may be selected by a setting menu provided by a camera application. As an example, the setting menu may be called by selecting a menu button that is one of the physical buttons under the first touch screen 12 on which the captured image 1502a is displayed.

As an embodiment, the mobile device stores a plurality of animations that can be used in the baby camera mode of the camera application, and while displaying the animation 1502d on the second touch screen 14 in the baby camera mode, the second touch screen ( 14), a previous or next animation (not shown) is displayed on the second touch screen 14 by detecting a predetermined touch gesture 1502d-1, for example, a left/right flick, a touch drag, or a sliding. indicate

Although not shown, the mobile device may display the captured image 1502a and the camera menu 1502b on one of the first and second touch screens, and display another application on the other. As an example, in the basic camera mode, the first touch screen 12 displays a captured image 1502a and a camera menu 1502b, and the second touch screen 14 displays other applications. As another example, in the selfie mode, the second touch screen 14 displays a captured image 1502a and a camera menu 1502b, and the first touch screen 12 displays other applications.

When the camera mode menu is not displayed, the camera application supports switching of the camera mode through the camera menu 1502b.

26A to 26C illustrate a scenario in which the camera mode is switched by the camera menu 1502b of the portable device. Here, it is shown that the touch screen on which the captured image 1502a is not displayed is turned off, but the following description is applicable even when other applications are displayed on the touch screen on which the captured image 1502a is not displayed. Of course.

Referring to FIG. 26A , the first touch screen 12 displays a captured image 1502a and a camera menu 1502b, and the second touch screen 14 is turned off. The camera menu 1502b includes function buttons such as a shutter button, a save image load button, a mode selection button 1508, a flash selection button, and the like. When a predetermined touch gesture 1510a, for example, a tap gesture, is detected on the mode selection button 1508, the portable device proceeds to FIG. 26B .

Referring to FIG. 26B , the mobile device displays a camera mode menu window 1512 for changing a camera mode on a captured image 1502a of the first touch screen 12 in response to detection of a touch gesture 1510a. . The camera mode menu window 1512 includes check boxes 1512a, 1512b, 1512c, and 1512d corresponding to a plurality of camera modes, for example, a basic camera mode, a selfie mode, a dual camera mode, and a baby camera mode. . When a tap gesture 1510b is detected on one of the check boxes 1512a-1512d in the self-camera mode check box 1512b, the mobile device proceeds to FIG. 26C .

Referring to FIG. 26C , the mobile device displays a captured image 1502a and a camera menu 1502b on the second touch screen 14 in response to detection of the tap gesture 1510b, and displays the first touch screen 12 turn off As another embodiment, when another application is being displayed on the second touch screen 14 before the camera mode is changed, the first touch screen 12 displays the other application in response to the detection of the tap gesture 1510b. can do.

Although not shown, when a tap gesture is detected on the dual camera mode 1512c in the camera mode menu window 1512, the mobile device captures the captured image 1502a of the first touch screen 12 as shown in FIG. 25I . A captured image 1502c without a camera menu is displayed on the second touch screen 14 while maintaining the camera menu 1502b and the camera menu 1502b. Also, when a tap gesture is detected on the baby camera mode 1512d in the camera mode menu window 1512, the mobile device displays the captured image 1502a of the first touch screen 12 and the camera menu ( While maintaining 1502b), the previously stored animation 1502d is displayed on the second touch screen 14 .

26D to 26G illustrate a scenario in which a camera mode is switched by a touch of a touch screen on which a captured image is not displayed.

Referring to FIG. 26D , the first touch screen 12 displays a captured image 1502a and a camera menu 1502b, and the second touch screen 14 is turned off. The first panel 2 provided with the first touch screen 12 and the second panel 4 provided with the second touch screen 14 are in a folded state. When a predetermined touch gesture 1510c, for example, two touches (double touch) or two taps (double tap) occurring substantially simultaneously on the turned-off second touch screen 14 is detected, the mobile device Proceed to Fig. 26E.

Referring to FIG. 26E , the mobile device includes mode buttons 1504a, 1504b, 1504c, and 1504d corresponding to a plurality of camera modes on the second touch screen 14 in response to detection of the touch gesture 1510c. The camera mode menu 1504 is displayed. When first displayed, the camera mode corresponding to the captured image 1502a of the first touch screen 12 of the camera mode menu 1504, in the illustrated example, the default camera button 1504a corresponding to the default camera mode is highlighted .

When a predetermined touch gesture 1510d, eg, a tap gesture, is detected on one of the other mode buttons in the camera mode menu 1504, eg, the selfie button 1504b, the portable device proceeds to FIG. 26F .

Referring to FIG. 26F , the mobile device switches to the selfie mode in response to the detection of the touch gesture 1510d and displays the captured image 1502a and the camera menu 1502b on the second touch screen 14, and the first Turn off the touch screen 12 . When a predetermined touch gesture 1510e, for example, two touches (double touch) or two taps (double tap) occurring substantially simultaneously on the turned-off first touch screen 12 is detected, the mobile device Proceed to Figure 26g

26G , the mobile device includes mode buttons 1504a, 1504b, 1504c, and 1504d corresponding to a plurality of camera modes on the first touch screen 12 in response to detection of a touch gesture 1510e. The camera mode menu 1504 is displayed. When the camera mode menu 1504 is displayed, a camera mode corresponding to the captured image 1502a of the second touch screen 14 of the camera mode menu 1504, that is, the selfie button 1504d is highlighted. Similarly, when a tap gesture for the dual camera button 1504c or the baby camera button 1504d on the camera mode menu 1504 is detected, the mobile device displays the captured image and animation of the corresponding camera mode on the first and second touch screens ( 12,14).

26H to 26J show scenarios of timer shooting. Hereinafter, a scenario of the basic camera mode will be described, but as an embodiment, counts and captured images may be displayed on the sub screen as well as the main screen in all camera modes during timer shooting.

Referring to FIG. 26H , the first touch screen 12 displays a captured image 1502a and a camera menu 1502b, and the second touch screen 14 is turned off. The first panel 2 provided with the first touch screen 12 and the second panel 4 provided with the second touch screen 14 may be in a folded state. The camera menu 1502b of the first touch screen 12 includes a timer shooting button 1514 . When a tap gesture 1510f is detected on the shutter button 1516 while timer shooting is selected using the timer shooting button 1514 , the mobile device proceeds to FIG. 26I .

Referring to FIG. 26I , the mobile device displays the count window 1518a on the captured image 1502a of the first touch screen 12 in response to the detection of the tap gesture 1510f. At the same time, the mobile device displays the captured image 1502e on the second touch screen 12 and displays the count window 1518b on the captured image 1502a. Initially, the two count windows 1518a and 1518b display a preset maximum timer value N, for example 5. As shown in FIG. 26J , the count windows 1518a and 1518b on the first and second touch screens 12 and 14 simultaneously decrement the timer value by 1 every predetermined unit (eg, 1 second). When the timer value reaches 0 after N seconds, the mobile device automatically operates the camera module while feeding back a shooting sound effect to automatically perform shooting. In this case, the timer value 0 may not be displayed.

Although not shown, a save screen may be displayed on the first and second touch screens 12 and 14 while the photographic image taken immediately after photographing is stored in the memory of the portable device. When the storage is performed quickly, the display of the storage screen may be omitted. After the photo image is stored, the mobile device returns the first and second touch screens 12 and 14 to the state before the photographing as shown in FIG. 26H as shown in FIG. 26K. In this case, a miniaturized thumbnail image 1502f of the photo image taken immediately before may be included in the camera menu 1502b on the first touch screen 12 .

27 (including FIGS. 27A to 27Q) exemplifies a change in a view mode according to a physical movement of a portable device according to an embodiment of the present invention.

27A to 27C illustrate a scenario in which the folded portable device is unfolded.

Referring to FIG. 27A , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in a folded state, that is, a state in which the relative angle is 0 degrees, and the first The touch screen 12 displays a first application 1602, for example, a photo gallery application, and the second touch screen 14 is turned off. Only the first touch screen 12 is displayed until the first and second panels 2 and 4 are slightly unfolded and the relative angle is increased to a predetermined critical angle, for example 60 degrees. When the first and second panels 2 and 4 are further unfolded 1600a and the relative angle reaches 60 degrees, the portable device proceeds to FIG. 27B .

Referring to FIG. 27B , in response to the unfolding 1600a of the first and second panels 2 and 4 , the mobile device displays a running second application 1604 on the second touch screen 14 , such as music Displays the playback application. When the mobile device detects the unfolding 1600a of the first and second panels 2 and 4 but there is no other running application, the mobile device displays the second touch screen 14 as shown in FIG. 27C . The first page 1606a of the home screen and the dock area 1606b are displayed.

27D to 27E illustrate a scenario in which the unfolded portable device is folded.

Referring to FIG. 27D , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in an unfolded state, that is, a relative angle of substantially 180 degrees. The screen 12 displays the first work screen 1604a of the second application, and the second touch screen 14 displays the second work screen 1604 of the second application. Here, the second work screen 1604 is a screen designated as having a final depth of the second application. As an example, the second application is a music playback application, the first operation screen 1604a is a music list screen, and the second operation screen 1604 is a music playback screen. When the first and second panels 2 and 4 are folded 1600b so that the relative angle is reduced to less than a predetermined critical angle, for example, 60 degrees, the portable device proceeds to FIG. 27E .

Referring to FIG. 27E , the mobile device turns off the second touch screen 14 in response to the folding 1600b of the first and second panels 2 and 4 , and connects to the first touch screen 12 . A work screen 1604 designated as the final depth of the second application being driven is displayed. After the relative angle of the first and second panels 2 and 4 becomes less than 60 degrees, the first and second touch screens 12 and 14 are maintained until they reach 0 degrees.

27F to 27G illustrate another scenario when the unfolded portable device is folded.

Referring to FIG. 27F , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in an unfolded state, that is, a relative angle of substantially 180 degrees, and the first touch The screen 12 is displaying the third application 1608 , and the second touch screen 14 is displaying the second application 1604 . As an example, the third application 1608 is a game application, and the second application 1604 is a music playback application. When the first and second panels 2 and 4 are folded 1600c and the relative angle is reduced to less than a predetermined critical angle, for example 60 degrees, the portable device proceeds to FIG. 27G .

Referring to FIG. 27G , the mobile device turns off the second touch screen 14 in response to the folding 1600c of the first and second panels 2 and 4 , and connects the first and second panels 2 and 4 to the first touch screen 12 . A third application 1608 that is running is maintained. After the relative angle of the first and second panels 2 and 4 becomes less than 60 degrees, the first and second touch screens 12 and 14 are maintained until they reach 0 degrees.

27H and 27I illustrate a scenario in which the folded portable device is unfolded in the landscape mode rotated 90 degrees to the left.

Referring to FIG. 27H , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in a folded state, that is, a relative angle of 0 degrees. The touch screen 12 displays a first application 1602, for example, a photo gallery application, and the second touch screen 14 is turned off. Only the first touch screen 12 is displayed until the first and second panels 2 and 4 are slightly unfolded and the relative angle is increased to a predetermined critical angle, for example 60 degrees. When the first and second panels 2 and 4 are further unfolded (1600d) so that the relative angle is greater than 60 degrees and less than or equal to 180 degrees, the portable device proceeds to FIG. 27I .

Referring to FIG. 27I , in response to the unfolding 1600d of the first and second panels 2 and 4 , the mobile device displays a running second application 1604 on the second touch screen 14 , such as music Displays the playback application. When the mobile device detects the unfolding 1600d of the first and second panels 2 and 4 but there is no other running application, the mobile device displays the second touch screen 14 as shown in FIG. 27J . The first page 1606a of the home screen and the dock area 1606b are displayed.

27K to 27M illustrate scenarios in which the folded portable device is unfolded in the landscape mode rotated 90 degrees to the right.

Referring to FIG. 27K , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in a folded state, that is, a relative angle of 0 degrees, and in the landscape mode, the first The touch screen 12 displays a first application 1602, for example, a photo gallery application, and the second touch screen 14 is turned off. Only the first touch screen 12 is displayed until the first and second panels 2 and 4 are slightly unfolded and the relative angle is increased to a predetermined critical angle, for example 60 degrees. When the first and second panels 2 and 4 are further unfolded (1600e) so that the relative angle is greater than 60 degrees and less than or equal to 180 degrees, the portable device proceeds to FIG. 27L .

Referring to FIG. 27L , in response to the unfolding 1600e of the first and second panels 2 and 4 , the mobile device displays a second application 1604 running on the second touch screen 14, as an example, music. Displays the playback application. When the mobile device detects the unfolding 1600e of the first and second panels 2 and 4 but there is no other running application, the mobile device displays the second touch screen 14 as shown in FIG. 27M . The first page 1606a of the home screen and the dock area 1606b are displayed.

27N to 27P illustrate scenarios in which the unfolded portable device is folded in the landscape mode.

Referring to FIG. 27N , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in an unfolded state, that is, a relative angle of substantially 180 degrees. The screen 12 displays the first work screen 1604 of the second application, and the second touch screen 14 displays the second work screen 1604a of the second application. Here, the first work screen 1604 is a screen designated as having a final depth of the second application. As an example, the second application is a music playback application, the first operation screen 1604 is a music playback screen, and the second operation screen 1604a is a music list screen. When the first and second panels 2 and 4 are folded (1600f) so that the relative angle is reduced to less than a predetermined critical angle, for example 60 degrees, the portable device proceeds to FIG. 27o.

Referring to FIG. 27O , the mobile device turns off the second touch screen 14 in response to the folding 1600f of the first and second panels 2 and 4 , and attaches the first and second panels 2 and 4 to the first touch screen 12 . A work screen 1604 designated as the final depth of the running second application is displayed. After the relative angle of the first and second panels 2 and 4 becomes less than 60 degrees, the first and second touch screens 12 and 14 are maintained until they reach 0 degrees.

27P and 27Q illustrate another scenario when the unfolded portable device is folded in the landscape mode.

Referring to FIG. 27P , the first and second panels 2 and 4 provided with the first and second touch screens 12 and 14 are in an unfolded state, that is, a relative angle of substantially 180 degrees, and the first touch The screen 12 displays the first application 1602 , and the second touch screen 14 displays the second application 1604 . As an example, the first application 1602 is a photo gallery application, and the second application 1604 is a music playback application. When the first and second panels 2 and 4 are folded (1600g) so that the relative angle is reduced to less than a predetermined critical angle, for example 60 degrees, the portable device proceeds to FIG. 27q.

Referring to FIG. 27Q , the mobile device turns off the second touch screen 14 in response to the folding 1600g of the first and second panels 2 and 4 , and connects the first and second panels 2 and 4 to the first touch screen 12 . Maintains the running first application 1602 . After the relative angle of the first and second panels 2 and 4 becomes less than 60 degrees, the first and second touch screens 12 and 14 maintain the displayed information until reaching 0 degrees.

Meanwhile, although specific embodiments have been described in the detailed description of the present invention, various modifications are possible without departing from the scope of the present invention. Therefore, the scope of the present invention should not be limited to the described embodiments and should be defined by the claims described below as well as the claims and equivalents.