Scenario synchronization between main display and auxiliary display of communication device

Mobile communication devices (mobile communication devices, mobile phones) are typically referred to as the primary display (also known as the primary display) and the secondary display (also known as the secondary display) that convey information to the user. It has both. For example, clamshell flip-style mobile devices often have an auxiliary display on the outside of the device and a larger main display that can be seen when the device is opened. The user can instantly collect information from the auxiliary display to determine the status of the device without opening it. For example, the calling phone number is displayed on the auxiliary display so that the user can choose to open the device and answer the call. Auxiliary displays involve a large number of potential hardware / software interactions and user scenarios (user behavior), so improving the user experience requires efficient and intuitive interaction. Sex is essential.

<p> The present invention is directed to methods and systems for synchronizing scenarios in mobile communication devices that allow users to complete tasks initiated or directed from an auxiliary display on a primary display. Auxiliary displays provide quick access to useful information such as time, date, battery life, signal strength, new messages, and calendar reminder. When opening a communication device (eg, a two-fold flip-up device) to take advantage of the primary display, the user does not have to navigate to a particular application to complete the initiated task. For example, an unattended schedule alert from the auxiliary display is displayed on the main display when the communication device is opened.</p><p> In one aspect of the invention, an event (event, event) is received by a communication device having an auxiliary display and a primary display. Information related to the event is displayed on the auxiliary display. The application corresponding to the event is launched on the main display. Information related to the event is displayed on the main display. In addition to the information displayed on the auxiliary display, when using the main display, application-related functions and information can be used on the main display.</p><p> In another aspect of the invention, the communication device scenario synchronization system includes an auxiliary display, a primary display coupled to the auxiliary display, and an application. The application is launched when an event occurs on the communication device. Information related to the event is displayed on the auxiliary display. When using the main display, in addition to the information displayed on the auxiliary display, application-related functions and information can be used on the main display.</p>

Briefly, the methods and systems for synchronizing scenarios on communication devices allow users to complete tasks started or directed on the auxiliary display on the primary display. Auxiliary displays provide quick access to useful information such as time, date, battery life, signal strength, new messages, and schedule alerts. When opening a communication device (such as a flip-up device) to access a primary display, the user does not have to navigate to a particular application to complete a task that has already been started. For example, an unattended schedule alert from the auxiliary display is displayed on the main display when the communication device is opened.

<u style="single">Illustrative operating environment</u> FIG. 1 is a functional block diagram showing an embodiment of an exemplary communication device that implements the present invention. In one embodiment of the present invention, the communication device 100 is implemented as a mobile communication device such as a personal digital assistant (PDA) or a smartphone (highly automatic function telephone). Communication devices 100 include handheld computers (handheld-sized computers), tablet computers, personal computers, multiprocessor systems, microprocessor-based or programmable home appliances, network PCs, wearable computers, and the like. ..

The communication device 100 can include more components than in FIG. However, the components of this figure are sufficient to disclose exemplary embodiments in which the present invention is practiced.

As shown in this figure, the communication device 100 includes a processor 102, a memory 104, a display 106, and a keypad 108. The memory 104 generally includes both volatile memory (RAM, etc.) and non-volatile memory (ROM, flash memory, etc.). Communication device 100 includes an operating system 110 such as Microsoft's Windows® CE operating system or other similar operating system, which resides in memory 104 and runs on processor 102. The keypad 108 is a push-button type numerical dial pad (such as a general telephone), a multi-key keyboard (such as a conventional keyboard), or the like. The display (display unit) 106 can be a liquid crystal display or another type of display commonly used in mobile communication devices. For example, the display 106 can be touch-sensitive, in which case it also functions as an input device that allows input of FE (format control character) language strokes. In one embodiment, the communication device 100 includes a primary display and an auxiliary display.

One or more application programs 112 are loaded into memory 104 and run on operating system 110. Examples of application programs include telephone dialing programs, content managers, e-mail programs, scheduling programs (scheduling programs), word processing programs (document processing programs), table calculation programs, smart filters (programs that filter junk mail), etc. Is included. The communication device 100 also includes the non-volatile storage 114 in the memory 104. The non-volatile storage 114 can be used to store permanent information that should not be lost when the communication device 100 is turned off. Application program 112 is used in appointment information and word processing applications used in scheduling programs, such as email or other messages used in email applications, contact information and databases used by content managers. Information in storage 114, such as a document, can be used and such information can be stored in storage 114. The sync application can also reside on the communication device 100 and interact with the corresponding sync application resident on the host computer to synchronize the information stored in storage 114 with the corresponding information stored on the host computer. Programmed to keep.

The communication device 100 also includes a power supply 116 that can be implemented as one or more batteries. The power supply 116 can further include an external power source such as an alternating current adapter or a powered docking cradle that assists or charges the battery.

In this figure, the communication device 100 is shown together with two types of external notification mechanisms, an LED (light emitting diode) 118 and an audio interface 120. These devices can be directly connected to power supply 116 and when booted are indicated by their notification mechanism even if the processor 102 and other components may be powered off to save battery power. Keep the power on for hours. The LED 118 can be programmed to remain powered on indefinitely until the user performs some action to indicate that the device has been powered on. The audio interface 120 is used to provide an audible signal (acoustic signal) to the user and receive the audible signal from the user. For example, the audio interface 120 can be coupled to a speaker that provides audible output and a microphone that receives audible input, such as to aid in telephone conversations.

The communication device 100 can also include a wireless interface layer 122 that functions to transmit and receive radio frequency communication. The wireless interface layer 122 assists in wireless connection between the communication device 100 and the outside world through a carrier or service provider. Transmission to and from the wireless interface layer 122 takes place under the control of operating system 110. That is, the communication received by the wireless interface layer 122 can be propagated to the application program 112 via the operating system 110 and vice versa.

The wireless interface layer 122 enables the communication device 100 to communicate with other computing devices via a network or the like. The wireless interface layer 122 is an example of a communication medium. Communication media can typically be implemented as modulated data signals such as carrier waves or other transport mechanisms by computer readable instructions, data structures, program modules, or other data, including any information transmission medium. The term "modulated data signal" means a signal in which one or more of its characteristics are set or changed in such a way that information is encoded in the signal. By way of example, but not limited to, communication media include wired media such as wired networks and direct wiring connections, and wireless media such as sound waves, RF (radio frequency), infrared, and other radio media. As used herein, the term "computer-readable medium" includes both storage and communication media.

<u style="single">Scenario synchronization between main display and auxiliary display</u> Scenario synchronization is characterized by allowing the user of the communication device to easily complete a given task initiated from the auxiliary display on the primary display. An event occurs on the communication device, and information related to the event is displayed on the auxiliary display. Events relate to, for example, telephone applications (such as incoming or outgoing messages, caller identification), information applications (such as schedule alerts), or user-initiated applications (such as camera and music applications). The user can start tasks related to the event on the auxiliary display. The device automatically navigates to the appropriate location in the user interface (UI) when opened, allowing the user to complete the initiated task. Users are also provided with access to more information and features related to the task.

For example, if a communication device is opened while the notification is still active on the auxiliary display, the notification will be displayed on the primary display with more information. The primary display provides the user with the opportunity to respond to notifications or dismiss warnings. If the user dismisses the warning before opening the device, the main display will be updated accordingly.

Scenario synchronization enables easy and intuitive UI (user interface) navigation on communication devices with auxiliary displays. For more complex and feature-rich devices, smart operation is essential to improving and maintaining an advanced user experience. Scenario synchronization gives users seamless access to the right information and features. Scenario synchronization includes additional features such as imaging and music on communication devices, especially as tasks such as finding playlists and adjusting camera settings are becoming as common as responding to notifications. It becomes even more important when it is done.

Figure 2 shows an exemplary functional block diagram of a system that synchronizes scenarios between the auxiliary display of a communication device and the main display. The communication device 200 includes an auxiliary display 210, a main display 220, a hardware button 230 associated with the auxiliary display 210, a hardware button 240 associated with the main display 220, a processor 250, and a memory 260. The auxiliary display 210 is connected to the main display 220. The hardware button 230 is connected to the auxiliary display 210. The hardware button 240 is connected to the main display 220. The processor 250 and the memory 260 are connected to the main display 220 and the auxiliary display 210. Memory 260 includes storage 270, application 280, and operating system 290 running on processor 250 and running application 280.

When an event (event, event, incident) occurs in the communication device 200, the application 280 corresponding to the event is started. Events include tasks initiated from auxiliary displays such as notifications (such as incoming calls), alerts (such as schedule alerts), or user-initiated applications (such as media applications). The event identifier associated with the event is displayed on the auxiliary display 210 to inform the user that the event has occurred. The user can operate the hardware button 230 to interact with the application 280 on the auxiliary display 210. Alternatively, the user can open the communication device 200 to utilize the main display 220.

When the user opens the communication device 200 (such as a flip-up device), application 280 is launched on the main display 220. Scenario synchronization provides the user with the opportunity to take advantage of features and information on the main display 220 that is not available from the auxiliary display 210. Therefore, users do not have to navigate through the UI to find the information and features they need. The user can operate the hardware button 240 to interact with the application 280 on the main display 220.

FIG. 3 shows an exemplary auxiliary display and an exemplary primary display of a communication device, such as the communication device 300, for scenario synchronization of a calendar reminder. Auxiliary display 310 includes notification tray 320 and status text 330. The notification tray 320 is a space in which the user can quickly refer to important information for seeking it. The notification tray 320 is located at the top of the auxiliary display 310 and provides a predictable place for notification icons such as battery life and signal strength icons.

The status text 330 can convey to the user information such as the next visit appointment on the user's calendar. The status text 330 can also provide additional information related to the notification icon, using text and up-to-date information to assist with the current notification, such as "low battery".

The main display 340 is larger than the auxiliary display 310. The main display 340 includes a notification tray 350 and a status text 360. In one embodiment, the notification tray 350 follows the example of the notification tray 320 displayed on the auxiliary display 310. The status text 360 includes information further added to the information notified by the status text 330 on the auxiliary display 310.

When the communication device 300 receives the notification, information about the notification is displayed on the auxiliary display 310. For example, as shown in this figure, at 9:45 am, the auxiliary display 310 shows an appointment notification for the upcoming 10 am visit. Since the user has not rejected (cancelled) this notification from the auxiliary display 310, the scenario is synchronized with the main display 340. The status text 360 on the main display 340 provides more information about the notification (purpose and location of the visit). Users are also provided with access to more functions (menu softkeys).

Scenario synchronization includes new message notifications (short message service, multimedia message service, email, etc.), incoming calls, new voice mail, and modified settings related to media applications (camera, music playback list, etc.), etc. , Can also be used for other types of notifications.

Figure 4 shows an exemplary auxiliary and primary display of a communication device for scenario synchronization of media content such as music applications. Auxiliary display scene (screen shot) 400 shows the auxiliary display when the communication device is in the default state. In one embodiment, the name of the owner of the communication device is shown in the status text area and notification icons indicating battery life, signal strength, ringtone volume, and time of day are displayed in the notification tray.

Users can interact (exchange information) with the contents of the auxiliary display with hardware buttons near the auxiliary display. For example, pressing the hardware button 402 changes the status text on the auxiliary display to indicate the next visit appointment as shown in scene 410 on the auxiliary display. The user can press the hardware button 412 to open the music application from the auxiliary display, as shown in scene 420 of the auxiliary display.

Pressing the hardware button 422 opens the music application and displays the first item in the music list on the auxiliary display, as shown in scene 430 on the auxiliary display. In the example in this figure, the first item in the music list is "Workout Mix". The user can press the hardware button 432 to play the "Workout Mix". The user can also press the hardware button 434 to see the next item in the music list on the auxiliary display. When the hardware button 436 is pressed, the auxiliary display returns to scene 420 of the auxiliary display.

The user can open the communication device to see the main display. Scene 440 on the main display shows various playlists available in the user's music list. The transition from scene 430 on the auxiliary display to scene 440 on the main display is an example of scenario synchronization. The user can select the desired music playlist from the main display.

Scene 450 on the auxiliary display shows the currently playing song and the corresponding playlist with which the song is associated. The user can pause the song by pressing the hardware button 452. The user can also press the hardware button 454 to advance to the next song, or press the hardware button 456 to return to the previous song.

The user can select a particular song without using the hardware buttons 452, 454, 456 by opening the communication device and looking at the main display. Scene 460 on the main display shows various songs available in the "Workout Mix" playlist. In this example, the user can select a song from "Workout Mix" in sync with the scenario because it is the playlist currently being played on the communication device. As shown in this figure, the user has selected the first song in the playlist ("Spin Me Right ...").

Scene 470 on the auxiliary display indicates that the first song in the playlist "Workout Mix" has been selected. In this example, the user pauses the song by pressing the hardware button 472. When the hardware button 472 is pressed, the music continues playing. By pressing the hardware button 474, the user can exit the music mode of the communication device and return to the previous communication device status such as the next visit schedule. The user can also exit the music mode of the communication device and proceed to the next communication device status by pressing the hardware button 476.

Figure 5 shows an exemplary auxiliary and primary display of a communication device for synchronizing media content scenarios such as camera applications. Auxiliary display scene 500 shows an auxiliary display when the communication device is in the default state. When the hardware button 502 is pressed, the status text on the auxiliary display changes to show the next visit appointment as shown in scene 510 on the auxiliary display.

The user can press the hardware button 512 to navigate to the camera application from the auxiliary display. The user is then prompted to launch the camera application, as shown in scene 520 on the auxiliary display. The camera function of the communication device is activated by pressing the hardware button 522. As shown in scene 530 of the auxiliary display, the auxiliary display can be used as a viewfinder or live preview. By pressing the hardware button 532, the user can capture the image shown on the auxiliary display without opening the communication device. The user can also press the hardware buttons 534 and / or 536 to exit the camera application and access other communication device features such as upcoming visits.

Scenario synchronization allows the user to open a communication device and make additional camera settings for scene 540 on the main display that are not available from the auxiliary display. For example, the user can select the menu softkey 542 to adjust camera viewfinder settings such as zoom.

When you take a picture from the auxiliary display, the captured image is displayed in scene 550 on the auxiliary display. The user can reject the captured image and return to the live preview by pressing the hardware button 552. In one embodiment, pressing the hardware buttons 554 and / or 556 returns the auxiliary display to live preview without rejecting the captured image. In another embodiment, pressing the hardware buttons 554 and / or 556 allows the user to view recently captured images on the auxiliary display.

FIG. 6 is an operation flow diagram illustrating the process of synchronizing the scenario between the main display and the auxiliary display of the communication device. This process begins at step 600, when the communication device is powered on and booted in its default state. Processing then proceeds to block 610.

At block 610, an event occurs on the communication device. An event is a task initiated on an auxiliary display, such as a notification (such as an incoming call), a warning (such as a schedule alert), or a user-initiated application (such as a media application). Processing continues to block 620.

At block 620, the event identifier is displayed on the auxiliary display of the communication device. The event identifier informs the user that an event has occurred. For example, an event identifier associated with a schedule alert can display the time and significance of an upcoming visit on an auxiliary display. The process proceeds to the determination block 630.

In the determination block 630, it is determined whether or not the user has opened the communication device. If the user opens the communication device, the process proceeds to block 640. If the user has not opened the device, the process proceeds to block 650.

At block 640, the application related to the event is shown on the main display. For example, if a communication device is opened while a media application is active on the auxiliary display, the media application will appear on the primary display. Scenario synchronization provides users with the opportunity to take advantage of key display features and information that are not available from the auxiliary display. Therefore, users do not have to navigate through the UI to find the information and features they need. Processing continues to block 680.

At block 650, the user interacts with what is displayed on the auxiliary display using the hardware associated with the auxiliary display. In one embodiment, the hardware includes a button on the surface of the communication device. The user can operate the button to launch an application on the auxiliary display and interact with it. The process moves to the determination block 655.

The determination block 655 determines whether the user has rejected the event identifier from the auxiliary display. If the user rejects the event identifier, the process terminates in termination block 695. If the user has not rejected the event identifier, the process proceeds to decision block 660.

In the determination block 660, it is determined whether or not the user has opened the communication device. If the user has not opened the device, processing ends at end block 695. If the user has a communication device open, processing proceeds to block 670.

At block 670, applications related to what is shown on the auxiliary display are launched on the main display. For example, if the auxiliary display contains content associated with a schedule alert, the schedule application will be launched on the primary display when the communication device is opened. The scheduling application provides additional information and features about scheduling alerts that, when displayed on the main screen, do not appear on the auxiliary display. Processing proceeds to block 680.

At block 680, the user interacts with what is displayed on the main display using the hardware associated with the main display. In one embodiment, the hardware includes a button associated with the softkey of the communication device. The user operates this button to interact with the application launched on the main display. The process proceeds to the determination block 690.

At block 690, information related to what is displayed on the main display is displayed on the auxiliary display. For example, if the content displayed on the main display is a playlist of music, the relevant information displayed on the auxiliary display may include the currently playing song and the title of the playlist. The process ends at the end block 695.

The above detailed description, illustration, and data provide a complete description of the fabrication and use of the configurations of the present invention. The present invention lies within the scope of the claims, as many embodiments of the invention can be made without departing from the gist and scope of the invention.

<figref num="1">It is a functional block diagram which shows the embodiment of the exemplary communication device which carries out this invention.</figref><figref num="2">FIG. 6 is an exemplary functional block diagram of a system for synchronizing scenarios between an auxiliary display of a communication device and a main display according to the present invention.</figref><figref num="3">It is a figure which shows the exemplary auxiliary display and exemplary main display of a communication device relating to scenario synchronization of a schedule alert application according to the present invention.</figref><figref num="4">It is a figure which shows the exemplary auxiliary display and main display of the communication device concerning the scenario synchronization of a music application by this invention.</figref><figref num="5">It is a figure which shows the exemplary auxiliary display and main display of the communication device concerning the scenario synchronization of a camera application according to this invention.</figref><figref num="6">It is operation flow diagram explaining the process of synchronizing a scenario between a main display and an auxiliary display of a communication device according to this invention.</figref>

Code description

102 Processor 104 Memory 106 Display 108 Keypad 110 Operating System 112 Application 114 Storage 116 Power Supply 118 LED 120 Audio Interface 122 Wireless Interface Layer 200 Communication Device 210 Auxiliary Display 220 Main Display 230, 240 Hardware Button 250 Processor 260 Memory 270 Storage 280 Application 290 Operating System 300 Communication Device 310 Auxiliary Display 320 Notification Tray 330 Status Text 340 Main Display 350 Notification Tray 360 Status Text 400,410,420,430,450,470 Auxiliary Display Scene 440,460 Main Display Scene 402,412,422,432,434, 436, Hardware Button 452,454,456,472,474,476 Hardware Button 500,510,520,530,550 Auxiliary Display Scene 540 Main Display Scene 502,512,522,532,534 Hardware Button 536,552,554,556 Hardware Button 542 Menu Softkey-