Multi-application environment.

IMPI ¹ í

<img file="MX349039B_D0001.tif" />

PATENT TITLE No. 349039

Owner (s): MICROSOFT TECHNOLOGY LICENSING, LLC

Address: One Microsoft Way, Redmond, Washington, 98052, USA

Name: MULTIPLE APPLICATION ENVIRONMENT.

Classification: CIP: G06F9 / 44; GOOF 3/14 ^ 0613 ^ 48.

CPC: G06F9 / 4443; GD6F3 / 017; GÓ6F3 / Q4817; G06F3 / 04842; G06F3 / 04883

Inventor (s)

ROBERT O JARRETT; JES $ E_TO* * CtAY ANDERSON; MUG YAN W0HG * 4p ^

ILS A. SUNDELIN; BRET P. ÍENh PATRICE L. MINER; *

National number:

:3

Λ .1&gt; '

PgíYES

US

18,339

Validity: Twenty years

Date of E ^^ mciónfYde JtApad ^ pl?

Άί »......... '

The patent of referenat ^^ wga with fúndamete enjos artia

In accordance with artigo &amp; ¿fe the Law of International Property from the date of submission of the application intém ^ ciciMI and

SUJI ySíteleTeyde la Industrial.

me prteffie veir ^ told to vigorasJfWechos.

<img file="MX349039B_D0002.tif" />

Whoever signs this title is funiStieaig, (Official Gazette of the Federation .F,) · 27 / 0B / 1991, 25/01/2006, 06/05 / 2009,06 / 01/2010, M®6 / 2 ^ 0 , 18 / 0ββ &lt;Regulation of the Mexican Institute dMarRcgpi ^ fad M articles 1, 3, 4, 5 fraction V subsection a), 16., fi ^ C6ionei 12/27/1999, amended 10/10/2002 , 29 / O7 / á) (W ^ 4 / 0Bi Adjunct Generals, Coordinator, Divinar Departmental Directors and other subordinates of the Mexii Institute 08/04/2004 and 09/13/2007).

what 1 012

994, tufe Mi AcÍBi bis2 of the Industrial Property Law 7ΦΛ5 / 1999, 01/26/2004, 06/16/2005, ^to). 4 'and 12' fractions I and III of £&gt; 0 ^ 7/2004, 28/07/2004 and 7/09/2007); Industrial Property Manager (DO F. i, which delegates powers to Industrial Directors:

ales, Divisional Deputy Directors, Coordinators 12/5/1999, amended on 02/04/2000, 07/29/2004,

This document is signed with an advanced electronic signature (FIEL), based on articles 7 BIS 2 of the Industrial Property Law; 3 of its Regulations, and 1 section III, 2 section V, 26 BIS and 26 TER of the Agreement establishing the guidelines for the use of the Payment and Electronic Services Portal (PASE) of the Mexican Institute of Industrial Property, in the procedures indicated

THE DIVISIONAL DIRECTOR OF PATENTS

NAHANNY CANAL REYES

<img file="MX349039B_D0003.tif" />

Original string:

NAHANNY MARISOL CANAL REYES | 00001000000403252793 | Administration Service

Tax | 1695 || MX / 2017/58925 | MX / a / 2013/013923 | PCT patent title | 1027 | RGZ | Page (s)

2 | 2s / 7ND2sY5HNh8S4ZDsQ15wz38Q =

Digital stamp:

uZIMAaAu0XdGqafk2KVopHqeDySTLCwjUWWgmHkLg8v0VdqSYj¡TzvCwUWrfB3S / oXnWqlMilo24x77E6QE9x2j3Pr qSupq2UQ / MqthqhoYxpF3LSJ5CtpiY10mJ1qeoJ4vUsV5mgz8WzdskZLTuwkKOHLph5XEpgqfwQJ71BD64kxMUmK2a 3AmlRjNrOC6gssJ3aa63w3KrmKhc + iMygfCwmr3g98Y4iw9vGs + 2BsGeZwVE / MMEVM61rEwzjLAe + NJ7noqRE4ZthU

LzSgW3zQ003WSn0jw3JxqZs2 + E9YgNQGIfSqExC / E7cAHD5H7Oa1q4D8IRJvAMNzNSZ6oA7A— * Additional information on reverse

Arenal No 550. Floor 1, Pueblo Santa María Tepepan, Xochimilco, 16020, Mexico City.

(55) 53340700 www.gob.mx/impí llllllllllllll

MX / 2017/58925

<img file="MX349039B_D0004.tif" />

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL CURRENCY

MULTIPLE APPLICATION ENVIRONMENT ''

BACKGROUND

Conventional operating systems allow users to view multiple computer applications through windows. Each of these windows generally includes a box that has controls for interacting with the compute application as well as controls for selecting which window box is parent or is moving, sizing, and otherwise managing the window layout. These window boxes, however, occupy portions of a presentation that may otherwise be dedicated to application content. Furthermore, managing the domain or layout of these windows through these controls can be time consuming and annoying for users.

BRIEF DESCRIPTION OF THE INVENTION

This document describes techniques and apparatus that allow for a multiple application environment. The multiple application environment described herein can present multiple applications without dedicating significant amounts of a screen to window boxes for the applications and / or requiring handling of window boxes, size, location, or dominance over the presentation. In some modalities these techniques and devices allow multiple application environments

IMPI msTmrr&gt; msscano of the norm »DAi&gt; INMISTIUAL

<img file="MX349039B_D0005.tif" />

that have immersive interface combinations, window-based interfaces, and a desktop treated as an immersive interface. Also, in some embodiments the techniques and apparatus allow the management of applications in the multiple application environment, such as to size and move interfaces within the environment. Furthermore, some modalities allow the handling of applications that have previously been interacted with that are not currently presented. In addition, some modalities of the techniques allow the management of applications and their interfaces, whether they are currently presented or not, through margin gestures or a user interface management menu.

This Brief Description is provided to introduce simplified concepts that are further described in the Detailed Description below. This Brief Description is not intended to identify essential characteristics of the claimed subject matter, nor is it intended for use in determining the scope of the claimed subject matter. Reference is also made here to techniques and / or apparatus that allow a multiple application environment separately as a set as in the "techniques" as allowed by the context, although techniques may include or in turn represent other aspects described herein.

BRIEF DESCRIPTION OF THE DRAWINGS

Modalities are described that allow an environment of

IMPI

IWJTTTUTO MUlCANC

OF INDUSTIUAL HOUSEHOLD

<img file="MX349039B_D0006.tif" />

Multiple application with reference to the giHL ± iontpg drawings. The same numbers are used throughout the drawings to refer to similar features and components:

Figure 1 shows an illustrative system in which techniques that allow for a multiple application environment can be implemented.

Figure 2 shows an illustrative method of allowing margin gestures, the margin gestures are approximately perpendicular to a margin at which gesture begins.

Figure 3 shows an illustrative tablet computing device having a touch-sensitive screen that features an immersive interface.

Figure 4 shows the illustrative immersive interface of Figure 3 along with illustrative margins.

Figure 5 shows the illustrative immersive interface of Figures 3 and 4 along with angular variation lines from a perpendicular line and the line from a starting point to a later point of a gesture.

Figure 6 illustrates the margins of the immersive interface shown in Figure 4 along with 2 regions on the right margin.

Figure 7 illustrates an application selection interface presented by a system interface module in response to a right margin gesture on the immersive interface and the web page of Figure 3.

Figure 8 shows an illustrative method of allowing gestures

INDUSTRIAL -— Margin including determining an interface to present based on a gesture factor.

Figure 9 illustrates illustrative method that allows expansion of, or suspension of presentation of, a presented user interface in response to a margin gesture or presentation of another user interface.

Figure 10 illustrates a laptop computer that has a touch-sensitive screen that has a window-based email interface and two immersive interfaces.

Figure 11 illustrates the interfaces of Figure 10 along with two gestures that have a starting point, later points, and one or more successive points.

Figure 12 illustrates the window-based email interface of Figures 10 and 11 along with an email handling interface displayed in response to a margin gesture.

Figure 13 illustrates the interfaces of Figure 12 along with an additional email options interface presented in response to a certain gesture to have a successive point at a preset distance from the margin.

Figures 14 illustrate a method of switching back to a previously interacted application using a queue or row.

Figure 15 illustrates an illustrative interaction order in which a user interacts with various applications.

Figure 16 illustrates the immersive interface of Figure 3 together

<img file="MX349039B_D0007.tif" />

with a thumbnail image of a user interface from — αΊΤ3Τ previous application. ,

Figure 17 illustrates a method of switching back to a previously interacted application, which may or may not use a queue or row.

Figure 18 illustrates the immersive interface of Figures 3 and 16, two progressive displays, and two gesture portions.

Figure 19 illustrates a method that enables a multiple application environment, including altering the sizes of multiple immersive interfaces in response to a single selection.

Figure 20 illustrates a desktop computing device of Figure 1 having a touch screen shown presenting a multi-application environment with two immersive interfaces divided by an interface dividing region.

Figure 21 illustrates the multiple application environment of Figure 20 with the sizes of the two immersive interfaces altered and the interface divider region moved.

Figure 22 illustrates a method of presenting an immersive interface of an application in a region in response to as little as a selection and in a size that completely occupies the region.

Figure 23 illustrates a current immersive interface that fully occupies a multi-application environment that has three regions.

Figure 24 illustrates the multiple application environment of the

Figure 23 with a reduced size immersive interface instead of the current immersive interface in Figure 23 and a second immersive interface.

Figure 25 illustrates a method for managing a multiple application environment through a user interface.

Figure 26 illustrates a multiple application environment that has primary and non-primary regions.

Figure 27 illustrates the multiple application environment of Figure 26 that includes a user interface management menu.

Figure 28 illustrates a method that enables the presentation of a desktop as an immersive interface within a multi-application environment.

Figure 29 shows an illustrative multi-application environment that has an immersive desktop interface that features window-based interfaces and a taskbar along with an immersive interface that presents content.

Figure 30 illustrates a method that allows content presentation and / or multi-application environment management.

Figure 31 shows an illustrative device in which techniques that allow for a multiple application environment can be implemented.

DETAILED DESCRIPTION

General view

This document describes techniques and apparatus that allow a

<img file="MX349039B_D0008.tif" />

multiple application environment. The multiple application element described herein can present multiple applications without dedicating significant amounts of a window box presentation to the applications and / or requiring the handling of window boxes, such as their size, location, or domain in the presentation. In some modalities, these techniques and devices allow multiple application environments that have combinations of immersive interfaces, window-based interfaces, and a desktop treated with an immersive interface. Also, in some embodiments, the techniques and apparatuses allow the handling of applications currently presented in the multiple application scope, such as to size and move interfaces within the environment and to select previously interacting applications that are not currently presented. These other forms of management are allowed, in some modalities, through margin gestures made through the multiple application environment or a user interface management menu.

These are just a few examples of the many ways in which techniques allow for a multiple application environment, others of which are described below.

Illustrative system

Figure 1 illustrates an illustrative system 100 in which techniques that allow a multiple application environment can be depicted. System 100 includes a computing device 102, illustrated

<img file="MX349039B_D0009.tif" />

<img file="MX349039B_D0010.tif" />

with six examples: a laptop 104, a dign, p &lt;; it · »^ d? · tablet computer 106, a smartphone 108, a cable tv box 110, a desktop computer 112, and a games 114, although other computing devices and systems, such as servers and netbooks, can also be used.

The computing device 102 includes a computer processor (s) 116 and computer-readable storage media 118 (media 118). Means 118 includes an operating system 120, window-based mode 122, multiple application environment module 124, system interface module 126, gesture handler 128, application manager 130, which includes or has access to a queue or row 132, manager 134, and one or more applications 136, each having one or more application user interfaces 138.

The computing device 102 also includes or has access to one or more displays 140 and input mechanisms 142. Four illustrative displays are illustrated in Figure 1. Input mechanisms 142 may include gesture-sensitive sensors and devices, such as touch-based sensors and motion-tracking sensors (eg, camera-based), as well as mice (standalone or integrated with a keyboard), tracking pads , and microphones with attached speech recognition software, to name a few. Input mechanisms 142 may be separate or integrated with displays 140; comprehensive examples include presentations

<img file="MX349039B_D0011.tif" />

gesture-sensitive with built-in touch — or sewyibles' · β · motion-sensitive sensors.

The window-based mode module 122 presents application user interfaces 138 through windows having boxes. These boxes can provide controls through which to interact with the application and / or controls that allow a user to move and readjust the window.

The multiple application environment model 124 provides an environment whereby a user can view and interact with one or more of the applications 136 through application user interfaces 138. The multiple application environment 124 may have one or more interfaces of application user 138 in conjunction with the window-based mode model 122. The multiple application environment 124 may also or rather present one or more application user interfaces 138 as immersive interfaces.

An immersive interface, in some modalities, presents content from, and allows interaction with, applications with or with no window boxes, without the need for a user to manage a window box layout or domain in relation to other windows (for example , which window is active or open), without the need for a user to manually size or position application user interfaces 138, and / or without presenting visual controls (for example, permanent controls on a window box or on content that darkens the window).

<img file="MX349039B_D0012.tif" />

IMPI

MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY

The multiple application environment allows multiple application environment module 124 can be, but is not required to be, hosted and / or covered without the use of a window-based desktop environment. Thus, in some cases the multiple application environment module 124 presents a multiple application environment with an immersive environment, and thus without a window (even one without a substantial frame) and / it avoids the use of similar presentations. to desktop (for example, a taskbar). Furthermore, in some modalities this multiple application environment is similar to an operating system in that it cannot be closed or is capable of being uninstalled. Although not required, in some cases this multi-application environment allows the use of all or nearly all of the pixels of a presentation by applications within the multi-application environment.

Examples of multi-application environments, some of which include only immersive interfaces and some of which include a window-based interface or a desktop treated as an immersive interface, are provided below, although they are not exhaustive or are intended to limit the techniques here described.

The system interface module 126 provides one or more interfaces through which interaction with the operating system 120 is allowed, such as an application launch interface, a start menu, or a menu of system tools or options. , to name just a few.

<img file="MX349039B_D0013.tif" />

The operating system 120, modules 122 124, and 126, as well as the gesture handler 128, application manager 130, and manager 134 may be separate from each other or combined or integrated in any suitable way.

Illustrative Methods

Illustrative methods 200, 800, and 900 direct margin gestures, Illustrative methods 1400 and 1700 direct the switch back to a previously interacted application, Illustrative methods 1900 and 2200 direct the handling of an immersive interface in a Multiple application environment, Illustrative Method 2500 directs the management of a multiple application environment through a user interface, method 2800 handles a desktop treated as an immersive interface within a multiple application environment, method 3000 handles content presentation and / or management of a multiple application environment.

The methods can be used separately or in combination with each other, in whole or in part. For example, techniques can use a margin gesture to allow selection, sizing, and switching of interfaces currently in a multi-application environment. Techniques can also select pre-interacting apps using an app queue, with or without a margin gesture. In addition, the techniques can automatically size multiple interfaces in selection of an application with which to interact

<img file="MX349039B_D0014.tif" />

IMPI

INSTITUTO MEXICANO DE LA MONEDAD INDUSTRIAL previously through an application queue or row or in. response, to a selection to move or alter a currently displayed interface.

Margin gestures

Figure 2 illustrates a method 200 for allowing margin gestures based on the margin gesture that is approximately perpendicular to a margin at which the gesture begins. In portions of the following discussion, reference may be made to the system 100 of Figure 1 and other illustrative methods and embodiments described elsewhere herein, referred to only by example.

Block 202 receives a gesture. This gesture can be received in various parts of the presentation, such as through a window-based interface, an immersive interface, or no interface. In addition, this gesture can be made and received in various ways, such as a pointer that tracks a movement received through a touch pad, mouse, or follow ball or a physical movement made with arm (s), finger (s), or a finger. stylus received through a movement-sensitive or touch-sensitive mechanism.

As an example consider Figure 3, which illustrates a tablet computing device 106. The tablet 106 includes a touch-sensitive screen 302 shown presenting an immersive interface 304 that includes a web page 306. As part of a current example, at block 202 the gesture handler 128 receives

IMPI

MMUCAN INSTITUTE

DELAMOHEDAt

INBUrntlAI

<img file="MX349039B_D0015.tif" />

to gesture 308 as shown in Figure 3.

Block 204 determines if a starting point of the gest ^ is in a margin. As noted above, the margin in question can be a margin of a user interface, either immersive or window-based, and / or of a presentation. In some cases, of course, a margin of the user interface is also a margin of a presentation. The size of the margin may vary based on various factors regarding the presentation or interface. A small display or interface may be smaller in absolute or pixel size than a large display or interface. A highly sensitive input mechanism also allows for a smaller margin. Illustrative margins are rectangular and vary between one and twenty pixels in one dimension and an interface boundary of the interface or screen in another dimension, although other sizes and shapes may be used in turn, including convex and concave margins.

Continuing with the current example, consider Figure 4, which illustrates the immersive interface 304 and gesture 308 of Figure 3 as well as left margin 402, top margin 404, right margin 406, and inside margin 408. For visual clarity not shown in web page 306. In this example the interface and screen dimensions are moderate in size, between that of smartphones and that of many laptop and desktop screens. Margins 402, 404, 406, and 408 have a small dimension of twenty pixels, one area of ​​each shown surrounded by lines

<img file="MX349039B_D0016.tif" />

dotted at twenty pixels from the boundary of_.panLAÍa de-intei fas'S * at the margin boundary 410, 412, 414 and 416, respectively. Although shown overlapping at the corners, the margins may in turn be mitered at the corners or one margin may be favored over another (for example, margin 404 is favored over margin 406 and a corner starting point is received that is overlap).

The gesture manipulator 128 determines that the gesture 308 has a starting point 418 and that this starting point 418 is within the left margin 402. The gesture manipulator 128 determines the starting point in this case by receiving data indicating coordinates [ X, Y] in pixels in which the gesture 308 begins and comparing the first of these coordinates with those pixels contained within each margin 402, 404, 406 and 408. The gesture manipulator 128 can often determine the starting point and whether it is in a range faster than a sample rate, thereby causing little or no performance to degrade from techniques that simply pass gestures directly to an exposed interface over which a gesture was made.

Returning method 200 generally, if block 204 determines that the starting point of the gesture is not in a margin, method 200 proceeds along a "No" path to block 206. Block 206 passes the gestures to a user interface exposed, such as an underlying interface on which the gesture was received. Altering the current example, assume that gesture 308 was determined

5 MDUCANO INSTITUTE

OF REOPIETY ^ ω / ί'γβΐ * INDUSTRIAL ..-- not to have a starting point within a margin. In such a case the gesture handler 128 passes buffered data for the gesture 308 to the immersive user interface 304. The gesture is then passed with the method 200 terminates.

If block 204 determines that the starting point of the gesture is in a margin, method 200 proceeds along a "Yes" path to block 208. Block 208 responds to the positive determination of block 204 by determining whether a line from the starting point to a posterior point the gesture is roughly perpendicular from the margin.

Block 208, in some embodiments, determines the back point used. The gesture manipulator 128, for example, may determine the back point of the gesture based on the back point that is received at a preset distance from the margin or the starting point, such as passing the margin limit 410 for the margin 402 or twenty pixels from starting point 418, all from Figure 4. In some other embodiments, the gesture handler 128 determines the back point based on it being received at a preset time after the starting point reception, such as a slightly longer amount of time than is generally used by the computing device 102 to determine that a gesture is a hit and hold or float gesture.

For the current mode, the gesture handler 128 uses a post received point of gesture 308 received outside the range.

402 as long as the subsequent received point is received within

<img file="MX349039B_D0017.tif" />

a preset time. If - p ··· - * »L.nm margin was not received within that preset time, gesture handler 128 proceeds to block 204 and passes gesture 308 to immersive interface 304.

Using the starting point, block 208 determines whether a line from the starting point to the back point of the gesture is approximately perpendicular to the margin. Various angles of variation can be used in this determination by block 208, such as 5, 10, 20, or 30 degrees.

As an example, consider an angle of variation of 30 degrees from the perpendicular. Figure 5 shows this illustrative variation, showing immersive interface 304, gesture 308, left margin 402, left margin boundary 410, and starting point 418 of Figures 3 and 4 along with 30 degree variation lines 502 from the perpendicular unit 504. Thus, the gesture manipulator 128 determines that the line 506 from the starting point 418 to the back point 508 (which is approximately 20 degrees from the perpendicular) is approximately perpendicular based on being within the variation line of 30 Illustrative 502 degrees.

Generally, if block 208 determines that the line is not approximately perpendicular to the margin, method 200 proceeds along a "No" path to block 206. As noted in part above, block 208 may also terminate a later point. another aspect of a gesture disqualify gesture.

<img file="MX349039B_D0018.tif" />

IMPI

INSTITUTO MEXICANO DE LA nOPISDA »INDUSTRIAL

Examples include when a back point is within the margin. such as due to a float, tap, press and hold gesture, or up and down (for example, to scroll content in the user interface), or when the gesture is set to be a single input gesture and is they receive input (for example, a first finger starts at one margin but a second finger then lands elsewhere).

If block 208 determines that the line is approximately perpendicular based on a back point outside the range, method 200 proceeds along a "Si" path at block 210.

Block 210 responds to the positive determination of block 208 by passing the gesture to an entity other than the exposed user interface. This entity is not an inferred user on which the gesture is received, assuming it was received on a user interface at all. Block 210 may determine which entity to pass the gesture to as well, such as based on a margin or region of a margin in which the starting point of the gesture was received. Consider Figure 6, for example, which illustrates the immersive interface 304 and margins 402, 404, 406, and 408 of Figure 4 but adds the upper region 602 and lower region 604 to the right margin 406. A starting point in the region Upper 602 may result in a different entity (or even the same entity but a different user interface provides in response) than a starting point received in lower region 604. Similarly,

<img file="MX349039B_D0019.tif" />

IMPI

INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL a starting point in the upper margin 404 may result in a different entity or interface than the left margin 402 or lower margin 408.

In some cases, this entity is an application associated with the user interface rather than an application or associated with the user interface, such as a system entity or a different application. In such a case, passing the gesture to the entity may be effective in causing the application to present a second user interface that allows interaction with the application. In the movie example above, the entity may be the media player that plays the movie but not the immersive interface that the movie presents. The media player may then present a second interface that allows the selection of subtitles or a director's comment instead of selections allowed by the interface presenting the movie, such as "pause", "play", and "stop". This capability is allowed in Figure 1, where one of the applications 136 may include or be capable of presenting more than one application user interface 138. In this way, block 210 can pass the gesture to the system interface module. 126, one of the applications 136 currently presented by the user interface, or another of the applications 136, to name just three possibilities.

Concluding the current mode, at block 210 the gesture handler 128 passes the gesture 308 to the system interface module 126. The system interface module 126 receives the

<img file="MX349039B_D0020.tif" />

IMPI Mexican iNsrrruTo

DE LA MOHEDAL industrial portion saved in the buffer memory of the gesture 308 and continues to receive the rest of the gesture 308 as it is done by the user. The

Figure 7 illustrates a possible response upon receiving the gesture 308, showing an application selection interface 702 presented by the system interface module 126 and through the immersive interface 304 and web page 306 from Figure 3. The application selection interface 702 allows the selection of various other applications and their respective interfaces in selectable application titles 704, 706, 708, and 710.

Illustrative application selection interface 702 is an immersive user interface presented using the multiple application environment module 124, although this is not required. The interfaces presented in turn can be window-based and presented using window-based mode module 122. Both modules are illustrated in Figure 1.

Block 210 may also or rather determine to pass the gesture to different entities and / or interfaces based on other factors about the received gesture. Illustrative factors are written in more detail in method 800 below.

Note that method 200 and other methods described hereinafter can be performed in real time, such as while a gesture is being made and received. This allows, among other things, a rendered user interface to be presented in response to a gesture before the end of the gesture. In addition, the user interface can be progressively presented as gestures are received. This enables a user-friendly experience of the user interface from the margin as a gesture is performed with the user interface that appears to “stick” to the gesture (for example, to a mouse or finger pointer). of the person making the gesture).

Figure 8 illustrates a method 800 for allowing margin gestures including determining an interface to present based on some factor of the gesture. In portions of the following discussion, reference may be made to the system 100 of Figure 1, which is referred to only by example. Method 800 may act wholly or partially separately from or in conjunction with other methods described herein.

Block 802 determines that a gesture made through a user interface has a starting point at a margin of the user interface and a later point not within the margin. Block 802 may operate similarly to or use aspects of methods 200, such as exerting a later point upon which to base the determination of block 802. Block 802 may also act differently.

In case, for example, block 802 determines that a gesture is an individual finger sweep gesture that starts at a margin of an exposed immersive user interface and has a back point not in the margin but based on an angle of the gesture. . Based on this determination, block 802 proceeds to block 804 instead of passing the gesture to the immersive user interface.

<img file="MX349039B_D0021.tif" />

exposed. __________

Block 304 determines which interface to present based on one or more factors of the gesture. Block 804 may do so based on a final or intermediate length of the gesture if the gesture is a Single or multiple point (eg, a single finger or multiple fingers gesture), or a speed of the gesture. Thus, block 804 may determine to present a home menu in response to a multi-finger gesture, an application selection interface in response to a relatively short individual finger gesture, or a system control interface that allows selection. to close the computing device 102 in response to the relatively long single finger gesture, for example. To do this, the gesture manipulator 128 may end the length of the gesture or a number of inputs (eg, fingers). In response, block 806 presents the determined user interface.

Assume, by way of example, that the gesture manipulator 128 determines, based on a gesture factor, to present a user interface allowing interaction with an operating system 120. In response, the system interface module 126 presents this interface of Username. The presentation of the user interface may be similar to forms described in other methods, such as with an application selection user interface progressive screen 702 of FIGS. 7.

Following method 200 and / or method 800 in whole or in part, the

<img file="MX349039B_D0022.tif" />

Technicians can proceed to perform the method 900 of Figure 9. The method 900 allows expansion of a user interface, presentation of another interface, or suspension of presentation of the user interface presented in response to a margin gesture.

Block 902 receives a successive point of the gesture and then the presentation of the least some portion of the second user interface. As noted in part above, the methods 200 and / or 800 are capable of presenting or causing to be presented a according user interface, such as a second user interface for my application associated with a current user interface, a different application , to a system user interface.

As an example, consider Figure 10, which illustrates a laptop computer 104 that has a touch sensitive screen 1002 featuring a window-based email interface 1004 and two immersive interfaces 1006 and 1008. The window-based email interface 1004 is associated with an application that handles email, which can be remote or local to the laptop 104. Figure 10 also illustrates the gestures, 1010 and 1012. Gesture 1010 proceeds in a straight line while gesture 1012 returns (shown with two arrows to show two directions).

Figure 11 includes the gesture 1010 that has a starting point 1102, a back point 1104, and a successive point 1106, and gesture 1012 that has the same starting point 1102, a point

<img file="MX349039B_D0023.tif" />

back 1108, and a first successive point 1110; and Ull üéJVnao successive point 1112. Figure 11 also shows a lower margin 1114, a posterior point area 1116, and an interface addition area 1118.

Block 904 determines, based on the successive point, whether the gesture includes a dip, an extension, or neither. Block 904 may determine a dip by determining that a successive point is on the margin or closer to the margin than a previous point of the gesture. The method 904 may determine that the gesture extends based on the successive point that is a reestablished distance from the margin a later point. If none of these are determined to be true, method 900 may repeat blocks 902 and 904 to receive and analyze additional successive points until the gesture ends. If block 904 determines that a dip exists, method 900 proceeds along the "Invert" path to block 906. If block 904 determines that the gesture is extended, method 900 proceeds along a path of "Extension to block 908.

In the context of the present example, assume that the gesture handler 128 receives the first successive point 1110 of the gesture 1012. The gesture handler 128 then determines that the first successive point 1110 is not in the margin 1114, it is not closer than a gesture's previous point at the margin 1114 (for example, it is not closer than the posterior point 1108), and is not at a preset distance from the margin a posterior point by not being within

<img file="MX349039B_D0024.tif" />

IMPI nWrnVTO MMICAHO OF THE IWDtRTWAl HkORtTY of the interface addition region 1118. In such a case, method 900 returns to block 902.

In a second repetition of block 902, assume that gesture handler 128 receives the second successive point 1112. In that case, the gesture handler 128 determines that the second successive point 1112 is closer to the margin 1114 than the first successive point 1110 and thus the gesture 1012 includes an inversion. The gesture handler 128 then proceeds to block 906 to suspend the presentation of the second user interface previously presented in response to the gesture. As an example, consider Figure 12, which illustrates an email handling interface 1202. In this illustrative case of block 906, the gesture handler 128 causes the email application to suspend presentation of interface 1202 in response. to a reversal of gesture 1012 (not shown removed).

Block 908, however, presents or causes the presentation of a third user interface or expansion of the second user interface. Continuing with the current example, consider Figure 13, which illustrates an interface of additional email options 1302 in response to the gesture 1010 determined to have the successive point 1106 at a preset distance from the margin 1104, in this case it is within the 1118 interface cleavage region of Figure 1. This preset region and distance can be set based on a size of the user interface previously displayed in response to the gesture.

<img file="MX349039B_D0025.tif" />

IMPI

INSTITUTO MEXICANO DEIAMIOHEDAD INDUSTRIAL

That way, a user who wants to add JUILlUflclléá ^ control panels can simply extend the gesture by passing the user interface presented in response to a previous portion of the gesture.

Method 900 can be repeated to add additional user interfaces or expand a displayed user interface. Returning to illustrative interface 702 of Figure 7, for example, gesture handler 128 may continue to add interfaces or controls to interface 702 as gesture 308 extends past interface 702, such as when presenting a group additional selectable application tiles. If the gesture 308 extends past the additional tiles, the gesture handler 128 may cause the system interface module 126 to present another adjacent interface between the tiles to allow the user to select controls, such as sleep mode, hibernation. , change modes (immersive window-based and inverse), or turn off computing device 102.

Although the above illustrative user interfaces presented in response to a margin gesture are opaque, they can also be partially transparent. This can be helpful by not obscuring the content. In the film example described above, a displayed user interface may be partially transparent thereby allowing the film to only partially darken during use of the user interface. Similarly, in the example of Figures 12 and 13, interfaces 1202 and 1302 may be partially transparent,

<img file="MX349039B_D0026.tif" />

consequently allowing a user to view the text of the email while also selecting a control on one of the interfaces.

As noted above, the illustrative methods 200,

800, and 900 take care of margin gestures and are described before methods 1400 and 1700, which take care of switching back to a previously interacted application. Any one or more of the method may be used separately or in combination with, in whole or in part, other of the methods.

Switching Back to a Previously Interactive Application

Figure 14 illustrates a method 1400 for switching back to a previously interacted application using a queue. Reference may be made in portions of the following discussion to the system 100 of Figure 1 and other illustrative methods and embodiments described elsewhere herein, to which only reference is made for example.

Block 1402 maintains a queue or row of multiple interacting applications, the queue arranged by most recently interacted applications to those last interacted with other than a current application. Consider, for example, Figure 15, which illustrates an interaction order 1502 in which a user interacts with various applications. First, the user interacts with a

IMPI

INSTITUTO MEXICANO ^ ​​C * S88 ^^ 4 DE LA PIOHEDAB industrial '• ¿-Yes- web search application 1504 through its interface. Second, the user interacts with web-enabled media application 1506 through a web browser. Third, the user interacts with a local (non-web) photo application 1508 through its interface. Fourth, the user interacts with a social network application 1510 through the web browser. Fifth, the user returns to interact with a web-enabled media application 1506. Sixth, the user interacts with a web-enabled news application 1512 again via web browser.

No row is maintained for the first interaction since no other application has been interacted with prior to this first interaction. For the second through sixth interactions of interaction order 1502, consider queues or rows 1514, 1516, 1518, 1520, and 1522, which correspond to each interaction in interaction order 1502 after the first interaction, respectively. Queues 1514 to 1522 are illustrative repeats according to application 132 maintained by application manager 130, both from Figure 1.

As shown in Figure 15, the application manager 130 keeps the application queue 132 updated based on user interactions. Queue 1522, for example, includes media app 1506 as the most recently interacted app, followed by social media app 1510, photo app 1508, and ending with app app.

IMPI fXSTnvi »mkican DE LA NOHEDAS nioumui.

web search 1504. Since the user interacts with the media application 1506 twice (in the second and fifth interaction) the application manager 130 moves it from the application queue 132 in the fifth interaction and reorders the other applications to reflect a Updated order of interactions but excluding applications that are currently being interacted with.

Block 1404 receives a gesture portions of gesture. This gesture or portions of gesture may include one or more of the various gestures or portions described elsewhere herein, such as a pointer that tracks a movement received via a touch pad, mouse, or follow ball or a physical movement made with an arm. (s), finger (s), or stylus received through a sensitive touch-sensitive movement mechanism. In some embodiments, gesture portions are received, each portion is part of a gesture, and each results in presentation of an application in the queue. Each of these portions may have, but is not required to have, a starting point at one screen margin, a back point not at the screen margin, and a successive point at the screen margin. A gesture that has multiple portions in this case would resemble a spiral of multiple loops, multiple circles, or back to front (e.g. zigzag) where each loop, circle, or back to front starts, stops, and returns. to the margin of a user interface or screen. Optionally, block 1404 may receive a number of gestures or gesture portions. These gestures or gesture portions may include one or more of the various gestures or gesture portions described herein in another oarfp - —j

Continuing with the current modality, consider again the

Figure 3, illustrating tablet computing device 106 having touchscreen 302 shown displaying immersive interface 304 including web page 306. For this example, assume that inquires interface 304 is associated with news application 1512 and that web page 306 is content from news app 1512.

As example parts, at block 1404, gesture handler 128 receives gesture 308 as shown in Figure 3, where gesture handler 128 passes to application manager 130. For the current example, assume that it is determined that Gesture 308 is associated with switching back to a previously interacted application rather than some other function or application.

Block 1406, in response to receiving the gesture or gesture portions, proceeds through the queue to another application of the multiple applications with which it interacts. Thus, upon receiving the gesture or portion (s) of the gesture, the application manager 130 can proceed to the first one, and thus to the one with which the applications in the application queue 132 are most recently interacted. In some embodiments, upon receiving two gestures or slices, the application manager 130 may proceed to the second most recently interacted application on the application queue 132, although the method 1400 may do so when

<img file="MX349039B_D0027.tif" />

repeat blocks 1404, 1406 and / or 1408, and abl '^ ULSSIVái'n'ente as described below.

Continuing with the current modality, assume that the gesture 308 is received after the sixth interaction at which time the application with which it is currently interacting is news application 1512 and that the application queue 132 is updated and represented by the queue 1522 of FIG. 15. In such a case, application manager 130 proceeds to media application 1506 upon receipt of the gesture or gesture portion.

Block 1408 presents a user interface associated with the other application. This user interface, in some modalities, the same user interface through which the interaction with the application was previously made. In some embodiments, the user interface is presented as a miniature or transparent overlay on the currently displayed user interface. The application manager 130 presents this user interface alone or in combination with the associated application, such as by causing the associated application to present the user interface with which the user last interacted.

For this example, the application manager 130 displays a thumbnail image of the user interface for the application progressively as the gesture 308 is received and then the thumbnail is expanded to encompass the available property of the screen when the gesture ends. The application manager 130 thereby replaces the web page 306 in the immersive interface 304 or

<img file="MX349039B_D0028.tif" />

IMPI ixwmo MaucANo

Ite LA noniLM · l || jUniUA4 replace the immersive interface 304 with another int ^ rphase. claim to be immersive or window-based.

This is illustrated in Figure 16 with thumbnail image 1602 of a media application user interface 1506 displayed through the immersive interface 304 and the web page 306 of the news application 1512. After the gesture 308 ends, the thumbnail image 1602 is expanded into the media player 1604, replacing the web page 306 in the immersive interface 304. This is only an illustrative way to present the user interface for the selected application. elsewhere here other ways to respond progressively or otherwise.

In some embodiments, block 1408 shrinks the current user interface to a second thumbnail image and passes the second thumbnail image to a region of a screen from which the first-mentioned thumbnail image was progressively displayed. Thus, block 1408 expands thumbnail 1602 in media player 1604 while shrinking web page 306 to a thumbnail and passes that thumbnail to the margin from which thumbnail 1602 was selected.

During the presentation of the user interface at block 1408, another gesture or gesture portion may be received, returning to block 1404. In some cases, the other gesture or gesture portion was received within an amount of time while the item was presented. User interface through block 1408. Following the return to block 1404, block 1406 can then even proceed to an application

<img file="MX349039B_D0029.tif" />

different or subsequent of the multiple ap interacts. Continuing with this progress, block 1408 then presents a user interface associated with the subsequent application of the multiple applications that it interacts with.

Thus, by repeating blocks 1404, 1406, and 1408, user interfaces associated with previously interacted applications can be presented successively. In some cases, a user interface associated with a previously interacting application may be presented in response to each received gesture. In the context of the present example, when another gesture is received while presenting the user interface of the media application 1506, a user interface associated with the social network application 1510 is presented (the second application that was most recently interacted with queue 1522). Receiving even another gesture or gesture portion during the presentation of the user interface associated with social network application 1510 results in a presentation of a user interface associated with photo application 1508 (the third application that was interacted with very recently of queue 1522) and so on.

Following this change from presenting a current application to a previous, selected application presentation, block 1410 updates the queue in response to an interaction with, or a period of time that passes during the presentation of, the user interface associated with the other app. In some cases, a previous application can be selected and then another selected

<img file="MX349039B_D0030.tif" />

quickly after this, effectively a 'scan through' the applications in the queue. In such cases, block 1410 may abandon the queue update, since a quick watch cannot be considered an interaction.

Illustrative interactions with which the application manager 130 updates the application queue 132 include an explicit selection to interact with the newly presented interface, such as to control playback or edit information regarding currently playing media using controls displayed in the user interface of media player 1604 of Figure 16. In other cases an interaction is determined based on a period of time that passes. Assume, for example, that the news application web page is presented in selection rather than the current application. After a period, such as 1, 2, 3 seconds, for example, the application manager 130 determines that the delay is effectively an interaction based on a probability that the user is reading the news article on the web page. Similarly, the presentation of a user interface for a media application at block 1408 that is playing media and remains on the screen with no further selection of applications in the application queue 132 can also be considered an interaction.

As partially noted above, the application queue

132 it can be circular. When you do this, the application selection is not

<img file="MX349039B_D0031.tif" />

it stops but rather rolls if a user reaches an application that was less recently interacted with from the application queue 132. For example, when selecting to switch back to a previous application from the social network application 1510 and thus use queue 1510, switching back once results in selecting photo application 1508, twice results in media application 1506, and 3 times in web search application 1504. A fourth selection to switch back returns, in a circular fashion, to result again in presenting the photo application 1 508.

The 1400 method describes various ways in which the techniques can allow selection of previously interacted applications and determine which to present based on a queue. The 1700 method can work in conjunction with the 1400 method and other methods described here, although the use of a queue is not required. Therefore, method 1400 is not intended to limit the techniques as described in illustrative method 1700.

Figure 17 illustrates a method 1700 for switching back to a previously interacted application, which may or may not use a queue. In portions of the following discussion, reference may be made to the system 100 of Figure 1, methods 200, 800, 900, 1400, and illustrative embodiments described above, to which reference is made only for example.

Block 1702 allows the selection of an application with which previously interacted through a gesture made on a

IMPIAS

INSTITUTO MEXICANO K LA MOHEDA »

5 BIDUSTRIAl VJJJ?

current user interface associated with a cfctuifl app. ΈΙ block 1702 can do this in various ways described above, such as with a margin gesture or portion thereof, just as an example.

Block 1704, in response to receiving the gesture and without further selection, presents a previous user interface associated with the application that was previously interacted with.

Assume, for example, that a gesture portion is received in association with the selection of a previous application, such as a margin gesture starting at such a user interface margin and proceeding approximately perpendicularly away from the margin. In response, block 1704 displays the user interface for the previously interacted application or a thumbnail image of the interface, or some indicator that the selection has been made successfully along with an indicator of the application with the selected interface. .

Illustrative thumbnails or indicators include any of the selectable application tiles 704, 706, 708, and 710 of Figure 7, some of which include a thumbnail image of an interface while others indicate the selected application. Another example is thumbnail image 1602 in Figure 16.

Block 1704 presents the user interface of the application you previously interacted with, selected, as shown in Figure 16 on media player 1604. In doing so, the »

block 1704 can allow interaction with

1508 via immersive interface 304 without additional selection. In this way, a user after selecting, with as little as a gesture, a previous application can interact without the need to make another selection. The user does not need to select to exit the application selection mode, for example, or to make the interface presented "live" or primary or on top of the stack. Simply put, the techniques allow selection of a previous application and additional interaction with that previous application with individual input.

In this example of Figure 16, immediately after the media player 1604 is displayed and replaces the web page 306, a next entry is immediately passed from the immersive interface 304 to the photo application 1508. Thus, one hit, key key, or other input is passed directly to photo application 1508, thereby allowing immediate response by photo application 1508 to the input.

In some embodiments, the gesture made on the current user interface includes portions, each of which indicates a previous application selection. In such a case, block 1704 presents the previous user interface in response to the first portion and then, in response to block 1702 that receives the second portion of the gesture, presents an additional previous user interface associated with an application with which it interacted. previously additional, and so on.

This is illustrated in Figure 18, which features immersive inu - * »304 of Figure 16 (shown twice for visual clarity), and ways in which block 1704 can respond to multiple gestures or portions of an individual gesture. Figure 18 illustrates two progressive displays, 1802, 1804, and gesture 1806 having two gesture portions 1806-1 and 1806-2, respectively. The first progressive display 1802 illustrates a drag from a left margin of immersive interface 304 of thumbnail image 1602, and thereby selection of the photo application with which it previously interacted 1508. Note that thumbnail 1602 "sticks" to the gesture portion 1806-1. Also note that gesture 1806, different from gesture 308 in Figures 3 and 16, returns to the left margin. In response, instead of the gesture 308 ending and the media player 1604 replacing the web page 306, the gesture portion 1806-1 of the gesture 1806 returns to the margin in which it started. In this case the thumbnail 1602 is progressively displayed with the gesture portion 1806-1 but then disappears when the gesture portion 1806-1 returns to the margin.

The 1800 gesture is continuous with the second portion 1806-2. In response, block 1704 presents the second progressive display 1804, illustrating a second drag from the left margin of the immersive interface 304. Here a social network thumbnail 1808 of an additional previous application, social network application 1510, is progressively displayed The 1806 gesture returns to the left margin as part of the second portion q O USTTTUTO MEXICANO^J U noHWA »industrial

1806-2. In response, block 1704 discards thumbnail 1808 when gesture portion 1806-2 returns margin. This is just one example of the ways in which the techniques allow users to select and view previous applications, including all the applications that they previously interacted with, with just a single gesture. At any point in this example, gesture 1806 may terminate or indicate selection to present the entire user interface for the selected application, in which time block 1704 presents the user interface (e.g., media player 1604 of Figure 16 or a full user interface for the social network application).

As noted above, illustrative methods 200, 800, and 900 handle margin gesture and are described before methods 1400 and 1700, which handle switching back to an application that you previously interacted with, which in turn. Methods 1900 and 2200 are once described before. Any one or more of the method may be used separately or in combination, or in whole or in part, another of the methods.

Manage an Immersive Infer

Figure 19 illustrates a 1900 method that allows for a multiple application environment, including altering sizes of multiple immersive interfaces in response to individual selection. In portions of the following discussion, reference may be made to the system 100 of Figure 1 and other methods and modalities.

<img file="MX349039B_D0032.tif" />

Illustrative here described elsewhere, at loo oualu 30 '^ IIUUU¹* ^ reference only for example.

Block 1902 allows the selection to alter a first size of a first immersive interface of a first application presented in a multiple application environment where a second immersive interface of a second application is presented to a second size.

Block 1902 may allow this selection in various ways described above, such as with a gesture, either done through a gesture-sensitive screen or a track pad or mouse, or with a hardware button or key keys, to name only. Some.

Consider, by way of example, a case where block 1902 allows a selection of gesture of selecting and moving through the screen simple gesture, the gesture of selecting and moving from a dividing region to interface between immersive interfaces of an environment of multiple application. This example is illustrated in Figure 20, which illustrates a desktop computing device 112 having a touch screen 2002 shown displaying a multiple application environment 2004. The 2004 multi-application environment includes a 2006 larger immersive interface and 2008 smaller immersive interface separated by an 2010 immersive interface splitter. The 2006 larger immersive interface is associated with a word processing application and presents 2012 document content. The smallest immersive interface 2008 is associated with a software mapping application and features 2014 mapping content. As part of a current example, at block 1902 manager 134 receives gesture 2016 as shown in Figure 20, shown with an arrow but omitting an input actuator (eg, a finger or stylus).

Block 1904, in response to selection to alter the first size of the first immersive interface, being the first size of the first immersive interface and the second size of the second immersive interface. Block 1904, therefore, can alter the sizes of multiplex immersive interfaces in response to as little as a selection. In addition, block 1904 can do it concurrently and without hampering either interface.

As an example, consider the current example in Figure 20. In response to the select and move gesture 2016 of the interface divider region 2010, the manager 134 reduces one interface and increases the other concurrently, increasing the smaller immersive interface here. 2008 and decreasing, at the same time, the largest immersive interface 2006. The result of this alteration is illustrated in Figure 21 at the smallest altered immersive interface 2102 and the largest altered immersive interface 2104. The previous position of the interface divider region 2010 is shown at the previous position 2106. Also note that the 2016 select and move gesture starts at the previous position 2106 of the 2010 interface divider region and ends at the final position 2108

INSTITUTO MEXICANA PE LA FROMEDAD INDUSTRIAL in the interface dividing region 2010.

Note that in this example, the 2004 multi-application environment is fully occupied with immersive interfaces, both before and after altering immersive interface sizes, with no unused property or property obstructed with visible controls to handle immersive interfaces.

This particular example illustrates one way in which the techniques allow a user to select immersive interface sizes, here to augment a map displayed by the mapping application.

The techniques also allow users to “close” immersive interfaces to automatically populate a predetermined region of the 2004 multi-application environment. In doing so, gestures or other selections can be used that are quick and easy for users. Additionally, these regions can be predetermined across multiple devices, thereby allowing application developers to prepare for region sizes. This is especially useful for smaller region sizes, as smaller sizes are often more challenging to present in an easy-to-use form. Consider again Figure 20, for example, which illustrates a default small region width 2018, which here is 320 pixels wide. In this example, three regions are shown, two of which are subordinate in that they are included within a complete region. These regions have

<img file="MX349039B_D0033.tif" />

widths, 2018 width and 2020 remaining width for-1 as-rlo »* subordinate regions, and a full 2022 width of a complete region, all from a 2004 multi-application environment. Note that the remaining width 2020 may vary across screens , as can the full width 2022.

Block 1902 may also allow drag-and-drop selection of one of the immersive interfaces from one region to another region. In such a case, block 1904 may change the interfaces between the regions or automatically move a divider (eg, immersive interface divider 2010 of Figure 20) so that resulting sizes are changed. In doing so, the manager 134 automatically shrinks the largest immersive interface 2006 to fully occupy a region previously occupied by the smallest immersive interface 2008, and vice versa.

In some cases, the selection is allowed to alter an interface size through a margin gesture. Consider, for example, a margin gesture that starts at a larger immersive interface margin 2006 and has a back point not in the margin of the larger immersive interface 2006. The manager 134, alone or in conjunction with the gesture 128 and / or application manager 130, shrinks the 2006 largest immersive interface to a reduced size image. The selection to reset interface 2006, then, can be made by dropping the reduced size image onto the smaller immersive interface 2008. In response, the

<img file="MX349039B_D0034.tif" />

administrator 134 resizes both interfaces, -

The 1900 method describes various ways that allow a multiple application environment, including altering sizes of multiple immersive interfaces in response to individual selection. The 2200 method can work in conjunction with the 1900 method and other methods described here, although the use of a queue is not required. Therefore, method 1900 is not intended to limit the techniques as described in illustrative method 2200.

Figure 22 illustrates a method 2200 for presenting an immersive interface of an application in a region, including in response to as little as a selection and in a size that completely occupies the region. In portions of the following discussion, reference may be made to the system 100 of Figure 1, methods 200, 800, 900, 1400, 1700, and 1900, and illustrative embodiments described above, to which reference is made only by example.

Block 2202 allows selection to present an immersive interface of an application in one of multiple regions of a multiple application environment that presents one or more current immersive interfaces of one or more current applications. Block 2202 can do this in various ways described above, such as with a margin gesture or portion thereof, just as an example. In addition, the selected application may be an application that you previously interacted with, determined in various ways, such as by the administrator of

<img file="MX349039B_D0035.tif" />

application 130 that uses the queue or application row Φ92, -emboa of Figure 1.

The multi-application immersive interface may, at block 2202, feature one, two, or even three current immersive interfaces. Thus, block 2202 allows selection of an application to be placed in regions currently occupied or that exist but are occupied by a larger immersive interface, such as in cases where an immersive interface completely occupies a multiple application environment.

As an example, consider Figure 23, which illustrates a current immersive interface 2302 that occupies the multiple application environment 2304. Note here that there are three subordinate regions, 2306, 2308, and 2310. These regions may or may not be indicated. In cases where an application has been selected and is floated or moved over one of the regions, the region may be indicated with partially transparent immersive interface dividers 2312 and 2314. These three subordinate regions 2360, 2308, and 2310 fall within the full-size region 2316 which occupies substantially the entire multi-application environment 2304.

As an example, assume that the administrator 134 receives an application with which it interacted previously selected according to the method 1700 and following the example illustrated in Figure 18. In this case, assume that the thumbnail image 1808 for network application social 1510 is selected and floated over region 2306 (not shown but similar to Figure 18). In response, the

<img file="MX349039B_D0036.tif" />

Administrator 134 indicates which region 2306 is to be selected and the size of region 2306 by displaying the partially transparent immersive interface divider 2312.

Returning to method 2200, block 2204, in response to the selection to display the immersive interface in the region, presents the immersive interface in a size that completely occupies the region. Note that the user, with as little as an application selection, can select and have presented an immersive interface in a size that completely occupies a selected region.

Continuing with the example, consider Figure 24, which illustrates a multi-application environment 2304 but now with a reduced-size immersive interface 2402 instead of the current immersive interface 2302 of Figure 23, and with a second immersive interface 2404 showing a social network web page 2406 for social network application 1510 of Figure 15. The second immersive interface 2404 completely occupies the region 2306 and with no user selection other than the region selection.

Note that the layout of content in immersive interface of reduced size 2402 and social network web page 2406 change. The resizing can be done more quickly or allow better applications of content layouts and / or developers of those applications having these region sizes in advance, which are provided by the techniques as predetermined region widths. Here, the region width

<img file="MX349039B_D0037.tif" />

The default provided is the region .2 ^ .06., - although .. * can also be provided to a 2408 full-width region.

Following block 2204, method 2200 can repeat blocks 2202 and 2204, thereby allowing selection of additional immersive interfaces. For example, manager 134 may allow selection of a third immersive interface for presentation in region 2310 or 2308 of Figure 23. In response to such selection, manager 134 reduces the size of, or replaces, the reduced-size immersive interface 2402 .

Note that any of these methods can be combined in whole or in part. Thus, one gesture portion, for example, you can use to select an immersive interface and another portion of the same gesture selection to position and / or size the immersive interface. In response to this individual gesture, techniques can resize multiple interfaces currently presented in a multiple application environment.

User Interface for Managing a Multiple Application Environment

Figure 25 illustrates a method 2500 for managing a multiple application environment through a user interface. In portions of the following discussion, reference may be made to the system 100 of Figure 1 and other illustrative methods and embodiments described elsewhere herein, to which reference is made only by example.

<img file="MX349039B_D0038.tif" />

Block 2502 allows the selection of a user &lt;tinlei IdbU to handle a multiple application environment. Selection of the user interface can be done in various ways including those described above, such as with a gesture or portion of a gesture, hardware button or key, or voice command, just to name a few. Before selection, the user interface can be fully displayed, partially displayed, or not displayed at all. Consider, for example, a scenario where a multiple application environment is presented and the user interface is not presented. An example of such a scenario is illustrated in Figure 26, which shows screen 2600 and multi-application content 2602. Multi-application content 2602 includes a primary region 2604 and a non-primary region 2606, both of which have multiple applications. application content 136. Note that the non-primary region 2606 includes two non-primary sections 2608 and 2610, each of which can be used to present content in parallel with another and that of the primary region 2604. In this example, the content of three applications is presented in Parallel: content 2612 from a social network website, content 2614 from a news website, and content 2616 from a local document watching application.

Here the manager 134 of Figure 1 allows user interface selection with a non-visual selector, such as a key or gesture (eg, a margin gesture made to a right margin of the multiple application environment 302). In some other

<img file="MX349039B_D0039.tif" />

cases, however, the administrator 134 allows — The ». silenced or .. a. via a selectable, featured control.

Block 2504 displays the user interface in response to this selection. The user interface can be an immersive user interface or a semi-transparent overlay that allows additional selection. Through its user interface, block 2506 allows the selection of an application for parallel presentation in the multiple application scope.

This user interface allows one user to handle multiple application scope, although it can allow this in several ways. The user interface, for example, may allow a user to present, remove, or default an application to the user interface and / or environment, such as through the selection of tags associated with it, or representations of, the applications. The user interface can allow a user to select preferences for applications to be presented in the user interface, to alter the environment generally, or to switch to a multi-application environment. Furthermore, the user interface may present applications for selection based on various criteria, such as those that are very recently used or very frequently used by a user of computing device 102, as well as whether or not the application is currently running. Furthermore, the user interface can present a common group of system commands that pertain to an application, such as a user interface that

<img file="MX349039B_D0040.tif" />

allows you to search for commands, share content, and alter the environment. - Continuing with the current example, assume that the administrator 134 receives, through a gesture made on a touch screen of the 2600 screen, a selection to present the user interface . In response, manager 134 displays the user interface management menu 2700 illustrated in Figure 27, through which selection of applications is allowed. This illustrative 2700 user interface management menu presents icons and / or names for nine applications. The nine applications include various local web sites, services, and computer applications, and are called "Social Net", "News.com", "PDFs", "Telecon", "Music.com", "Movies.com", "Poker.com", "Art Space" and GPS Maps "at 2702, 2704, 2706, 2708, 2710, 2712, 2714, 2716, and 2718, respectively. As noted, other applications, such as those pertaining to system commands, may also be presented by the administrator 134. As an example, consider system commands 2719 displayed as a neighboring user interface management menu application 2700, called "Find Sharing Settings."

In this particular example, two applications, 2702 and 2704, are "docked." The pin icons, shown at 2720 and 2722, indicate that applications 2702 and 2704 will be maintained in one or both of the multiple application environment 2602 and in the user interface management menu 2700 (here indicates both). That way, both “Social Net” and “News.com” applications will be running and

<img file="MX349039B_D0041.tif" />

IMPI • «τιτυτο MMtlGANC _in M la rUiriDA »

OU INDUSTRY!

presenting content with some part of arrrbren + e — end the _ additional selection by the user (shown in sections 2608 and 2610, respectively). Note that the selection of maintained ("pinned") applications can be allowed by the administrator 134 in several ways, such as through the user interface management menu 2700 that presents the anchor selection icon 2724 for the selection of any of the applications. applications 2702-2718. As noted, any of the selectable applications may or may not be currently running, in this case applications 2702, 2704, 2706, and 2708 are running and applications 2710-2718 are not currently running.

The user interface management menu 2700 can also present applications based on other criteria, such as a user history. Applications 2706, 2708, 2710, and 2712, for example, are presented based on being the four most recently used by a user of computing device 102 (other than 2702 and 2704). Applications 2714, 2716 and 2718 are presented based on the most frequently used applications, excluding 2702-2712. In other cases, applications may be presented based on new content associated with the application that is available (for example, new emails, messages, or RSS feeds) or as other alerts are received for the application.

Furthermore, the user interface management menu 2700 allows the user to manage a multiple application environment 2602

<img file="MX349039B_D0042.tif" />

in addition to application handling, such r.nmn — with — a —- Joofie de— window selection 2726. Through this selection, the administrator 134 allows a user to select exit the multiple application environment 2602 and continues with the content currently featured using a window-based environment.

Returning to method 2500, block 2508, in response to selecting one or more applications, causes the content of the selected application to be presented in the multiple application environment in parallel with the presentation of content from a different application.

Method 2500 can receive multiple choices. In response to these multiple selections, block 2508 causes the content of each selected application to be presented in the multiple application environment. In such a case, the manager 134 may stream content from each of the selected applications or at the same time. In a serial case, consider the previous example but assume that application 2706 was selected in a previous iteration of block 2506 and, in response to this selection, manager 134 presented the content 2616 of application 2706 (as shown in the Figures 26 and 27). Following this selection from application 2706, subsequent replications of blocks 2506 and 2508 were performed. Serial presentation of the applications was allowed by administrator 134 at least through additional repetitions of block 2506 and 2508, shown as potentially repeating with a dotted line

<img file="MX349039B_D0043.tif" />

from block 2508 to block 2506. __

Desktop as an Immersive Interface in a Multiple Application Environment

Figure 28 illustrates a method 2800 that enables the presentation of a window-based desktop as an undeserved interface within a multi-application environment. In portions of the following discussion you may refer to the system 100 of Figure 1 and other illustrative methods and embodiments described elsewhere herein, to which reference is made only by example.

Block 2802 presents a desktop as an immersive interface within the multi-application environment. The multiple application environment, such as those described elsewhere herein, is configured to support access to multiple applications. In this way, a user can view content through an interface associated with an application (or multiple applications if multiple applications include interfaces on the desktop) and interact with that application through the interface, all through the multiple application environment. .

Block 2804 allows interaction with the immersive desktop interface. This interaction can be simultaneous with interactions allowed for other interfaces. Furthermore, this interaction can be through the multi-application environment and also includes window-based and window-based controls.

<img file="MX349039B_D0044.tif" />

IMPI «πτυτο mkicanc

OF THE RROnUMD industrial desktop, such as window box controls and a taskbar, respectively.

The window-based mode module 122 and the multi-application environment module 124, acting separately or in conjunction with the operating system 120 of Figure 1, for example, can treat an immersive desktop interface as one of the applications 134 and windows and taskbar, etc., as various examples of application user interfaces 138.

As an example, consider Figure 29, which illustrates tablet computing device 106 having an immersive desktop interface 2902 featuring window-based interfaces 2904 and taskbar 2906, and an immersive interface 2908 presenting content. 2910, all within the 2912 multi-application environment. The immersive desktop interface 2902 may also include representations (eg, icons) of executable applications within the immersive desktop interface 2902 and folder representations to support a hierarchical file structure of the computing device 102, just to name a few.

Additionally, the functionality provided within the immersive desktop interface 2902 may behave differently than other interfaces within the multi-application environment 2912, such as those common for window-based interfaces.

The 2806 method, in response to interaction, provides integration to an application within the immersive interface of

<img file="MX349039B_D0045.tif" />

IMPI

INSTITUTO MBUCANO

OF THE PHOF1EDAD XDUSTRIAL DESK. In some cases this includes passing a gooto o-po ^ tion.de .. gesture to an application that has a center interface of the immersive desktop interface, such as for operating system 120 for an interaction with the 2906 taskbar, or for an application associated with one of the 2904 window-based interfaces. In other cases this may include passing keystrokes to a primary (eg, open) window of 2904 window-based interfaces. In doing so, the techniques allow users to engage with common applications and interfaces for while window-based, desktop , while also allowing interaction with immersive interfaces and other operations in a multi-application environment.

An immersive desktop interface can be handled in a similar or identical way to those described elsewhere herein. A margin gesture, for example, can be used to select, move, or size an immersive desktop interface, such as immersive desktop interface 2902. Furthermore, an immersive desktop interface can behave as a single application as part of an application queue, and thus be selected or removed from a multiple application environment as observed for previous interfaces.

Multiple Application Environment

The techniques and apparatus described above allow for many different modalities of an application environment, - multiple, including while having one interface but allowing additional interfaces, multiple interfaces that are all immersive, multiple interfaces that are a mix of immersive and window-based interfaces , and a desktop treated as an immersive interface. In some embodiments, these multi-application environments allow selection of various additional menus or interfaces for systems and applications that offer additional controls. Even in other modes, these multiple application environments allow gestures by which to handle applications and interfaces.

Figure 30 illustrates a method 3000 that allows content presentation and / or management of a multiple application environment. In portions of the following discussion, reference may be made to the system 100 of Figure 1 and other illustrative methods and embodiments described elsewhere herein, to which reference is made only by example.

Block 3002 features multiple interfaces associated with multiple applications within a multiple application environment, at least one of the multiple interfaces is an immersive interface.

As noted elsewhere here, the multiple application environment can feature various combinations of different interfaces. Consider, for example, multi-application environments that have at least one immersive interface as shown in each of Figures 3, 7, 10, 12, 16, 18, 20, 23, 24, 26, 27, and 29. These illustrative multi-application environments are described in

<img file="MX349039B_D0046.tif" />

IMPI

INSTITUTO MEXICANO DE LA NSNEDAD INDUSTRIAL order. - .....

Figure 3 illustrates a multiple application environment that has a single immersive interface 304. Figure 7 illustrates a multiple application environment that has the individual immersive interface of Figure 3 along with the application selection interface 702. Figure 10 illustrates a multi-application environment that has windows-based email interface 1004 and two immersive interfaces 1006 and 1008. Figure 12 illustrates the multiple application environment of Figure 10 along with an interface that allows additional controls, email handling interface 1202. Figure 16 illustrates a multiple application environment that changes web page 306, in response to a gesture selection, to the media player 1604. Figure 18 illustrates a multi-application environment having immersive interface 304 and thumbnail images 1602, 1808 of two other interfaces (one immersive and the other window-based). Figure 20 illustrates a multi-application environment that has two immersive interfaces, larger immersive interface 2006 and smaller immersive interface 2008 separated by the immersive interface splitter 2010. Figure 23 illustrates a multi-application environment that has current immersive interface 2302 and regions 2306 and 2310 in which other interfaces can be closed for full occupancy. Figure 24 illustrates the multiple application environment of Figure 23 which has a second immersive interface 2404 showing a social network web page 2406 for application

<img file="MX349039B_D0047.tif" />

social network 1510 of Figures 15. Figure 26 illustrates a multiple application environment that presents content through three immersive interfaces, one in primary region 2604 and the other two in non-primary region 2606. Figure 27 illustrates the environment multi-application interface of Figure 26 along with a 2700 user interface management menu. Figure 29 illustrates a multi-application environment 2912 having an immersive desktop interface 2902 featuring window-based interfaces 2904 and taskbar 2906, and an immersive interface 2908 displaying content 2910.

Block 3004 presents the content through at least one of the multiple interfaces. The content presented in many figures described above is displayed, such as the medium being played, strong social network pages, website news articles, and word processing documents. The content being presented is received from various sources, such as applications 136, which may have generated the content or received the content from a remote source (for example, in case a web browser application receiving the content is a provider remote).

Note that many of the figures mentioned show concurrently presented content. The multi-application environment can present a mobile, visual medium, such as a movie, in one interface while simultaneously presenting a web page that has a media slideshow on another.

<img file="MX349039B_D0048.tif" />

IMPI

INSTITUTO MBUCANO MUnenHMD INDUSTMIAl interphase, both in real time. Furthermore, the multiple application environment allows interaction with multiple interfaces without necessarily requiring an initial selection. That way, a user can select one interface or another, without first having to select an interface that is not primary or the top of a stack, as may be the case in window-based scopes.

Block 3006 allows selection to alter a size of a location in the multiple application environment or remove at least one of the multiple interfaces from the multiple application environment. Block 3006 may act in various ways described elsewhere herein, such as to allow selection to move an interface from one region of the multi-application environment to another with a drag-and-drop gesture.

Block 3008, in response to receiving the selection, alters the size of, alters the relocation of, or removes the selected interface from the multiple scope. Illustrative alterations to interface sizes and locations in the multi-application environment are shown in Figures 23 and 24. Figure 23 illustrates a multi-application environment 2304 that has a current first immersive interface 2302 and then has a reduced-size immersive interface 2402 and with a second immersive interface 2404 displaying a social network web page 2406.

Block 3010, in response to the same selection, alters a size or location of another interface in the multiple application environment. This is shown in Figures 23. and.-24 --- Aunqxi ». Not shown, the multiple application environment module 124 responds to an interface that is removed by resizing and / or relocating other interface (s) within the multiple application scope. Assume a case where the multiple application environment 2304 includes both interfaces 2402 and 2404 from Figure 24. In response to a selection to remove the second immersive interface 2402, the environment module a multi-application element 124 returns to the multi-application environment 2304 as shown in Figure 23, which includes only the current immersive interface 2302. Note that the current immersive interface 2302 is greater than, and occupies a region of, the second immersive interface 2404.

The preceding discussion describes some methods in which the techniques handle immersive interfaces in a multi-application environment, some other methods that allow switching back to an application that was previously interacted with, even other methods that describe ways in which the techniques allow and / or use margin gestures, additional methods that describe ways in which the techniques allow and / or use a desktop with an immersive interface, and a method that allows the presentation of content and / or management of a multiple application environment. These methods are shown as groups of blocks that specify operations performed but are not necessarily limited to the order shown to perform operations by the respective blocks. Furthermore, these methods, in whole or in part,_eo IMPI ^

OU INSTITUTO MEXICANO 72 *** «

OF THE FIOFLEOAD /

INDUSTRIAL can be used in combination.

Aspects of these methods can be implemented in hardware (eg, fixed logic circuitry), firmware, a System Chip (SoC), software, manual processing, or any combination thereof. A software implementation represents program code that performs specified tasks when executed by a computer processor, such as software, applications, routines, programs, objects, components, data structures, procedures, modules, functions, and the like. The program code can be stored in one or more computer-readable memory devices, both local and / or remote to a computer processor. The methods can also be practiced in a distributed computing environment using multiple computing devices.

Illustrative Device

Figure 31 illustrates various components of the illustrative device 3100 that can be implemented as any type of client, server, and / or computing device as described with reference to previous Figures 1-31 to implement techniques that allow and utilize margin gestures. , change back an application with which you previously interacted, and / or manage an immersive interface in a multiple application environment. In embodiments, the 3100 device may be implemented as one or a combination of a wired and / or wireless device, with a

<img file="MX349039B_D0049.tif" />

IMPI ίΝΓΓΠυΤΟ MEXICANO DE LA PROPIEDAD INDUSTRIAL form of television client device (p * ear, cable tv box, digital video recorder (DVR), etc.), consumer device, computer device, server device, device laptop, user device, communication device, video processing and / or presentation device, gadget device, gaming device, electronic device, and / or as another type of device. Device 3100 may also be associated with a user (eg, a person) and / or an entity that operates the device such that a device describes logical devices that include users, software, firmware, and / or a combination of devices.

Device 3100 includes communication devices 3102 that allow wired and / or wireless communication of device 3104 data (eg, received data, data being received, data scheduled for transmission, data packets of the data, etc.) . Device data 3104 or other device content may include device configuration properties, media content stored on the device, and / or information associated with a user of the device. The media content stored on the device 3100 can include any type of audio, video, and / or image data. Device 3100 includes one or more data inputs 3106 through which any type of data, media content, and / or inputs, such as user-selectable inputs, messages, music, television media content, content, can be received. recorded video, and

<img file="MX349039B_D0050.tif" />

IMPI

INSTITUTO MBCICANO DE LA MONEDAD INDUSTRIAL any other type of audio, video, and / or data gives. rooibides image of any content and / or data source.

The 3100 device also includes 3108 communication interfaces, which can be implemented as any one or more of a serial and / or parallel interface, a wireless interface, any type of network interface, a modem, or any other type of interface of communication. Communication interfaces 3108 provide a communication connection and / or links between device 3100 and a communication network over which other electronic, computing, and communication devices communicate data with device 3100.

Device 3100 includes one or more processors 3110 (eg, any of microprocessors, controllers, and the like), that process various computer-executable instructions to control the operation of device 3100 and to allow techniques that allow for a multiple application environment. Alternatively or in addition, device 3100 may be implemented with any one or a combination of hardware, firmware, or fixed logic circuitry that is implemented in connection with processing and control circuitry generally identified at 3112. Although not shown, the device 3100 may include a common system conductor or data transfer system that couples the various components within the device. A common system conductor can include any or combination of different common conductor structures, such as a conductor

..

common memory or memory controller, a condu ^ nr ^^Wl'' - peripheral, a universal serial common conductor, and / or a local common conductor or processor utilizing any of a variety of common conductor architectures.

Device 3100 also includes a computer-readable storage medium 3114, such as one or more memory devices that allow persistent and / or non-transient data storage (i.e., in contrast to simple signal transmission), examples of which They include random access memory (RAM), non-volatile memory (eg, one or more than one read-only memory (ROM), flash memory, EPROM, EEPROM, etc.), and a disk storage device. A disk storage device can be implemented as any type of magnetic or optical storage device, such as a hard disk drive, a recordable and / or rewritable compact disc (CD), any type of a digital versatile disc (DVD), and the like. Device 3100 may also include mass storage media device 3116.

The computer-readable storage medium 3114 provides data storage mechanisms for storing the data of the device 3104, as well as various applications of the device 3118 and any other type of information and / or data related to operational aspects of the device 3100. For example, a 3120 operating system can keep up with a computer application with the most element-readable medium

<img file="MX349039B_D0051.tif" />

IMPI

INSTITUTO MUUCANO DE LA MOMIDAD INDUSTRIAL computer 3114 and run processors ai 1 n ¹ apiirarinnaa. Device 3118 may include a device manager, such as any form of a control application, software application, signal and control processing module, code that is native to a particular device, a hardware abstraction layer for a device particular, and so on.

Device applications 3118 also include any system components or modules to implement the techniques, such as device applications 3118 including multiple application module 124, system interface module 126, gesture manipulator 128, application manager 130, administrator 134, and application (s) 136.

Conclution

Although modalities of techniques and apparatus that allow a multiple application environment have been described in language specific to features and / or methods, it will be understood that the subject of the appended claims is not necessarily limited to the specific features or methods described. Rather, the specific features and methods are described as illustrative implementations that allow for a multi-application environment.