Static and dynamic information elements selection

(57) Abrégé/Abstract:

An embodiment of the present invention provides a method for managing information elements on axes thereof, the method comprising providing a plurality of axes of information elements adapted to display information elements thereon in a substantially rectilinear fashion, displaying at least a portion of at least one of the plurality of axes of information elements with information elements respectively displayed thereon, at least some of the information elements displayed being adapted to be selectable, to enable a first group of actions thereon, and adapted to be activated, to enable a second group of actions thereon. Another embodiment of the present invention provides a method for enabling logical functions on a basis of a plurality of axes of information elements adapted to be displayed on a display. Another embodiment of the present invention provides a method for navigating among axes of information elements identifying directions where movements of the active information element are allowed.

Canada rue Victoria · Place du Portage 1 · Gatineau, (Québec) KIA 0C9 · www.opic.ic.gc.ca

Victoria Street · Place du Portage 1 · Gatineau, Quebec K1APC9 · www.cipo.ic.gc.ca

MA-009044J04-CA1

STATIC AND DYNAMIC INFORMATION ELEMENTS SELECTION

FIELD OF THE INVENTION [01] This invention relates generally to computer systems and more specifically to a method, a system and an interface that facilitates localization, organization and use of information elements and user-selectable elements. More precisely, the present invention relates to a method of selecting and identifying information elements.

BACKGROUND OF THE INVENTION [02] With the always-increasing amount of documents one has to deal with on a daily basis it becomes harder to manage the documents (or information or file) on an item-by-item basis. An alternative document management system adapted to organize large amount of information would be beneficial to the user.

[03] United States Patent Application Publication No.: US 2007/0214169 A1, published on September 13, 2007 discloses a Multi-dimensional locating system and method (title), which is incorporated herewith by reference. The patent application provides embodiments for managing and displaying axes of documents and other computer-readable files. An axis of documents grouping a plurality of documents along a predetermined order, inter alia, is taught.

[04] The use of an axis of documents brings some specific behavior as oppose to document presentation mechanism in the art. One of the specific of an axis is that one might want to navigate thereon while making selections of documents and seeing a magnified version of a document, [05] The use of a small number of axes of information elements on a display might result in a non-optimal use of the usable display area. A larger number of axes might be desirable to provide more information to a viewer. A number of

CA 3003249 2016-05-01

MA-00904-004-CA1 challenges need to be addressed in order to provide functions performed on a larger quantity of documents. For instance, the selection of elements needs to be identified in a fashion discriminating the selected elements among the other documents. Additionally, the element on which the focus is also needs to be discriminated.

[06] Also, navigation among a plurality of axes and among a plurality of groups of axes requires particular behaviors that the prior art fails to provide. Other possibilities coutd also be leveraged by the manipulation of a plurality of axes that the prior art fails to take advantage from.

(07) In view of the prior art it appears that improvements over the prior art is desirable to improve the user experience and usability either with innovative graphical, structural or functional improvements.

SUMMARY OF THE INVENTION [08] The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. This summary is not an extensive overview of the invention. It is not intended to identify key/critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some concepts of the invention in a simplified form as a prelude to the more detailed description that is presented later.

[09] This invention generally refers to user-selectable elements that might represent computer-readable files like documents and multimedia assets. Information elements can alternatively be referred to as, user-selectable elements, menu icons or thumbnails that are associated to an attribute, a category or a tag and a ranged as explained below. In order to lighten the reading of the present specification, the term “document” is generally used without intending to limit the scope of the present patent application only to documents, unless expressly specified.

CA 3003249 2018-05-01

MA-00904-004-CA1 [010] Also, the invention is generally described using an assembly of documents called an axis of documents. The axis of documents generally refers to, but is not limited to, a comprehensive graphical layout of documents. Hereinbelow referred to as an axis that is a substantially rectilinear arrangement of documents. The axis might not necessarily be straight but preferably has a consistent shape providing a viewer en indication of continuity therebetween documents disposed thereon. In other words, the axis of documents can be defined by a single axis or a double axis of documents (or more adjacent axes of documents) and the axis can be completely straight, slightly curved, substantially curved, angled, following a particular shape or having a consistent shape over which documents are disposed in a reasonably consistent fashion adapted to allow a viewer to infer a » comprehensive suite of documents. The axes presented in the embodiments below are illustrated in the horizontal position while they could be disposed vertically without departing from the scope of the present disclosure.

[011] An embodiment referred to below provides one or more groups of axes comprising documents thereon. Each axis of documents is preferably rectilinear to easily be located adjacent with other axes of documents to efficiently use the useful display area of the display. A system adapted to carry on the embodiments, a user graphical interface adapted to display the embodiments, a method adapted to provides the steps required to enable the embodiments and a medium storing instructions enabling the method once read by a machine are all considered within the scope of the present invention.

[012] Therefore, an embodiment of the present invention provides a plurality of axes of documents adapted to form a group of axes of documents.

[013] An embodiment of the present invention provides a mechanism adapted to visually discriminate a document on an axis of document representing the document in focus for a user.

CA 3003249 2018-05-01

MA-00904-004-CA1 [014] Another embodiment of the present invention provides an active document on at least one axis of documents.

[015] One embodiment of the present invention provides an active document on each of the axes of documents in a group of axes; the active document of the active axis of documents being adapted to change.

[016] Another embodiment of the present invention provides an active document that is adapted to move between axes of documents.

[017] Another embodiment of the present invention provides a method of selecting an active element along an axis by using keys on a keyboard; by pointing a mouse or another pointing device on a display, moving a body part in a sensing regions of multi-dimensional sensors, and touching a display with a finger (or hovered with a user-managed pointer or with a human body part contacting a touch-screen).

[018] One embodiment of the present invention provides a method of magnifying an active document by displaying the selected document in a magnified fashion on a display.

[019] Another embodiment of the present invention provides an active document on axes of documents that are not selected (e.g. active); the active documents on non-selected axes remaining still when the active document on the active axis moves.

[020] One other embodiment of the present invention provides a method of selecting an active axis of documents among a plurality of axes of documents.

[021] Another embodiment of the present invention provides a visually discriminating method of representing an active axis of documents.

[022] One additional embodiment of the present invention provides a selected axis of documents bordered with enlarged rails or borders.

CA 3003249 2018-05-01

MA-0Û904-004-CA1 [023] Another embodiment of the present invention provides an axis that becomes active when an active document is enabled.

[024] An embodiment of the present invention provides a method of selecting documents on an axis of documents.

[025] One other embodiment of the present invention provides a method of selecting a plurality of documents (adjacent or not) on an axis of documents.

[026] Another embodiment of the present invention provides a method of performing actions on selected documents on an axis of documents.

[027] One additional embodiment of the present invention provides to keep documents selected on an axis of documents that is not selected or active.

[028] An embodiment of the present invention provides a mechanism adapted to assemble, or to display, a plurality of groups of axes of documents. One of the groups of axes of documents being active, and/or selected, while the other group(s) of axes being inactive, and/or non-selected. The actions being performed on the active axis of documents on the active group of axes.

[029] Another embodiment of the present invention provides a mechanism adapted to select a group of axes of documents, among a plurality of groups of axes, by selecting a desired axis of documents.

[030] One embodiment of the present invention provides groups of axes of documents that can be reordered therebetween on a graphical user interface by selecting and/or dragging a group of axes to a desired position.

[031] Another embodiment of the present invention provides groups of axes of documents that are adapted to be independently longitudinally moveable and independently magnifyable.

CA 3003249 2018-05-01

MA-00904-004-CA1 [032] Another embodiment of the present invention provides a method for managing information elements on axes thereof, the method comprising providing a plurality of axes of information elements adapted to display information elements thereon in a substantially rectilinear fashion, displaying at least a portion of at least one of the plurality of axes of information elements with information elements respectively displayed thereon, at least some of the information elements displayed being adapted to be selectable, to enable a first group of actions thereon, and adapted to be activated, to enable a second group of actions thereon.

[033] Another embodiment of the present invention provides a method for enabling logical functions on a basis of a plurality of axes of information elements adapted to be displayed on a display, the method comprising providing a plurality of axes of information elements, at least some of the axes of information elements being adapted to be used in a determination of a logical equation, and providing logical equation results on a basis of the logical equation.

[034] Another embodiment of the present invention provides a method for navigating among axes of information elements, the method comprising displaying at least a portion of a plurality of axes of information elements, providing an active information element, identifying directions where movements of the active information element are allowed, and moving the active information element in an allowed direction to another information element.

[035] Other advantages might become apparent to the skilled reader of this patent specification in light of the appended drawings.

[036] BRIEF DESCRIPTION OF THE DRAWINGS [037] Figure 1 is a schematic illustration of an exemplary computer network;

CA 3003249 2018-05-01

MA-00904-004-CA1 £038] Figure 2 is a schematic illustration of an exemplary multi-devices network layout;

[039] Figure 3 is a schematic illustration of a typical exemplary computer system;

[040] Figure 4 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents therein in accordance with an exemplary embodiment of the present invention;

[041] Figure 5 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[042] Figure 6 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and selected documents therein in accordance with an exemplary embodiment of the present invention;

[043] Figure 7 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected documents therein in accordance with an exemplary embodiment of the present invention;

[044] Figure 8 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[045] Figure 9 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

CA 3003249 2018-05-01

MA-OÛ904-004-CA1 [046} Figure 10 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[047] Figure 11 is a schematic illustration of multiple axes of documents disposed tn a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[048] Figure 12 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[049] Figure 13 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[050] Figure 14 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[051} Figure 15 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents and a selected document therein in accordance with an exemplary embodiment of the present invention;

[052] Figure 16 is a schematic illustration of multiple axes of documents separated in two groups of axes of documents and disposed in a longitudinal and

CA 3003249 2018-05-01

MA-00904-Ô04-CA1 parallel arrangement with active documents and selected documents therein in accordance with an exemplary embodiment of the present invention;

[053] Figure 17 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[054] Figure 18 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[055] Figure 19 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[056] Figure 20 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[057] Figure 21 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[058] Figure 22 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with particular documents alignment in accordance with an exemplary embodiment of the present invention;

[059] Figure 23 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with identifications thereon in accordance with an exemplary embodiment of the present invention;

CA 3003249 2018-05-01

MA-00904-004-CA1 [060] Figure 24 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with identifications thereon in accordance with an exemplary embodiment of the present invention;

(061] Figure 25 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement with active documents thereon in accordance with an exemplary embodiment of the present invention;

[062] Figure 26 is a schematic illustration of multiple axes of documents disposed in a longitudinal and parallel arrangement and an axis of documents disposed at a non-zero angle thereof with active documents thereon in accordance with an exemplary embodiment of the present invention;

[063] Figure 27 is a schematic illustration of a block diagram in accordance with an exemplary embodiment of the present invention;

[064] Figure 28 is a schematic illustration of a block diagram in accordance with an exemplary embodiment of the present invention; and [065] Figure 29 is a schematic illustration of a block diagram in accordance with an exemplary embodiment of the present invention.

[066] DESCRIPTION OF EMBODIMENT(S) OF THE INVENTION [067] The present invention is now described with reference to the drawings, wherein like reference numerals are used to refer to like elements throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It may be evident, however, that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to facilitate describing the present invention.

CA 3003249 2010-05-01

MA-00904-004-CA1 [068] The description is separated with subtitles to facilitate its readability. The subtitles include descriptions of portions of invention that might be interrelated despite they might appear under different subtitles. In other words, subtitles are not intended to separate part of the same invention or different inventions described therein but are rather intended to structure the text.

(069] The features provided in this specification mainly relates to basic principles for managing axes of documents. These code/instructions are preferably stored on a machine-readable medium adapted to be read and acted upon to with a computer or a machine having corresponding code/instructions reading capability.

1070] Exemplary Network

1071] Figure 1 illustrates an exemplary network 10 in which a system and method, consistent with the present invention, may be implemented. The network 10 may include multiple client devices 12 connected to multiple servers 14,16,18 via a network 20. The network 20 may include a local area network (LAN), a wide area network (WAN), a telephone network, such as the Public Switched Telephone Network (PSTN), an intranet, the Internet, Wi-Fi, WiMAX or a combination of networks. Two client devices 12 and three servers 14, 16, 18 have been illustrated as connected to network 20 for simplicity. In practice, there may be more or less client devices and servers. Also, in some instances, a client device may perform the functions of a server and a server may perform the functions of a client device.

[072] The client devices 12 may include devices, such as mainframes, minicomputers, personal computers, laptops, personal digital assistants, telephones, or the like, capable of connecting to the network 20. The client devices 12 may transmit data over the network 20 or receive data from the network 20 via a wired, wireless, or optical connection.

[073] The servers 14,16,18 may include one or more types of computer systems, such as a mainframe, minicomputer, or personal computer, capable of connecting

CA 3003249 2018-05-01

MA-00904-004-CA1 to the network 20 to enable servers 14,16,18 to communicate with the client devices 12. tn alternative implementations, the servers 14,16, 18 may include mechanisms for directly connecting to one or more client devices 12. The servers 14,16,18 may transmit data over network 14 or receive data from the network 20 via a wired, wireless, or optical connection.

[074] In an implementation consistent with the present invention, the server 14 may include a search engine 22 usable by the client devices 12. The servers 14 may store documents, such as web pages, accessible by the client devices 12.

[075] With reference to Figure 2, a network 20 includes the content cloud 30, a content database 32, content devices 34-38, and devices 40-48. The network mediator 28 enables the network devices 32-38 to communicate with each other without pre-configuring each device.

[076] The content cloud 30 represent a content source such as the Internet, where content exists at various locations across the globe. The content includes multimedia content such as audio and video. The mediator 28 allows the content cloud to provide content to devices 40-48.

[077] The content database 32 is a storage device that maintains content. The content database 32 may be a stand-alone device on an external communication network. The mediator 28 communicates with the content database 32 to access and retrieve content.

[078] The content devices 34-38 include intelligent devices, such as, for example, personal computers, laptops, cell phones and personal digital assistants. The content devices 32-38 are capable or storing content information.

[079] The devices 40-48 are intelligent devices that receive content from a content source 30-38. However, the devices 30-38 can also operate as servers to distribute content to other client devices.

CA 3003249 2018-05-01

MA-00904-004-CA1 [080] Exemplary Client Architecture [081] Figure 3 and the following discussion provide a brief, general description of an exemplary apparatus in which at least some aspects of the present invention may be implemented. The present invention will be described in the general context of computer-executable instructions, such as program modules, being executed by a personal computer. However, other apparatus may affect the methods of the present invention. Program modules may include routines, programs, objects, components, data structures, applets, WEB 2.0 type of evolved networked centered applications, etc. that perform a task(s) or implement particular abstract data types. Moreover, those skilled in the art will appreciate that at least some aspects of the present invention may be practiced with other configurations, including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network computers, minicomputers, set top boxes, mainframe computers, gaming console and the like. At least some aspects of the present invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote memory storage devices.

[082] Now, with reference to Figure 3, an exemplary apparatus 100 for implementing at least some aspects of the present invention includes a general purpose-computing device in the form of a conventional personal computer 120. The personal computer 120 may include a processing unit 121, a system memory 122, and a system bus 123 that couples various system components, including the system memory 122, to the processing unit 121, The system bus 123 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. The system memory may include read only memory (ROM) 124 and/or random access memory (RAM) 125. A basic input/output system 126 (BIOS), containing basic routines that help to transfer information between elements within the personal

CA 3003249 2018-05-01

MA-00904-004-CA1 computer 120, such as during start-up, may be stored in ROM 124. The personal computer 120 may also include a hard disk drive 127 for reading from and writing to a hard disk, (not shown), a magnetic disk drive 128 for reading from or writing to a (e.g., removable) magnetic disk 129, and an optical disk drive 130 for reading from or writing to a removable (magneto) optical disk 131 such as a compact disk or other (magneto) optica) media. The hard disk drive 127, magnetic disk drive 128, and (magneto) optical disk drive 130 may be coupled with the system bus 123 by a hard disk drive interface 132, a magnetic disk drive interface 133, and a (magneto) optical drive interface 134, respectively. The drives and their associated storage media provide nonvolatile (or persistent) storage of machine-readable instructions, data structures, program modules and other data for the personal computer 120. Although the exemplary environment described herein employs a hard disk, a removable magnetic disk 129 and a removable optical disk 131, those skilled in the art will appreciate that other types of storage media, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROM), and the like, may be used instead of, or in addition to, the storage devices introduced above.

[083] A number of program modules may be stored on the hard disk 127, magnetic disk 129, (magneto) optical disk 131, ROM 124 or RAM 125, such as an operating system 135 (for example, Windows® NT.RTM. 4.0, sold by Microsoft® Corporation of Redmond, Wash.), one or more application programs 136, other program modules 137 (such as Alice, which is a research system developed by the User Interface Group at Carnegie Mellon University available at www.Alice.org, OpenGL from Silicon Graphics Inc. of Mountain View Calif., or Direct 3D from Microsoft Corp, of Bellevue Wash.), and/or program data 138 for example.

[084] A user may enter commands and information into the personal computer 120 through input devices, such as a keyboard 140, a camera 141 and pointing device 142 for example. Other input devices (not shown) such as a microphone, joystick, game pad, satellite dish, scanner, a touch sensitive screen,

CA 3003249 2018-05-01

MA-00904-004-CA1 accelerometers adapted to sense movements of the user or movements of a device, or the like may also be included. These and other input devices are often connected to the processing unit 121 through a serial port interface 146 coupled to the system bus. However, input devices may be connected by other interfaces, such as a parallel port, a game port, blue tooth connection or a universal serial bus (USB). For example, since the bandwidth of the camera 141 may be too great for the serial port, the video camera 141 may be coupled with the system bus 123 via a video capture card (not shown). The video monitor 147 or other type of display device may also be connected to the system bus 123 via an interface, such as a video adapter 148 for example. The video adapter 148 may include a graphics accelerator. One or more speaker 162 may be connected to the system bus 123 via a sound card 161 (e.g., a wave table synthesizer such as product number AWE64 Gold Card from Creative® Labs of Milpitas, Calif.). In addition to the monitor 147 and speaker(s) 162, the personal computer 120 may include other peripheral output devices (not shown), such as a printer for example. As an alternative or an addition to the video monitor 147, a stereo video output device, such as a head mounted display or LCD shutter glasses for example, could be used.

[085] The personal computer 120 may operate in a networked environment that defines logical connections to one or more remote computers, such as a remote computer 149. The remote computer 149 may be another personal computer, a server, a router, a network PC, a peer device or other common network node, and may include many or all of the elements described above relative to the personal computer 120, although only a memory storage device has been illustrated in Figure 1. The logical connections depicted in Figure 2 include a local area network (LAN) 14 and a wide area network (WAN) 152, an intranet and the Internet.

[086] When used in a LAN, the personal computer 120 may be connected to the LAN 14 through a network interface adapter (or NIC) 153. When used in a WAN, such as the Internet, the personal computer 120 may include a modem 154 or

CA 3003249 2018-05-01

MA-00904-004-CA1 other means for establishing communications over the wide area network 152 (e.g. Wi-Fi, WiMax...). The modem 154, which may be internal or external, may be connected to the system bus 123 via the serial port interface 146. In a networked environment, at least some of the program modules depicted relative to the personal computer 120 may be stored in the remote memory storage device. The network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

[087] The Interface [088] An interface program providing an interface for managing documents in accordance with an embodiment of the invention is installed on a machine e.g. a computer system. The interface can be programmed using various programming languages e.g. C++, Java or other suitable programming languages. Programming of these languages is well known in the art and is adapted to be readable to provide executable instructions to a hardware system and will not be further described therein. The interface might run through the operating system and the hardware of the computer system or, alternatively, through a network based system e.g. client-server, and/cloud computing system. The interface is adapted to manage documents, computer files, pictures, multimedia content, applications (i.e. computer programs), menu elements, sets of icons and other user-selectable elements in a comprehensive fashion.

[089] Several embodiments follows: Documents are stored on a machinereadable medium and can be retrieved on demand when needed with the interface program. Documents are disposed in an axis-like layout providing a visually comprehensive display arrangement of the documents. The axis can, illustratively, among other possibilities, be based on a selection of attribute(s), tag(s), category(ies), owner of documents, a chronological order, a statistical order or an order representing an increasing file size. Combinations of the above-listed possible choices, inter alia, are possible if desired to build a query adapted to

CA 3003249 2018-05-01

MA-00904-004-CA1 reduce the number of documents to be displayed on the axis. The axis thus helps the viewer to infer additional meaning from the comprehensive layout, consistent display and distribution of the documents thereon.

(090] An axis is adapted to accommodate a single type of documents or, if desired, more than one type of documents, and/or a mix of documents, computer files, multimedia contents and/or user-selectable menu elements. Documents might overlap to squeeze more documents on the space available on the display. Magnification of selected documents on an axis can be made to increase the level of details of the selected documents.

[091] Using an axis of documents helps to meaningfully and intuitively display a group of documents. An axis of documents can be embodied as being a substantially linear distribution of documents adapted to dispose each document to be displayed on a line or on a curved line. A curved or a circular axis of documents is also contemplated to be within the scope of the present disclosure. The exact shape of the axis is secondary, what matters, inter alia, is that the layout structure of an axis provides a comprehensive suite of documents from which a viewer can infer an order, a sequence or a relationship between documents. The display of the axis of documents might be made in accordance with a predetermined order (e.g. chronologically), or not. A chronological distribution of documents can sort documents on a timeline. The chronological order can either be linear or nonlinear; meaning that a unit of time has always the same graphical length on the display in the linear configuration. The non-linear configuration might non-evenly display similar units of time because the distribution of documents along the timeline prevails over the linearity of time. Another illustrative embodiment is a group of juxtaposed axes of documents grouped together to form an axis of documents referring to a matrix of documents.

[092] The display of documents on an axis of documents allows to contextually manage documents as a flow, or an ongoing suite, of documents instead of dealing

CA 3003249 2018-05-01

MA-00904-004-CA1 with each document independently. By getting away from managing each document independently it becomes possible to efficiently deal with a significantly higher number of documents and still keep the documents in a structured order.

[093] Each axis of documents assembles documents in accordance with, for example, a selected tag, a category, keywords, or an attribute that is commonly shared among the documents displayed on the axis of documents. The term “attribute will consistently be used throughout the instant specification to lighten the reading of the text and will include the other commonality between documents described therein unless otherwise specified. The selection of one or more attribute (using Boolean logic for instant) determines which documents will be displayed on the axis of documents. If no specific attribute is selected, then, the axis of documents displays all documents. Thus, all documents on the same axis of documents are normally associated with the selected set or combination of attributes (trivial data, like publicity or specific related information, could be added to an axis as long as the outoome remains a presentation of documents resulting from a query without departing from the scope of the present invention). In addition, a timeline can be used to determine the order of the suite of documents on the axis of documents. Chronological ordering is a very intuitive ordering to humans and is one of the preferred ways to present documents on an axis of documents. In the case of a matrix of documents, then, one axis (e.g. horizontal direction) of the matrix can represent a timeline while the other axis (e.g. vertical direction, orthogonal,...) represents another criterion like, for example, the type of computer files each document relates to. The other axis can also use a timeline if desirable.

[094] The attributes of a document can be selected to create another axis of documents. The attribute of a document from the newly created axis of documents can be selected to create an additional axis of documents and so on so forth. This is what could be called “relational navigation and is well described in the United States patent application publication referred to at the beginning of the present

CA 3003249 201B-05-01

MA-00904-004-CA1 patent specification. Hence, the user can “navigate along axes of documents in accordance with their categorization to visualize the documents. Navigation tools are provided with the interface to allow navigation through various axes of documents, when a plurality of axes is enabled, and through the documents of a single axis of documents. In the context of the present invention, a single suite of documents forming an axis along a timeline is one of the preferred embodiments because it is easy to sequentially navigate throughout the documents disposed along the axis. Other graphical layouts of documents might become obvious for a skilled reader in light of the present application and would be considered within the scope of this application.

[095] When only a portion of the axis is visible, a play of zoom, pan and movements along the axis allows a viewer to navigate on the axis and change the document(s) that is (are) displayed on the display. A small display area could display only one document from the axis of documents while the remaining documents from the axis of documents are not displayed but remain nonetheless at their respective “virtual” position on the axis and ready to be displayed if the axis is scrolled to show other documents. In other words, if we consider a mobile platform like a mobile phone having a small display, the small display area might allow to efficiently displaying only one document at the time. However, the displayed document being part of an axis of documents, the other documents on the axis of documents remain displayable in accordance with their respective position on the axis of documents when the axis is scrolied/navigated/gestured.

[096] Referring now to Figure 4, it is possible to appreciate an embodiment depicting a plurality of documents 200 disposed on various axes of documents 202, A, B and C illustratively juxtaposed next to each other. Another embodiment could provide more or less axes of documents 202. One axis of documents 202, in the present situation axis of documents A, 205 has previously been selected and is considered the active axis 207 of documents among the three axes of documents 202, A, B and C.

CA 3003249 2018-05-01

MA-00904-004-CA1 [097] The selection of an axis of documents 202 to become an active axis of documents 207 can be made via a simple selection performed with a pointing device on a display, hand gestures on a touch sensitive display, body movement gestures in a sensing region of multi-dimensional sensors or other suitable means to influence the selection of the axis 202. A selection of the rails 215, or wherever on the axis of documents, will select the axis of documents. If the selection is made on a document 200 of the axis of documents 202, the pointed document 200 will become the active document 220 in one of the embodiments of the invention. Alternatively, in another embodiment, the active document 220 of a non-selected axis of documents 202 will remain the same until a new active document 220 is selected.

[098] An active document 220 is a document on which the focus is put on instead of the other documents on the same axis or on a plurality of other axes. Specific functions are associated with an active document 220 (or a document in focus). For example, an active document 220 can be magnified in a separate display area to better appreciate the details of the document, rapid change of active documents can rapidly change the magnified document in the separate windows, the active element can change from one document to another document to navigate among documents without loosing selection of other documents,... Conversely, selecting documents allows to act on the selected documents to, for example, copy the document, refresh the thumbnail of the document and so on so forth. In other words, the activation of a document allows actions thereon that are unlikely possible if only a function of selecting documents is provided.

[099] The first axis of documents 202 can be automatically selected when a group of axes of documents 204 is displayed for a first time. A default selected axis of documents 202 can be defined in the group of axes of documents preferences to always get the same selected axis of documents when the group of axes of documents 204 is displayed for the first time.

CA 3003249 2016-05-01

MA-00904-004-CA1 [0100] The active axis of documents A, 205 is visually discriminated by, for example, enlarged axis border, or rails, 210 as opposed to axis rails 215 of unselected axes 202, B and C. Other active axis of documents 205 identification could be used, like a change in color of the axis of documents 205 and a change in color, thickness or texture of the rails 215, without departing from the scope of the present invention.

[0101] In one embodiment, each axis of documents 202, A, B and C has an active document 220 illustratively identified with a bolder dotted border 222. In the present situation, documents A-8, B-8 and C-8 are identified as active documents 220.

[0102] In the present embodiment, only the active document 220 A-8 of the active axis A, 205 can be acted upon without changing the selected axis of documents. For example, only the selected document A-8, 220 of the active axis A, 205 is moveable using the keyboard’s arrows, for instance in an embodiment, or by hand gesture in another embodiment directed to touch screen navigation. Thus the active document can change in accordance with the action of the user. In the present situation, if a user actuates the left arrow on the keyboard, the active document 220 will change to A-7 then A-6, A-5 and so on so forth till document A1 is active. If the user further move to the left then the focus of the display will change to see the next document to the left (A-0) that is not visible at the moment. The same mechanism works on the right side to see document A-9 for instance.

[0103] Information 225 related to the selected axis of documents A, 205 and/or the active document C-8, 222 is displayed on the header 230 located above 230 the group of axes 204. The following information can, inter alia, be displayed simultaneously or consecutively on the header 230:

• Title of the selected axis of documents;

• Number of documents on the axis of documents;

CA 3003249 2018-05-01

MA-00904-004-CA1 • Title of the selected document;

• Date of the selected document;

• Number of the selected document among all documents in the axis of documents; and inter alia • Number of unread documents on the axis of documents.

[0104] The size, color, width and height of the header 230 can be modified without departing from the scope of the present invention.

[0105] Figure 5 illustrates a selected document 235 in addition to the active documents 222. The selected document 235 can be acted upon as opposed to the active document 222 that mainly identify the document on which visualization is directed. The selection 235 of a document 200 can be done to copy, cut and act upon the selected document 235.

[0106] As illustrated in the embodiment illustrated in Figure 6, one or many documents 200 can sequentially or collectively be selected 235 on an active axis of documents 205. The selection 235 can be made by pointing the desired document 200 with the pointing device (cursor not shown) and clicking on the document 200. A multiple selection of documents 235, 200 can be done by dragging an area over the axis 202 or by using the SHIFT or COMMAND key. Other means for selecting documents like a contact of a body part on a touch sensitive display or body movements in a sensing region of a multi-dimensional sensing device are encompassed by the present specification as well. In Figure 6, document 200, A-2, A-5 through A-8, in axis of document 202, A, are selected and represented by a darker filling 237.

[0107] The selection of a document 200, with a pointing device or other means, of another will enable the lastly selected document as the active document 220. The

CA 3003249 2018-05-01

MA-00904-004-CA1 active document 220 in the case of a multiple selection of documents 200 will be the lastly selected document 235, 200.

[0108] Turning now to Figure 7 where axis B is the active axis identified by bolder rails 210. In this example, document B-5 has been pointed by the user of the interface and is the active document 220. Meanwhile the active axis has changed to axis B since the last action has been made on axis B.

[0109] Figure 8 illustrates the embodiments of Figure 7 where the active document B-5,220 is also a selected document 240 depicted with a darker more opaque filling.

[0110] The active document 220 has moved to the left to document B-4 as opposed to document B-5 while document B-5 remains selected as illustrated in Figure 9.

[0111] Holding down the COMMAND key (or a proper gesture) and selecting document B-4 it now shows in darker filling in Figure 10 along with still selected document B-5.

[0112] Now, from the illustrative scenario of Figure 10, document B-1 is selected holding the SHIFT key to select 240 in group documents B-3 to B-1.

[0113] Still beginning with the illustrative scenario of Figure 11, holding the COMMAND key, document B-1 is selected another time to deselect it as illustrated in Figure 12 where document B-1 does not have a dark filling anymore.

[0114] Again, another example beginning with the illustrative scenario of Figure 12, holding the COMMAND key, document B-7 is selected to select it as illustrated in Figure 13 where document B-7 have a dark filling. Additionally, in a second action, holding the COMMAND key, document B-2 is selected to deselect it as illustrated in Figure 13 where document B-2 does not have a dark filling 237 anymore. The left arrow key has pressed to move the active document 220 to document B-1.

CA 3003249 2018-05-01

MA-00904-004-CA1 [0115] Turning now to Figure 14 where documents B-3 through B-7 have been unselected either by selecting independently a second time each of the documents 200 or by collectively deselecting documents B-3 and B-7 holding the SHIFT key. Then document A-2 has been selected, the active document of axis A has been moved with the arrow key to move it to document A-8. Then document C-8 has been selected, and shows in darker filling, and becomes the active element 220. Axis C also becomes the active axis at the same time.

[0116] Combining keyboard keys may be used in order to navigate and select element. These keys may vary for specific need or may depend on the Operating System platform of the user. Combining arrow key with several modifier keys, such as ALT or CONTROL, the user may navigate from a time unit to another. Using multiple modifiers tike SHIFT with ALT or CONTROL with arrow key, the user may make a selection or expand current selection from the active element to the next or previous time unit. Using Page Up and Page Down, the user may navigate from a screen, display or windows, to another. Using Page Up and Page Down with SHIFT may create a selection or expand the current selection from the active element to the next or previous screen, display or windows. Using Home and End keys, the user may navigate to the start or the end of the axis of document. Using Page Up and Page Down with SHIFT may create a selection or expand the current selection from the active element to start or the end of the axis of document.

[0117] On Figure 15, the scenario of Figure 14 is copied although the active document in axis C has been moved to document B-5,220 with the arrow key from the keyboard.

[0118] Figure 16 illustrates two distinct groups of axes of documents 250, 260. The first group 250 illustratively comprises three axes of documents A, B and C. The second group of documents 260 also illustratively, but non-restrictively, comprises three axes of documents A, B and C. The first group of axes 250 is active as opposed to the second inactive group of axes 260 that is inactive. The active axis

CA 3003249 2018-05-01

MA-00904-004-CA1 of documents 250 is active because document 255 is the active document of the active axis C. Should another document of the same axis A or another axis B or C of group A be the active document, group A would still be the active group of axes.

[0119] The inactive group of axes of documents 260 also has a plurality of axes of documents, a latent active axis of documents C and latent inactive axes of documents A and B. We consider latent axes of documents because they have a particular state in an inactive group of axes 260 - that is illustrated in a lighter color thereof to ensure sufficient discrepancy with the active group of axes of documents 250.

[0120] Still referring to Figure 16, document 270 in group 250, illustrated with visually distinct border 272, is also present in group of axes 260. Document 270 is repeated in axis A as document A-4 with similar border 272. This is an example of correlation among various axes of documents 200 located in different groups of axes of documents 200 to provide insight to a user as to what documents are found in more that one axis of documents (that might represent various queries or other grouping of documents 200). A border or a frame can illustrate repetition of a document 200. In one embodiment of the present invention, the sole repetition of a document is enough to visually illustrate the repetition. The visual distinctive feature used to visually discriminate the repeated documents 200 can also represent a repeated document in the case the repeated document is an active document 220 or a selected document 240.

[0121] In embodiments of the present specification is presented selected and nonselected axes of documents. At least one axis from a plurality of axes can be selected to apply actions thereon. It is therefore possible to perform operations on axes that is going to effect, in at least one embodiment, the documents contained therein. A selected axis is going to be graphically discriminated from the other axes by, for example, a bolder border 215,

CA 3003249 2018-05-01

MA-00904-004-CA1 [0122] In the present embodiment of the invention, axes of documents may be considered as active and/or selected. Figure 17 depicts a plurality of axes of documents with different border rails styles. The thin full line 210 indicates the user that the axis of documents is neither active nor selected. The thin dotted line 211 indicates the user that the axis of document is selected but not active. The thick dotted line 216 indicates the user that the axis of document is selected and active. A thick full line 215 (not shown in Figure 17) would represent an active but not selected axis of documents. Other styles or colors may be applied or add more variation for further semantic needs. In the preferred embodiment, the user is constraint to have only one active axis of documents at a time in one axes of the document’s environment, but it may be possible to have multiple active axes at a time for particular needs.

[0123] Selection of a plurality of axes of documents gives possibility to the user of doing operations to all the selection, such as changing properties to a common value, joining axes of document in a group, etc.

[0124] Figure 18 is an illustrative representation of a plurality of axes of document with a filter on an attribute. In the illustrative example, the axes of documents 202.1,202.2 and 202.3 shows only documents that have respectively attribute A, B and C defined. Some documents may be shown in multiple axes of documents since they have attributes that satisfy many filters. In the illustrative example, these instances 200.1, 200.2 and 200.4 are aligned horizontally to help the user see the common results.

[0125] One embodiment of the present invention is to consider selected documents in a plurality of documents as a common selection of document. When a document is selected, all shared instance in all axes of documents should be marked as selected as well. Figure 19 shows how the user select the document 200.4 in axis

202.1 was selected and how all instance of 200.4 in other axes of documents were selected as well.

CA 3003249 2018-05-01

MA-00904-004-CA1 [0126] The user interface may gives user several menu commands or keyboard shortcuts to do operation on active or selected axes of documents. In the illustrative example Figure 20, the user made the axis of document 202.3 active then use a select all operation on this axis of document. One can appreciate that shared selection atso affected the document 200.2 in axis 202,1, [0127] Figure 21 illustrate a similar behaviour where the user made the axis of document 202.2 active, and then a unselect all operation was triggered. The document 200.1 was already unselected and stay still while document 200.4 is unselected. In the illustrative example how all instances of document 200.4 got unseiected in other axes of document 202.1 and 202.3. Documents 200.2 and 200.5 remains selected since they were not modified by the last operation.

[0128] One can appreciate the way the Set union operation can be easily made with these axes of documents. Selection of axes of documents can be use to made other Set operations. Figure 22 shows the result of an intersection operation. The user made a selection on axes of documents 202.1 and 202,2 and triggers an intersection operation on selected axes of documents. Commons documents of all selected axes of documents, such a 200.1 and 200,4 get selected while others 200,1, 200.2 and 200.5 gets unselected. Different behaviour may be defined to make a union between the last state of the selection and the current result of the intersection. In this case, 200.2 and 200.5 would have remained selected.

[0129] All these user activities may be describe as a succession of mathematical Set operation. By example, user operations illustrated on Figures 18-22 can be described like:

[0130] (((is document 200.4) UNION (has attribute C)) MINUS (has attribute B)) UNION ((has attribute A) INTERSECTION (has attribute B))

CA 3003249 2018-05-01

MA-00904-004-CA1 [0131] The user may use this selection to create a new axis of document with selected documents only. This new axis of document may use this Set description to create a Boolean predicative condition over documents.

[0132] One embodiment of the present invention is that the user may have the choice to have a static or dynamic document selection. These two modes affect documents that are added, modified or removed live. These events may happen because another process or other users over a network, by example, access the documents that are currently shown in axis of documents.

[0133] Static selection is a conservative way to react to these events. Added document are not added to selection, modified document stay in selection and removed documents are removed from selection. This is the default selection behaviour in most applications as it is the most predictable system, but lacks power.

[0134] Dynamic selection is an operation-based selection. Using the Set operation made from select all, unselect all, intersection and other Set operations on selection, the document events stay consistent with this operation. Added documents get selected if they respect the selection operation scheme, modified documents get selected or unselected if they respect or not the selection operation scheme. Finally, the removed documents get removed from selection.

[0135] Figure 23 shows how a newly created document 200.6 appears in axes

202.1 and 202.2 since it have the attributes A and B. A visual distinctive feature 250 may be shown to indicate the user that this document is new and have been added to the axis of document. The document gets automatically selected with the dynamic selection system, since it is a result of the intersection between axis of document 202.1 and 202.2.

[0136] Figure 24 shows how the modified document 200,4 gets modified. A visual distinctive feature 255 may be shown to indicate the user that the document gets

CA 3003249 2018-05-01

MA-00904-004-CA1 modified. The document 200.4 gets its attribute A removed, so it is no longer a member of axis of document 202.1. Since the selection is dynamic, the document

200.1 is not part of the intersection of axes of documents 202.1 and 202.2 anymore, so the document 200.4 gets unselected in all axis of documents it appears.

[0137] This strategy of dynamic selection may be used in large database results where the client application may truncate the axis of document for bandwidth, speed or memory optimization. As the user navigates in the large axis of document, parts of it may be loaded (and other parts unloaded) by the system. In this situation, when a user made a Set operation, such as a select all, unselect air, unions, intersections, differences, the server could compute a Boolean operation from this succession of Set operation and makes change happen on the server-side when the user choose to do an operation on the list of documents selected. It frees the client application of determining the complete list of selected documents and communicates the server the succession of Set operation or its Boolean equivalent formula instead of the complete list of selected documents.

[0138] Another embodiment of this invention is to gives the possibility to the user to maintain a plurality of selected documents Sets. The interface may show only one selection at a time and give the user a possibility to switch from a selection Set to another, create a virgin selection and delete a selection. The interface may also show multiple selections at the same time by using different color or patterns over the selected documents of the different Sets. Finally, these distinct Sets may be used to create a new Set by using Set operation over other Sets, such as union, intersection, difference, etc. This gives the possibility to the user to construct complex Sets selection operations.

[0139] The selection Set operations can be saved, loaded, used to create new axis of document of the selection, used the condition to create visual distinctive features, create permissions rules, etc.

CA 3003249 2018-05-01

MA-Ο0904-004-C A1 [0140] Turning now to Figure 25 illustrating where is depicted another embodiment of the invention directed to navigation among documents 200 in axes 202 of documents and groups 204 of axes of documents.

[0141] In Figure 25, active document 300, on axis A 202, illustrated with a bold frame 302, is adapted to sequentially move the activation of an adjacent document to the left 304, or to the right 308, to move the selection of the active document to another document 200, One can appreciate that the actual document does not move and it is the activation of the document that is enabled. Navigation from an active document to a document makes it active in an embodiment. The active document preferably automatically changes by the sole movement of the selection thereof. For example, an active document can be magnified in a separate window to appreciate more details thereof. Changing of active document is going to change the document that is magnified in the separate window. Navigation with an active document among the documents is going to sequentially magnify the documents 200 that are going to be active at some point during the navigation.

[0142] Returning back to active document 300, no movement of the active document is possible above because there is no more axes 202 above of axis A 202. No movement is possible below because there is no adjacent document 200 directly below document 300 on axis B 202 at location 312. The same dynamic is applied to document 316 where a downward movement is possible toward document 320 because document 320 is adjacent to document 316. One can appreciate that in the embodiment illustrated in Figure 25, the documents 200 are vertically and horizontally aligned in a matrix type of configuration. This alignment is desirable because each axis 202 assembles documents pertaining to a same commonality while the vertical alignment is possible because the same timeline 324 is shared by all the axes 202 of the group of axes 204 formed thereby and separated with separators 328. In the present situation, the separators are separating time in days while other embodiments could separate the longitudinal

OA 3003249 2018-05-01

MA-00904-004-CA1 axes in accordance with another criterion without departing from the scope of the present invention.

[0143] Still referring to Figure 25, is illustrated document 332 that can provide therefrom three navigation directions, up, left and right. Movement downward is not allowed because there is no document 200 at location 336 in axis E 202.

Document 344 has similar navigation possibilities while document 348 can navigate toward all four directions because it is bordered by documents 200 in all the four orthogonal directions. Alternatively, and that embodiment is not illustrated in the Figures, navigation could be made at an angle from a document when there are documents in that direction.

[0144] Another embodiment illustrated in Figure 25 provides navigation capability among documents 200 on an axis even if there are no documents 200 immediately next to the subject document. In the present situation document 340 can move to the left and to the right to directly reach document 344, In this embodiment, no movement is allowed to another axis 202 because there are no documents immediately adjacent to document 340 on another adjacent axis B. D, 202.

[0145] Document 352 illustrates another embodiment that allows navigation to another axis 202 of documents despite there is no adjacent document on the adjacent axis of document 202. This jump 354 to the next available document 356 can be based on a preselected option or by being actuated by a specific action like, for instance, a double-click of the arrow pointing above on the keyboard, of the like.

[0146] Another embodiment is illustrated in Figure 25. Document 352 does not have access to juxtaposed documents in axes 202, F, E, D and C to reach document 356 in axis B. A previous embodiment described a jump 354 to the next available document 356. This embodiment allows “ghost” documents 356 allowing a sequential navigation between axes 202 when no document exists to support the actual navigation using activation of the documents as previously

CA 3003249 2018-05-01

MA-00904-004-CA1 describe above. The “ghost” document 356 identifies the virtual position of what would be an active document, even if there are no document, to allow sequential navigation to axes from where a longitudinal navigation can begin to reach the next document available on the subject axis. For example, active document 352 would allow a jump 354 to axis B. In this circumstances there is not possible to stop to another intervening axis 202 to further navigate thereon. The present embodiment would provide intervening steps on intervening axes C, D, E and F, herein referred to as “ghost documents 356, activating no document thereof, because there is no document aligned with document 352, while allowing axial navigation on axis F, to the right, from ghost document 356.1. Moving up with another ghost document

356.2 that would allow navigation to the left. Then ghost document 356.3 allowing navigation to the left and the right. After, if moved toward axis C, ghost document 356.4 allows also navigation on both axial sides and finally reaching document 356 from which navigation therefrom has been explained above.

[0147] Figure 26 illustrates a sequence of navigation beginning with document 370 on axis A 202 that is going to reach document 374 and not changes direction downward to reach document 376 on axis D 202. Now, navigation from document 376 is embodied to directly reach document 380. Document 380 is an intersecting document between axis D 202 and axis 1202. For example, axis D includes documents 200 having a common attribute “D” and axis I 202, provides documents 200 having common attributes “D and T. Navigation on axis I 202 can therefore be made in the direction of axis 1202, vertically, since axis I 202, is illustrated vertically, orthogonal to the other axes 202.

[0148] Finally, the present specification has recited many possible embodiments that can be practiced independently and/or collectively, if desirable. It is considered that the text of the present specification has been drafted as it is for helping a reader to understand many different embodiments taken independently and is not intended to limit the scope of any of the embodiments or combinations thereof.

CA 3ÛÛ3249 2Û1B-Û5-01

MA-00904-004-CA1 [0149] The description and the drawings that are presented above are meant to be illustrative of the present invention. They are not meant to be limiting of the scope of the present invention. Modifications to the embodiments described may be made without departing from the present invention, the scope of which is defined by the following claims:

CA 3003249 2018-05-01

MA-00904-004-CA1