Data processing apparatus and method

FIELD OF THE INVENTION

p-0002The present invention relates to data processing apparatuses and methods of displaying resizable graphical elements.

BACKGROUND OF THE INVENTION

p-0003Data processing devices such as portable personal computers, mobile telephones, personal media devices and so on, provide users with an increasing number of functions. For example, even a relatively inexpensive mobile telephone might nowadays be expected to provide functions including audio/video playback, internet access, email, content streaming, instant messaging, satellite assisted navigation functionality and so on.

p-0004Providing a graphical user interface that enables a user to easily and conveniently understand and use all the available functionality on such devices can be quite difficult. Conventional personal computer “desktop” type graphical user interfaces in which the various functions available to a user are accessed by selecting an icon or the like are less appropriate for data processing devices with limited display space. Moreover, such conventional graphical user interfaces can become increasingly difficult to use when there are a large number of functions available to chose from and display.

SUMMARY OF THE INVENTION

p-0005According to a first aspect of the invention there is provided a data processing apparatus for running one or more computer program applications. The data programming apparatus is operable to display at least one resizable graphical element from a plurality of resizable graphical elements on a display and resize the at least one displayed graphical element in response to a resize control input from a user control. The data processing device is operable to switch between which of the plurality of graphical elements is displayed if a displayed graphical element is resized to be greater in size or to be less in size than one of a plurality of predetermined threshold sizes. Each of the plurality of graphical elements includes at least one graphical object or interface control different from the other graphical elements of the plurality of graphical elements and a greater a size of one of the plurality of predetermined threshold sizes, a greater a number of controls and/or graphical objects included in the graphical element that is displayed when the displayed graphical element is resized to exceed that predetermined threshold size.

p-0006In accordance with this aspect of the invention, a graphical element is provided which allows the various functions and information accessible via a graphical element to be more conveniently organised and displayed. Conventional data processing devices such as personal computers allow a user to access various functionality and information through various resizable graphical elements. However, keeping track of all the functionality and information provided by conventional graphical elements can be confusing and may not be appropriate for data processing devices with smaller screens, particularly if multiple graphical elements are displayed at the same time. For example, even though a user may be able to resize the various graphical elements, doing so merely obscures or reveals part of the graphical element which makes it unclear to a user what information and functionality is available.

p-0007On the other hand in accordance with this aspect of the present invention, once a user has resized a graphical element past a certain predetermined threshold size, the original graphical element is replaced by a second different graphical element. This new graphical element can contain a display of additional or completely different functionality and information from the first graphical element. Accordingly, a convenient means is provided which enables a user to switch between different graphical elements which ensures that all the information and functionality available via the graphical element is displayed at one time whilst reducing the inconvenience that would otherwise arise by displaying multiple graphical elements. Furthermore, the second graphical element may be arranged so that it contains a greater level of functionality and/or it provides more information than the first graphical element. Accordingly, a user can dictate the level of complexity (i.e. available functionality and information) provided by a currently displayed graphical element by resizing it past the predetermined threshold size. This is in contrast to the prior art which merely obscures or reveals part of a single graphical element after resizing.

p-0008In one example of the invention, each graphical element is displayed on the display by virtue of one of a plurality of applications being run on the data processing apparatus. The data processing apparatus is arranged to switch between the display of the graphical elements by switching from running a first application associated with a currently displayed graphical element to running a second application arranged to generate a second graphical element in response to the resize control input.

p-0009According to this example, the resizing of a first graphical element being provided by a first application can be used to launch a second application which provides a second graphical element. In this example a simple application (i.e. one that is stored in a small amount of memory and can be run quickly and efficiently by the data processing apparatus) can provide a simple graphical element. The simple graphical element may provide a small number of simple functions. If a user wishes to gain access to further functions, for example more complex functions that although related to those provided by the first graphical element are not actually provided in the first graphical element, the user can, for example, resize the first graphical element past the first predetermined threshold size. The second application can then be launched and the second graphical element is then displayed which provides the more complex functionality. As will be appreciated, this arrangement means that an application that is being run at any one time is only as complex (e.g. large) as is needed to support the graphical element being displayed. This reduces a requirement to run unduly complex applications supporting relatively simple functionality.

p-0010In another example of the invention, the data processing apparatus is arranged to render each of the plurality of graphical elements on the display at substantially the same time and switch between the display of the graphical elements by displaying only one graphical element at a time as non-transparent.

p-0011In this example, the period of time taken to switch between the display of each graphical element is reduced as each graphical element is pre-rendered.

p-0012In another example of the invention, when the data processing apparatus switches between displaying an initial graphical element from the plurality of graphical elements to a replacement graphical elements from the plurality of graphical elements, the data processing apparatus is operable to retrieve data from a server to display in conjunction with the replacement graphical element. In some examples the data is user data indicating previous activity of a user using the data processing device.

p-0013In accordance with this example, the data processing apparatus is operable to use the resizing operation as a cue to retrieve potentially useful user data from a data source such as remote data server. This can improve the efficiency with which communication resources available to the data processing apparatus are used as data need only be retrieved when actually needed for the display of a particular graphical element.

p-0014According to another aspect of the invention there is provided a data processing apparatus for running one or more computer program applications. The data programming apparatus is operable to display at least one resizable graphical element from a plurality of resizable graphical elements on a display and resize the at least one displayed graphical element in response to a resize control input from a user control. Each graphical element includes at least one of a plurality of graphical objects and interface controls. The data processing device is operable to switch between which of the plurality of graphical elements is displayed if a displayed graphical element is resized to be greater in size or to be less in size than one of a plurality of predetermined threshold sizes, each of the plurality of graphical elements including at least one graphical object or interface control different from the other graphical elements of the plurality of graphical elements and at least two of the graphical objects and/or interface controls are associated with functions provided by at least two different computer applications.

p-0015According to this aspect of the invention, a data processing apparatus can be arranged to provide a “thematic” graphical user interface. In the thematic graphical user interface, rather than providing various different types of functionality to a user via a number of discrete applications as is the case with conventional graphical elements, the thematic display divides the functionality into “themes” and each theme is then provided with its own graphical element which can be replaced by another graphical element providing further functionality when a user wishes to access more complex functions associated with the theme. The graphical objects and/or interface controls associated with the graphical elements are provided by different applications.

p-0016Various further aspects and features of the invention are defined in the appended claims.

BRIEF DESCRIPTION OF THE DRAWINGS

p-0017Embodiments of the present invention will now be described by way of example only with reference to the accompanying drawings where like parts are provided with corresponding reference numerals and in which:

p-0018<figref idrefs="DRAWINGS">FIG. 1</figref> provides a schematic diagram illustrating a conventional personal computer;

p-0019<figref idrefs="DRAWINGS">FIGS. 2 to 5</figref> provide schematic diagrams illustrating a number of examples of a view of a conventional graphical user interface displayed on the laptop of <figref idrefs="DRAWINGS">FIG. 1</figref>;

p-0020<figref idrefs="DRAWINGS">FIG. 6</figref> provides a schematic diagram illustrating an example of a data processing apparatus;

p-0021<figref idrefs="DRAWINGS">FIGS. 7 to 11</figref> provide schematic diagrams illustrating graphical elements displayable using the data processing apparatus of <figref idrefs="DRAWINGS">FIG. 6</figref> in accordance with examples of the present invention;

p-0022<figref idrefs="DRAWINGS">FIGS. 12</figref><i>a </i>to <b>12</b><i>h </i>provide schematic diagrams illustrating further graphical elements displayable using the data processing apparatus of <figref idrefs="DRAWINGS">FIG. 6</figref> in accordance with examples of the present invention;

p-0023<figref idrefs="DRAWINGS">FIG. 13</figref> shows a schematic diagram illustrating minimum widths and heights that define three display states in accordance with examples of the present invention;

p-0024<figref idrefs="DRAWINGS">FIG. 14</figref> provides a flow chart illustrating an algorithm for displaying a graphical elements in accordance with examples of the invention;

p-0025<figref idrefs="DRAWINGS">FIG. 15</figref> shows a schematic diagram providing a simplified illustration of how a display of a number of graphical elements can be implemented on the data processing apparatus shown in <figref idrefs="DRAWINGS">FIG. 6</figref>;

p-0026<figref idrefs="DRAWINGS">FIGS. 16</figref>, <b>17</b>, <b>18</b>, <b>19</b> and <b>20</b> provide schematic diagrams illustrating examples of a thematic display arranged in accordance embodiments of the present invention, and

p-0027<figref idrefs="DRAWINGS">FIG. 21</figref> provides a schematic diagram showing a flowchart illustrating an example method according to the present invention.

DESCRIPTION OF EXAMPLE EMBODIMENTS

h-0006Conventional Graphical User Interface

p-0028<figref idrefs="DRAWINGS">FIG. 1</figref> shows a schematic diagram of a laptop personal computer <b>101</b>. The laptop <b>101</b> is an example of a conventional data processing device. The laptop <b>101</b> includes a screen <b>102</b>, a user control input means including a keyboard <b>103</b> and a touch sensitive pad <b>104</b>. Although not shown in <figref idrefs="DRAWINGS">FIG. 1</figref>, the laptop <b>101</b> also includes a processing unit for running software and memory for storing data.

p-0029<figref idrefs="DRAWINGS">FIG. 2</figref> provides a schematic diagram illustrating a typical view of a graphical user interface <b>201</b> shown on the screen <b>102</b> of the laptop <b>101</b>. The graphical user interface <b>201</b> is generated by an operating system which runs on the laptop <b>101</b>. This graphical user interface <b>201</b> is typically the interface provided for controlling most other computer programs that a user may wish to run on the laptop. Examples of graphical user interfaces provided by operating systems include the so-called desktop view of Microsoft Windows XP™ and Vista™ operating systems and the desktop view of Apple MAC OS X™ operating system.

p-0030The graphical user interface <b>201</b> includes a cursor <b>202</b> which a user can move around using the touch sensitive pad <b>104</b>. A user can “select” items shown on the graphical user interface <b>201</b> by moving the cursor <b>202</b> to the position of the item and performing a selecting action such as a “double-tap” on the touch sensitive pad. The graphical user interface <b>201</b> includes a number of icons <b>203</b>, <b>204</b>, <b>205</b>, <b>206</b>, <b>207</b>, <b>208</b>. Each icon represents an application. An application is a computer program that can be loaded from the memory of the laptop <b>101</b> and run by the processor. Each application is typically run under the control of and in conjunction with the operating system. For the sake of brevity details of the interaction between the operating system and the applications will be omitted as these are well known in the art.

p-0031Each application provides a user with a number of functions. For example, a first application (e.g. “App <b>1</b>”) may be a web browser allowing a user to surf different internet sites. A second application (e.g. “App <b>2</b>”) may be a media player allowing a user to listen to audio content and watch video content. A third application (e.g. “App <b>3</b>”) may be an email client allowing a user to send and receive email. A fourth application (e.g. “App <b>4</b>”) may be an image viewing program allowing a user to view and edit images such as photographs. A fifth application (e.g. “App <b>5</b>”) may be a spreadsheet program allowing a user to generate and edit spreadsheets. Finally, a sixth application “App <b>6</b>” may be a word processing application allowing a user to generate and edit text documents.

p-0032A user can launch (i.e. load from memory and run on the processor of the laptop) one of the applications by selecting the corresponding icon using the cursor <b>202</b>. This is shown in <figref idrefs="DRAWINGS">FIG. 3</figref>.

p-0033<figref idrefs="DRAWINGS">FIG. 3</figref> provides a schematic diagram illustrating the graphical user interface <b>201</b> in which an icon <b>208</b> associated with one of the applications, “App <b>6</b>”, has been selected. When the icon <b>208</b> has been selected, App <b>6</b> is launched and a new graphical element <b>301</b> associated with App <b>6</b> is displayed. The graphical element <b>301</b> shown in <figref idrefs="DRAWINGS">FIG. 3</figref> is sometimes referred to as a “window”, “pane”, “control panel” or “dialogue box” with reference to conventional operating systems such as Microsoft Windows. The App <b>6</b> graphical element <b>301</b> includes graphical objects associated with App <b>6</b> (such as a representation of a page and a representation of text that a user has typed using the keyboard <b>103</b>) and user interface controls such as the “Fn1” icon which a user can select using the cursor <b>303</b> which may result in a drop down menu enabling a user to select further functions such as a “create new file” function.

p-0034As explained above, App <b>6</b> is a word processing application which allows a user to create documents by typing using the keyboard <b>103</b>. The graphical element <b>301</b> associated with App <b>6</b> may be manipulated by a user using the cursor <b>202</b>. This manipulation can include moving the graphical element <b>301</b> around and resizing the graphical element <b>301</b> by “dragging” and “dropping” in a conventional manner. Resizing the graphical element <b>301</b> is illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref>. Resizing the graphical element <b>301</b> may involve changing the height, width, or both height and width of the graphical element <b>301</b>.

p-0035Typically, when the graphical element <b>301</b> is resized as shown in <figref idrefs="DRAWINGS">FIG. 4</figref> (i.e. by reducing it in size), although the area of the display <b>201</b> taken up by the graphical element <b>301</b> is reduced, typically a user may still interact with the application. As shown in <figref idrefs="DRAWINGS">FIG. 5</figref>, the graphical element <b>301</b> may also be resized to expand in area.

p-0036When the graphical element <b>301</b> is resized as shown in <figref idrefs="DRAWINGS">FIGS. 4 and 5</figref>, a reduced or increased amount of the graphical element is displayed. However, the functions provided to the user do not change. For example, in <figref idrefs="DRAWINGS">FIG. 4</figref>, although a reduced amount of the graphical element is shown, a user is still able to enter text into the text document, although not all of the text may necessarily be displayed.

h-0007Size Dependent Graphical Elements

p-0037<figref idrefs="DRAWINGS">FIG. 6</figref> shows a schematic diagram of a data processing apparatus arranged in accordance with an example of the present invention. The apparatus includes a processing unit <b>601</b> and a memory <b>602</b> connected to the processing unit <b>601</b>. The processing unit <b>601</b> is operable to execute applications (i.e. computer programs) and the memory <b>602</b> is operable to store data such as application data. An application can be stored in the memory <b>602</b> in that data representing the instructions for running the application are stored in the memory. As described above, as and when the application is to be run, these instructions are loaded from the memory into the processing unit <b>601</b>. The processing unit <b>601</b> is connected to a control means <b>603</b> allowing a user to input control signals to the data processing apparatus. The control means <b>603</b> can comprise any suitable means for inputting user commands to the data processing apparatus. Examples include a keyboard, a computer mouse, a touch sensitive pad, a touch sensitive screen, a games console controller and so on.

p-0038The processing unit <b>601</b> is connected to a display unit <b>604</b> which is operable to display video information rendered by the processing unit <b>601</b>. In some examples the data processing apparatus may be arranged as a laptop as shown for example in <figref idrefs="DRAWINGS">FIG. 1</figref>. In some examples the data processing apparatus can be connected to peripheral devices such as speakers <b>605</b> which are connected to the processing unit <b>601</b> and a network connections means <b>606</b> such as a modem for the communication of data to and from external networks such as the internet. For example, a remote server <b>607</b> can be accessed via the interne.

p-0039<figref idrefs="DRAWINGS">FIG. 7</figref> shows a schematic diagram illustrating a resizable graphical element <b>702</b> generated by an application being run on the processing unit <b>601</b> and displayable on the display unit <b>604</b>. The generation of the graphical element typically involves the processing unit <b>601</b> rendering for display the graphical element based on instructions provided by the application. The rendering process typically involves converting the instructions provided by the application into data (for example pixel data) which can then be used to generate a video signal which is sent to the display unit <b>604</b>.

p-0040The application is run in conjunction with an operating system. For the sake of clarity, a graphical element associated with the operating system is not shown in <figref idrefs="DRAWINGS">FIG. 7</figref>, although it will be appreciated that the resizable graphical element <b>702</b> shown in <figref idrefs="DRAWINGS">FIG. 7</figref> could be displayed on an operating system graphical element as illustrated for example in <figref idrefs="DRAWINGS">FIGS. 2 to 5</figref>. A cursor <b>703</b> which is displayable on the display unit and a position of which a user can control using the control means <b>603</b> is shown. In the example shown in <figref idrefs="DRAWINGS">FIG. 7</figref>, the application that generates the graphical element <b>702</b> is a simple music playback application which reproduces audio content stored on the memory <b>602</b> using the speakers <b>605</b>. In another example, the audio content may be streamed from an external server to the data processing apparatus and received via the network connection <b>606</b>.

p-0041The graphical element <b>702</b> associated with the simple music playback application includes a simple user interface control, namely two playback controls <b>704</b>, <b>705</b> that a user can manipulate with the cursor <b>703</b>, and a simple graphical object, namely an information bar <b>706</b> providing information on a music track that is currently being played. As shown in <figref idrefs="DRAWINGS">FIG. 8</figref>, similar to the graphical element <b>301</b> shown in <figref idrefs="DRAWINGS">FIGS. 3</figref>, <b>4</b> and <b>5</b>, a user can resize the graphical element <b>702</b> associated with the music playback application using the cursor <b>703</b> by, for example, selecting an outer edge of the graphical element <b>702</b> and moving the cursor downwards and rightwards. In some examples horizontal movement of the cursor will increase or decrease the width of the graphical element <b>702</b>, whereas vertical movement will increase or decrease the height of the graphical element <b>702</b>. In other examples, the aspect ratio of the graphical element will be constant, i.e. any movement of the cursor which changes one dimension of the graphical element will produce a corresponding change in the other dimension (e.g. moving the cursor horizontally to double the width of the graphical element results in a corresponding doubling of the height of the graphical element). In some examples the graphical element <b>702</b> can be resized by performing other operations such as performing a “double-tap” operation on the control means <b>603</b> or causing any other suitable pattern of cursor operation to occur.

p-0042As will be appreciated from <figref idrefs="DRAWINGS">FIGS. 7 and 8</figref>, as the user moves the cursor away from the position of the graphical element <b>702</b>, it will increase in size. However, once the graphical element <b>702</b> reaches a first predetermined threshold size it is replaced by a second graphical element.

p-0043This is illustrated in <figref idrefs="DRAWINGS">FIG. 9</figref>.

p-0044<figref idrefs="DRAWINGS">FIG. 9</figref> shows a schematic diagram of a view of the display <b>701</b> shown on the display unit <b>604</b> of the graphical element that, due to user resizing, has exceeded a first predetermined threshold size. In some examples, the predetermined threshold size can correspond to a threshold area (i.e. the predetermined threshold size is not defined by a specific width value or height value, it is determined by the area which is the width multiplied by the height). In other examples, the predetermined threshold size is defined by a threshold width and a threshold height both of which have to be exceeded. In other examples the predetermined threshold size is defined by a single dimension, i.e. defined by either a threshold height or threshold width.

p-0045As is illustrated in <figref idrefs="DRAWINGS">FIG. 9</figref>, once the predetermined threshold size is exceeded, rather than simply increasing the size of the graphical element <b>702</b>, a second graphical element <b>901</b> replaces the first graphical element. The second graphical element includes graphical objects and user interface controls which are different to those provided with the first graphical element.

p-0046Specifically, the second graphical element includes further playback controls <b>903</b>, <b>904</b>, a playlist <b>902</b> of music related to the currently playing track and an image <b>905</b> which is associated with the music track currently being played.

p-0047<figref idrefs="DRAWINGS">FIG. 10</figref> provides a schematic diagram of a view as the user resizes the second graphical element <b>901</b> further using the cursor <b>703</b>. As can be seen, the size of the second graphical element <b>901</b> increases and the relative positions of the elements that are included in the second graphical element <b>901</b> have changed. However, despite the resizing, in both the second graphical element <b>901</b> shown in <figref idrefs="DRAWINGS">FIG. 9</figref> and the resized version of the second graphical element <b>901</b> shown in <figref idrefs="DRAWINGS">FIG. 10</figref>, the graphical objects and user interface controls remain the same.

p-0048<figref idrefs="DRAWINGS">FIG. 11</figref> shows a schematic diagram of the graphical element that, due to continued user resizing, has exceeded a second predetermined threshold size. As described above, the predetermined threshold size can be determined by either an absolute area value or specific threshold height and width values or a specific height value or specific width value. As can be seen from <figref idrefs="DRAWINGS">FIG. 11</figref>, as the second predetermined threshold size has been exceeded, a third graphical element <b>1101</b> is now displayed which along with the previous graphical objects and user interface controls includes yet more graphical objects and user interface controls such as a file directory <b>1102</b> which shows various music tracks stored on the memory <b>602</b>, a web interface <b>1103</b> providing access to a website that allows the user to purchase content related to the currently played track and a social networking portal <b>1104</b> that includes an indication of music tracks that other users are listening to or have recently listened to.

p-0049In some examples, the process illustrated in <figref idrefs="DRAWINGS">FIGS. 7 to 11</figref> can happen in reverse. For example, if the third graphical element <b>1101</b> is resized so that it is reduced in size below the second predetermined threshold size, the third graphical element <b>1101</b> is replaced with the second graphical element <b>901</b>. Similarly, if the second graphical element <b>901</b> is resized so that it is reduced in size below the first predetermined threshold size, it is replaced with the first graphical element <b>702</b>.

p-0050In some examples the actual content of each graphical element may be dependent on a user's previous actions (e.g. a user history) and/or a user profile. Accordingly, when a graphical element is displayed which includes elements dependent on a user history or user profile, the data processing apparatus may be operable to access user data from, for example the remote server <b>607</b>, via the network connection means <b>606</b> to access such user data. Examples of a user history include websites previously visited, online content purchases previously made, instant messages previously sent to other users and so on. Examples of a user profile include profile data indicating online services to which the user has subscribed, a layout of a customised social networking website homepage, online search engine preferences and so on.

p-0051In some examples, in order to reduce the time taken switching between graphical elements, each graphical element is rendered by the data processing apparatus at substantially the same time, for example as soon as a first graphical element is displayed. However, all but one graphical element is displayed with an opacity value of zero. As is known, many operating systems permit elements to be displayed with a predefined opacity value which dictates a degree to which they appear to be transparent when displayed. Accordingly, by setting this opacity value to zero, although all the processing and memory allocation processes required to render the graphical elements have been undertaken, the graphical elements are not actually displayed. The graphical element which does not have an opacity value of zero is provided with a non-zero opacity value so that it can be seen on the display means <b>604</b>.

p-0052<figref idrefs="DRAWINGS">FIGS. 12</figref><i>a </i>to <b>12</b><i>h </i>provide schematic diagrams illustrating further examples of a number of resizable graphical elements displayable in accordance with examples of the present invention. <figref idrefs="DRAWINGS">FIG. 12</figref><i>a </i>shows a schematic diagram of a first graphical element which when resized to exceed a first predetermined threshold size is replaced with a second graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>b</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>b </i>is resized to exceed a second predetermined threshold size, it is replaced by a third graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>c</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>c </i>is resized to exceed a third predetermined threshold size, it is replaced by a fourth graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>d</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>d </i>is resized to exceed a fourth predetermined threshold size, it is replaced by a fifth graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>e</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>e </i>is resized to exceed a fifth predetermined threshold size, it is replaced by a sixth graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>f</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>f </i>is resized to exceed a sixth predetermined threshold size, it is replaced by a seventh graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>g</i>. When the graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>g </i>is resized to exceed a seventh predetermined threshold size, it is replaced by an eighth graphical element shown in <figref idrefs="DRAWINGS">FIG. 12</figref><i>h. </i>

h-0008Display States

p-0053As described with reference to <figref idrefs="DRAWINGS">FIGS. 7 to 12</figref><i>h</i>, once a graphical element is resized to exceed a predetermined threshold size, it is replaced by another graphical element. An alternative way to describe this procedure is in terms of a number of “display states”. In other words, each graphical element is considered equivalent to a display state. This concept is illustrated in <figref idrefs="DRAWINGS">FIG. 13</figref>.

p-0054<figref idrefs="DRAWINGS">FIG. 13</figref> shows a schematic diagram illustrating minimum widths and heights that define three display states. A broken line <b>131</b> indicates a current size that a user has resized a graphical element to. As can be seen from <figref idrefs="DRAWINGS">FIG. 13</figref>, this has exceeded the minimum width and height of display state <b>1</b> and display state <b>2</b>. Accordingly, the graphical element associated with display state <b>2</b> is displayed.

p-0055As mentioned above, each state is associated with a particular graphical element. Taking the graphical elements shown in <figref idrefs="DRAWINGS">FIGS. 8 and 9</figref> as examples, state <b>1</b> could relate to a graphical element containing two playback controls and an information bar. State <b>2</b> could relate to a graphical element containing further playback controls, a playlist and an image. To illustrate this concept further, Table 1 is provided below which describes the various graphical elements illustrated in <figref idrefs="DRAWINGS">FIGS. 12</figref><i>a </i>to <b>12</b><i>h </i>in terms of display states and indicates the composition of the graphical element in each case:

p-0056<tables id="TABLE-US-00001" num="00001"><table frame="none" colsep="0" rowsep="0"><tgroup align="left" colsep="0" rowsep="0" cols="2"><colspec colname="1" colwidth="49pt" align="left" /><colspec colname="2" colwidth="168pt" align="left" /><thead><row><entry namest="1" nameend="2" rowsep="1">TABLE 1</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row><row><entry>Display State</entry><entry>Composition</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></thead><tbody valign="top"><row><entry>State 1</entry><entry>The icon of the application</entry></row><row><entry>State 2</entry><entry>The cover art of the song currently listened to</entry></row><row><entry>State 3</entry><entry>The cover art of the song currently listened to and a</entry></row><row><entry /><entry>recommendation</entry></row><row><entry>State 4</entry><entry>A history of the current song and the previous song</entry></row><row><entry>State 5</entry><entry>A history of the current song and the previous song plus</entry></row><row><entry /><entry>recommendations</entry></row><row><entry>State 6</entry><entry>A more complete history</entry></row><row><entry>State 7</entry><entry>A more complete history plus recommendations</entry></row><row><entry>State 8</entry><entry>A Web page</entry></row><row><entry namest="1" nameend="2" align="center" rowsep="1" /></row></tbody></tgroup></table></tables><br /> First Example Implementation of Size Dependent Graphical Elements

p-0057<figref idrefs="DRAWINGS">FIG. 14</figref> provides a schematic diagram of a flowchart which illustrates an algorithm showing a first example implementation of the display of the size dependent graphical elements on the data processing device shown in <figref idrefs="DRAWINGS">FIG. 6</figref>.

p-0058In this implementation an application is arranged to run on the processing unit <b>601</b> and a first graphical element is displayed.

p-0059At step S<b>101</b> a resize event is detected as the user uses the control means <b>603</b> to resize the first graphical element.

p-0060At step S<b>102</b>, the processing unit <b>601</b> sets the display state to a tentative “highest” state. The highest state could refer to a most complex state (i.e. a state which provides the most functionality) or a state which is the result of the user resizing the graphical element to its maximum possible size. In the example shown in <figref idrefs="DRAWINGS">FIG. 13</figref>, the highest state could refer state <b>3</b>.

p-0061At step S<b>103</b> the dimensions of the resized graphical element are referenced and it is determined if the highest state is displayable. For example, with reference to <figref idrefs="DRAWINGS">FIG. 13</figref>, assuming state <b>3</b> is the highest state, the user has resized the graphical element to a size which is smaller than the minimum width and height associated with state <b>3</b>. Accordingly, it is not displayable.

p-0062In this case the algorithm moves to step S<b>104</b>. At step S<b>104</b> the state below the current state (which in the example shown in <figref idrefs="DRAWINGS">FIG. 13</figref> would be state <b>2</b> as this is below state <b>3</b>) is set as the tentative state.

p-0063The algorithm returns to step S<b>103</b> at which point, in the example shown in <figref idrefs="DRAWINGS">FIG. 13</figref>, it would be determined that state <b>2</b> is displayable because the minimum width and the minimum height associated with state <b>2</b> is smaller than that associated with the resized graphical element.

p-0064At step S<b>105</b>, the graphical element is configured in accordance with the state determined at S<b>104</b> (e.g. state <b>2</b> shown in <figref idrefs="DRAWINGS">FIG. 13</figref>).

p-0065At step S<b>106</b> an optional step is performed in which user data from an external server is retrieved to update components of the graphical element that are shown in the selected state and are relevant to user data. For example, this data could relate to past actions of the user such as the purchasing of content online, data relating to social networking and so on.

p-0066At step S<b>107</b> a further optional step is performed in which the components of the graphical element (as defined by the state determined at step S<b>103</b>) are arranged in accordance with the current size of the graphical element.

p-0067At step S<b>108</b> the graphical element is displayed on the display <b>604</b>.

h-0009Second Example Implementation of Size Dependent Graphical Elements

p-0068In the examples described above, the graphical elements which replace each other based on the resizing performed by a user may be implemented by a single application. However, as will be appreciated by comparing <figref idrefs="DRAWINGS">FIGS. 7</figref>, <b>9</b> and <b>11</b>, and comparing <figref idrefs="DRAWINGS">FIGS. 12</figref><i>a </i>to <b>12</b><i>h</i>, in the examples described above, as a user resizes the graphical element to change between the various different graphical elements, the functionality that a user is provided and thus the complexity of the graphical element changes. In some examples, each graphical element is provided by a separate application which is run on the data processing unit <b>601</b>.

p-0069Accordingly in some examples, the first graphical element <b>702</b> is provided by a first simple music playback application. This playback application typically provides very basic functions, for example providing a user with a minimal number of functions to playback music such as a “start playing track” and “stop playing track” function, and a graphical display indicating the name of the track currently being played.

p-0070The second graphical element is provided by a second more complex application which, for example, provides a user with further playback functions such as a “fast-forward” function and a “re-wind” function and allows a user to select different music tracks.

p-0071Finally the third graphical element is provided by an application which is more complex still in that it provides a user with a comprehensive number of functions to control how music tracks are played back, organised and so on.

p-0072<figref idrefs="DRAWINGS">FIG. 15</figref> shows a schematic diagram providing a simplified illustration of how the various graphical elements described above can be implemented on the data processing apparatus shown in <figref idrefs="DRAWINGS">FIG. 6</figref>.

p-0073As shown in <figref idrefs="DRAWINGS">FIG. 15</figref>, an operating system <b>1201</b> runs on the data processing unit <b>601</b>. Examples of operating systems include Windows. Mac OS X, Linux, iPhone or Android.

p-0074In the case shown in <figref idrefs="DRAWINGS">FIGS. 7 and 8</figref>, the first graphical element <b>702</b> is shown on the display <b>701</b>. As mentioned above, the first graphical element <b>702</b> is provided by a simple application <b>1202</b> which is loaded from the memory <b>602</b> to the data processing unit <b>601</b>.

p-0075As described above, when the user resizes the first graphical element <b>702</b> beyond the first predetermined threshold size, the first graphical element <b>702</b> is replaced by the second graphical element <b>901</b>. The second graphical element <b>901</b> is provided by the second application. Accordingly, when the user resizes the first graphical element beyond the first predetermined threshold size, the second application <b>1203</b> is loaded from the memory <b>602</b> to the data processing unit <b>601</b>. The second application <b>1203</b> is then run which provides the second graphical element <b>901</b>.

p-0076When the user resizes the second graphical element <b>901</b> beyond the second predetermined threshold size, the second graphical element <b>901</b> is replaced by the third graphical element <b>1101</b>. The third graphical element <b>1101</b> is provided by the third application. Accordingly, when the user resizes the second graphical element <b>901</b> beyond the second predetermined threshold size, the third application <b>1204</b> is loaded from the memory <b>602</b> to the data processing unit <b>601</b>. The third application <b>1204</b> is then run which provides the third graphical element <b>1101</b>.

p-0077As will be appreciated, as well as a transition from displaying the first graphical element to the second graphical element, and the second graphical element to the third graphical element, it will be appreciated that the opposite can occur. For example, when a user resizes the third graphical element so that it is reduced to a size below the second predetermined threshold size, the data processing apparatus can be arranged to switch to the display of the second graphical element. Equally, when a user resizes the second graphical element so that it is reduced to a size below the first predetermined threshold size, the data processing apparatus can be arranged to switch to the display of the first graphical element.

h-0010Thematic Display

p-0078The following describes how the concepts relating to the size dependent graphical elements described above can be employed to provide a thematic display which allows a user to more easily control and navigate through multiple functions provided by a number of applications.

p-0079<figref idrefs="DRAWINGS">FIGS. 2</figref>, <b>3</b>, <b>4</b> and <b>5</b> illustrate examples of how the graphical element of a conventional operating system is organised. As discussed above, a series of icons are displayed. When one of the icons is selected by a user a corresponding application is launched which typically results in the display of a resizable graphical element (e.g. a “window”). Other methods of launching applications include opening a drop-down or pop-up menu and selecting an application for launch from a list of applications.

p-0080Typically, the applications will include a great deal of related functionality. For example, a web browser application may allow a social networking site to be displayed which allows a user to send and receive messages from other users. However, an email client application may do much the same thing except, whereas the social networking site may permit a user to send and receive simple messages, the email client may allow the user to send and receive attachments with email including data files such as images, audio files, word processing files and so on.

p-0081It will be understood therefore, that many of the applications that the user may launch on the data processing apparatus include related functionality. However, in conventional data processing apparatus such as the laptop shown in <figref idrefs="DRAWINGS">FIG. 1</figref>, this functionality can only be accessed by launching multiple separate applications which can be confusing and inconvenient for a user.

p-0082In some examples the data processing apparatus shown in <figref idrefs="DRAWINGS">FIG. 6</figref> can be arranged to provide a “thematic display”. In the thematic display, rather than providing various different types of functionality to a user via a number of discrete applications, the thematic display divides the functionality into “themes” and each theme is then provided with its own graphical element. Furthermore, as will be understood with reference to the graphical element shown in <figref idrefs="DRAWINGS">FIGS. 7 to 11</figref>, in the thematic display, the graphical element associated with each theme is resizable. When each “themed” graphical element is resized beyond a predetermined threshold size, the graphical element changes to include a different, typically more comprehensive level of functionality. In other words, the information displayed to the user is more detailed and the graphical element provides a greater number of functions and a higher level of control.

p-0083<figref idrefs="DRAWINGS">FIG. 16</figref> shows a schematic diagram of a thematic display <b>1301</b> for display on a data processing apparatus such as that illustrated in <figref idrefs="DRAWINGS">FIG. 6</figref> which incorporates the graphical elements principles described with reference to <figref idrefs="DRAWINGS">FIGS. 7 to 11</figref>.

p-0084The thematic display <b>1301</b> includes a first “media” graphical element <b>702</b> (as described above with reference to <figref idrefs="DRAWINGS">FIG. 7</figref>), a first “communication” graphical element <b>1302</b> and a first “office” graphical element <b>1303</b>.

p-0085The media graphical element <b>702</b> provides in one graphical element various functions associated with media on the data processing apparatus, i.e. functions or applications relating to audio and video playback and the managing of audio and video content stored on or accessible to the data processing apparatus. Similarly the communication graphical element <b>1302</b> is intended to provide in one graphical element various functions or applications relating to communication such as the sending and receiving of email, instant messaging, VoIP and so on. Finally the office graphical element <b>1303</b> is intended to provide in one graphical element access to functions or applications associated with the creation and editing of office type files such as spread sheet, word processing documents, presentations and so on.

p-0086As shown in <figref idrefs="DRAWINGS">FIG. 16</figref>, the first media graphical element <b>702</b> includes two playback controls <b>704</b>, <b>705</b> and an information bar <b>706</b> providing information on a music track that is currently playing. The first communication graphical element <b>1302</b> includes a simple message pane <b>1304</b> which includes a most recently received message from another user. The first office graphical element <b>1303</b> simply includes two icons <b>1305</b>, <b>1306</b> which represent two most recently edited files. The first icon <b>1305</b> represents a most recently edited presentation and the second icon <b>1306</b> represents a most recently edited word processing file.

p-0087<figref idrefs="DRAWINGS">FIG. 17</figref> shows a schematic diagram illustrating the display <b>1301</b> after the first communication graphical element <b>1302</b> has been resized beyond a predetermined threshold size and the first communication graphical element <b>1302</b> has been replaced by a second communication graphical element <b>1405</b>. As can be seen, the original simple message pane <b>1304</b> from the first communication graphical element has been replaced by a more complex message pane including further controls <b>1401</b>, <b>1402</b>. A “Recent Messages” pane <b>1403</b> is included displaying recently received messages and a contact list <b>1404</b> is included providing a list of contact details such as email addresses.

p-0088<figref idrefs="DRAWINGS">FIG. 18</figref> shows a schematic diagram illustrating the display <b>1301</b> after the second communication graphical element <b>1405</b> has been resized beyond a second predetermined threshold size and replaced by a third communication graphical element <b>1501</b>. As can be seen, a very detailed messaging pane <b>1502</b> is provided which includes controls and information panes that allows a user a high degree of control over the sending and receiving of messages and managing of contacts. The third communication graphical element <b>1501</b> also includes a video pane <b>1503</b> that allows the user to take part in video conferencing. The third media graphical element <b>1501</b> also includes a web browser pane <b>1504</b> which provides access to a social networking website.

p-0089<figref idrefs="DRAWINGS">FIG. 19</figref> shows a schematic diagram illustrating the display <b>1301</b> after the office graphical element <b>1303</b> has been resized beyond a predetermined threshold size and the first office graphical element <b>1303</b> has been replaced by a second office graphical element <b>1601</b>. As can be seen, the original two icons <b>1305</b>, <b>1306</b> which represent two most recently edited files have been replaced by a pane which shows an editing screen <b>1602</b> for editing the most recently edited file which was indicated by the first icon <b>1306</b>. In this example, the user is able to begin directly editing the most recently opened file by simply resizing the first office graphical element <b>1303</b>.

p-0090<figref idrefs="DRAWINGS">FIG. 20</figref> shows a schematic diagram illustrating the display <b>1301</b> after the second office graphical element <b>1601</b> has been resized beyond a second predetermined threshold size and replaced by a third office graphical element <b>1701</b>. As can be seen, the editing screen <b>1602</b> has gone and is replaced by a recent file pane <b>1702</b> providing a detailed overview of recently edited files; a diary pane <b>1703</b> showing the user's schedule and allowing the user to add and delete appointments and so on, a clock graphic <b>1704</b> indicating the time, and an application pane <b>1705</b>. The application pane <b>1705</b> provides icons which allow a user to launch conventional applications (such as a spreadsheet application, word processor application, presentation application and so on) by selecting an appropriate icon.

p-0091The various interface controls and graphical objects shown within the graphical elements illustrated in <figref idrefs="DRAWINGS">FIGS. 16 to 20</figref> may be provided by different applications. For example the video pane <b>1503</b> of the third media graphical element <b>1501</b> maybe provided by a video conferencing application whilst the web browser pane <b>1504</b> may be provided by a web browser application.

p-0092<figref idrefs="DRAWINGS">FIG. 21</figref> provides a schematic diagram showing a flowchart illustrating an example method according to the present invention. At step S<b>201</b> a first graphical element is displayed by a data processing device. At step S<b>202</b> the data processing apparatus detects a resize control input which causes the data processing apparatus to resize the display of the first graphical element. At step S<b>203</b> the data processing apparatus determines if the first graphical element has been resized beyond a first predetermined threshold size. If so at S<b>204</b> a second graphical element is displayed to replace the first graphical element. If not, the data processing, apparatus determines if the first graphical element has been resized so as to be smaller than a second predetermined threshold size. If so, the data processing apparatus displays a third graphical element at step S<b>206</b>. If not, the data processing apparatus continues to display the first graphical element.

p-0093Insofar as the embodiments of the invention described above are implemented, at least in part, using software controlled data processing apparatus, it will be appreciated that a computer program providing such software control and a transmission, storage or other medium by which such a computer program is provided are envisaged as aspects of the present invention.

p-0094Various modifications can be made to the above described embodiments without departing from the scope of the invention. For example, it will be appreciated that suitable data processing apparatuses for implementing examples of the present invention typically include all suitable data processing apparatuses that include a display means such as a screen. This includes for example mobile telephones, games consoles such as the Sony PS3™, portable game devices such as the Sony PSP™, set top boxes, televisions, personal media players, tablet computing devices and so on.

p-0095Further more, although examples of the present invention have been described mainly with reference to graphical elements provided by an application (or applications) being executed in conjunction with an operating system running on the data processing apparatus itself, in some examples the graphical elements can be provided via a web application presented in a web browser such as Internet Explorer™, Firefox™ or Chrome™. In such examples the application or applications could be Flash™ or Silverlight™ applications embedded in the browser.