Scrolling assisted by relevance indication

BACKGROUND OF THE INVENTION

Field of the Invention

0001The invention relates to computer systems and, more particularly, to scrolling of displayed information in away which reflects the relevance of the material at a particular point in the scroll.

Description of Related Art

0002Scrollbars are used in various software programs to enable a user to view different portions of long files. Some software programs add limited information to the scrollbar thumb. For example, some word processing software will display the current page number while the user is scrolling. However, this information does not indicate the relevance of the content visible at the scrolled location.

0003Programs and procedures that can find and mark relevant content in a document are known in the art. For example, many World Wide Web search engines, when responding to an information retrieval query, mark all occurrences of terms from the query in the documents with an HTML tag (typically STRONG).

The Problems

0004When scrolling through long document files users have no way of knowing where in the file relevant content is located. This requires users to stop scrolling at regular intervals to view the content to determine its relevance. This problem commonly occurs in browsers , in information retrieval systems, and in word processing programs.

SUMMARY OF THE INVENTION

0005The invention provides methods, apparatus, systems and computer program products which change a display of information, such as changing the appearance of a scroll bar thumb to reflect the amount of relevant content which would be visible in a display window at the current location of the scrolling thumb on the scrollbar. When a document is retrieved, it is examined for the presence of relevance markers which can be used to identify terms in the search query used to retrieve the document. These relevance markers can be applied either at the server prior to downloading to a user or at the user, if the search engine is not so equipped. Various algorithms can be used to map relevant content to a representation of the amount of relevant content in away which can be perceived by a user.

0006The invention relates to a computer having a graphical user interface providing a visual indication of the presence of relevant information at different scrolling locations in a document.

0007The invention also relates to a computer configured to submit an information retrieval query, store the terms of that query in said memory and add one or more relevance markers to information retrieved in response to that query.

0008The invention also relates to a method of displaying information retrieved in response to a query by determining the amount of relevant information at a particular scrolling location and modifying a system attribute to indicate that amount of relevant information.

0009The invention also relates to a method of retrieving information by submitting a query to a search engine, retrieving information from said search engine in response to the query; and if information retrieved from said search engine contains no relevance markers, adding relevance markers to the information retrieved.

0010The invention also relates to a method of identifying relevant information retrieved in response to a query by identifying query terms in the information retrieved and inserting a relevance marker adjacent each query term identified.

0011The invention also relates to a method of identifying the amount of relevant information at a particular scrolling location by counting a number of relevance markers contained in the information displayed or that would be displayed at that location, and altering a system attribute to reflect said number.

0012The invention also relates to systems and computer program products for carrying out these techniques.

0013The foregoing and other features, aspects and advantages of the present invention will become more apparent from the following detailed description of the present invention when taken in conjunction with the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

0014The objects, features and advantages of the system of the present invention will be apparent from the following description in which:

0015<b>Figure 1A</b> is a view of exemplary computer system suitable for use in carrying out the invention.

0016<b>Figure 1B</b> is a block diagram of an exemplary hardware configuration of the computer of Figure 1.

0017<b>Figure 1C</b> is an illustration of an exemplary memory medium suitable for storing program and data information in accordance with the invention.

0018<b>Figure 1D</b> is a block diagram of a network architecture suitable for carrying data and programs in accordance with some aspects of the invention.

0019<b>Figure 2A</b> is flow chart of an exemplary relevance enhanced scrolling process for displaying documents in accordance with one embodiment of the invention.

0020<b>Figure 2B</b> is a flow chart of an exemplary process for adding relevance markers locally in accordance with one embodiment of the invention.

0021<b>Figure 3</b> illustrates the relationship between a text file, a character generator and a display window and its corresponding video buffer.

0022<b>Figure 4</b> is a flow chart of an exemplary relevance-enhanced scrolling process in accordance with one embodiment of the invention.

0023<b>Figure 5</b> is a flow chart of one embodiment of a process for altering a display to reflect the relevance of a portion of a document that would be visible at a scrolling location.

0024<b>Figure 6</b> is a look up table which can be used to set color based on a number of relevance markers that would be visible at a given scrolling location.

0025<b>Figure 7</b> is a flow chart of an exemplary process for setting color of an on-screen object based on relevance.

NOTATIONS AND NOMENCLATURE

0026The detailed descriptions which follow may be presented in terms of program procedures executed on a computer or network of computers. These procedural descriptions and representations are the means used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art.

0027A procedure is here, and generally, conceived to be a self-consistent sequence of steps leading to a desired result. These steps are those requiring physical manipulations of physical quantities. Usually, though not necessarily, these quantities take the form of electrical or magnetic signals capable of being stored, transferred, combined, compared, and otherwise manipulated. It proves convenient at times, principally for reasons of common usage, to refer to these signals as bits, values, elements, symbols, characters, terms, numbers, or the like. It should be noted, however, that all of these and similar terms are to be associated with the appropriate physical quantities and are merely convenient labels applied to these quantities.

0028Further, the manipulations performed are often referred to in terms, such as adding or comparing, which are commonly associated with mental operations performed by a human operator. No such capability of a human operator is necessary, or desirable in most cases, in any of the operations described herein which form part of the present invention; the operations are machine operations. Useful machines for performing the operation of the present invention include general purpose digital computers or similar devices.

0029The present invention also relates to apparatus for performing these operations. This apparatus may be specially constructed for the required purpose or it may comprise a general purpose computer as selectively activated or reconfigured by a computer program stored in the computer. The procedures presented herein are not inherently related to a particular computer or other apparatus. Various general purpose machines may be used with programs written in accordance with the teachings herein, or it may prove more convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these machines will appear from the description given.

DESCRIPTION OF THE PREFERRED EMBODIMENT

0030<b>Figure 1A</b> illustrates a computer of a type suitable for carrying out the invention. Viewed externally in <b>Figure 1A</b>, a computer system has a central processing unit <b>100</b> having disk drives <b>110A</b> and <b>110B</b>. Disk drive indications <b>110A</b> and <b>110B</b> are merely symbolic of a number of disk drives which might be accommodated by the computer system. Typically, these would include a floppy disk drive such as <b>110A</b>, a hard disk drive (not shown externally) and a CD ROM drive indicated by slot <b>110B</b>. The number and type of drives varies, typically, with different computer configurations. The computer has the display <b>120</b> upon which information is displayed. A keyboard <b>130</b> and a mouse <b>140</b> are typically also available as input devices. Preferably, the computer illustrated in <b>Figure 1A</b> is a SPARC workstation from Sun Microsystems, Inc.

0031<b>Figure 1B</b> illustrates a block diagram of the internal hardware of the computer of <b>Figure 1A</b>. A bus <b>150</b> serves as the main information highway interconnecting the other components of the computer. CPU <b>155</b> is the central processing unit of the system, performing calculations and logic operations required to execute programs. Read only memory (<b>160</b>) and random access memory (<b>165</b>) constitute the main memory of the computer. Disk controller <b>170</b> interfaces one or more disk drives to the system bus <b>150</b>. These disk drives may be floppy disk drives, such as <b>173</b>, internal or external hard drives, such as <b>172</b>, or CD ROM or DVD (Digital Video Disks) drives such as <b>171</b>. A display interface <b>175</b> interfaces a display <b>120</b> and permits information from the bus to be viewed on the display. Communications with external devices can occur over communications port <b>185</b>.

0032<b>Figure 1C</b> illustrates an exemplary memory medium which can be used with drives such as <b>173</b> in <b>Figure 1B</b> or <b>110A</b> in <b>Figure 1A</b>. Typically, memory media such as a floppy disk, or a CD ROM, or a Digital Video Disk will contain the program information for controlling the computer to enable the computer to perform its functions in accordance with the invention.

0033<b>Figure 1D</b> is a block diagram of a network architecture suitable for carrying data and programs in accordance with some aspects of the invention. A network <b>190</b> serves to connect a user computer <b>100</b> with one or more servers, such as server <b>195</b> for the download of program and data information. A user <b>100'</b> can also connect to the network via a network service provider, such as ISP <b>180</b>.

0034<b>Figure 2A</b> is a flow chart of an exemplary relevance-enhanced scrolling process for displaying documents in accordance with one embodiment of the invention. When a user submits a query (<b>200</b>) such as might be done in an information retrieval system or, for example, when using a "find" command either within a word processing program or within a browser, the search terms from the query are captured (<b>220</b>) and stored locally (<b>210</b>). In systems where it is known that the server provides marking of query terms, this step is unnecessary. However, in an environment where some servers provide query term marking and others do not, a local capability for identifying relevant portions of a document is desirable. Storing the search terms permits this. In response to a query to an information retrieval system, a list of relevant documents, which contain one or more of the search terms are displayed to the user for the user's consideration. The user then selects one of the listed documents for retrieval (<b>230</b>). When the document is retrieved, it is examined to determine whether it contains relevance marking. If relevance marking is detected, the document is displayed (<b>260</b>) as discussed more hereinafter. If no relevance marking is detected (<b>240-N</b>), relevance markers are added locally as described more in conjunction with <b>Figure 2B</b> (<b>250</b>).

0035In a preferred embodiment, an indication of how relevant a section of text is is based on the number of query terms found in that section of text. Other relevance indicators are also possible. For example, one could keep a count of the number of times a section of text was opened by a user (analogous to a well worn book falling open to one's favorite pages). Alternatively, an eyetracker could keep track of the sections of text of most interest to users, based on how long they considered the text.

0036Where a search engine provides relevance rankings based on a layer portion of text, such as a paragraph, one could use a summation of all relevance indicators for a section of text.

0037<b>Figure 2B</b> is a flow chart of an exemplary process for adding relevance markers locally in accordance with one aspect of the invention.

0038As a document is retrieved after a query, the incoming text is examined to determine whether or not the document contains relevance markers adjacent to search terms. A similar process is undertaken with respect to locally applying relevance markers. The document text is examined and passed through a text filter to identify terms within the text which match one or more query terms (<b>270</b>). For each query term identified, a relevance marker is inserted adjacent to the query term in the document. Typically, a relevance marker might be the HTML tag <STRONG>. Existing search engines utilize this marker to identify terms from the query. However, the term <STRONG> is also used by authors to emphasize portions of their text. So by using the same HTML tag to identify query terms, one cannot distinguish between author emphasis and query term identification emphasis. To distinguish these conditions better, it is preferred to use a new relevance marker which, in the case of an HTML tag would be <RELEVANT>. One could also combine a relevance tag <RELEVANT> with an author generated tag <STRONG>. Once the local identification process illustrated in <b>Figure 2B</b> is completed, a relevance-enhanced file will exist containing embedded relevance markers next to each query term.

0039<b>Figure 3</b> illustrates a relationship between a text file, a character generator and a display window and its corresponding video buffer. Text files are typically represented as ASCII. Such a text file is illustrated at item <b>300</b>. When a character is displayed on a screen, it is typically displayed as a matrix of pixels, for example, as a 6 X 9 pixel array. Since the display screen is made up of individual pixels, individual characters from a text file are translated into pixel arrays suitable for displaying the character on the screen by a character generator <b>310</b>. Typically, the character generator can be controlled by setting attributes such as font size, font type, highlighting, blinking, pixel inversion or the like. Typically, a default font type and size is established for the display. However, this can be established by commands, for example HTML commands, embedded within the text. Also, it is typical that the default representations for terms which are marked as <STRONG> are pre-established. As text is read from the text file into the character generator, the HTML tag or other markers are read to identify the attributes with which a character or set of characters are to be represented. The character generator then responds to these marks and generates the appropriate character with the desired attributes. These are then displayed in a window. Typically, a window is a bit mapped representation in which the text will be displayed. Commonly, there is a display buffer which has a bit map 1 to 1 correspondence with the pixels of the display window. As shown in item <b>320</b> in <b>Figure 3</b>, the right hand extent of the display window is occupied by a scroll bar in a well-known fashion. The range of scrolling available in the display window is shown and when a scroll bar is moved within the scrolling channel, the text from the text file that corresponds to a certain displacement of the scrolling thumb is displayed in the display window <b>320</b>. In the example shown, scroll thumb position <b>330</b>, shown in dashed lines, is displaced 38% from the top of the scroll bar toward the bottom. The underlying text, which would be displayed in the display window <b>320</b>, is the text which corresponds approximately to text beginning 38% of the way through the text file <b>300</b>.

0040<b>Figure 4</b> is a flow chart of an exemplary relevance-enhanced scrolling process in accordance with one embodiment of the invention. First, a location of the scroll bar thumb, typically expressed as a percentage of the overall range of the scroll bar is determined (<b>400</b>) and a corresponding location in the relevance-enhanced text file is determined (<b>410</b>) as discussed above. Thus, as shown in <b>Figure 3</b>, the scroll bar is displaced 38% of the linear distance constituting the range of scroll bar movement. Accordingly, the corresponding starting location in the relevance-enhanced text file would be approximately 38% into the file. Characters are read from the relevance-enhanced text file beginning with the corresponding starting location and passed to the character generator until the screen is filled, while concurrently counting the relevance markers within the text file. Note the existence of relevance markers within the text file would normally be ignored when determining position for the corresponding starting location. They would also be ignored in counting the number of characters displayed for purposes of filling the screen. However, they are not ignored, but rather counted, when determining the number of relevance markers in a segment of text <b>420</b>. Once the number of relevance markers is determined for a particular segment of text, a system attribute, such as the color of an object displayed will be altered to reflect the number of those markers that would be displayed on the screen if the scrolling were stopped at that point <b>430</b>. Other system attributes include sound and a selection of an object displayed.

0041<b>Figure 5</b> is a flow chart of one embodiment of a process for altering a display to reflect the relevance of portions of a document that would be visible at a scrolling location. If the count of relevance markers is zero (<b>400-N</b>), a sad face is displayed in the scroll bar thumb (<b>410</b>). If the count is greater than zero (<b>410-Y</b>), a check is made to see if the count is greater than or equal to two (<b>420</b>). If it is not (<b>420-N</b>), the scroll bar thumb is changed to display a standard happy face (<b>430</b>). If the count is greater than or equal to two (<b>420-Y</b>), the scroll bar thumb will be changed to a very happy face (<b>440</b>). In a typical example the principal difference between a standard happy face and a very happy face resides in how big the smile is. In the implementation shown in <b>Figure 5</b>, only three states are distinguishable corresponding to 0, 1 and more than 1 relevant terms for the location at which the scroll bar thumb is positioned. However, it is possible to have more than three symbols for distinguishing states. For example, color can be utilized to form a continuous indicator of the amount of relevance. For example, at one extreme the color blue, indicating relatively fewer relevance markers, can be compared with the other extreme at which a color red indicates a very large number of relevance markers. Shades of color between the two extremes can be generated by mixing the two colors in various proportions. Such an approach is shown in <b>Figure 6</b>. Alternatively, a sound could be used to indicate the amount of relevant content at a particular location. The pitch of the sound could be adjusted to reflect how much relevant content is at a scrolling location. This is somewhat analogous to the "getting warmer," "getting colder" game.

0042<b>Figure 6</b> is a look up table which can be used to set color based on a number of relevance markers that would be visible at a given scrolling location. Although only ten different conditions are distinguished in the table shown in <b>Figure 6</b>, it is clear that the amount of mixing of color 1 with color 2 can be a continuous function. As shown, the number of relevance markers ranges from 0 through 10 or more. The percentage of blue color for each of the states specified in the look up table varies as shown in the second column. Exemplary values for the color red mixed with the corresponding amount of blue are also shown.

0043<b>Figure 7</b> is flow chart of an exemplary process for setting color of a screen object based on relevance. Which particular screen object is utilized to feedback the amount of the relevance is somewhat arbitrary. However, it is preferred that either the scroll thumb itself or the entire scroll bar have its color changed to reflect the amount of relevance detected at a given scroll thumb location.

0044When the number of relevance marks at a given scroll thumb location has been determined (<b>700</b>), one can look up the color mix appropriate for that number from the look up table shown in <b>Figure 6</b> (<b>710</b>). Then the display of at least one on screen object is altered by giving it a color attribute based on the color mix from the table (<b>720</b>). The smiley face combined with the color approach is particularly effective since the cursor may partially obscure the smiley face.

0045In the manner described, one can quickly identify the portions of a document containing relevant material to a search query or a find operation without needing to stop and examine irrelevant portions of the text.

0046Although the present invention has been described and illustrated in detail, it is clearly understood that the same is by way of illustration and example only and is not to be taken by way of limitation, the spirit and scope of the present invention being limited only by the terms of the appended claims.