A search tool

[0001] The present invention relates to a method for selecting an initial image from which to display an image stream and to a system for selecting an initial image from which to display an image stream. It is particularly, but not exclusively, used in the area of ​​video recorders, such as Sky + (TM) Box, as well as in DVD players and video display systems implemented in computers. Often, a person watching a TV program or movie using a personal video recorder may want to start watching the program or movie from a specific starting point other than the beginning of the recording. When playing a DVD, for example a comedy series such as "Friends", the viewer can choose the episode to start watching the DVD from. The DVD recording is divided into data packets, each corresponding to a different episode. The viewer can only play the recording from the beginning of each packet. This restricts the viewer by forcing him to watch DVD recordings from a limited number of fixed starting points.

[0002] Viewers may want to skip ads in a personal broadcast or television broadcast. In order to find the end of each commercial break, the viewer must fast forward the recording. It could increase the speed at which the recording plays ("cue" method) when displaying the accelerated version of the recording. This is a time consuming way to search the recording. The viewer could rewind the recording at an even faster speed. It's a faster way to navigate the recording, but viewers can't easily tell that they've reached the end of the ads without scrolling too far. The viewer will probably have to go back to the right point when recording again.

[0003] Sometimes the data packets are spaced apart in the recording data stream by fixed time intervals. Choosing one of these data packets prevents the user from easily determining his preferred starting point if the selected starting point is within the data packet. To select a selected starting point, viewers would have to fast-forward or rewind the image stream from the beginning or end of the data packet.

[0004] In EP 0999504, an information processing device, information processing method and information delivery medium allow the user to freeze still images forming part of the film to be searched, at the desired time points, at the desired time intervals and in the desired amount. The user uses the mouse or keyboard to enter the time and period of time in which the image is displayed. Based on the time and time interval, the CPU generates movie thumbnails. The CPU then displays the created thumbnails arranged in order at a time.

[0005] Document US 2003067479 provides a method of hierarchical indexing of images that extracts representative images from a TV program and creates from representative images a guide with a hierarchical index of images, and a device for implementing this method. The corresponding images for the predetermined times are extracted from the predetermined program. A hierarchical index is allocated to each extracted image, with the indexes being mapped to places in the transport stream packets. As a hierarchical guide

-2-indexed images (HIIG) is a constructed image tree with assigned indexes. When the saved program is to be played, the desired place for viewing is selected in the HIIG guide and from this point the playback and additional functions (FF, rewind) are possible, so that the user can easily search the program and start watching the program from the searched place.

[0006] Document EP 0 619 550 A2 discloses a function of searching movie image data, in which initially the position where the scroll field is displayed in the scroll bar shows the relative storage location of the currently displayed frame in the recorded data. It is possible to define the search area by selecting different parts of the scroll bar and the scroll box, after which the window display area displays a predetermined number of reduced frames, which are representative frames (for example, divides the search area into 10 parts and displays a system of 3x3 representative frames). When the user re-determines the search area (by selecting a representative frame on the display as a new start point and / or a new end point), the CPU displays an image surrounding the entire representative frame to indicate the specified search area again. The CPU then divides the specified search area, i.e. the area lying between the stored screen images corresponding to the two representative screen images selected on the display screen into 10 parts to designate representative screen images of the new second stage. The designated representative screen images are displayed. After this, the procedure is repeated so that the search area is restricted and representative screen images are replaced.

[0007] In a non-patent article of HONGJIANG ZHANG ET AL: "CONTENT-BASED VIDEO BROWSING TOOLS" PROCEEDINGS OF THE SPIE. vol. 2417, pages 389-398, a content-based hierarchical browser was disclosed.

[0008] The object of the present invention is to reduce said disadvantages of the prior art.

[0009] In a first aspect of the invention there is provided a method as defined in claim 1. 1.

[0010] In this specification reference is made to "the nearest candidate image". When the closest candidate image is selected, it is not necessarily the closest candidate image at the time of the initial image. It should be understood that according to this specification, when the user selects the last of the candidate images that he recognizes as the preceding initial image, the latter candidate image is considered closest to the initial image because the user cannot be expected to recognize candidate images repeated later in the stream images. The phrase 'nearest candidate image' must be interpreted accordingly.

[0011] This method allows the viewer to quickly determine the point he selects as the place from which the program will be viewed or resumed.

[0012] At the iterative step of redialing the reference image, the scope of the searched image stream may be reduced in subsequent iterations. Preferably, the search scope decreases in each subsequent iteration.

[0013] Preferably, the method includes one or more iterative steps of displaying a number of candidate images from a time stream of the image stream close to the candidate image selected by the user in response to the previous iteration. This allows you to select the desired initial image much more precisely using the method.

[0014] When candidate images are displayed, it is preferred that they are displayed in chronological order, which helps the user to apply the method. It is more preferable that the candidate images are arranged in the same configuration as the number of buttons on the user control device, allowing the user to select the image by pressing the associated button. Each of the candidate images may contain a corresponding selection number. In addition, to assist the user, a hard candidate image selection can be made that reproduces the image stream starting from that image or from an image very close to it. Preferably, the hard selection can be made by holding the keyboard button corresponding to the selected candidate image for a relatively long period of time, e.g. longer than 0.6 seconds, or by pressing the button twice within a short period of time, e.g. in within 0.5 seconds. This means that any subsequent normal operation is skipped in favor of moving the system directly to playing back the image stream from that point. Other types of hard choice can be made. For example, the button on the keyboard that corresponds to the selected candidate image may be pressed together with the shift or extension key to distinguish this situation from a normal key press. If screen selection is used in the system, then some hard selection means may be used on the screen. For example, if a screen pointer is used, the pointer may be moved to the desired candidate image, and a double click may be a hard choice. If the indicator is not used and the candidate images are selected by a backlight that is shifted from image to image on the screen, the corresponding candidate image can be highlighted and a hard selection can be made, for example, by double-clicking on that selection. When the screen is touch sensitive, touching the appropriate candidate image can be used to make a selection.

[0015] In some embodiments, it is preferable to define an image stream from which candidate images are displayed, including a reference image at the beginning of the image stream. The display of candidate images may further include the step of displaying the elapsed time of each candidate image relative to the reference image.

[0016] The candidate images may be stationary or they may be moving snapshots from the image stream giving film images for each or some of the candidate images. It is beneficial if the duration of each shutter is not longer than two seconds. When the time interval between candidate images is smaller than the shutter duration, the candidate image may be stationary.

[0017] The candidate images will preferably be separated from each other by a time interval, and it is further preferred that the time interval be reduced in each subsequent iteration. It is preferred that in each subsequent iteration the time interval is reduced according to the geometric progression.

[0018] Under certain circumstances, it may be beneficial if the time lapse between candidate images is adjustable. This allows the user to increase or decrease the time interval between candidate images. Reducing the time interval can help him focus on the point where he would like to start the image stream. Increasing the time interval can allow the user to quickly search a longer stream of images. The time lapse between candidate images can be adjusted by providing the control device with a button or buttons, e.g. volume up and volume down buttons.

[0019] Each step of displaying candidate images may include displaying the reference image as one of the candidate images. In a preferred embodiment, the reference image precedes other candidate images in the image stream. It is also preferred that the method further includes the step of displaying the initial image when a predetermined number of iterations has been performed. This may require counting the number of iterations performed by the method. It may also be beneficial to analyze the passage of time between candidate images or the duration of the image stream and appropriately increase or decrease the number of iterations performed by the method. For example, the number of iterations needed to skip 3 or 4 minutes of announcements in the image stream is rather smaller than needed to find a point in a 5-hour video. The processor implementing the method may include an algorithm that determines the correct number of iterations to perform. Preferably, the candidate images are spaced at equal intervals in the image stream.

[0020] The time interval in the first iteration may be at least 40 seconds. It is advantageous if the initial time elapsing between each candidate image is greater than that the user would normally scroll the image stream forward in the preview. Preferably the time interval at the last iteration is 0.625 seconds. As mentioned earlier, it may be beneficial to be able to regulate the passage of time between candidate images. A preferred method of accomplishing this is by using a button or buttons on the control device to control the passage of time between candidate images. The volume increase or decrease buttons can be used here. In addition, the number of iterations may vary depending on the length of the image stream or the passage of time in the first iteration.

[0021] Nine images can be displayed. There can be nine buttons and these buttons can have the usual numeric keypad layout, for example with numbers from 1 to 9. It is advantageous if the numbers of the buttons are displayed on the display, each number with the associated image. The numbers can be arranged on the display so as not to obstruct the candidate images. As mentioned above, the buttons can be used to perform a hard selection in which the button is held down for a relatively long period of time to start the image stream from the candidate image corresponding to the button that was pressed.

[0022] The image stream may have an audio component. Preferably, the method is suitable for audiovisual programs, including but not limited to television programs, films or home video.

[0023] The image stream may comprise a series of frames. Preferably, the image stream is a television broadcast recording that includes but is not limited to television programs, a movie or home video. In some embodiments, the invention can be applied to systems displaying a stream of images implemented on a computer, such as Windows Media Player, but can also be used in personal video recorders, such as Sky + (TM) box, TiVo recorder, a portable video player such as iPod, or DVD players or video players. In many of these systems, the image stream can be derived from broadcasting, cable television, Internet streaming server, etc., and is recorded before being restored using a suitable player. If the video stream is directed one-to-one from a web server to the user, then the search tool can work on the web server side, however user-controlled. Therefore, the user, if he wishes to find a specific point in the video stream or if he wishes

Skipping a specific part of the video stream, can press a key or button that causes the system to go into search mode, whereby the user can search for the opening image according to the invention. Therefore, in such an embodiment, the web server will generate a set of candidate images to be displayed on the user's device, which may be a PC or TV with Internet access, etc. The user can then select the nearest candidate image, after which the remote web server will display another set of candidates for further selection by the user. Of course, this applies not only to video streaming over the Internet, but can also be applied to other systems where the remote server delivers video content on a one-to-one basis, rather than multicasting to multiple users.

[0024] A second aspect of the invention is a system as defined in claim 23.

[0025] Preferably, the system allows the viewer to quickly identify the point from which he wants to start or resume watching the program. It is preferred that the processor is further adapted, when used, to reduce the range of the searched image stream in each subsequent iteration. It is furthermore advantageous for the control device to be adapted in each iteration to re-select one of the candidate images displayed on the display as a reference image. In addition, the display may be adapted to display chronologically candidate images, and the reference image may be adapted to precede one or more candidate images in the image stream.

[0026] It is preferred that the system is adapted to start the image stream from the candidate image in response to the hard selection of the candidate image. For example, the system may be adapted for hard selection to be made by holding the control device button for a relatively long period of time. This allows the user to save time and skip subsequent iterations, if he is satisfied that the image stream will be shown from the candidate image that was selected by hard selection. In addition, the processor may be adapted to allow adjustment of the passage of time between candidate images. In one embodiment, the control device includes one or more buttons adapted to be used by the user to adjust the passage of time between candidate images, e.g., volume up and volume down buttons. In a preferred embodiment, the processor is adapted to cause the display to display the elapsed time of each candidate image relative to the initial reference.

[0027] The control device may comprise at least two buttons arranged in the same configuration as the candidate images displayed on the display, each candidate image corresponding to a button. The processor may be adapted to select candidate images, each candidate image separated by the same time interval in the image stream, and wherein the time interval is reduced in each subsequent iteration, and in a preferred embodiment the reference image is re-selected a predetermined number times. The processor may be adapted to control the display means to display the image stream starting from the initial image. The processor may be adapted to analyze the passage of time between candidate images or the duration of the image stream, and to respectively increase or decrease the number of iterations performed by the method. This allows the system to select the appropriate number of iterations depending on the length of the image stream that is being searched. If

- the user simply skips 3 or 4 minutes of ads, then fewer iterations are probably needed than when the user searches the 5-hour video.

[0028] The system may further include a cache wherein the cache is controlled by the processor and adapted to download a portion of this image stream locally to the processor. Preferably, the image stream that must be displayed on the display, both as a continuous image and a candidate image, is easily accessible in cache. This avoids delays in requesting, receiving, and obtaining part of the image stream for immediate display.

[0029] The system may be a personal video recorder that includes a processor and memory. Preferably, the memory is a hard disk or solid state memory.

[0030] A number of further aspects with preferred properties result from the appended claims. [0031] Further features and advantages of the present invention will be disclosed in the following description of their embodiments, given merely by way of examples, and with reference to the following figures, in which:

Fig. 1 is a diagram illustrating the most important elements of a preferred embodiment of the system according to the invention;

Fig. 2 is a diagram illustrating the keyboard of the control device used in the invention;

Fig. 3 is a flowchart showing the steps of the method implementing the invention;

Fig. 4 is a diagram illustrating a display with nine candidate images in the first iteration;

Fig. 5 is a diagram illustrating a display with nine candidate images in a second iteration;

Fig. 6 is a diagram illustrating a display with nine candidate images in a third iteration;

Fig. 7 is a diagram illustrating a display with nine candidate images in a first iteration with the image stream rewound one step;

Fig. 8 is a diagram illustrating a display with nine candidate images in a first iteration with the image stream being scrolled forward one step;

Fig. 9. is a diagram illustrating a computer implementing another embodiment of the invention.

Fig. 1 illustrates an example of a suitable system environment comprising Sky + TM Box in which the invention may be implemented. This system environment is only an example of a suitable system environment, which is a preferred embodiment, and is not intended to imply any restrictions on the scope or functionality of the invention.

[0032] The exemplary system 1 implementing the invention shown in Fig. 1 has components that include: a data warehouse 3 for providing an image stream; processor 5; cache 7; visual display unit 9; and the control device 11. The processor 5 and the cache 7 are connected to each other and each of them is adapted to communicate with the data warehouse 3. The cache is connected to the visual display unit 9, and the control device is

Adapted for wireless communication or via wired means with the processor 5. [0033] In use, a request is sent from the processor 5 to the data warehouse 3. The data warehouse 3 loads the image stream into the cache 7. Upon receipt of the instruction from the processor 5, the cache 7 forwards the image stream to the visual display unit 9 to display the image stream. Consequently, the cache 7 may download and store the image stream before displaying the image stream on the visual display unit 9. [0034] Since the control device 11 is adapted to control the processor 5, the control device 11 can be used to control the image stream that is displayed on the visual display unit 9, for example to stop the image stream on a specific image or to fast forward or backward display image stream.

[0035] Fig. 2 shows a control device 11 suitable for use in the system 1. The control device 11 has a numeric keypad with numbers from 1 to 9 (labeled 30) and 0 (32). It also has a button to change the channel to a higher 34, a button to change the channel to a lower 36, a return button 38 and a volume control button 40.

[0036] The processor 5 is adapted to control the data warehouse 3 after receiving instruction from the control device 11 to provide the image stream to the cache 7 to store the data stream and forward part of the stored data stream to the visual display unit 9. The processor is also adapted to receiving cached signals 7. These signals contain confirmation from the cache 7 indicating whether it stores a specific portion of the image stream.

[0037] Embodiments of the invention may be described in the general context of computer-executed instructions, such as computer program modules. In general, program modules contain procedures, programs, objects, components, data structures, and so on that perform specific tasks. The invention can also be used in distributed computing environments where tasks are performed by remote processing devices that are connected through a communication network. In a distributed computing environment, program modules can be located on local and / or remote computer media, including storage devices. In this particular system, the data warehouse may be a remote device in relation to the rest of the system (e.g. on the head side of the cable television system) and the task of providing the image stream is performed remotely.

[0038] In addition to the general functions described above, the system implementing the invention is adapted to implement a method of selecting an initial point in an image stream from which the display of the image stream begins, as schematically illustrated in the flowchart of Fig. 3. The method allows the viewer to iteratively search for the initial image in the image stream of the recording provided from the computer-readable medium without the need to rewind or rewind the displayed image stream.

[0039] In the flowchart, single completed arrowheads indicate the transition of the process from one stage to the next in the absence of an alternative to this transition. A single open arrowhead means that the arrow indicates a negative result from two alternative stage results; and the double open arrowhead means that the stage result is a positive result.

[0040] In order to find the start point in the image stream, it is first necessary to select or specify the beginning and end of the image stream that is being searched. In some

In 8 cases, this will correspond to the data packets or the entire recording. For example on a DVD containing several "Friends" episodes, the searchable data stream may be one of the episodes. Alternatively, it may be a fragment of a segment, depending on the length of the data packets. If the DVD is a movie, such as Star Wars, the movie can be divided into a number of packages, each of which can be searched separately. Alternatively, you can take the whole movie and a search can be carried out throughout the entire movie. In the event that the recording was made from a television broadcast and it is desirable to skip the commercials that were recorded, the searchable video stream can be defined as the period of five minutes following the point in the program being watched in which skipping was activated.

[0041] After activating the search function and selecting the image stream to be searched, the viewer is presented with nine images on a three-in-three board on a TV screen. Of course, in other embodiments, the image table may be larger or smaller, but nine is a convenient number corresponding to nine natural numbers on the keyboard.

[0042] Generally speaking, the nine images shown in the image table are images arranged in the image stream. Therefore, the first image will be close to or at the very beginning of the image stream, and subsequent images will be evenly distributed throughout the rest of the image stream. In the described embodiment, the image stream is actually divided into eight parts and except for the ninth image, each image in the table generally corresponds to the beginning of each of these eight parts. Each of the images displayed in the table is a candidate image that can be selected by the user by pressing the corresponding button on the keyboard. In the embodiment shown in Fig. 4, nine images are spread over just over five minutes. Therefore, you can use it to skip the commercial break in a movie or TV program that has been recorded. To skip the break, the user simply selects the candidate image, which is the first image after the advertising break, and this immediately takes the viewer to a place quite near the end of the advertising break. Then a new table of nine candidate images is displayed, corresponding to the part of the image stream that was selected by the user in his first selection, in the first iteration. Therefore, a new set of candidate images creates a second iteration of the process, where the first image unrelated to the advertising break is selected again and the user is taken closer to the end of the advertising break. By taking this action in a number of iterations, the user quickly finds the initial image from which the program or movie should be resumed. The number of iterations may depend on the initial length of the image stream. The number of iterations may be smaller when skipping the advertising break than when searching for a point in a two-hour movie. The processor may include an algorithm that determines the number of iterations based on either the length of the image stream being searched or the duration of the current iteration.

[0043] The selection of the correct candidate image is made above by pressing the corresponding button on the keyboard. The selection is made by simply pressing the button briefly. However, if the user is concerned about simply starting the image stream from one of the images without going to the next iteration, he or she may press the appropriate button corresponding to the image from which the image stream should be continued, and may hold the button for a longer period of time, e.g. for 1 second. This type of selection can be called a "hard" choice, which refers to the period of time the button is held down rather than how much it is pressed. A hard choice can also be made sure

- 9 different image selection methods. For example, a numbered button on the keyboard could be pressed together with the shift or extension key (not shown). Instead of selecting a candidate image using the numbered keys on the keyboard, a screen selection system can be used in which the candidate image is selected on the screen. A typical example of screen selection could be a sliding pointer that can be placed on the candidate image to be selected, followed by selection by clicking the confirmation button on the keyboard. A different type of selection system on the screen marks each image using the backlight (focus), but the arrow buttons or the joystick on the keyboard can be used to move the backlight from the candidate image to the candidate image. The candidate image can be selected for example by pressing the confirm button. In such cases, the hard selection could be made by pressing the alternative button or by double-clicking the selection or confirmation button instead of the single click used to make the soft selection. In another embodiment (not shown) the screen is touch sensitive and in order to make a selection the user simply touches the correct candidate image on the screen.

[0044] More details will now be described about the embodiments.

[0045] Initially, the image stream is displayed on the visual display unit 9. The viewer initiates in the first step 101 the process of implementing the method by pressing the search button on the control device 11. This selects the initial reference image. It can be an image displayed on the screen when the search button is pressed or an image shortly before the button is pressed. In the following example, the image is taken from the image stream five seconds before the button is pressed. The search that is initiated here allows the user to skip the ads. Therefore, the user initiates the search when he reaches the beginning of the advertising break, and this allows him to skip it quickly and easily. The initial reference time generally corresponds to the start of the advertising break. The search will take place over the next 320 seconds of the image stream. In this process, all subsequent images in the image stream have a passage of time T relative to the initialization image. The initialization image is the image that was displayed when the search button was pressed to initiate the search function. Therefore, the reference image has a time interval T of -5 seconds. A time interval of T of -5 seconds means that the entire video stream range is slightly extended. This allows the first candidate image to be positioned just before the search was selected. In some embodiments, the user may find it better if this time is set to 0 seconds. This embodiment will be described with reference to Fig. 4.

[0046] In a second step 103, the processor sets the search conditions. Each iteration has a counter value (C), which is initially set to one. In each iteration, the processor selects a number of candidate images. Reference time of the first iteration T_R1 (T_RC, where C is the value of the iteration counter) is set to the same value as the first candidate image 13, T ^ [0047] In the third step, 105, processor 5 issues cache instructions 7 to provide nine candidate images from the image stream. Each image is separated in the image stream from adjacent images by a time interval of eightfold. This value could be changed by the user as needed. For example, the value could be changed 131, 132 using the volume buttons 40. Instead of increasing or decreasing the volume, the volume buttons could

- be used to increase 131 and decrease 132 time interval 133, 134. Alternatively, the time interval value could be changed 133, 134 using a different user input signal via the keyboard or anything else. In Fig. 3 in blocks 133 and 134, when the volume up or volume down buttons are pressed, the passage of time is either doubled or halved, giving geometric progress. Other embodiments could increase or decrease the passage of time by a set value, for example by 20% of the original passage of time. This will increase or decrease the passage of time in steps, which are an arithmetic progression instead of a geometric one, óf is the time interval between images, i.e. between Τ_Ί and T₂, T₂ and T₃ etc. It depends on the value of C. In this embodiment;

for

C = 1 óf = 40 s C = 2 óf = 5 s C = 3 óf = 0.625 s [0048] The first of these nine images is the first candidate image 13. If the cache does not store any of these images, processor 5 issues an instruction to the magazine data 3 to send an image stream containing these missing images to the cache 7. The cache 7 then sends the candidate images 15 to the visual display unit 9. The images are displayed on the visual display unit in chronological order. The first image in Ti in the image stream is shown as the first candidate image 13 in the upper left corner of the screen 17 of the visual display unit 9. The second image in T₂ in the stream of images is shown in the center of the top row on screen 17. This is repeated for each of the remaining seven images so that the last candidate image in T₉ in the image stream is the image in the lower right corner of screen 17, as shown in Fig. 4. Candidate images are displayed to the viewer until the processor 5 receives the signal from the control device 11. The processor 5 waits for the signal from the control device 11 in the fourth step 107. Any from a number of different input signals can be received from the control device 11. This will be explained in Fig. 3. Ultimately, however, the user is required to select one of the candidate images, which is designated here as the fifth stage 109. However, it should be understood that between the fourth and the fifth stage other input signals may also be given.

[0049] The control device has a keyboard, which is a standard numeric keypad. Each numeric button 30 has a number between one and nine inclusive and is assigned a candidate image 13. The viewer selects one of the new candidate images. The reference image in the next iteration will be the previous candidate image before the one selected (pressing button 6 selects the fifth image as the reference image for the next iteration). In the sixth step 109, when the button is not a number button between 1 and 9, the process returns to the fourth step 107 until the number button is pressed. As described above, if a hard selection occurs, the video stream will run from the selected image. In this embodiment, the hard selection is made by double pressing or double clicking a number button, which is identified by the fifth step 135. If no double-click is detected, then the processor goes to step 6. However, if double-click is detected, then playback will resume 136.

[0050] In the sixth step 109, the processor records the input as a numeric button,

- 11 α. In the seventh step 111, the iteration counter C is checked to see if it is equal to three, which means the third iteration. (The process is adapted to end after three iterations.) If C is not equal to three, the process proceeds to step seven 113 to continue the process in further iterations where the time interval δί is smaller.

[0051] In the eighth step 113 the search conditions are changed. The value of the C counter is increased by one. The time of the new first candidate image in the image stream, T, is calculated_n i.e. a new reference image, where the current time interval, δί, is multiplied by an integer one less than the value of the number button pressed, and, and this value is then added to the time of the previous candidate image:

T "lnew ~ Ti_aboutld ⁺ ((O - 1) X δί)).

[0052] The reference time value for the second iteration, T_R2, adopts the new value of the first candidate image, T_1new· The process then returns to step three 105. The time interval, δί, is eight by a factor, however it can be any value up to one, less than the number of candidate images selected. The visual display unit 9 displays nine candidate images as shown in Fig. 5, where nine images are arranged in the image stream with a time interval of five seconds. The selection of candidate images shown in Fig. 5 is derived from the selection of the seventh image from the first iteration shown in Fig. 4. In Fig. 5, the first candidate image 19 is placed in the image stream 195 seconds after the initialization image.

[0053] The third, fourth, fifth, sixth, seventh and eighth stages of the process are repeated as shown by the example in Fig. 6 for the third iteration. In the second iteration of this example, the number six button is pressed, and in the third iteration, the number button seven. In the third iteration, the candidate images are separated by a time interval of 0.625 seconds. When in the seventh stage 111 the iteration counter, C becomes three, the process goes to the ninth stage 115. The candidate image preceding the selected image becomes the initial image.

[0054] In step nine, the opening image is displayed on the screen. In one embodiment, the visual display unit 9 immediately starts playing the image stream. In another embodiment, the image stream is frozen on the display 9 until the button on the control device 11 is pressed to start playback.

[0055] In this preferred embodiment, the reproduction of the image stream can be resumed without the user selecting one of the candidate images. If the return button 38, which can also be a zero 32 number button, is pressed on the numeric keypad of control device 11, the process enters the "return" mode 117. If the iteration counter C is equal to one, in step 119 the image stream is restored starting from one second preceding the initialization image in the image stream, as in step 121. If the iteration counter C is not equal to one, in step 123 the reference image is same as the first candidate image from the previous iteration and the value of the iteration counter C is reduced by one. The process then returns to step three 105, in which the visual display unit 9 displays the candidate images from the previous iteration. It also allows the viewer to re-review the candidate images from the previous iteration if he realizes that he has chosen the wrong candidate image in the iteration.

[0056] Alternatively or additionally, if the viewer selects a candidate image that has a range that does not include the initial image, it may search the image stream without returning to

-12 previous iteration. If the opening image lies in front of the first candidate image on the visual display device 9, in T₉ in the image stream, the viewer could press the change channel up button 34 on the control device 11. The process enters the "scroll up" mode 125. At this stage 127 time of the first candidate image T; is set again to precede the current T | value by six time intervals, δί, from the current iteration. Time value from the current iteration T_Rc is set to equal the new Ti value. The process returns to the third step 105, with the visual display unit 9 displaying nine candidate images, each separated by a time interval of 5t, with the first candidate image being taken from the image stream from the new T_r Fig. 7 shows the result of the upward scrolling process of the image shown in Fig. 4. [0057] If the viewer wants to search for the initial image after the last currently displayed candidate image, the viewer can press the channel change button to lower 36 on the keyboard of the control device 11 to enter down scrolling process 129. At this stage 130 the time of the seventh image candidate in T₇ becomes the time of the first candidate image in T · ,. Time value from the current iteration T_RC takes the new T | value. The process then returns to the third step 105 as shown in Fig. 8, where the down scrolling process was applied to the images displayed in Fig. 4.

[0058] By using the invention during playback of the recording, the user can select the initial reference image 101. The display shows nine images at a distance of 40 seconds, and the first image T is preceded by the initialization image by five seconds, as shown in Fig. 4. If the viewer intended to select the seventh image 21 in Fig. 4, the visual display unit 9 would then display nine images at a distance of 5 seconds, as shown in Fig. 5, the last image being the seventh image 21 in Fig. 4. If the viewer then selects the sixth image 23, the visual display unit 9 displays nine images as shown in Fig. 6, where the last image T₉ is the sixth image 23 in Fig. 5 and the images are at a distance of 0.625 seconds. The viewer can choose his initial image from these nine images. The initial image will be the candidate image that precedes the image that was finally selected. The visual display unit 9 will then display the image stream starting from the start image.

[0059] For all these candidate images, the position of each image in the image stream is expressed as a function of time relative to the initialization image, and can be displayed on the visual display unit 9 in conjunction with the respective candidate image.

[0060] In this preferred embodiment, the initial image is searched for by selecting the image being the first image in the range of the image stream that the viewer wants to watch. The method can be modified so that the image selected in each iteration becomes the first image of the next iteration, whereby the method selects the initial image using the last image in the range of the image stream that the viewer does not want to watch.

[0061] Also, the value of the numeric button associated with the image may be displayed with the associated image. Any number of images may be shown on the visual display unit 9 as long as at least two images are shown and the viewer has the means to select all images in the image stream. The initial time interval between candidate images can be any value suitable for search purposes, also the number of iterations can be any predefined number. The number of iterations need not be predetermined and may be influenced by the size of the time interval between the images of the candidate in iteration.

[0062] The ratio of the time interval between iterations may be arbitrary as long as there are a sufficient number of candidate images and the time interval between them is sufficient for the entire range of image stream selected for search.

[0063] Information about each candidate image, for example the corresponding button on the keyboard and the time position in the image stream relative to the initial reference image, can be displayed so that this information does not transfer the images.

[0064] The images may be stationary or moving. If the images are moving, the duration of each shutter is 2 seconds, but in other embodiments it may be smaller or larger than specified. When the time interval is reduced so that it becomes smaller than the time interval between the candidate images in the image stream, each image is displayed for the duration of the time interval, each image starting with one of the candidate images. To ensure that the viewer watches the image of his chosen starting point, the viewer will select the candidate image as his reference image that precedes the initial image that he would choose if the images were stationary.

[0065] The image stream may comprise a series of frames. If the time in the image stream selected from the image does not have an image frame or the contrast is insufficient to make the image distinguishable, the next frame is displayed in the image stream.

[0066] The control device may be operated by buttons or operating means other than numeric buttons. The positioning of the candidate images may be such that it matches the arrangement of the buttons on the control device.

[0067] Additional search modes are included within the scope of the invention. In an additional embodiment that can be made in the system shown in Fig. 1, the processor may be adapted to enter the multi-image search mode when the user stops the search during forward or reverse search (cue, review) in the image stream while viewing image stream. In conventional devices for watching video programs or recordings it is possible to search forward or backward while watching the stream of images and it is often possible to search at different speeds. This forward or reverse search is usually performed to find a specific point from which the user wants to start watching the recording. In such a search, a significant leap is inevitable: stopping the search takes a certain amount of time since the viewer recognized the point from which he would like to start. The hop will depend on two factors, firstly the user's response speed and secondly the speed at which the video stream is searched. The higher the search speed, the higher the jump. In this search mode, when the search is stopped, the processor in the device is adapted to enter the multi-image search mode, in which a number of images are fed to the display, preferably nine, which are shown in the order in which they appear in the image stream . When entering the multi-image search mode after searching back in the image stream, the final image reached at the end of the skip creates the first candidate image. Eight consecutive images are shown, each of which is separated from the previous image by the passage of time or a time interval. The passage of time may depend on the speed at which the forward or reverse search is performed immediately before stopping the search. Therefore, a quick search may require 10 seconds of time between each picture to be taken during

-14 when a slower search will result in less skipping, and the passage of time can be 1 second. However, these are examples and the passage of time can be greater than 10 seconds or less than 1 second.

[0068] If the pre-skip search was a forward search, then the image selected at the end of the skip will create the last of the candidate images, and the remaining eight images will be selected sequentially before the final candidate image. The user's choice of the most suitable candidate image may then allow to reproduce the image stream from that point, or alternatively lead to one or more further iterations.

[0069] Some available personal video recorders may be adapted to record the last 10, 15 or other number of minutes of live broadcast or other stream of images that the user is watching. In the additional search mode, which may be called the replay search mode, the processor is adapted to, in the event that the viewer watches a transmission or another stream of images, a certain period of the last viewed image stream was recorded, e.g. the previous 10 minutes of the image stream, and the processor is further adapted to download nine candidate images from that recorded time when the search button is pressed. The ninth image will be the one that was current when the search button was pressed. If the intervals are 10 seconds, the minimum length of the image stream that must be recorded is 80 seconds. Pressing the number on the keyboard that corresponds to the candidate image that has been selected will start the video stream from the selected candidate image, resulting in the action replay function. It may be possible to increase or decrease the time lapse between candidate images using the volume control buttons. If it is possible to increase the passage of time, then there will be a need to record more than 80 seconds from the preceding stream of images watched. Further iterations may also be possible if needed. System 1 in which the invention operates is anything that is suitable for playing a recording as an image stream, for example a CD Rom player, DVD player, computer running a video player program or Sky + TM Box. Examples of computer video player are Microsoft Media Player, Adobe Flash Player and RealPlayer. Software that provides the functionality of the present invention may be incorporated into the video player computer software, or may be provided as a plug-in that adds functionality to an existing video player computer program that originally does not have the functionality of the present invention. The data warehouse 3 can be connected to the processor 5 or can be remote in relation to the rest of the system 1. The combination of processor 1, cache 7, data warehouse 3 and visual display unit 9 described so far is only an example. Processor 5 could only communicate with data storage 3. Cache 7 could be remote with respect to data storage 3 and processor 5, or could be positioned with visual display unit 9. Each, therefore, visual display unit 9, processor 5 and data storage 3, may include a computer containing a computer readable medium. [0070] The computer-readable medium may be any available medium that the computer can access, including both volatile and non-volatile media, as well as removable and non-replaceable media. By way of example and without limitation, computer-readable media may include computer data storage media and communication media.

[0071] Computer data storage media include volatile and non-volatile and interchangeable and non-replaceable media made by any method or by any information storage technology such as computer-understandable instructions, data structures, program modules or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or memory implemented in another technology, CD-Roms, general purpose digital disks (DVDs) or other optical disk memory, magnetic memory disk or magnetic recording devices, or any other medium that can be used to store the desired information and which the computer can access.

[0072] Communication media typically implement computer-understandable instructions, data structures, program modules or other data in the form of a modulated data signal, such as a carrier wave or other transport mechanism, and include any media for providing information. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a way as to encode information in the signal. The term "image stream" as used herein is such a modulated data signal in which the image data is encoded. By way of example and without limitation, communication media include wired media such as wired networks or direct cable connections, and wireless media such as acoustic, radio frequency (RF), infrared and other wireless media. The combination of any of the above should be included in the range of media read by the computer.

[0073] The image stream may also contain an audio component, and the system is adapted to emit this audio component together with the display of the image stream on the visual display unit. [0074] The computer in which the embodiment is implemented is shown in Fig. 9, in which the computer system 60 comprises a personal computer PC, a computer screen 62, a keyboard 63 and a control device 69. The PC includes a media drive unit, which in this example is a DVD 64 player. Note that any suitable drive may be turned on, or that a PC hard disk may be used as the source of the image stream. In addition, the image stream can be received from any other suitable source, including Internet 70. On PC 61, the operating system 65 runs, in which the video player program 66 operates, such as Microsoft Media Player, the plug-in search tool 67 and the operating data 68, with which the video player program 66 operates. In this example, operating data 68 could simply be video stream. The Search plug-in 67 is part of the add-on software for the video player program, however it can be included in the video player program itself. Thus, the plug-in may be provided as independent software or it may be included in the video player program if necessary. The combination of video player program and plug-in search tool means that when using the video player program to display the video stream, the plug-in 67 can be invoked to use the search service described in Figs. 3 to 8. Control device 69 may be used or the functions of the control device buttons could be replaced by buttons on the keyboard 63, buttons available on the touch screen 62 or buttons selected by the mouse (not shown).