System and method for synchronizing presentation of media stream playlists with real time

This invention relates to multimedia server systems and more particularly to the synchronization of media stream playlists with real time i.e., actual clock time, in a video server environment.

Media servers provide cost-effective video, audio, and other multimedia stream capabilities for use in both business and consumer environments. For example, a video server may include a library of video sources such as movies from video, and permit one or more users to select one or more of the movies for viewing. The video server typically includes magnetic storage hard disk drives on which recorded blocks from the user-selected video sources are magnetically stored. Movies typically are two hours long, and are encoded (e.g., using MPEG) at a rate of between perhaps one Mb/second and about eight Mb/second. Thus, one movie may require one GB to eight GB of storage media.

An admission arbiter unit is typically provided to limit the overall number of users of the video server at a given time and to prevent overloading of the network or disk storage system. Such overload could cause movies to run too slowly or to move forward (or backward) in a jerky manner. The time at which a particular movie should be played and the order at which movies are played is controlled by a playlist. A playlist is a contiguous list of multimedia titles placed at a particular position upon the playlist timeline. Each title has a specified duration. Once a command to play the playlist is given, the play should advance along the playlist timeline in equal measure with the time of day.

It is often impractical to store an entire movie in a single hard disk unit since a typical hard disk unit can only output data at a rate of a few Mb/second. To circumvent this storage problem, it is common to store blocks of the movie (e.g., perhaps 0.5 second sequences) across multiple hard disk units. These blocks are then read out or transferred to a buffer, and communicated over the network. As these blocks are sent over the network, new blocks from the movie are read out from the hard disk unit. At the receiving end, the blocks are decoded for user viewing on a video monitor, television receiver or the like.

The use of hard disk drives to store information magnetically is well known. A single hard disk drive typically includes several rotating disks or platters upon whose surfaces information may be written or read by a read/write head. Within a hard disk drive, the platters rotate together, and all read/write heads typically are moved simultaneously to access different platter positions. A platter typically is formatted into concentric tracks that define collectively, platter-to-platter, a family of concentric cylinders, and into sectors that represent a portion of a track. A controller associated with the hard disk unit determines which cylinder, read/write head and sector is to be accessed for reading or writing.

The platters may also be considered as being divided into zones. Since they are physically larger, tracks in zones at the outer platter perimeter contain more sectors than tracks in zones nearer the rotational axis of the platter. Therefore, assuming that the platters rotate with a constant velocity w, the data bandwidth available from the outermost zones is greater than the data bandwidth available from the innermost zones. Even with modern hard disk drives, there can be a 2:1 variation between worst case and average case disk transfer bandwidth, due to sectors/track variations between outer and inner zones.

Unfortunately, providing a video bit stream from the output of a video server at the exact time specified by the playlist is difficult due to the delays inherent in multimedia players, which is a property of the disk access times and other delays associated with the multimedia server. The delay between the time when the play of a particular title on the playlist is commanded and the actual initiation of play is referred to as <img file="EP0817489A2_D0001.tif" />admission delay<img file="EP0817489A2_D0002.tif" />.

The length of an admission delay is in general not of predictable duration. The duration of any particular admission delay is a property of the current load on the multimedia server and the specific timing relationship of the request to initiate play with respect to the position of the first requested data block within the disk array containing the multimedia stream. As a result, the exact time at which the video bit stream will be provided from the multimedia server will become offset with respect to real time. As a day progresses, the offset between the playlist and real time may increase due to the accumulating admission delays of the movies within the playlist.

Hence, a system and method would be desirable to synchronize the presentation of media stream playlists with real time, and to allow a system operator to flexibly specify the manner in which admission delays are accounted for.

The problems outlined above are in large part solved by a system and method for synchronizing presentation of media streams, e.g. movies, with real time in accordance with the present invention. Particular and preferred aspects of the invention are set out in the accompanying independent claims.

In one embodiment, a multimedia server system includes a disk array subsystem including a plurality of multimedia files, a media file system manager for managing the storage of the plurality of multimedia files within the disk array subsystem, and a playlist which includes a list of items (identifiers) corresponding to a specific subset of the multimedia files to be played at designated times. The multimedia server system advantageously includes synchronization parameters associated with each of the items specified by the playlist. The synchronization parameters, which are programmed by a system operator or an end user, specify the manner in which multimedia files corresponding to each item in the playlist should be truncated in order to compensate for admission delays.

An admission delay synchronization unit receives the synchronization parameters and truncates the multimedia files as specified by the synchronization parameters. In one implementation, a first synchronization parameter is used to specify that the current multimedia file should be truncated at the time for the play of the next multimedia file. A second synchronization parameter is provided to specify that up to a given amount of time should be sacrificed at the beginning of the next multimedia file to account for the admission delay of the current multimedia file. In this manner, the beginning of the next multimedia file is truncated.

A third synchronization parameter is provided to specify an amount of time up to which the current multimedia file can be truncated (at its end) to account for any admission delay. In other words, by permitting the actual play duration ("played duration") of each multimedia file to be shorter than scheduled allocation of play time for the multimedia file, the difference between the scheduled and played durations, i.e., the "excess time", can be used to absorb any admission delays, thereby avoiding the problems associated with accumulative admission delays over a period of time.

As a result, the multimedia server system advantageously allows the synchronization of the presentation of media streams with real time over the period of time by allowing a system operator to flexibly absorb any admission delays.

Exemplary embodiments of the invention are described hereinafter, by way of example only, with reference to the accompanying drawings in which: <ul id="ul0001" list-style="none" compact="compact"><li><b>Figure 1</b> is a functional block diagram of a multimedia server system in accordance with one embodiment of the present invention.</li><li><b>Figure 2</b> is a diagram that illustrates an exemplary listing of multimedia titles specified by a user and exemplary associated synchronization parameters.</li><li><b>Figure 3</b> is a flow diagram which depicts the operation of an admission delay synchronization unit.</li><li><b>Figure 4</b> is a diagram which illustrates the synchronization of items specified by a playlist with real time.</li></ul>

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail. It should be understood, however, that the drawings and detailed description thereto are not intended to limit the invention to the particular form disclosed, but on the contrary, the intention is to cover all modifications, equivalents and alternatives falling within the scope of the present invention.

Turning now to Fig. 1, a functional block diagram is shown of a multimedia server system in accordance with one embodiment of the present invention. As will be explained in further detail below, several of the functional blocks depicted in Fig. 1 may be implemented in software.

The multimedia server system 10 of Fig. 1 includes a disk array subsystem 12 which may comprise one or more magnetic disk drives that store video. Video files stored by disk array subsystem are managed by a media file system manager 14. More specifically, media file system manager 14 allows specified files to be output from multimedia server system 10 by scheduling accesses to disk array subsystem 12 via a scheduler 16 and disk driver 18. A multimedia bit stream is output from multimedia server subsystem 10 through a bit pump unit 20 including buffers 22 which temporarily store data accessed from disk array subsystem 12 in response to commands from disk driver 18. The output of bit pump 20 is a bit stream of encoded video (and audio, if present) information. For example, the output of bit pump 20 may be encoded in an MPEG (Motion Picture Experts Group) format.

New video files may be stored within disk array subsystem 12 via a file input interface 24. The storage of files within disk array subsystem 12 is managed by media file system manager 14.

It is noted that file input interface 24 may communicate with media file system manager 14 through an application programming interface (API). It is further noted that media file system manager 14, scheduler 16, disk driver 18, file input interface 24, and/or playlist 26 may be implemented either partially or wholly in software, and that one or more microprocessors may be employed as a portion of the hardware forming multimedia server subsystem 10 to control the functionality of these blocks.

It is further noted that the above described features of multimedia server subsystem 10 are conventional, and that a variety of other specific implementations of a multimedia server system are also possible that employ the system and method for synchronizing the presentation of media stream playlists with real time in accordance with the following description and appended claims.

The functional block diagram of multimedia server system 10 as illustrated in Figure 1 also depicts synchronization parameters 30 which are associated with a playlist 26. Playlist 26 is also shown coupled to an admission delay synchronization unit 32. More specifically, synchronization parameters 30 allow a user to specify the manner in which multimedia server system 10 synchronizes the output of multimedia as specified by playlist 26 with real time.

Fig. 1 finally illustrates an admission delay synchronization unit 32 which receives the synchronization parameters 30 and playlist 26, and controls the synchronization of the video output from multimedia server system 10 accordingly. Playlist 26 includes commands that specify what files are to play and at what time the specified files should play. Admission delay synchronization unit 32 uses this information, along with the current time of day (<img file="EP0817489A2_D0003.tif" />real time<img file="EP0817489A2_D0004.tif" />) as indicated by real time clock 28, to provide output requests to disk array subsystem 12 via scheduler 16.

The specific manner in which admission delay synchronization unit 32 synchronizes playlist 26 depends upon synchronization parameters 30. Details regarding further aspects of synchronization parameters 30 and admission delay synchronization unit 32 will be provided below in conjunction with the description of Figs. 2-4. It is noted that, similar to several of the other functional blocks of Fig. 1, synchronization parameters 30 and admission delay synchronization unit 32 may be partially or wholly implemented in software.

Fig. 2 illustrates playlist 26 including an exemplary listing of multimedia titles with itemDurations as scheduled by a user to be output from multimedia server system 10 in the specified sequence. Associated with each listed movie is an amount of real time (clock time) allocated for playing each movie, called the "itemDuration".

In addition, Fig. 2 further illustrates synchronization parameters 30 which includes a set of synchronization parameters associated with each movie on playlist 26. Each set of parameters include a parameter <img file="EP0817489A2_D0005.tif" />isTimeLocked<img file="EP0817489A2_D0006.tif" />, a parameter <img file="EP0817489A2_D0007.tif" />joinInDuration<img file="EP0817489A2_D0008.tif" />, and a parameter <img file="EP0817489A2_D0009.tif" />playDuration<img file="EP0817489A2_D0010.tif" />. As stated previously, synchronization parameters 30 are used by synchronization unit 32 to maintain the given itemDuration for each movie, given the expectation that perturbations of playtime are introduced by admission delay.

Fig. 3 is a flow diagram which depicts the operation of admission delay synchronization unit 32. In the following description, depending on the context, an <img file="EP0817489A2_D0011.tif" />item<img file="EP0817489A2_D0012.tif" /> refers to either an identifier of a media stream or to the content of the media stream. Time synchronized play of playlist 26 is initiated by issuing a command to synchronization unit 32 directing unit 32 to begin play of the playlist 26 at a particular point in real time by referencing real time clock 28. For example, assume that synchronization unit 32 is commanded to begin playlist 26 at 1:00 hours (real time). Given the itemDurations shown in Fig. 2, ideally movie #1 should begin at 1:00, movie #2 should begin 1 hour and 30 minutes afterwards, i.e., at 2:30, movie #3 should begin at 1 hour and 30 minutes after the start of movie #2, i.e., at 4:00, and so on.

Synchronization unit 32 ensures that itemDurations specified within playlist 26 are maintained in synchronization with the real time schedule as dictated by playlist 26. As such, whenever admission delay induced itemDuration deviations from real time schedule are detected by synchronization unit 32, unit 32 regains synchronization with the real time schedule as directed by synchronization parameters 30.

Hence, for each item in playlist 26 (step 310), the following exemplary steps are performed. As each item from playlist 26 is accessed within disk array subsystem 12 via scheduler 16 and disk driver 18, admission delay synchronization unit 32 detects the associated synchronization parameters for that item.

If the flag <img file="EP0817489A2_D0013.tif" />isTimeLocked<img file="EP0817489A2_D0014.tif" /> is True for an item on playlist 26 (step 320), the item is played until it expires, or until it is time to start the next item if the next item is scheduled to begin before the end of the current item (step 330). In other words, time synchronization can be regained by truncating the play of the current item at the time of day at which the next item should be initiated, regardless of the fact that admission delays may have delayed the initiation of play of the current item and thus the current title may not have completely played. If the current item expires before the scheduled start time of the next item, then synchronization unit 32 waits for the scheduled start time of the next item (steps 340, 350).

Conversely, if <img file="EP0817489A2_D0015.tif" />isTimeLocked<img file="EP0817489A2_D0016.tif" /> is False (step 320), then synchronization unit 32 begins playing the current item for the play duration (step 360). If at completion of current item play the real time is greater than the scheduled start time of the next item and the next item has a non-zero <img file="EP0817489A2_D0017.tif" />joinInDuration<img file="EP0817489A2_D0018.tif" />, then the start time of the next item is allowed to slip, i.e., to be advanced, by the lessor of either the "joinInDuration" of the next item or the difference between the real time and the start time of the next item (steps 390, 395). As such, up to <img file="EP0817489A2_D0019.tif" />joinInDuration<img file="EP0817489A2_D0020.tif" /> of the beginning of the next item is <img file="EP0817489A2_D0021.tif" />sacrificed<img file="EP0817489A2_D0022.tif" /> (i.e., truncated) to allow the current item to play to completion. The next item will begin play at a position equivalent to the admission delay of the current item.

The parameter <img file="EP0817489A2_D0023.tif" />playDuration<img file="EP0817489A2_D0024.tif" /> allows the system operator to specify an alternate play duration less than the full duration of the item's entry in playlist 26. The purpose of including the parameter <img file="EP0817489A2_D0025.tif" />playDuration<img file="EP0817489A2_D0026.tif" /> is to allow more time to be allocated than is actually needed for an item to play. This extra time can then be used to absorb any admission delays. This parameter may be specified in conjunction with the other two parameters.

Hence, if none of these parameters are specified, or the <img file="EP0817489A2_D0027.tif" />joinInDuration<img file="EP0817489A2_D0028.tif" /> or <img file="EP0817489A2_D0029.tif" />playDuration<img file="EP0817489A2_D0030.tif" /> parameter values were insufficient to fully correct for the admission delay, then playlist 26 will <img file="EP0817489A2_D0031.tif" />slip<img file="EP0817489A2_D0032.tif" /> with respect to the time of day by the accumulation of admission delays as each item in playlist 26 is initiated. System 10 further allows that these accumulating delays be addressed by synchronization parameters associated with a later item in playlist 26.

Fig. 4 is a diagram which illustrates the synchronization of items specified by playlist 26 and real time. Movie #1 is specified to start at one o'clock (1:00). However, because an admission delay 412, the actual start of movie #1 is delayed and hence the expected completion of movie #1 will extend beyond the time period as allocated by itemDuration.

Since movie #1 has "isTimeLocked" set, an end portion 418 of movie #1 will be truncated at 2:30 which is the scheduled start time for movie #2. Accordingly, synchronization unit 32 is commanded to begin playing movie #2 after movie #1 has been truncated. However, movie #2 is also subject to an admission delay 422. In this example, since the specified playDuration of movie #2 is less than the full itemDuration of movie #2, any schedule slip caused by admission delay 422 can be reduced by the difference.

According to playlist 26, movie #3 is scheduled to begin play after movie #2 completes. However, the actual start time may be earlier or later than the scheduled start time depending on whether the difference between playDuration and itemDuration of movie #3 is greater or less than admission delay 432. Although movie #3 is initiated immediately upon the completion of movie #2, movie #3 is not timeLocked, has a zero joinInDuration, and has a playDuration identical to its itemDuration. As such, any schedule deviation at the end of movie #2 is accumulated with admission delay 432 of movie #3 resulting in a schedule slip 431, i.e., no explicit resynchronization occurs.

Upon the completion of movie #3, movie #4 is initiated. Note that a schedule slip 441 has already occurred. Movie #4 specifies a joinInDuration. Hence, any accumulated schedule slip beyond slip 441, up to the value of joinInDuration, will be compensated for at this point in time by initiating actual play of movie #4 at an offset from its beging defined by a skipped segment 444.

It is noted that combinations of synchronization parameters 30 as described above may be specified for a particular item. In this manner, a particular item may be truncated at both its beginning and its end, depending upon the parameter(s) specified.

The system and method as described above for synchronizing items specified by a playlist with real time advantageously prevents the accumulation of admission delays as playlist items are played. The system and method further allows the system operator to flexibly allocate differing truncation techniques for differing items, depending upon the importance of the beginning and/or end of a particular item.

Server systems and subsystems incorporating features of the present invention can be implemented entirely in hardware, or in a combination of hardware and software (i.e. program modules stored in memory). For example, the admission delay synchronization unit and playlist can be implemented entirely in software. Suitable media for server software include, for example. magnetic media (e.g. disks and tapes), optical media (e.g. CD-ROMs), EPROM, DRAMs and SRAMs. In addition, software can either be pre-loaded into the server system or loaded by the user electronically with or without the use of tangible storage media, e.g. by downloading program modules to the user's server from ftp/telnet or html sites on the Internet or WorldWide Web, respectively.

Thus, program modules incorporating features of the invention can be conveniently distributed by CD-ROM, for example: or by accessing a Web site. In the latter case, the modules are typically loaded temporarily from permanent storage into RAM and/or output buffers of the Web server; i.e., these are the media serving to store and distribute the program modules of the invention whenever a download request is made. After loading into RAM, the Web server transmits the program modules to the user's host.

Numerous variations and modifications will become apparent to those skilled in the art once the above disclosure is fully appreciated. It is intended that the following claims be interpreted to embrace all such variations and modifications. It should be noted that although specific combinations of features are set out in the dependent claims, combinations of features from the dependent claims and those of the independent claims other than those specifically enumerated by the claim dependencies may be made, as appropriate.