DE69925254T2

Method and apparatus for media data transmission

Abstract

This record has no abstract on file.

DE69925254T2, drawing sheet 1 — Sheet 1 of 14

Term

Term ended

Projected expiry passed 13 January 2019, 7.7 years ago.

19 claims: 5 independent, 14 dependent

1
Verfahren, welches durch ein digitales Verarbeitungssystem zur Verarbeitung von Mediendaten implementiert ist, wobei das Verfahren umfasst:Erstellen eines Satzes von Daten auf einem ersten digitalen Verarbeitungssystem, um anzuzeigen, wie eine zeitbezogene Sequenz von Mediendaten gemäß einem Übertragungsprotokoll übertragen wird;und Speichern des Satzes von Daten auf einer Speichervorrichtung, die mit dem ersten digitalen Verarbeitungssystem verbunden ist, wobei der Satz von Daten eine zeitbezogene Sequenz von Daten ist, welche der zeitbezogenen Sequenz von Mediendaten zugeordnet und von ihr getrennt ist.
2
Verfahren gemäß Anspruch 1, wobei der Satz von Daten als eine Spur von anzeigenden Daten gespeichert wird.
3
Verfahren gemäß Anspruch 1 weiter umfassend:Bestimmen eines Formats der zeitbezogenen Sequenz von Mediendaten vor Erstellen des Satzes von Daten;Bestimmen des Übertragungsprotokolls vor Erstellen des Satzes von Daten.
4
Verfahren gemäß Anspruch 1, wobei das Übertragungsprotokoll ein Paketdatenprotokoll umfasst.
5
Vorrichtung umfassend:ein erstes digitales Verarbeitungssystem, umfassend einen ersten Prozessor, um einen Satz von Daten zu erzeugen, welcher der Übertragung einer zeitbezogenen Sequenz von Mediendaten gemäß einem Übertragungsprotokoll zugeordnet ist, wobei der Satz von Daten eine zeitbezogene Sequenz von Daten ist, welche der zeitbezogenen Sequenz von Mediendaten zugeordnet und von ihr getrennt ist.
6
Vorrichtung gemäß Anspruch 5, weiter umfassend:Ein zweites digitales Verarbeitungssystem, welches mit dem ersten digitalen Verarbeitungssystem verbunden ist, um den Satz von Daten von dem ersten digitalen Verarbeitungssystem zu erhalten, wobei der zweite Prozessor umfasst: einen zweiten Prozessor;einen ersten Speicherbereich, um die Mediendaten zu speichern;und einen zweiten Speicherbereich, um den Satz von Daten zu speichern.
7
Computerlesbares Medium, umfassend:eine zeitbezogene Sequenz von Mediendaten;einen Satz von Daten, welcher, wenn er durch ein digitales Verarbeitungssystem verarbeitet wird, dem digitalen Verarbeitungssystem anzeigt, wie die zeitbezogene Sequenz von Mediendaten gemäß einem Übertragungsprotokoll zu übertragen ist, wobei der Satz von Daten eine zeitbezogene Sequenz von Daten ist, welche der zeitbezogenen Sequenz von Mediendaten zugeordnet und von ihr getrennt ist.
8
Computerlesbares Medium gemäß Anspruch 7, wobei der Satz von Daten als eine Spur von anzeigenden Daten gespeichert ist.
9
Computerlesbares Medium gemäß Anspruch 7, weiter umfassend:einen ersten Satz von Anweisungen, um ein digitales Verarbeitungssystem zu veranlassen, ein Format der zeitbezogenen Sequenz von Mediendaten zu bestimmen;einen zweiten Satz von Anweisungen, um das digitale Verarbeitungssystem zu veranlassen, das Übertragungsprotokoll zu bestimmen, wobei das Übertragungsprotokoll ein Paketdatenprotokoll umfasst.
10
Computerlesbares Medium gemäß Anspruch 7, umfassend eine magnetische Speicherfläche, wobei mindestens die zeitbezogene Sequenz von Mediendaten oder der Satz von Daten in der magnetischen Speicherfläche gespeichert ist.
11
Computerlesbares Medium gemäß Anspruch 7, umfassend eine optische Speicherfläche, wobei mindestens die zeitbezogene Sequenz von Mediendaten oder der Satz von Anweisungen in der optischen Speicherfläche gespeichert ist.
12
Computerlesbares Medium gemäß Anspruch 7, umfassend eine elektronische Speicherfläche, wobei mindestens die zeitbezogene Sequenz von Mediendaten oder der Satz von Daten in der elektronischen Speicherfläche gespeichert ist.
13
Computerlesbares Medium beinhaltend ausführbare Computerprogramm-Anweisungen, welche, wenn sie auf einem ersten digitalen Verarbeitungssystem ausgeführt werden, das erste digitale Verarbeitungssystem veranlassen, ein Verfahren auszuführen, welches umfasst:Erzeugen eines Satzes von Daten, um ein Verfahren anzuzeigen, um eine zeitbezogene Sequenz von Mediendaten gemäß einem Übertragungsprotokoll zu übertragen, wobei der Satz von Daten eine zeitbezogene Sequenz von Daten ist, welche der zeitbezogenen Sequenz von Mediendaten zugeordnet und von ihr getrennt ist;und Speichern des Satzes von Daten.
14
Computerlesbares Medium gemäß Anspruch 13, wobei der Satz von Daten als eine Spur von anzeigenden Daten gespeichert ist.
15
Computerlesbares Medium gemäß Anspruch 13, wobei die ausführbaren Programmanweisungen weiter das erste digitale Verarbeitungssystem dazu veranlassen, das Verfahren auszuführen, welches umfasst:Bestimmen eines Formats der zeitbezogenen Sequenz von Mediendaten;Bestimmen des Übertragungsprotokolls, wobei das Übertragungsprotokoll ein Paketdatenprotokoll umfasst.
16
Vorrichtung gemäß Anspruch 5, weiter umfassend Mittel zum Speichern des ersten Satzes von Daten.
17
Verfahren, welches durch ein digitales Verarbeitungssystem zur Mediendaten-Verarbeitung implementiert ist, wobei das Verfahren umfasst:Erzeugen auf einem ersten digitalen Verarbeitungssystem einer ersten zeitbezogenen Sequenz von Daten, um anzuzeigen, wie eine zweite zeitbezogene Sequenz von Daten gemäß einem Übertragungsprotokoll übertragen werden soll, wobei die zweite zeitbezogene Sequenz von Daten zeitbezogenen Medien zugeordnet ist, und wobei die erste zeitbezogene Sequenz von Daten der zweiten zeitbezogenen Sequenz von Daten zugeordnet ist;und Speichern der ersten zeitbezogenen Sequenz von Daten.
18
Verfahren gemäß Anspruch 17, wobei die erste zeitbezogene Sequenz von Daten als eine Spur von anzeigenden Daten gespeichert ist.
19
Verfahren gemäß Anspruch 17, weiter umfassend:Bestimmen eines Formats der zweiten zeitbezogenen Sequenz von Daten vor dem Erzeugen der ersten zeitbezogenen Sequenz von Daten;und Bestimmen des Übertragungsprotokolls vor dem Erzeugen der ersten zeitbezogenen Sequenz von Daten, wobei das Übertragungsprotokoll ein Paketdatenprotokoll umfasst.

Independent claims19

252 paragraphs, as filed

0001the present invention relates to methods; computer-readable media and devices for preparing time related sequences of Media data for transmission, and in particular packetized transmission of such media data.

0002It are various different file structures today be used to save time-based media: audio formats such as AIFF, video formats such as AVI, and data stream formats such as RealMedia. One reason that such file structures are different, is their different focus and Applicability. Some of these formats are sufficiently relatively far accepted widely to implement in their application, and quite simply, and can thus not for Content delivery may be used but also as interchange formats. leading under these general formats is the QuickTime file format. It is now used in the majority of sites that caters to time-based data; in the majority of copyright environments, including professional such; and on the majority of multimedia CDROM titles.

0003the supports QuickTime media layer the efficient display and management of general multimedia data, with a Focus on time-based material (video, audio, etc.). the Media layer uses the QuickTime file format as the storage and interchange format Media information. The architecture is modest capabilities of the layer generally wider than the existing implementations, and the File format is capable of more information than currently represent by the existing QuickTime implementations is required.

0004in the Unlike formats such as AVI, which are generally designed were to local random access of synchronized media support, allow QuickTime systems, data, relationships and Timing to be managed by a general multimedia presentation. especially , the QuickTime file format structures to the temporary or temporary display behavior of general time-based data streams, a concept that the time-based emission of network packets covering, as well as the time-based local presentation or performance of Multimedia data.

0005The existing QuickTime file format is public by the company. Apple Computer file format specification described from May 1996, which can be found on the Quick-Time-page <http://www.apple.com/quicktime>.

0006On Aspect of the QuickTime file format is the concept that the physical Structure of media data (the design in disc recordings) is independent of a, and is described by a logical structure for the file. The file is complete described by a set of "movie" meta-data. This meta-data deliver declaring or explanatory, structural and temporary information about the actual media data.

0007the Media data be in the same file as the description data (the "Film" meta-data) or in a separate file or in other files. A film that is structured in a file that is typically "flat" or "level" (flat) called and is independent. Non-level films can are structured to refer to some or all of the media data to relate in other files.

0008As Such is the format generally suitable for optimization in different Applications. For example, when edited (together) is data which is not rewritten as edits need, applied and media are new or rearranged; the Meta-data file can be extended or renewed and temporary assignment information can be adjusted. If edits are completed, can the the relevant media data and meta-data in a single, with a Space equipped and optimized file for local or network access be re-written. Both the structured and the optimized data are valid QuickTime files, and both can be inspected, played or edited again reviewed and overhauled.

0009the Using structured ( "Non-levels") - files enables that the same basic media data in any number of presentations are to be used and to be used again. This same advantage applies when operating, as shown below.

0010Both when editing or editing as well as for operation, permits also, that a number of other files as part of an Film is to be treated, without the media data is copied. Thus can edit and operate directly from files such as the "au" audio format be done by the company. Sun Microsystems or the AVI video format, so that the great usefulness or the benefits of these formats will be expanded.

0011the QuickTime file is divided into a set of objects that Atoms are mentioned. Each object starts with an atom header, which its size and declared type or agreed:

0012the Size is in Bytes, including the size and Type header fields. The type field contains four characters (usually printable) to to permit easy documentation and identification. The data in an object according to the type field, fields, a sequence of Objects contained or both.

0013A File is therefore simply a sequence of objects:

0014the two important header-level objects are the media-data (mdat) and the meta-data (moov).

0015The and the media-data object (s) contain the actual Media (for example, sequences of Klangabtastwerten). their format is not limited by the file format; they are usually not Objects. Their format is described in the meta-data, not by any declarations or agreements that physically associated with them. Thus, for example in a film, the only motion JPEG is, JPEG frame contiguous stored in the media data with no intervening extra headers. The media data within the media data objects are logically divided into chunks or lumps; However, there is no explicit Klumpenmarkierer within the media data.

0016If the QuickTime file refers to media data in other files, it is not necessary that these secondary files according to the QuickTime specification are formatted as such media data files formatted can as if they were the contents of a media object. Since the QuickTime format does not necessarily require that any headers or physically related other information with the media data is it is possible to that the media data files, which, foreign 'headers (eg. UNIX ".au" files contain or AVI files) and that the QuickTime meta-data corresponding explanatory Information and reference the media data in the containing foreign 'file. In this way the QuickTime file format can be used, to existing material body Copy in incompatible formats without updating. The QuickTime file format is both a furnished or established format as well as in able with other established formats to work, this and include characterized these forward bring or forward.

0017suitor Space (eg. Deleted by an editing operation) can also be described as an object. A software that reads a file that includes space objects should ignore such space objects, as well as objects to any Plane which she does not understand. This permits extension of the File by on almost any level or at almost any measure introduced new items will.

0018the primary Meta-data are the movie object. A QuickTime file has exactly a movie object to which is typically at the beginning or at the end of the file is to allow a simple detection:

0019The Movie headpiece provides basic information on About the All Presentation (Their creation date, About Everything timescale, and so continue). In the sequence of contained objects, there is typically at least one track, which presented data temporarily describes.

0020The Track header provides relative basic information about the track (its ID, timescale, and so on). Objects that are included in the track, can References on other tracks (eg. for complex joining or assembling) or Editierungslisten be. In this sequence of contained objects can be as a give media object that describes the media, which presents be when the track is played.

0021The includes media object Declarations that the presentation concern that is required by the track (eg. that they sampled Audio, or MIDI, or orientation information for a 3D scene is). The type of track is declared by its leader or handler:

0022Within the media information there is also a guide for the declaration data guide (which Media data obtained), and a data information declaration, which defines which files contain the media data for the associated track. By Use this declaration or agreement can be built films which comprise or span multiple files.

0023On the lowest level is a scan table used the temporary aspect the trail to the data relates to, which are saved in the file:

0024the contains Abtastbeschreibung information about the media (eg. the compression formats used in video). The time-to-sample table relates to a time in the track to the sample (by index), which will be displayed at this time should. The synchronization table indicates or declares that This sync (key) samples are not dependent on other samples.

0025The Sample-to-chunk object declares how the media data for a given sample can be found, and its description is given by its index:

0026the Abtastwertgrößentabelle shows the size of each Sample to. The chunk offset table shows the offset in the containing file to the start of each chunk.

0027On Passing through the structure described above, the matching data to find, in order for display a given time, is pretty straight easy which is generally bring indexing and adding with it. Among Using the sync table, it is also possible to preceding sync sample to secure, and, silently 'accumulating deltas to a desired Starting point forward to roll or spool.

0028<figref idrefs="S90">1</figref> shows the structure of a simple film with a track. A similar Chart can in the QuickTime file format description be found, together with a detailed describing the Fields of the various objects. QuickTime atoms (objects) are shown here with their type in a gray box, and a descriptive Name it. This film contains a single video track. The video frames are in the same file, in a single data chunk. It should be noted that of, chunks' only is a logical construct; it is not an object. Inside in the Chunks are video frames that typically in their natural Form are stored. There are no required headers or fields in the video frames themselves.

0029<figref idrefs="S91">2</figref> is a diagram of an independent or independent File with both an audio and a video track. Fewer the atoms are here for brevity shown; the pointers from the tracks in the media data are, of course, the ordinary Abtastwerttabellendeklarationen which timing information contain.

0030The QuickTime file format has a number of advantages, including: <ul><li>1) Scalability for size and bit rates. The metadata are flexible, even compact. This makes them suitable for small downloaded movies (eg. on the Internet) as well as to provide the basis for a number of high-quality editing systems.</li><li>2) A physical structure of the logical and temporal structure independently. This makes it possible, the physical structure differently depending on the use, the will have the file, optimize. In particular, this means that a single file format for authoring and editing suitable is; Downloadable or placing on CDROMs; and stream-type transmission.</li><li>3) The file format has proven that it is capable of to handle a very wide variety of codec types and track types, including many designed unknown at the time when the format. This proven ability in an upward-compatible developing type, is fundamental to the success of a storage format.</li></ul>

0031Scalable or layered codecs handled in a number of ways in the QuickTime file format will. For a stream-like transmission protocol, which supports scalability, can Samples with the layer or bandwidth threshold or -schwellwert be marked or labeled that or to transfer or sending the samples is to be fulfilled.

0032Feel, comprising a set of alternatives forms (eg. different Klangspuren in natural language) can be marked in such a way that only one will be selected to play. The same structure can be used as an alternative to stream-type transmission (Eg. For select a language). This ability is described in further detail in the QuickTime file format.

0033If QuickTime displays a movie or track, without prejudice to the right media guide on the media data for a special or single time. The media guide must correctly interpret the data stream to recover the required data or recover. For example, crossed with respect to video media, the media guide typically several atoms to determine the location and size of a sample for a given find media time. The media guide can perform the following:<ul><li>1. Determine the time in the media time coordinate system.</li><li>2. Examine the time-to-sample atom to the sample number to determine for the data the contains specified time.</li><li>3. scanning the sample-to-chunk atom to locate to make that chunk contains the sample in question.</li><li>4. Extract the offset of the chunk from the chunk offset atom.</li><li>5. Finding the offset within the chunk and the size of the sample, by the Abtastwertgrößen atom is used.</li></ul>

0034It is often desirable a QuickTime file or other types of time-related sequences of media data via to transmit a data communication medium, which with a Computer network (eg. The Internet) can be linked. In many Computer networks should the data transmitted in the network will generally be or are present in packet form. Usually are time related sequences of media data are not in the appropriate or proper packetized format for transmission over a network. For example are media data files in the QuickTime format is not in a packetized Format. Thus, there exists a need to store the data in packets for transmission over a collect network, sometimes referred to as stream-type data transmission referred to as.

0035On earlier Approach to the problem of transmitting address time related sequences of media data over a network, is the media file via to send the network by using a network transmission protocol, such as Hypertext Transfer Protocol (HTTP) is used. Thus, the media file itself from a computer system over the network to another Computer system sent. However, it can not give no desire the media file in or on the receiving computer system to to keep. This means, if the media file on the receiving or receiving computer system is received and viewed or listened to, since it can not Desired by the user of that receiving computer system give, to store a copy of the file, for example, when the receiving Computer system is a network computer or a computer with a low Memory Carcapacity is.

0036On Another alternative approach to solve the problem, such as data for transmission by packets over a network are to be collected, is to prepare a file, which the network protocol data units in the file for a special transmission protocol contains. In a sense, such a file as a packetised File be considered that substantially the same format in is stored, when it transferred according to the specific communication protocol will be. Carry out this process takes a generally save the file in a packetized form for a special network protocol for a specific data transfer rate and a particular media file format itself. Thus, for each different transmission protocol In a particular data transmission rate, reproduces the file in its packaged form substantially be or copied. The fixed form of such files can their applicability / compatibility restrict and make it hard to view such files locally or to sift. Thus, such an approach greatly increase storage requirements, in Attempt the file in various transmission protocols at variously different data rates to deliver. also each pake formatted file that alternative according to this earlier approach produced is generally limited to a particular media file format, and thus be other media file formats for the same media object (Eg., A digital film) typically packetized and transmitted to the or Transmitting computer system stored.

0037Even a different approach to solve the problem of how zeitbezogenene sequences are to transmit data stream like media data is perform the packetization of the media data when transmitting on the or, the sending system according to the particular transmission protocol, which desired is required. This processing requires in many cases a relatively considerable Amount of time and can thus the performance of the transmission system slow it down.

0038A Publication "RAVE: Real-time services for the Web " of England et al. discloses an RTP transmission of multimedia, eg. QuickTime by a Paketierungsunterprogramm is used.

0039Thus it is desirable an improved method and an apparatus for transmitting time related sequences of media data to be provided.

0040the present invention provides methods; Computer readable media and apparatus for processing media data for transmission in a data communication medium. In one embodiment a data record such as a time related sequence of media data according to a transmission protocol transferred to is. The data set in accordance with a embodiment closes a time related sequence of dates which time related with the linked sequence of media data are. According to a Aspect of the invention, the data record utilized by a digital processing system are respectively sold to the time related sequence of media data (Eg. By packets according to the transmission protocol are generated and the data set) to be transmitted.

0041Preferred embodiments of the present invention will now be apparent from the following drawings by way of example described. Show it:

0042<figref idrefs="S90">1</figref> on Example of the structure of a simple movie with a trace after State of the art;

0043<figref idrefs="S91">2</figref> on Example of an independent Movie file of the prior art;

0044<figref idrefs="S92">3</figref> on Flow chart, an example of a method according to the present invention shows;

0045<figref idrefs="S93">4</figref> on Example of a hint track of the present invention;

0046<figref idrefs="S94">5</figref> on Another example of a hint track of the present invention;

0047<figref idrefs="S95">6</figref> on Diagram of Netwerkcomputersystems in which media data according to a embodiment are exchanged and / or processed in the present invention can;

0048<figref idrefs="S96">7</figref> on Block diagram of a digital processing system which, in accordance with one embodiment of the present invention may be used;

0049<figref idrefs="S97">8</figref> on Block diagram of a system that utilizes hints to media data according to a Outmanagement form the invention must be specified;

0050<figref idrefs="S98">9</figref> on Block diagram of a system that utilizes hints to media data according to a embodiment the invention must be specified;

0051<figref idrefs="S99">10</figref> on Flow chart, a method for generating hints for providing media data transmission according to a embodiment the invention;

0052<figref idrefs="S100">11</figref> a flow diagram, a method of processing media data explained, the by a receiving system in accordance with requirements set out in a embodiment the invention is received;

0053<figref idrefs="S101">12</figref> an example of a machine-readable storage medium, to digital by a processing system, such as a generator, according to a embodiment the invention is accessed;

0054<figref idrefs="S101">13</figref> an example of a machine-readable storage medium, to digital by a processing system, such as a server, according to an embodiment the invention is accessed;

0055<figref idrefs="S102">14</figref> an example of a machine-readable storage medium, to digital by a processing system, such as a receiving system or other digital processing system, according to a embodiment the invention is accessed;

0056<figref idrefs="S103">15</figref> a diagram of a data storage and / or Communication medium, the stored / transported thereon media and indication information according to a embodiment the invention comprises.

0057the present invention provides methods, computer readable media and Devices for permitting the transmission to disposal, and particularly the packetized transmission of time related sequences of media data, which, for example, Video, audio, video and audio, etc. may include, via a communication medium, such as in a computer network.

0058In one embodiment the present invention creates and creates a digital Processing system a record to display as a time-related Sequence of media data according to a transmission protocol transferred to is. Typically, this data record is stored on a storage device, the coupled or connected to the digital process ing system is. Furthermore, this data is a time related sequence of data that is associated with said time related sequence of media data.

0059the present invention can fully in executable Computer program instructions or directives may be implemented, which they are stored on a computer readable medium or may be in a combination of software and hardware, or in certain embodiments exclusively be implemented in hardware. Typically, a server computer system, which is coupled to a network, create the data set which can be referred to as a hint track and this hint track in or on a storage device store, which is coupled to the server computer system. If a client computer system, a presentation or performance (eg. a watch or listen or viewing and listening) a media data file requests, uses the server system Hint track to determine how the media data for transmission are to package at or on the client computer system. It is understood that the present invention relates generally to time-related Sequences of media data is applicable, and that QuickTime herein is shown as an example of this general applicability. Thus, the invention should not necessarily limited to QuickTime be limited.

0060<figref idrefs="S92">3</figref> shows an example of a method according to the present invention. This in <figref idrefs="S92">3</figref> method shown <figref>300</figref> begins at step <figref>301</figref>. in which the media file format for the particular media data, which desired be that they transmit be, is determined. In step<figref>303</figref> is the special transmission protocol or - logs, which desired) is (are) that it (they) is (are) used, as intended. However, steps <figref>301</figref> and <figref>303</figref> optional, to For example, in the case where always transmit the same media file format is by the same transmission protocol is used.

0061In step <figref>305</figref> creates and stores a digital processing system, such as a server computer system, the instructions for packaging a time related sequence of media data in a Memedia file. Alternatively, a computer system created the notes and to another system, such as a server computer system, provide that they for later Use in a transfer process stores. The packaging allows the transmission over a network or via communication media according to the desired transmission protocol, which in step <figref>303</figref> was determined. In one embodiment, of the present invention are the instructions as a trace of time related sequence of instructions stored, which in itself other tracks of media data relates, but which in one embodiment, is separate from other tracks of media data. The hint track in one embodiment, of the present invention separately from the media data to which it relates, are stored. As such, the hint track are stored in a file which is separated from a different file is that contains the media data, to which the hint track by reference, or the hint track may be stored in a reference area and a Retail Space in the file be that contains the media data, which are separate and separated from the data area of the actual or actual media data contains. In one embodiment, the invention, a hint track, or a portion thereof, as executable Instructions are interpreted by the server, wherein the executable instructions cause the server to a time related sequence packetized data, which is typically, but not necessarily, time-based media are data. In one embodiment of the present Invention, these instructions stored on the storage device, which with the transferor coupled digital processing system.

0062In step <figref>307</figref> the data which is packetized according to the instructions, of a transmission system, transferred such as a server computer system to a receiving system. This media data is transmitted, by the media data according to the instructions be packaged. In an alternative embodiment of the invention, the server computer system decides that the evidence is not used be and that the media data by an alternative packaging process be sent.

0063In step <figref>309</figref> brings or presents the receiving system the media object represented by the media data. Typically, this presentation will (Which a viewing and listening a media object or a mere Reputation or merely a listen to may be the media object) performed when the packetized data in or on the receiving system are received. The packetized Data, in one embodiment, of the present invention, but need not, on the receiving system be saved. Thus, the presentation of the data is short-lived in the sense that once the presentation past is, there is no local are copy on the receiving system. In another embodiment, can a presentation the media object on the server system subsequent to creating of evidence for the media data representing the media object, take place. In one embodiment the invention, the media data is not necessarily (re) formatted, copied, etc. for packetization according to the instructions.

0064In step <figref>311</figref> may the receiving system optional legally the reassemble media file when the media file as received has been stored on the receiving system. It is understood that the manifold Steps of the method described in <figref idrefs="S92">3</figref> shown will be performed in a different order or other can than the one which has been shown and described above, and / or some the steps may be performed simultaneously. To the For example, in one embodiment steps <figref>309</figref> and <figref>311</figref> performed in parallel.

0065A special implementation with QuickTime according to one embodiment of the present invention will now be described. In a embodiment of the present invention, a presentation is provided, which can be both viewed locally to the file (eg. in a server, Generator, etc.) and data stream over a network-like manner within transmit a QuickTime movie can be. In general, in the data stream transmitted Server (or another system) information on the data units that to transmit data stream moderately are, their composition and timing have. Since such information typically are temporal, can they will be described in tracks. A server can packetization carry out and log information to determine, for example, by using the same indexing operations be, how they would be used to view a presentation.

0066the Tracks, the instructions for contain the servers are sometimes called, notice 'trails, since such tracks represent a record to the server in the process of forming and transferring align packages or control. The QuickTime file format supports stream-type data transmission of media data via a network as well as local playback. The process of sending Protocol data units is time-based, just like the display of time-based data, and is therefore suitable by a time-based Format described. A QuickTime file or a -, Film 'which respectively welcher stream-type data transmission supports, closes information about the data units, which are to transmit data stream as (streaming). This information is in additional Traces of the file included, called tracks "Note".

0067hint tracks include instructions for a data stream as transmitted Server (or other digital processing system) which assists in the formation of packets. These instructions can direct contain data that the server sends (eg. header information) or reference segments of the media data. In one embodiment, of the present invention are instructions in the QuickTime file encoded in the same manner, in the Bad edit or presentation information in a QuickTime file for local play are encoded. Instead of editing or presentation information can Information is provided to permitting that a server packetizes the media data in a manner that for streamwise data transmission is suitable, by using a specific network transport is.

0068In one embodiment of the present invention are the same media data in a QuickTime file used which contains instructions, whether for local playback, or for stream-wise transferring a Number of different transport types. Separate, Hinweis'spuren for different can transport types be included within the same file and the media can all Such transport types are played without additional Copies of the media are making themselves ge. In addition, existing media data stream as capable of transmission through the addition of matching hint tracks for specific shipments are made. According to one aspect of the invention, need the media data itself is not converted type moderately or reformatted will.

0069That's why containing samples in a hint track general instructions, in order to form packages. These instructions may contain immediate data, the server sends (eg. header information) or reference segments the media data in another track.

0070In one embodiment of the present invention, a three-level construction used in such that: <ul><li>1) The media data as a set of network independent Traces shown, which can be played as normal, edited can be and so on;</li><li>2) There is a common declaration and base structure for server hint tracks; This common format is protocol independent, but contains the declarations, which protocol or which protocol in the server or track the -spuren described or will;</li><li>3) Since there is a specific construction of the server hint tracks for each Protocol, which transferred can be; all these designs use the same basic structure. For example, it may as designs for RTP (for the Internet) give and MPEG-2 transport (for Radio and television broadcasting) or for new standard or vendor-specific Protocols.</li></ul>

0071In one embodiment of the present invention, the resulting data streams which transmitted by the server under control of the hint tracks are normal streams, and not close necessarily a trace or record QuickTime Information on. This embodiment the invention does not require that QuickTime or its structures or declaration style necessarily either in the data or on the transmission medium (Eg. Network cable) or in the decoding station. For example can a file that uses H.261 video and DVI audio, the stream-like transmitted by RTP is, in one embodiment of the present invention in a packet data stream resulting, which completely compliant or compatible with the IETF specifications for Bundling those codings into RTP.

0072In one embodiment the invention will be built hint tracks and in such or flagged that if the presentation is viewed locally, the hint tracks by substantially Receiving system are ignored.

0073In one embodiment can be a time related sequence of media data such as video, Include audio, etc. can, are packetized by a digital processing system and then on are presented to the same digital processing system. furthermore may be such perishable packetization that the time-related Sequence just presented is stored, read, etc., as well packaged "on the fly" is. In one embodiment, can , references to media data that is not copied, formatted, have become so; For example, the media data to which is the notice relates, in an original format on a read-only memory etc. are stored.

0074In one embodiment presents Note the same routine that provides packetization, as well as the media during or as packetization is performed. In alternative embodiments, the invention, a packetized file of time related media data according to the hint tracks are generated and stored, for example, for later transmission.

0075<figref idrefs="S93">4</figref> explained a Use of hint tracks for transporting media data according to a embodiment the invention. In<figref idrefs="S93">4</figref> is a hint track <figref>401</figref> for the media track <figref>403</figref> shown. Each Hinweisspurabtastwert such as Hinweisspurabtastwert <figref>405</figref> - which one describes how an RTP packet is to be formed - may contain a header and can reference some data from a linked media track or call - in this case, a video track <figref>403</figref>, In that in<figref idrefs="S93">4</figref> shown embodiment were the media data (video frame) and the RTP indications such equipped with a space or interlaced, that the associated media file can be read relatively easily. In this example, each shown frame, to fit into a single RTP packet inside. Of course it is possible to frame If necessary to separate into multiple packets. Conversely enough, can multiple frames, if desired, be placed in a single packet, which is commonly with performed audio data is.

0076As discussed above, takes the above-described logical structure not a physical structure imply. The metadata can in Memory are cached hiding, and the Hinweisspurabtastwerte can to which they relate with the Medienabtastwerten (as in <figref idrefs="S93">4</figref> shown is) placed in between, and are interlaced.

0077alternative Is it possible, To write a new set of metadata and media data, the containing the hint tracks, which the metadata and media data in an existing presentation Referencing and bigger. <figref idrefs="S94">5</figref> explained a Exploitation or use of hint tracks to reference media data in a separate file in accordance with a embodiment the invention. In<figref idrefs="S94">5</figref> two movie files <figref>502</figref> and <figref>504</figref> shown, each with their own meta data. The first, the movie file<figref>502</figref>. contains a video track. The second, the movie file<figref>504</figref>, Contains both a video track and a hint track, but the metadata declare, that the metadata for the video track in the first film <figref>502</figref> is. Thus show the clues to the movie file <figref>504</figref> are linked, as to the media data in the first film <figref>502</figref>,

0078In one embodiment of the present invention, a media file Paketierungshinweisspuren for multiple or different protocols included. As such, each track Declarations of the protocol (and protocol parameters, if appropriate), For which Note the track is suitable contained. These tracks can of course all Media data references of the basic media tracks in the file. Of the Desire for protocol independence and expandability can be fulfilled in the manner described.

0079In one embodiment the present invention need not hint tracks all data use in the media tracks. The hint tracks can have a Sub- or sub-set of data (eg. By omitting some video frames) use to or a bandwidth threshold, a - threshold value, or for other reasons, to reach. provided Da multiple hint tracks for the same protocol can be, can differing subsets the same basic media information for or at different Rates or speeds are provided or supplied. As such, the present invention provides an improved scalability over prior methods and devices provide.

0080It should be stressed that - although Note the tracks themselves and the QuickTime meta-data in one embodiment, in QuickTime files should be - the basic media of any File type can be left, can import that QuickTime and can reference instead. In one embodiment, the present invention may Include the meta data in the movie file is a data reference which declared that the media data is in another file. The Abtastwerttabellenversätze and pointer to thus relate to data in this 'foreign' file. Thus, according to a embodiment of the present invention, existing legacy formats such as "au" audio files, "AVI" audio / video files and MIDI files are data stream as transmitted without they require copying or reformatting of the base media data. Because is not written on the basic media information, but only by QuickTime declarations and guidance information are increased in separate files can Basic media data as well to read-only machine-readable media come as a CDROM.

0081In one embodiment the present invention embody the hint tracks the results of off-line computation and are typically optimized to supply the server with information to packetization, and if necessary, transfer channel bundling or multiplexing support.

0082Beispielhinwiese, for example for RTP (the IETF standard real-time protocol) and MPEG-2 transport are in Annexes A to C shown.

0083In one embodiment of the present invention supports a single file, hint tracks for multiple or different protocols or multiple different parameterizations the same protocols, without undue space overhead. New Protocols and their associated therewith can hint tracks be constructed without interfering with systems that relate to existing leave protocols. Thus, the invention is in at least one embodiment protocol-neutral.

0084In the QuickTime file format, a track for the film may be added, by updating the meta data or copied and enlarged. If the metadata is in files separate from the meta-data are, or an optimized accessorizing with a gap (interleave) is not required, this can be a relatively simpler and more efficient its operation.

0085In one embodiment the present invention may Traces are extracted by a new set of movie meta data is built, which contains only one track and which, if desired, the media data can reference in the original.

0086To the For example, in one embodiment the present invention provides a new audio track is added, which is selected to have an alternative to a Sa tz of other audio tracks. If it just a language code (eg. French or Tagalog) is selected, then the appropriate track for the presentation time selected will.

0087SMPTE time-code tracks are an example of elementary streams which may be present, added, or can be eliminated, such a need occurs, according to a embodiment of Invention.

0088According to a Aspect of the invention can Note traces the development of new formats for new protocols allow without having existing compatibility issues for cause servers or local playback. In addition, new media tracks can about the Life of the file format to be added, while a Backward compatibility upright is obtained.

0089In one embodiment the present invention include the fields of extensibility on: <ul><li>a) New types of tracks, which for media types can be defined, the not gegegenwärtige by the QuickTime file format (Eg. Laboratory instrument readings) are covered.</li><li>b) New coding types existing tracks, which can be defined (eg. video or audio codecs). Since there is an explicit provision for their codec-specific Initialization information.</li><li>c) New hint track types, defining new protocols can be, and a file containing reference information for more than one protocol may, without space for expenses draw the media data itself.</li></ul>

0090existing Content on read-only media can be used with the present invention (eg. pre-packed movies on CD ROM, DV D, etc.).

0091Continue can according to a Aspect of the invention, various "foreign" file formats be used. In one embodiment ei the present invention may them if the existing content is either in QuickTime format or can be imported, edited and data stream as transmitted, without copying or re-formatting is required.

0092In one embodiment of the present invention may if a codec supports stripping of media data to to achieve bandwidth scalability, this stripped represents bandwidths or be represented by using multiple stream tracks will. Each track can be a different bandwidth. tracks can in selected subsets the base media are grouped together.

0093In one embodiment of the present invention, when a protocol is a bandwidth scalability supports, then the hint track itself information for each protocol data unit (A sample included in the hint track). Information may include the Bandwidth threshold or to include -schwellwert above, which the protocol data unit to be delivered to the network should. Thus, Note marks an available Bandwidth than that it is high, low, etc., advertisements, and / or other information the bandwidth for data transmission affect.

0094In one embodiment of the present invention may If the protocol is a multi-channel or multiplex protocol (eg. MPEG-2 transport) is then different hint tracks are built, which a use different subset of the elementary data stream tracks in order to achieve different data rates. This may result in some traces of a transfer completely at low bit rate be left out.

0095In one embodiment of the present invention may if desired is to record the basic data by different codecs be used, then those tracks in a set of alternatives are formed, and are only one selected for presentation. The choice of which track the presentation is used is tpyischerweise protocol-dependent and can be achieved, by the approaches described herein are used for hint tracks.

0096In one embodiment of the present invention, an encryption as a media file preceded turned. In this case, the encrypted Data is either (a) in a new elementary stream (a new Track), which with the original media data (or the original Media data be eliminated if they are no longer needed) connected or (b) are stored in the hint track itself. In the case (B) it is possible to Note that the track does not have any data from the elementary unencrypted Data stream extracted in flight. Thus, the entire media data be in the hint track as well as the protocol data unit information of the transmitted power as Package because the media data is transformed by encryption can.

0097As an example of embedded object content information, the IETF session description information for one whole movie and for individual tracks, as in the meta-data for the RTP hint tracks Users atoms are stored.

0098In one embodiment includes the present invention a file format typically both media data in a playable Format and information for current-like data transfer. In one embodiment, Is it possible of this format with relatively low overhead expense data stream, directly transferred to, while a media independence, a protocol independence and a skill that Media to present locally, is preserved.

0099According to a Aspect of the invention can Note traces detailed knowledge of codecs, timing and abstract packaging in an off-line preparation process. Thus, it may be relatively easy to follow the hint tracks, to produce the data stream, and no specialized knowledge of the Media require being transmitted stream-like manner. Thus, a decoupling of a server, for example, from the details of the Data content, according to a Aspect of the invention, can be provided.

0100In one embodiment the present invention uses a set of hint tracks are to construct a file that directly to the stream-like transfer is optimized - for Example, by network PDUs on a disk at logical disk boundaries, in the time sequence, in which they are to be sent, designed or formed will. Such file must not longer a general presentation be, but it can be transmitted stream-like manner. In a Embodiment, packetized Files that were created with hint tracks are stored, and later as for stream-type transmission be optimized.

0101In one embodiment of the present invention may by foreign file formats are encapsulated media data in other Formats are preserved while they nevertheless published in QuickTime will. For example, an existing format directly into a New Me encapsulated serving data file by the right packaging (Wrapper) is applied, or can be left intact and referred to in segments or as a whole by the reference track be, is allowed that that the old formats without copying transmitted data stream like will. A single movie may contain pieces of multiple selected Altformaten will. This invention is limited not the basic media format.

0102in the Generally, a common format, which capture, Be and editing, download and stream-type transmission spans, general flexibility to disposal put. materialcan be reprocessed after use or be used in multiple ways without it being copied or reformatting. In one embodiment of the present Invention, it is possible To process material has been advised that again and to use again by the hint tracks are stripped, by standard editors are used, and then the re-pointed be after machining is complete.

0103If wished is that a media file for Downloading local reputation, an optimized space between standard equipped or verkämmte file for this purpose with the stream-like transmitting meta-data in a separate Declaration file that references the same basic media information, be built. Therefore, the download does not need the information for stream-type transmission include, and even the media data just once on a server for stream-type transmission to be present.

0104while isolated a logical structure of a physical structure is the physical structure of the file can depend on the application (eg. Edit, local reputation, stream-type transmission) be optimized differently.

0105while the existence of multiple hint tracks for each media track in a embodiment of the present invention is permitted, the file may be published are by about multiple protocols is transmitted stream-like manner without multiple Copies of the media are required.

0106<figref idrefs="S95">6</figref> is a diagram of a network of Computersytemen in which media data according to a embodiment of the present invention can be processed. As in<figref idrefs="S95">6</figref> shown, is a number of client computer systems, one or more of that of the reference to an implementation with <figref idrefs="S92">3</figref> above Receiving system described can represent, through an Internet <figref>622</figref> coupled together. It understood that the term "Internet" in a network of networks relates. Such networks may using a variety of protocols for information exchange, such as TCP / IP, ATM, SNA, SDI, etc. The physical Connections of the Internet and the protocols and communication procedures of the Internet to the skilled worker are well known. Access to the Internet<figref>103</figref> becomes typically provided by Internet service providers (ISPs), such as the ISP <figref>624</figref> and the ISP <figref>626</figref>, Users on client systems, such as the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref>Receive general access to the Internet through Internet service suppliers, such as ISPs <figref>624</figref> and <figref>626</figref>, Access to the Internet can an information transfer simplify (eg. email, text files, media files, etc.) between two or more digital processing systems, such as the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref> and / or a Web server system <figref>628</figref>, To the example one or more of the computer systems client- <figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref> and / or the Web server system <figref>628</figref> media data (Eg. Video and audio, or video, or audio) to another or several other of the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref> and / or the Web server system <figref>628</figref> supply. Such can be delivered in response to a request. As described herein, can such media data in the system <figref>600</figref> transmitted in accordance with instructions will. Such notes may in one embodiment, the invention according to a specific Format of the media data and / or a specific data communication (Eg. Network) protocol or specific data communication protocols be created.

0107Of the webserver <figref>628</figref> typically has at least one computer system on to one or more data communication protocol or protocols to operate, such as the protocols of the global network and as such, is typically connected to the Internet <figref>622</figref> coupled. Optional may expediently the Web <figref>628</figref> be part of an ISP, which access to the Internet and / or to another Network for client computer systems to disposal can provide. The client computer systems<figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref> can each with matching web navigation and presentation software data access accept, such as HTML documents (eg. Sites), which by the web server <figref>628</figref> to provide can. Such data may deliver media, such as QuickTime movies, which by the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref>. and <figref>620</figref> presents can be.

0108Of the ISP <figref>624</figref> provides Internet connectivity to the Client Computer System <figref>602</figref> via a modem interface <figref>606</figref> to available which as a part of the client computer system <figref>602</figref> considered can be. The client computer system may be a conventional be computer system, such as a Macintosh computer, a "network" computer, a handheld / portable computer, a Web TV system, or other types of digital Processing systems (eg., A cellular phone, the digital processing capacity has). Similarly supplies the ISP <figref>626</figref> Internet connectivity for the client computer systems <figref>604</figref>. <figref>618</figref>. and <figref>620</figref>Although, as in <figref idrefs="S95">6</figref> shown, such connectivity between differentvary like client computer systems can, such as the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref> and <figref>620</figref>, For example, as in <figref idrefs="S95">6</figref> shown, the client computer system <figref>604</figref> at the ISP <figref>626</figref> through a modem interface <figref>608</figref> coupled, while the client computer systems <figref>618</figref> and <figref>620</figref> part a local area or region network (LAN). The interfaces<figref>606</figref> and <figref>608</figref>, the as modems <figref>606</figref> or. <figref>608</figref> in <figref idrefs="S95">6</figref> correspondingly are shown, an analog modem, an ISDN modem, a cable modem, a satellite transmission interface (Eg. "Direct PC "), a wireless interface or other interface to be coupling a digital processing system, such as Such a client computer system, to another digital Processing system. The client computer systems<figref>618</figref> and <figref>620</figref> will to a LAN bus <figref>612</figref> through network interface <figref>614</figref> or. <figref>616</figref> correspondingly coupled. The network interface<figref>614</figref> and <figref>616</figref> can a Ethernet type, an Asynchronous Transfer Mode be (ATM) or other type of network interface. Of the LAN bus is also in a digital processing system <figref>610</figref> one Doorway (gateway) coupled having a firewall and other Internet-related services for a LAN available provides. The digital processing system<figref>610</figref> a doorway, in turn to the ISP <figref>626</figref> coupled to an Internet Konektivität for the client computer systems <figref>618</figref> and <figref>620</figref> available to put. The digital processing system<figref>610</figref> a doorway For example, a conventional Include server computer system.

0109The system <figref>600</figref> can one or more of the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref> and <figref>620</figref> and or the Web server <figref>628</figref> allow he or she media data (Eg. Video and audio, or video, or audio) to another, or several other of the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref> and <figref>620</figref> and / or webserver <figref>628</figref> to disposal asked now. Such data may, for example, in response placed on a request by a receiving system available are, for example, which one or more of the client computer systems <figref>602</figref>. <figref>604</figref>. <figref>618</figref> and <figref>620</figref> be can. As described herein, can Such media data into the system <figref>600</figref> according to instructions transmitted or hint tracks will. Such notes may in one embodiment, the invention according to a specific format of the media data and / or a specific Datacom (eg. Network) protocol or protocols be created in order according to a Aspect of the invention to allow packetization of media data.

0110<figref idrefs="S96">7</figref> is a block diagram of a digital processing system which in accordance with an embodiment of the present invention may be used. For example, the digital processing system <figref>650</figref>, this in <figref idrefs="S96">7</figref> shown is, as a client computer system, a Web server system, a conventional Server System are used. Further, the digital processing system<figref>650</figref> used be to one or more function / s of Internet service suppliers, such as the ISP <figref>624</figref> and <figref>626</figref>Perform. The digital processing system <figref>650</figref> An interface with external systems via a modem or a network interface <figref>668</figref> form. It is understood that the modem or network interface <figref>668</figref> as a part of the digital processing system <figref>650</figref> be seeks can be. The modem or network interface<figref>668</figref> can an analog modem, an ISDN modem, a cable modem, a token ring interface, a satellite transmission interface, a wireless interface or other interface or other interfaces to provide a data communication connection between two or more digital processing systems.

0111The digital processing system <figref>650</figref> includes a processor <figref>652</figref> on, can which represent one or more processors and a or more conventional may include types of such processors, such as, for example, a Motorola PowerPC processor, an Intel Pentium (or x86) Processor, etc. A memory <figref>155</figref> is connected to the processor <figref>652</figref> by a bus <figref>656</figref> coupled. The memory<figref>155</figref> can may be a dynamic random access memory (DRAM) and / or static RAM (SRAM) include. The processor may also in other types of memory areas or areas / memories (Eg. The cache memory, flash memory, , Etc. may be coupled disc) serving as a part of the memory <figref>155</figref> or separated from the memory <figref>155</figref> can be considered.

0112Of the bus <figref>656</figref> further couples the processor <figref>652</figref> to a display control <figref>658</figref>, A mass storage device <figref>662</figref>. the modem or Network interface <figref>668</figref>And an input / output (I / O) control <figref>664</figref>, The mass storage <figref>662</figref> may be a magnetic, optical, magneto-optical, tape and / or other type of machine-readable Medium / device represent for storing information. For example, the mass storage<figref>662</figref> a Hard disk, a read-only or writable CD, etc. represent. The display controller <figref>658</figref> controls in a conventional Fashion ad <figref>660</figref>Comprising a cathode ray tube (CRT) display, a liquid crystal display (LCD), representing a plasma display, or other type of display device can. The I / O controller<figref>664</figref> controls an I / O device or devices <figref>666</figref>. which one or more keyboards, mouse / Spurball- or other Pointing Devices, magnetic and / or optical disk drives, printers, scanners, digital cameras, microphones, etc. can include.

0113It understood that the digital processing system <figref>650</figref> just illustrating an example of a system that many different may have configurations and architectures, and which with the present invention may be employed. For example, have Macintosh and Intel systems often multiple buses or bus systems on, such as a peripheral bus, a dedicated cache bus, etc. On the other hand, needs a network computer, which functions as a digital processing unit of the present invention can be used, for example, not a hard disk or include other mass storage devices, may received but routines and / or data from a network connection, such as the modem or interface <figref>668</figref>. order by the processor <figref>652</figref> to be processed. Similarly, a Web TV system, which is known in the prior art considered, be, a digital processing system of the present invention to be, but such a system does not have one or more I / O devices include, such as those described above with respect to I / O device or devices <figref>666</figref> described were. additionally , a portable communication and data processing system, which a cellular Telephone and / or Renown abilities may use, be regarded as a digital processing system, which can be used with the present invention.

0114In the system <figref>650</figref>, this in <figref idrefs="S96">7</figref> shown is the mass storage can <figref>662</figref> (And / or memory <figref>654</figref>) Media (eg. Video, audio, movies, etc.) store, which according to the present Invention (eg., By information) can be processed. alternative can Media data by the digital processing system <figref>650</figref> receive are, for example through the modem or network interface <figref>668</figref>And stored and / or through the display <figref>660</figref> and / or an I / O device or devices <figref>666</figref> presents will. In one embodiment, can packetized media data a data communication network such as a LAN and / or the Internet can be transferred in accordance with hint tracks. on the other hand , the processor <figref>652</figref> perform one or more routines to a file containing one or to use multiple hint tracks, or alternatively, to create one or more hint tracks, to Media (eg. A pre-packed film, an audio file, a video file etc.) for presentation or packaging according to the hint tracks to process. Such routines may in mass storage <figref>662</figref>In the memory <figref>664</figref> and or are stored in another machine-readable medium, which by digital processing system <figref>650</figref> accessible and accessible is. In one embodiment, , the digital processing system <figref>650</figref> process media data, having hint tracks embedded therein. Similarly, such embedded media data in the mass storage <figref>662</figref>, in the memory <figref>664</figref>, And / or machine-readable in a different Media are stored, obtained by the digital processing system <figref>650</figref> is accessible.

0115<figref idrefs="S97">8</figref> is a block diagram of a system that uses the hints to media data according to one embodiment the invention to be transferred. This in <figref idrefs="S97">8</figref> system shown <figref>680</figref> includes a receiving system a, which as a client data processing system <figref>682</figref> illustrated is that to a server <figref>694</figref> via a data communication link <figref>686</figref> coupled is. The server<figref>694</figref> and / or the client data processing system can for example, represent a combination of devices / systems with reference to <figref idrefs="S95">6</figref> and <figref idrefs="S96">7</figref> described are.

0116Of the server <figref>694</figref> closes a Hinweiserzeugungs- and processing unit <figref>688</figref> on, a media processing unit <figref>690</figref>And a data communication unit <figref>692</figref>. each having a fixed-wired circuitry or machine executable instructions may include or a combination thereof. Furthermore, at least a portion of such hard-wired circuitry and / or between from such machine executable instructions a combination of Hinweiserzeugungs- and processing unit <figref>688</figref>. media processing unit <figref>690</figref>And the data communication unit <figref>692</figref> GE / distributed or be shared. In one embodiment, at least a / s storage area / memory (eg. a machine-readable medium) having appropriate routines and / or therein stored comprising data linked to at least one processor are least utilized in part to one or a combination Note the generation and processing unit <figref>688</figref>, the Media processing unit <figref>690</figref>And the data communication unit <figref>692</figref> to to implement.

0117In one embodiment creates and stores the Hinweiserzeugungs- and processing unit <figref>688</figref> Notes for a Packetization of media data by the media processing unit <figref>690</figref> are processed. As described above, can the information as a separate file, relative to media files and produces are stored, or can be embedded with or in media data. If more than one media format is to be processed, an appropriate format, through the Hinweiserzeugungs- and processing unit <figref>688</figref> be considered, to generate the hints. Information about the media size can the media processing unit <figref>690</figref> made available be that, as the media data (eg. media files from video Audio, or video and audio, etc.) can provide. Similarly, the data communication unit <figref>692</figref> one or more data communications (Eg. Network) -protokolle for the exchange of such media data on the Data communication link <figref>686</figref> provide that in accordance with the instructions are packaged. As such, the Hinweiserzeugungs- and processing unit - based on Media format information through the media processing unit <figref>690</figref> to disposal will be provided, and data communication protocol information, by the data communication unit <figref>692</figref> made available be - right Hints and packetization of media and / or the instructions for transfer to a receiving digital processing system, such as the client data processing system <figref>682</figref>. determine. In one embodiment, is the stream-like transfer the media and information in accordance with the QuickTime format performed.

0118In Response to media data and hint packets, the data communication connection via <figref>686</figref> receive be, can the client data processing system <figref>682</figref> on Media object present, which is represented by the media data. Such presentation can be described transitory performed above. In one embodiment, the invention can the media data optional legally by the client data processing system <figref>682</figref> saved be and, for example, at a later time for the presentation and / transmission by the client data processing system <figref>682</figref> again are assembled.

0119<figref idrefs="S98">9</figref> is a block diagram of a system that uses the hints to media data according to one embodiment the invention to be transferred. Specifically, <figref idrefs="S98">9</figref> An embodiment of the invention, wherein a separate digital processing system as a generator is called, hints (or hint tracks) can produce to to deliver them to another system, such as to a server, the the evidence used to media data for transmission to a different system such as a client computer system to package. In<figref idrefs="S98">9</figref> becomes a system <figref>696</figref> shown that a server <figref>700</figref> including that Data about the data communication link <figref>686</figref> with the client data processing system <figref>682</figref> change can. However, the server creates in the in<figref idrefs="S98">9</figref> shown embodiment not the notes. But rather; a generator<figref>710</figref>. of the server <figref>700</figref> through a data communication link <figref>708</figref> coupled is closed a reference generation unit <figref>712</figref> a to generate hints that are used to packetize media data.

0120In one embodiment is the operation of the system <figref>696</figref> as follows: The server <figref>700</figref> power a request or inquiry to the generator <figref>710</figref>, around Information for to generate more media files one or the media data contain. For example, the media files in the server <figref>700</figref> on a machine-readable Medium are stored. The request may include information to the format of the media file and / or a data communications protocol to transfer of the media data and / or other / s data display. The data communication protocol can access the data communication link <figref>686</figref> based be, which in one embodiment, of the invention may be associated with a network connection, the particular has physical and logical characteristics to facilitate the exchange of media and / or other data between the server <figref>700</figref> and said client data processing system <figref>682</figref> simplify. In response to the request the information generation unit <figref>712</figref> fitting Notes, which are associated with a time-related hint track can, and provides the instructions to the server <figref>700</figref>, In response on the clues from the generator <figref>710</figref> about the Data communication link <figref>708</figref> be received, used the server <figref>700</figref> and in particular a reference processing unit <figref>702</figref> the Pointers to the media data for transmission to the client processing system <figref>682</figref> to packetized.

0121In Response to media data and hint packets, the data communication connection via <figref>686</figref> receive be, can the client data processing system <figref>682</figref> on Media object present, which is represented by the media data. Such presentation can be described transitory performed above. In one embodiment, the invention can optionally the media data by the client data processing system <figref>682</figref> saved be and, for example, at a later time for the presentation and / or transmission by the client data processing system <figref>682</figref> again are assembled.

0122<figref idrefs="S99">10</figref> is a flow diagram, a method for generating hints for providing media data transmission according to a embodiment the invention will be explained. In step <figref>720</figref> a media format for media data is determined, the transferred to are, if more than one format will be used. If only one Format is used, need step <figref>720</figref> not running to be. In step <figref>722</figref> or will be a suitable or appropriate Data communication protocol or protocols determined, again it is believed that more than one (protocol) may be used can. In step<figref>724</figref>, Based on the media size and the or the Datenkommunikationsprotkoll or protocols (where one or have been selected by this / configured both can), notes (eg., hint tracks), the Me aserving data transmission concern, created and stored.

0123In step <figref>726</figref>Which is optional, the messages may appear another transmit digital processing system will. In one embodiment, of the invention may, for example, the method of <figref idrefs="S99">10</figref>. at least in part, exclusively through a digital processing system (. A server for example) carried out will. In an alternative embodiment, for example the method of <figref idrefs="S99">10</figref>, At least in part, by two or more digital processing systems are performed. For example, Attributes of media data by a server or other system for a other digital processing system, such as for a Generator, available be provided. In response, the generator, based on attributes, a suitable or appropriate media format, data communication protocol or protocols and instructions for packetizing media data determine which can be stored on the server. Alternatively, the server the appropriate media format and a protocol or protocols to the generator to disposal filters, which then could produce evidence. The generator can transmit instructions to the server or to another digital processing system, which media data according to the instructions could packetized.

0124<figref idrefs="S100">11</figref> is a flow chart illustrating a method the processing of media data explained by a receiving system in accordance with requirements set out in a embodiment the invention will be received. In step<figref>730</figref> are media data, under a transmitted reception system in accordance with hints or hint tracks are received by the receiving system. In one embodiment, may the receiving system packetized media data as well as packetized receive hint tracks. The hint tracks, in one embodiment the invention will be linked with at least portions of the media data. Such data may are received by the receiving system in response to a request, the can be made by the receiving system. For example, in one embodiment, the receiving system may be a client computer system and the request can to a server or other digital processing system for the Media data is made. In response, the server may contain references to generate packetizing the media data (or they separate by a can generate digital processing system) and the packetized Media data, which may include instructions, transmitted to the receiving system.

0125In step <figref>732</figref> is a media object represented by the media data is represented, which are received by the receiving system, presented by the receiving system. For example, Include the media data video, audio, or a combination thereof, by the receiving system, for example on a display, and a be speaker or speakers "presented". As mentioned above, the Media data to be linked to a QuickTime movie.

0126Optional can the media data in step <figref>734</figref> may include indications by the receiving system are saved as media file or files. Thus needs in alternative embodiments of the invention step <figref>732</figref> not be performed as the media data received, or can before, after or in parallel with step <figref>734</figref> be executed.

0127In step <figref>734</figref> can the media file stored optional legally be reassembled and / or presented. As such can step <figref>732</figref> subsequent to step <figref>734</figref> be performed.

0128<figref idrefs="S101">12</figref> is an example of a machine readable storage medium, to digital by a processing system, such as a generator according to a embodiment the invention can be accessed. It is understood that the actual Memory that stores the elements shown in and below with reference to <figref idrefs="S101">12</figref> describes a or more elements such as one or more discs may be (which, for example, magnetic, optical, magnetic optical, may be, etc.), wherein the memory <figref>654</figref> and / or mass storage <figref>662</figref> above with reference to <figref idrefs="S96">7</figref> is described. furthermore in one embodiment, in which the generator, with which the machine readable storage medium, this in <figref idrefs="S101">12</figref> is shown, linked, a network computer, one or more of the elements of the machine-readable storage medium stored on another digital processing system can be and on the generator may be downloaded. Furthermore, the elements, the described with reference to the machine readable storage medium be, at any point on or in a non-volatile Mass Storage (eg. A disk) are stored. Vice versa can the elements of the machine storage medium at different times between different memory areas or regions, are scattered like DRAM, SRAM, disk, etc.

0129<figref idrefs="S101">12</figref> shows a machine-readable storage medium <figref>740</figref>, In one embodiment, is used, the machine readable storage medium, at least to one part, by a digital processing system, the notes generated or hint tracks, i.e., a generator in accordance with one or more methods of the invention. The generator, as described with reference to <figref idrefs="S97">8</figref> described, in a digital processing system be integrated, transmits the media data according to the hint tracks, or , as described with reference to <figref idrefs="S98">9</figref> described, be a digital processing system to the Notes to another digital processing system, such as to a server, creates and delivers, that exploits the clues to the media data to package and transmit.

0130As in <figref idrefs="S101">12</figref> shown includes the computer readable storage medium <figref>740</figref> typically a number a of elements. For example, the machine readable includes storage medium <figref>740</figref> Software for providing operating system functionality to the A generator, such as by a generator operating system (OS) <figref>742</figref> shown. A network transmission routine or routines <figref>748</figref> provide data communication functionality, such Example routines, protocols, etc., to allow the generator, that he data the data communication link transmits and receives.

0131Additionally includes the machine readable storage medium <figref>740</figref> Routines and data for creation of Instructions, which are linked to a media transfer. As such, the machine readable storage medium <figref>740</figref> optional legally informations <figref>750</figref> Include, supply information, the and on one or more data communication protocols Media formats, since the latter for a creation of hints by a hint creation routine or routines <figref>744</figref> may be necessary. For example, the information <figref>750</figref> Include information, to QuickTime movies RTP, MPEG, etc. relate. However, such information, at least in part, in the pointer creation routine <figref>744</figref> integrated and / or may the generator by a remote digital processing system disposal be provided.

0132the Notes that routines by the Notice Creation routine or <figref>744</figref> generated will have the created and / or stored elsewhere / transmitted Notes <figref>746</figref> saved (eg. at a remote digital processing device, which may be a server). The hints are hint tracks, which time-based for a Pake orientation and transfer are of media data, which is also time-related (eg. video, Audio, video and audio, etc.).

0133Although The machine readable storage medium <figref>740</figref> in reference to is described on a generator, the medium <figref>740</figref>. at least in part, a part of a number of types of digital Processing systems, data storage media, etc. be. For example , the machine-readable storage medium <figref>740</figref>, at least digital to one part, as a part of a server or other Processing system be included. Furthermore, the machine-readable storage medium <figref>740</figref>, At least in part, as a part of a Softwarenutzprogramms on one or more disks or other machine-readable media may be included.

0134<figref idrefs="S101">13</figref> is an example of a machine-readable storage medium, to digital by a processing system, such as a server according to a embodiment the invention can be accessed. It is understood that the actual Memory that stores the elements with reference to <figref idrefs="S101">13</figref> are shown and described below , Can be one or more or different elements or can, such as one or more disks (which, for example, magnetic, optical, magneto-optical, etc. may be), wherein the memory <figref>654</figref> and / or mass storage <figref>662</figref> above with reference to <figref idrefs="S96">7</figref> is described. furthermore can in one embodiment, where the server, with which the in <figref idrefs="S101">13</figref> shown machine readable storage medium is associated with, a network computer is one or more of the elements of the machine readable storage medium be stored on another digital processing system and are loaded on the server down. Furthermore, the Elements with reference to the machine readable storage medium are described, at some point in a non-volatile Mass Storage (eg. A disk) are stored. Vice versa can at other times, the elements of the machine storage medium between different storage areas, such as DRAM, SRAM, Disc, etc. scattered.

0135<figref idrefs="S101">13</figref> shows a machine-readable storage medium <figref>760</figref>, In one embodiment, The machine readable storage medium is utilized, at least a part to media data for transmission on a data communication link in accordance with one or more method / n to package of the invention. The machine readable storage medium may be a server, such as For example, the server <figref>694</figref> are linked, the referring on <figref idrefs="S97">8</figref> is described to include routines to downoriented tracks to create and transmit media data according to the hint tracks. In another embodiment, , the machine-readable storage medium <figref>760</figref> with a digital processing system such as the server <figref>700</figref> be linked the reference to <figref idrefs="S98">9</figref> is described in which a digital processing system, such as a generator, Routines including, Notes to create, and the server - by the evidence, as processed by routines by the machine readable storage medium <figref>760</figref> to disposal will be provided, used - can Media data packetized and transmitted.

0136The machine readable storage medium <figref>760</figref> includes a A number of elements. For example, the machine-readable storage medium <figref>760</figref> Software including for providing operating system functionality to the Server, such as by a server operating system (OS) <figref>762</figref> shown. A network transmission routine or routines <figref>768</figref> provides or provide a data communication functionality, such Example routines, protocols, etc., to allow the server, that he data a data communication link transmits and receives.

0137Additionally includes the machine readable storage medium <figref>760</figref> a Medienpaketierungsroutine <figref>770</figref> on for packetizing media data, which may be time-related, the based on hints, and which may also be packetized. Accordingly closes, the machine readable storage medium <figref>760</figref> a media data storage area <figref>764</figref> on and a note storage area <figref>766</figref>. to store media data (which, for example, QuickTime movies may be or other media tracks) or instructions (eg., hint tracks) accordingly. These notes can hint tracks lock in, the packaging and the transfer of Media data are time-based, which typically also time-related (eg. video, audio, video and audio). In one embodiment, the instructions are packaged separately from the media data packets. In one embodiment, conclude Notes pointer information identifying media data (Eg. A special or single package or individual packages (which may be in a separate media file.

0138<figref idrefs="S102">14</figref> is an example of a machine-readable storage medium, to digital by a processing system, such as a receiving system or other digital processing system according to a embodiment the invention can be accessed. It is understood that the actual memory, that stores the elements shown in and subsequently with reference to <figref idrefs="S102">14</figref> describes a or may be several elements, such as one or more Discs (which, for example, magnetic, optical, magneto-optical, etc. can), wherein the memory <figref>654</figref> and / or mass storage <figref>662</figref> among with reference to <figref idrefs="S96">7</figref> to be discribed. furthermore An embodiment is wherein the receiving system, with which the machine readable storage medium, this in <figref idrefs="S102">14</figref> is shown, is associated, a network computer, wherein one or more of the elements the machine-readable storage medium on another digital Processing system and stored on the receiving system can be downloaded. Furthermore, the elements with reference to the machine readable storage medium will be described, at some point in or on a non-volatile Mass Storage (eg. A disk) are stored. Vice versa can the elements of the machine readable storage medium at different times between different storage areas or regions such For DRAM, SRAM, etc. be scattered.

0139<figref idrefs="S102">14</figref> shows a machine-readable storage medium <figref>780</figref>, In one embodiment, , the machine readable storage medium, at least in part used to process media data in accordance with a or more methods of the invention are packaged. The machine-readable storage medium <figref>780</figref> can with a receiving system, such For a client- data processing system <figref>682</figref> be linked the reference to <figref idrefs="S97">8</figref> and <figref idrefs="S98">9</figref> described is to include routines, to present media data, under instructions be transmitted / received. Alternatively, the machine readable storage medium <figref>780</figref> Include media data Notes (eg., Hint tracks), which are embedded therein. Such embedded media data may be prepackaged or a routine to be produced which, on a machine readable storage medium such as the machine readable storage medium <figref>780</figref>. is stored.

0140The machine readable storage medium <figref>780</figref> can to a number Include elements. For example closes The machine readable storage medium <figref>780</figref> software for providing operating system functionality to the Empfangssys tem, such as by a server operating system (OS) <figref>772</figref> illustrated is. A network transmission routine or routines <figref>782</figref> provide a data communication functionality, such Example routines, protocols, etc., to allow the server, that he data a data communication link transmits and receives.

0141Additionally includes the machine readable storage medium <figref>780</figref> a media presentation routine <figref>778</figref> on for presenting media data, in accordance with instructions are packaged. Thus, the machine readable storage medium<figref>780</figref>. and in particular, the media presentation routine <figref>778</figref> routines decompression of audio and / or video data to display Video, and / or playing audio, etc. Include. furthermore , the media presentation routine <figref>778</figref> typically treatment of evidence available that the media data connected are. In one embodiment, are the notes ignore how or when the media presents will.

0142Optional enough, , the machine readable storage medium <figref>780</figref> media data save that according clues as media data <figref>774</figref> have been packaged, and can be a media data reassembly routine <figref>776</figref> Include in order the stored media data (eg. to be presented or transmitted etc. to be) re-build together.

0143<figref idrefs="S103">15</figref> is a diagram of a data storage and / or -kommunikationsmediums, the according to an embodiment the invention stored thereon / transported media and Notice Information having. A data storage and / or -kommunikationsmedium (medium)<figref>800</figref> becomes shown that various types of transport and / or storage medium, represents in which a media data packet <figref>804</figref> and a Note package <figref>806</figref>Which according to the present invention are packaged, stored or trans could be ported. To the For example, the medium may <figref>800</figref> the mass storage <figref>662</figref> and or memory <figref>654</figref> constitute the reference above on <figref idrefs="S96">7</figref> is described. The medium<figref>800</figref> can as a communication medium such as the LAN bus <figref>612</figref> represent, the shown in <figref idrefs="S95">6</figref> is or may be the data communication link 686 for transporting data / signals, media and / or other represent information.

0144The Note package <figref>806</figref> and the media pack <figref>804</figref> can in a package to be integrated or are stored and / or separately be transported, as in <figref idrefs="S103">15</figref> illustrated is. Furthermore, the notice package<figref>806</figref> and the media pack <figref>804</figref> several or different format types embody, such as those which are described herein or one that, with other media formats Network protocols and / or a digital processing device architecture connected is.

0145Below some sample formats of references are provided. It is understood that the present invention but with various Types of network protocols, digital processing system architectures, Media formats, etc. can be recycled or used to transfer of time-related data to deliver.

0146While the Invention within the meaning of several or different embodiments and explanatory Figures has been described, the skilled artisan will recognize that does not limit the invention to the described embodiments and figures is. In particular, the invention in several alternative embodiments accomplished be that provide packetization of time related media.

Appendix A - Packaging-Note-sample description

0147In one embodiment of the present invention, each hint track a table with on pattern or Abtastwertbeschreibungen. exhibit hint tracks typically a pattern or Abtastwertbeschreibung on. The format for each Abtastwertbeschreibungseintrag for a hint track, according to a embodiment of the present invention is described in Table 1 below.

Table: 1 Hinweisspurabtastwertbeschreibungsformat <img img-content="tb" img-format="tif" he="50" wi="153" file="00530001.tif" />

0148The Paketierungshinweiskopfstückatom contains the following data elements:

0149the structure for the additional Data table entries is shown in Table 2 below.

table 2: Extra Data Table Format <img img-content="tb" img-format="tif" he="29" wi="152" file="00540002.tif" />

0150the additional Data table entries contain the following data elements:

0151the following data tags may for many various types are defined to data format types. Other indicator can be created as needed.

0152the following data format types are defined. New types as needed To be defined.

0153The The following data tag is utilized in an embodiment for, rtp' data.

0154the following data tags are optional for, rtp' data.

Appendix B - Example hint track for RTP

0155This section presents an example of a hint track format for stream-like transfer RTP from a QuickTime movie.

0156at Standard RTP, each media data stream as a typically separate RTP stream sent. Multiplexing is generally achieved, by multiplexing the IP port level is used, not by the data of multiple data streams in a single RTP session be interposed or interleaved. Therefore, should any have media track in the movie a linked RTP hint track. In one embodiment, includes the present invention each hint track a track reference back to the media track which it transmits data stream like.

0157In This example sets the packet size to the Time determines to which the hint track is created. Therefore, in Abtastwertbeschreibung for Note the track (a data structure, which fields can contain, specifically to that coding 'are - which in this case, a protocol) shows the selected packet size. In one example of the present invention, various RTP hint tracks for each media track available asked to provide different packet size selections. Other protocols can are well parameterized. Similar is the appropriate time scale for the RTP clock in the following Abtastwertbeschreibung provided.

0158the Note Track refers to its base media track by a single Track reference declaration. (RTP allowed not a multiplexing Media within an individual RTP data stream). The Abtastwertbeschreibung for RTP declared the maximum packet size, which this hint track will generate. Sitzungsbeschreibungs- (SAP / SDP) - information are stored in the user data atoms in the track.

0159Each Sample in the RTP hint track contains the instructions to a Set of packets, which are transmitted at a given time have to, emit. The time in the hint track is a transmission time, not necessarily the media time of the linked media.

0160In the following description of the internal structure of samples, which media data, not meta data, in which the terminology This example will be described, they need not structured as objects to be.

0161In contains this example each sample two areas: the instructions to the packages to put together and any extra data that are needed, if those packets (eg. an encrypted version of the media data) be sent.

0162Each Note RTP packet contains the information to send a single packet. In one embodiment, is to separate media time of transmission time, an RTP timestamp specific legally included, along with data needed to form the RTP header. In alternative embodiments, however, this is not the case. Other header information is typically provided. A Table of construction entries is constructed as follows:

0163There There are various forms of the constructor. Each constructor has 16 bytes, which being repeated relatively easily. The first byte is a union discriminator:

0164Of the immediate mode allows insertion of payload-specific headpieces (Eg. The RTP H.261 header). For hint tracks, where the media is sent in the Pure ', the Medienabtastwerteintrag can specify the bytes to copy from the media track, by the sample number, data offset, and to copy length specified is. For relatively complex cases (Eg. Encryption or forward error correction) can the transformed data is placed in the Hinweisabtastwerte, and then a Hinweisabtastwertmodus can be used, which would come from the extra data field in the RTP sample itself.

0165In one embodiment of the present invention there is no requirement that successive Packets transmitted consecutive bytes from the media stream. For example, to conform to the RTP standard packaging H.261 adjust, in one example of the present invention, a byte at the end of a packet, and also at the beginning of the next (if a macroblock boundary in one byte falls into it) are sent.

Appendix C - Packaging of Hinweisabtastwertdaten for a data format rtp '

0166This Appendix provides a description of the sample data for the, rtp' format, according to a embodiment the invention. That rtp' format assumes that a server is sending data by a real-time transport protocol (RTP) is used. This format assumes that the server via RTP headers communication White, but it does not require that the server via a somehow specific media headpiece Knows, including Media head pieces, which are defined in various IETF drafts.

0167In one embodiment the present invention, each sample in the hint track generate one or more RTP packets. Each entry in the Abtastwertdatentabelle in a Hinweisspurabtastwert corresponds to a single RTP packet. Samples in the hint track may or may not with samples correspond in the media track. In one embodiment of the present Invention, the data in the byte-aligned Hinweisspurabtastwert, but not 32-bit aligned.

table 3 - Additional data <img img-content="tb" img-format="tif" he="50" wi="152" file="00610002.tif" />

0168In one embodiment contains the package record the following data elements:

0169The RTP header information field contains the following item:

0170The RTP header information field contains the following elements:

0171all unde fined Bits (0-1 and 4-7) are reserved and are set to zero.

0172Of the Place the defined bits are on the same bit place like in the RTP header.

table 4 - Data Table <img img-content="tb" img-format="tif" he="21" wi="153" file="00650001.tif" />

0173The Data Source box, the entry table indicates how the other 15 Bytes of the entry are to be interpreted. are values from 0 to 4 defined. The various data table formats are shown below defined. Although there are various schemes, the Posts in the various schemes typically 16 bytes long.

Non-operational data mode

0174Of the Data table entry has the following format for a non-operating mode on:

Immediate data mode

0175Of the Data table entry has the following format for the immediate mode:

Scanning or Abtastwertmodus

0176Of the Data table entry has the following format for the scanning or Abtastwertmodus on:

0177If the bytes per compression block and / or the samples per compression block greater than 1 are, then this ratio used a sample number into an actual byte offset into to translate. This ratio mode is typically used for compressed audio tracks in QuickTime movies used such that: <st32:df xmlns:st32="http://lighthouseip.com/">CB = NS · BPCB / SPCB</st32:df>wherein CB = Compressed bytes NS = number of samples BPCB = Bytes per compression block SPCB = samples per compression block

0178To the Example, a GSM compression block typically 160 samples, packed into 33 bytes into it. Therefore BPCB = 33 and SPCB = 160. The Hinweisabtastwert Calls 33 bytes of data that start at the 161-th Medienabtastwert. It is believed that the first QuickTime chunk least <figref>320</figref> samples contains, so, after it is determined that these data will come from chunk 1, and where chunks 1 starts, the ratio used to offset set in the file in where the requested samples found: Brocken_nummer = 1; / * Is calculated by dividing by the sample-to-chunk atom is * / erster_Abtastwert_in_diesem_Brocken = 1 / * is calculated as of this atom * / Brocken_Versatz = Brocken_Versätze [Brocken number]; / * From the STCO atom * / = Daten_Versatz (Abtastwert_nummer - first sample in_diesem_Brocken) * BPP / SPP gelesen_aus_Datei (Brocken_Versatz + Daten_Versatz, length); / * Read our data * /

Abtastwertbeschreibungsmodus

0179Of the Data table entry has the following format for a Abtastwertbeschreibungsmodus on:

Appendix D - Example hint track format for MPEG-2 transport

0180This section presents an example of a simple track format for stream-like transfer an MPEG-2 transport from a QuickTime movie, the elementary streams holds or contains.

0181On MPEG-2 transport stream is a multiplex of one or several elementary data streams connected. For this reason, describes an MPEG-2 transport hint track how such a multiplex is to construct one or more media tracks. There is it is not necessarily a one-to-one relationship between media tracks and MPEG-2 transport hint tracks. Each hint track can References to the elementary data streams included that it represents. In one example, the present invention could a QuickTime file contained multiple of such hint tracks, to be described by different multiplexes.

0182Package size is generally not a problem, since all MPEG-2 transport packets size of 188 have bytes. In one example of the present invention, each Transport packet (in the MPEG-2 transport protocol) payload data of a media track. this makes possible or considered a relatively simple Hinsetting description for each transport packet. In an example of the present invention, each describes such Notes which head data appear on each transport packet, and then points to the payload in the matching media track for the transport packet. For Packages which do not correspond with a media track, such Example PSI packets, the hint can 188 bytes of header data describe, and any media track reference may be irrelevant to be viewed as. For Packages that do not correspond with a media track, can the Header data information, such as transport headers, possible adaptation headers and PES headers for transport packets, beginning with PES packets, accountability and information give.

0183reference Referring to the MPEG-2 transport hint track in the Abtastwertbeschreibungsatom (the type stsd '). This atom includes a Abtastwertta belle, and distinguish the entries in this table be. based on the media type In one example, the present Invention begin hint tracks with a structure in Table 1 is shown. The additional Data table can Listings included having the structure shown in Table 2: one example of the present invention, when the hint track an MPEG-2 transport hint track is, the data format in the Hinweisspurabtastwertbeschreibungseintrag , M2t be 'and the Maximum packet size always be 188. In such a description entry can Types that are described under standing in Tables 5 to 7, in the additional Data table are found:

table 6 -, otyp' values in the additional data Table <img img-content="tb" img-format="tif" he="7" wi="153" file="00720002.tif" />

table 7 - Format of entries in the additional , Tmap 'data entry <img img-content="tb" img-format="tif" he="28" wi="153" file="00730002.tif" />

0184In one embodiment the present invention describes each Hinweisabtastwert a Transport Package. Each transport packet can be used as some amount of header data describes that by some amount of payload of a Media track is traced. Since MPEG-2 transport packets relatively small are a large Number generated by Hinweisabtastwerten, and thus should these samples preferably be as small as possible. Various items in the additional Data table above can be used be to increase the size of the samples minimize, but such factors, some of the fields in the Abtastwerteinträgen variable in size do.

0185If of, otyp' listing in the data table has a value of 0, indicating that payload data be described in terms of Medienabtastwerten can Hinweisabtastwerte in the following form to be shown in Table 8:

table 8 - Hinweisabtastwertformat, uses the Medienabtastwertreferenzen <img img-content="tb" img-format="tif" he="14" wi="154" file="00730003.tif" />

0186In one example of the present invention, it is not necessary that length of Payload data for indicate the package as this length MPEG-2 is equal to 188 minus the size of the header for the package is.

0187If of, otyp' listing in the data table has the value 1, indicating that payload data within the meaning of Dateiversätzen be described, Hinweisabtastwerte be of the following form shown in Table 9 will be shown:

0188On one example of the present invention, describe Hinweisabtastwerte their offsets within the meaning of Medienabtastwerten within the meaning of Dateiversätzen. Each of these has advantages and disadvantages. If Hinweisabtastwerte specify payload within the meaning of Medienabtastwerten, they can for additional Edit the file containing the media track, be elastic, but they can additional making process required for delivery. If Hinweisabtastwerte Payload within the meaning of Dateiversätzen specify Can Respond to the payload data relatively easily accessed be, but any editing the file containing the media track, can the notes invalid do.

Appendix D - A sample file

0189Below to disposal provided is a relatively short (six frame) or Abtastwerte- Pattern file, in which some of the relatively less important fields and Objects are omitted (here by enclosing quotes "..." marking) and with some fictitious numbers to the overall structure of a file, which is ready for a stream-like transmission over RTP, according to a embodiment to explain the present invention. The media data are been omitted; only the meta-data is shown.

93 members in 10 offices

This recordMember, by publication datePriority claim

Priority claims6

Priority claims
Document	Office	Kind	Date
7156698	United States of America	–	1998-01-15
7156698	United States of America	P	1998-01-15
14017398	United States of America	–	1998-08-25
14017398	United States of America	A	1998-08-25
9900954	United States of America	–	1999-01-13
9900954	United States of America	W	1999-01-13

Members93

Family members, oldest first
Document	Office	Kind
CA2316852A1	Canada	A1	1999-07-22
CA2318963A1	Canada	A1	1999-07-22
CA2325828A1	Canada	A1	1999-07-22
WO9937056A2	World Intellectual Property Organization (WIPO)	A2	1999-07-22
WO9937056A2	World Intellectual Property Organization (WIPO)	A2	1999-07-22
WO9937057A2	World Intellectual Property Organization (WIPO)	A2	1999-07-22
WO9937057A2	World Intellectual Property Organization (WIPO)	A2	1999-07-22
WO9937072A2	World Intellectual Property Organization (WIPO)	A2	1999-07-22
AU2232799A	Australia	A	1999-08-02
AU2232899A	Australia	A	1999-08-02
AU2322499A	Australia	A	1999-08-02
AU2322499A	Australia	A	1999-08-02
WO9937057A3	World Intellectual Property Organization (WIPO)	A3	1999-09-16
WO9937057A3	World Intellectual Property Organization (WIPO)	A3	1999-09-16
WO9937072A3	World Intellectual Property Organization (WIPO)	A3	1999-09-16
WO9937056A3	World Intellectual Property Organization (WIPO)	A3	1999-09-30
WO9937056A3	World Intellectual Property Organization (WIPO)	A3	1999-09-30
WO9937056A9	World Intellectual Property Organization (WIPO)	A9	1999-11-04
WO9937056A9	World Intellectual Property Organization (WIPO)	A9	1999-11-04
US6134243A	United States of America	A	2000-10-17
AU5501800A	Australia	A	2000-11-02
EP1048156A2	European Patent Office (EPO)	A2	2000-11-02
EP1051008A2	European Patent Office (EPO)	A2	2000-11-08
EP1062782A2	European Patent Office (EPO)	A2	2000-12-27
CN1290444A	China	A	2001-04-04
CN1290445A	China	A	2001-04-04
KR20010034224A	Republic of Korea	A	2001-04-25
KR20010034224A	Republic of Korea	A	2001-04-25
KR20010052144A	Republic of Korea	A	2001-06-25
KR20010052144A	Republic of Korea	A	2001-06-25
KR20010052145A	Republic of Korea	A	2001-06-25
KR20010052145A	Republic of Korea	A	2001-06-25
CN1308437A	China	A	2001-08-15
HK1035277A1	Hong Kong, China	A1	2001-11-16
HK1035278A1	Hong Kong, China	A1	2001-11-16
JP2002510165A	Japan	A	2002-04-02
KR100339629B1	Republic of Korea	B1	2002-06-21
KR100339629B1	Republic of Korea	B1	2002-06-21
US6453355B1	United States of America	B1	2002-09-17
AU755830B2	Australia	B2	2002-12-19
US6512778B1	United States of America	B1	2003-01-28
AU758220B2	Australia	B2	2003-03-20
AU758248B2	Australia	B2	2003-03-20
US2003131117A1	United States of America	A1	2003-07-10
JP2003526227A	Japan	A	2003-09-02
US2003204555A1	United States of America	A1	2003-10-30
US6714984B2	United States of America	B2	2004-03-30
US6717952B2	United States of America	B2	2004-04-06
KR100431110B1	Republic of Korea	B1	2004-05-12
US6744763B1	United States of America	B1	2004-06-01
CN1166142C	China	C	2004-09-08
CN1166143C	China	C	2004-09-08
US2004205224A1	United States of America	A1	2004-10-14
US6829648B1	United States of America	B1	2004-12-07
EP1051008A3	European Patent Office (EPO)	A3	2004-12-08
EP1062782B1	European Patent Office (EPO)	B1	2005-05-11
DE69925254D1	Germany	D1	2005-06-16
DE69925254T2This record	Germany	T2	2006-03-16
AU2003204871B2	Australia	B2	2006-06-22
AU2003204872B2	Australia	B2	2006-06-22
AU2003204873B2	Australia	B2	2006-06-22
KR100607784B1	Republic of Korea	B1	2006-08-03
KR100607784B1	Republic of Korea	B1	2006-08-03
EP1051008B1	European Patent Office (EPO)	B1	2006-09-20
DE69933281D1	Germany	D1	2006-11-02
US2007067477A1	United States of America	A1	2007-03-22
DE69933281T2	Germany	T2	2007-05-10
CA2325828C	Canada	C	2007-07-10
EP1048156B1	European Patent Office (EPO)	B1	2007-07-18
EP1819127A2	European Patent Office (EPO)	A2	2007-08-15
EP1819128A2	European Patent Office (EPO)	A2	2007-08-15
EP1819129A2	European Patent Office (EPO)	A2	2007-08-15
DE69936570D1	Germany	D1	2007-08-30
DE69936570T2	Germany	T2	2008-04-10
US7366788B2	United States of America	B2	2008-04-29
JP4282232B2	Japan	B2	2009-06-17
JP2009225458A	Japan	A	2009-10-01
JP2009246991A	Japan	A	2009-10-22
EP1819127A3	European Patent Office (EPO)	A3	2009-10-28
EP1819129A3	European Patent Office (EPO)	A3	2009-10-28
EP1819128A3	European Patent Office (EPO)	A3	2009-11-04
US7747765B2	United States of America	B2	2010-06-29
US2010262713A1	United States of America	A1	2010-10-14
EP1819128B1	European Patent Office (EPO)	B1	2011-06-22
EP1819129B1	European Patent Office (EPO)	B1	2011-07-27
EP1819127B1	European Patent Office (EPO)	B1	2011-09-07
US8028080B2	United States of America	B2	2011-09-27
JP4891364B2	Japan	B2	2012-03-07
US2012066342A1	United States of America	A1	2012-03-15
CA2318963C	Canada	C	2012-03-20
US8271670B2	United States of America	B2	2012-09-18
JP5081868B2	Japan	B2	2012-11-28
CA2316852C	Canada	C	2014-01-07

2 legal events, as the office reported them to INPADOC

Over the term

Point at a mark for the event

Events

Legal events, newest first
	Event	Code
2009-06-25	Change in the person/name/address of the patent owner8327	8327
2006-06-08	No opposition during term of oppositionOpposition8364	8364