DECODER STRUCTURE FOR OPTIMIZED CONTROL OF ERRORS PROCESSING IN MULTIMEDIA DATA STEAMING<tab>

(19) and A (11) 92004 (13) C2

(51) IPC (2009)

H04N 7/64

UKRAINE

MINISTRY OF EDUCATION SCIENCE OF UKRAINE

STATE DEPARTMENT OF INTELLECTUAL PROPERTY

DESCRIPTION

TO THE INVENTORY PATENT

(54) DOCTOR STRUCTURE FOR OPTIMIZED MANAGEMENT FOR PROCESSING ERRORS IN THE TRANSMISSION OF MULTIMEDIA DATA

1

(21) a200711132

(22) 10.03.2006

(24) 27.09.2010

(86) PCT / and32006 / 008763, 10.03.2006

(31) 60 / 660,681

(32) 10.03.2005

(33) from

(31) 60 / 660,867

(32) 10.03.2005

(33) from

(31) 60 / 660,923

(32) 10.03.2005

(33) from

(46) September 27, 2010, No. 18, 2010

(72) RAVININDRAN VJJAYAAKAKHMI R., FROM, SHIFAN, FROM, OGUZ SEIFULLAH HALIT, FROM, SETHISumit Singh, from

(73) kveklkomom incorporated, from

(56) out of 6530055 В1; 04.03.2003

(57) 1. A multi-level integration method for use in troubleshooting, comprising the steps of:

detect by means of a multimedia device a multitude of errors in the multimedia data, based on the protocol of the level of communication; identify the detected errors as non-correct protocol of the level of communication;

determine the distribution of detected error errors, based on the synchronization level protocol, determine the set of marked errors in the error generation, based on the protocol synchronization level,

insert a set of labeled errors into one or more multimedia packets by the help of the synchronization level protocol; mask detected errors in multimedia data, based on application-level protocol, using a set of labeled errors.

2. The method of claim 1, wherein the level of communication comprises either one, or a combination of physical layer, MAC level and transport layer.

3. The method of claim 1, wherein the identification step for detected errors comprises a step on which the distribution of detected errors is limited.

4. Device for multi-level integration for use in troubleshooting, containing:

2

a means for detecting a plurality of errors in multi-media data, based on the protocol communications interface;

A tool for identifying identified errors as non-

Corrective communication protocol;

means for detecting error detection of detect-

based on the protocol of the level

synchronization

a means for determining the set of labeled errors in the distribution of errors, based on the protocol level synchronization,

a means for inserting a set of labeled errors into one or more multimedia data packets using a synchronization level protocol; A tool for masking detected errors in multi-media data, based on the protocols at the level level, using a variety of mistakes.

5. The apparatus of claim 4, wherein the level of communication comprises either one or a combination of physical layer, MAC level and transport layer.

6. The apparatus of claim 4, wherein the identification means comprises a means for limiting the spread of detected errors.

7. Device for multi-level integration for use in troubleshooting, containing: a sensor for detecting a plurality of errors in multimode data, based on protocol communications;

identifier for identifying identified packs as non-conforming communication protocol protocol; identifier for:

Definition of the error distribution of the detected mi-loops, based on the protocol of the level of synchronization,

the determination of the set of marked errors in the error handling, based on the synchronization level protocol, and

inserting a set of labeled errors into one more multimedia packet with the help of a synchronization level protocol; idle masking to mask detected errors in the multimedia data, based on application-level protocols, using a number of labeled errors.

iA (11) 92004 (13) C2

σ&gt;

92004

3

8. The apparatus of claim 7, wherein the level of communication comprises either one or a combination of physical layer, MAC level and transport layer.

9. The device of claim 7, wherein the identifier restricts the distribution of detected errors.

10. Processor for multi-level integration for use in the elimination of errors, whileprocessor executed with the ability:

detecting the set of errors in multimedia data, based on communications protocol level; identify identified errors as incorrect protocol communication level;

Definition of the error distribution of the detected mi-loops, based on the protocol of the level of synchronization,

determination of the set of marked errors in the error handling, based on the protocol of the synchronization level,

inserting a set of labeled errors into one more multimedia packet with the help of a synchronization level protocol; masking the errors found in multimedia data, based on the application protocol protocol, using a set of labeled errors.

11. The processor of claim 10, wherein the communications layer comprises either one or a combination of the physical layer, the MAC level and the transport layer.

12. The processor of claim 10, which is also configured to restrict the spread of detected errors.

13. Readable computer media to implement a multi-level integration method, for use in the elimination of errors, containing the stages in which:

detect with a multimedia device a multitude of errors in multimedia data, based on communications protocol level; identify identified errors as non-correct protocol of the level of communication;

determine the distribution of detected error errors, based on the synchronization level protocol, determine the set of marked errors in the error generation, based on the protocol synchronization level,

insert a set of labeled errors into one or more multimedia packets by the help of the synchronization level protocol; mask detected errors in multimedia data, based on application-level protocol, using a set of labeled errors.

14. The carrier of claim 13, wherein the level of communication comprises either one or a combination of physical layer, MAC level and transport layer.

15. The carrier of claim 13, wherein the identification step for detected errors comprises a step on which the distribution of detected errors is limited.

16. The method of multi-level integration for use in the elimination of errors, containing the stages, in which:

detect by means of a multimedia device a multitude of errors in the multimedia data, based on the protocol of the level of communication; identify the detected errors as non-correct protocol of the level of communication;

determine the distribution of detected error errors based on the protocol of the synchronization level,

4

determine the set of marked errors in the error handling, based on the synchronization level protocol, and

mask detected errors in multimedia data, based on application-level protocol, using a set of labeled errors.

17. A multi-level integration device for use in troubleshooting, comprising: a means for detecting a plurality of errors in multi-media data, based on protocol communications;

A tool for identifying identified errors as non-

Corrective communication protocol;

means for detecting error detection of detect-

based on the protocol of the level

synchronization

a means for determining the set of labeled errors in the distribution of errors, based on the protocol level synchronization, and

A tool to mask detected errors in multi-media data, based on an application-level protocol, using a variety of malicious errors.

18. A multi-level integration device for use in troubleshooting, comprising: a sensor for detecting a plurality of errors in multi-media data, based on protocol communications;

identifier for identifying identified packs as non-conforming communication protocol protocol; identifier for:

Definition of the error distribution of the detected mi-loops, based on the protocol of the level of synchronization, and

the determination of the set of marked errors in the error handling, based on the protocol of the synchronization level; and

masking unit to mask detected errors in the multimedia data, based on application-level protocols, using a number of labeled errors.

19. Processor for multi-level integration for use in the elimination of errors, whileprocessor executed with the ability:

detecting the set of errors in multimedia data, based on communications protocol level; identify identified errors as incorrect protocol communication level;

definition of the distribution of errors detected on the bridge, based on the protocol of the level of synchronization;

the determination of the set of marked errors in the error handling, based on the protocol of the synchronization level; and

masking detected errors in multimedia data, based on the application protocol protocol, using a set of labeled errors.

20. Computer-readable medium to implement a multi-level integration method for use in eliminating errors, containing the stages on which:

detect with a multimedia device a multitude of errors in multimedia data, based on communications protocol level; identify identified errors as non-correct protocol of the level of communication;

92004

5

determine the distribution of detected error errors, based on the synchronization level protocol, determine the set of error bugs noted on the basis of the synchronization level protocol, and

mask detected errors in multimedia data, based on application-level protocol, using a set of labeled errors.

A method for using multimedia data processing comprising the steps of: receiving in the multimedia device identification of the plurality of errors in encoded multimedia data that is incorrect communication level, while the error identification contains a plurality of observed errors , inserted in one or more packets of encoded multimedia data, and many-tagged errors are determined from the distribution errors;

perform the elimination of encoded multi-media data errors using the accepted identification of errors at the application level in the multimodetic device; and

support the scalability of encoded multi-media data at the application level in the multi-media device.

22. The method of claim 21, wherein the scalability includes either a spatial or temporal load, or a combination thereof.

23. The method of claim 21, wherein the step of eliminating the errors contains either a stage of time masking errors, or a stage of spatial masking errors, or stage of frame rate transformation, or a combination of these stages.

24. Device for use in multidimensional data processing comprising:

a means for receiving the identification of a plurality of errors encoded by multimedia data that is an incorrect communication level, the identification of an error comprising a plurality of labeled errors inserted into one or more packets of encoded multimedia data, and the set of labeled packs are determined from the error distribution;

a means to perform the elimination of encoded errors in multimedia data, using the accepted identification of errors at the application level in the multimedia device; and

a tool for maintaining the scalability of encoded multimedia data at the application level.

25. A device according to claim 24, wherein the scalability may be either spatial, or temporal, or probationary, or both.

26. The apparatus of claim 24, wherein the step of removing the pillboxes comprises either a step of time masking the pillbox, or a stage of spatial masking errors, either the stage of the frame rate transformation, or the combination of these phases.

27. Device for use in multidimensional data processing, comprising:

the receiving component for receiving identification of a plurality of errors in encoded multimedia data that is an incorrect communication level, in which this error identification contains a plural of noticed errors inserted into one or more packets of encoded multimedia data, and the multiple-noted errors are determined from the distribution errors;

6

an error correction component for performing encoded multimedia data error correction, using the adopted error identification to the application layer in the multimedia device; and

a component of scalability support for sub-scaling coded multimedia data at the application level.

28. The device of claim 27, wherein the scalability may be either spatial or temporal, or both.

29. The apparatus of claim 27, wherein the step of removing the pillboxes comprises either a step of time masking the pillbox, or a stage of spatial masking errors, either the stage of frame rate transformation, or the combination of these phases.

30. The processor used to handle the multimedia data is made with the ability: to receive the identification of a plurality of errors in code-based multimedia data that are incorrectly the level of communication, while the error identification contains the set of labeled errors inserted in one or more multimedia packets encoded- their data, and the set of marked errors is determined by the distribution of errors;

Performing the elimination of encoded multi-media data errors using the accepted identification of errors at the application level in the multimode device; and

support the scaling of encoded multi-media data at the application level.

31. The processor of claim 30, wherein the scalability may be either spatial or temporal, or both.

32. The processor of claim 30, wherein the step of disposing in a soap comprises either a stage of time masking in a soap, or a stage of spatial masking of pillocks, or a stage of frame rate transformation, or a combination of these steps.

33. A computer readable medium for implementing a means for using multimedia data processing comprising the steps of: receiving in the multimedia device an identification of the plurality of errors in encoded multimedia data that are incorrect in the level of communication when this error identification contains a plurality of marked errors enclosed in one or more packets of encoded multimedia data, and many-noted bugs are determined from the distribution errors;

perform the elimination of encoded multi-media data errors using the accepted identification of errors at the application level in the multimodetic device; and

support the scalability of encoded multi-media data at the application level.

34. The carrier of claim 33, wherein scalability may be either spatial or temporal scalability, or both.

35. The carrier of claim 33, wherein the step of eliminating the errors contains either a stage of time masking errors, or a stage of spatial masking errors, or stage of frame rate transformation, or a combination of these stages.

36. A method for use in the processing of a cache of media, comprising the steps of:

92004

7

take multimedia streams of encoded multimedia data in a multimedia device; detect a plurality of errors in a plurality of streams of legitimate multimedia data, based on communication protocols;

identify identified errors as non-correct protocol of the level of communication;

determine the distribution of detected error errors based on the protocol of the synchronization level; determine the set of marked errors in error generation, based on the protocol of the level of synchronization;

insert a set of labeled errors in one more multimedia packets with the help of the protocol of the synchronization level; perform the elimination of errors using a variety of errors noted, based on the pro-tokol of the applied level; and

Recover multimedia data from a plurality of threads based on application-level protocol.

37. The method of claim 36, wherein the step of eliminating the errors contains either a stage of time masking errors, or a stage of spatial masking errors, or stage of frame rate transformation, or a combination of these stages.

38. A device for use in processing a cache of media data comprising:

a means for receiving a plurality of streams of encoded multimedia data;

means for detecting a plurality of errors in the plurality of streams of encoded multimedia data, based on the communication protocol;

A tool for identifying identified errors as non-

Corrective communication protocol;

means for detecting error detection of detect-

based on the protocol of the level

synchronization;

a means for determining the set of labeled errors in the distribution of errors, based on the protocol level synchronization;

means for inserting a plurality of marked errors into one or more multimedia data packets using a synchronization level protocol; a means for performing error correction, using a set of marked errors, based on the protocol of the application layer; and

means for restoring multimedia data of a plurality of flows, based on the protocol of the level level.

39. The device of claim 38, wherein the elimination of errors contains or time-based error masking, or pro-trick masking errors, or transformationfrequencies of frames, or a combination thereof.

40. A device for use in processing a cache of media data comprising:

a receiver for receiving a plurality of streams of coded multimedia data;

a sensor for detecting a plurality of errors in the plurality of streams of encoded multimedia data, based on the communication protocol;

identifier for identifying identified packs as non-conforming communication protocol protocol; identifier for:

Definition of the error distribution of the detected mi-loops, based on the protocol of the level of synchronization,

8

the determination of the set of marked errors in the error handling, based on the synchronization level protocol, and

inserting a set of labeled errors into one or more multimedia data packets using the synchronization level protocol; a component for performing error correction, using a set of marked errors based on the application layer protocol; means for restoring multimedia data of a plurality of flows, based on the protocol of the junction level.

41. The device of claim 40, wherein the elimination of the errors contains or time-based error masking, or skipping the error masking, or convertingfrequency of frames, or a combination thereof.

42. Processor for use in streaming multimedia data, executed from the possibilities:

take multiple streams of encoded multi-media data;

to detect a plurality of errors in the plurality of streams of coded multimedia data, based on the protocol level of the communication;

identify identified errors as non-correct protocol of communication level;

determine the distribution of detected error errors, based on the protocol of the synchronization level; determine the set of observed errors in the distribution of errors, based on the protocol of the synchronization level;

insert a set of marked errors into one or more multimedia packets using the synchronization level protocol;

perform the elimination of errors, using a number of marked errors, based on the pro-tocol of the applied level; and

Recover multimedia data from a plurality of threads based on application-level protocols.

43. The processor of claim 42, wherein the step of removing the soap comprises either a timing masking step in a soap, or a stage of spatial disguise, or a stage of frame rate transformation, or a combination of these steps.

44. A carrier readable by a computer for implementing a means for use in processing a stream of multimedia data comprising the steps of: receiving in the multimedia device a plurality of streams of encoded multimedia data; detecting a plurality of errors in the plurality of streams of the coded multimedia data, based on the protocol of the level ' tongue

identify identified errors as non-correct protocol of the level of communication;

determine the distribution of detected error errors based on the protocol of the synchronization level; determine the set of marked errors in error generation, based on the protocol of the level of synchronization;

insert a set of labeled errors in one more multimedia packets with the help of the protocol of the synchronization level; perform the elimination of errors using a variety of errors noted, based on the pro-tokol of the applied level; and

92004

9

Recover multimedia data from a plurality of threads based on application-level protocol.

45. The carrier of claim 44, wherein the step of eliminating the errors contains or the stage of time-based error masking,

10

or stage of spatial masking errors, or stage of frame rate transformation, or a combination of these stages.

According to this patent application, a priori application is claimed in accordance with the previous application for patent No. 60 / 660,681, entitled "Intervention of the Interpretation of the Agreement on the Application of Patents and Trademarks" dated 10 March 2005, Preliminary Application No. 60 / 660,923, entitled " an apolograise for its interconnection "filed March 10, 2005, and a preliminary application for the patent number 60 / 660.867, entitled" The Interaction of the Hedgehog of the Hedgehog, The Hedgehog ", filed March 10, 2005, each of which belongs to the applicant for the application, and includes the following description with the help of link.

The present invention relates to methods and apparatus for decoding the streaming of multimedia data in real time on portable devices.

Due to the high growth and great success of the Internet and wireless communications network, as well as increased demand for multimedia services, the flow of multimedia data over the Internet and mobile / wireless communications channels attracted tremendous attention. In heterogeneous IP networks, video data is provided by the server, but can also be provided by one or more clients. Leading connections include communication over a telephone line, a digital network with complementary services (ΙδόΝ), a cable line, protocols of a digital subscriber line (collectively called χü3Ι_), fiber optic cable, local area networks (Ι_ΑΝ) , on global issues (ΜΑΝ), and others. The transmission mode can be either single or multicast (group).

Mobile / wireless communication is similar tocommunication on the heterogeneous IP-network. The transportation of multimedia content (content) over mobile / wireless communication channels is rather difficult due to the fact that the quality of these channels is often significantly degraded due to fading associated with multi-beam propagation, shading, cross-linking, frontal interference and noise barriers (interference noise). Some other causes, such asmobility and competing traffic, also result in bandwidth and loss changes. Channel noises and the number of service users determine the time-varying channel properties.

The requirements for higher data transfer speeds and higher quality of service both in heterogeneous IP networks and in mobile communication systems are growing rapidly. However, factors such as the limited latency (delay), limited by the transmission power, limited throughput and fading, associated with multipath, continue to restrict the speed transfer of system data, applied in practice. When transmitting multimedia data, in particular in error-prone environments, the resilience of transmitted multimedia media errors is critical in providing the desired service quality, due to the fact that,

Soap dishes, even in a separate decoded sense, can lead to the decoding of artifacts (image creations) that propagate in plain-air and temporal relationships. To minimize mistakes, different encoding parameters are used that support the required data transfer speed, but all these methods suffer from problems associated with errors that reach the decoder's side.

Data is compressed using a source code encoder, which transmits the maximum amount of information when the minimum amount of bits consumed by the channel encoder tends to maximize the bandwidth of the channel for a specified probability of error when receiving these bits.

The channel coding, such as the Reed Solomon encoding, is used to increase the efficiency of the data encoded by the source encoder. Common channel coding methods are used to provide variable security levels bypassing the data encoded by the source encoder with varying levels of importance or for providing the ability to adapt speed transfer coded video data to an available bandwidth network by partitioning and rejecting packets. This is due to the fact that the usual transport protocols do not supply damaged data source decoder.

Source source coding methods, for example, revive-encoding with variable-length code (for example, in the standard of the IME-4) were used to eliminate errors by decoding the packet in reverse order with the actual po-yom of damaged packets. There is a compromise in the efectibility of encoding using source code methods, which preserves the quality of decodedvdds at a given data rate.

Hybrid coding standards, such as IMRES-1, IR-2, IR-4 (commonly referred to as IMRES-x), H.261, H.262, H.263 and H.264 (collectively referred to as H.26x), use points re-synchronizing in the bit stream as the main way of decoding bugs.

Another reason that can cause data loss beyond the initial distortion is due to the incorrect key layer emulation. Identification of the initial position of the bit error is not a trivial task, and, as a rule, it is impossible without a special structure, supporting the identification of the positions of bit errors on the MA-level or the component of the physical level. So, after detecting the damage to the bit stream, the decoder will probably have to stop decoding and move through the bitstream to search for the next re-synchronization point, which inevitably misses a large number of potentially useful data. Despite the emulation of a different keyword that has a length similar to the original, that is, true, the keyword

92004

11

may seem less of a problem in comparison with the sequence of the above-described events; in fact, it is not an example. There is a large number of ways in which such a type of error can lead to a mistake when decoding the correct bit stream decoder. For example, in the most modern codecs (encoders-decoders), in the bitstream there areobjects (parameters associated with compression), whose significance affects the order of the next time of the bit stream. Consequently, the incorrect value of such an object can lead to the decipherment of a non-threaded bit stream.

Due to the fact that ordinary traffic sometimes does not deliver damaged data to the decoder (for example, the use of a video or audio decoder), the decoder has a limited ability to handle binary errors using discarded packets and re-synchronization, which is the most widespread solution. It is necessary to improve the way of processing bit errors that lead to the spread of errors, as well as data loss due to problems, such as loss of synchronization and the emulation of an incorrect keyword.

In one aspect, the method and device for multi-level integration used to eliminate errors, contain a method or means for detecting errors in multimedia data based on the protocol of the first level, and masking detected multimedia data errors based on the protocol of the second level . In another aspect, the device for multi-level integration used to eliminate errors, contains a means of detection to detect an error in multimedia data on the basis of the protocol of the first level and the masking tool to mask detected in multimedia data errors based on the protocol of the second level. In a method and device for multi-level integration the first level can include the level of communication. The level of communication may include a single unit of a large number, containing a physical level, MAC level and transport level, or a combination of these elements. In addition, the method and the steps may further comprise a method or a means for controlling the detected error based on the transport layer protocle. The control phase of the detected error may include the step of limiting the distribution of the detected error. The method and apparatus may further include a method or a method for determining the distribution of the detected error based on the protocol of the synchronization level. The second level may include an applied level. The method and apparatus may further include a method or a method for determining the distribution of the detected error based on the protocol of the synchronization level. The second level may include an applied level. The method and apparatus may further include a method or a method for determining the distribution of the detected error based on the protocol of the synchronization level. The second level may include an applied level.

In another aspect, the method and device for multi-level integration used to eliminate errors include a method or means for detecting an error in multimedia data based on the communication layer protocol, monitoring the detected error based on the transport layer protocol, determining the distribution an error that is controlled on the basis of the protocol of the synchronization level and masking the detected in the multimedia data error based on the protocol application level. In another aspect, the method and apparatus used for processing multimedia data includes a method or means for performing a removal of encoded multimedia data and encoded multimode data encryption subcodes,

12

durable data. In yet another aspect, a device that is used to handle multimedia data includes a removing component for removing encoded multimedia data errors and a scaling component to support the scalability of encoded multimedia data. In the method and device used in the processing of multimedia data, scalability can be either spatial or temporal, or both. The elimination step may include either the stage of time masking errors, or the stage of spatial masking in the soap, or the stage of converting the frame rate, or combination of these stages.

In another aspect, the method and apparatus used to handle the multimedia stream include a method or means for receiving a plurality of streams of encoded multimedia data, performing error correction in the error portion of the stream, and restoring multimedia data from a plurality streams In another aspect of the preamble used for processing a multi-media stream, includes a receiver for receiving a plurality of streams of encoded multimedia data, an error correction component for executing error correction in an error portion of the stream, and an recovery unit for restoring multimedia data from a plurality of streams. In the method and device used for processing the multimedia stream, the error elimination step may comprise either a time-based error masking step, or a stage of pro-mask error, or a frame rate transformation step,

It should be noted that the above-mentioned device and the device can be implemented using a medium-readable medium and / or a processor executed with the ability to perform a method or operation of the device.

Brief description of the drawings

FIG. 1A depicts a block diagram of an example system communication for delivering streaming multimedia data.

FIG. 1B depicts a block diagram of an example of a multi-level communication system for delivering streaming multimedia data transmission.

FIG. 1C depicts a block diagram of another example of a multi-level communication system for delivering flow-through transmission of multimedia data.

FIG. 2A is a block diagram of an example structure of a decoding device for decoding a stream of multimedia data.

FIG. 2B is a diagram of a protocol stack in an in-tagged multi-level control system that includes a transmitter, and another representation represented in FIG. 2A structure of decoding device.

FIG. 3 depicts an example of multimedia symbols arranged for cascaded coding with erasing errors of Reed-Solomon and turbo coding.

FIG. 4 depicts a sequence of operations example example of decoding the streaming multimedia data.

FIG. 5 depicts the structure of the information tour-bo-package for video data.

92004

13

FIG. 6 is a block diagram of an illustrative component system, which may be part of the multimeter-receiver 24 shown in FIG. 1

FIG. 7 depicts a flowchart for the elimination of errors.

Describes the way and device to provide enhanced capabilities to eliminate errors in the multimedia decoder. Integrated error-handling capabilities are provided, such as detecting errors in the stream of multimedia data at the top level (for example, at the communication level), and performing correction of errors in relation to the detected error at the application level (for example, video or audi-oddoker). In one example, a stream of decoder is provided, which provides information that marks the damaged bits, for component-level level, which is used to create reasonable solutions when performing various types of error-correction methods. Clearing methods are used to replace damaged characters with predictable symbols received from information available for the component at the level level, such as pre-decoded video data, audio data, textual and graphic information. To provide a full understanding of the options implementation in the following description are given the characteristic elements. However, for those skilled in the art, it will be understood that the embodiments may be carried out without these characteristic elements. For example, in block diagrams, electrical components may be depicted in order to prevent the use of unnecessary elements. In other cases, similar components, other structures and methods can be depicted in detail for additional explanation of embodiments. It is also understood by the facsimiles in the art that electro-components, depicted as separate blocks, can be rearranged and / or combined into one component. However, for those skilled in the art, it will be understood that the embodiments may be carried out without these characteristic elements. For example, in block diagrams, electrical components may be depicted in order to prevent the use of unnecessary elements. In other cases, similar components, other structures and methods can be depicted in detail for additional explanation of embodiments. It is also understood by the facsimiles in the art that electro-components, depicted as separate blocks, can be rearranged and / or combined into one component. However, for those skilled in the art, it will be understood that the embodiments may be carried out without these characteristic elements. For example, in block diagrams, electrical components may be depicted in order to prevent the use of unnecessary elements. In other cases, similar components, other structures and methods can be depicted in detail for additional explanation of embodiments. It is also understood by the facsimiles in the art that electro-components, depicted as separate blocks, can be rearranged and / or combined into one component. In other cases, similar components, other structures and methods can be depicted in detail for additional explanation of embodiments. It is also understood by the facsimiles in the art that electro-components, depicted as separate blocks, can be rearranged and / or combined into one component. In other cases, similar components, other structures and methods can be depicted in detail for additional explanation of embodiments. It is also understood by the facsimiles in the art that electro-components, depicted as separate blocks, can be rearranged and / or combined into one component.

Also, it should be noted that some variantsimplementation can be described as a process depicted in the form of a flowchart, sequence diagramsoperations, a block diagram or a schematic diagram. Despite the fact that the block diagram can describe the operation as a multi-stage process, many of the operations can be performed in parallel or simultaneously, and the process can be repeated. In addition, the order of operations can be changed. The process is completed if its operations are completed. The process may correspond to the method, function, procedure, subroutine, part of the program, etc. If the process matches a function, that completion corresponds to the return of the function to the calling function or to the main function.

FIG. 1A depicts a block diagram of an example system communication for delivering streaming multimedia data. System 20 includes a transmitter 22 and receiver multimedia decoder 24. The pe-editor 22 contains compressed multimedia data for various forms, including, but not limited to, video data, audio data, graphical information, text information and images. The data can be a live video data and audio data, as in the standard MREO-x and H.26x, compressed audio data, as the standards for compression of speech or video MREO-4

14

AAS, MP3, AMR and O.723, or any other type of digital data.

The transmitter 22 receives data from a variety of sources, including external memory, the Internet, and the operational delivery of audio data and / or video data. Transmitter 22 also transmits (Tx) received data over the network. The network may be a wired network 28, for example, a telephone, cable or fiber optic, or a non-conductive network 26. As for the wireless communication system, the network 26 may include, for example, a portion of a multiple-access code-division access system channels (COMA or COMA2000) or alternatively, the system may be a frequency division multiple access (EMA) system, a multiple-access system based on orthogonal frequency division (BOOM), a time-division multiple access system (TOMA), as a mobile communication technology Communication for the service industry OZM / ORRZ (packet radio system '

The decoder 24 includes a means, such as a radio frequency antenna or a network connection, for receiving data on the wireless network 26 and / or the network of the network 28. The decoder 24 may include a large number of processors that contain different combinations of previous processors (for example, any type of CPU, for example, ARM), a digital signal processor (UPS), software, firmware and hardware such as the UiSeoSoftware multimedia processor for demodulation and decoding tasks related their perceived data. Decoder 24 also containscomponents of memory to save accepteddata and intermediate data at various stages of the processdemodulation / decoding. In some embodiments, the previous processor ARM performs less complex tasks, which include unpacking (removing side information, such as headers and messages) and demultiplexing a number of bit streams, including audio databases, video data, and more. The previous processor AMD also performs parsing of bitstream, detecting errors, masking and decoding entropy-varying lengths. In some such embodiments, the digital signal processor (UDP) executes UI_C extensions (with variable length code), reverse zigzag scan of the video data for the spatial determination of the pixel parameters, the inverse prediction of the alternating current / DC current parameters the pixel for the video of the standard MREO-4 (not a feature of the standard N.264 through context-sensitive adaptive entropy coding) and audio decoding (for example, MREO-4 AAS, MP3, AMR or O.723).

92004

15

giving decoding video data containing dequantization, inverse transformation, forecasting with motion detection and unlocking (the form of filtering to reduce border distortions of the image (artifacts) between the edges of the pixel block). In the system of communication 20, one or more elements may be added, rebuilt, or merged. In the wired communication system, the network 26 may include, for example, a part of a communications system based on an Internet Protocol (IP), with transport protocols such as a transport real-time protocol (RTR) or a universal Transmission Datagram Protocol (YUUR).

FIG. 1B is a block diagram of a multi-layered protocol library used for division tasks performed on a transmitter 22 and decoder 24. The upper layer components 205 and 210 that are located in transmitter 22 and decoder 24 respectively may include a plurality of applications such as, for example, video or audio cassettes and / or decoders. Some embodiments may include a large number of information streams that are preselected for simultaneous decoding. In these times, the synchronization tasks of a plurality of flows can also be performed in components 205 and 210 of the upper levels. The upper level component 205 can provide encoded information on the synchronization of the waveform stream transmitted through the wireless network 26 and / or the wired network 28. Component 210 of the upper level 210 can disassemble a large number of information flows,

The lower level components 215 that are located in the transmitter 22 may include in the cross-sectional circuitry to provide error tolerance. Error-bound channels, for example, the free-end network 26 and / or the lead network 28, may cause bit-stream errors that is adopted by the decoder 24. Such error-tolerance schemes provided in the lower-level components 215 may include one or more schemes of non-resistive coding (with control of the pins), duty schedules, and other known experts in the art of circuitry. The lower level components 220 in the decoder 22 may include appropriate components of the decoding of errors that allow detection and correction of errors. Some errors introduced by the wireless network 26 and / or the lead network 28 may be unconfigured with the components of the lower level. For unconfixed errors, solutions such as lower-level components 220 that request retransmission of damaged com-components using components 215 of the lower level of transmitter 22 may not be feasible in some situations, for example, when transmitting multimedial data in real time, for example, when streaming applications. In some embodiments, the components 215 and 220 of the lower layer contain the components of the level of communication. One or more elements may be added, rearranged or combined in transmitter 22 or decoder 24 as depicted in FIG. 1B. when transmitting multi-timed data in real time, for example, in the streaming of applications. In some embodiments, the components 215 and 220 of the lower layer contain the components of the level of communication. One or more elements may be added, rearranged or combined in transmitter 22 or decoder 24 as depicted in FIG. 1B. when transmitting multi-timed data in real time, for example, in the streaming of applications. In some embodiments, the components 215 and 220 of the lower layer contain the components of the level of communication. One or more elements may be added, rearranged or combined in transmitter 22 or decoder 24 as depicted in FIG. 1B.

FIG. 1C depicts a block diagram of a more detailed example of a multi-level stack of protocols that

16

is used for dividing tasks in transmitter 22 and decoder 24. Top-level components 205 located in transmitter 22 are distributed either to one level from a plurality that contains an application level 206 and synchronization level 207, or in several levels. The lower layer components 215 that are located in the transmitter 22 are distributed either to one level from the set containing the transport layer 216, the access control layer 217 to the transmission medium (MAC) / stream level217 and the physical layer 218, or to several levels. In a similar manner Top-level components 210 in the decoder 24 are distributed or one level in a plurality of application levels 211 and synchronization level 207, or at several levels. The lower layer components 220 that are found in the decoder 24 are distributed, or a level of the plural, which comprises a transport layer 221, an access layer control layer 222 (MAC), a stream level 222, and an physical layer 223, or at several levels. Those skilled in the art are aware of these levels, and they are familiar with the distribution of various tasks among them. Further, an example of a structure that unites different levels of the decoding device 24, as discussed above, is discussed for use in their interfaces. Error-resceability provided by the transmitters 22. One or more elements may be added, rearranged, or combined in the n-editor 22 or the decoder 24 depicted in FIG. 1C.

FIG. 2A is a block diagram of an example structure of a decoding device for decoding a stream of multimedia data. FIG. 2View the diagram of the protocol stack for an example of an integrated multi-level control system that contains a transmitter 22 and a representation of the pro-tokol stack as depicted in FIG. 2A structure of decoding device. As shown in FIG. 2A and 2B, the multimidia decoder 30 comprises a physical layer component 32, an MAC layer 34, a transport level parsing unit 39, and a synchronization level and an application layer component 50. The multi-media decoder 30 receives an incoming bitstream (B) comprising a cascade error correction scheme, for example, a cascade turbo / Reed-Solomon coding scheme. Component 32 of the physical level can perform demodulation tasks, among others, including reception, interference failure, decoding, such as decoding using turbo code and interacting with the MAC layer (access control environment for the transmission medium). The MAC-level component 34 may perform an interrupt-proof decoding, for example, detecting Reed-Solomon errors, correcting errors and marking incorrect corrupted data, for example, a group consisting of one or several bits. Component 34 of the MAC level interacts with the component of the parsing of the transport layer and level of synchronization (TPD).

The TPD component 39 may further comprise a transport layer demultiplexing component 36 and a synchronization level parsing component 38. The transport level demultiplexing component 36 may receive a bit stream transmitted from the MAC component 34 containing as

92004

17

correct and corrupted bits, and information that malfunctions bits of corrupted groups. Damaged groups of bits and corresponding marking information contain information corresponding to errors 33 in the control loop amount (CPC) of the turbo decoder and 35Rida-Solomon errors. (In some protocol stacks, component demultiplexing transport layer 36 is also known as the sub-level of the stream level, where the sub-level of the MAC-level and the sub-level of the flow level are sub-levels of the transport layer.) Component36, demultiplexing the transport layer can demultiplexize (be-them) or disassembled bit stream on a plurality of bitstream flows. The disassembled bitstream streams may include bitstream streams for different applications, such as a video decoder, an audio decoder, and various combinations of text, graphics, and imaging applications. The transport layer demultiplexing component can also disassemble one bitstream for a single application such a bit rate of video data, such as two or several individual levels (e.g., using scalable encodings), for example, an underlying level and level of improvement. Then, these levels can be used to provide scale-rate, such as time and / or 3NP scalability. One example of scalable coding divides frames with internal encoding (such as I frames) and other frames with reciprocal encoding (for example, F-frames or B-frames obtained when using, for example, motion-compensated prediction) on different levels in the bit stream. I-frames can be encoded at the main level, and P-frames and / or B-frames can be encoded at the level of improvement. Scalable encoding is useful in dynamic channels, where scalable bit streams can be adapted to match the fluctuations in network bandwidth. In the tendency to channel errors, scalable coding can also increase the reliability by protecting the uneven errors of the main level and the level of improvement. The best error protection can be applied to a more important level.

The synchronization parsing component 38 performs beforehand the parsing of the bitstream on the bitstream, linked to each other on the basis of clock synchronization. Multimedia bitstream video data can be disassembled on bit stream video data, bit stream audio data and bitstream with corresponding text information hidden bytes. The parser 38 of the synchronization level transmits the disassembled bit streams of the attached decoder application along with the timing synchronization information. It provides the connected audio data, video data and text information to display and playback at the right time.

In addition to the discussion discussed above, the compartment 36 of the demultiplexing transport layer can disassemble and forward information that marks the damage, (e.g., the information about the SRC error and the error message 31 of the Rida-Solomon) that it received from the component 34MAAS-level and the physical-level component 32 , a com ponent for parsing the level of synchronization and / or an appropriate application level process (e.g., a video decoder or an audio decoder). Component 38

18

The parsing of the synchronization level may transmit the information that marks the damage in the form of information about the distribution of errors. The synchronization level robin component 38 may also provide recommended information 41 on the error control strategy. Then, the application layer process may use information 37, which marks the postcode, and information 41 on the control strategy for error handling.

Application layer component 50 may comprise one or more components such as, for example, an error correction component 40, a zoom component 42, a frame rate transformation component 44, a base decoding component 46, and a further processing part 48. The application layer component 50 utilizes the information marking the damage information 37 and information 41 on the control strategy for decision making regarding the method for using the components for error correction, scaling and frame rate transformation (RRBIS) for managing the corrupted data, thus offering more High quality decoding using the base application decoding component 46. For example, in terms of time scalability, where some multimedia data is taken at one level, which contains important information, and the rest of the multimedia data - at another level, the component of frame rate transformation (RRBIS) can be used to restore missing multimedia data in the event that the second level was not adopted, lost or damaged. After decoding, the component 48 of the subsequent processing performs any necessary modifications of the hardware to provide the ability to display, play or render video and audio output to the display device or speakers, respectively. The subsequent processing component 48 may also perform an improvement or recovery operation earlier than multimedia data will be reproduced or presented. After decoding, the component 48 of the subsequent processing performs any necessary modifications of the hardware to provide the ability to display, play or render video and audio output to the display device or speakers, respectively. The subsequent processing component 48 may also perform an improvement or recovery operation earlier than multimedia data will be reproduced or presented. After decoding, the component 48 of the subsequent processing performs any necessary modifications of the hardware to provide the ability to display, play or render video and audio output to the display device or speakers, respectively. The subsequent processing component 48 may also perform an improvement or recovery operation earlier than multimedia data will be reproduced or presented.

The base decoding component 46 may contain a video decoder (s), audio decoder (s), as well as text and graphics applications. By performing error correction processing, scaling and frame rate transformation (RBIS) bitstream streams of various applications before or during decoding using component 46 of the decoding of the base application, improvements can be made to improve the quality of the bit stream of low quality (encoded with low quality, or accepted with poor quality due to errors). For example, components 40, 42, and 44 can propose improvements to the standard initial, suited to the standard H.264, bit stream vids (the basic profile is a very simple profile, which was designed for malopotrushogo device), and provide some elements of the other profiles of the standard H.264, such as B-frames and the separation of layer data, which are required to perform scaling, detection and stability of the feeds for the stream of video data. The elements of the process using the components of the multimedia decoder 30 are shown below. One or more deck elements can be added, rebuilding

92004

19th

or combined in a transmitter 22 or a decoder 30 depicted in FIG. 2A and 2B.

Below is a brief discussion of the process of error detection and error correction. One example of an error detection and correction scheme uses cascading code that contains both internal (channel) and external (channel) code. The cascode channel codes consist of a turbo (internal) code on the physical level and a correction code (external) for erasing errors of the Reed-Solomon set at the MAC level. FIG. 3 depicts the cluster of multimedia symbols arranged for cascading encoding with erasing Reed-Solomon errors and turbo coding. As far as the code-side side, the output of the characters from the information source, the output of the dual key words from the encoder, is glued to bytes 102. Each byte 102 is considered a symbol in the final field known as the "Galois field (256)" for external purposes (N, K) of the Reed-Solomon (RH) code in the Gaul field (256) (SR). N and K, respectively, represent the size of all the key word 104 of Reed-Solomon (RH) and its output data 106, containing among the symbols a systematic part. Thus, the nominal K is the number of characters of the 108 parity included in each keyword 104. The Solomon's code (RZ) (N, K) is corrected for N minus K erasing errors.

The upper strings 106, in essence, contain characters derived from the source of information, and these characters can be scanned from K to the rows or rows that are initially scanned, or columns. Alternation is achieved by scanning the initial stacks, and leads to significantly smaller groups of mail-coded bits in the event that this line 112 informational turbopacket is corrupted. The duration of each group of damaged bits, due to spontaneous errors in the information turbo packet, may be equal to 1 byte for the first scanned counts, in contrast to the length (B-1) bytes for the first line of the scan. In the decoder, marking these damaged bits, as discussed below, may be necessary to identify the size and position (in bitstream) of these bits. After this initial stageplacing the source data, each of the B columns104 (K bytes) is encoded using RH in N bytes, by adding NK bytes of parity and, consequently, K + 1, ..., N are shown in FIG. 3 lines108. The upper rows consist of data sources 106 that are referred to as an information blockRZ, and a whole set of N lines is referred to as a block coded using RH, or simply an encoded unit 110.

Each line 112 has a control loop amount (CPC) and some locking bits required for the correct operation of the turbo encoder. By adding a checksum to each line, 112 queues will not be able to meet their respective control amounts after turbo decoding can be declared erased. Each code block 110 at one time introduces one line 112 in the turbo encoder and, therefore, each line refers to the information turbo package.

The process of turbo decoding represents a precise process of decoding the Reed-Solomon, which

20

then reduces the coefficient of residual errors. The ability of a successful correction to erase depends on the total number of erasers within the code block and the number of minus K) parity symbols, which is used in the key word RH.

In the channel coding structure, assigned to the multimedia decoder 30 depicted in FIG. 2, in the event that the Reed-Solomope (RZ) code block is erased off of the corrective capability, then the corresponding RZ information block (Figure 3) can be transmitted to the components at the trans-level level, at the synchronization level, or at the level level, from a message stating what of the number K information turbochargers 112 (FIG. 3) are damaged. The systematic structure of the external (RK) Reed-Solomon (RH) code in the Ga-Loa field (256) allows the direct use of the unconditioned information turbopackets (intact).

FIG. 4 depicts a sequence of operations example example of decoding the streaming multimedia data. Modulated false data (^) are accepted and entered into the process of decoding and demodulating (step 62). Data may be received on wired or wireless networks, for example, wireless network 26 and the network 28 shown in FIG. 1. At stage 62, the physical layer 32 component is depicted in FIG. 2, performs demodulation of the received mistaken data. Then, the demodulated data is transferred to stage 64, where errors can be detected and corrected. In step 64, the physical layer level component 32 is depicted in FIG. 2, can perform a tour-bode coding, while a component 34 of the MAC level shown in FIG. 2, can correct the errors of Reed-Solomon.

Once, at step 64 of the turbo decoding of the Reed-Solomon coding, all corrected errors are corrected and corrected, informational turbo boxes and / or damaged bytes are identified at stage 66, for example, by marking. Before transmitting a bit stream to perform parsing in step 68, from controllingcycle sums (CPCs), locking bits in each information turbo package, as well as from parity strings108 (FIG. 3), refuse. The error-free, accepted, error-corrected, but corrupted and labeled corrupted data, along with the brand-name information that identifies the damaged data, is jointly transmitted to stage 68 for disassembling the bitstream. In step 66, the physical level component 32 and / or the MAC level 34 component (Figure 2) may perform identification (for example, by marking) the damaged data.

As discussed above, the transport layer multiplexing component 36 and the synchronization level parser 38 disassembled the bitstream on a plurality of bitstream streams recognized for a plurality of application layer processes. As depicted in FIG. In Figure 4, the bit stream is rotated (at block 68) to bit stream 70 video data, bit stream 72 audio data and bit stream 74 text and / or graphical information. A quasi-bit stream 70, 72, and 74 may contain data that goes-animate the damaged bits of the individual binary streams. Also, if there are separate bit streams

92004

21

should be synchronous in a timely manner, then bitstream streams may contain synchronization information.

After parsing individual bit streams, the processing of errors at the application level is performed, and steps 78, 82 and 86 are replaced by damaged bits using one of several methods for eliminating errors or cloaking. An error correction component 40, a scaling component 42, and an application layer layer component component 44 of the frame rate component (ERIS) 44 (Figure 2) can execute a change at steps 78, 82 and 86. After replacing damaged characters, separate streams of video data, audio data, and text / graphical information may be decoded at stages 80, 84 and 88, respectively. The decoding component 46 of the application layer component 50 (FIGURE 2) may perform decoding at steps 80, 84 and 88. The application decoding component decoding component 46 of the application layer 50 (Figure 2) can also replace the damaged bits in steps 78, 82 and / or 86, which, can be marked with a component of the lower level. One or more elements may be added, rearranged or combined for the processing process shown in FIG. 4

The following is a detailed discussion of an example of identifying damaged bits (step 66) by helping to mark damaged data as an image. FIG. 4. FIG. 5 depicts the structure of information turbo package for video data. Block 140 is a set of information turbopumps, for example, the lines of information turbopacks 106, which are shown in FIG. 3 informational RH block. The videotape may require the coding of several data turbo data packages. For example, the first frame (E1) takes the beginning of the order 142A of the information block 148A. Data, which remained in frame E1, are located in rows 142B, 142C, 142-Y, as well as in the first part of the line142E. The 142A line also includes a Synchronization Level (LN) header 146 that contains information such as stream identification, synchronization time, frame identification (number of frames, number of upstream levels, in the case of a basic level and level of improvement), and other information. The synchronization level header 146A is used to identify the synchronization level parsing block (reference number 38 in FIG. 2), which (application of which) sends data contained in the following information blocks representing the frame E1. In the case of a single row there is a control loop amount (CPC),

22

as discussed above, which is used jointly with the decoding of Reed-Solomon to identify the wiped (damaged) packages.

At the beginning of each line of the information tour-boot package there is a heading 144 transport level (TN). Each header 144 of the transport level (TN) contains the fields "I_aeii: _Riaad" and "ΟίϊεθίΡοίπίθΓ". Indication of the damaged information turbopacket, executed in the pictured onFig. 4, stage 66, can be executed directly with the value of the field "Ottsytsy_Pyysptsii". Installing an incorrect value in the field "Otchytsy_Positrya" may determine the package as being damaged. Alternatively, the "Egg_Riaad" field can be used in the transport layer header (TN). The marking can be achieved by setting the value of the "Egg_Riaad" field, which is equal to one (Egg_RID = 1) in the corresponding transport layer header (TN). For example, if line 142C is damaged, then the value of the transport layer (TN) of the 142C line can be set to equal one. The "I_Aye_EIad" field is used to indicate that the current line is the last line of a frame (for example, by setting its value to one unit), and if it is the last row, then the field "Οίί5θί_ΡοίπίθΓ" is used to indicate where in the line information tour-bopaket is the beginning of the next frame (counting bytes). For example, in line 142E, the value is a noteIn the transport layer (TN), it can be equal to one (the value of the field "LaTeY_Riaad" is equal to one), and the value of the field "OTs" can be equal to the number of bytes contained in the line before the beginning of the heading 144C of the transport layer (TN) (the beginning of the frame E3). The 146B header of the synchronization level may contain data indicating the field "Fetch_IU" and bitstream, as discussed above. Informational block 148C contains video data representing the frame E3. If line 142E has been defined as magnetized, then the decoder may not determine where the frame E1 ends and where the frame E3 starts.

In addition to (or instead) the inclusion of the "Egg_R1ad" field in the header of the transport layer, as discussed above, the data table can be created and transferred to the application level with the information listed in Table 1 for each viewfinder.

Sample information contained in the table error bitstream video data

Table 1

Sample information contained in the bitmap error table of video data

- The number of frames is an integer limited by a set of frames, for example, 30 frames, where after the largest number the numbering is restored from the unit.

- B / E - indicates the number of baseline levels or levels of improvement in the frame in case of the presence of a plurality of levels of scaling.

- Ragate Beps - the length of the video frame in bytes.

- PAP EIA is an indicator indicating whether the frame is a random access point, for example, an entire I-frame with internal encoding. Such indicator may also serve as a point of re-synchronization when dealing with errors.

- Time display mark (PT3) - time in the sequence of frames, during which the frame should be displayed.

23

92004

24

Continuation of Table 1

- Shots per second (HR)

The number of information turbo boxes involved in the frame (and completely and partially)

- Eggg_Viy_RayEgyp is a variable that indicates which information turbo packets are damaged (five bits "00100" will indicate that the third of the five information turbopackets is damaged).

- Eggog_RaIIo is a variable indicating the damaged information packet distortion factor for packet correction (1/5 will indicate that one of the five packets is damaged).

Other binary stream error tables may also be formed, similar to Table 1. An information marking error in the transport layer header and / or spreadsheet similar to Table 1 may be used by components of the application layer such as components 40, 42 and 44 (Figure 2) to identify the damaged characters in the disassembled bitstream threads 70, 72 and 74, as well as to replace them at the steps 78,82 and 86 (Figure 4), respectively. As discussed elsewhere, Reed-Solomon (P5) encryption packages are not denied, they are transmitted to the application layer, for example, a video encoder. This protects integral packets, potentially up to 122 bytes or more for video data packets, from loss.

Replacing damaged symbols in steps 78,82 and 86 (Figure 4) can take two basic forms, namely: error correction and masking errors. Operations of correction and masking errors on the level of the bit stream are performed on erasures and packet errors. Decoding errors (through errors in bytes) are corrected by the use of the IDA criterion (maximum a posteriori probability) to the extent possible. Mistakes that can not be corrected are masked by the use of spatial and / or temporal information from neighboring macroblocks (the macroblock is an area of ​​pixels that is 16x16 in size, which generally operates with video compression standards, as well as Sub-macroblocks can be used, for example, 8x8.8x16 and others). Time masking can be used, for example, if the image is static over one frame.

As discussed above, it may be possible to adopt a range of encoded data representing one bit stream. Levels may include a basic level and one or more levels of improvement where level (n) improvements can provide additional frames that are not available at the baseline level (eg, bi-directional B-frames are provided) or it can provide differentials Improving the quality of the pixel parameters of the base level. Regarding

Differential improvements to the parameters of the base level, if the baseline level is damaged, then the level of improvement may be useless, since it was obtained based on the values ​​of peak levels of the baseline. Thus, the level of improvement can be exempted from decoding in case if the base level data is corrupted. This process is called selective decoding, and it can also be used under scenarios of high power. For example, if a device that contains a decoder, works in low power mode, or works on battery power, only the base level can be decoded, lowering the level of improvement, thus maintaining the cycle of calculation and, in turn, the power consumption. Methods of spatial and / or time masking can be used to replace data of combined levels (baseline and level of improvement).

The level of improvement (which is sometimes interpreted as a low priority level) can be transferred to low power in contrast to the base level (or high priority level). This increases the integrity of the error at the level of improvement by the base level. Consequently, if the adopted base level contains a high percentage of errors, the level of improvement can potentially be omitted.

The provided two-directional frames (B-frames) are intended both from the previous frame and for the next frame, using the forecast with the compensation movement. In-frames offer very high compression rates and are too desirable to maintain the throughput. In-frames are also desirable for theircharacteristic of time scalability. Compatible with standard B-frames are not used for the advance of any other frames, and in connection with this, they can be skipped without touching other frames. In-frames are also the most accepted-to-spread errors due to errors in the frames on which they depend. In this regard, the B-frames are more likely to be at the same level of improvement (or low priority). If the enhancement is transmitted at low power, then the B-frames are even more susceptible to errors.

If the B-frame (or any other frame type) is completely damaged or has a percentage of the content of the error above the threshold, which makes it impossible for the time-out or half-page masking errors to be made, the frequency conversion can be used (component RCRC shown in FIG. 2). Frame Rate Adjustment (PPI) is used to recover a lost frame. Frame Rate Transmission (RIiS) can also be used to recover the frame that was played

92004

25

Fetch from decoding for purposes like eco nomic energy. Methods for converting frame rates (BRiS) use the motion vector and information pixel from the previous and subsequent frames for the interpolation of values ​​for motion vectors and pixels. Appropriate methods for converting frame rates (BRs) are not included in the context of this discussion. Methods for converting frame rates (BRiS) include the form of "only encoder" and "only decoder." Frame Rate Conversion Method (BRIS) The "only decoder" performs a pseudo-interpolation of the frame data without any other information. The "only code" frame rate conversion method (BRIS) uses third-party information transmitted in the H.264 Advanced Enhancement Information (EII) messages or in the user's messaging data of the TWR-2 standard.

FIG. 6 depicts a block diagram of an example system of components, which may be part of a multimeter-di-receiver, for example, a receiver 24 of the image in FIG. 1. System 600 is a multi-system integration system used to eliminate errors. FIG. 7 depicts a block diagram of an error correction process that can be used by system 600. With reference to FIG. 6 and 7, process 700 in step 705 takes one or more multimedia data streams. Data streamsmay include video data, audio data and / ortext information of hidden titles, and so on. When used, one or more streams may contain legitimate data. The encrypted data may be non-revised data, quantized data, compressed data, or combinations thereof. The receptacle, such as shown in FIG. 1A receiver 24, upon step 705 may receive one or more flows. In addition to receiving a plurality of threads multimedia data, each received stream may contain multiple levels, such as the base level and the level of improvement. Receiver 24 may beconductive or wireless receiver or theircombination.

Mistakes that remain in the bit stream are detected in step 710. The errors detected may contain errors remaining after the error correction at the lower level, and detection protocols containing some of the corrected errors that were introduced via the transfer a channel, such as a wireless channel 26 or a control channel 28 (FIG. IA). As discussed above, not all errors are corrected, and any of the lower-level protocols can detect damaged data and / or data groups that contain errors. The lower-level protocols used in step 710 to detect errors can be implemented at the level of ' as discussed above. Relative communication can be one element of a set containing physical level, MAS level (or stream level) and transport level, or combination of these elements. Detection tool as shown in FIG. 6, the detection unit 605, may, in step 710, perform the detection of pins. An error detection unit 605 may employ various detection schemes known to those skilled in the art of the art, for example, Reed-Solomon and / or turbo code schemes, as discussed above. Error detection may occur due to damage

26

Control Circular Amount (CPC) in the turbo decoder. Error detection can occur due to the failure of the decoder of Reed-Solomon.

Over identified errors, you can carry out control (in step 715) using several ways. The control step 715 may include the step of marking (or marking) the damaged data as discussed above. The control step 715 can provide a stage for limiting error propagation by identifying data groups, for example, packages, blocks, parts, frames, macroblocks, sub-macroblocks that contain detected errors. Stage 715 control may be based on protocol transport level. Such a protocol may notice errors remaining after encoding one or more bits in the header transport layer for use in upper levels (Figures 1B and 1C). The upper levels can use the transport level header error indicators for additional identification and / or restriction of the distribution of top-level packets, consisting of one or more damaged trans-packet packets, thus further limiting or distributing errors in bitstream top-level flows. Means of control, such as pictured on theFig. 6 error control unit 610, can execute error control tasks.

At block 720 the distribution of errors is determined. In one aspect, the error distribution is determined on the basis of the protocol of the synchronization level. One or several bit streams that were accepted at step 705 can be disassembled at the synchronization level. If the synchronization level takes from one down level, for example, from the communication level, the information that marks the corrupted data, then it can identify the damaged bit portions flows The availability of such information can provide a synchronization layer protocol, the ability to schedule masking errors at the upper level (for example, application level) and / or elimination strategies errors. Depending on the size of the damaged data, other strategies can be applied. Transport-level k-bets that can be seen as corrupted can be combined into packet level synchronization, which will be transferred to differentcomponents of the application level, depending onthat part of which the bit stream they are. Packet-level transport levels can have unchanged lives, and packets of synchronization level are variable. The level of synchronization can identify the distribution of data by inserting data to identify what part of the synchronization packet of the variable-length contains a damaged transport package level. In addition to the use of information on error control (step 715), the level synchronization protocol may include additional ways to detect errors. These methods for detecting mistakes may include a checking con trolled cyclic sum (CPC) of synchronization level packets. A certain error distribution can be additionally passed to application-level components by inserting error markings into broken data packets.

92004

27

At block 725, the elimination of errors in parts of one or more coded multimedia data streams may be performed. Elimination of mistakes may be based on protocols at the prime level. Application-level components can perform bug fixes. Component-level components can determine which type of error handling is used based on the information taken from the synchronization level, as discussed above. Error correction may include one element of a plurality that includes time error scanning, spatial disguise packs, frame rate conversion, or combinations of these elements, as discussed above, andalso other methods. Masking detected pins in one or more streams of multimedia data may be based on the protocol of the jump level. Error handling can also support the scalability of one or more data streams. Scalability may include either spatial or temporal scalability, or both, as discussed above. An error correction tool, such as shown in Fig. 2A error correction component 40, error correction can be found on ethane 725. An error mitigation tool, such as a masking error block 620, can mask errors. The scaling, such as shown in FIG. 2A and 6, scaling components 42 and 620 may sub-immitate scalability when performing error correction in step 725. can eliminate errors on the 725th bit. An error mitigation tool, such as an error mask block 620, can mask errors. The scaling, such as shown in FIG. 2A and 6, scaling components 42 and 620 may sub-immitate scalability when performing error correction in step 725. can eliminate errors on the 725th bit. An error mitigation tool, such as an error mask block 620, can mask errors. The scaling, such as shown in FIG. 2A and 6, scaling components 42 and 620 may sub-immitate scalability when performing error correction in step 725.

Process 700 may include step 730 restoring one or more bit streams. The recovery step 730 may include a step of combining incorrectly received data with masked data. The recovery phase may include the phase of reducing the frame rate (the shape of the chaos scalability), the number of which exceeds the error margin in the frame. The recovery phase may require decision-making not to decode, mask, or adjust the level of improvement (form 3NP). Application layer protocols may be a basis for recovery step 730. A recovery means such as a data stream recovery block 630 may perform a restore at step 725. One or more elements may be added, rearranged, or combined in system 600. One or more elements may be added, rebuilt, or combined for process 700.

Examples of the above-described methods and devices include the following.

A method for decoding multimedia data, which includes the steps of receiving a bit stream, performing decoding with error control of the received bit stream, the error-decoding stage comprising the identification step of the damaged bits that have not been corrected, the decoded bit-stream editing with a control error that contains identifiable damaged bit decoder, replacing at least one of the ID-typed bits, and decoding the bitstream decoded with error control containing substituted bits. In one aspect, the additional method comprises the step of parsing a bit stream coded with error control for one or more than one character, as well as a step of parsing information,

28

which identifies the corrupted bits, provided that any characters containing the corrupted bits are identified as corrupted. In another aspect, the method further includes the step of constructing an error table containing a disassembled information that identifies the damaged bits where the error table contains information that marks the identified bits for the positions in the sequence of the video frame. In another aspect, the method further includes the step of parsing the bit stream encoded with the error control, the first disassembled bitstream and the second disassembled bit stream, wherein the first bit-stream disassembled is a bitstream of the base level, and the second discharged bitstream is a bi-directional stream of improvement level .

A method for decoding multimedia data, which includes the steps of receiving a bit stream, performing decoding with error control of the received bitstream, wherein the error control decoding step includes a step of identifying the damaged bits that have not been corrected, remitting the bit stream decoded with a control error comprising identifiable damaged bits, a decoder, replacing at least one of the identity bits, by performing a frame rate shift between the first frame and the second frame and decoding the bit stream stream decoded with error control.

Those skilled in the art will appreciate that information and signals may be presented, using any variety of different technologies and methods. For example, data, instructions, commands, information, signals, bits, ciphers, and elementary signals that can be sent everywhere in the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or time-lines , optical fields or particles, or any of their combination.

Those skilled in the art also need to understand that the various illustrative logical blocks, modules, and steps of the algorithm, described with reference to the examples disclosed in this document, may be implemented as electronic hardware, embedded software, software provision , firmware, micropro grams or a combination of them. For a clear illustration of these interchangeability of hardware and software provision, various illustrative components, blocks, modules, circuits, and stages were described above, generally, based on their functional capabilities. Whether such functionality as hardware or software depends on the specific purpose and constraints of the structure imposed on the whole system. Experts can implement the described functionality in different ways for each specific purpose,

Various illustrative logical blocks, components, modules, and circuits are described with reference to the disclosed examples that can be performed or performed in this document using a universal processor, a digital signal processor (3P), a specialized integrated circuit (ASiS), a gate matrix with an operating program

92004

29

(RRCA) or other programmable logic device, a logical element on discrete components or transistor logic, discretecomponents of hardware, or any combination of them, designed to perform the functions described in this document. A universal processor may be a microprocessor, but alternatively, the processor can be any ordinary processor, controller, microcontroller or end-to-end automaton. The processor can also be implemented as a combination of computing devices, for example, a combination of a digital signal processor (UDP) and a microprocessor, a plurality of microprocessors, one or more microprocessors, in conjunction with the digital signal processor (UDP) core, or any another such configuration.

The steps of the method or algorithm described herein by reference to the examples disclosed in this specification may be embodied directly in hardware objects, in a software module implemented with the aid of a processor, or in a combination thereof. The program module can be permanently stored in the RAM memory, flash memory, permanent memory storage device (ROM), memory erased pro grammed memory (ERROM), the memory of an electrically erasable programmed memory device (EEPROM), registers, a hard disk, a removable disk, a CD-ROM (CU-ROM) or in any another form, well-known in the technology of data carriers. Illustrative media data is connected to the processor provided so that the processor could read and write information in the data carrier. Alternatively, the data carrier can be an integral part of the processor. The processor of data indium can be permanently located in a specialized integrated circuit (ASEE). An integrated circuit (AZIS) can always be used in a wireless modem. Alternatively, the processor and carrier can be constantly found as discrete components in the wirelessmodem.

The foregoing description of the disclosed examples is provided in order to provide any person skilled in the art with the possibility of creating or using the disclosed methods and devices. The various modifications to these examples will be apparent to those skilled in the art in this field, in addition, the principles described herein can be applied to other examples, as well as additional supplementary elements may be added.

Thus, methods and methods have been described for decoding the streaming of multimedia data in real time using infromation that marks damaged bits and corrupted data in the decoder application to perform intelligent error masking and error correction of damaged data.

List of reference positions

22 Source of Compressed Multimedia Data / Transmitter

24 Receiver / Multimedia decoder

32 Physical level

32 Physical level

30

Turbo decoding damaged flip-flops with loss of control cyclic sum (CPC)

33 Damage to control cyclic sum

(CPC)

35 Damage to RH

34 MAS level

34 Stream / MAC level

Correction of errors of Reed-Solomon from Markovan-

damaged blocks

36 Demultiplexer of transport level

36 Transport level

Insert a false combination into a bit stream

37 Distribution of errors

38 Synchronization level parsing unit38 Synchronization level

- Transfer of information about the distribution of errors andstrategy

40 Troubleshooting

- Error processing

- Masking errors

41 Error control strategy

42 Scalability

- 2 levels of ZKIR

- Hourly

44 Frequency Reduction (FPS)

46 Basic application

- Decoding video data

- Decoding audio dataText information or graphics48 Further processing

50 Application level

- Masking errors: WEEE, TPP, FROST, containing misleading

62 Demodulation of the input signal

64 Detection and correction of errors

66 Identification of damaged data

68 Parse the bit stream

78, 82, 86 Replacing damaged characters

80 Decoding video data

84 Decoding audio data

88 Decoding text / image information

tion

102 Field of Galois (SR) (256) The symbol is 1 byte

106 Consecutive

108 Parity

Top Levels 205,210

206, 211 Applied level

207,212 Synchronization level

215.220 Lower levels

216.221 Transport level

217.222 Flow / MAC level 228, 223 Physical level

605 Detection of errors

610 Block error control

615 Block definition of error distribution

620 Block of masking errors

625 Scaling Component

630 Data stream restoration block

705 Receiving one or more streams

multimedia data

710 Detection of errors

715 Bug tracking

720 Definition of error distribution

725 Performing a bug fix

730 Restore one or more threads

multimedia data

31

92004

32

33

92004

34

35

92004

36

37

92004

38

39

92004

40

ΓΗ = Transport level headerZN = Synchronization level headerConclusion with control cyclic sum (SCS)

FIG. 5

41

92004

42

43 92004 44

Computer layout V. Matsele Signature Circulation 26 copies.

Ministry of Education and Science of Ukraine

State Department of Intellectual Property, st. Uritskogo, 45, Kyiv, SME, 03680, Ukraine

State Enterprise "Ukrainian Institute of Industrial Property", st. Glazunova, 1, Kyiv - 42, 01601