Untitled record

Full description

Sister Ar'a's background

The present document relates to methods and apparatuses for layered audio coding. Specifically, the present document relates to methods and devices for audio coding

apparatuses for layered audio coding for layered audio representations

<p dir="rtl">5 compressed sound or sound field such as Higher-Order Ambisonics (HOA) representations of a surround sound system.</p>

For a sound representation (or sound field) to flow over a transmission channel under times-varying conditions, multi-layer coding is a means of adapting the quality of the receiving sound representation to the transmission conditions, especially avoiding unwanted signal drops.

<p dir="rtl">10 In layered coding, the sound representation (or sound field) is often subdivided into a base layer with a high priority of relatively small size and additional enhancement layers with decreasing priority and arbitrary sizes. Each enhancement layer is typically assumed to contain increasing information to complement information of all lower layers to improve the quality of the sound (or sound field) representation. The amount of error protection for transmitting individual layers is controlled based on</p>

<p dir="rtl">15 Degree of priority. Specifically, the base layer is provided with a high degree of fault protection which is reasonable and feasible given its small size.</p>

European Patent No. 2922057 discloses a method for compressing a Higher-Order Ambisonics (HOA) system signal, a method for decompressing a compressed HOA signal, an apparatus for compressing an HOA signal and an apparatus for decompressing an HOA signal.

HOA decompressing a compressed signal 20

8872

-3-

US Patent No. 2015248889 discloses a layered audio coding formula with a monophonic layer and at least one sound field layer, the set of audio signals being decoded, according to decoder variables controlling the quantum properties of the vertical compressive energy conversion, into rotating audio signals. A time-varying gain profile is also created to determine the extent to which the signal can be processed

<p dir="rtl">5 Managed audio to mitigate unwanted audio content. The sound field layer includes the driven signals and decoding variables. In one embodiment, the gain coil includes a gain coil cleaner for the primary purpose of eliminating all non-speech components and/or noise. The gain profile can also include independent bandwidth gains. Because signals in audio coding format can be mixed with limited computing effort, the invention is unique in its use in conference rooms.</p>

<p dir="rtl">10 Circuit television tele-conferencing application.</p>

Anonymous, “Information Technology for Encryption Systems, ISO/IEC JTC 1/SC, 29

<p dir="rtl">3 ISO/IEC 23008-3:2015/PDAM - High efficiency coding and media delivery in heterogeneous environments" discloses a method for decoding a higher order compressed surround sound system representing a sound or sound field, the method comprising: receiving a bit stream containing a representation</p>

<p dir="rtl">15 An HOA is a representation of a set of hierarchical layers that includes a base layer and two or more hierarchical augmenting layers, and contains basic side information that is related to the base layer and side reinforcement information that is related to two or more hierarchical augmenting layers.</p>

.enhancement layers

Deep Sen et al., “Ideas in Layered/Scalable Coding for 110. MPEG” HOA,

MEETING; 10-20-2014 - 10-24-2014; STRASBOURG; (MOTION 20

PICTURE EXPERT GROUP OR ISO/IEC JTC1/SC29/WG11),, (20141015), no. m35160, XP030063532 [X] 1-3,10-12 * page 1, paragraph 1 Introduction - page 3.4, paragraph Solution IV; figures

6-8,15-17 [2,3,4,5 * [A] 4,5,9,13,14,18 [I, revealing the multi-layer structure of the flow

<p dir="rtl">25 Multilayer structure of the bitstream.</p>

8872

-4-

Eric Hillerud et al. “Spatial repetition in high-order surround sound and its use in...

ACOUSTICS, SPEECH AND SIGNAL

CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, (20090419), ISBN 978-1-4244-2353-8, pages 269 - 272, XP031459218 [X] 1-5,10-14 * 5

page 269, paragraph 2. - page 271, paragraph 3.3; figure 3 * [Y] 9,18 [I]

6-8,15-17 reveal the multilayer structure of bit stream

.the bitstream

However, layered encryption schemes (extended versions of) of various types are needed

<p dir="rtl">10 Especially from compressed representations of sound or sound fields such as HOA sound representations.</p>

The current document addresses the above issues. Specifically, methods and encoders/decoders for layered coding of compressed sound field representations are described.

General description of the invention

<p dir="rtl">15 In one aspect, a method is described for layered coding of a compressed audio representation</p>

Pertaining to a sound or sound field. A compressed audio representation can contain a basic compressed audio representation that includes a set of components. The combination of components may be complementary components. The compressed audio representation may also contain side information essential for decoding the underlying compressed audio representation into a reconstructed audio representation

<p dir="rtl">20 Fundamental of sound or sound field. The compressed sound representation may also contain augmented side information containing parameters for improving (e.g. enhancing) the underlying reconstructed sound representation. The method may include sub-dividing (e.g. dividing into groups) ) of a set of components into a plurality of subsets of components. The method may also include an assignment</p>

8872

-5-

(For example, adding) each of the groups to a layer within the hierarchical set of classes. Assignment can indicate a connection between the groups and the corresponding layers. Components assigned to the corresponding layer can be said to be included in that layer. The number of groups can correspond to (for example) Equal (for example) to the number of layers. It can contain

<p dir="rtl">5 A group of layers containing a base layer and one or more hierarchical enhancement layers. The group of layers can be arranged hierarchically, from the basal layer, then the first reinforcement layer, the second reinforcement layer, etc., all the way up to the overall highest reinforcement layer (generally the top layer). The method may include adding basic side information to the basal layer (including side information In the basal layer or allocate side information</p>

<p dir="rtl">10 The method may further comprise identifying (for example, adding) each portion of the reinforcement side information to the basal layer for the purpose of, for example, transmission or storage. Group parts of the reinforcement information to the corresponding layer of the layer group. Each piece of reinforcement information can contain variables to improve the representation of a sound</p>

<p dir="rtl">15 Reconstructed (e.g. decompressed) data can be obtained from data contained in (e.g. allocated or added) the corresponding layer and any of the layers below the corresponding layer. Layered encryption can be performed for the purposes of transmission over a transmission channel or for the purposes of Storage in a storage medium such as a CD, digital video disc, or Blu-ray Disc™, for example.</p>

<p dir="rtl">20 After being adapted to the above, the proposed method enables layered coding to be efficiently applied to compressed audio representations that contain a set of components and basic and enhancing side information (independently basic and enhancing side information) with the properties described above. Specifically, the method ensures It is proposed that each layer include appropriate side information to reconstruct the reconstructed sound representation from the components contained in any layer</p>

<p dir="rtl">25 down to the relevant layer. It is understood that the classes, down to the relevant class, include</p>

8872

-6-

For example, on the base layer, the first reinforcement layer, the second reinforcement layer, and so on until the relevant layer. Therefore, regardless of the highest usable layer (for example, the layer below the lowest layer was not received correctly, as all layers below the highest usable layer and the highest usable layer itself were received correctly), the device can be activated

<p dir="rtl">5 Decoding to enhance or enhance a reconstructed audio representation even though the reconstructed audio representation may differ from the complete (complete) audio representation. Specifically, regardless of the actual highest usable layer, it is sufficient for the decoder to decode the playback load of the enhancement side information in relates to only one layer (e.g. the highest usable layer) to improve or enhance the reconstructed sound representation that can be obtained on the basis of all components</p>

<p dir="rtl">10 Contained in layers down to the highest actual usable layer. That is, for each time interval (e.g. frame), a single operating load of enhancement side information must be decoded. On the other hand, the proposed method allows to make the most of the required bandwidth reduction that can be achieved when layered coding is applied.</p>

In embodiments, components of the underlying compressed audio representation may correspond to related signals

<p dir="rtl">15 Binary signals (either transmission signals or binaural transmission signals). Binary signals may represent dominant audio signals or HOA sequences. Binary signals can be quantified.</p>

In one embodiment, the underlying side information may contain information that specifies the decoding (e.g. decompression) of one or more components of the plurality of components individually.

<p dir="rtl">20 Independent of other components. For example, basic side information may represent side information related to the signal related to one individual ear independently of the signal related to one of the other ears. Therefore, basic side information can be referred to as independent basic side information.</p>

In embodiments, the reinforcement collateral information may represent the reinforcement collateral information. The reinforcement side information 25 may include prediction variables to represent the underlying compressed sound of the enhancement (e.g. reinforcement).

8872

-7-

Example) The basic reconstructed audio representation that can be obtained from the basic compressed audio representation and the basic side information.

In embodiments, the method may include generating a transport flow to transfer layer group data (data allocated to or added to the corresponding layers or otherwise included in the layers

<p dir="rtl">5 For example, the basal layer may have the highest transmission priority and the hierarchical enhancement layers may have decreasing transmission priority. That is, the transmission priority may be decreased from the basal layer to the first enhancement layer from the first enhancement layer to the augmentation layer. The second and so on can control the amount of error protection for layer group data transmission according to the relevant transmission priority degrees</p>

<p dir="rtl">10 Verify that at least a number of lower layers are transmitting without limiting the other side of the generally necessary bandwidth by not applying excessive fault protection to the higher layers.</p>

.layers

In embodiments, the method can further include, with respect to each layer of the plurality, generating a transport layer packet comprising the data of the corresponding layer. For example, regarding

<p dir="rtl">15 For each time interval (for example a frame), a transmission layer packet corresponding to each plurality of layers can be generated.</p>

In embodiments, the compressed audio representation can also contain additional basic side information for decoding the underlying compressed audio representation into a basic reconstructed audio representation. Additional basic side information can contain information that specifies the decoding of a component

<p dir="rtl">20 One or more sets of components based on other related components. The method may also include decoding the additional basic collateral information into a plurality of additional basic collateral information pieces. The method may also include adding basic side information to the basal layer (including portions of the additional basic side information in the basal layer or assigning additional basic side information to the basal layer for the purpose of</p>

<p dir="rtl">25 transmission or storage, for example). Each piece of side information can correspond</p>

8872

-8-

Basic side information with a corresponding layer and may contain information that determines the decoding of one or more components assigned to the relevant layer in reliance (solely) on other corresponding components assigned to the corresponding layer and any layers below the corresponding layer. That is, each piece of additional basic side information identifies Components in the corresponding layer to which this corresponds

<p dir="rtl">5 The piece of additional basic side information without reference to any other components assigned to layers above the corresponding layer.</p>

By configuring this way, the proposed method avoids fragmentation of additional basic side information by adding all parts to the basal layer. In other words, all additional pieces of essential side information are included in the basal layer. It includes decomposition of side information

<p dir="rtl">10 Additional Basic: Provides a portion of additional basic side information for each layer that does not require identifying components in higher layers. Therefore, regardless of the highest usable layer, it is sufficient for the decoder to decode the additional basic side information contained in the layers up to the highest usable layer.</p>

In embodiments, the additional basic side information may include information specifying the decoding (e.g. decompression 15) of one or more components of the plurality of components based on

Other related components. For example, additional background information may represent side information related to the signal from one ear by relying on signals from the other ear. Therefore, additional basic side information can be referred to as approved basic side information.

<p dir="rtl">20 In embodiments, representations of compressed audio at successive time intervals may be treated as equal time intervals for example. Successive time intervals may be frames. Therefore, the method can work on a frame basis, i.e. the compressed audio representation can be encoded in a frame manner. A compressed audio representation may be available for each successive time interval, i.e., each frame. That is, the compression process through which the sound representation is obtained can be triggered</p>

<p dir="rtl">25 Compressed on a frame basis.</p>

8872

-9-

In embodiments, the method can further include generating configuration information that indicates, with respect to each layer, the components of the underlying compressed audio representation assigned to that layer. Therefore, the decoder can already access the information needed for decoding without unnecessary parsing through the received data payloads.

<p dir="rtl">5 According to another aspect, a method is described for layered coding of compressed audio representation with respect to</p>

With a voice or sound field. A compressed audio representation can contain a basic compressed audio representation that includes a set of components. The combination of components may be complementary components. A compressed audio representation can also contain basic side information (independent basic side information) and third information (independent basic side information).

<p dir="rtl">10 Supported) for decoding the underlying compressed audio representation into a basic reconstructed audio representation of the sound or sound field. The underlying side information may contain information that specifies the decoding of one or more components of a set of components individually and independently of the other components. Additional basic side information contains information that determines the decoding of one or more components of a set of components based on other related components</p>

<p dir="rtl">15 The method may include subdividing (for example, grouping) a set of components into several subsets of components. The method may also include assigning (for example, adding) each of the groups to a stratum within a set of hierarchical layers. Personalization can indicate a connection between groups and corresponding classes. It can be said that the components assigned to the corresponding class are included in that class</p>

<p dir="rtl">20 The number of groups may correspond (for example, be equal) to the number of layers. The group of layers may contain a basal layer and one or more hierarchical reinforcement layers. The method may include adding basic side information to the basal layer (including side information in base layer or assigning essential side information to the base layer for the purpose of transmission or storage, for example). The method may also include</p>

<p dir="rtl">25 Decompress additional basic side information into a set of side information parts</p>

8872

-10-

Additional basic side information and adding pieces of additional basic side information to the base layer (including parts of additional basic side information in the base layer or assigning additional basic side information to the base layer for the purpose of transmission or storage, for example). Each piece of information can correspond to Basic sidebar with corresponding layer and contains

<p dir="rtl">5 Information that specifies the decoding of one or more components assigned to the relevant layer relying (solely) on other corresponding components assigned to the corresponding layer and any layers located below the corresponding layer.</p>

Through this configuration, the proposed method ensures that appropriate additional basic side information is available for each layer to decode the components contained in any layer up to the corresponding layer without

<p dir="rtl">10 The need for correct reception or decoding (or as common knowledge) of any higher layers. In the case of compressed HOA representation, the proposed method in vector coding mode ensures that there is a vector V appropriate for all components of the layers up to the highest usable layer. Specifically, the method excludes The proposed case is that no clear signals are sent with the elements of the vector V that correspond to the components in the higher layers. Accordingly, the information contained in the layers is</p>

<p dir="rtl">15 down to the highest usable layer sufficient to decode (decompress) any components belonging to</p>

Layers down to the highest usable layer. Hence, decompression of the corresponding reconstructed HOA representations with respect to lower layers is verified in an appropriate manner even if higher layers are not properly received by the decoder. On the other hand, the proposed method allows to make the most of the required bandwidth reduction that can be achieved

<p dir="rtl">20 When applying layered encryption.</p>

The models presented on this side may relate to the models of the previous side.

According to another aspect, a method of decoding representing a compressed sound with respect to a sound or sound field is described. The representation of compressed audio can be encoded in a set of hierarchical layers. A hierarchical layer group can contain a base layer and one or more hierarchical reinforcement layers. It was completed

<p dir="rtl">25 Assign components of a basic compressed audio representation from a sound or sound field to a group</p>

8872

-11-

Layers. In other words, a set of layers can contain basic side information components. Components can be assigned to corresponding layers in related component groups. The combination of components may be complementary components. The basal layer can contain side information essential for decoding the underlying compressed audio representation. Probably

<p dir="rtl">5 Each layer contains a piece of augmentation side information that includes variables to improve the underlying reconstructed sound representation that can be obtained from the data contained in the corresponding layer and any of the layers below the corresponding layer. The method may include receiving corresponding data loads corresponding to the hierarchical set of layers. The method may also include specifying a first layer indicator indicating the highest usable layer among the plurality of layers to be used</p>

<p dir="rtl">10 In decoding the underlying compressed audio representation into the underlying reconstructed audio representation with respect to a sound or sound field. The method may include obtaining the underlying reconstructed audio representation from components assigned to the highest usable layer and any of the layers below the highest usable layer using the underlying side information. The method may also include specifying a second layer indicator indicating the lateral information portion of the reinforcement which</p>

<p dir="rtl">15 It shall be used to enhance (enhance) the underlying reconstructed sound representation. The method may further comprise obtaining the reconstructed sound representation of the sound or sound field from the underlying reconstructed sound representation by reference to a layer 2 indicator.</p>

Through this configuration, the proposed method ensures the highest quality representation of the reconstructed sound using the available (correctly received) information to the best possible extent.

<p dir="rtl">20 In embodiments, components of the underlying compressed audio representation may correspond to binaural signals (or binaural transmission signals). The binaural signals may represent dominant audio signals or HOA sequences. The signals can be quantized Related to one ear.</p>

In one embodiment, the underlying side information may contain information that determines the decoding

<p dir="rtl">25 Encryption (eg decompression) of one or more components of a group of components individually</p>

8872

-12-

Independent of other components. For example, basic side information may represent side information related to the signal related to one individual ear independently of the signal related to one of the other ears. Therefore, basic side information can be referred to as independent basic side information.

<p dir="rtl">5 In embodiments, the reinforcement collateral information may represent the reinforcement collateral information. The augmentation side information may include predictor variables of the underlying compressed audio representation to enhance (for example, enhance) the underlying reconstructed audio representation that can be obtained from the underlying compressed audio representation and the underlying side information.</p>

In embodiments, the method may further include specifying, with respect to each layer, a receiver

<p dir="rtl">10 Corresponding layer correctly or not. The method may also include identifying the first layer indicator as an indicator of the layer immediately below the lower layer that is not properly received.</p>

In embodiments, determining the second layer index may include determining that the second layer index is equal to the first layer index or determining an index value such as the second layer index indicating that lateral information is not being used for reinforcement when obtaining the reconstructed sound representation. In the latter case, it may be equal

<p dir="rtl">15 Reconstructed audio representation with basic reconstructed audio representation.</p>

20

In embodiments, data loads may be received and processed at successive time intervals such as equal time intervals. Successive time intervals may be frames. Accordingly, it is possible for the method to work on a frame-based basis. The method may further include that if the compressed audio representations at successive time intervals can be decoded independently of each other, the equality of the second layer index with the first layer index is determined.

In embodiments, data loads may be received and processed at successive time intervals such as equal time intervals. Successive time intervals may be frames. Accordingly, it is possible for the method to work on a frame-based basis. The method may also include that, with respect to a particular time interval among successive time slots, in the event of inability to decode

8872

-13-

Compressed audio representations of successive time intervals independently of each other, the receipt of the corresponding pitch being determined correctly or not with respect to each pitch. The method may further include determining the first layer index of a given interval as the smallest index of the first layer index of the preceding interval of the given interval and the index of the layer immediately below the lowest layer and not

<p dir="rtl">5 It is received correctly.</p>

In embodiments, the method may further include that with respect to a given interval, if the compressed audio representations of successive intervals cannot be decoded independently of each other, the first layer index of the given interval is determined to be equal to the first layer index of the interval Previous timeline. The method may also include that if

<p dir="rtl">10 The equality of the index of the first layer of a given interval with the index of the first layer of the previous interval, the equality of the index of the second layer of a given interval with the index of the first layer of a given interval is determined. The method may further include that if the first layer index for a given interval is not equal to the first layer index for the preceding interval, an index value is determined as a second layer index indicating that no side information is used for reinforcement when obtaining the sound representation.</p>

<p dir="rtl">15 Reconstituted.</p>

In embodiments, the basal layer may include at least one piece of basic side information that corresponds to a corresponding layer and contains information that determines the decoding of one or more components assigned to the relevant layer depending on other components assigned to the corresponding layer and any layers located below. corresponding class. The method may also include:

<p dir="rtl">20 However, with respect to each piece of additional basic side information, the piece of additional basic side information is decoded with reference to the components assigned to its corresponding layer and any layers below the corresponding layer. The method may further include correcting the additional basic side information portion by reference to the components assigned to the highest usable layer and any layers located between the highest usable layer and the corresponding layer. Can be obtained</p>

<p dir="rtl">25 Basic reconstructed audio representation of components assigned to the highest usable layer and any</p>

8872

-14-

From the layers below the highest usable layer using the basic side information and the corrected parts of the additional basic side information obtained from the parts of the additional basic side information that correspond to the layers up to the highest usable layer.

In embodiments, additional basic side information may include information that determines the decoding

<p dir="rtl">5 Encoding (e.g. decompression) of one or more components of a set of components based on other related components. For example, additional basic side information may represent side information related to the signal related to one ear based on the signals related to one of the other ears. Therefore Additional essential side information may be referred to as approved essential side information.</p>

<p dir="rtl">10 According to another aspect, a method of decoding representing a compressed sound with respect to a sound or field is described</p>

voice. The representation of compressed audio can be encoded in a set of hierarchical layers. A hierarchical layer group can contain a base layer and one or more hierarchical reinforcement layers. Components of a basic compressed audio representation of a sound or sound field are assigned to a layer group. In other words, a set of layers can contain side information components

<p dir="rtl">15 the basic. Components can be assigned to corresponding layers in related component groups. The combination of components may be complementary components. The basal layer can contain side information essential for decoding the underlying compressed audio representation. The basal layer may also include at least one piece of basic side information that corresponds to a corresponding layer and contains information that determines the decoding of one or more components.</p>

<p dir="rtl">20 The number assigned to the relevant layer depends on the other components assigned to the corresponding layer and any layers below the corresponding layer. The method may include receiving corresponding data loads corresponding to the hierarchical set of layers. The method may also include specifying a first layer index indicating the highest usable layer among the plurality of layers to be used in decoding the underlying compressed audio representation into the underlying reconstructed audio representation therein.</p>

<p dir="rtl">25 Pertaining to a sound or sound field. The method may also include with respect to each part</p>

8872

-15-

From the additional basic side information, the additional basic side information portion is decoded with reference to the components assigned to its corresponding layer and any layers below the corresponding layer. The method may further include that for each essential side information portion, the additional essential side information portion is corrected by reference to the components

<p dir="rtl">5 Assigned to the highest usable layer and any layers between the highest usable layer and the corresponding layer. The basic reconstructed sound representation can be obtained from the components assigned to the highest usable layer and any of the layers below the highest usable layer using the basic side information and the corrected parts of the additional basic side information obtained from the parts of the additional basic side information that correspond to Layers</p>

<p dir="rtl">10 down to the highest usable layer. The method may also include specifying an indicator</p>

The second layer is equivalent to the first layer indicator or indicates the omission of side information of the reinforcement during decoding

Encryption.

Through this configuration, the proposed method ensures that the additional essential side information ultimately used in decoding the underlying compressed audio representation does not include elements

<p dir="rtl">15 Frequently used to make the actual decoding process of the underlying compressed audio representation more efficient.</p>

The models presented on this side may relate to the models of the previous side.

According to another aspect, an encoder is described for layered encoding of a compressed audio representation with respect to a voice or sound field. A compressed audio representation can contain a basic compressed audio representation that includes a set of components. It could be a combination of components

<p dir="rtl">20 They are complementary components. The compressed audio representation may also contain essential side information for decoding the underlying compressed audio representation into an underlying reconstructed audio representation of the sound or sound field. The compressed audio representation may also contain augmented side information containing variables to enhance (for example, enhance) the underlying reconstructed audio representation. The encoder may have a processor configured to perform all or some of the</p>

<p dir="rtl">25 Method steps according to the first aspect and the second aspect mentioned above.</p>

8872

-16-

According to another aspect, a decoder is described for decoding representations of compressed audio with respect to a sound or sound field. The representation of compressed audio can be encoded in a set of hierarchical layers. A hierarchical layer group can contain a base layer and one or more hierarchical reinforcement layers. The components of a basic compressed audio representation of a sound or sound field are assigned to

<p dir="rtl">5 Layers group. In other words, a set of layers can contain basic side information components. Components can be assigned to corresponding layers in related component groups. The combination of components may be complementary components. The basal layer can contain side information essential for decoding the underlying compressed audio representation. Each layer can contain a piece of reinforcement side information that includes variables</p>

<p dir="rtl">10 To improve (enhance) a basic reconstructed audio representation obtained from the data contained in the corresponding layer and any of the layers below the corresponding layer. The set-top box may have a processor configured to perform all or some of the method steps in accordance with Aspects 3 and 4 mentioned above. .</p>

In other respects, methods, devices and systems for decoding the sound representation of a surround sound system are directed

<p dir="rtl">15 High order (HOA) with respect to a sound or sound field. The device may have a receiver configured to receive, or the method may receive, a bit stream containing an HOA representation that corresponds to a set of hierarchical layers containing a base layer and one or more hierarchical reinforcement layers. Components of a basic compressed audio representation of a sound or sound field are assigned to a layer group, where the components are assigned to corresponding layers in corresponding groups of .</p>

<p dir="rtl">20 the components. The device may include a decoder configured to decode or the method may include decoding a compressed HOA representation based on fundamental side information associated with the basal layer and based on reinforcement side information associated with one or more hierarchical reinforcement layers. Basic side information may include basic independent side information related to signals related to the first individual ear that will be independently decoded at</p>

<p dir="rtl">25 Signals relating to one ear to the other. Each layer may contain reinforcement layers</p>

8872

-17-

The one or more hierarchies contain a portion of augmentation side information that includes variables to improve a basic reconstructed sound representation that can be obtained from the data contained in the corresponding layer and any of the layers below the corresponding layer.

Basic independent side information may refer to signals related to one of the first individual ears

<p dir="rtl">5 Which represents a directional signal in the direction of falling. The basic side information may also include basic dependent side information regarding the signals from the second individual ear that will be decoded dependently on the signals from the other ear. The underlying dependent side information may include vector-based signals distributed directionally within the sound field where the directional distribution is determined by the vector. The vector components are set at the value</p>

<p dir="rtl">10 is zero and is not part of the compressed vector representation.</p>

Components of the basic compressed audio representation may correspond to signals relative to one ear that represent the dominant audio signals or HOA representation sequences. A bit stream can include data loads that correspond correspondingly to a hierarchical set of layers. The reinforcement side information may include variables related to at least one element of: spatial expectation, synthesis of sub-domain directional signals, and parametric reproduction of the surrounding environment. The reinforcement side information may include information that allows missing parts of the sound or sound field to be predicted from directional signals. It is also possible to determine with respect to each layer that the corresponding layer is receiving correctly or not and the layer indicator for the layer that lies immediately below the lowest layer that is not

Receive it correctly.

<p dir="rtl">20 According to another aspect, a computer program is described. A computer program can be configured to be executed on a processor</p>

To perform some or all of the steps of the method set forth in the present document when executed on a computer.

8872

-18-

According to another aspect also, a storage medium is described. The storage medium may contain a computer program configured to execute on a processor to perform some or all of the steps of the method set forth in the present document when executed on a computer.

All statements made apply in relation to any of the above aspects or their respective forms

<p dir="rtl">5 On other aspects, there are corresponding models and models according to what an experienced person in the field will know. The repetition of these phrases in each aspect or model has been omitted for the sake of brevity.</p>

The methods and devices, including preferred embodiments, set forth in this document may be used alone or in combination with other methods and systems disclosed herein. In addition, all aspects and devices set forth herein may be combined in an arbitrary manner.

<p dir="rtl">10 Specifically, the features set forth in the protections may be combined with each other in an arbitrary manner.</p>

Multiple knocking steps and hardware attributes can be switched. Specifically, the details of the disclosed method may be implemented as a device configured to perform some or all of the steps of the method and vice versa as a person skilled in the art would recognize.

<p dir="rtl">15 Brief explanation of the drawings</p>

The invention is described hereinafter by way of example by reference to the accompanying drawings, where:

Figure 1 is a flow chart showing one provided example of a method for layered encryption in accordance with the embodiments in the disclosure;

<p dir="rtl">20 Figure 2 is an illustrative box plot showing one provided example of an encoder stage according to the embodiments set forth in the disclosure;</p>

8872

-19-

Figure 3 is a flowchart illustrating one example provided of decoding a compressed audio representation of a sound or sound field encoded into a set of hierarchical layers according to the embodiments in the disclosure;

Figures 4a and 4b are illustrative box plots showing examples provided on a decoder stage

<p dir="rtl">5 encryption in accordance with the forms contained in the disclosure;</p>

Figure 5 is an illustrative box plot showing one example provided of an application of an encryption device according to the embodiments in the disclosure; And

Figure 6 is an illustrative box plot showing one provided example of a decoder implementation according to the embodiments in the disclosure.

<p dir="rtl">10 Detailed description:</p>

First, a compressed sound field representation will be described

Hereinafter referred to as compressed sound representation for brevity as it applies to methods and encoders/decoders in accordance with the present disclosure. In general, a complete compressed audio representation (or sound field) may comprise (hereinafter referred to as audio representation).

<p dir="rtl">15 The full brevity CD consists of the following three components: a basic compressed audio representation (or sound field) (hereinafter referred to as the brevity CD representation), basic side information, and enhancement side information.</p>

The basic compressed audio representation itself comprises (consists of) a number of components (complementary components). The basic compressed audio representation may represent a characteristically larger proportion of

<p dir="rtl">20 Representation of complete compressed audio. The basic compressed audio representation may include binaural transmission signals representing the dominant audio signal or the original HOA representation sequences.</p>

8872

-20-

Basic side information is required to decode the underlying compressed audio representation and it is possible

Assume that it has a much smaller size compared to the basic compressed audio representation. The bulk of them may consist of unrelated parts, each of which specifies the decompression of only one component of the underlying compressed audio representation. It is possible that the basic side information contains part

<p dir="rtl">5 The first part may be known as basic side information and the second part may be known as basic side information.</p>

Both the first part and the second part, independent basic side information and additional basic side information, may specify the decompression of specific components of the underlying compressed audio representation. The second part is optional and can be omitted. In this case, it can be said that the representation of the compressed audio 10 consists of the first part (basic side information).

The first part (basic side information) may contain side information describing individual (supplemental) components of the underlying compressed audio representation that are independent of other (supplementary) components. Specifically, the first part (supplementary information) may specify the decoding of one or more components. More than a group of components individually, independently of and based on other components.

<p dir="rtl">15 The first part can be referred to as independent basic side information.</p>

The second (optional) part, also known as additional basic side information, can contain information describing individual complementary components of the basic compressed audio representation based on other (complementary) components. This second part can also be referred to as: It's basic side information

<p dir="rtl">20 Accredited. Specifically, accreditation may have the following characteristics:</p>

<p dir="rtl">- The basic side information adopted for each individual (supplementary) component of the basic compressed audio representation may obtain its maximum score if there are no other certain (supplementary) components included in the basic compressed audio representation.</p>

8872

-21-

<p dir="rtl">- If certain additional (supplementary) components are added to the basic compressed audio representation, the basic dependent side information with respect to the relevant individual (supplementary) component may become a subset of the basic dependent side information resulting in a reduction in its size.</p>

Boost side information is also optional. It can be used to improve or enhance (improve or

<p dir="rtl">5 Parametrically enhanced (base compressed audio representation). Its size is also assumed to be much smaller than that of the base compressed audio representation.</p>

Therefore, in embodiments, the compressed audio representation may include a basic compressed audio representation containing a plurality of components and basic side information for decoding (decompressing) the basic compressed audio representation into a basic reconstructed audio representation of the sound or sound field and side information for enhancement. It includes variables to improve or enhance (improvement or enhancement).

The basic reconstructed audio representation may also contain additional background information for decoding (decompressing) the underlying compressed audio representation into the underlying reconstructed audio representation, which may contain information specifying the decoding of one or more components. More than one set of ingredients depending on the other 15 related ingredients.

One example given of this type of complete compressed audio representation is in the representation of the sound field of a Higher Order Ambisonics system (HOA) as defined in the preliminary version of the MPEG-H 3D audio standard (Ref. 1), Chapter 12 and Appendix C 5. That is, a compressed sound representation may correspond to a 20 HOA sound (or sound field) representation with respect to a sound or sound field.

In this example, the basic compressed sound field representation (basic compressed sound representation) may contain (recognizable by) a number of components. The components may represent (correspond to) signals relevant to one ear. The signals are:

8872

-22-

Related to one ear in signals related to one ear are limited in quantity. Signals related to one ear may represent dominant acoustic signals or ambient HOA sound field component parameter sequences.

Basic collateral information can describe, among other things, how each of the signals relating to one of the two ears mentioned is how it contributes spatially to the sound field. for example

<p dir="rtl">5 For example, basic side information may identify a dominant acoustic signal as purely directional, meaning the presence of a general surface wave with a particular direction of incidence. Alternatively, the underlying side information may define an ear-specific signal as an original HOA parameter sequence containing a particular index. The basic side information can also be separated into part one and part two as indicated above.</p>

<p dir="rtl">10 The first part is collateral information (independent basic collateral information) related to signals related to one particular individual ear. This basic independent collateral information is independent of the presence of signals related to one of the other ears. This collateral information can identify, for example, a related signal with one ear to represent a directional signal (meaning a general flat wave) with a given direction of incidence. Alternatively, a specific signal with one ear can be defined as a representation coefficient sequence</p>

<p dir="rtl">15 The original HOA that has a specific indicator. The first part can be referred to as independent basic side information. In general, the first part (basic side information) may specify the decoding of one or more components of the set of signals relating to one ear individually and independently of the signals relating to one of the other ears.</p>

The second part is collateral information (additional basic collateral information) related to signals related to a particular individual ear. This collateral information is dependent on the presence of signals related to another ear. This collateral information can be used, for example, when identifying signals related to These signals are distributed directionally within the sound field, where the directional distribution can be determined by the vector. in a particular situation (see, for example,

<p dir="rtl">25 1 = CodedVVecLength(, certain components of this vector are set to zero and no</p>

8872

-23-

Represents part of a compressed vector representation. These components are those components that contain indices equivalent to the indices of the original HOA representation sequences and are part of the underlying compressed audio representation. This means that if individual components of a vector are encoded, their total number may depend on the underlying compressed audio representation. Specifically, it is possible to depend on the number

<p dir="rtl">5 Total over the parameter sequences contained in the original HOA representation.</p>

If parameter sequences of the original HOA representation are not included in the underlying compressed audio representation, the dependent fundamental side information for each vector-based signal includes all components of the vector and is of maximum size. If the original HOA representation parameter sequences containing certain indicators are added to the underlying compressed audio representation, the

<p dir="rtl">10 The components of the vector that contain these indicators contain more side information with respect to each vector-based signal, which reduces the amount of fundamental side information adopted with respect to the vector-based signals.</p>

The boost side information can include variables related to spatial (wideband) expectation (see Reference 1, Section 12.4.2.4.3) and/or variables related to signal synthesis.

<p dir="rtl">15 Sub-domain directionality and parametric peripheral transcription.</p>

Variables related to spatial (wideband) prediction can be used to predict (linearly) the missing parts of the sound field from directional signals.

Sub-band directional synthesis and parametric surround copying are tools

Compression was recently introduced into the MPEG-H 3D audio standard by amendment [see Reference 2, Section

<p dir="rtl">20 1[. These two tools allow frequency-based parametric prediction of the distribution of signals related to one of the following:</p>

Additional ears are space-wise to complete a spatially incomplete or incomplete compact HOA representation. The prediction may be based on basic compressed audio representation parameter sequences.

It is important to note that the aforementioned complementary contribution to the sound field is not represented within a representation

HOA is compressed with additional quantum signals, and even with additional side information of a smaller size

8872

-24-

so far. Accordingly, the above two encoders are particularly suitable for compressing HOA representations at low data transfer rates.

Another example is given of a compressed representation of one or more binaural signals in the above structure that may include spectral information encoded for non-frequency bands.

<p dir="rtl">5 linked down to a certain upper frequency which can be thought of as a fundamental compressed representation; Basic side information, which specifies the encoded spectral information (for example, by the number and range of encoded frequency bands); and enhancement side information, which includes (consists of) Spectral Band Replication (SBR) variables, which describes how to reconstruct parametrically from the compressed representation. The basic spectral information for higher frequency bands is not obtained</p>

<p dir="rtl">10 Take into account the basic compressed representation.</p>

The present disclosure proposes a layered coding method for representing a complete compressed sound (or sound field) with the above composition.

Compression may be frame-based on the part that provides compressed representations (in the form of data packets or equivalent frame loads) of successive time intervals. The time intervals may be equal or

<p dir="rtl">15 Different. It can be assumed that these data packets contain a flow tag, which is a value that indicates their size and the actual compressed representation data. The tire-based pressure ground will be assumed below, without limitation. In addition, unless otherwise indicated, without wishing to be restricted, the processing will be focused on a single frame and accordingly the frame indicator will be omitted.</p>

Each frame load is assumed to contain the entire captured compressed audio (or sound field).

<p dir="rtl">20 Considering data packets (or frame loads), each component of the basic compressed audio representation is denoted by 1,…, BSRC = ^. In addition, it is assumed to include a packet containing independent side information (side information Basic (referred to by BSI_I Which defines certain BSRC components of the underlying compressed audio representation independently of other components. Optionally, the ground can be assumed additionally</p>

8872

-25-

Includes a package containing approved side information (additional background information) referred to by the BSI_D BSRC defines certain components of the underlying compressed audio representation based on other components.

The information contained in the two BSI data packages can be combined_I And BSI_D In one data packet

<p dir="rtl">5 ^ Basic side information. It can be said that a single data packet^ includes...</p>

Among other things, parts that each define a particular BSRC component of the sound representation

Basic CD. It can be said that each of these parts in turn includes a part of independent side information and, optionally, a part of dependent side information.

Finally, it may include the carrying of reinforcement collateral information (reinforcement collateral information).

<p dir="rtl">10 Denoted by ^^ and describing how to enhance or enhance the sound (or sound field) reconstructed from the complete underlying compressed audio representation.</p>

The proposed solution for layered encryption deals with the necessary steps to enable the compression part including packing the data packets for transmission and the receiver and decompression part. Each part will be described in detail below.

<p dir="rtl">15 First, compression and packaging (for transmission) will be described. Specifically, representation components and elements will be described</p>

The complete compressed audio (or sound field) in the case of layered encoding.

Figure 1 shows a flowchart in which one of the examples provided is a method of compression and packing (a method of encoding or a method of layered encoding to represent compressed sound in relation to a sound or sound field). Assignment (assignment) of individual loads to the base layer and (1-) layers can be accomplished.

<p dir="rtl">20 Reinforcement by transport layer packing method. Figure 2 shows a box plot of one of the given examples of assigning individual loads.</p>

As indicated above, the full compressed audio representation 2100 may for example relate to a compressed HOA representation comprising a basic compressed audio representation. The compressed audio representation 2100 may include a plurality of components (e.g., signals relative to one ear).

8872

-26-

Example) 2110-1, … 2110-, independent basic side information (independent side information) 2120, optional enhancement side information (enhancement side information) 2140, and optional independent basic side information (additional basic side information) 2130. The basic side information may be 2120 In the information needed to decode the underlying compressed audio representation to

<p dir="rtl">5 A basic reconstructed sound representation of sound or sound field. The basic side information 2120 may contain information that determines the decoding of one or more components (eg signals from one ear) individually and independently of the other components. The reinforcement side information 2140 may include variables to enhance (enhance) the representation of Basic reconstructed audio The basic side information 2130 may also be information</p>

<p dir="rtl">10 Needed to decode the underlying compressed audio representation into the underlying reconstructed audio representation, which may contain information that determines the decoding of one or more components of the plurality depending on other related components.</p>

Figure 2 shows a key assumption where there is a set of hierarchical layers that includes one base layer (base layer) and one or more reinforcement (hierarchical) layers. For example, there could be

<p dir="rtl">15 In total, 1 base layer and 1 reinforcement layer. The layer group contains</p>

Hierarchical layer index layer increases successively. A value lower than the layer index (layer index 1) corresponds to the basal layer. It will also be understood that the layers will be arranged from the basal layer through the reinforcement layers all the way to the highest overall reinforcement layer (overall top layer).

The proposed method can be performed on the basis of frames (framework method). Specifically, it can

<p dir="rtl">20 Compressing the compressed audio representation 2100 into successive time intervals such as equal time intervals. Each interval can correspond to a frame. The method described below can be performed for each successive time interval (frame).</p>

At 1010 s in FIG. 1, the component assembly 2110 is subdivided into several component groups. Each of the groups is then assigned (added or assigned) to the layer

<p dir="rtl">25 The counterpart is within the hierarchical set of classes. Therefore, the number of groups corresponds to the number of layers.</p>

8872

-27-

For example, the number of groups may be equal to the number of layers since there is one group of components per layer. As indicated above, a layer group can contain a base layer and one or more (1-) hierarchical reinforcement layers.

In other words, the underlying compressed audio representation is subdivided into parts that are assigned to layers

<p dir="rtl">5 Individuality. Without affecting the general aspect, the division of sets can be described by 1 + numbers</p>

<p dir="rtl">, ,…,0 = with 1 = 0 and 1 + = ^ so that the BSRC components are assigned to -</p>

Class with respect to > ^ ≥_1- .

At 1020 s, the component groups are assigned to their corresponding layers. At 1030 BC, basic lateral information 2120 is added (assigned) to the basal layer (the lowest layer of the group of 10 hierarchical layers).

That is, due to its small size, it is proposed to include the complete basic side information (basic side information and optional additional basic side information) in the basal layer to avoid unnecessary segmentation.

If the compressed audio representation considered includes essential side information

<p dir="rtl">15 Independently (additional basic side information), the method may also include (not shown in Figure 1) decomposing the additional basic side information into a plurality of parts 2130-1, …, 2130-</p>

Additional basic side information. Additional basic side information pieces can be added (assigned) to the base layer. In other words, additional basic side information pieces are included in the base layer. Each basic side information piece can correspond to

<p dir="rtl">20 Corresponding layer and may contain information that determines the decoding of one or more components assigned to the relevant layer depending on other corresponding components assigned to the corresponding layer and any layers below the corresponding layer.</p>

Therefore, although the basic independent side information BSI is left out_I (Basic side information) 2120 Unchanged For customization, the approved basic side information must be treated privately

8872

-28-

For layered encryption to allow correct decoding at the receiver side and to limit on the other side the amount of underlying side information to be transmitted on the other side. It is proposed to break down the basic side information adopted into parts referred to as:

during_,1,…,,BSI_D = , where the -part contains essential supported side information

<p dir="rtl">5 For all components₁ ≤ ^ &lt;, BSRC_- The basic compressed audio representation assigned to the Buffett layer ensures that the basic side information adopted for the audio representation is output</p>

pressure taken into account. If the relevant supported side information is not output, a blank can be assumed for parts of the compressed audio representation_,BSI_D. It is possible to depend on each piece of basic side information_,BSI_D On all components 1 ≤ ^ &lt; BSRC, included

<p dir="rtl">10 In all layers up to the -component (included in all layers,...,1 = ^).</p>

If the basic side information package is independent_^^ Small in size, reasonable to maintain

It is fully integrated and added (allocated) to the base layer. Optionally, an analysis similar to that of the dependent basic side information can be performed in relation to the independent basic side information and provide packages._,^^,...,1 = . This is useful for reducing the layer size

<p dir="rtl">15 Basic by adding (assigning) parts of the approved basic side information to the layers</p>

with the corresponding components of the underlying compressed audio representation.

At 1040 s, a set of parts 2140-1,..., 2140- side information of the reinforcement can be determined. Each layer may contain a portion of the reinforcement side information, which may contain variables to enhance (enhance) the underlying reconstructed sound representation that can be obtained from the data included in

<p dir="rtl">20 The corresponding class and any of the classes below the corresponding class.</p>

The reason for performing this step is that in the case of layered encoding, it is important to realize that the reinforcement side information must be calculated with respect to each additional layer because it is for the underlying decomposed sound (or sound field) reinforcement that depends on the layers available for analysis. Specifically , the audio (or sound field) is based on the fundamental decomposition of a given decodable layer

<p dir="rtl">25 (highest usable layer) on the components included in the highest decodable layer and all</p>

8872

-29-

Layers that lie above the decodable layer. Then, pressure M must provide individual boost side information data packets (parts of boost side information) referred to by ESIm; 701 = M, where the reinforcement lateral information contained in m bundle is calculated

ESIm data to enhance the representation of sound (or sound field) obtained from all 5 data included in the basal layer and enhancement layers that have indices less than m

(All data contained in layer m—and all layers below layer 77).

At 1050, the part set 2140-1, ..., 2140 ~Μ of the reinforcement side information is assigned (added or assigned) to the layer set. Each part of the reinforcement side information part group is assigned to the corresponding layer of the layer group. For example, 10 all layers include a corresponding portion of reinforcement side information.

The assignment of reinforcement and/or core side information to the corresponding layers may be referred to in the configuration information generated by the coding method. In other words, the correspondence between the reinforcement and/or core side information and the corresponding layers may be referred to in the configuration information. In addition, configuration information may indicate, with respect to each layer, the components of the compressed audio representation

<p dir="rtl">15 Custom base (included for example) for that layer. Additional essential side information pieces are included in the basal layer and may correspond to layers different from the basal layer.</p>

Briefly, in the compression phase, a frame data packet, denoted by FRAME, is provided with the following structure:

(1)1441 [Explain... BSRC; BSII Β5Ι5 1...1350 ESIi...ESIm]

<p dir="rtl">20 In addition, packages 357/9, BSli of 1A,...,1-171 can be combined into one package.</p>

1361, wherein the frame data packet in this case referred to 11141 has the following composition:

(2) FRAME = [BSRCi BSRC₂ ... BSRCj BSI ESIi ESI ... ESI]

The order of individual loads with a tire data package may generally be random.

858572

-30-

Individual data packets can then be grouped into payloads, identified by special data packets that include a flow tag, a value indicating their size and the actual compressed representation data. The use of loads allows for simplified deduplication on the receiver side, offering the advantage of being able to eliminate unused loads without the requirement of analyzing them. Possible grouping can be done by

<p dir="rtl">5 - Assign (for example assign) each ^packet,,...,1 = ^, to a referenced individual load</p>

To him through.

<p dir="rtl">- Allocate (assign, for example) the reinforcement side information data package ^^ and the approved side information data package_,^^ To carry a single reinforcement indicated by</p>

^، ,…,1 = .

<p dir="rtl">10 - Customize the basic side information package_^^ To carry separate side information is indicated</p>

To it through. ^.

Optionally, if the size of the independent basic side information is large, each can be customized with its components,_,^^, ,…,1 = , to the reinforcement load ^. In this case, it is a pregnancy

SideInfo^ is empty and can be ignored.

<p dir="rtl">15 Another option is to customize all approved basic side information data packages</p>

_,^^To carry side information^, which is reasonable if the size of the side information

The approved core is small.

Finally, a frame data packet, denoted by ^^^, can be provided with the following structure

(3) FRAME = [^̅̅̅̅1 … ^̅̅̅̅J^̅̅̅̅̅^^{̅̅ ̅}^^̅̅̅1 … ^̅^^̅̅̅^]

<p dir="rtl">20 The order of individual loads with the frame data packet may generally be arbitrary.</p>

The method may also include (not shown in Figure 1) generating, with respect to each layer of the plurality, a transmission data packet (base layer packet 2200 and reinforcement layer packets 1-M

8872

-31-

2300-1,…, 2300-(1-)() including the corresponding layer data (components and information

Basic side information, reinforcement side information regarding the base layer or components, and reinforcement side information for one or more reinforcement layers.

Transport layer packets related to different layers may have different priority levels

<p dir="rtl">5 By sending. Accordingly, the method may also include (not shown in Figure 1) generating a transport flow for transmitting layer group data where the base layer has the highest priority for transmission and the hierarchical boosting layers have decreasing priority for transmission. Accordingly, the priority degree corresponds to Higher transmission with greater range of fault protection and vice versa.</p>

Unless other steps are required as a prerequisite, the above steps can be performed in any way

<p dir="rtl">10 Arrangement It is understood that the arrangement provided for example in Figure 1 is not provided exclusively.</p>

Figure 3 shows a method for decoding a compressed audio representation from a voice (or sound field) for decoding or decompression (unpacking). Examples given on a corresponding transmitter and decompression stage are illustrated in the illustrative box plots of Figures 4a and 4b.

<p dir="rtl">15 Based on the above, the compressed audio representation can be encoded in a hierarchical layer set. from</p>

The layer set may be assigned (may include) components of the underlying compressed audio representation, where components are assigned to corresponding layers in corresponding groups of components. The base layer may contain the essential side information for decoding the underlying compressed audio representation. Each layer may contain One piece of side information for the reinforcement is shown

<p dir="rtl">20 above which includes variables to improve the representation of basic reconstructed audio that can be obtained from the data contained in the corresponding layer and any of the layers below the corresponding layer.</p>

The proposed method can be performed on a frame basis (frame method). Specifically, a stored representation of sound or sound field for successive time intervals can be generated as equal time intervals on

8872

-32-

for example. Intervals may be frames for example. The steps below can be performed for each successive interval (frame).

At 3010, data payloads (transport layer packets) that correspond to the layer group are received. Data payloads can be received as part of a bit stream containing a compressed HOA representation of audio

<p dir="rtl">5 Or a sound field, the representation of which corresponds to the hierarchical set of classes. Hierarchical layers contain a base layer and one or more hierarchical reinforcement layers. Components of a basic compressed audio representation of a sound or sound field are assigned to a layer group. Components are assigned to corresponding layers in relevant component groups.</p>

Individual layers can be multiplexed to provide the packet of frames received from the full Compressed 10 audio representation. The package of frames received can be indicated by

(4)15! B s ] D, 1 0 BSES 1a B SRCi ... BSRCyj—1 15 1 BS -39 30 1? rcj a

In the alternative case of the BSIj and 0rk=m packages being combined into a single package 851, the individual layers may be multiplexed to provide the package of frames received from the complete compressed audio representation referred to by

<p>BS] ESIi BSRCi ... BSRC1512 ... 1_(will not BSRC BSRC</p>

<p>(5) 15</p>

Regarding loads, the tire package received can be indicated by

<p>(6) FRAME: Ρ?Ρ1 ... RPj 0 7515 ... 757,</p>

The frame packet can then be passed to a decompressor or decoder 4100. If the individual layer transmission is error-free, the flow flag of the side information carrying portion is set for reinforcement.

20 The content of at least 51.4% (which corresponds to part of the boost side information) is set to a value of 'correct'. In the event of an error due to a single layer transmission, the flow signal within the boost side information load in at least this layer is set to 'incorrect'. Therefore, it can be Determine the flow of a layered package from the flow carrying the lateral reinforcement information included (from its flow label).

858572

-33-

In decompressor 4100, the received frame packet can be deduplicated. To this end, information on the size of each load can be used to avoid unnecessary analysis of individual load data.

At 3020 s, a first layer indicator is selected indicating the highest layer (highest usable layer or).

<p dir="rtl">5 The highest decodable layer) among the set of layers that must be used to decode the underlying compressed audio representation into the underlying reconstructed audio representation with respect to a sound or sound field.</p>

In addition, at 3020 s, there can be a selected value (layer indicator)_B The highest layer (highest usable layer) that will be used in decompressing the underlying audio representation. 10 The highest boost layer that will actually be used in decompressing the underlying audio representation is identified from

within 1 -_B. Since each layer contains exactly one reinforcement side information load (part of the reinforcement side information), it can be determined based on the reinforcement side information load whether or not the containing layer is effective (correctly received or not). Accordingly, a choice can be made using all information loads Lateral reinforcement 1,…,, ESI = (or correspondingly, ^, =).

15 ,…,1(.

At 3030 s, a basic reconstructed sound representation is obtained. The basic reconstructed audio representation can be obtained from components assigned to the highest usable layer indicated by the first layer index and all layers below the highest usable layer using basic side information (or using basic side information in general).

(with) all BSRC₁,…, BSRC20 can provide basic compressed audio representation component loads

Basic side information loads )^ or BSI_I And_,1,…,,BSI_D = (and value_B،

To a basic representation decompression processing unit 4200. The basic representation decompression processing unit 2400 (shown in Figures 4a and 4b) represents the basic audio (or sound field) representation using components of the basic compressed audio representation contained in the lower layers._B, which is the class

8872

-34-

Basal1 -_B and reinforcement layers (layers up to the layer indicated by the first layer indicator). Alternatively, the payloads of the basic compressed audio representation components contained in the lower layers along with the corresponding basic side information payloads may be provided only to the basic representation decompression processing unit 4200.

<p dir="rtl">5 It is assumed that the necessary information about the components of the underlying compressed audio representation (or sound field) contained in the individual layers of the decompression device 4100 is known from the data packet containing the configuration information intended to be transmitted and received before the frame data is packetized.</p>

To provide approved side information data packages_,^^, ,…,1 = and data packet

Reinforcement side information ^^ All reinforcement loads may be entered into the 10 microanalyzer 4400 (see Figure 4b) from the decompression device 4100 with the value and value.

The parser loads all data packages that will not be used in the actual decompression process. If the value is equal to zero, all booster side data packets can be assumed to be empty.

If the base layer includes at least one supported base side information load (part 15 of additional basic side information) that corresponds to a corresponding layer, the decoding of each load may include

Individual dependent basic side information (i.e., BSID = ,1,…,B) is part of

Additional basic side information) consists of (1) decoding part of the additional basic side information with reference to the components assigned to the corresponding layer and all layers below the corresponding layer (core decoding) and (2) debugging the part of the additional basic side information 20 with reference to Components assigned to the highest usable layer and any of the layers between the highest usable layer and the corresponding layer (correction). Accordingly, additional basic side information that corresponds to the corresponding layer includes Information that determines the decoding of one or more components assigned to the corresponding layer depending on other components assigned to the corresponding layer and any layers located below the corresponding layer.

8872

-35-

The basic reconstructed audio representation can then be obtained from the components assigned to the highest usable layer and any of the layers below the highest usable layer using the basic side information and the corrected parts of the additional basic side information obtained from the parts of the additional basic side information that Corresponds to classes

<p dir="rtl">5 down to the highest usable layer.</p>

Specifically, the basic decoding of each load may involve,1,...,B,BSID=,using

Its reliance on the first basic compressed audio representation components1 -

Included in the first layers that are assumed in the BSRC1 stage,…, BSRC( )-1

Encryption.

<p dir="rtl">10 It may involve successive correction for each load_,1,…, _B ,BSI_D =, consider reconfiguration</p>

The basic sound component is ultimately one of the first basic compressed sound representation components 1 - 1-( )BSRC1,..., BSRC included in the first layers &lt; B, which are components

More than the supposed components of basic decoding. Accordingly, correction can be accomplished by eliminating old information and this can be done because of the first assumed property of side information

<p dir="rtl">15 Supported Core When some supplementary components are added to the basic compressed audio representation, the underlying side information of each individual component (supplementary) becomes a subset of the original information.</p>

At 3040 s, a second layer indicator can be determined. The second layer indicator may indicate which part of the boost side information should be used to improve (boost) the underlying reconstructed sound representation.

<p dir="rtl">20 In addition to the first layer indicator, an indicator (second layer indicator) can be specified._E Carry the boost side information (part of the second boost information) to be used for decompression. The second layer index may often be equal to the first layer index_B Or equal to zero. Augmentation may be achieved according to the representation of the underlying sound obtained from the highest usable pitch or not achieved at all.</p>

8872

-36-

At 3050 s, the reconstructed sound representation of the sound or sound field is obtained from the underlying reconstructed sound representation by referring to the second layer index.

That is, the parametric representation of the reconstructed sound is obtained using the reinforcement side information (part of the reinforcement 5 side information) indicated by the second layer indicator. As indicated further below, it may indicate Indicator

The second layer is to not use any of the side information for reinforcement at all at this point. The reconstructed sound representation may then correspond to the underlying reconstructed sound representation.

To this end, the reconstructed basic sound representation is presented with all the enhancement side information loads ^ESI1,...,ESI, and the basic side information loads (i.e., ^ or BSII

<p dir="rtl">10 And ,1,…,M, BSID = (, and the value of E to the Enhanced Representation Decompression Processing Unit 4300</p>

(As shown in Figures 4a and 4b) resulting in the final reinforcement (or sound field) representation of 2100" being calculated using only the ESI load and eliminating all other ESI loads. Alternatively, only the ESI load can be introduced ESI, instead of all the boost side information loads to a processing unit

<p dir="rtl">15 Decompress the augmented representation 4300. If the value is equal_E With a value of zero, all reinforcement side information loads are eliminated (or alternatively, no reinforcement side information loads are introduced) and the final reconstructed reinforcement sound representation 2100" is equal to the reconstructed base sound representation. The reinforcement side information load can then be obtained ESI by microanalyzer 4400.</p>

<p dir="rtl">20 Figure 3 generally shows the decoding of the compressed HOA representation based on the basic lateral information associated with the basal layer and based on the reinforcement lateral information associated with one or more hierarchical reinforcement layers.</p>

8872

-37-

Unless other steps are required as a prerequisite, the above steps may be performed in any order and it is understood that the order given as an example in Figure 3 is not provided exclusively.

The details of choosing the layers for decompression (choosing the first layer index and the

<p dir="rtl">5 The second layer) in steps 3020 s and 3040 s.</p>

Determining the indication of the first layer may include determining, with respect to each layer, whether or not the corresponding layer is received correctly. Determining the first layer indicator may also include specifying the first layer indicator as an indicator of the layer immediately below the lowest layer and not being received correctly. Whether a layer is received correctly or not can be determined by evaluating whether the reinforcement side information load of that layer 10 is received correctly or not. This can be done by evaluating the flow charts within loads

Side information for reinforcement.

Determining the Layer 2 index may generally involve determining that the Layer 2 index is equal to the Layer 1 index or specifying an index value such as the Layer 2 index (index value 0) that indicates that lateral information is not used for reinforcement when obtaining the reconstructed sound representation.

<p dir="rtl">15 If all frame data packets can be decompressed independently of each other,</p>

_B The highest layer (the highest usable layer) that will actually be used to decompress the audio representationBasic and index_E The load of the reinforcement side information that will be used in decompression must be the highest number of ^ of the load of the reinforcement side information that can be determined by itself by evaluating the flow signals present in the loads of the reinforcement side information. By using knowledge of the size of each of the 20 lateral reinforcement information loads, complex analysis of the actual load data to determine their degree of flow can be avoided.

That is, the equality of the second layer index with the first layer index can be determined if the compressed audio representations at successive time intervals can be decoded independently of each other. In this

8872

-38-

In the case, the reconstructed underlying sound representation can be boosted based on the load of boost side information to the highest usable layer.

If differential decompression is used with degrees of dependence between layers, the decision taken from the previous framework must be taken into account in addition. It should be noted that in the case of differential decompression,

<p dir="rtl">5 Independent frame data packets are often sent at regular intervals to allow decompression to begin from these intervals where the values become determined._B And_E Depending on the framework and implemented as follows:</p>

It is stated above.

To illustrate the proposed frame-based resolution in detail, the highest number (layer index) of carrying the reinforcement side information with respect to a frame is denoted by (^), and

<p dir="rtl">10 Layers (layer indicator) which will be selected and used to decompress the underlying audio representation by_B(), and the number of (layer index) carrying the side information of the enhancement that will be used in decompression with ()._E</p>

Using this illustration, the highest number of layers used in decompressing the underlying audio representation can be calculated by ()_B According to

(7) B() = min(B( - 1), ^()).15

by selecting()_B Not more than (1 - )_B ()^ Verify that all information is available

needed for differential decompression with respect to the underlying audio representation.

That is, if compressed audio representations cannot be decoded into successive time intervals (frames) independently of each other, it may involve determining the first layer index

<p dir="rtl">20 Determines, for each layer, whether the corresponding layer was correctly received or not and defines the index of the first layer of a given interval as the smallest index of the index of the first layer of the interval preceding the given interval and the index of the layer immediately below the lowest layer that was not correctly received.</p>

number() can be specified_E Enhancement side information loads that will be used in decompression according to

8872

-39-

_{)8( () = {}B() if B() =B(-1)

^E 0 else^.

Therefore, choosing 0 for ( ) indicates that the reconstructed underlying sound representation is not enhanced or enhanced using side information for reinforcement.

This means in particular that as long as the number of the top layer ()_B User in decoder

<p dir="rtl">5 Compressing the basic audio representation, the same number of corresponding layers are chosen. But if change()_B, boost is disabled by setting()_E On the zero value. Due to differential decompression</p>

Assumed for side information of reinforcement, cannot be changed according to ()_B Because this may need to decompress the corresponding reinforcement side information layer in the previous frame, which should not be implemented.

<p dir="rtl">10 That is, if compressed audio representations cannot be decoded into successive time intervals (frames) independently of each other, the first-layer index of a given interval is determined to be equal to the first-layer index of the previous interval. given time with the first layer index of the previous interval, the equality of the second layer index of a given interval with the first layer index of a given interval is determined on the side</p>

<p dir="rtl">15 The other is, if the first layer index of a given interval is not equal to the first layer index of the previous interval, an index value is specified as the second layer index indicating that no side information is used for enhancement when obtaining the reconstructed sound representation.</p>

Alternatively, if all the boost side information loads are decompressed down to ( )_E In parallel when decompressing, the selection rule in Equation (4) can be replaced by

(9) E() = B(). 20

Finally, it should be noted that for differential decompression, the number of the highest layer used only increases when data is packaged into independent frames, while a decrease is possible at each frame.

8872

-40-

It is understood that the proposed method of layered coding of compressed audio representation can be implemented by an encoder dedicated to performing layered coding of compressed audio representation. Said encoder may include corresponding modules configured to perform the corresponding steps described above. An example given of the encoder 5000 is shown in Figure 5.

<p dir="rtl">5 For example, said encoder 5000 may have a component subdivision unit 5010 configured to perform the above step 1010s, an allocation unit 5020 configured to perform the above step 1020s, and a basic side information allocation unit 5030 configured to perform</p>

step 1030s mentioned above, and the booster side information splitter 5040 is configured to perform

Step 1040S mentioned above, and the allocation unit 5050 is configured to perform step 1050S mentioned above.

<p dir="rtl">10 above. It is further understood that the corresponding modules composing said cryptographic device may be embodied by processor 5100 in a computer device configured to process operations performed by all said corresponding modules, being configured to perform some or all of the above steps and any other steps of the proposed cryptographic method. The encoder or computing device may also include memory 5200 that is accessible by processor 5100.</p>

<p dir="rtl">15 It is also understood that the proposed method for decoding a compressed audio representation encoded in a set of hierarchical enhancement layers can be implemented by a decoder to decode a compressed audio representation in a set of hierarchical layers. Said set-top box may include corresponding modules configured to perform the corresponding steps described above. An example given on the 6000 decoder mentioned is shown in Figure 6. E.g</p>

<p dir="rtl">20 For example, said set-top box 6000 may include a receiving unit 6010 configured to perform the above step 3010 s, a first layer indicator selection unit 6020 configured to perform the above step 3020 s, a basic reconfiguration unit 6030 configured to perform the above step 3030 s, and an indicator selection unit 6020 configured to perform the above step 3020 s. A second layer 6040 is configured to perform the above step 3040s, and a booster reconfiguration unit 6050 is configured to perform the above step 3050s. from</p>

<p dir="rtl">25 It is also understood that the corresponding modules composing said set-top box can be embodied by</p>

8872

-41-

The 6100 processor in a computer is configured to process operations performed by all of the aforementioned corresponding units, where it is configured to perform some or all of the above steps and any other steps of the proposed decoding method. The set-top box or computer may also include memory 6200 that is accessible by processor 6100.

<p dir="rtl">5 It should be noted that the description and drawings are provided by way of illustration of the principles of the methods and the proposed apparatus only. Therefore, those skilled in the art will be able to make arrangements that, although not stated or expressly stated in this disclosure, embody the principles of the invention and are within the spirit and scope of the invention. Additionally, all examples expressly set forth in this disclosure are intended for educational purposes only to assist the reader in understanding the principles of the methods, apparatus, and concepts presented by</p>

<p dir="rtl">10 They are intended to advance the field and should not be construed as being limited to the examples and cases specifically set forth. All expressions stipulated in this disclosure to express the principles, aspects, and models of the invention and the examples provided thereof also specifically include the expressions that are equivalent to them.</p>

The methods and apparatus set forth in the present document may be implemented in the form of computer software, firmware and/or hardware. Some components may be implemented in the form of a computer program that runs on

<p dir="rtl">15 A digital signal processor or microprocessor. While other components can be implemented in the form of application-specific devices or integrated circuits. The signals encountered on the road and the provided device can be stored on a medium such as RAM or video storage. These signals can be transmitted over networks such as radio networks, satellite networks, wireless networks, or wired networks such as the Internet.</p>

<p dir="rtl">20 Reference 1 ISO/IEC JTC1/SC29/WG11 23008-3:2015(E). Information:</p>

technology - High efficiency coding and media delivery in heterogeneous February 2015.,environments - Part 3: 3D audio

ISO/IEC JTC1/SC29/WG11 23008-3:2015/PDAM3. Information:2 Reference technology - High efficiency coding and media delivery in heterogeneous

8872

-42-

AMENDMENT 3: MPEG-H 3D Audio, environments - Part 3: 3D audio

July 2015.,Phase 2

8872

-43-