MX366000B

Audio apparatus and audio providing method thereof.

Abstract

An audio apparatus and an audio providing method thereof are provided. The audio providing method of the audio apparatus comprises: receiving an audio signal including a plurality of channels; generating a plurality of virtual audio signals to be output to a plurality of speakers by applying an audio signal including a channel having a sense of elevation, among the plurality of channels, to a filter for processing the audio signal to enable the audio signal to have the sense of elevation; applying a synthetic gain value and a delay value to the plurality of virtual audio signals in order to form a sound field in which the plurality of virtual audio signals output through the plurality of speakers have a plane wave; and outputting the plurality of virtual audio signals to which the synthetic gain value and the delay value are applied, through the plurality of speakers.

MX366000B, drawing sheet 1 — Sheet 1 of 54

Term

7.5 yearsleft in the term

Expires 28 March 2034.

9 claims: 4 independent, 5 dependent

1
CLAIMS REIVINDICACIONES Habiéndose descrito la invención como antecede, se reclama como propiedad lo contenido en las siguientes reivindicaciones:Having described the invention as above, the contents of the following claims are claimed as property: 1. Un método de provisión de una señal de audio, caracterizado porque comprende: one. A method of providing an audio signal, characterized in that it comprises: receive a plurality of channel signals;recibir una pluralidad de señales de canal;receive input channel distribution information according to the multiple channel signals;recibir información de distribución de canal de entrada de acuerdo con las múltiples señales de canal;identificar por lo menos una señal de canal de entrada de altura de entre la pluralidad de señales de canal identify at least one input channel signal of height from among the plurality of channel signals perform elevation provision on at least one height input channel signal based on the filter coefficients and panoramic gains, to provide high sound images by a plurality of output channel signals, where the filter coefficients are based on the head-related transfer function, realizar provisión de elevación sobre por lo menos una señal de canal de entrada de altura en base en los coeficientes de filtro y las ganancias panorámicas, para proporcionar imágenes de sonido elevadas por una pluralidad de señales de canal de salida, en donde los coeficientes de filtro están basados en la función de transferencia relacionada con cabeza, - 67 en donde las ganancias panorámicas se obtienen en base en un intervalo de frecuencia e información de posición de por lo menos una señal de canal de entrada de altura, y en donde la información de posición comprende un acimut y un ángulo de elevación de por lo menos una señal de canal de entrada de altura. - 67 where the panoramic gains are obtained based on a frequency range and position information of at least one height input channel signal, and where the position information comprises an azimuth and an elevation angle of At least one height input channel signal.
5
An apparatus for providing an audio signal, characterized in that it comprises:5. Un aparato de provisión de una señal de audio, caracterizado porque comprende: a receiver unit configured to receive a plurality of channel signals and identify at least one input channel signal of height from among the plurality of channel signals based on the input channel distribution information;and a provision parameter provision unit configured to obtain a filter coefficient for a height input channel signal and obtain a panoramic gain for the height input channel signal a provision unit configured to perform elevation provision on at least one height input channel, based on filter coefficients and panoramic gains, to provide high sound images by a plurality of output channel signals, where the filter coefficients are based on the head-related transfer function, where the panoramic gains are obtained based on a frequency and information range of position of at least one input channel signal height, and wherein the position information comprises an azimuth and an elevation angle of at least one height input channel signal. una unidad receptora configurada para recibir una pluralidad de señales de canal e identificar por lo menos una señal de canal de entrada de altura de entre la pluralidad de señales de canal en base en la información de distribución de canal de entrada;y una unidad de obtención de parámetro de provisión configurada para obtener un coeficiente de filtro para una señal de canal de entrada de altura y obtener una ganancia panorámica para la señal de canal de entrada de altura una unidad de provisión configurada para realizar provisión de elevación sobre por lo menos un canal de entrada de altura, en base en los coeficientes de filtro y las ganancias panorámicas, para proporcionar imágenes de sonido elevadas por una pluralidad de señales de canal de salida, en donde los coeficientes de filtro se basan en la función de transferencia relacionada con la cabeza, en donde las ganancias panorámicas se obtienen en base en un intervalo de frecuencia e información de posición de por lo menos una señal de canal de entrada de altura, y en donde la información de posición comprende un acimut y un ángulo de elevación de por lo menos una señal de canal de entrada de altura.
7
The device in accordance with the 7. El aparato de conformidad con la 5 claim 5, characterized in that the plurality of output channel signals are horizontal channel signals. 5 reivindicación 5, caracterizado porque la pluralidad de señales de canal de salida son señales de canal horizontal.
9
10- one of the plurality of output channel signals. 10- una de la pluralidad de señales de canal de salida. - 70 RESUMEN DE LA INVENCIÓN - 70 SUMMARY OF THE INVENTION An audio apparatus and an audio provision method thereof are described. The method of providing audio includes receiving audio that includes a plurality of channels. Se describe un aparato de audio y un método de provisión de audio del mismo. El método de provisión de audio incluye la recepción de audio que incluye una pluralidad de canales. aplicando una señal de audio que tiene un canal, de entre la pluralidad de canales, dando una sensación de elevación a un filtro para generar una pluralidad de señales de audio virtuales que van a ser respectivamente enviadas a una pluralidad de altavoces, aplicando un valor de ganancia de combinación un valor de retraso a la pluralidad de señales de audio virtuales, de modo que la pluralidad de señales de audio virtuales enviada respectivamente a través de la pluralidad de altavoces forman un campo de sonido que tiene una onda plana, y enviando respectivamente la pluralidad de señales de audio virtuales, a las cuales son aplicados el valor de ganancia de combinación y el valor de retraso, a través de la pluralidad de altavoces. El filtro procesa la señal de audio para tener una sensación de elevación. applying an audio signal that has a channel, from among the plurality of channels, giving a sensation of elevation to a filter to generate a plurality of virtual audio signals that will be respectively sent to a plurality of speakers, applying a value of combination gain a delay value to the plurality of virtual audio signals, so that the plurality of virtual audio signals sent respectively through the plurality of speakers form a sound field that has a flat wave, and respectively sending the plurality of virtual audio signals, to which the gain value is applied combination and delay value, through the plurality of speakers. The filter processes the audio signal to have a sense of elevation. • s •s 1/26 1/26 Fig. 1A Fig. 1A TFL Tfl 2/26 2/26 Fig. IB Fig. IB 3/26 3/26 4/26 4/26 Fig. 3 Fig. 3

Independent claims4

312 paragraphs in 18 sections, as filed

(57) Summary

An audio apparatus and an audio provision method thereof are described. The method of providing audio includes receiving an audio signal that includes a plurality of channels, applying an audio signal having a channel, from among the plurality of channels, giving a filter a sense of elevation to generate a plurality of virtual audio signals that will be respectively sent to a plurality of speakers, applying a combination gain value and a delay value to the plurality of virtual audio signals, so that the plurality of virtual audio signals sent respectively through the plurality of speakers form a sound field that has a flat wave, and respectively sending the plurality of virtual audio signals, to which the gain value is applied combination and delay value, through the plurality of speakers. The filter processes the audio signal to have a sense of elevation.

(57) Abstract

An audio apparatus and an audio providing method thereof are provided. The audio providing method of the audio apparatus comprises: receiving an audio signal including a plurality of channels; generating a plurality of virtual audio sign to be output to a plurality of speakers by applying an audio signal including a channel having a sense of elevation, among the plurality of channels, to a filter for processing the audio signal to enable the audio signal to have the sense of elevation; applying a synthetic gain valué and a delay valué to the plurality of virtual audio sign in order to form a sound field in which the plurality of virtual audio signáis output through the plurality of speakers have a plañe wave; and outputting the plurality of virtual audio sign to which the synthetic gain valué and the delay valué are applied, through the plurality of speakers.

• j ·. , <j $

<>< ?·<

1MFI

PATENT TITLE No. 366000

Owner (s): SAMSUNG ELECTRONICS CO „LTD.

Address: 129, Samsumg-ro, Yengtong-gu, Suwon-s¡, Gyeonggi-do 16677, REPUBLIC OF

KOREA

Name: AUDIO DEVICE AND AUDIO PROVISION METHOD OF THE SAME.

Classification: CIP: H04S7 / 00; H04S3 / 00

CPC: H04S3 / 008; H04S5 / 005; H04S7 / 302; H04S2400 / 01; H04S2400 / 11;

H04S2400 / 13; H04S2420 / 01

Inventor (s): SANG-BAE CHON; SUN-MIN KIM; HYUN JO; JEONG-SU KIM

REQUEST

Number: International Presentation Date:

MX / a / 2017/003988 March 28, 2014

Divisional of the Patent Number: 346627

PRIORITY

Country: Date:

US March 29, 2013

US April 8, 2013

Number:

61/806,654

61/809,485

Validity: Twenty years

Expiration Date: March 28, 2034

Issue Date: June 24, 2019

The reference patent is granted based on articles 1, 2 "fraction V, 6" fraction III, and 59 of the Industrial Property Law.

In accordance with article 23 of the Industrial Property Law, the present patent is valid for twenty non-extendable years, counted from the date of submission of the international application and will be subject to the payment of the fee to keep the rights in force .

Who subscribes to this title does so based on the provisions of articles 6S fraction III, 7to BIS 2 and 59 of the Industrial Property Law; Articles 1st, 3rd fraction V subsection a), subparagraph iii), 4th and 12to fractions I and III of the Regulations of the Mexican Institute of Industrial Property; articles 1to, 3to, 4to, 5to fraction V subsection a), sub subsection ii), 16 fractions I and III and 30 of the Organic Statute of the Mexican Institute of Industrial Property; Ito, 3to and 5to subsection a) and the second to last paragraph of the Agreement that delegates powers to the Deputy Directors General, Coordinator, Divisional Directors, Regional Office Holders, Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property.

This document is signed with an advanced electronic signature (FAITHFUL), based on Articles 7 BIS 2 of the Industrial Property Law; 3rd of its Regulations, and 1 section III, 2 section V, 26 BIS and 26 TER of the Agreement establishing the guidelines for the use of the Electronic Payment and Services Portal (PASE) of the Mexican Institute of Industrial Property, in the procedures indicated.

DIVISIONAL SUB-DIRECTOR OF PATENT FUND EXAMINATION OF MECHANICAL, ELECTRICAL AND INDUSTRIAL DESIGNS AND UTILITY MODELS PEDRO DAVID FRAGOSO LÓPEZ

Original string:

PEDRO DAVID FRAGOSO LOPEZ | 00001000000405457619 | Administration Service

Tax | 1052 || MX / 2019/55602 | MX / a / 2017/003988 | Normal patent title with divisional PCT | 1048 | SEF | Page (s) | 1jUyZ¡Glwdi + cZ¡WxoBRSrvbVaQ =

Digital stamp:

JH4pzkhdu7ZGselewrxR1gQYZjg0cc0w1ar4k + 5FyzD7j9 / wWv6p3 + 4kV8qsy1 DXg4wRwQdfd4dTg2kcAcTymFEKcD

Z7wkTjOKRDrXX8p6ELNXUKHGkS7sETpcMd9xE7wGK2twpsGtoBGLkh8Mr + bvKe / 0ZCyfH0j8XkVs5Rz68mvg8O8Db

XITEAial9dcVY6r0RexKFs2AA2w K7Ab9GsfaVIIKAkyuoYIUP1bYpeas4TRI8pU + 1s + + + 57ZkfZkbg zo7cdknrAp1 mZHI0CkVcLIR FIFpvjVVe0NGJFZbweBagjf / pore4cyM8UufUzAmvtUgaEFH / MdwaZ0aWeBAg ==

MX / 2019/55602

AUDIO DEVICE AND AUDIO PROVISION METHOD OF THE SAME

FIELD OF THE INVENTION

<td>The present</td><td>invention refers to</td><td>a</td><td>apparatus</td><td>from</td>

<td>audio already a method</td><td>audio provisioning</td><td>of the</td><td>same,</td><td>Y</td>

<td>particularly to a</td><td>audio device already</td><td>a</td><td>method</td><td>from</td>

provision of audio thereof by means of which the virtual audio that gives a sense of elevation is generated and provided by the use of a plurality of speakers located on the same plane.

BACKGROUND OF THE INVENTION

With the advancement of video and sound processing technology, content that has high image and sound quality has been mass produced. Users, who demand content that has a high amount of image and sound, want realistic video and audio, and thus, research on three-dimensional (3D) video and 3D audio has been actively conducted.

3D audio is a technology whereby a plurality of speakers are placed in different positions on a horizontal plane, and output the same audio signal or different audio signals, which makes it possible for a user to perceive a sense Of space. However, effective audio is provided in various positions on a horizontal plane and is also

I laughed No. 275594 provided at different heights. Therefore, it is required to develop a technology to effectively reproduce an audio signal provided at different heights.

In the related art, as illustrated in Figure 1A, an audio signal is filtered by a tone-color conversion filter (for example, a head-related transfer filter correction filter (HRTF) acronym in English) corresponding to a first height, and a plurality of audio signals are generated by copying the filtered audio signal. A plurality of gain application units respectively amplify or attenuate the generated plurality of audio signals, based on the gain values that correspond respectively to the plurality of speakers through which the generated plurality of audio signals are sent from output, and amplified or attenuated sound signals are respectively sent through the corresponding speakers. Consequently, virtual audio that gives a sense of elevation can be generated by using a plurality of speakers located on the same plane.

However, in a method of generating virtual audio signals of the related art, an optimal point is narrow, and for this reason, in the case of the actual reproduction of audio through a system, its operation is limited. . That is, in the related art, as illustrated in Figure IB, since the audio is optimized and performed at only one point (for example, a region 0 located in the center), a user cannot normally hear a signal from virtual audio that of a sense of elevation in a region (for example, an X region located to the left of the center) instead of a point.

BRIEF DESCRIPTION OF THE INVENTION

TECHNICAL PROBLEM

The present invention provides an audio apparatus and an audio provision method thereof, whereby a user can listen to a virtual audio signal in various regions, based on a delay value so that a plurality of audio signals Virtual forms a sound field that has a flat wave.

In addition, the present invention provides an audio apparatus and an audio provision method thereof, whereby a user can listen to a virtual audio signal in various regions, based on the different gain values according to a frequency based in the type of a channel of an audio signal from which a virtual audio signal will be generated.

TECHNICAL SOLUTION

According to one aspect of the inventive concept, an audio provisioning method performed by an audio apparatus is provided which includes: the reception of an audio signal that includes a plurality of channels; the generation of a plurality of virtual audio signals, which will be respectively output to a plurality of speakers, by applying an audio signal having a channel between the plurality of channels, giving a sense of elevation to a filter, the filter processes the audio signal to have a sense of elevation; the application of a combination gain value and a delay value to the plurality of virtual audio signals, so that the plurality of virtual audio signals, which are respectively output from the plurality of speakers, form a sound field that has a flat wave, and respectively send out the plurality of virtual audio signals, to which the combination gain value and the delay value are applied, through the plurality of speakers.

The generation may include: copying the filtered audio signal to correspond to the number of speakers; and applying a panoramic gain value, corresponding to each of the plurality of speakers, to each of the plurality of audio signals obtained through copying, so that the filtered audio signal has a virtual sense of elevation, to generate the plurality of

.......... ** virtual audio signals.

The application may include: multiplying a virtual audio signal that corresponds to at least two speakers, from among the plurality of speakers, used to implement the sound field that the flat wave has by the combination gain value; and the application of the delay value to the virtual audio signal corresponding to at least two speakers.

The application may include the application of a gain value of 0 to an audio signal corresponding to a speaker, except at least two speakers between the plurality of speakers.

The application may include: applying the delay value to the plurality of virtual signals, corresponding respectively to the plurality of speakers; and multiplying the plurality of virtual audio signals, to which the delay value is applied, by a final gain value obtained by multiplying the panoramic gain value and the combination gain value.

The filter that processes the audio signal to have a sense of elevation can be a head-related transfer filter (HRTF).

Respectively, the output send may include mixing a virtual audio signal, corresponding to a specific channel, with an audio signal having the specific channel to send an audio signal, obtained through mixing, through a loudspeaker. which corresponds to the specific channel.

In accordance with yet another aspect of the inventive concept, an audio apparatus is provided that includes: an input unit configured to receive an audio signal that includes a plurality of channels; a virtual audio generation unit configured to apply an audio signal, which has a channel, from among the plurality of channels, giving a sense of elevation to a filter to generate a plurality of virtual audio signals to be respectively sent to a plurality of speakers, the filter is configured to process the audio signal to have a sense of elevation; a virtual audio processing unit configured to apply a combination gain value and a delay value to the plurality of virtual audio signals, so that the plurality of virtual audio signals respectively sent through the plurality of speakers form a sound field that has a flat wave; and an output unit configured to send output respectively the plurality of virtual audio signals , to which the combination gain value and the delay value are applied, through the plurality of speakers.

The virtual audio processing unit can also be configured to copy the filtered audio signal to correspond to the number of the speakers and apply a panoramic gain value, corresponding to each of the plurality of speakers, to each of the plurality of audio signals obtained through copying, so that the filtered audio signal has a virtual sense of elevation, to generate the plurality of virtual audio signals.

The virtual audio processing unit can also be configured to multiply a virtual audio signal, corresponding to at least two speakers, from among the plurality of speakers, to implement the sound field that the flat wave has, by the gain value Combine and apply the delay value to the virtual audio signal that corresponds to at least two speakers.

The virtual audio processing unit can also be configured to apply a gain value of 0 to an audio signal corresponding to a speaker, except at least two speakers from among the plurality of speakers.

The virtual audio processing unit can also be configured to apply the delay value to the plurality of virtual audio signals corresponding respectively to the plurality of speakers, and multiply the plurality of virtual audio signals, to which it is applied. the delay value, by a final gain value obtained by multiplying the panoramic gain value and the combination gain value.

The filter configured to process the audio signal to have a sense of elevation may be a head-related transfer filter (HRTF).

The output unit can also be configured to mix a virtual audio signal, corresponding to a specific channel, with an audio signal that has the specific channel to output an audio signal obtained through mixing, through a channel that corresponds to the specific channel.

According to yet another aspect of the inventive concept, an audio provision method carried out by an audio apparatus is provided which includes: the reception of an audio signal that includes a plurality of channels; the application of an audio signal having a channel, from among the plurality of channels, giving a sense of elevation, to a filter that processes the audio signal to have a sense of elevation; the generation of a plurality of virtual audio signals by application of different gain values to the audio signal according to a frequency, based on a type of a channel of an audio signal from which a signal is to be generated virtual audio; and respectively send the plurality of virtual audio signals through the plurality of speakers.

The generation may include: copying the filtered audio signal to correspond to the number of speakers; determine an ipsilateral speaker and a contralateral speaker, based on a type of a channel of an audio signal from which a virtual audio signal will be generated; apply a low band intensification filter to a virtual audio signal corresponding to the ipsilateral speaker, and apply a high pass filter to a virtual audio signal corresponding to the contralateral speaker; and multiply, by a panoramic gain value, an audio signal that corresponds to the ipsilateral speaker and an audio signal that corresponds to the contralateral speaker, to generate the plurality of virtual audio signals.

According to another aspect of the inventive concept, an audio apparatus is provided that includes: an input unit that receives an audio signal that includes a plurality of channels; a virtual audio generation unit that applies an audio signal, which has a channel that gives a sense of elevation between the plurality of channels, to a filter that processes the audio signal to have a sense of elevation, and generates a plurality of virtual audio signals by application of different gain values to the audio signal according to a frequency, based on a type of a channel of an audio signal from which a virtual audio signal will be generated; and an output unit that respectively sends the plurality of virtual audio signals through the plurality of speaker.

The virtual audio generation unit can copy the filtered audio signal to correspond to the number of speakers, determine an ipsilateral speaker and a contralateral speaker, based on a type of a channel of an audio signal from which it will be generated. a virtual audio signal, apply a low band intensification filter to a virtual audio signal that corresponds to the ipsilateral speaker, and apply a high pass filter to a virtual audio signal that corresponds to the contralateral speaker, and multiply, by a panoramic gain value, an audio signal that corresponds to the ipsilateral speaker and an audio signal that corresponds to the contralateral speaker, to generates the plurality of virtual audio signals.

According to yet another aspect of the inventive concept, an audio provisioning method provided by an audio apparatus is provided which includes: receiving an audio signal that includes a plurality of channels; determining whether an audio signal is produced, which has a channel that gives a sense of elevation between the plurality of channels, in a way that gives a sense of elevation; apply some of the plurality of channels that give a sense of elevation to a filter that processes some channels to have a sense of elevation, based on a result of the determination; apply a gain value to a signal, to which the filter is applied, to generate a plurality of virtual audio signals, and respectively send out the plurality of virtual audio signals through the plurality of speakers.

The determination may include determining whether the sense of elevation is delivered, in the form that gives a sense of elevation, based on a correlation and a similarity between the plurality of channels.

According to another aspect of the inventive concept, an audio provisioning method provided by an audio apparatus is provided: receiving an audio signal that includes a plurality of channels; apply at least some of the plurality of channels to a filter, which processes at least some channels to have a sense of elevation, to generate virtual; and recoding, by an encoder-decoder (codee) executable by an external device,

ADVANTAGE EFFECTS OF THE INVENTION

As described above, according to various embodiments of the present invention, a user listens to a virtual audio signal that gives a sense of elevation, which is supplied by an audio device, in various positions.

BRIEF DESCRIPTION OF THE FIGURES

Figures 1A and IB are diagrams to describe a virtual audio provision method of the related technique.

Figure 2 is a block diagram illustrating a configuration of an audio apparatus according to an exemplary embodiment of the present invention.

Figure 3 is a diagram for describing the virtual audio that has a flat wave sound field according to an embodiment of the present invention.

Figures 4 to 7 are diagrams to describe a method of delivering a channel 11.1 audio signal to output the delivered audio signal, through a 7.1 channel speaker, according to various exemplary embodiments herein. invention.

Figure 8 is a diagram for describing an audio provision method performed by an audio apparatus, according to an exemplary embodiment of the present invention.

Figure 9 is a block diagram illustrating a configuration of an audio apparatus according to another exemplary embodiment of the present invention.

Figures 10 and 11 are diagrams to describe a method of delivering a channel 11.1 audio signal to output the audio signal delivered through a 7.1 channel speaker, in accordance with various exemplary embodiments of the present invention.

Figure 12 is a diagram for describing an audio provision method performed by an audio apparatus, according to another exemplary embodiment of the present invention.

Figure 13 is a diagram for describing a method of related technique of delivering a channel 11.1 audio signal to output the audio signal delivered through a 7.1 channel speaker.

Figures 14 through 20 are diagrams to describe a method of sending a channel 11.1 audio signal through a 7.1 channel speaker, by using a plurality of delivery methods, according to various exemplary modalities of the present invention

Figure 21 is a diagram to describe an exemplary mode where delivery is performed by using a plurality of delivery methods when a channel extension codee having a structure such as the MPEG environment is used, according to one modality copy of the present invention, and

Figures 22 through 25 are diagrams for describing *> a multi-channel audio provisioning system, according to an exemplary embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

From now on, the exemplary modalities of the inventive concept will be described in detail, with reference to the attached figures. The modalities of the inventive concept are provided so that this description will be comprehensive and complete, and will completely transfer the concept of the inventive concept to a person of ordinary skill in the art. The inventive concept can, however, be exemplified in many different ways and should not be considered as limited to the modalities described here. However, this does not limit the inventive concept within the specific modalities, and it should be understood that the inventive concept covers all modifications, equivalents, and replacements within the idea and technical scope of the inventive concept. Similar reference numbers refer to similar elements throughout the description. The dimensions of the structures illustrated in the attached figures and a range between the members may be exaggerated for clarity of specification.

It will be understood that although the terms that include an ordinary number such as first or second, are used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element.

In the following description, the technical terms are used only to explain a specific exemplary modality while not limiting the inventive concept. The terms of a singular form may include plural forms unless otherwise referred to. Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning that is commonly understood by a person of ordinary experience in the technique to which the exemplary modalities belong. It will also be understood that the terms, such as those defined in commonly used dictionaries, must be interpreted as having a meaning that is consistent with their meaning in the context of the relevant technique, and will not be interpreted in an idealized or overly formal sense. unless it is so expressly defined herein.

In exemplary modalities, ... module or ... unit described herein perform at least one function or operation, and may be implemented in hardware (physical equipment), software (computer hardware) or the combination of hardware and software. Also, a plurality of ... modules or a plurality of ... units can be integrated at least as a module and thus implemented with at least one processor (not shown), except for the ... module or ... . unit that is implemented with specific hardware.

From now on, the exemplary modalities will be described in detail with reference to the attached figures. Similar numbers refer to similar elements throughout the description of the figures, and a repetitive description of the same element is not provided.

Figure 2 is a block diagram illustrating a configuration of an audio apparatus 100 according to an exemplary embodiment of the present invention. As illustrated in Figure 2, the audio apparatus 100 may include an input unit 110, a virtual audio generation unit 120, a virtual audio processing unit 130, and an output unit 140. According to an exemplary embodiment of the present invention, the audio apparatus 100 may include a plurality of speakers, which may be located on the same horizontal plane.

The input unit 110 can receive an audio signal that includes a plurality of channels. In this case, the input unit 110 can receive the audio signal that includes the plurality of channels that give different elevation directions. For example, input unit 110 can receive audio signals from channel 11.1.

The virtual audio generation unit 120 can apply an audio signal, which has a channel that gives a sense of elevation between a plurality of channels, to a tone-color conversion filter, which processes an audio signal to have a sense of elevation, thereby generating a plurality of virtual audio signals that will be sent through a plurality of speakers. Particularly, the virtual audio generation unit 120 can use an HRTF correction filter to model a sound, which is generated at a higher elevation than the actual positions of a plurality of speakers located on a horizontal plane, by use of the speakers. In this case, the HRTF correction filter may include the information (i.e., the frequency transfer characteristic) of a path from a spatial position of a sound source to two ears of a user. The HRTF correction filter can recognize a 3D sound according to a phenomenon where a characteristic of a complicated path such as the reflection by atria is changed depending on a direction of transfer of a sound, in addition to an inter-aural level difference (ILD) and an inter-aural time difference (ITD) that occurs when a sound reaches two ears, etc. Since the HRTF correction filter has a unique characteristic in an angular direction of a space, the HRTF correction filter can generate a 3D sound by using a unique characteristic.

For example, when the audio signals of the channel

11.1 are introduced, the virtual audio generation unit 120 can apply an audio signal, which has an upper left front channel between the audio signals of channel 11.1, to the HRTF correction filter to generate seven audio signals that they will be sent through a plurality of speakers that have a 7.1 channel layout.

In an exemplary embodiment of the present invention, the virtual audio generation unit 120 can copy an audio signal obtained through filtration by the color-by-tone filter, to correspond accordingly to the number of speakers and can apply respectively the panoramic gain values, corresponding respectively to the speakers, to the audio signals that are obtained through copying so that the audio signal has a virtual sense of elevation, thereby generating a plurality of virtual audio signals. In another exemplary embodiment of the present invention, the virtual audio generation unit 120 can copy an audio signal obtained through the filtration by the color-tone compression filter, thus corresponding to the number of speakers, whereby a plurality of virtual audio signals are generated. In this case, the panoramic gain values can be applied by the virtual audio processing unit 130.

The virtual audio processing unit 130 can apply a combination gain value and a delay value to a plurality of virtual audio signals, so that the plurality of virtual audio signals, which are sent through a plurality of speakers, constitute a sound field that has a flat wave. In detail, as illustrated in Figure 3, the virtual audio processing unit 130 can generate a virtual audio signal to constitute a sound field that has a flat wave instead of an optimal point that is generated at one point, with This makes it possible for a user to listen to the virtual audio signal at several points.

In an exemplary embodiment of the present invention, the virtual audio processing unit 130 can multiply a virtual audio signal, which corresponds to at least two speakers to implement a sound field having a flat wave between a plurality of speakers, by the combination gain value and you can apply the delay value to the virtual audio signal that corresponds to at least two speakers. The virtual audio processing unit 130 may apply a gain value 0 to an audio signal corresponding to a speaker, except at least two of a plurality of speakers. For example, the virtual audio generation unit 120 generates seven virtual audio signals in order to generate an audio signal of channel 11.1, which corresponds to the upper left front channel, such as a virtual audio signal and the implementation of a signal FLtlf that is to be reproduced as a signal corresponding to a front left channel between the seven virtual audio signals generated, the virtual audio processing unit 130 can multiply, by the combination gain value, the virtual audio signals corresponding respectively to a front center channel, a front left channel, and a left environment channel between a plurality of 7.1 channel speakers, and you can apply the delay value to the audio signals to process a plurality of the virtual audio signals that are to be output through the speakers, respectively, corresponding to the front center channel, in the front left channel, and the left environment channel. Also, in the implementation of the FLtlf signal, the virtual audio processing unit 130 can multiply, by a combination gain value 0 the virtual audio signals corresponding respectively to a front right channel, a right environment channel, a left rear channel, and a right rear channel which are contralateral channels in the 7.1 channel speakers.

In another exemplary embodiment of the present invention, the virtual audio processing unit 130 may apply the delay value to a plurality of virtual audio signals corresponding respectively to a plurality of speakers, and may apply a final gain value, the which is obtained by multiplying a panoramic gain value and the combination gain value, to the plurality of virtual audio signals to which the delay value is applied, whereby a sound field is generated that has a flat wave.

The output unit 140 can send the processed plurality of virtual audio signals through the corresponding speakers. In this case, the output unit 140 may mix a virtual audio signal corresponding to a specific channel, with an audio signal having the specific channel to output an audio signal, obtained through mixing, through of a speaker that corresponds to the specific channel. For example, the output unit 140 may mix a virtual audio signal corresponding to the front left channel with an audio signal, which is generated by processing the upper front left channel, to send an audio signal,

obtained through mixing, through a speaker corresponding to the front left channel.

The audio apparatus 100 makes it possible for a user to listen to a virtual audio signal that gives a sense of elevation, provided by the audio apparatus 100, in various positions.

Hereinafter, a method of distributing a channel 11.1 audio signal to a virtual audio signal for output output, through a 7.1 channel loudspeaker, will be described in detail with reference to Figures 4 through 7, an audio signal corresponding to each of the channels that give different elevation directions between the audio signals of channel 11.1, according to an exemplary mode.

Figure 4 is a diagram for describing a method of distributing a channel 11.1 audio signal having the upper left front channel to a virtual audio signal, thus sending the virtual audio signal through a 7.1 channel speaker. , according to various exemplary embodiments of the present invention.

First, when the channel audio signal

11.1 that has the upper front left channel is introduced, the virtual audio generation unit 120 can apply the input audio signal the upper left front channel to a tone color conversion filter

H. Also, the virtual audio generation unit 120 can copy an audio signal, which corresponds to the upper left front channel to which the H color conversion filter is applied, to seven audio signals and then can enter respectively the seven audio signals to a plurality of gain application units corresponding respectively to the 7-channel speakers. In the virtual audio generation unit 120, the seven gain application units can multiply the audio signal converted to tone color by 7 channel panoramic gains Gtfl, fl, Gtfl, fr, Gtfl, fcz Gtfl, sl, Gtfl , sr, Gtfl, bl, and Gtfl, br to generate 7-channel virtual audio signals.

In addition, the virtual audio processing unit 130 can multiply a virtual audio signal from the 7-channel virtual audio signals introduced, corresponding to at least two speakers to implement a sound field having a flat wave between a plurality of speakers, for a combination of gain value and you can apply a delay value to the virtual audio signal that corresponds to at least two speakers. In detail, as illustrated in Figure 3, when it is desired to convert an audio signal having the front left channel into a flat wave that is introduced to a specific angular position (for example, 30 degrees), the processing unit of Virtual audio 130 can multiply an audio signal by the combination gain values Afl-fl, AFl-fc, and Afl-sl needed for the flat wave combination by using speakers, which have the front left channel, the front center channel, the surrounding left channel and the speakers located on the same flat medium (for example, a left half plane and a center in a left signal, and in a right signal, a right half plane and the center) as an incident direction and may apply delay values dTFL, fl, dTFL, fc and dTFL, sl to a signal obtained through multiplication to generate a virtual audio signal that has the plane waveforms. This can be expressed as the following Equation:

P ^ TFl, Fl=^ Fl.Fí ^^ TFL ^ '^ TFlJ'l ^^ Fi, FL ^ TFl, FL ^ * T ^ (n ~ dTFL, Fi)

TFL, FLFL, F <^> ^ 'TFL ^n~ ^ TFl, F¿) FL.FC ^ TFL.F1 & H * TFL (n-dTFL.Fc) ^ TFL, Fl ^^ FlJiL ^ TFLFl ^^ TFL ^ n-dj-fusi)

In addition, the virtual audio processing unit 130 can set, at 0, the combination gain values Afl, fr, Afl, sr, Afl, bl, and Afl, br of the virtual audio signals sent through the speakers which have the right front channel, the surrounding right channel, the right rear channel, and the left rear channel, and are not located in the same flat medium with the incident direction.

Therefore, as illustrated in Figure 4, the virtual audio processing unit 130 can generate seven virtual audio signals FTflw, FCtflw, SLTflw, SRtfl ”, and BLtflw to implement a flat wave.

In Figure 4, it is described that the virtual audio generation unit 120 multiplies an audio signal by a panoramic gain value and the virtual audio processing unit 130 multiplies the audio signal by a combination gain value, but This is merely an exemplary modality. In other exemplary embodiments, the virtual audio processing unit 130 can multiply an audio signal by a final gain value obtained by multiplying the panoramic gain value and the combination gain value.

In detail, as described in Figure 6, The virtual audio processing unit 130 may first apply a delay value to a plurality of virtual audio signals of which the tone colors are converted by the color-by-tone filter H and then may apply a gain value. end to the virtual audio signals with the delay value applied to them to generate a plurality of virtual audio signals that have a sound field that are in the form of flat waves. In this case, the virtual audio processing unit 130 can integrate the panoramic gain values G of the gain application units of the virtual audio generation unit 120 of Figure 4 and the combination gain values A of the Gain application units of the virtual audio processing unit 130 of Figure 4 to calculate a final gain value This can be expressed as the following Equation:

FL w TFL

QFLrpLs QAssGTFL (n'dTFLFI) @s iás

H * RFLS (ndTF FL) Q ^ lx, fF> G @s = H ^ RFL ^ ndTFLfF^ PTfl^L where s denotes an element of S = (FL, FR, FC, SL, SR, BL, BR).

In Figures 4 through 6, an exemplary mode where an audio signal corresponding to the upper left front channel between the audio signals of channel 11.1, is distributed to a virtual audio signal that has been described above, but the signals of audio corresponding respectively to a top right front channel, a top surrounding left channel, and an upper surrounding right channel that give different directions of elevation between the audio signals of channel 11.1, can be distributed by the method described above.

In detail, as illustrated in Figure 7, the audio signals corresponding respectively to an upper left front channel, the upper right front channel, the upper surrounding left channel, and the upper surrounding right channel can respectively be distributed to a plurality of virtual audio signals by a plurality of virtual channel combination units that include virtual audio generation unit 120 and virtual audio processing unit 13 0, and The plurality of virtual audio signals obtained through the distribution can be mixed with audio signals corresponding respectively to the 7.1 channel speakers and the output.

Figure 8 is a diagram for describing an audio provision method carried out by the audio apparatus 100, according to an exemplary embodiment of the present invention.

<td></td><td>First, in</td><td colspan="2">the operation</td><td colspan="2">S810, the device</td><td>from</td>

<td>audio 100</td><td colspan="2">can receive a signal from</td><td colspan="2">Audio. In this</td><td>case,</td><td>the</td>

<td>signal of</td><td>audio received</td><td>can be</td><td>a</td><td>signal of</td><td>Audio</td><td>from</td>

<td>channels</td><td>multiple (by</td><td>example,</td><td> 11.1</td><td>channels)</td><td>what</td><td>give</td>

Multiple senses of elevation.

In operation S820, the audio apparatus 100 can apply an audio signal, which has a channel that gives a sense of elevation between a plurality of channels, to the tone color conversion filter that processes a signal

of audio to have a sense of elevation, whereby a plurality of virtual audio signals are generated that are to be output through a plurality of speakers.

In operation S830, the audio apparatus 100 can apply a combination gain value and a delay value to the plurality generated of the virtual audio signals. In this case, the audio apparatus 100 can apply the combination gain value and the delay value to the plurality of virtual audio signals, so that the plurality of virtual audio signals have a flat wave sound field .

In operation S840, the audio apparatus 100 can respectively output the plurality of virtual audio signals output to the plurality of speakers.

As described above, the audio apparatus 100 may apply the delay value and the combination gain value to a plurality of virtual audio signals to distribute a virtual audio signal having a flat wave sound field, and of this mode a user listens to a virtual audio signal that gives a sense of elevation, provided by the audio device 100, in various positions.

In the exemplary mode described above, in order for a user to listen to an audio signal

virtual that has a sense of elevation in various positions instead of a point, the virtual audio signal can be processed to have a flat wave sound field, but this is merely an exemplary mode. In other exemplary embodiments, in order for a user to listen to a virtual audio signal that gives a sense of elevation in various positions, the virtual audio signal can be processed by another method. In detail, the audio apparatus 100 can apply different gain values to the audio signals according to a frequency, based on the type of a channel of an audio signal from which a virtual audio signal is to be generated. , which makes it possible for a user to listen to a virtual audio signal in various regions.

Hereinafter, a method of providing virtual audio signals according to another exemplary embodiment of the present invention will be described with reference to Figures 9 through 12. Figure 9 is a block diagram illustrating a configuration of an audio apparatus 900 according to another exemplary embodiment of the present invention. First, the audio apparatus 900 may include an input unit 910, a virtual audio generation unit 920, and an output unit 930.

The input unit 910 can receive an audio signal that includes a plurality of channels. In this case, the input unit 910 can receive the audio signal that includes the plurality of channels that give different elevation sensations. For example, the input unit 910 can receive an audio signal from channel 11.1.

The virtual audio generation unit 920 can apply an audio signal, which has a channel that gives a sense of elevation between a plurality of channels, to a filter that processes an audio signal to have a sense of elevation, and can apply different gain values to the audio signal according to a frequency, based on the type of a channel of an audio signal from which a virtual audio signal will be generated, thereby generating a plurality of virtual audio signals.

In detail, the virtual audio generation unit 920 can copy a filtered audio signal to correspond to the number of speakers and can determine an ipsilateral speaker and a contralateral speaker, based on the type of a channel of an audio signal of the which will be generated a virtual audio signal. In detail, the virtual audio generation unit 920 can determine, as an ipsilateral speaker, a speaker located in the same direction and can determine, as a contralateral speaker, a speaker located in an opposite direction, based on the type of a channel of an audio signal from which a virtual audio signal will be generated. For example, when an audio signal from which a virtual audio signal is to be generated is an audio signal that has the upper left front channel, the virtual audio generation unit 920 can determine, as ipsilateral speakers, the speakers corresponding respectively to the front left channel, the surrounding left channel, and the rear left channel located in the same direction as a direction closer to that of the upper front left channel, and may end up, as contralateral speakers, the speakers corresponding respectively to the front right channel, the surrounding right channel, and the right channel posterior located in an opposite direction to that of the upper left front channel.

In addition, the virtual audio generation unit 920 can apply a low band intensification filter to a virtual audio signal corresponding to an ipsilateral speaker, and can apply a high pass filter to a virtual audio signal corresponding to a contralateral speaker In detail, the virtual audio generation unit 920 can apply the low band intensification filter to the virtual audio signal corresponding to the ipsilateral speaker to adjust a full tone color balance and can apply the high pass filter, the which filters a high frequency domain that affects the location of the sound image, the virtual audio signal that corresponds to the contralateral speaker.

a general component

<td colspan="2">sound image with</td><td colspan="2">ITD base, and a</td>

<td>frequency of</td><td>the</td><td>signal</td><td>audio affects</td>

<td>location</td><td>from</td><td>the</td><td>sound image</td>

<td>Particularly</td><td>t</td><td>when</td><td>a spectator</td>

ILD

ILD, can be moves in

a panoramic gain, and by adjusting a degree to which

move one

sound<img file="MX366000B_D0023.tif" />left

A right sound source moves to the left, the viewer continually listens to a soft audio signal. However, in the ITD, a sound coming from a nearby speaker is first heard by the ears, and thus, when the viewer moves, the inversion of the left-right location occurs.

The inversion of the left-right location must necessarily be resolved in sound image location. To solve such a problem, the virtual audio generation unit 920 can eliminate a low frequency component that affects the ITD in the virtual audio signals corresponding to the contralateral speakers located in a direction opposite to a sound source, and can filter only a high frequency component

which predominantly affects ILD. Therefore, the inversion of the left-right location, caused by the low frequency component is prevented, and a position of a sound image can be maintained by the ILD, based on the high frequency component.

In addition, the virtual audio generation unit

920 You can multiply, by a panoramic gain value, an audio signal that corresponds to an ipsilateral speaker and an audio signal that corresponds to a contralateral speaker, to generate a plurality of virtual audio signals. In detail, the virtual audio generation unit 920 can multiply, by a panoramic gain value for the location of the sound image, an audio signal that corresponds to an ipsilateral speaker and passes through the low band intensification filter, and an audio signal that corresponds to the contralateral speaker and passes through the high pass filter, thereby generating a plurality of virtual audio signals. That is, the virtual audio generation unit 920 can apply different gain values to an audio signal according to the frequencies of a plurality of virtual audio signals, to generate the plurality of virtual audio signals, based on a Position of a sound image.

The output unit 930 can send a plurality of virtual audio signals through the corresponding speakers. In this case, the output unit 930 can mix a virtual audio signal that corresponds to a specific channel with an audio signal that has the specific channel to send an audio signal, obtained through mixing, through a loudspeaker. which corresponds to the specific channel. For example, the output unit 930 may mix a virtual audio signal corresponding to the front left channel with an audio signal, which is generated by the processing of the upper front left channel, to output an audio signal, obtained at through mixing, through a speaker corresponding to the front left channel.

Hereinafter, a method of distributing a channel 11.1 audio signal to a virtual audio signal to output from a 7.1 channel loudspeaker, a signal from a channel 7.1 will be described in detail with reference to Figure 10 audio that corresponds to each of the channels that give different directions of elevation between the audio signals of channel 11.1, according to an exemplary mode.

Figures 10 and 11 are diagrams to describe a method of distributing a channel 11.1 audio signal to output the reproduced audio signal, through a 7.1 channel speaker, according to various exemplary embodiments of the present invention. .

First, when the channel audio signal

11.1 which has the upper left front channel is introduced, the virtual audio generation unit 920 can apply the input audio signal that has the upper left front channel to the H tone color conversion filter. Also, the virtual audio generation unit 920 can copy an audio signal, which corresponds to the upper left front channel to which the H color conversion filter is applied, to seven audio signals and then can determine an ipsilateral speaker and a contralateral speaker according to a position of an audio signal that has the upper left front channel. That is, the virtual audio generation unit 920 can generate, as ipsilateral speakers, the speakers corresponding respectively to the front left channel, the surrounding left channel, and the rear left channel located in the same direction as that of the audio signal which has the upper left front channel, and can determine, as contralateral speakers, the speakers corresponding respectively to the right front channel, the surrounding right channel, and the rear right channel located in an opposite direction to that of the audio signal that has the upper left front channel.

In addition, the virtual audio generation unit 920 can filter a virtual audio signal corresponding to an ipsilateral speaker between a plurality of virtual audio signals, copied, by using the low band intensity filter. Also, the virtual audio generation unit 920 can introduce the virtual audio signals that pass through the low band intensification filter to a plurality of gain application units corresponding respectively to the front left channel, the surrounding left channel, and the left rear channel, and can multiply an audio signal by the panoramic gain values of multiple channels Gtfl, fl, Gtfl, sl, and Gtfl, bl, to locate the audio signal in a position of the upper left front channel, whereby a 3-channel virtual audio signal is generated.

In addition, the virtual audio generation unit 920 can filter a virtual audio signal corresponding to a contralateral speaker among the plurality of virtual audio signals, copied, by using the high pass filter. Also, the virtual audio generation unit 920 can introduce the virtual audio signals that pass through the high pass filter to a plurality of gain application units corresponding respectively to the front right channel, the surrounding right channel, and the right rear channel, and you can multiply an audio signal by the multi-channel panoramic gain values Gtfl, fr, Gtfl, sr, and Gtfl, br for the location of

the audio signal in a position of the upper left front channel, thereby generating a 3-channel virtual audio signal.

In addition, in a virtual audio signal that corresponds to a front center channel instead of an ipsilateral speaker or a contralateral speaker, the virtual audio generation unit 920 can process the virtual audio signal that corresponds to the front center channel by use in the same method as the ipsilateral speaker or the same method as the contralateral speaker. In an exemplary embodiment of the present invention, as illustrated in Figure 10, the virtual audio signal corresponding to the front center channel can be processed by the same method as a virtual audio signal corresponding to the ipsilateral speaker.

In Figure 10, an exemplary mode where an audio signal corresponding to the upper left front channel between the audio signals of channel 11.1 is distributed to a virtual audio signal, has been described above, but the corresponding audio signals respectively to the upper right front channel, the upper surrounding left channel, and the upper right surrounding channel which gives different elevation directions between the audio signals of channel 11.1, It can be distributed by the method described above with reference to Figure 10.

In another exemplary embodiment of the present invention, an audio apparatus 1100 illustrated in Figure 11 can be implemented by integrating the virtual audio provisioning method described above with reference to Figure 6, and the virtual audio provisioning method described. above with reference to Figure 10. In detail, the audio device 1100 can perform the color conversion by tones on an input audio signal by using the H color conversion filter by tones, you can filter the virtual audio signals corresponding to an ipsilateral speaker by the use of the low band intensification filter so that different gain values are applied to the audio signals, and can filter the audio signals that correspond to a contralateral speaker by using the high pass filter according to a frequency, based on the type of a channel of an audio signal from which a signal will be generated virtual audio signal Also, the audio apparatus 100 may apply a delay value d and a final gain value P to a plurality of virtual audio signals so that the plurality of virtual audio signals constitute a sound field having a flat wave, whereby a virtual audio signal is generated.

Figure 12 is a diagram for describing an audio provision method carried out by the audio apparatus 900, according to another exemplary embodiment of the present invention.

First, in operation S1210, audio device 900 can receive an audio signal. In this case, the received audio signal may be a multi-channel audio signal (for example, channel 11.1) giving it multiple sensations of elevation.

In operation S1220, the audio apparatus 900 may apply an audio signal, which has a channel that gives a sense of elevation between a plurality of channels, to a filter that processes an audio signal to have a sense or sense of elevation . In this case, the audio signal that has a channel that gives a sense of elevation between a plurality of channels can be an audio signal that has the upper left front channel, and the filter that processes an audio signal to make sense. Lifting can be the correction filter of HRTF.

In operation S1230, the audio device 900 can apply different gain values to the audio signal according to a frequency, based on the type of a channel of an audio signal from which a signal will be generated. virtual audio signal, thereby generating a plurality of virtual audio signals.

In detail, the audio apparatus 900 can copy a filtered audio signal to correspond to the number of speakers, and can determine an ipsilateral speaker and a contralateral speaker, based on the type of the audio signal channel from which The virtual audio signal will be generated. The audio apparatus 900 can apply the low band intensification filter to a virtual audio signal corresponding to the ipsilateral speaker, you can apply the high pass filter to a virtual audio signal corresponding to the contralateral speaker, and you can multiply, by a panoramic gain value, an audio signal that corresponds to the ipsilateral speaker and an audio signal that corresponds to the contralateral speaker, to generate a plurality of virtual audio signals.

In operation 1240, the audio apparatus 900 can emit the plurality of virtual audio signals.

As described above, the audio apparatus 900 can apply the different gain values to the audio signal according to the frequency, based on the type of the audio signal channel from which the audio will be generated. virtual audio signal, and thus, a user listens to a virtual audio signal that gives a sense of elevation, provided by the audio device 900, in various positions.

Hereinafter, another exemplary embodiment of the present invention will be described. In detail, Figure 13 is a diagram to describe a method of the related technique of distributing a channel audio signal

11.1 to send the reproduced audio signal through a 7.1 channel speaker. First, an encoder 1310 can encode a channel 11.1 audio signal, a plurality of target audio signals, and pieces of path information that correspond to the plurality of target audio signals to generate a bit stream. Also, a decoder 1320 can decode a bit stream received to send the audio signal of

<td>channel 11.1</td><td>to</td><td>a unit</td><td>1314 mixer,</td><td>Y</td><td>Send</td><td>the</td>

<td>plurality</td><td>from</td><td colspan="2">target audio signals and</td><td>the</td><td>pieces</td><td>from</td>

<td>information</td><td>from</td><td>trajectory</td><td>that correspond</td><td colspan="3">to these, towards</td>

<td>a unit</td><td>from</td><td>distribution</td><td>objective 1330.</td><td>Lcl</td><td>Unit</td><td>from</td>

<td colspan="3">target distribution 1330</td><td>can distribute</td><td>the</td><td>signals</td><td>from</td>

<td colspan="2">target audio</td><td>to channel</td><td colspan="3">11.1 by using</td><td>the</td>

<td>information</td><td>from</td><td>trajectory</td><td>and can send</td><td>the</td><td>signals</td><td>from</td>

<td colspan="2">target audio,</td><td colspan="2">distributed to channel 11.1</td><td>, to</td><td colspan="2">unit</td>

<td>mixer</td><td> 1340</td><td>Unit</td><td colspan="2">1340 mixer can</td><td>Mix</td><td>the</td>

Channel 11.1 audio signal with the target audio signals distributed to channel 11.1, to generate the channel 11.1 audio signals and can send the channel 11.1 audio signals generated to a virtual audio distribution unit 1350. As described above with reference to Figures 2 through 12, the virtual audio distribution unit 1350 can generate a plurality of virtual audio signals by using audio signals having respectively four channels (eg, the left channel upper front, right upper front channel, upper surrounding left channel, and the upper right surrounding channel) giving different elevation directions between the audio signals of channel 11.1 and can mix the generated plurality of virtual audio signals with the other channels to output an audio signal of channel 7.1.

However, as described above, in a case where a virtual audio signal is generated by uniformly processing the audio signals that have the four channels that give different elevation sensations between the audio signals of channel 11.1, when a signal from audio that has a broadband such as applause or the sound of rain, has no cross-channel cross correlation (ICC) (that is, has a low correlation), And it has impulsive characteristic, it is distributed to a virtual audio signal, audio quality is deteriorated. Particularly, since an audio quality is more severely impaired when a virtual audio signal is generated, a distribution operation of generating a virtual audio signal can be performed through downmixing, based on the tone color without be performed for an audio signal that has an impulsive characteristic, which provides better sound quality.

Hereinafter, an exemplary mode will be described with reference to Figures 14 through 16 where the type of distribution or reproduction of an audio signal is

<td>determined with</td><td>base</td><td>in</td><td>the</td><td>information of</td><td>distribution of</td><td>the</td>

<td>audio signal</td><td></td><td></td><td></td><td></td><td></td><td></td>

<td colspan="2">The figure</td><td> 14</td><td>it is</td><td>a diagram</td><td>to describe</td><td>a</td>

<td>method where a</td><td colspan="2">apparatus</td><td>from</td><td>audio performs</td><td colspan="2">different methods</td>

of distribution over a channel signal 11.1, according to the distribution information of an audio signal, to generate an audio signal of channel 7.1, according to various exemplary embodiments of the present invention.

An encoder 1410 can receive and encode a channel 11.1 audio signal, a plurality of audio signals, the path information corresponding to the plurality of target audio signals, and distribute the

<td>information</td><td>from</td><td>a sign of</td><td>Audio.</td><td>In</td><td colspan="2">this case, the</td>

<td>information</td><td>from</td><td>distribution</td><td>of the</td><td>signal</td><td>audio</td><td>may</td>

<td>denote the</td><td>kind</td><td>of the signal of</td><td>audio and</td><td>may</td><td>include the</td><td>less</td>

one of the information regarding whether or not an input audio signal is an audio signal that has an impulsive characteristic, information about whether the input audio signal is an audio signal that has a broadband, and the information regarding a if the input audio signal is low in ICC. Also, the distribution information of the audio signal may include information regarding a method of distributing an audio signal. That is, the distribution information of the audio signal may include information regarding which of the ring distribution method and the spatial distribution method is distributed to the audio signal.

A decoder 1420 can decode a signal obtained through encoding to output the audio signal of channel 11.1 and the distribution information of the audio signal to a mixing unit 1440, and send the plurality of target audio signals, the path information to it, and the distribution information of the audio signal to the mixer unit 1440.

An objective distribution unit 1430 can generate a target audio signal from channel 11.1 by using the plurality of target audio signals introduced to it and the path information corresponding to it and can send the target audio signal from channel 11.1 , generated, to the mixer unit 1440.

A first mixer unit 1440 may mix the channel audio signal 11.1 introduced thereto with the target channel audio signal 11.1 to generate the channel 11.1 audio signals. Also, the first mixer unit

1440 it may include a distribution or reproduction unit that distributes the audio signals of channel 11.1, generated from the distribution information of the audio signal. In detail, the first mixer unit 1440 can determine if the audio signal is an audio signal that has an impulsive characteristic, if the audio signal is an audio signal that has a broadband, and if the audio signal is low in ICC, based on the distribution information of the audio signal. When the audio signal is the audio signal that has the impulsive characteristic, the audio signal is the audio signal that has a broadband, or the audio signal that is low in ICC, the first mixer unit 1440 can send the Audio signals from channel 11.1 to the first distribution unit 1450. On the other hand, when the audio signal does not have the characteristic described above, the first mixing unit 1440 can output the audio signals of channel 11.1 to a second distribution unit 1460.

The first distribution unit 1450 can distribute four audio signals that give different directions of elevation between the channel audio signals

11.1 introduced to it, using the ring distribution method. In detail, the first distribution unit 1450 can distribute the audio signals, corresponding respectively to the upper left front channel, the upper right front channel, the upper surrounding left channel, and the upper surrounding right channel between the channel audio signals 11.1, to the front left channel, the right front channel, the surrounding left channel and the upper right surrounding channel, by using a first channel downstream mixing method, and you can mix the audio signals that have four channels obtained through the downstream mixing with audio signals that the other channels have, to output an audio channel signal

7.1 to a second mixer unit 1470.

The second distribution unit 1460 can distribute four audio signals, which have different sensations of elevation between the audio signals of channel 11.1 introduced thereto, to a virtual audio signal that has a sensation of elevation by using the method of spatial distribution described above with reference to Figures 2 through 13.

The second mixer unit 1470 can output the 7.1 channel audio signal that is sent through at least one of the first distribution unit 1450 and the second distribution unit 1460.

In the exemplary embodiment described above, it has been previously described that the first distribution unit 1450 and the second distribution unit 1460 distribute an audio signal by using at least one of the ring distribution method and the spatial distribution method, but this is merely an exemplary modality. In other exemplary embodiments, the target distribution unit 1430 can distribute a target audio signal by using at least one of the ring distribution method and the spatial distribution method, based on the distribution information of an audio signal. .

In addition, in the exemplary mode described above, it has been previously described that the distribution information of an audio signal is determined by the analysis of the audio signal before encoding. However, for example, the distribution information of an audio signal can be generated and encoded by a sound mixer engineer, to reflect an intention to create the content, and can be acquired by various methods.

In detail, the encoder 1410 can analyze the plurality of channel audio signals, the plurality of target audio signals, and the path information to generate the distribution information of the audio signal. In more detail, the encoder 1410 can extract the characteristics that are the most used to classify an audio signal, and can teach the

features extracted to a classifier to analyze whether the plurality of channel audio signals or the plurality of target audio signals introduced thereto, have the impulsive characteristic. Also, the encoder 1410 can analyze the path information of the target audio signals, and when the target audio signals are static, the encoder 1410 can generate the distribution information that allows the distribution to be performed by using the method of Ring distribution When the target audio signals include a movement, the encoder 1410 can generate the distribution information that allows the distribution to be performed by using the spatial distribution method. That is, in an audio signal that has an impulsive characteristic and has the static characteristic that has no movement, the encoder 1410 can generate the distribution information that allows the distribution to be performed by using the ring distribution method, and otherwise, the encoder 1410 can generate the distribution information that allows the distribution to be performed by using the spatial distribution method. In this case, where a movement is detected, it can be estimated by calculating a movement distance per frame of an objective audio signal.

When analyzing by which of the ring distribution method and the spatial distribution method the distribution is performed, this is based on the soft decision instead of the hard decision, the encoder 1410 can perform the distribution by a combination of an operation of distribution based on the ring distribution method and a distribution operation based on the spatial distribution method, based on a characteristic of an audio signal. For example, as illustrated in Figure 15, when a first objective OBJ1 audio signal, the first TRJ1 path information, and an RC distribution weighting value with the encoder 1410 are analyzed analyzes a characteristic of an audio signal. to generate, the target distribution unit 1430 can determine a weighting value Wt for the ring distribution method and a weighting value Ws for the spatial distribution method, by using the RC distribution weighting value. Also, the target distribution unit 1430 can multiply the first target OBJ1 audio signal input, by the weighting value WT for the ring distribution method, to perform the distribution based on the ring distribution method, and you can multiply the first target audio signal entered OBJ1 by the weighting value Ws for the spatial distribution method, to make the distribution based on the spatial distribution method. Also, as described above, the objective distribution unit 1430 can make the distribution over the other objective audio signals.

As another example, as illustrated in Figure 16, when a first channel audio signal CH1 and the RC distribution weighting value that the encoder 1410 analyzes the characteristic of the audio signal to generate, the first unit are introduced Mixer 1440 can determine the weighting value Wt for the ring distribution method and the weighting value Ws for the spatial distribution method, by using RC distribution weighting value. Also, the first mixer unit 1440 can multiply the audio signal of the first input channel CH1 by the weighting value Wt for the ring distribution method to output a value obtained through the multiplication of the first distribution unit 1450 , and can multiply the first audio channel CH1 input, entered, by the weighting value Ws for the spatial distribution method, to send out a value obtained through multiplication to the second distribution unit 1460. Also, as described above, the first mixer unit 1440 can multiply the audio signals of other channels by a weighting value to send out respectively the values obtained through multiplication to the first distribution unit 1450, and the second distribution unit 1460.

In the exemplary mode described above, it has been previously discovered that encoder-1410 acquires the distribution information of an audio signal, but this is merely an exemplary mode. In other exemplary embodiments, decoder 1420 can acquire the distribution information of the audio signal. In this case, the encoder 1410 may not transmit the distribution information, and the encoder 1420 may directly generate the distribution information.

In addition, in another exemplary mode, decoder 1420 can generate the distribution information that allows a channel audio signal to be distributed through the use of ring distribution, and allows an objective audio signal to be distributed through the use of the method. of special distribution.

As described above, a distribution operation can be performed by different methods according to the distribution information of an audio signal, and the sound quality is prevented from deteriorating due to a characteristic of the audio signal.

Hereinafter, a method of determining a distribution channel of a channel audio signal by analyzing the channel audio signal when an objective audio signal is not separated will be described, and only the audio signal exists channel where all audio signals are distributed and mixed. Particularly, a method will be described that analyzes an objective audio signal to extract a component of the objective audio signal from a channel audio signal, which makes the distribution, providing a virtual sensation of elevation, over the target audio signal by the use of the spatial distribution method, and performs the distribution on an environmental audio signal by using the timbre distribution method.

Figure 17 is a diagram to describe an exemplary mode where the distribution is performed by different methods according to whether an applause is detected from four higher audio signals that give different sensations of elevation in channel 11.1

First, an applause detection unit 1710 can determine whether the applause is detected from the four upper audio signals that give different elevation sensations in channel 11.1.

In a case where the applause detection unit 1710 uses the hard decision, the applause detection unit 1710 can determine the following output signal.

When applause is detected: TFLTO = TFL, TFRTO =

TFR, TSLTO = TSL, TSRTO = TSR, TFLG = 0, TFRG = 0, TSLG = 0, TSRG = 0

When applause is not detected: TFLTO = 0, TFR? = 0, TSLTO = 0, TSRTO = 0, TFLG = TFL, TFRG = TFR, TSLG = TSL, TSRG = TS

In this case, an output signal can be calculated by an encoder instead of the applause detection unit 1710 and can be transmitted in the form of flags.

In a case where the applause detection unit 1710 uses the soft decision, the applause detection unit 1710 can multiply a signal by the weighting values a and β to determine the output signal, based on whether or not the signal is detected. Applause and an intensity of applause.

TflTO = (Xtfl TFL, TFRTO = (Xtfr TFR, TSIA = OCtsl TSL, TSRTO

<td>TFL signalsG,</td><td colspan="2">TFRG, TSLG, Y</td><td>TSRG</td><td>between</td><td>the</td>

<td>output signals can</td><td>be</td><td>sent to</td><td>a</td><td colspan="2">unit of</td>

1730 spatial distribution and can be distributed by the spatial distribution method.

TFL signalsTO, TFRTO, TSLTO, and TSRTO between the output signals can be determined as components of

<td colspan="2">applause and can be</td><td>sent to</td><td>a unit</td><td>of analysis</td><td>from</td>

<td>distribution</td><td> 1720.</td><td></td><td></td><td></td><td></td>

<td>A</td><td>method</td><td>where the</td><td>unit of</td><td>analysis</td><td>from</td>

<td>distribution</td><td colspan="2">1720 determines a</td><td>component</td><td>of applause</td><td>Y</td>

<td>analyze a</td><td>method</td><td colspan="2">of distribution, it will be</td><td>described</td><td>with</td>

reference to Figure 18. The distribution analysis unit 1720 may include a frequency converter 1721, a coherence calculator 1723, a distribution method determiner 1725, and a signal separator 1727.

The frequency converter 1721 can convert the TFL signalsTO, TFRTO, TSLTO, and TSRTO introduced to it in frequency domains to send the TFL signalstof, TFRtof, TSIAf, and TSRtof. In this case, the frequency converter 1721 can represent the signals as sub-band samples of a filter bank such as the quadrature mirror filter bank (QMF) and then can send the TFL signals.tof, TFRtof, TSLtof, and TSRtoF.

The coherence calculator 1723 can calculate an xLf signal that is the coherence between the TFL signalstoF and TSLtof, an xRf signal that is the coherence between the TFR signalstofy TSRtof, an xRf signal that is the coherence between the TFL signalstofy TFRtof, and an xSf signal that is the coherence between the TSL signalstofy TSRtof, for each of the plurality of bands. In this case, when one of the two signals is 0, the coherence calculator 1723 can calculate the coherence as 1. This is because the spatial distribution method is used when a signal is located only in one channel.

The determiner 1725 of the distribution method can calculate the weighting values wTFLf, wTFRf, wTSLf, and wTSRf, which are to be used for the spatial distribution method, from the coherence calculated by the coherence calculator 1723, as is

<td>expressed in the following</td><td colspan="2">Equation:</td><td></td>

<td>wTFLf = mapper</td><td>(max</td><td>(xLF,</td><td>xFF) )</td>

<td>wTFRf = mapper</td><td>(max</td><td>(xRf,</td><td>xFf))</td>

<td>wTSLf = mapper</td><td>(max</td><td>(xLf,</td><td>xSF) )</td>

<td>wTSRf = mapper</td><td>(max</td><td>(xRf,</td><td>xSF) )</td>

where max denotes a function that selects a large number from two coefficients, and inaperator denotes the various types of functions that map a value between 0 and 1, to a value between 0 and 1 through nonlinear mapping.

The determiner of the distribution method 1725 may use different mappers for each of the plurality of frequency bands. In detail, the signals are much more mixed due to the interference of signals caused because the delay becomes more severe and a bandwidth becomes wider at a high frequency, and thus, when different mappers are used for each band , sound quality and a degree of signal separation are improved to a greater extent than a case where the same mapper is used to all bands. Figure 19 is a graph showing a characteristic of a mapper when the 1725 distribution method determiner uses mappers that have different characteristics for each frequency band.

In addition, when there is no signal (that is, when a value of functions and similarities is 0 or 1, and the panoramic representation is performed only on one side), the coherence calculator 1723 can calculate the coherence as 1. However, since a signal that corresponds to a lateral lobe or a noisy floor caused

<td>for the conversion</td><td>to</td><td>a domain</td><td colspan="2">of frequency is</td><td colspan="2">generated,</td>

<td>when the value of</td><td>the</td><td>function of</td><td>similarity</td><td>have a</td><td>value</td><td>from</td>

<td>similarity equal to</td><td>or</td><td>smaller than</td><td>a value</td><td colspan="2">threshold by</td><td>the</td>

<td>value setting</td><td>from</td><td>threshold (for</td><td>example,</td><td>0.1) in</td><td>East,</td><td>the</td>

Spatial distribution method can be selected, which prevents noise from occurring. Figure 20 is a graph for determining a weighting value for a distribution method according to a similarity value. For example, when a value of the similarity function is equal to or less than 0.1, a weighting value can be adjusted to select the method of spatial distribution.

The signal separator 1727 can multiply the TFL signalstof, TFRtof, TSLtof, and TSRtof, which are converted into frequency domains, by the weighting values wTFLf, wTFRf, wTSLf, and wTSRf, determined by the 1725 distribution method determiner to convert the TFL signalstoF, TFRtof, TSLtof, and TSRtof, in frequency domains, and then can send the TFL signalsTOs, TFRTOs, TSLTOs, and TSRTOsa 1730 space distribution unit.

In addition, the signal separator 1727 can send the TFlAr, TFR signals to a bell distribution unit 1740TOT, TSLtot, and TSRV 'obtained by subtracting the TFL signalsTOS, TFRTOS, TSLTOs, and TSRTOs, sent to the spatial distribution unit 1730, from the signals TFL ^ f, TFRtof, TSLtof, and TSRtof introduced to it.

As a result, the TFL signalsTOs, TFRTOs, TSLTOs, and TSRTOs sent to the spatial distribution unit 1730 may constitute signals corresponding to the objects located to four higher channel audio signals, and the TFIAr, TFR ^ r, TSIA ·, and TSR ^ r signals sent output to the distribution unit of bell 1740 can constitute signals that correspond to diffused sounds.

Therefore, when an audio signal such as an applause or a rain sound where it is low in coherence between channels, it is distributed by at least one of the ring distribution method and the spatial distribution method through the process described above. , an incidence of deterioration of sound quality is minimized.

Indeed, a multi-channel audio codee can largely use an ICC to compress data such as surrounding MPEG. In this case, a channel level difference (CLD) and the ICC can mainly be used as parameters. The MPEG spatial audio object (SAOC) encoding that is the target coding technology can have a similar shape to this. In this case, an internal coding operation can use the channel extension technology that extends a signal from a downstream mixing signal to a multi-channel audio signal.

Figure 21 is a diagram to describe an exemplary mode where distribution is performed by using a plurality of distribution methods when a channel extension codee having a structure such as surrounding MPEG is used, according to an exemplary mode of the present invention.

A decoder of a channel codee can separate a channel from a bit stream that corresponds to a higher layer audio signal, based on a CLD and then a de-correlator can correct the coherence between the channels, based on a ICC As a result, a dry channel sound source and a diffuse channel sound source can be separated from each other and sent out. The dry channel sound source can be distributed by the spatial distribution method, and the diffuse channel sound source can be distributed by the ring distribution method.

In order to efficiently utilize the present structure, the channel codee can separately compress and transmit an intermediate layer audio signal and the upper layer audio signal, or in a tree structure of a one to two / two box to three (OTT / TTT), the intermediate layer audio signal and the upper layer audio signal can be separated from each other and then transmitted by the compression of separate channels.

In addition, the applause can be detected for the upper layer channels and can be transmitted as a bit stream. A decoder can distribute a sound source, from which a channel is separated based on the CLD, by using the spatial distribution method in an operation to calculate the TFL signalsTO, TFRTO, TSLTO, and TSRTO which is channel data equal to the applause. In a case where the filtration, the weighting and the sum that are operational factors of the spatial distribution are performed in a frequency domain, the multiplication, the weighting, and the sum can be performed, and thus, the filtration, the Weighting and addition can be performed without adding a number of operations. Also, in a distribution operation of a diffuse sound source generated based on the ICC through the use of the ring distribution method, the distribution can be performed through the weighting of the sum, and thus, the distribution Spatial and ring distribution can all be performed by adding a small number of operations.

Hereinafter, a multi-channel audio provisioning system according to various exemplary embodiments of the present invention will be described with reference to Figures 22 through 25. Particularly, Figures 22 through 25 illustrate a multi-channel audio provisioning system that provides a virtual audio signal that gives a sense of elevation by using the speakers located on the same plane.

Figure 22 is a diagram for describing a multi-channel audio provision system according to a first exemplary embodiment of the present invention.

First, an audio device can receive a multi-channel audio signal from a medium. Also, the audio apparatus can decode the multi-channel audio signal and can mix a channel audio signal, which corresponds to a speaker in the decoded multi-channel audio signal with an interactive effect audio signal. sent from the outside to generate a first audio signal.

In addition, the audio apparatus can perform the processing of the vertical plane audio signal over channel audio channels that give different sensations of elevation in the decoded multi-channel audio signal. In that case, the processing of the audio signal in the vertical plane can be an operation of generating a virtual audio signal that gives a sense of elevation, by using a horizontal plane speaker and can use the generation technology of virtual audio signals described above.

In addition, the audio apparatus can mix an audio signal processed in the vertical plane with an interactive effect audio signal sent from the outside to generate a second audio signal.

In addition, the audio apparatus may mix the first audio signal with the second audio signal to send a signal, obtained through mixing, to a corresponding horizontal plane audio speaker.

Figure 23 is a diagram for describing a multi-channel audio provision system, according to a second exemplary embodiment of the present invention.

First, an audio device can receive a multi-channel audio signal from a medium. Also, the audio apparatus can mix the multi-channel audio signal with an interactive effect audio signal sent from the outside to generate a first audio signal.

In addition, the audio apparatus can perform the processing of the vertical plane audio signal on the first audio signal, to correspond to an arrangement to an audio speaker in the horizontal plane, and can send a signal, obtained through the processing, to a corresponding horizontal plane audio speaker.

In addition, the audio apparatus can encode the first audio signal for which the vertical plane audio signal processing has been performed, and can transmit an audio signal, obtained through encoding, to a video receiver of external audio (AV). In this case, the audio apparatus can encode an audio signal in a format, which is bearable by the existing AV receiver, such as a Dolby digital format, a DTS format, or the like.

The external AV receiver can process the first audio signal for which an audio signal processing has been performed in the vertical plane, and can send an audio signal, obtained through processing, to a plane audio speaker horizontal, corresponding.

Figure 24 is a diagram for describing a multi-channel audio provision system, according to a third exemplary embodiment of the present invention.

First, an audio device can receive a multi-channel audio signal from a medium and can receive an interactive effect audio signal sent from the outside (for example, a remote controller).

In addition, the audio apparatus can perform the vertical plane audio signal processing on the received multi-channel audio signal, to correspond to an arrangement of a horizontal plane audio speaker, and can also perform the processing of the horizontal plane audio signal on the interactive effect audio signal, received, to correspond to a speaker arrangement.

In addition, the audio apparatus can mix the multi-channel audio signal and the interactive effect audio signal, for which the vertical plane audio signal processing has been performed, to generate a first audio signal, and can send the first audio signal to a corresponding horizontal plane audio speaker.

In addition, the audio apparatus can encode the first audio signal and can transmit an audio signal, obtained through encoding, to an external AV receiver. In this case, the audio apparatus can encode an audio signal in a format, which is supported by the existing AV receiver, such as a Dolby digital format, a DTS format, or the like.

Subsequently, the external AV receiver can process the first audio signal for which the audio signal processing of the plane has been performed

<td>10 vertical, and can send</td><td>a sign of</td><td>audio, obtained</td><td>to</td>

<td>through processing,</td><td>to a speaker</td><td colspan="2">flat audio</td>

<td>corresponding horizontal.</td><td></td><td></td><td></td>

<td>Figure 25 is</td><td>a diagram</td><td>to describe</td><td>a</td>

<td>provisioning system of</td><td colspan="2">multi channel audio,</td><td>from</td>

. 15 according to a fourth exemplary embodiment of the present invention.

An audio device can immediately transmit a multi-channel audio signal, introduced from a medium, to an external AV receiver.

The external AV receiver can decode the multi-channel audio signal and can perform audio signal processing from the vertical plane over the multi-channel audio signal, decoded, to correspond to an arrangement of a horizontal plane audio speaker .

In addition, the external AV receiver can send the multi-channel audio signal, for which the processing of vertical plane audio signals has been performed, through a horizontal plane speaker.

It should be understood that the exemplary modalities described herein should be considered in a descriptive sense only, and not for purposes of limitation. Descriptions of the characteristics or aspects within each exemplary modality should typically be considered as available for other characteristics or similar aspects in other exemplary modalities. While one or more exemplary modalities have been described with reference to the figures, it may be understood by those of ordinary experience in the art that various changes can be made in the form and details of the present, without departing from the spirit and scope, such as It is defined by the following claims.

It is noted that in relation to this date, the best method known by the applicant to implement said invention is that which is clear from the present description of the invention.

CLAIMS

Contents18

49 members in 13 offices

This recordMember, by publication datePriority claim3 more offices are in the list below

Priority claims14

Priority claims
Document	Office	Kind	Date
201361806654	United States of America	P	2013-03-29
201361806654	United States of America	P	2013-03-29
61806654	United States of America	–	2013-03-29
201361809485	United States of America	P	2013-04-08
201361809485	United States of America	P	2013-04-08
61809485	United States of America	–	2013-04-08
2014002643	Republic of Korea	W	2014-03-28
2014002643	Republic of Korea	W	2014-03-28
61806654	–	–	–
61809485	–	–	–
PCTKR2014002643	–	–	–
US201361806654P	–	–	–
US201361809485P	–	–	–
WO2014KR02643	–	–	–

Members49

Family members, oldest first
Document	Office	Kind
CA2908037A1	Canada	A1	2014-10-02
CA3036880A1	Canada	A1	2014-10-02
WO2014157975A1	World Intellectual Property Organization (WIPO)	A1	2014-10-02
SG11201507726XA	Singapore	A	2015-10-29
AU2014244722A1	Australia	A1	2015-11-05
CN105075293A	China	A	2015-11-18
KR20150138167A	Republic of Korea	A	2015-12-09
EP2981101A1	European Patent Office (EPO)	A1	2016-02-03
US2016044434A1	United States of America	A1	2016-02-11
MX2015013783A	Mexico	A	2016-02-16
JP2016513931A	Japan	A	2016-05-16
AU2014244722B2	Australia	B2	2016-09-01
EP2981101A4	European Patent Office (EPO)	A4	2016-11-16
AU2014244722B9	Australia	B9	2016-12-15
AU2016266052A1	Australia	A1	2017-01-12
US9549276B2	United States of America	B2	2017-01-17
KR101703333B1	Republic of Korea	B1	2017-02-06
KR20170016520A	Republic of Korea	A	2017-02-13
AU2014244722C1	Australia	C1	2017-03-02
MX346627B	Mexico	B	2017-03-27
US2017094438A1	United States of America	A1	2017-03-30
RU2015146225A	Russian Federation	A	2017-05-04
BR112015024692A2	Brazil	A2	2017-07-18
CN105075293B	China	B	2017-10-20
AU2016266052B2	Australia	B2	2017-11-30
KR101815195B1	Republic of Korea	B1	2018-01-05
KR20180002909A	Republic of Korea	A	2018-01-08
CN107623894A	China	A	2018-01-23
JP2018057031A	Japan	A	2018-04-05
KR101859453B1	Republic of Korea	B1	2018-05-21
US9986361B2	United States of America	B2	2018-05-29
US2018279064A1	United States of America	A1	2018-09-27
RU2676879C2	Russian Federation	C2	2019-01-11
RU2018145527A	Russian Federation	A	2019-02-04
CA2908037C	Canada	C	2019-05-07
JP6510021B2	Japan	B2	2019-05-08
MX366000BThis record	Mexico	B	2019-06-24
JP2019134475A	Japan	A	2019-08-08
RU2018145527A3	Russian Federation	A3	2019-08-08
EP2981101B1	European Patent Office (EPO)	B1	2019-08-14
MX2019006681A	Mexico	A	2019-08-21
US10405124B2	United States of America	B2	2019-09-03
CN107623894B	China	B	2019-10-15
RU2703364C2	Russian Federation	C2	2019-10-16
MY174500A	Malaysia	A	2020-04-23
CA3036880C	Canada	C	2021-04-27
JP6985324B2	Japan	B2	2021-12-22
JP2022020858A	Japan	A	2022-02-01
JP7181371B2	Japan	B2	2022-11-30