Method and apparatus of motion vector prediction for scalable video coding.
Abstract
Inter-layer motion mapping information may be used to enable temporal motion vector prediction (TMVP) of an enhancement layer of a bitstream. For example, a reference picture and a motion vector (MV) of an inter-layer video block may be determined. The reference picture may be determined based on a collocated base layer video block. For example, the reference picture may be a collocated inter-layer reference picture of the reference picture of the collocated base layer video block. The MV may be determined based on a MV of the collocated base layer video block. For example, the MV may be determined by determining the MV of the collocated base layer video block and scaling the MV of the collocated base layer video block according to a spatial ratio between the base layer and the enhancement layer. TMVP may be performed on the enhancement layer picture using the MV of the inter-layer video block.

Term
6.9 yearsleft in the term
Expires 29 August 2033.
- Priority
- Filed
- Granted
- Today
- Expires
18 claims: 3 independent, 15 dependent
- 1REIVINDICACIONES 1. Un método que comprende:recibir un flujo de bits, el flujo de bits comprende una capa base y una capa de mejora;añadir una imagen de intercapa a una lista de imágenes de referencia para una imagen de capa de mejora;y decodificar la imagen de capa de mejora utilizando la predicción de vector de movimiento temporal (TMVP) , en la que una imagen de intercapa se utiliza como imagen intercalada para la TMVP de la capa de mejora.
- 2El método de conformidad con la reivindicación 1, caracterizado porque la imagen de intercapa comprende textura proveniente de una imagen de capa base intercalada, vectores de movimiento escalados con base en vectores de movimiento de la imagen de capa base intercalada, e indices de imagen de referencia determinados a partir de indices de imagen de referencia asociados a la imagen de capa base intercalada.
- 3El método de conformidad con la reivindicación 1, caracterizado porque la decodificación de la imagen de capa de mejora que utiliza la TMVP comprende:determinar un campo de vector de movimiento (MV) de la imagen de intercapa con base en un campo de MV de una imagen de capa base intercalada;y decodificar la imagen de capa de mejora con base IMPI INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL en el campo de MV de la imagen de intercapa.
- 4El método de conformidad con la reivindicación 3, caracterizado porque la decodificación de la imagen de capa de mejora con base en el campo de MV de la imagen de intercapa comprende:determinar un campo de MV de la imagen de capa de mejora con base en el campo de MV de la imagen de intercapa;y decodificar la imagen de capa de mejora con base en el campo de de MV de la imagen de capa de mejora.
- 5El método de conformidad con la reivindicación 3, caracterizado porque el campo de MV de la imagen de intercapa comprende:determinar un campo de MV comprimido de la imagen de capa base intercalada;y determinar el campo de MV de la imagen de reivindicación 6, caracterizado porque la determinación de IMPI INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL la imagen de referencia y el MV de bloque de video imagen de intercapa comprende: determinar la imagen de referencia del bloque de video de intercapa con base en una imagen de referencia de un bloque de video de la capa base intercalada;y determinar el MV del bloque de video de intercapa con base en un MV del bloque de video de la capa base intercalada.
- 68. El método de conformidad con la reivindicación 7, caracterizado porque la determinación de la imagen de referencia del bloque de video de intercapa comprende:determinar una imagen de referencia del bloque de video de la capa base intercalada;y determinar la imagen de referencia del bloque de video de intercapa, en la que la imagen de referencia del bloque de video de intercapa es una imagen de intercapa intercalada de la imagen de referencia del bloque de video de la capa base intercalada.
- 79. El método de conformidad con la reivindicación 7, caracterizado porque la determinación del MV del bloque de video de intercapa comprende:determinar el MV del bloque de video de la capa base intercalada;y escalar el MV del bloque de video de la capa base IMPI INSTITUTO MEXICANO DE LA FROPIEDAD INDUSTRIAL intercalada de acuerdo con una relación espacial entre la capa base y la capa de mejora a fin de determinar el MV del bloque de video de intercapa.
- 810. Un método que comprende:determinar un campo de vector de movimiento (MV) de una imagen de intercapa;utilizar la predicción de vector de movimiento temporal (TMVP) para predecir un campo de MV de una imagen de capa de mejora con base en el campo de MV de la imagen de intercapa;y decodificar la imagen de capa de mejora con base en el campo de MV de la imagen de capa de mejora.
- 911. El método de conformidad con la reivindicación 10, caracterizado porque la imagen de intercapa se intercala con la imagen de capa de mejora.
- 1012. El método de conformidad con la reivindicación 10, caracterizado además porque comprende:de capa de mejora.
- 1113. Un decodificador, caracterizado porque comprende:ΙΜΡΪ INSTITUTO MEXICANO DS LA WOMF.DAO industrial un procesador configurado para: recibir un flujo de bits, el flujo de bits comprende una capa base y una capa de mejora;añadir una imagen de intercapa a una lista temporal (TMVP) , en la que la imagen de intercapa se utiliza como imagen intercalada para la TMVP de la imagen de capa de mejora.
- 1214. El decodificador de conformidad con la reivindicación 13, caracterizado porque la imagen de intercapa comprende textura proveniente de una imagen de capa base intercalada, vectores de movimiento escalados con base en vectores de movimiento de la imagen de capa base intercalada, e índices de imagen de referencia determinados a partir de índices de imagen de referencia asociados a la imagen de capa base intercalada.
- 1315. El decodificador de conformidad con la reivindicación 13, caracterizado porque el procesador configurado para decodificar la imagen de capa de mejora utilizando la TMVP comprende:el procesador configurado para: determinar un campo de vector de movimiento IMPI INSTITUTO MEXICANO Oí LA PROPIEDAD INDUSTRIAL (MV) de la imagen de intercapa con base en un campo de MV de una imagen de capa base intercalada;y decodificar la imagen de capa de mejora con base en el campo de MV de la imagen de intercapa.
- 1416. El decodificador de conformidad con la reivindicación 15, caracterizado porque el procesador configurado para decodificar la imagen de capa de mejora de intercapa;y decodificar la imagen de capa de mejora con base en el campo de MV de la imagen de capa de mejora.
- 1517. El decodificador de conformidad con la reivindicación 15, caracterizado porque el procesador configurado para determinar el campo de MV de la imagen de intercapa comprende:el procesador configurado para: determinar un campo de MV comprimido de la imagen de capa base intercalada;y determinar el campo de MV de la imagen de intercapa con base en el campo de MV comprimido de la imagen de capa base intercalada. 99 IMPI INSTITUTO MEXICANO DI LA PROPIEDAD INDUSTRIAL
- 1618. El decodificador de conformidad con la reivindicación 15, caracterizado porque el campo de MV de la imagen de intercapa comprende un MV y un indice de imagen de referencia de un bloque de video de la imagen de intercapa.
- 1719. El decodificador de conformidad con la reivindicación 18, caracterizado porque el procesador configurado para determinar la imagen de referencia y el MV del bloque de video de la imagen de intercapa comprende:el procesador configurado para: determinar la imagen de referencia del bloque de video de intercapa con base en una imagen de referencia de un bloque de video de capa base intercalada;y reivindicación 19, caracterizado porque el procesador configurado para determinar la imagen de referencia del bloque de video de intercapa comprende: el procesador configurado para: 100 IMPI INSTITUTO MEXICANO DS I.A PROPIEDAD industrial bloque de video de intercapa, en el que la imagen de referencia del bloque de video de intercapa es una imagen de intercapa intercalada de la imagen de referencia del bloque de video de la capa base intercalada.
- 1821. El decodificador de conformidad con la reivindicación 19, caracterizado porque el procesador configurado para determinar el MV del bloque de video de intercapa comprende:10 el procesador configurado para: determinar el MV del· bloque de video de la capa base intercalada;y escalar el MV del bloque de video de la capa base intercalada de acuerdo con una relación espacial entre la capa base y la capa de mejora a fin de determinar el MV del bloque de video de intercapa. 101 IMPI INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL
Independent claims18
593 paragraphs in 145 sections, as filed
(54) Title: MOTION VECTOR PREDICTION METHOD AND APPARATUS FOR SCALABLE VIDEO CODING.
(54) Title: METHOD AND APPARATUS OF MOTION VECTOR PREDICTION FOR SCALABLE VIDEO CODING.
(57) Summary
In accordance with the present invention, the interlayer motion mapping information can be used to enable Temporal Motion Vector Prediction (TMVP) of a bit stream enhancement layer. For example, a reference image and a motion vector (MV) of an interlayer video block can be determined. The reference image can be determined based on an interleaved base layer video block. For example, the reference image may be an interleaved interlayer reference image of the interleaved base layer video block reference image. The MV can be determined based on an MV of the interleaved base layer video block. For example, the MV can be determined by determining the MV of the interleaved base layer video block and scaling the MV of the interleaved base layer video block according to a spatial relationship between the base layer and the enhancement layer. TMVP can be performed on the enhancement layer image using the MV of the interlayer video block.
(57) Abstract
Inter-layer motion mapping Information may be used to enable temporal motion vector prediction (TMVP) of an enhancement layer of a bitstream. For example, a reference picture and a motion vector (MV) of an inter-layer video block may be determined. The reference picture may be determined based on a collocated base layer video block. For example, the reference picture may be a collocated inter-layer reference picture of the reference picture of the collocated base layer video block. The MV may be determined based on a MV of the collocated base layer video block. For example, the MV may be determined by determining the MV of the collocated base layer video block and scaling the MV of the collocated base layer video block according to a spatial ratio between the base layer and the enhancement layer. TMVP may be performed on the enhancement layer picture using the MV of the inter-layer video block.
<img file="MX341900B_D0001.tif" />
Institute
Mexican Property
Industrial
PATENT TITLE NO. 341900 _SE_
SítfttTAKÍA Bt ECONOMÍA
<img file="MX341900B_D0002.tif" />
Headlines):
Home:
Denomination:
Classification:
Inventor (s):
Number:
MX / a / 2015/002536
Country:
US
US,
US
VID SCALE, INC.
200 Bellevue Parkway, Suite 300, Wilmington, Delaware, 19809, USA
MOTION VECTOR PREDICTION METHOD AND DEVICE FOR SCALABLE VIDEO ENCODING. Int.CI.8: H04N19 / 31; H04N19 / 39; H04N19 / 513 XIAOYU XIU; YAN YE; YONG HE; YUWEN HE
REQUEST
International filing date:
August 2013
PRIORITY
Date:
August 2Q12 December 7, 2012 August 16, 2013
61/694,555
61/734,650
61/866,822
Validity: Twenty years
Expiration Date: August 29, 2033, the reference patent is granted based on articles 1 2nd fraction V, 6th fraction Itl, and 59 of the Industrial Property Law.
In accordance with article 23 of the Industrial Property Law, this patent has a non-extendable term of twenty years, counted from the date of filing of the international application, and your payment will be * te teWA to keep the rights.
Whoever subscribes to the present title does so with the founding, in the provisions of toe arttoutoe. 08/02 * 1884 10/25/1996, 12/26/1987, 17705/1999, 01/26/2004, 06/16/2005 ^ 25/01 / 2tj | 06/06/05/2009/06/06 / 2010 1WCB / 2010, 28/087/010 27/010 * '2 and 04/09/2012); Articles J ?, 3rd fraction V dbciso a), 4th and 12th sections I * dll of the Regulations of the Institute MgfflMfltil ♦ w Industrial Age (DOF 14/12 / I9íj |, amended on 07/01/2002, 07/15/200 * 28/07/21 ^ 4 and 7/09/2007), articles 4, 5, section V, subsection a), 16 sections I and III and 30 of the Organic Statute of the Mexican Institute of Industrial Property (OOF 12/27/1899, amended »18/10/2002, ^ ntnd ^ f ^ 9/2007); one ”, 3rd and 5th paragraph a) of the Agreement that delegates powers to the Deputy Directors General, Coordinator, Divisional Directors, Holders of the Regional Offices, Divisional Deputy Directors, Departmental Coordinators and other subordinates of the Mexican Institute of Industrial Property. (DOF 12/15/1999, amended on 02/04/2000, 07/29/2004, 08/04/2004 and 09/13/2007).
<img file="MX341900B_D0003.tif" />
Sand! No. 55G. Floor 1 Coi. Santa María Tepepan town. Xochimiíco. CP 16020.
Mexico City
Tea). 55) 53 34 07 00 www. Olímpi gob.mx
Issue Date: September 7, 2016
DIVISIONAL DIRECTOR OF PATENTS
<img file="MX341900B_D0004.tif" />
NAHANNY CANAL REYES
<img file="MX341900B_D0005.tif" />
<img file="MX341900B_D0006.tif" />
MX / 2016/72407
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL EROEIEDAD
<img file="MX341900B_D0007.tif" />
MOTION VECTOR PREDICTION METHOD AND APPARATUS FOR
SCALABLE VIDEO ENCODING
FIELD OF THE INVENTION
In the past two decades, digital video compression technologies have been developed and standardized to enable efficient digital video communication, distribution, and consumption. Most of the massively commercially implemented standards are developed by ISO / IEC and ITU-T, such as MPEG-2 and H.264 (MPEG-4 part 10). Due to the emergence and maturity of video compression technologies, high efficiency video coding (HEVC) may be developed.
BACKGROUND OF THE INVENTION
Compared to traditional digital video services over satellite, cable, and terrestrial transmission channels, more and more video applications, such as, but not limited to, video chat, mobile video, and real-time video broadcast, can be used in an environment that can be heterogeneous in the client, as well as in the network part. Smartphones, tablets, and TVs can dominate the client side, where video can be streamed over the Internet, the mobile network, and / or a combination of
IMPI iNsmvro Mexican Dt LA «INDUSTRIAL OTIITY
<img file="MX341900B_D0008.tif" />
both. In order to improve the user experience and the video quality of the service, scalable video coding (SVC) can be implemented. In the SVC, the signal can be encoded once in the highest resolution, but they allow decoding of subsets of the specific resolution and speed dependent streams desired by the application and supported by the client device. International video standards MPEG-2 Video, H.263, MPEG4, and H.264 Visual may have the tools and / or profiles to support scalability modes.
BRIEF DESCRIPTION OF THE INVENTION
Interlayer motion mapping information can be used to enable Temporal Motion Vector Prediction (TMVP) of a bitstream enhancement layer. For example, a reference image of an enhancement layer video block may be determined based on an interleaved base layer video block. The video block of the enhancement layer can be associated with an enhancement layer of a video bitstream and the video block of the embedded base layer can be associated with a base layer of the bitstream. For example, the enhancement layer video block can be associated with an enhancement layer image and the embedded base layer video block
<img file="MX341900B_D0009.tif" />
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY can be associated with a base layer image. The video block of the interleaved base layer can be determined by selecting a video block of an interleaved base layer image that is characterized by greater overlap in area with the video block of the enhancement layer. A video block can be an operating unit at any level of the bit stream. A video block | it can be any size (for example, block size (for example, 16 * 16), PU, SPU, or the like).
The reference image of the enhancement layer video block can be determined by determining a reference image of the interleaved base layer video block. The reference image of the enhancement layer video block may be an embedded enhancement layer image of the reference image of the embedded base layer video block. The reference image of the enhancement layer video block can be determined by determining a reference image of the interleaved base layer video block, using the reference image of the interleaved base layer video block therein to determine a reference image of an interlayer video block, and using the reference image of an interlayer video block to determine the reference image of the enhancement layer video block. The interlayer video block can
IMPI
INSTITUTO MEXICANO OE LA PROPIEDAD INDUSTRIAL interspersed with the video block of the enhancement layer and / or the video block of the base layer.
A motion vector (MV) of the enhancement layer video block can be determined based on an MV of the interleaved base layer video block. The MV of the enhancement layer video block can be determined by determining the MV of the interleaved base layer video block, and the scaling of the interleaved base layer video block MV according to a spatial relationship between the layer base and enhancement layer to determine the MV of the enhancement layer video block.
The MV of the enhancement layer video block can be determined by determining the MV of the interleaved base layer video block, scaling the MV of the interleaved base layer video block according to a spatial relationship between the base layer and the enhancement layer in order to determine a MV of an interlayer video block, and predict the MV of the enhancement layer video block based on the MV of the interlayer video block. For example, the MV of the enhancement layer video block can be predicted based on the MV of the interlayer video block by time scaling the MV of the interlayer video block. The interlayer video block can be interleaved with the video block of the
<img file="MX341900B_D0010.tif" />
IMPI
MEXICAN INSTITUTE Dt THE INDUSTRIAL PROPERTY
<img file="MX341900B_D0011.tif" />
enhancement layer and / or the base layer video block.
TMVP can be performed in the video block of the enhancement layer using the MV and / or the reference image of the interlayer video block layer. The enhancement layer video block can be decoded based on the reference image and / or the enhancement layer video block MV and / or the reference image and / or the interlayer video block MV .
One method may include receiving a bitstream that includes a base layer and an enhancement layer, and decoding the enhanced bitstream layer encoded using time motion vector prediction (TMVP). An interlayer reference image can be used as an interleaved reference image for the enhancement layer TMVP.
Decoding the enhanced bitstream layer encoded using the TMVP may include decoding an enhancement layer image using the TMVP. Decoding the enhancement layer image using the TMVP may include determining a motion vector (MV) field of an interlayer reference image, and decoding the enhancement layer image based on the field. of MV of the interlayer reference image. The MV field of the interlayer reference image can be determined based on a β
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0012.tif" />
MV field of an interleaved base layer image. The MV field may include a MV and a reference frame index of a video block of the interlayer reference image. For example, a MV field can include an MV and one or more reference image indexes from one or more video blocks of the interlayer reference image (for example, depending on whether it is a P segment or a segment B). Determination of the MV field of the interlayer reference image may include a field determining a compressed MV field of an interleaved base layer image and determining the MV field of the interlayer reference image based on the Compressed MV field of the interleaved base layer image.
Determination of the MV field of the interlayer reference image may include determining a reference image and an MV of a video block of the interlayer reference image. Determination of the reference image and the video block MV of the interlayer reference image may include determining the reference image of the interlayer video block based on a reference image of a video block of the interleaved base layer and the determination of the MV of the interlayer video block based on an MV of the video layer of the base layer
IMPI
MEXICAN INSTITUTE OF THE NON-INDUSTRIAL AGE
<img file="MX341900B_D0013.tif" />
interspersed. The video block of the hAco-ίntorra1afla layer can be determined by selecting a video block of an interleaved base layer image that can be characterized by greater overlap in area with the video block of the interlayer reference image.
Determination of the reference image of the interlayer video block may include determination of a reference image of the interleaved base layer video block and determination of the reference image of the interlayer video block. The interlayer video block reference image may be an interleaved reference image interleaved from the interleaved base layer video block reference image. Determination of the MV of the interlayer video block may include determining the MV of the interleaved base layer video block and scaling the MV of the interleaved base layer video block according to a spatial relationship between the base layer and the enhancement layer to determine the MV of the interlayer video block.
An MV field of an enhancement layer video block can be determined based on the MV field of the interlayer video block. The enhancement layer video block can be interleaved with the interlayer video block and / or the base layer video block. For example, a reference image of the enhancement layer video block
<img file="MX341900B_D0014.tif" />
<sup>8</sup> IMPI
MEXICAN INSTITUTE
OF THE PROPERTY
INDUSTRIAL can be determined based on the image of —xe £ ecen.c ± a interlayer video block (for example, it can be an interleaved enhancement layer image). The MV of the enhancement layer video block can be determined based on the MV of the interlayer video block. For example, the MV of the interlayer video block may be scaled (eg, graduated temporarily) in order to determine the MV of the enhancement layer video block. The enhancement layer video block can be decoded based on the MV field of the enhancement layer video block.
One method may include receiving a bitstream that includes a base layer and an enhancement layer and interlayer motion mapping information, and performing interlayer motion prediction of the enhancement layer. Interlayer motion prediction can be determined to be enabled for the enhancement layer based on the interlayer mapping information.
Interlayer mapping information may be signaled at the sequence level of the bit stream. For example, the interlayer mapping information may be a variable (eg, a flag) that is signaled at the sequence level of the bit stream. Interlayer mapping information can be inferred at the stream level of the · bitstream. Interlayer mapping information can be signaled
<img file="MX341900B_D0015.tif" />
ΙΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY using a variable [for example, a hanrWaí pn nn bit stream video parameter set (VPS) [for example, interlayer mapping information may be a flag in a VPS bitstream). For example, interlayer mapping information may be signaled by a variable (for example, a flag) in a sequence stream set (SPS) of the bitstream [eg, interlayer mapping information may be a flag in a bitstream SPS). For example, interlayer mapping information may be signaled by a variable (for example, a flag) in a bitstream picture parameter set (PPS) [for example, interlayer mapping information may be a flag in a bitstream PPS).
BRIEF DESCRIPTION OF THE FIGURES
Figure 1 is a diagram illustrating an example of a scalable structure with additional interlayer prediction for SVC spatial scalable coding.
Figure 2 is a diagram illustrating an exemplary interlayer prediction structure that can be considered for scalable HEVC coding.
Figure 3 is a diagram illustrating an example of spatial motion vector (MV) (SMVP) prediction.
Figure 4 is a diagram illustrating an example
ΙΜΡίλ>
MEXICAN INSTITUTE
OE THE PROPERTY
INDUSTRIAL J for temporal MV prediction (TMVP).
Figure 5 is a diagram illustrating an example of a prediction structure duplication from a base layer to an oversampled base layer.
Figure 6 is a diagram illustrating an exemplary relationship between SPUs of an oversampled base layer and SPUs of an original base layer.
Figures 7A-7C are diagrams illustrating an exemplary relationship between the segments of a base layer image and the segments of a processed base layer image.
Figure 8A is a diagram illustrating MV prediction among short-term temporary MVs.
Figure 8B is a diagram illustrating MV prediction of short-term temporary MVs from a short-term mapped MV.
Figure 9A is a diagram illustrating an example of MV prediction among long-term temporary MVs.
Figure 9B is a diagram illustrating an example of MV prediction of a long-term temporary MV from a long-term mapped MV.
Figure 10A is a diagram illustrating an example of MV prediction of a short-term temporary MV from a long-term temporary MV.
<img file="MX341900B_D0016.tif" />
Figure 10B is a diagram illustrating an example of MV prediction of a short-term temporary MV from a long-term mapped MV.
Figure 10C is a diagram illustrating an example of MV prediction of a long-term temporary MV from a short-term temporary MV.
Figure 10D is a diagram illustrating an MV prediction example of a long-term temporary MV from a short-term mapped MV.
Figure 11A is a diagram illustrating an example of predicting disabled MV of a short-term temporary MV from an interlayer MV.
Figure 11B is a diagram illustrating an example of predicting disabled MV of an interlayer MV from a short-term temporary MV.
Figure 11C is a diagram illustrating an example of predicting disabled MV from an interlayer MV of a short-term mapped MV.
Figure 12A is a diagram illustrating an example of predicting disabled MV of a long-term temporary MV from an interlayer MV.
Figure 12B is a diagram illustrating an example of an interlayer MV from a long-term temporary MV.
Figure 12C is a diagram illustrating a
IMPI
<img file="MX341900B_D0017.tif" />
Example of an interlayer MV from a long-term mapped MV.
Figure 13A is a diagram illustrating an example of MV prediction between two interlayer MVs when Te = Tp.
Figure 13B is a diagram illustrating an example of MV prediction disabled between interlayer MVs when Te Ψ Tp.
Figure 14A is a system diagram of an exemplary communication system in which one or more of the described modalities can be implemented.
Figure 14B is an exemplary system diagram of a wireless transmission / reception unit (WTRU) that can be used in the communication system illustrated in Figure 14A.
Figure 14C is a system diagram of an exemplary radio access network and an exemplary core network that can be used in the communications system illustrated in Figure 14A.
Figure 14D is a system diagram of another exemplary radio access network and another exemplary core network that can be used in the communication system illustrated in Figure 14A.
Figure 14E is a system diagram of another
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0018.tif" />
exemplary radio access network and another exemplary core network that can be used in the communication system illustrated in Figure 14A.
The Figure illustrates an example blocks.
Figure illustrates an example <blocks.
is a diagram of an encoder of is a diagram of a block decoder that video based on blocks that video based on
Figure 17 is a diagram illustrating an exemplary communication system.
DETAILED DESCRIPTION OF THE INVENTION
Encoding and / or decoding (eg, transmission and / or reception) of bit streams (eg, partial bit streams) may be provided to provide video services with lower temporal resolutions, spatial resolutions, and / or lower fidelity, while maintaining a reconstruction quality that can be relatively high at the rate of partial bitstreams, for example, by the scalability extension of H.264. Figure 1 is a diagram illustrating an example of a scalable structure with additional interlayer prediction for SVC spatial scalable coding. Diagram 100 can illustrate an example of a SVC interlayer prediction mechanism of
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY IA two layers that can improve the efficiency of scalable coding. A similar mechanism can be applied to a multilayer SVC encoding structure. In diagram 100, the base layer and enhancement layer can represent two adjacent spatial scalable layers with different resolutions. Within a layer (eg, base layer and / or enhancement layer), motion compensation prediction and / or intra-prediction, eg, by an H.264 encoder, may be employed. Interlayer prediction can use base layer information (eg, spatial texture, motion vector, reference image indices, residual signals, or the like) to improve the coding efficiency of the enhancement layer. When decoding an enhancement layer, the SVC should not use reference images from the lower layers (for example, layers dependent on the current layer) to fully rebuild itself.
Interlayer prediction can be employed in a scalable coding system (eg, a HEVC scalable coding extension), eg, to determine a correlation between multiple layers and / or to improve scalable coding efficiency. Figure 2 is a diagram illustrating an exemplary interlayer prediction structure that can be considered for scalable HEVC coding. By
<img file="MX341900B_D0019.tif" />
<img file="MX341900B_D0020.tif" />
MEXICAN INSTITUTE »; OF IA PROPERTY
INDUSTRIAL
<img file="MX341900B_D0021.tif" />
For example, Diagram 200 can illustrate an example of a scalable structure with additional interlayer prediction for HEVC spatial scalable coding. The prediction of an enhancement layer can be formed by the motion compensation prediction derived from the reconstructed base layer signal (for example, after oversampling if the spatial resolutions between the two layers are different), by the temporal prediction within the current enhancement layer and / or by averaging the base layer reconstruction signal with a time prediction signal. Full reconstruction of the lower layer images can be performed. A similar application can be used for a scalable coding system with more than two layers (for example, a HEVC scalable coding system with more than two layers).
The HEVC can use advanced motion compensation prediction techniques to determine the inherent interimage redundancy in a video signal, for example, using a pixel from an encoded video image to predict a pixel in a current video image. . The displacement between a prediction unit (PU) to be encoded and its one or more matching blocks in the reference images (for example, a neighboring PU) can be represented by a motion vector (MV), by
I
X XVA XX
INSTITUTO MEXICANO JA »E LA rwon RILA c ¿£ J
INDUSTRIAL ** _ * ·!
example, in motion compensation prediction.
An MV can comprise two components, MVX and MVy. Mvx and MVy can represent displacement in the horizontal and vertical directions, respectively. MVX and MVy may or may not be directly encoded.
Advanced motion vector prediction (AMVP) can be used to predict a MV from one or more MVs of neighboring PUs. The difference between the actual MV and the MV predictor can be coded. By encoding (eg encoding only) the MV difference, the bits used to encode the MVs can be reduced. The MVs used for the prediction can be obtained from the spatial and / or temporal neighborhood. The spatial neighborhood can refer to the spatial PUs surrounding the current encoded PUs. The temporary neighborhood may refer to the PU sandwiched in the neighboring image. In the HEVC, in order to obtain an accurate MV predictor, the spatial and / or temporal neighborhood prediction candidates can be grouped together to form a candidate list, and the best predictor can be selected to predict the current PU MV. For example, the selection of the best MV predictor may be based on the Lagrangian (RD) rate distortion cost (RD), or the like. The MV difference can be encoded in a bit stream.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0022.tif" />
Figure 3 is a diagram illustrating an example of spatial MV prediction (SMVP). Diagram 300 can illustrate an example of a neighboring reference image 310, a current reference image 320, and a current image 330. In the current image to be encoded (CurrPic 330), the hash square (CurrPU 332) may be the PU current. The CurrPU 332 may have the best match block (CurrRefPU 322) in the reference image (CurrRefPic 320). The MV of the CurrPU (MV2 340) can be predicted. For example, in the HEVC, the spatial neighborhood of the current PU may be the upper, left, upper left, lower left, or upper right neighbor PU of the current PU 332. For example, the neighboring PU 334 may display as the upper neighbor of the
<td>CurrPU 332.</td><td>The</td><td>image</td><td>of</td><td>reference</td><td>of</td><td>the NeighbPU</td>
<td>(NeighbRefPie</td><td> 310)</td><td>, PU</td><td> 314,</td><td>and MV (MV1</td><td> 350)</td><td>They may be</td>
<td>known for</td><td colspan="2">example,</td><td>due</td><td>to that</td><td colspan="2">NeighbPU 334 can</td>
<td colspan="2">to have coded</td><td>before</td><td>of the</td><td>CurrPU 332</td><td></td><td></td>
Figure 4 is a diagram illustrating an example of temporal MV prediction (TMVP). Diagram 400 can include four images, ColRefPic 410, CurrRefPic 420, ColPic 430, and CurrPic 440, for example. In the current image to encode (CurrPic 440), the scattered square (CurrPU 442) can be the current PU. The scattered square (CurrPU 442) can have the best match block (CurrRefPU
<img file="MX341900B_D0023.tif" />
IMPI
INSTITUTO MEXICANO SF. INDUSTRIAL PROPERTY
422) in the reference image (CurrRefPic 420). The MV of the CurrPU (MV2 460) can be predicted. For example, in the HEVC, the temporary neighborhood of the current PU may be the sandwiched PU (ColPU 432), for example, which may be part of a neighboring image (ColPic 430). The ColPU reference image (ColRefPic 410), the PU 412 and the MV (MV1 450) may be known, for example, because the ColPic 430 may have been encoded prior to the CurrPic 440.
The movements between PUs can be of translation with uniform speed. The MV between two PUs can be in proportion to the temporal distance between the time instances when the two associated images are captured. A motion vector predictor can be scaled before predicting the MV of the current PU (for example, in the AMVP). For example, the time distance between the CurrPic and the CurrRefPic can be called TB. For example, the time distance between CurrPic and NeighbRefPic (for example, in Figure 3) or between ColPic and ColRefPic (for example, in the
Figure 4) can be called TD. Given TB and TD, the graduated predictor of MV2 (for example, MV2 ') can be equal to:
^ = ™ ^ MV2 '= MV1X<sup>T</sup>-1 MVl TD TD
Equation (1)
Short reference images can be supported
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0024.tif" />
term and long term. For example, reference images stored in the Decoded Picture Buffer (DPB) may be marked as short-term reference images or long-term reference images. Motion vector grading, for example, as in Equation (1), can be disabled if one or more of the reference images are long-term reference images.
The use of MV prediction for multi-layer video encoding can be described herein. The examples described here can use the HEVC standard as a single underlying layer encoding standard and a scalable system with two spatial layers (eg enhancement layer and base layer). The examples described herein may be applicable to other scalable coding systems that use other types of underlying single-layer code, that have more than two layers, and / or that support other types of scalability.
At the start of decoding a video segment (eg, a P segment or a Β segment), one or more reference images in the DPB can be added to a reference image list (eg, ready) of the P segment and / or two lists of reference images (for example, ready and listl) of segment B for prediction by
<img file="MX341900B_D0025.tif" />
IMPI
INSTITUTO MEXICANO DS THE PROPERTY industrial movement compensation. A scalable .coding system can apply the pr .coding motion compensation prediction using the temporal reference images of the enhancement layer and / or the processed reference images from the base layer (for example, base layer images oversampled if spatial resolutions may be different between layers). When predicting the MVs of the current image in an enhancement layer, an interlayer MV that points to a processed reference image from a base layer can be used to predict a temporary MV that points to a layer's temporal reference image for improvement. A temporary MV can be used to also predict an interlayer MV. Since there may be little correlation between these two types of MVs, it can cause loss of efficiency of MV prediction for an enhancement layer. The single-layer codec may not support prediction of the temporal MV among the enhancement layer images from the temporal MV between the base layer images, which may be highly correlated and can be used to improve the prediction performance of MV.
The MV prediction process can be simplified and / or the compression efficiency for multi-layer video encoding can be improved. The prediction of MV in the enhancement layer can be
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0026.tif" />
backward compatible with the MV prediction process of a single layer encoder. There may be a MV prediction implementation that may not require any change in the block level operations of the enhancement layer, for example, such that the single layer encoder and decoder logics can be reused for the improvement. This can reduce the complexity of implementing the scalable system. MV prediction of an enhancement layer can distinguish the temporary MVs that point to the temporal reference images in an enhancement layer and the interlayer MVs that point to the processed (for example, oversampled) reference images of the base layer . This can improve coding efficiency. MV prediction in an enhancement layer can support MV prediction between the temporary MV between images in the enhancement layer and the temporary MV between images in the base layer. This can improve coding efficiency. When the spatial resolutions differ between the two layers, the temporary MVs between the images in the base layer can be scaled according to the ratio of the spatial resolutions of the two layers.
<td>The</td><td>implementations</td><td>described in</td><td>the</td><td>Present</td>
<td>can be</td><td>related to</td><td>an algorithm</td><td>of</td><td>mapping of</td>
<td>information of</td><td>movement of</td><td>interlayer for</td><td>MVs</td><td>layer</td>
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0027.tif" />
base, for example, such that mapped or flake -MVa · s can be used to predict enhancement layer MVs in the AMVP process (eg, the TMVP mode of Figure 4). Block level operations should not be changed. The single layer encoder and decoder can be applied without change for MV prediction of an enhancement layer. MV prediction tools that can comprise block-level changes for enhancement layer encoding and decoding processes can be described herein.
An interlayer can include a processed base layer and / or an oversampled base layer. For example, an interlayer, a processed base layer, and / or an oversampled base layer can be used interchangeably. An interlayer reference image, a processed base layer reference image, and / or an oversampled base layer reference image may be used interchangeably. An interlayer video block, a processed base layer video block, and / or an oversampled base layer video block may be used interchangeably. There may be a temporal relationship between an enhancement layer, an interlayer, and a base layer. For example, a video and / or image block of an enhancement layer may be associated with a temporarily corresponding video block and / or the image of the interlayer and / or the base layer.
I Μ. ΡI
MEXICAN INSTITUTE '/ ¿“« «írócS
DF I to «nRirn * γ. * ·· ν ^ ί<sup>-</sup>
OF THE PROPERTY
A video block can be unique ^^ oper;
to any layer and / or level of City flow. For example, a video block can refer to an operating unit at the image level, at the block level, at the segment level, etc. A video block can be any size. For example, a video block can refer to a video block of any size, such as a 4 * 4 video block, an 8 * 8 video block, a 16 * 16 video block, or the like. . For example, a video block may refer to a prediction unit (PU), a smaller PU (SPU), or the like. A PU can be the video block unit used to carry the information related to motion prediction, for example, including a reference image index and MV. A PU can include one or more smaller PUs (SPUs). Although SPUs on the same PU can refer to the same reference image with identical MVs, storing motion information in units of the SPUs can facilitate retrieval of motion information in some implementations. The motion information (eg, a MV field) can be stored in units of the video block, such as the PU, the SPU, or the like. Although the examples described herein can be described with reference to the images, video blocks, PUs and / or SPUs, any
<img file="MX341900B_D0028.tif" />
operating unit of any size [eg, an image, a video block, a PU, a SPU, or the like).
The texture of the reconstructed base layer signal can be processed for interlayer prediction of the enhancement layer. For example, when spatial scalability between the two layers is enabled, processing the interlayer reference image may involve oversampling one or more base layer images. Motion related information (eg MVs, reference image lists, reference image indexes and / or the like) may not be generated properly for processed reference images from the base layer. Missing motion information can affect the prediction of enhancement layer MVs [eg, by TMVP) when temporal MV predictors from processed base layer reference images [eg, as shown in Figure 4).
For example, when a processed base layer reference image is selected as the temporal neighbor image (ColPic) comprising the temporal interleaved PU (ColPU), if the MV predictor (MV1) and the reference image (ColRefPic) do not are properly generated for the processed base layer reference image, then the TMVP may not function properly. In order to enable TMVP for enhancement layer MV prediction, you can
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0029.tif" />
An implementation of mapping interlayer motion information, for example, as described herein, will be used. For example, the MV field (for example, including MVs and reference images) can be generated for processed base layer reference images.
A reference image of the current video segment can be specified by one or more variables, for example, the list of ListX reference images (for example, with X being 0 or 1), the reference image index refldx in ListX, and / or the like. Using the example in Figure 4, in order to obtain the reference image (ColRefPic) of the interleaved PU (ColPU), the reference images of a PU (for example, each PU) (ColPU) can be generated in the image of reference processed (ColPic). This can be broken down to generate the ColPic reference image list and / or the reference image index for a ColPU (for example, each ColPU) in a ColPic. Given a list of reference images, the generation of the reference image index for a PU in a reference image of the processed base layer can be described herein. Implementations related to forming a reference image list for a processed base layer reference image can be described herein.
Since the base layer and the processed base layer
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0030.tif" />
they can be correlated, they can asnmirsa-gna L · rapa hase and the processed base layer have the same or practically the same prediction dependency. The prediction dependency of the base layer image can be duplicated to form the reference image lists of the processed base layer image. For example, if a BLl base layer image is a temporary reference image of another BL2 base layer image with the reference image index refldx of the ListX reference image list (for example, X is 0 or 1), then BLl's processed base layer image pBLl can be added to the same ListX reference image list (for example, being X 0 or 1) with the same index refldx of BL2's processed base layer image pBL2. Figure 5 is a diagram illustrating an example of a prediction structure duplication from a base layer to an oversampled base layer. Diagram 500 shows an example of spatial scalability, in which the same hierarchical structure B applied for predicting motion of a base layer (for example, represented by solid lines in the figure) is duplicated as the motion information of the oversampled base layer (for example, represented by dashed lines in the figure).
A reference image of a processed base layer prediction unit (PU) can be determined based on an interleaved base layer PU. For example,
ΜΙ _
MEXICAN INSTITUTE
I> E PROPERTY <sup>4</sup>
<img file="MX341900B_D0031.tif" />
Industrial, a processed base layer interleaved PU layer can be determined. The interlaid base layer PU can be determined by selecting a PU from an interleaved base layer image that is characterized by greater overlap in area with the processed base layer PU, for example, as described herein. A reference image of the interleaved base layer PU can be determined. The reference image of the processed base layer PU can be determined as an interleaved processed base layer image of the reference image of the interleaved base layer PU. The reference image of the processed base layer PU can be used for the TMVP of an enhancement layer and / or to decode an enhancement layer (eg, an interleaved enhancement layer PU).
The processed base layer PU can be associated with a processed base layer image. A MV field of the processed base layer image may include the reference image of the processed base layer PU, for example, for the TMVP of an enhancement layer image (eg, an embedded enhancement layer PU) . A list of reference images can be associated with the processed base layer image. The reference image list of the processed base layer image may include one or more of the reference images of the processed base layer PUs. An image (for example, each image) in a
<img file="MX341900B_D0032.tif" />
IMPI
INSTITUTO MEXICANO DS LA PROPIEDAD INDUSTRIAL processed base layer can inherit the same picture order count (POC) and / or short / long-term image marking from a corresponding image in the base layer.
Spatial scalability with a 1.5 * oversampling ratio can be used as an example. Figure 6 is a diagram illustrating an exemplary relationship between SPUs of an oversampled base layer and SPUs of an original base layer. Diagram 600 can illustrate an exemplary relationship between oversampled base layer SPUs (eg, blocks denoted as u¿) and original base layer SPUs (eg, blocks denoted as bj). For example, given the various oversampling ratios and coordinates in the image, an SPU in the oversampled base layer image may correspond to various numbers and / or proportions of the SPUs from the original base layer image. For example, the SPU u<sub>4</sub> can cover the regions of four base layer SPUs (eg bo, bi, b<sub>2</sub>, b<sub>3</sub> and bj). The SPU ui can cover two base layer SPUs (for example, b<sub>0</sub> and b<sub>x</sub>). The SPU u<sub>0</sub> you can cover a single base layer SPU (eg bo). The MV field mapping implementation can be used to calculate the reference image index and MV for a SPU on the processed base layer images, for example using the
IMPI
MEXICAN INSTITUTE OF FROFIEDAD
INDUSTRIAL
<img file="MX341900B_D0033.tif" />
motion information of their corresponding SPUs from the original base layer images.
An MV of a processed base layer PU can be determined based on an MV of an interleaved base layer PU. For example, an interleaved base layer PU can be determined from the processed base layer PU. The MV of the interleaved base layer PU can be determined. The MV of the base layer PU can be scaled to determine the MV of the processed base layer PU. For example, the MV of the
Base layer PU can be scaled according to a spatial relationship between the base layer and the enhancement layer to determine the MV of the processed base layer PU. The MV of the processed base layer PU can be used for the enhancement layer TMVP (eg, an interleaved enhancement layer PU) and / or to decode the enhancement layer (eg, an enhancement layer PU interspersed).
The processed base layer PU may be associated (eg temporarily associated) with an enhancement layer image (eg a PU in the enhancement layer image). An MV field of an interleaved enhancement layer image may be based on the MV (s) of the processed base layer PU (s), for example for the TMVP of the enhancement layer image (for example, an interlayer enhancement layer PU). An MV of an enhancement layer PU (for example, an embedded enhancement layer PU) can
IMPI
MEXICAN INSTITUTE OE THE INDUSTRIAL EKOPIEDAD
<img file="MX341900B_D0034.tif" />
determined based on the MV of the processed base layer PU. For example, the MV of an enhancement layer PU (eg, an interleaved enhancement layer PU) can be predicted (eg, spatially predicted) using the MV of the processed base layer PU.
The reference image (s) for a SPU (for example, each SPU) in processed base layer images can be selected based on the reference image indexes of the corresponding SPU (s) in the base layer. For example, for a SPU in the processed base layer image, a majority rule can be applied to determine the reference image index that may have been used very frequently by its corresponding SPUs from the base layer image. For example, assuming that u<sub>h</sub> SPU in the processed base layer image corresponds to K SPUs bi (i = 0, 1, Kl) of the base layer, there can be M reference images in the list of reference images of the processed base layer image with indices (0, 1, Ml). Assuming the corresponding K SPUs from the base layer are predicted from a set of reference images with indices (r<sub>0</sub>, ri, ..., r<sub>K</sub>-i) in which ri e (0, 1, ..., Ml) for i = 0,
1, Kl, the reference image index of Uh can be determined by Equation (2):
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROFESSION r (u<sub>TO</sub>) = r<sub>lr</sub> = argmax<sub>i £ l0</sub>, i, ...,<sub>K</sub>-i) C (n)
Equation (2) in which C (ri), i = 0, 1, ..., Kl, can be the counter of how many times the reference image rj can be used. For example, if the base layer image has 2 reference images (M = 2) denoted as {0, 1} and a certain Uh in the processed base layer image it may correspond to 4 (K = 4) base layer SPUs predicted from {0, 1, 1, 1} (for example, {r<sub>0</sub>, ri, r<sub>3</sub>} can be equal to {0, 1, 1, 1}), so r (u<sub>h</sub>) can be set to 1 according to Equation (2). The reference image ri with the smallest POC distance to the current processed image may be selected, for example, since two images with the smallest temporal distance may have the highest correlation (for example, break to C (ri) when applying Equation (2)).
Different SPUs in a processed base layer image may correspond to different numbers and / or proportions of SPUs from the original base layer (for example, as shown in Figure 6). The reference image index of the base layer SPU having the largest covered area can be selected to determine the reference image of the corresponding SPU in the processed base layer. For a given UH of SPU in the processed base layer, its reference image index may
-
MEXICAN INSTITUTE * 1
OF THE jS & PROPERTY
INDUSTRIAL
IMPI determined by Equation (3):
r (u<sub>h</sub>) = r<sub>lr</sub> 1 = argmaxiefo, Γ-, κ-ii Yes
Equation (3) where Si can be the area covered by the i th corresponding bi SPU from the base layer. The reference image r ± with the smallest POC distance to the current processed image can be selected, for example, to unpack the S ± in Equation (3) when two or more corresponding SPUs cover an area of the same size.
A corresponding base layer SPU bj can be encoded intra-mode. A reference image index (eg from the corresponding base layer SPU bj) should be set to -1 and should not be considered when applying Equation (2) and / or and Equation (3). If the corresponding base layer SPUs bj are intracoded, the reference image index of the u-, of SPU can be set to -1 and / or marked as not available for TMVP.
For a given UH of SPUs in the processed base layer, the areas of their corresponding SPUs b ^ s cannot be the same. The MV of a SPU (eg, each SPU) in a processed base layer image can be calculated, for example, using an area-based implementation as described herein.
ΙΜΡΙ
<img file="MX341900B_D0035.tif" />
To calculate the MV of a u<sub>h</sub> SPU in the processed base layer image, you can select the MV of the base layer SPU bi that has the largest area covered (for example, the largest overlap) with the u<sub>h</sub> of SPUs among the base layer SPU candidate biS. For example, Equation 4 can be used:
MV '= N MV<sub>lr</sub> 1 = argmax<sub>ieí0</sub>, i, ..., k-1} Yes
Equation (4) where MV 'can denote the MV resulting from the UH of SPU, the MVi can represent the MV of the i-th bi of corresponding SPU from the base layer, and N can be the oversampling factor (for example , N can be equal to 2 or 1.5) depending on the spatial relationship (for example, the spatial resolution) between the layers (for example, the base layer and the enhancement layer). For example, the oversampling factor (eg, N) can be used to scale the resulting MV determined from the base layer PU to calculate the MV of the PU of the processed base layer image.
The weighted average can be used to determine the MV of a SPU in a processed base layer. For example, the weighted average can be used to determine the MV of a SPU in a processed base layer by using the MVs associated with the corresponding SPUs in the base layer. Using the weighted average can,
<img file="MX341900B_D0036.tif" />
IMPI
MEXICAN INSTITUTE OF THE IROPIFDAI)
INDUSTRIAL for example, increase the precision of the MV of the processed base layer. For a UH of SPU in the processed base layer, its MV can be derived by determining a weighted average for the MV of one or more {eg, each) bj of underlying base layer SPU which overlaps with Uh- For example, this may be shown by the
Equation 5:
Μ V = NB = {j: rj = r {u<sub>h</sub>}} Equation (5) ί, ΚΞΒ St in which B can be a subset of the bis of the base layer SPUs whose reference image index can be equal to ar (Uh), for example, as determined in Equation (2) and / or Equation (3).
One or more filters (eg, a medium filter, a Gaussian low-pass filter, or the like) can be applied to the set of MVs denoted B in
Equation (5), for example, to get the mapped MV denoted MV '. You can use a confidence-based average to improve the accuracy of the calculated MV, for example, as shown by Equation 6:
MV '= N -<sup>l</sup>~<sup>Wl Si M</sup>-, B = {j: rj = r {uh)} Equation (6)
ZieBWi-St <sup>J</sup> where the parameter Wi can be the confidence measurement of the MV of a bi of base layer SPU (for example, each bi of base layer SPU) when calculating the MV of
IMPI
Mexican Institute of Industrial Property
<img file="MX341900B_D0037.tif" />
the u<sub>h</sub> from SPU. RiifprpTitPR metrics can be used to derive the value of Wi. For example, Wi can be determined according to the amount of prediction residual during motion compensation prediction, w<sub>±</sub> it can be determined according to how consistent the MV ± can be with its neighboring MVs, or the like.
Motion information from a processed base layer image can be mapped from the original base layer original motion field, for example, which can be used to perform temporal motion compensation prediction on the base layer. A motion field compression algorithm (eg, as supported in the HEVC) can be applied to the base layer motion field, eg, to produce a compressed motion field of the base layer. The motion information of one or more processed base layer images can be mapped from the compressed motion field of the base layer.
The missing motion information for a processed base layer image can be generated, for example, as described herein. The TMVP supported by a single layer codec (eg, a HEVC codec) can be used for an enhancement layer without additional changes in block level operations.
An image list generation process
IMPI
INSTITUTO MEXICANO DB LA PROPIEDAD INDUSTRIAL reference and / or a MV mapping process, for example, as described herein, can be used when a corresponding base layer reference image is made up of one or more sectors. If there are multiple segments in a base layer reference image, the segment partition can be mapped from the base layer image to the processed base layer image. The reference image list generation process can be performed for a segment in the processed base layer in order to derive the appropriate segment type and / or the reference image list.
Figures 7A-7C are diagrams illustrating an exemplary relationship between the segments of a base layer image and the segments of a processed base layer image, for example, for a spatial scalability of 1.5 *. Figure 7A is a diagram 701 illustrating an example of segment partitions in a base layer. Figure 7B is a diagram 702 illustrating an example of segment partitions mapped to a processed base layer. Figure 7C is a diagram 703 illustrating an example of fitted segment partitions in the processed base layer.
A base layer image can include a plurality of segments, for example two segments as shown in diagram 701. Segment partitions
<img file="MX341900B_D0038.tif" />
Mua.-Kv * »·
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY processed base may
<img file="MX341900B_D0039.tif" />
tree blocks tree) in the mapped in the layer image traversing the boundary between neighboring encodings (CTBs - enhancement coding, eg when base layer is oversampled (eg as shown in diagram 702) This may be due to the various spatial relationships between the base layer image and the enhancement layer image Segment partitions (eg in HEVC) can be aligned to the boundaries of the CTB. Segment partitions in the processed base layer can be adjusted so that the segment boundaries are aligned with the boundaries of the CTB, for example, as shown in diagram 703.
An enhancement layer TMVP derivation process may include a constraint. For example, if there is a segment in a corresponding base layer image, then the processed base layer image can be used as an interleaved image. Interlayer motion information mapping (eg, reference image list generation and / or MV mapping as described herein) should not be performed for a base layer reference image processed when there is more of a segment in a corresponding base layer image. If there is more than one segment in a corresponding base layer image, then a
<img file="MX341900B_D0040.tif" />
DELA PROPERTY 'INDUSTRIAL temporal reference image as the interleaved image for a TMVP bypass process of the enhancement layer. The number of segments in a base layer image can be used to determine if an interlayer reference image and / or a temporal reference image is used as the interleaved image for the TMVP of the enhancement layer.
If a segment exists in a corresponding base layer image and / or if the segment information (for example, the segment type, the list of segment reference images in a corresponding base layer image, or the like) is identical , then the processed base layer image can be used as an interleaved image. Mapping of interlayer motion information (for example, reference image list generation and / or MV mapping as described herein) should not be performed for a base layer reference image processed when two or more segments in a corresponding base layer image they have different segment information. If two or more segments in a corresponding base layer image have different segment information, then a time reference image can be used as an interleaved image for a TMVP derivation process of the enhancement layer.
Mapping motion information can
IMPI
OE THE INDUSTRIAL PROPERTY
<img file="MX341900B_D0041.tif" />
MEXICAN INSTITUTE
ΠΓ IA / *, allow various single layer MV prediction techniques to be used for a scalable coding system. Block level MV prediction operations can be applied to improve the coding performance of the enhancement layer. MV prediction of enhancement layers can be described here. The base layer MV prediction process can remain unchanged.
Temporary MV can refer to MVs that point to a reference image from the same enhancement layer. The interlayer MV can refer to MVs that point to another layer, for example, a reference image of the processed base layer. The mapped MV can refer to the MVs generated for a processed base layer image. Mapped MVs can include the temporary MV and / or the interlayer mapped MV. Mapped temporary MVs can refer to mapped MVs that originate from the timing prediction of the last encoding layer. Interlayer mapped MVs can refer to the mapped MVs generated from the interlayer prediction of the last encoding layer. Interlayer mapped MVs can exist for scalable coding systems with more than two layers. A temporary MV and / or a mapped temporary MV can be a short-term or long-term MV, for example, depending on whether
IMPI
MEXICAN INSTITUTE jfo
D € LA PROFILOAD 'Omw3BO $ F _ _, <sub>Ί</sub> INDUSTRIAL .2?
the MV refers to a short-term or long-term reference image. The short-term temporary MV and ^ he MV<sup>1</sup> Short-term mapping can refer to temporary MVs and mapped temporary MVs that use short-term temporary references in the respective encoding layer. The long-term temporary MV and the long-term mapped MV can refer to temporary MVs and mapped temporary MVs that use long-term temporary references in their respective encoding layers. The temporary MV, the mapped temporary MV, the interlayer mapped MV, and the interlayer MV can all be considered as different types of
MVs.
The enhancement layer MV prediction may include one or more of the following. MV prediction of a temporary MV from an interlayer MV and / or an interlayer mapped MV can be enabled or disabled. Prediction of MV of an interlayer MV from a temporary MV and / or a mapped temporary MV can be enabled or disabled. MV prediction of a temporary MV from a mapped temporary MV can be enabled. Prediction of MV of an interlayer MV from an interlayer MV and / or an interlayer mapped MV can be enabled or disabled. MV prediction can be used without MV scaling for the long-term MV involved in MV prediction, for example, including both the MV
IMPIOS
MEXICAN INSTITUTE
DE LA RROPIEDAI m'wsSÍ-'WS
INDUSTRIAL temporal— temporary long-term as the long-term mapped MV.
Prediction between short-term MVs with MV scaling can be enabled (for example, similar to single-layer MV prediction). Figure 8A is a diagram illustrating MV prediction among short-term temporary MVs. Figure 8B is a diagram illustrating MV prediction of short-term temporary MV from short-term mapped MV. In diagram 800, a short-term temporary MV 802 can be predicted from a short-term temporary MV 804. In diagram 810, a short-term temporary MV 812 can be predicted from a short-term mapped MV 814.
Prediction between long-term MVs without MV scaling can be provided, for example, due to the large POC distance. This may be similar to MV prediction of single layer encoding and decoding. Figure 9A is a diagram illustrating an example of MV prediction among long-term temporary MVs. Figure 9B is a diagram illustrating an example of MV prediction of a long-term temporary MV from a long-term mapped MV. In diagram 900, a long-term temporary MV 902 can be predicted from a long-term temporary MV 904. In diagram 910, a long-term temporary MV 912 can be predicted from a long-term mapped MV 914.
IMPI
MEXICAN INSTITUTE
FROM THE 'NDUSTWAL PROPERTY
<img file="MX341900B_D0042.tif" />
The prediction between a short-term MV and a long-term MV without MV scaling can be provided, for example, since the two reference images can have a great distance. This may be similar to MV prediction of single layer encoding and decoding. Figure 10A is a diagram illustrating an example of MV prediction of a short-term temporary MV from a long-term temporary MV. Figure 10B is a diagram illustrating an example of MV prediction of a short-term temporary MV from a long-term mapped MV. Figure 10C is a diagram illustrating an example of MV prediction of a long-term temporary MV from a short-term temporary MV. Figure 10D is a diagram illustrating an example of MV prediction of a long-term temporary MV from a short-term mapped MV.
In diagram 1000, a short-term temporary MV 1002 can be predicted from a long-term temporary MV 1004. In diagram 1010, a short-term temporary MV 1012 can be predicted from a long-term mapped MV 1014. In diagram 1020, a long-term temporary MV 1024 can be predicted from a short-term temporary MV 1022. In diagram 1030, a long-term temporary MV 1032 can be predicted from a short-term mapped MV 1034.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0043.tif" />
Prediction of a short-term temporary MV from an interlayer MV and / or an interlayer mapped MV can be disabled. Prediction of an interlayer MV from a short-term temporary MV and / or a short-term mapped MV can be disabled. Figure 11A is a diagram illustrating an example of predicting disabled MV of a short-term temporary MV from an interlayer MV. Figure 11B is a diagram illustrating an example of MV prediction disabled from a
MV of an interlayer MV from a short-term temporary MV. Figure 11C is a diagram illustrating an example of predicting disabled MV of an interlayer MV from a short-term mapped MV.
Diagram 1100 illustrates an example of predicting disabled MV of a short-term temporary MV 1102 from an interlayer MV 1104. For example, the short-term temporary MV 1102 should not be predicted from the
Interlayer MV 1104. Diagram 1110 illustrates an example of disabled MV prediction of an interlayer MV
1112 from a short-term temporary MV 1114. For example, the interlayer MV 1112 should not be predicted from the short-term temporary MV 1114. Diagram 1120 illustrates an example of predicting disabled MV from an interlayer MV 1122 to from a short-term mapped MV 1124. For example, the interlayer MV 1122 should not
<img file="MX341900B_D0044.tif" />
IMPI
INSTITUTO MEXICANO 'DE IA FROFIEDAD INDUSTRIAL
<img file="MX341900B_D0045.tif" />
be predicted from the short-mapped MV niazo 1124.
Prediction of a long-term temporary MV from an interlayer MV and / or an interlayer mapped MV can be disabled. Prediction of an interlayer MV from a long-term temporary MV and / or a long-term mapped MV MV can be disabled. Figure 12A is a diagram illustrating an example of predicting disabled MV from a long-term temporary MV from an interlayer MV. Figure 12B is a diagram illustrating an example of predicting disabled MV of an interlayer MV from a long-term temporary MV. Figure 12C is a diagram illustrating an example of predicting disabled MV of an interlayer MV from a long-term mapped MV.
Diagram 1200 illustrates an example of disabled MV prediction of a long-term temporary MV 1202 from an interlayer MV 1204. For example, the long-term temporary MV 1202 should not be predicted from the
Interlayer MV 1204. Diagram 1210 illustrates an example of predicting disabled MV of an interlayer MV 1212 from a long-term temporary MV 1214. For example, interlayer MV 1212 should not be predicted from temporary MV to long-term 1214. Diagram 1220 illustrates an example of predicting disabled MV of a 1222 interlayer MV from a mapped MV to
IMPI
INSTITUTO MEXICANO DI LA FXOPIEDAD INDUSTRIAL
<img file="MX341900B_D0046.tif" />
long-term 1224. For example, the interlayer MV 1222 should not be predicted from the long-term mapped MV 1224.
Predicting an interlayer MV from another interlayer MV can enable, for example, if two interlayer MVs have the same time interval in an enhancement layer and a processed base layer. If two interlayer MVs do not have the same time interval in an enhancement layer and a processed base layer, prediction between the two interlayer MVs may be disabled. This may be because the prediction may not deliver good encoding performance due to the lack of a clear MV correlation.
Figure 13A is a diagram illustrating an example of MV prediction between two interlayer MVs when Te = Tp. Figure 13B is a diagram illustrating an example of MV prediction disabled between interlayer MVs when TeáTp. TMVP can be used as an example (eg, as in Figures 13A-B). In diagram 1300, the current interlayer MV (for example, MV2)
1302 it can be predicted from another interlayer MV (eg MV1) 1304. The time interval between the current CurrPic image and its temporary neighbor ColPic image (eg comprising the ColPU of the interleaved PU) can be denoted as Ts. The time interval between their respective reference images (for example, CurrRefPic
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0047.tif" />
and ColRefPic) can be denoted as T<sub>p</sub>. CurrPic and ColPic may be on the enhancement layer. CurrRefPic and ColRefPic can be in the processed base layer. If T<sub>and</sub> = T<sub>p</sub>, then MV1 can be used to predict MV2.
MV scaling can be disabled for prediction between two interlayer MVs since, for example, POC-based MV scaling may fail. In diagram 1310, the current interlayer MV (for example, MV2) 1312 should not be predicted from another interlayer MV (for example, MV1) 1314, for example, because the time interval between the current CurrPic image and its image Temporary neighbor ColPic (for example, T<sub>and</sub>) is not equal to the time interval between their respective reference images (for example, T<sub>p</sub>) .
Prediction of an interlayer MV of an interlayer mapped MV can be inhabited without scaling, for example, if the interlayer MV and the interlayer mapped MV have the same time distance. If they do not have the same time distance, prediction of the interlayer MV of the interlayer mapped MV can be disabled.
Table 1 can summarize examples of different conditions on a MV prediction for SVC enhancement layer encoding.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0048.tif" />
Table 1: Conditions as an example ert [pTU “'ydbid Id prediction of the SV of the SVC enhancement layer
<td>MV objective</td><td>Predictor MV</td><td colspan="2">Condition on MV prediction</td>
<td rowspan="6">MV temporary to short term</td><td>Temporary MV short term</td><td colspan="2">available with MV scaling</td>
<td>MV mapped short term</td><td colspan="2">available with MV scaling</td>
<td>Long temporary MV term</td><td colspan="2">available without MV scaling</td>
<td>MV long-term mapping</td><td colspan="2">available without MV scaling</td>
<td>Interlayer MV</td><td colspan="2">not available</td>
<td>Interlayer mapped MV</td><td colspan="2">not available</td>
<td rowspan="6">MV temporary long term</td><td>Temporary MV short term</td><td colspan="2">available without MV scaling</td>
<td>MV mapped short term</td><td colspan="2">available without MV scaling</td>
<td>Long temporary MV term</td><td colspan="2">available without MV scaling</td>
<td>MV long-term mapping</td><td colspan="2">available without MV scaling</td>
<td>Interlayer MV</td><td colspan="2">not available</td>
<td>Interlayer mapped MV</td><td colspan="2">not available</td>
<td rowspan="6">MV of interlayer</td><td>Temporary MV short term</td><td colspan="2">not available</td>
<td>MV mapped short term</td><td colspan="2">not available</td>
<td>Long-term temporary MV</td><td colspan="2">not available</td>
<td>MV long-term mapping</td><td colspan="2">not available</td>
<td>Interlayer MV</td><td>available without escalation of MV when T<sub>and</sub>= T<sub>p</sub></td><td>not available when Τ<sub>6</sub>^ Τ<sub>Ρ</sub></td>
<td>Interlayer mapped MV</td><td>available without escalation of MV when T<sub>and</sub>= T<sub>p</sub></td><td>not available when T<sub>and</sub>#T<sub>p</sub></td>
MV mapping of interlayer MVs can be disabled for motion information mapping implementations between different encoding layers, for example, as described herein.
ΙΜΡΙ
MEXICAN INSTITUTE OF PROPERTY
<img file="MX341900B_D0049.tif" />
Interlayer mapped MVs may not be<sup>DUS</sup><3Tkpon ^ for prediction of MV in the enhancement layer.
MV prediction involving interlayer MVs can be disabled. For improvement, temporary MVs (eg only temporary MVs) may be able to be predicted from other temporary MVs. This can be equal to the MV prediction for single layer codes.
A device (eg, a processor, an encoder, a decoder, a WTRU, or the like) can receive a bit stream (eg, a scalable bit stream). For example, the bit stream may include a base layer and one or more enhancement layers. The base layer (eg, a video block of the base layer) and / or the enhancement layer (eg, a video block of the enhancement layer) of the bitstream can be decoded using TMVP. TMVP can be performed for a base layer and a bit stream enhancement layer. For example, TMVP can be performed for the base layer (for example, a video block of the base layer) of the bitstream without any change, for example, as described with reference to Figure 4. TMVP can be performed by the enhancement layer (eg, an enhancement layer video block) of the bitstream using an interlayer reference image, eg, as described herein. For example, an image of
IMPI
MEXICAN INSTITUTE Dt THE INDUSTRIAL PROPERTY
<img file="MX341900B_D0050.tif" />
Interlayer reference can be used as an interleaved reference image for the enhancement layer TMVP (eg, an enhancement layer video block). For example, a compressed MV field can be determined from the interleaved base layer image. The MV field of the interlayer reference image can be determined based on the compressed MV field of the interleaved base layer image. The MV field of the interlayer reference image can be used to perform the TMVP in the enhancement layer (eg, a video block of the enhancement layer). For example, the MV field of the interlayer reference image can be used to predict an MV field for the video block of the enhancement layer (for example, a video block of the embedded enhancement layer).
An MV field of the interlayer reference layer image can be determined. For example, the MV field of the interlayer reference layer image can be determined based on an MV field of an interleaved base layer image. The MV field can include one or more MVs and / or reference image indexes. For example, the MV field can include a MV and a reference image index of a PU in the interlayer reference layer image (for example, for each PU in the interlayer reference layer image). An enhancement layer image (for example, an embedded enhancement layer image) can be decoded with
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0051.tif" />
base on the MV field. TMVP can be performed on the enhancement layer image based on the MV field.
Syntax signaling (eg, high-level syntax signaling) can be provided for interlayer motion prediction. Interlayer motion information mapping and MV prediction can be enabled and / or disabled at the sequence level. Interlayer motion information mapping and MV prediction can be enabled and / or disabled at the image / segment level. For example, the decision to enable and / or disable certain interlayer motion prediction techniques can be made based on considerations to improve improved encoding efficiency and / or less system complexity. Sequence level signaling may use less supplemental information than image / segment level signaling, for example, because the added syntax can be applied to images (eg all images) in a sequence. Signaling at the image / segment level may provide greater flexibility, for example, because the images (eg, each image) in a sequence may receive their own motion prediction implementation and / or MV prediction implementation.
Signaling can be provided at the sequence level. Mapping motion information from
IMPI
MEXICAN INSTITUTE QE THE INDUSTRIAL PROPERTY
<img file="MX341900B_D0052.tif" />
Interlayer and / or MV prediction can be signaled at the sequence level. If signaling at the sequence level is used, then the images (eg all images) in a sequence can use the same mapping of motion information and / or MV prediction. For example, the syntax shown in Table 2 may indicate whether mapping of interlayer motion information and / or prediction of MV is allowed at the sequence level. The syntax in Table 2 can be applied to a set of parameters, for example, such as, but not limited to, a video parameter set (VPS) (for example, in the HEVC), a set of parameters sequence (SPS) (for example, in H.264 and HEVC), a set of image parameters (PPS) (for example, in H.264 and HEVC), and / or the like.
Table 2: Example of aggregated signaling syntax at the sequence level
<td>inter layer seq mvp set (layer id) {</td><td>Descriptor</td>
<td>inter layer mvp present flag</td><td>u (l)</td>
<td>if (inter layer mvp present flag) {</td><td></td>
<td>inter layer motion mapping seq enabled flag</td><td>u (l)</td>
<td>inter layer add mvp seq enabled flag</td><td>u (l)</td>
<td> }</td><td></td>
The inter_layer_mvp_present_flag can indicate whether an interlayer motion prediction can be used at the sequence level or at the image / segment level. By
IMPI
MEXICAN INSTITUTE Of. INDUSTRα INDUSTRIAL error example, if the flag is set to 0, then the
<img file="MX341900B_D0053.tif" />
signaling may be at the image / segment level. If the 'flag is set to 1, then the motion mapping and / or MV prediction signaling may be at the sequence level. The inter_layer_motion_mapping_seq_enabled_flag can indicate whether interlayer motion mapping (eg interlayer motion prediction) can be used at the sequence level. The inter_layer_add_mvp_seq_enabled_flag can indicate whether the block MV prediction (for example, the additional block MV prediction) can be used at the sequence level.
Image / level level signage can be provided. Interlayer motion information mapping and / or MV prediction can be signaled at the image / segment level. If image / segment level signaling is used, then an image (eg each image) in a sequence can receive its own signaling. For example, images in the same sequence may use different MV prediction and / or motion information mapping (eg, based on their received signaling). For example, the syntax in Table 3 can be used in the segment header to indicate whether the mapping of interlayer motion information and / or a MV prediction can be used for the current image / segment in the enhancement layer.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0054.tif" />
Table 3: Example of a modified segment header syntax
<td>slice header () {</td><td>Descriptor</td>
<td></td><td></td>
<td>if (tiles enabled flag || entropy coding sync enabled flag) {</td><td></td>
<td>num_entry_polnt offsets</td><td>ue (v)</td>
<td>if (num entry point offsets> 0) {</td><td></td>
<td>offset len minusl</td><td>ue (v)</td>
<td>for (i = 0; i <num entry point offsets; i ++)</td><td></td>
<td>entry point offset [i]</td><td>u (v)</td>
<td> }</td><td></td>
<td> }</td><td></td>
<td>if (! inter_layer mvp present flag) {</td><td></td>
<td>inter layer motion mapping siice enabled flag</td><td>u (l)</td>
<td>inter_layer_add mvp_slice_enabled flag</td><td>u (l)</td>
<td> }</td><td></td>
<td>if (slice header extension present flag) {</td><td></td>
<td>slice_header_extension length</td><td>ue (v)</td>
<td>for (i = 0; i <slice header extension length; i ++)</td><td></td>
<td>slice header data byte extension [I]</td><td>u (8)</td>
<td> }</td><td></td>
<td>alignment byte</td><td></td>
<td> }</td><td></td>
The inter_layer_motion_mapping_slice_enabled_flag can indicate whether an interlayer motion mapping can be applied to the current segment. The inter_layer ~ add_mvp_slice_enabledflag can indicate whether the additional block MV prediction can be applied to the current segment.
MV prediction encoding can be proposed for video encoding systems of
<img file="MX341900B_D0055.tif" />
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY multiple layers. Interlayer motion information mapping algorithms can be described herein to generate motion related information for the processed base layer, for example such that a correlation between the base layer temporary MVs and an enhancement layer It can be explored in the TMVP process in an enhancement layer. Since operations at the level of
<td>block can</td><td>not to be</td><td>modified,</td><td>a</td><td>encoder</td><td>and</td>
<td>decoder</td><td>of a</td><td colspan="2">single layer can</td><td>apply</td><td>without</td>
<td>modifications</td><td>for the</td><td>prediction of</td><td>MV</td><td>for improvement.</td><td>The</td>
<td>prediction of</td><td>MV can</td><td>build on the</td><td colspan="2">analysis of</td><td>the</td>
<td>characteristics</td><td colspan="2">of different types of</td><td>MVs</td><td colspan="2">in the system</td>
<td>scalable (by</td><td>example,</td><td>to improve</td><td>the</td><td>efficiency</td><td>of</td>
MV prediction).
Although two-layer SVC systems with spatial scalability are described herein, the description can be extended to SVC systems with more than two layers and other modes of scalability.
Interlayer motion prediction can be performed by a bitstream enhancement layer. Interlayer motion prediction can be signaled, for example, as described herein. The interlayer motion prediction can be signaled at the sequence level of the bitstream (eg using the inter_layer_motion_mapping_seq_enabled_flag, or the like).
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0056.tif" />
For example, the ··· intercap »· motion prediction can be signaled by a variable (eg a flag) in a video parameter set (VPS), a sequence parameter set (SPS), a set of image parameters (PPS), and / or the like, of the bit stream.
A device (eg, a processor, an encoder, a decoder, a WTRU, or the like) can perform any of the functions described herein. For example, a decoder can include a processor that can be configured to receive a bit stream (eg, a scalable bit stream). The bit stream may include a base layer and an enhancement layer. The decoder can decode the bit stream enhancement layer using time motion vector prediction (TMVP) which uses an interlayer reference image as the interleaved reference image for the
TMVP of the enhancement layer. The enhancement layer video block, the interlayer video block, and / or the base layer video block may be interleaved (eg, temporarily interleaved).
The decoder can decode an enhancement layer image using TMVP. For example, the decoder may determine a MV field of an interlayer reference image based on a MV field of
MTXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0057.tif" />
an embedded base layer image. *** Ld imugun ... de. interlayer reference and enhancement layer image can be interleaved. The MV field of the interlayer reference image may include an MV and a reference image index of a video block of the interlayer reference image. The decoder can decode the enhancement layer image based on the MV field of the interlayer reference image. For example, the decoder may determine an enhancement layer image MV field based on the image MV field
<td>of</td><td>reference</td><td>interlayer</td><td>and decode</td><td>the</td><td>image</td><td>layer</td>
<td>of</td><td>improves with</td><td>base on the</td><td>MV field of</td><td>the</td><td>image</td><td>layer</td>
<td>of</td><td>improvement.</td><td></td><td></td><td></td><td></td><td></td>
<td></td><td>The</td><td>MV field</td><td>from image</td><td>of</td><td colspan="2">reference of</td>
Interlayer can be determined based on a compressed MV field. For example, the decoder may determine a compressed MV field of an interleaved base layer image and / or determine the MV field of the interlayer reference image based on the compressed MV field of the interleaved base layer image.
The decoder can determine a reference image and an MV of a video block of the interlayer reference image. For example, the decoder may determine the reference image of the interlayer video block based on a reference image of
IMPI
MEXICAN INSTITUTE of inimktriai property
<img file="MX341900B_D0058.tif" />
a video block of the embedded base layer. The decoder can determine the MV of the interlayer video block based on an MV of the interleaved base layer video block. The decoder can determine the interleaved base layer video block by selecting a video block from an interleaved base layer image that is characterized by greater overlap in area with the interlayer video block. The decoder may determine a reference image and / or an MV of a video block of an enhancement layer image (eg, an interleaved video block of an enhancement layer image) based on the reference image and / or the MV of the video block of the interlayer reference image.
The decoder can determine a reference image of the interleaved base layer video block, and determine the reference image of the interleaved video block based on the reference image of the interleaved base layer video block. For example, the reference image of the interlayer video block may be an interleaved reference image of the interleaved base layer video block reference image. The decoder can determine a reference image of a video block from an enhancement layer image based on the reference image of the interlayer video block. For example, the reference image of
<img file="MX341900B_D0059.tif" />
VI Λ
THE MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY the enhancement layer can be a reference image of the enhancement layer interleaved from the reference image of the interlayer video block. The enhancement layer video block, the interlayer video block, and / or the base layer video block may be interleaved (eg, temporarily interleaved).
The decoder can determine an MV of the interlayer video block. For example, the decoder can determine the MV of the interleaved base layer video block, and scale the MV of the interleaved base layer video block according to a spatial relationship between the base layer and the enhancement layer in order to determine the MV of the interlayer video block. The decoder can determine an MV of an enhancement layer video block based on the MV of the interlayer video block. For example, the decoder can predict the MV of the enhancement layer video block using the MV of the interlayer video block, for example, by temporarily scaling the MV of the interlayer video block.
A decoder can be configured to determine a reference image of an enhancement layer video block based on an interleaved base layer video block, determine an MV of the enhancement layer video block based on an MV of the interleaved base layer video block, and / or decode the
IΜ ΡI
MEXICAN INSTITUTE
Dt THE INDUSTRIAL PROPERTY X¿ ~<sup>I</sup>isr ~ ^ and video of the enhancement layer based on the reference image of the enhancement layer video block and the MV of the enhancement layer video block. For example, the decoder can determine the interleaved base layer video block by selecting a video block of an interleaved base layer image that is characterized by greater overlap in area with the enhancement layer video block. .
The decoder can determine a reference image of the interleaved base layer video block.
The decoder can determine a reference image of an interlayer video block using the reference image of the interleaved base layer video block.
The decoder can determine the reference image of the enhancement layer video block. For example, the reference image of the enhancement layer video block may be an embedded enhancement layer image of the reference image of the embedded base layer video block and the reference image of the enhancement video block. interlayer interleaved. The enhancement layer video block, the interlayer video block, and / or the base layer video block may be interleaved (eg, temporarily interleaved).
The decoder can determine the MV of the interleaved base layer video block. The
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0060.tif" />
decoder can scale the MV of the interleaved base layer video block according to a spatial relationship between the base layer and the enhancement layer in order to determine an MV of an interlayer video block. The decoder can predict the MV of the enhancement layer video block based on the MV of the interlayer video block, for example, by temporarily scaling the MV of the interlayer video block.
A decoder can include a processor that can receive a bit stream. The bit stream may include a base layer and an enhancement layer. The bit stream may include interlayer motion allocation information. The decoder can determine that interlayer motion prediction can be enabled for the enhancement layer based on the interlayer mapping information. The decoder can perform the interlayer motion prediction of the enhancement layer based on the interlayer mapping information. Interlayer mapping information may be signaled at the sequence level of the bit stream. For example, the interlayer mapping information may be signaled by a variable (eg, a flag) in a VPS, SPS, and / or PPS of the bitstream.
Although it has been described from the perspective of a decoder, the functions described herein (for
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0061.tif" />
For example, an inverse of the functions described here) can be performed by another device, such as an encoder, for example.
Figure 14A is a diagram of an exemplary communication system 1400 in which one or more described modalities can be implemented. Communication system 1400 can be a multiple access system that provides content, such as voice, data, video, messaging, broadcast, etc., to multiple wireless users. The 1400 communications system can allow multiple wireless users to access such content through the distribution of system resources, including wireless bandwidth. For example, the 1400 communication systems may employ one or more channel access methods, such as code division multiple access (CDMA), time division multiple access (TDMA). , frequency division multiple access (FDMA), orthogonal FDMA (OFDMA - orthogonal FDMA), single-carrier FDMA (SC-FDMA - single-carrier FDMA), and the like.
As shown in Figure 14A, the communication system 1400 may include wireless transmit / receive units (WTRUs) 1402a, 1402b, 1402c, and / or
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0062.tif" />
1402d (which generally or collectively can be called WTRU
1402), a radio access network (RAN) 1403/1404/1405, a core network 1406/1407/1409, a public switched telephone network (PSTN) 1408, the Internet 1410 , and other networks 1412, although it will be noted that the described modalities consider any number of WTRUs, base stations, networks, and / or network elements. Each of the WTRUs 1402a, 1402b, 1402c, 1402d can be any type of device configured to operate and / or communicate in a wireless environment. By way of example, WTRUs 1402a, 1402b, 1402c, 1402d can be configured to transmit and / or receive wireless signals and can include user equipment (UE), a mobile station, a fixed or mobile subscriber unit, a pager personal, a cell phone, a personal digital assistant (PDA personal digital assistant), a smartphone, a laptop, a mini laptop, a personal computer, a wireless sensor, consumer electronics, and the like.
Communications systems 1400 may also include a base station 1414a and a base station 1414b. Each of the base stations 1414a, 1414b can be any type of device configured to interface wirelessly with at least one of the WTRUs
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX341900B_D0063.tif" />
1402a, 1402b, 1402c, 1402d to facilitate access to one or more communication networks, such as the core network
1406/1407/1409, the Internet 1410, and / or the 1412 networks. As an example, the base stations 1414a, 1414b may be a base station transceiver (BTS), a Node B, an eNode B , a local Node B, a local eNode B, a site controller, an access point (AP access point), a wireless router, and the like. Although each of the base stations 1414a, 1414b is represented as an individual element, it will be appreciated that the base stations 1414a, 1414b may include any number of interconnected base stations and / or network elements.
Base station 1414a may be part of RAN 1403/1404/1405, which may also include other base stations and / or network elements (not shown), such as a base station controller (BSC), a radio network controller (RNC), repeater nodes, etc. Base station 1414a and / or base station 1414b can be configured to transmit and / or receive wireless signals within a particular geographic region, which may be referred to as a cell (not shown). The cell can also be divided into cell sectors. For example, the cell associated with base station 1414a can be divided into three sectors. So,
IMPI
<img file="MX341900B_D0064.tif" />
<img file="MX341900B_D0065.tif" />
In one embodiment, base station 1414a may include three transceivers, ie, one for each sector of the cell.
In another embodiment, the base station 1414a may employ multiple input multiple output (MIMO) technology, and therefore may use multiple transceivers for each sector of the cell.
Base stations 1414a, 1414b can communicate with one or more of WTRUs 1402a, 1402b, 1402c, 1402d through an air interface 1415/1416/1417, which can be any suitable wireless communication link (for example, radio frequency ( RF - radio frequency), microwave, infrared (IR), ultraviolet (UV), visible light, etc.). The 1415/1416/1417 air interface can be established using any suitable radio access technology (RAT).
More specifically, as indicated above, the communication system 1400 may be a multiple access system and may employ one or more channel access schemes, such as CDMA, TDMA, FDMA,
OFDMA, SC-FDMA, and the like. For example, base station 1414a on RAN 1403/1404/1405 and WTRUs 1402a, 1402b,
1402c can implement a radio technology, such as Terrestrial Radio Access (UTRA - UMTS Terrestrial Radio
Access) of the Universal Mobile Telecommunications System (UMTS), the
IMPI
INSTITUTO MEXICANO DE LA WOF1EDAD INDUSTXIAL which can establish the air interface 1415/1416/1417 using wideband CDMA (WCDMA). The
WCDMA can include communication protocols such as High-Speed Packet Access (HSPA) and / or Evolved HSPA (HSPA + - Evolved HSPA). The HSPA may include High Speed Downlink Packet Access (HSDPA - High-Speed Downlink Packet Access) and / or High Speed Uplink Packet Access (HSUPA - High-Speed Downlink Packet Access).
In another embodiment, base station 1414a and WTRUs 1402a, 1402b, 1402c can implement radio technology such as UMTS Terrestrial Radio Access
Evolved (E-UTRA - Evolved UMTS Terrestrial Radio
Access), which can establish the 1415/1416/1417 air interface using Long Term Evolution (LTE) and / or Advanced LTE (LTE-A - Long Term)
Evolution-Advanced).
In other embodiments, base station 1414a and WTRUs 1402a, 1402b, 1402c can implement radio technologies, such as the IEEE 802.16 standard (i.e.World Interoperability for Microwave Access (WiMAX)),
CDMA200G, CDMA2000 IX, CDMA2000 EV-DO, Provisional Standard 2000 (IS-2000), Provisional Standard 95 (IS-95), the Standard
Provisional 856 (IS-856), Global System for
<img file="MX341900B_D0066.tif" />
I ΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROMSTY
<img file="MX341900B_D0067.tif" />
Mobile Communications (GSM - Global System for Mobile
Communications), Improved Data Rates for Evolution of
GSM (EDGE - Enhanced Data rates for GSM Evolution), GSM
EDGE (GERAN), and the like.
The base station 1414b in Figure 14A can be a wireless router, Local Node B, Local eNode B, or access point, for example, and can use any suitable RAT to facilitate wireless connectivity in a localized area, such as a place of work, a house, a vehicle, a campus, and the like. In one embodiment, base station 1414b and WTRUs 1402c, 1402d can implement radio technology, such as the IEEE 802.11 standard to establish a wireless local area network (WLAN). In another embodiment, base station 1414b and WTRUs 1402c, 1402d can implement radio technology, such as the IEEE 802.15 standard to establish a wireless personal area network (WPAN). In yet another embodiment, base station 1414b and WTRU 1402c, 1402d can use a cellular-based RAT (eg,
WCDMA, CDMA2000, GSM, LTE, LTE-A, etc.) in order to establish a picocell or femtocell. As shown in Figure 14A, base station 1414b can have a direct connection to Internet 1410. Therefore, the base station
1414b may not be necessary to access the Internet
IMPI
AITO MEXICANO Say The PROPERTY
INDUSTRIAL
<img file="MX341900B_D0068.tif" />
1410 through the central network i zi or 6/1 zi η n / 1 / i ^ g.
The RAN 1403/1404/1405 can be in communication with the central network 1406/1407/1409, which can be any type of network configured to provide voice, data, applications, and / or voice over Internet protocol services (VoIP - Voice over Internet Protocol) to one or more of the
WTRUs 1402a, 1402b, 1402c, 1402d. For example, core network 1406/1407/1409 can provide call control, billing services, call-based services
<td colspan="3">mobile location calls</td><td colspan="2">pre-payment,</td><td colspan="2">connectivity to</td>
<td>Internet,</td><td>distribution</td><td>of</td><td>video,</td><td>etc.,</td><td>me</td><td>run</td>
<td>functions</td><td>of security</td><td>of</td><td>high</td><td>level,</td><td>such</td><td>as the</td>
user authentication. Although not shown in Figure 14A, it will be appreciated that RAN 1403/1404/1405 and / or core network 1406/1407/1409 may be in direct or indirect communication with other RANs that use the same RAT as RAN 1403 / 1404/1405 or a different RAT. For example, in addition to connecting to RAT 1403/1404/1405, which may be using E-UTRA radio technology, core network 1406/1407/1409 may also be in communication with another RAT (not shown) that it employs a GSM radio technology.
The core of the 1406/1407/1409 network can also serve as a gateway for WTRUs 1402a, 1402b,
1402c, 1402d to access PSTN 1408, Internet 1410,
IMPI
MEXICAN INSTITUTE OF INCTJSTRIAL PRORIETY
<img file="MX341900B_D0069.tif" />
and / or other networks 1412. PSTN 1408 may include circuit-switched telephone networks that provide plain telephone service (POTS). The Internet 1410 may include a worldwide system of computer networks and interconnected devices that use common communication protocols, such as the Transmission Control Protocol (UDP), User Datagram Protocol (UDP). ) and the Internet Protocol (IP) in the TCP / IP Internet Protocol Suite. Networks 1412 may include wired or wireless communication networks owned and / or managed by other service providers. For example, networks 1412 may include another core network connected to one or more RANs, which may use the same RAT as RAN 1403/1404/1405 or a different RAT.
Some or all of the WTRUs 1402a, 1402b, 1402c,
1402d in communication system 1400 can include multiple-mode capabilities, that is, WTRUs 1402a, 1402b, 1402c, 1402d can include multiple transceivers to communicate with different wireless networks through different wireless links. For example, WTRU 1402c shown in Figure 14A can be configured to communicate with base station 1414a, which can
IMPI
Mexicanoτηντο Mexican INDUSTRIAL PROPERTY employ a cellular-based radio technology, and with the
<img file="MX341900B_D0070.tif" />
1414b base station, which can employ radio technology from the IEEE 802 standard.
Figure 14B is a system diagram of an exemplary WTRU 1402. As shown in Figure 14B, the WTRU 1402 may include a processor 1418, a transceiver 1420, a transmitter / receiver element 1422, a speaker / microphone 1424, a keyboard 1426, a display / touch pad 1428, a non-removable memory 1430 , a removable memory 1432, a power supply 1434, a global positioning system (GPS) chipset 1436, and other peripherals 1438. It will be appreciated that WTRU 1402 can include any sub-combination of the above elements, while still being consistent with one modality. Also, the embodiments contemplate that the base stations 1414a and 1414b, and / or the nodes that the base stations 1414a and 1414b may represent, such as, but not limited to, the transceiver station (BTS), a
Node B, a site controller, an access point (AP), a local node B, an evolved local node B (eNodeB), an evolved local node B (HeNB - home evolved node-B), a gateway Evolved local node B, and proxy nodes, among others, may include some or all of the elements represented in Figure 14B and described herein.
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0071.tif" />
Processor 1418 may be a general-purpose processor, a specific-purpose processor, a conventional processor, a digital signal processor (DSP digital signal processor), a plurality of microprocessors, one or more microprocessors associated with a core of DSP, a controller, a microcontroller. Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), any other type of integrated circuit (IC), a state machine, and the similar. Processor 1418 can perform signal encoding, data processing, power control, input / output processing, and / or any other functionality that enables the WTRU 1402 to operate in a wireless environment. Processor 1418 can be coupled to transceiver 1420, which can be coupled to transmit / receive element 1422. While Figure 14B depicts processor 1418 and transceiver 1420 as separate components, it will be appreciated that processor 1418 and transceiver 1420 can be integrated together into an electronic package or chip.
The transmit / receive element 1422 can be configured to transmit signals to, or to receive
<img file="MX341900B_D0072.tif" />
INSTITUTO MEXICANO OE LA PROPIEDAD INDUSTRIAL signals from a base station (for example, base station 1414a) through the air interface
1415/1416/1417. For example, in one embodiment, the transmit / receive element 1422 may be an antenna configured to transmit and / or receive RF signals. In another embodiment, the transmit / receive element 1422 may be an emitter / detector configured to transmit and / or receive IR, UV, or visible light signals, for example. In yet another embodiment, the transmit / receive element 1422 can be configured to transmit and receive both RF and light signals. It will be appreciated that the transmit / receive element 1422 can be configured to transmit and / or receive any combination of wireless signals.
Furthermore, although transmit / receive element 1422 is depicted in Figure 14B as a single element, WTRU 1402 can include any number of transmit / receive elements 1422. More specifically, WTRU 1402 can employ MIMO technology. Therefore, in one modality, the WTRU
1402 it may include two or more transmit / receive elements 1422 (eg, multiple antennas) for transmitting and receiving wireless signals via air interface 1415/1416/1417.
The 1420 transceiver can be configured to
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX341900B_D0073.tif" />
modulate the signals to be transmitted by the transmit / receive element 1422 and to demodulate the signals that are received by the transmit / receive element
1422. As stated previously, the WTRU 1402 can have multiple mode capabilities. Therefore, transceiver 1420 can include multiple transceivers to allow WTRU 1402 to communicate using multiple RATs, such as UTRA and IEEE 802.1 1, for example.
WTRU 1402 processor 1418 can be coupled to, and can receive user input data from, speaker / microphone 1424, keyboard 1426, and / or display / touch pad 1428 (for example, a liquid crystal (LCD
- Liquid Crystal Display) or an Organic Iight Emitter Diode (OLED). Processor 1418 can also output user data to speaker / microphone 1424, keyboard 1426, and / or touch screen / surface 1428. In addition, processor 1418 can access information from, and store data in any type of suitable memory, such as 1430 non-removable memory and / or 1432 removable memory. 1430 non-removable memory may include random-access memory (RAM), read-only memory (ROM)
- read-only memory), a hard disk, or any other type
IMPI
MEXICAN INSTRUMENT B € INDUSTRIAL PROPERTY
<img file="MX341900B_D0074.tif" />
removable momn-r-ia storage device 1432 may include a Subscriber Identity Module (SIM) card, a memory stick, a Secure memory card
Digital (SD), and the like. In other embodiments, processor 1418 can access information from, and store data in, memory that is not physically found in WTRU 1402, such as on a server or personal computer (not shown).
Processor 1418 can receive power from power supply 1434, and can be configured to distribute and / or control power to the other components in WTRU 1402. Power supply 1434 can be any suitable device to power WTRU 1402. For example, the 1434 power supply may include one or more dry cells (eg, nickel-cadmium (NiCd), nickel-zinc (NiZn), nickel metal hydride (NiMH), lithium-ion (Li-ion), etc.), solar cells, fuel cells, and the like.
Processor 1418 can also be coupled to GPS chipset 1436, which can be configured to provide location information (eg, longitude and latitude) with respect to the current location of WTRU 1402. In addition to, or instead of, the information of the GPS chipset 1436, the WTRU 1402 can receive
I IVí PI
MEXICAN INSTITUTE Dt LA neniDAU INDUSTRIAL
<img file="MX341900B_D0075.tif" />
location information via air interface
1415/1416/1417 originating from a base station (eg, base stations 1414a, 1414b) and / or determining their location based on the timing of signals that are received from two or more nearby base stations. It will be appreciated that the WTRU 1402 can acquire location information by any suitable location determination method while remaining consistent with a modality.
Processor 1418 can also be coupled to other peripherals 1438, which may include one or more software and / or hardware modules that provide additional wired or wireless features, functionality, and / or connectivity. For example, 1438 peripherals can include an accelerometer, an electronic compass, a satellite transceiver, a digital camera (for photography or video), a universal serial bus (USB) port, a vibration device, a television transceiver, some hands-free headset, a Bluetooth® module, a frequency modulated (FM) radio unit, a digital music player, a media player, a video game player module, an Internet browser, and the like.
FIG. 14C is a system diagram of RAN 1403 and core network 1406 according to one embodiment.
IMPI
Mexican Institute of Industrial Property
<img file="MX341900B_D0076.tif" />
As noted above, RAN 1403 can employ UTRA radio technology to communicate with WTRUs.
1402a, 1402b, 1402c through the 1415 air interface. The RAN
1403 it may also be in communication with core network 1406. As shown in Figure 14C, RAN 1403 may include Node Bs 1440a, 1440b, 1440c, each of which may include one or more transceivers to communicate with WTRUs 1402a, 1402b, 1402c through the air interface
1415. Each of Node B 1440a, 1440b, 1440c may be associated with a particular cell (not shown) within RAN 1403. RAN 1403 may also include RNCs 1442a, 1442b. It will be appreciated that RAN 1403 can include any number of Node Bs and RNCs while still being consistent with one modality.
As shown in Figure 14C, Node B 1440a, 1440b may be in communication with RNC 1442a. Also, Node B 1440c may be in communication with the
RNC 1442b. Nodes B 1440a, 1440b, 1440c can communicate with the respective RNCs 1442a, 1442b through an Iub interface. The RNCs 1442a, 1442b can be in communication with each other through an Iur interface. Each of the RNCs 1442a, 1442b can be configured to control the respective Node Bs 1440a, 1440b, 1440c to which it connects. In addition, each of the RNCs 1442a, 1442b can be configured to perform or support other functionality, such as
IMPI
MIXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0077.tif" />
such as external loop power control, load control, admission control, packet scheduling, transfer control, macro diversity, security features, data encryption, and the like.
The core network 140 6 shown in Figure 14C may include a media gateway (MGW) 1444, a mobile switching center (MSC) 1446, a service GPRS support node (SGSN - serving GPRS support node) 1448, and / or a network access GPRS support node (GGSN - gateway GPRS support node) 1450. While each of the above elements is graphically represented as part of core network 1406, it will be appreciated that any one of these elements may be owned and / or operated by an entity other than the core network operator.
RNC 1442a on RAN 1403 can connect to the
MSC 1446 on core network 1406 via an IuCS interface.
MSC 1446 can connect to MGW 1444. MSC 1446 and MGW 1444 can provide WTRUs 1402a, 1402b,
1402c access to circuit-switched networks, such as PSTN 1408, to facilitate communications between WTRUs 1402a, 1402b, 1402c and traditional land line communication devices.
RNC 1442a on RAN 1403 can also connect to SGSN 1448 on core network 1406 using a
ΙΜΡΙ
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0078.tif" />
IuPS interface. SGSN 1448 can connect to GGSN 1450. SGSN 1448 and GGSN 1450 can provide WTRUs 1402a, 1402b, 1402c access to packet switched networks, such as the Internet 1410, to facilitate communications between and WTRUs 1402a, 1402b, 1402c and IP enabled devices.
As previously stated, the core network
1406 You can also connect to networks 1412, which may include other wired or wireless networks that are owned and / or operated by other service providers.
Figure 14D is a system diagram of the RAN
1404 and the core network 1407 according to one embodiment. As noted above, RAN 1404 can employ E-UTRA radio technology to communicate with
WTRUs 1402a, 1402b, 1402c through the 1416 air interface.
RAN 1404 may also be in communication with core network 1407.
RAN 1404 can include eNode B 1460a, 1460b,
1460c, although it will be noted that RAN 1404 can include any number of eNode B while still being consistent with a modality. Each of the 1460a, 1460b, 1460c eNodes B may include one or more transceivers to communicate with the WTRUs 1402a, 1402b, 1402c via the air interface
1416. In one embodiment, eNodes B 1460a, 1460b, 1460c can implement MIMO technology.
IMPI iNjmvro MEXICANO Dt THE INDUSTRIAL PROPERTY
<img file="MX341900B_D0079.tif" />
Consequently, eNode B 1460a, for example, can use multiple antennas to transmit wireless signals to, and receive wireless signals from, WTRU 1402a.
Each of eNodes B 1460a, 1460b, 1460c can be associated with a particular cell (not shown) and can be configured to handle radio resource management decisions, transfer decisions, uplink user scheduling and / or the downlink, and the like. As shown in Figure 14D, eNodes B 1460a, 1460b, 1460c can communicate with each other through an X2 interface.
The core network 1407 shown in Figure 14D may include a Mobility Management Gateway (MME) 1462, a Service Gateway 1464, and a packet data network (PDN) gateway. 1466. Although each of the above elements is represented as part of the core network 1407, it will be appreciated that any one of these elements may be owned and / or operated by an entity other than the core network operator.
The MME 14 62 can connect to each of the B node 1460a, 1460b, 1460c on the RAN 1404 through an SI interface and can serve as a control node. For example, the MME 1462 may be responsible for authenticating
IMPI
MEXICAN INSTITUTE BE LA MEOEIEOAD INDUST1IAL
WTRUs 1402a, 1402b, 1402c,
<img file="MX341900B_D0080.tif" />
users of carrier enable / disable, select a particular service gateway during an initial connection of WTRUs 1402a, 1402b, 1402c, and the like. The MME 1462 can also provide a control plane function to switch between RAN 1404 and other RANs (not shown) that employ other radio technologies, such as GSM or WCDMA.
The service gateway 1464 can connect to each of the 1460a, 1460b, 1460c eNodes B on RAN 1404 through the SI interface. The service gateway 1464 can generally route and forward user data packets to / from WTRUs 1402a, 1402b, 1402c. The 1464 service gateway can also perform other functions, such as pinning user planes during inter-eNode transfers
B, activate calls when downlink data is available for WTRUs 1402a,
1402b, 1402c, manage and store the contexts of the
WTRUs 1402a, 1402b, 1402c, and the like.
Service gateway 1464 can also connect to PDN gateway 1466, which can provide WTRUs 1402a, 1402b, 1402c access to packet-switched networks, such as the Internet 1410, to facilitate communications between
IMPI
MEXICAN INSTITUTE M IA INDUSTRIAL PROPERTY
<img file="MX341900B_D0081.tif" />
WTRUs 1402a, 1402b, 1402c and IP enabled devices.
Network core 1407 can facilitate communications with other networks. For example, core network 1407 may provide WTRUs 1402a, 1402b, 1402c, with access to circuit-switched networks, such as
PSTN 1408, in order to facilitate communications between
WTRUs 1402a, 1402b, 1402c and traditional land line communication devices. For example, core network 1407 may include, or communicate with, an IP gateway (eg, an IP multimedia subsystem server (IMS) - IP multimedia subsystem) that serves as the interface between core network 1407 and PSTN 1408. In addition, core network 1407 can provide WTRUs 1402a, 1402b, 1402c access to networks 1412, which may include other wired or wireless networks that are owned and / or operated by other service providers.
Figure 14E is a system diagram of the RAN
1405 and the core network 1409 according to one embodiment. The
RAN 1405 can be an access service network (ASN access Service network) that uses IEEE 802.16 radio technology to communicate with WTRUs 1402a, 1402b,
1402c via air interface 1417. As will be described in more detail below, the links from
IMPI
MEXICAN INSTITUTE M LA RMOPI INDUSTRIAL AGE
<img file="MX341900B_D0082.tif" />
Communication between the different functional entities of WTRUs 1402a, 1402b, 1402c, RAN 1405, and core network 1409 can be defined as reference points.
As shown in Figure 14E, RAN 1405 can include 1480a, 1480b, 1480c base stations, and an ASN 14 82 gateway, although it will be noted that RAN 1405 can include any number of base stations and ASN still being consistent with a modality. Each of the 1480a, 1480b base stations,
1480c can be associated with a particular cell (not shown) in RAN 1405 and each can include one or more transceivers to communicate with WTRUs 1402a, 1402b,
1402c via air interface 1417. In one embodiment, base stations 1480a, 1480b, 1480c can implement MIMO technology. Therefore, base station 1480a, for example, can use multiple antennas to transmit wireless signals to, and receive wireless signals from, WTRU 1402a. 1480a, 1480b, 1480c base stations can also provide mobility management functions such as transfer activation, tunnel establishment, radio resource management, traffic classification, quality of service policy compliance (QoS), and the like. ASN 1482 Gateway can serve as a traffic aggregation point and can be responsible
<img file="MX341900B_D0083.tif" />
mexican irramuro DE LA MOHEDAD iWDumuAi
<img file="MX341900B_D0084.tif" />
of paging calls, the ι. ™ · τ · am -i <sub>Ρ</sub>η4-ο ..<sub>Γ</sub> in.
associated memory of subscriber profiles, routing to core network 1409, and the like.
The air interface 1417 between WTRUs 1402a, 1402b, 1402c and RAN 1405 can be defined as a R1 reference point that implements the IEEE 802.16 specification. In addition, each of the WTRUs 1402a, 1402b, 1402c can establish a logical interface (not shown) with the core network 1409. The logical interface between the WTRUs 1402a,
1402b, 1402c and core network 1409 can be defined as a R2 reference point, which can be used for authentication, authorization, IP host configuration management, and / or mobility management.
The communication link between each of the base stations 1480a, 1480b, 1480c can be defined as a reference point R8 that includes protocols to facilitate WTRU transfers and data transfer between base stations. The communication link between base stations 1480a, 1480b, 1480c and ASN gateway 1482 can be defined as a R6 reference point. Reference point R6 may include protocols to facilitate mobility management based on mobility events associated with each of the WTRUs
1402a, 1402b, 1402c.
As shown in Figure 14E, RAN 1405
<img file="MX341900B_D0085.tif" />
it can connect to core network 1409. The communication link between RAN 1405 and core network 1409 can be defined as a R3 reference point that includes protocols to facilitate data transfer capabilities and mobility management, for example. Core network 1409 may include a 1484 mobile IP local agent (MIP-HA), a 1486 AAA authentication, authorization, and accounting server, and a 1488 gateway. While each of the above elements is graphically represented as part of core network 1409, it will be appreciated that any one of these elements may be owned and / or operated by an entity other than the core network operator.
The MIP-HA can be responsible for IP address management, and can enable WTRUs 1402a, 1402b,
1402c to track between different ASNs and / or different core networks. MIP-HA 1484 can provide WTRUs 1402a, 1402b, 1402c access to packet-switched networks, such as
Internet 1410, in order to facilitate communications between WTRUs 1402a, 1402b, 1402c and IP enabled devices. The AAA 1486 server may be responsible for authenticating users and supporting user services. The 1488 gateway can
IMPI
<img file="MX341900B_D0086.tif" />
INDUSTRIAL
<img file="MX341900B_D0087.tif" />
facilitate interworking with other networks. For example, gateway 1488 can provide WTRUs 1402a, 1402b, 1402c access to circuit switched networks, such as PSTN 1408, to facilitate communications between WTRUs 1402a, 1402b, 1402c and traditional devices. of land line communications. In addition, gateway 1488 can provide WTRUs 1402a, 1402b, 1402c with access to networks 1412, which may include other wired or wireless networks that are owned and / or operated by other service providers.
Although not shown in Figure 14E, it will be appreciated that RAN 1405 can connect to other ASNs and core network 1409 can connect to other core networks. The communication link between RAN 1405 and the other ASNs can be defined as a R4 reference point, which can include protocols for coordination of the mobility of WTRUs 1402a, 1402b, 1402c between the
RAN 1405 and the other ASNs. The communication link between core network 1409 and the other core networks can be defined as a R5 reference, which may include protocols to facilitate interworking between local core networks and visited core networks.
Figure 15 is a block diagram illustrating an example of a video encoder based on
<img file="MX341900B_D0088.tif" />
IMPI
INSTITUTO MEXICANO DE LA PROPIEDAD INDUSTRIAL blocks, for example, a hybrid video coding system. An input video signal 1502 can be processed in blocks. The video block unit can include 16 * 16 pixels. Such a block unit may be called a macroblock (MB). In High Efficiency Video Coding (HEVC), extended block sizes (for example, which can be called a Coding Unit) can be used to efficiently compress high-resolution video signals (for example, 1080p and beyond). At HEVC, a
CU can be up to 64 * 64 pixels. The CU can be divided into prediction units (PUs), for which separate prediction methods can be applied.
For a video input block (eg MB or CU), spatial prediction 1560 and / or temporal prediction 1562 can be carried out. Spatial prediction (for example, intra-prediction) can use pixels from neighboring blocks already encoded in the same image / video segment to predict the current video block. Spatial prediction can reduce the spatial redundancy inherent in the video signal. Temporal prediction (for example, motion compensation prediction or prediction) can use pixels from already encoded video images (for example, they can
IMPI
MEXICAN INSTITUTE OE LA FE »EIEOAC INDUSTRIAL
<img file="MX341900B_D0089.tif" />
called reference images) to predict the current video block. Temporal prediction can reduce the temporal redundancy inherent in the video signal. A time prediction signal for a video block can be signaled by one or more motion vectors, which can indicate the amount and / or direction of movement between the current block and its prediction block in the reference image. If there is support for multiple reference images (for example, such as H.264 / AVC and / or HEVC), then for each video block, its reference image index can be sent additionally. The reference index can be used to identify from which reference image in reference image store 1564 (eg, which may be referred to as a photo decoded buffer or DPB) the time prediction signal comes from.
After spatial and / or temporal prediction, the mode decision block 1580 in the encoder can select a prediction mode. The prediction block can be subtracted from the current video block 1516. The prediction residual can be transformed 1504 and / or quantized 1506. The quantized residual coefficients can be inversely quantized 1510 and / or inversely transformed 1512 to form the reconstructed residual, which
IMPI
<img file="MX341900B_D0090.tif" />
<img file="MX341900B_D0091.tif" />
industrial
<img file="MX341900B_D0092.tif" />
it can be added back to the predict block & form the reconstructed video block.
Loop filtering such as, but not limited to, an unlock filter, adaptive sample compensation, and / or adaptive loop filters can be applied 1566 on the reconstructed video block before placing it in the reference image store 1564 and / or used to encode future video blocks. In order to form the output video bitstream 1520, an encoding mode (eg, interprediction mode or intraprediction mode), prediction mode information, motion information, and / or coefficients Quantized residuals can be sent to the entropy encoding unit 1508 to be compressed and / or packaged to form the bit stream.
Figure 16 is a block diagram illustrating an example of a block based video decoder. A video bitstream 1602 may be decompressed and / or decoded by entropy in the entropy decoding unit 1608. The coding mode and / or the prediction information can be sent to the spatial prediction unit 1660 (eg if it is intracoded) and / or the temporal prediction unit 1662 (eg if it is intercoded) to form the block of prediction. If intercoded, the information in
IMPI
MEXICAN INSTITUTE DB LA PROPIEDAD
INDUSTRIAL
<img file="MX341900B_D0093.tif" />
Prediction may comprise prediction block sizes, one or more motion vectors (eg, which may indicate the direction and amount of motion), and / or one or more reference indices (eg, which may indicate from which reference image is going to get the prediction signal).
Motion compensation prediction can be applied by time prediction unit 1662 to form the time prediction block. The residual transform coefficients can be sent to the inverse quantization unit 1610 and the Inverse transform unit 1612 to reconstruct the residual block. The prediction block and the residual block can be added together in 1626. The reconstructed block can go through loop filtering before being stored in the reference 1664 image store. The reconstructed video in the 1664 reference image store can be used to drive a display device and / or used to predict future blocks of video.
A single layer video encoder can take a single video stream input and generate a single compressed bitstream transmitted to the single layer decoder. A video codec can be designed for digital video services (for example, such as, but without
<img file="MX341900B_D0094.tif" />
MEXICAN INSTITUTE OF PROPERTY
INDUSTRIAL
<img file="MX341900B_D0095.tif" />
limited to sending satellite television signals, cable and terrestrial transmission channels). With video-centric applications implemented in heterogeneous environments, multi-layer video encoding technologies can be developed as an extension of the video encoding standards to enable various applications. For example, scalable video encoding technologies can be designed to handle more than one video layer, in which each layer can be decoded to reconstruct a video signal of a particular spatial resolution, temporal resolution, fidelity, and / or sight. . Although the single layer encoder and decoder are described with reference to Figure 15 and Figure 16, the concepts described herein may use a multi-layer encoder and decoder, for example, for scalable or multi-layer encoding technologies. The encoder and / or decoder of Figures 15 and 16 can perform any of the functions described herein. For example, the encoder and / or decoder in Figures 15 and 16 can perform TMVP in an enhancement layer (eg, an enhancement layer image) using an MV of an enhancement layer PU.
Figure 17 is a diagram illustrating an example of a communication system. The system
IMPI
MEXICAN INSTITUTE OF INDUSTRIAL PROPERTY
<img file="MX341900B_D0096.tif" />
Communications 1700 may comprise an encoder 1702, a communication network 1704, and a decoder 1706. Encoder 1702 may be in communication with a communication network 1704 via a connection 1708. The connection
1708 It can be a wired connection or a wireless connection. Encoder 1702 can be similar to the block-based video encoder of Figure 15. Encoder 1702 can include a single layer codec (eg, as shown in Figure 15) or a multi-layer codec.
Decoder 1706 may be in communication with communication network 1704 via a connection
1710. Connection 1710 can be a wired connection or a wireless connection. Decoder 1706 may be similar to the block-based video decoder of Figure 16. Decoder 1706 may include a single layer codec (eg, as shown in Figure 16) or a multi-layer codec. Encoder 1702 and / or Decoder 1706 can be incorporated into any wide variety of wired communication devices and / or wireless transmission / reception units (WTRUs), such as, but not limited to, digital televisions, wireless broadcast systems, a network element / terminal, servers, such as content or web servers (for example, such as a protocol server
VIL JL JL MEXICAN INSTITUTE
OE PROPERTY V «sa4 INDUSTRIAL hypertext transfer (HTTP - Hypertext Transfer
Protocol)), personal digital assistants (PDAs), laptops or desktops, tablet computers, digital cameras, digital recording devices, video game devices, game consoles
<img file="MX341900B_D0097.tif" />
video games, satellite cellular radiotelephones, digital multimedia players, and the like.
Communication network 1704 may be a suitable type of communication system. For example, communication network 1704 can be a multiple access system that provides content, such as voice, data, video, messaging, broadcast, etc., to multiple wireless users. Communications network 1704 can allow multiple wireless users to access such content by distributing system resources, including wireless bandwidth. For example, communication network 1704 may employ one or more channel access methods, such as code division multiple access (CDMA), time division multiple access (TDMA), frequency division multiple access (FDMA) , Orthogonal FDMA (OFDMA), Single Carrier FDMA (SC-FDMA), and the like.
The procedures outlined above can be implemented in a computer program, software, or firmware embedded in a readable medium. <sup>92</sup> IMPI
MEXICAN INSTITUTE
Of the property
INDUSTRIAL computer for execution by a computer or processor. Examples of computer readable media include electronic signals (transmitted over wired or wireless connections) and computer readable storage media. Examples of computer readable storage media include, but are not limited to, a read-only memory (ROM), a random access memory (RAM), a register, associated memory, semiconductor memory devices, magnetic media such as internal hard drives and removable drives, magneto-optical media, and optical media such as CD-ROM drives and digital versatile discs (DVDs). A processor in association with software can be used to implement a radio frequency transceiver for use in a WTRU, UE, terminal, base station, RNC, or any host computer.
IMP
MEXICAN INSTITUTE OF THE INDUSTRIAL MONFRAD
<img file="MX341900B_D0098.tif" />
Contents145
119 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23 Sheet 24 Sheet 25 Sheet 26 Sheet 27 Sheet 28 Sheet 29 Sheet 30 Sheet 31 Sheet 32 Sheet 33 Sheet 34 Sheet 35 Sheet 36 Sheet 37 Sheet 38 Sheet 39 Sheet 40 Sheet 41 Sheet 42 Sheet 43 Sheet 44 Sheet 45 Sheet 46 Sheet 47 Sheet 48 Sheet 49 Sheet 50 Sheet 51 Sheet 52 Sheet 53 Sheet 54 Sheet 55 Sheet 56 Sheet 57 Sheet 58 Sheet 59 Sheet 60 Sheet 61 Sheet 62 Sheet 63 Sheet 64 Sheet 65 Sheet 66 Sheet 67 Sheet 68 Sheet 69 Sheet 70 Sheet 71 Sheet 72 Sheet 73 Sheet 74 Sheet 75 Sheet 76 Sheet 77 Sheet 78 Sheet 79 Sheet 80 Sheet 81 Sheet 82 Sheet 83 Sheet 84 Sheet 85 Sheet 86 Sheet 87 Sheet 88 Sheet 89 Sheet 90 Sheet 91 Sheet 92 Sheet 93 Sheet 94 Sheet 95 Sheet 96 Sheet 97 Sheet 98 Sheet 99 Sheet 100 Sheet 101 Sheet 102 Sheet 103 Sheet 104 Sheet 105 Sheet 106 Sheet 107 Sheet 108 Sheet 109 Sheet 110 Sheet 111 Sheet 112 Sheet 113 Sheet 114 Sheet 115 Sheet 116 Sheet 117 Sheet 118 Sheet 119
37 members in 9 offices
Priority claims19
| Document | Office | Kind | Date |
|---|---|---|---|
| 201261694555 | United States of America | P | |
| 201261694555 | United States of America | P | |
| 61694555 | United States of America | – | |
| 201261734650 | United States of America | P | |
| 201261734650 | United States of America | P | |
| 61734650 | United States of America | – | |
| 201361866822 | United States of America | P | |
| 201361866822 | United States of America | P | |
| 61866822 | United States of America | – | |
| 2013057291 | United States of America | W | |
| 2013057291 | United States of America | W | |
| 61694555 | – | – | – |
| 61734650 | – | – | – |
| 61866822 | – | – | – |
| PCTUS2013057291 | – | – | – |
| US201261694555P | – | – | – |
| US201261734650P | – | – | – |
| US201361866822P | – | – | – |
| WO2013US57291 | – | – | – |
Members37
| Document | Office | Kind | |
|---|---|---|---|
| US2014064374A1 | United States of America | A1 | |
| WO2014036259A1 | World Intellectual Property Organization (WIPO) | A1 | |
| TW201424390A | Taiwan Province of China | A | |
| AU2013308719A1 | Australia | A1 | |
| KR20150046228A | Republic of Korea | A | |
| CN104604230A | China | A | |
| EP2891311A1 | European Patent Office (EPO) | A1 | |
| JP2015529420A | Japan | A | |
| MX2015002536A | Mexico | A | |
| AU2013308719B2 | Australia | B2 | |
| AU2016201903A1 | Australia | A1 | |
| JP5961761B2 | Japan | B2 | |
| MX341900BThis record | Mexico | B | |
| JP2016213857A | Japan | A | |
| KR101754999B1 | Republic of Korea | B1 | |
| KR20170081741A | Republic of Korea | A | |
| JP6220013B2 | Japan | B2 | |
| AU2016201903B2 | Australia | B2 | |
| TW201804792A | Taiwan Province of China | A | |
| US9900593B2 | United States of America | B2 | |
| JP2018029361A | Japan | A | |
| CN104604230B | China | B | |
| US2018131952A1 | United States of America | A1 | |
| CN108156463A | China | A | |
| TWI637625B | Taiwan Province of China | B | |
| JP6431966B2 | Japan | B2 | |
| TWI646822B | Taiwan Province of China | B | |
| KR101955700B1 | Republic of Korea | B1 | |
| KR20190025758A | Republic of Korea | A | |
| EP3588958A1 | European Patent Office (EPO) | A1 | |
| KR102062506B1 | Republic of Korea | B1 | |
| US10939130B2 | United States of America | B2 | |
| US2021120257A1 | United States of America | A1 | |
| US11343519B2 | United States of America | B2 | |
| CN108156463B | China | B | |
| CN115243046A | China | A | |
| EP3588958B1 | European Patent Office (EPO) | B1 |
1 legal event, as the office reported them to INPADOC
Events
| Event | Code | |
|---|---|---|
| Grant or registrationFG | FG |
Numbers
- Publication
- 341900
- Publication, DOCDB
- 341900
- Publication, EPODOC
- MX341900
- Application
- 2015002536
- Application, DOCDB
- 2015002536
- Application, EPODOC
- MX20150002536
Titles2
- Spanish
- METODO Y APARATO DE PREDICCION DE VECTOR DE MOVIMIENTO PARA CODIFICACION DE VIDEO ESCALABLE.
- English
- METHOD AND APPARATUS OF MOTION VECTOR PREDICTION FOR SCALABLE VIDEO CODING.
Classification
- CPC, 11
- H04N19/31
- H04N19/30
- H04N19/52
- H04N19/70
- H04N19/46
- H04N19/51
- H04N19/33
- H04N19/587
- H04N19/59
- H04N19/105
- H04N19/139
- IPC, 3
- H04N19 31
- H04N19 39
- H04N19 513