(19)
(11)EP 3 782 361 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
20.09.2023 Bulletin 2023/38

(21)Application number: 19810692.4

(22)Date of filing:  28.05.2019
(51)International Patent Classification (IPC): 
H04N 19/122(2014.01)
H04N 19/61(2014.01)
H04N 19/12(2014.01)
H04N 19/147(2014.01)
H04N 19/60(2014.01)
H04N 19/17(2014.01)
(52)Cooperative Patent Classification (CPC):
H04N 19/122; H04N 19/176; H04N 19/119; H04N 19/61; H04N 19/167
(86)International application number:
PCT/CN2019/088751
(87)International publication number:
WO 2019/228332 (05.12.2019 Gazette  2019/49)

(54)

SPATIALLY VARYING TRANSFORM WITH ADAPTIVE TRANSFORM TYPE

RÄUMLICH VARIIERENDE TRANSFORMATION MIT ADAPTIVER TRANSFORMATIONSART

TRANSFORMÉE VARIANT SPATIALEMENT AVEC UN TYPE DE TRANSFORMÉE ADAPTATIVE


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 31.05.2018 US 201862678738 P

(43)Date of publication of application:
24.02.2021 Bulletin 2021/08

(60)Divisional application:
23185053.8

(73)Proprietor: HUAWEI TECHNOLOGIES CO., LTD.
Shenzhen, Guangdong 518129 (CN)

(72)Inventors:
  • ZHAO, Yin
    Shenzhen, Guangdong 518129 (CN)
  • YANG, Haitao
    Shenzhen, Guangdong 518129 (CN)
  • CHEN, Jianle
    San Diego, California 92130 (US)

(74)Representative: Grünecker Patent- und Rechtsanwälte PartG mbB 
Leopoldstraße 4
80802 München
80802 München (DE)


(56)References cited: : 
CN-A- 101 668 205
CN-A- 103 716 623
US-A1- 2012 128 074
CN-A- 102 165 771
US-A1- 2003 156 648
  
  • ALSHIN A ET AL: "Description of SDR, HDR and 360° video coding technology proposal by Samsung, Huawei, GoPro, and HiSilicon - mobile application scenario", 10. JVET MEETING; 20180410 - 20180420; SAN DIEGO; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), , no. JVET-J0024 14 April 2018 (2018-04-14), XP030248219, Retrieved from the Internet: URL:http://phenix.int-evry.fr/jvet/doc_end _user/documents/10_San%20Diego/wg11/JVET-J 0024-v4.zip JVET-J0024_v3.docx [retrieved on 2018-04-14]
  • ZHAO (HUAWEI) Y ET AL: "CE6: Spatially Varying Transform (Test 6.1.12.1)", 11. JVET MEETING; 20180711 - 20180718; LJUBLJANA; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), , no. JVET-K0139 11 July 2018 (2018-07-11), XP030199419, Retrieved from the Internet: URL:http://phenix.int-evry.fr/jvet/doc_end _user/documents/11_Ljubljana/wg11/JVET-K01 39-v3.zip JVET-K0139.docx [retrieved on 2018-07-11]
  • SAID (QUALCOMM) A ET AL: "Description of Core Experiment 6 (CE6): Transforms and transform signaling", 11. JVET MEETING; 20180711 - 20180718; LJUBLJANA; (THE JOINT VIDEO EXPLORATION TEAM OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ), , no. JVET-K1026 18 July 2018 (2018-07-18), XP030200052, Retrieved from the Internet: URL:http://phenix.int-evry.fr/jvet/doc_end _user/documents/11_Ljubljana/wg11/JVET-K10 26-v1.zip JVET-K1026.docx [retrieved on 2018-07-18]
  • CIXUN ZHANG ET AL: "Video coding using Variable Block-Size Spatially Varying Transforms", ACOUSTICS, SPEECH AND SIGNAL PROCESSING, 2009. ICASSP 2009. IEEE INTERNATIONAL CONFERENCE ON, IEEE, PISCATAWAY, NJ, USA, 19 April 2009 (2009-04-19), pages 905-908, XP031459377, ISBN: 978-1-4244-2353-8
  • ZHANG CIXUN ET AL: "Video Coding Using Spatially Varying Transform", 13 January 2009 (2009-01-13), IMAGE ANALYSIS AND RECOGNITION : 11TH INTERNATIONAL CONFERENCE, ICIAR 2014, VILAMOURA, PORTUGAL, OCTOBER 22-24, 2014, PROCEEDINGS, PART I; IN: LECTURE NOTES IN COMPUTER SCIENCE , ISSN 1611-3349 ; VOL. 8814; [LECTURE NOTES IN COMPUTER SCIENCE; LECT.NO, XP047468398, ISBN: 978-3-642-17318-9 * abstract * * sections 2-3.2 and 4 with figures 1-3 *
  • AN J ET AL: "Non-CE7: Boundary Dependent Transform for Inter Predicted Residue", 7. JCT-VC MEETING; 98. MPEG MEETING; 21-11-2011 - 30-11-2011; GENEVA; (JOINT COLLABORATIVE TEAM ON VIDEO CODING OF ISO/IEC JTC1/SC29/WG11 AND ITU-T SG.16 ); URL: HTTP://WFTP3.ITU.INT/AV-ARCH/JCTVC-SITE/,, no. JCTVC-G281, 8 November 2011 (2011-11-08), XP030110265,
  • ZHAO XIN ET AL: "Enhanced Multiple Transform for Video Coding", 2016 DATA COMPRESSION CONFERENCE (DCC), IEEE, 30 March 2016 (2016-03-30), pages 73-82, XP033027689, DOI: 10.1109/DCC.2016.9
  
Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


Description

TECHNICAL FIELD



[0001] The present disclosure relates to video decoding technologies, and specifically, to a video decoding method and a related apparatus employing spatially varying transform with adaptive transform type.

BACKGROUND



[0002] Video coding like H.265 is based on a prediction plus transform framework. At encoder, an image block (containing a plurality of pixels) may be decomposed into a prediction block and a residual block, and the prediction information (e.g., prediction mode and motion vector information) and residual information (e.g., transform mode, transform coefficients and quantization parameter) are coded into a bitstream. At decoder, prediction information and residual information are parsed. According to the prediction information, intra or inter prediction is conducted to generate the prediction samples. According to the residual information, inverse quantization and inverse transform are conducted sequentially to generate residual samples. The prediction samples and the residual samples are added to obtain the reconstructed samples.

[0003] Spatially varying transform (SVT) was developed to improve video coding efficiency. For a rectangular residual block of width w and height h (i.e., w×h), a transform block smaller than the residual block is used to transform a part of the residual block, and the rest part of the residual block is not coded. The rationale behind SVT is that residual may not distribute evenly in a residual block. Using a smaller transform block with adaptive position can capture the major residual in the residual block, and thus may achieve better coding efficiency than transforming all residual in the residual block.

[0004] When SVT is applied for a residual block of size w×h, the size and position information of the transform block is coded into the video bitstream, and thus the decoder can reconstruct the transform block and compose it to the right place of the prediction block associated with the residual block.

[0005] In one example, three types of SVT block can be used for a residual block, as illustrated in Fig. 1.
  1. 1) SVT-I: w_t=w/2, h_t =h/2, where w_t and h_t denote the width and height of the transform block, respectively, and w and h denote the width and height of the residual block. In other words, the width and height of the transform block are both half of those of the residual block.
  2. 2) SVT-II: w_t=w/4, h_t =h;
  3. 3) SVT-III: w_t=w, h_t =h/4;


[0006] The type information of the SVT block are coded into bitstream.

[0007] The position of the transform block is represented by a position offset (x, y) to the top left corner of the residual block, where x means the horizontal distance between the top left corner of the transform block and that of the residual block in the unit of pixel, and y means the vertical distance between the top left corner of the transform block and that of the residual block in the unit of pixel. Each position that makes the transform block inside the residual block is a candidate position. For a residual block, the number of candidate positions is (w-w_t+1)× (h-h_t+1) for a type of SVT. More specifically, for a 16×16 residual block, when SVT-I is used, there are 81 candidate positions; when SVT-II or SVT-III is used, there are 13 candidate positions. The x and y values are coded into bitstream. To reduce complexity for SVT-I, a subset of 32 positions are selected from the 81 candidate positions as the allowed candidate positions for SVT-I.

[0008] One drawback of the SVT scheme is the heavy signaling overhead of the position information. In addition, the encoder complexity may be significantly increased with the number of positions tested in Rate-Distortion Optimization (RDO). Since the number of candidate positions increases with the size of the residual block, the overhead can be even bigger for larger residual blocks, like 32×32 or 64×128.

[0009] Another drawback of the SVT scheme is the size of transform block is ¼ of the residual block. The transform block is probably not large enough to cover the major residual in the residual block.

[0010] Therefore, a simplified SVT is developed, Two types of SVT blocks are used for residual coding, denoted as SVT-H and SVT-V, as shown in Fig. 2.
  1. 1) SVT-V: w_t = w/2 and h_t = h.
  2. 2) SVT-H: w_t = w and h_t = h/2.


[0011] SVT-V is similar to SVT-II and SVT-H is similar to SVT-III. Compared with SVT-II and SVT-III, the transform block in SVT-V and SVT-H is enlarged to half of the residual block, which can cover more residual in the residual block.

[0012] Candidate positions are decided by a Candidate Position Step Size (CPSS). Accordingly, candidate positions are separated with an equal space specified by the CPSS. The number of candidate positions is reduced to no more than 5, which mitigates the overhead of position information as well as the encoder complexity for deciding the best transform block position.

[0013] Document JVET-J0024 discloses description of SDR, HDR and 360° video coding technology proposal considering mobile application scenario, in which position-dependent core transform is applied in SVT, where three positions are associated with different core transforms, and DCT-8 is used for position 0 while DST-7 is used for position 1 and 2.

SUMMARY



[0014] The present disclosure discloses a video decoding method and a related apparatus employing spatially varying transform with adaptive transform type, to improve decoding quality.

[0015] The foregoing and other objects are achieved by the subject matter of the independent claims. Further implementation forms are apparent from the dependent claims, the description and the figures.

[0016] The present invention is defined by the independent claims. Additional features of the invention are presented in the dependent claims. In the following, parts of the description and drawings referring to embodiments which are not covered by the claims are not presented as embodiments of the invention, but as examples useful for understanding the invention.

[0017] According to a first aspect the disclosure relates to a video decoding method. The method is performed by a video decoding apparatus. The method includes: determining the usage of spatially varying transform (SVT) for a residual block; determining a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either SVT-V or SVT-H; determining a transform block position of a transform block of the residual block; determining a transform type of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform and the vertical transform is DST-7, wherein the vertical transform for the SVT-V type for all transform block positions and the horizontal transform for the SVT-H type for all transform block positions are set as DST-7, and the other transform is based on the transform block position, and reconstructing the residual block based on the transform type, the transform block position and transform coefficients of the transform block.

[0018] In a possible implementation form of the method according to the first aspect, when the SVT type for the residual block is SVT-V, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is DCT-8, and the vertical transform is DST-7.

[0019] In a possible implementation form of the method according to the first aspect, when the SVT type for the residual block is SVT-V, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DST-7.

[0020] In a possible implementation form of the method according to the first aspect, when the SVT type for the residual block is SVT-H, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DCT-8.

[0021] In a possible implementation form of the method according to the first aspect, when the SVT type for the residual block is SVT-H, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DST-7.

[0022] According to a second aspect the disclosure relates to a video decoding apparatus, comprising: a unit configured to determine the usage of spatially varying transform (SVT) for a residual block; a unit configured to determine a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either SVT-V or SVT-H; a unit configured to determine a transform block position of a transform block of the residual block; a unit configured to determine a transform type of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform and the vertical transform is DST-7, wherein the vertical transform for the SVT-V type for all transform block positions and the horizontal transform for the SVT-H type for all transform block positions are set as DST-7, and the other transform is based on the transform block position, and a unit configured to reconstruct the residual block based on the transform type, the transform block position and transform coefficients of the transform block.

[0023] In a possible implementation form of the method according to the second aspect, when the SVT type for the residual block is SVT-V, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is DCT-8, and the vertical transform is DST-7.

[0024] In a possible implementation form of the method according to the second aspect, when the SVT type for the residual block is SVT-V, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DST-7.

[0025] In a possible implementation form of the method according to the second aspect, when the SVT type for the residual block is SVT-H, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DCT-8.

[0026] In a possible implementation form of the method according to the second aspect, when the SVT type for the residual block is SVT-H, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is DST-7, and the vertical transform is DST-7.

[0027] According to a third aspect the disclosure relates to a video decoding apparatus, comprising: one or more processors; and a non-transitory computer-readable storage medium coupled to the processors and storing programming for execution by the processors, wherein the programming, when executed by the processors, configures the decoder to perform the method according to the first aspect.

[0028] According to a fourth aspect the disclosure relates to a non- volatile computer-readable storage medium storing computer instructions, that when executed by one or more processors, cause the one or more processors to perform the steps of the method according to the first aspect.

[0029] It can be seen that, the present disclosure adaptively uses multiple transform types for transform block based on the SVT type and position information, thus can improve decoding quality and decoding efficiency; further, the quantity of the transform algorithm are limited in some embodiments, thus can simplify the realization of the decoding apparatus.

BRIEF DESCRIPTION OF DRAWINGS



[0030] 

Fig. 1 is an illustration of SVT-I, SVT-II and SVT-III;

Fig. 2 is an illustration of SVT-V and SVT-H;

Fig. 3 is an illustration of candidate positions of SVT-V and SVT-H blocks;

Fig.4 is an illustration of SVT-V and SVT-H with 3 candidate positions;

Fig. 5 is a flowchart of a video decoding method according to an embodiment of the present disclosure;

Fig. 6 is a schematic structural diagram of a video decoding apparatus according to an embodiment of the present disclosure.


DESCRIPTION OF EMBODIMENTS



[0031] The present disclosure introduces an improved SVT scheme. The improvement is that the type of horizontal transform and the type of vertical transform of a SVT block are determined based on the SVT type and SVT block position. The horizontal transform can be different from the vertical transform.

[0032] A first embodiment describes the process of decoding a residual block. A bitstream containing at least one picture of video data is decoded. A picture is split into a plurality of rectangular image regions and each region corresponds to a Coding Tree Unit (CTU). A CTU is partitioned into a plurality of blocks, such as the coding units in HEVC, according to block partition information contained in the bitstream. The coding information of the blocks is parsed from the bitstream and pixels of the blocks are reconstructed based on the coding information.

[0033] In one embodiment, SVT is restricted to being used for inter-predicted blocks. In another embodiment, SVT may also be used for intra-predicted blocks.

[0034] In one example, SVT may be allowed for blocks using a specific inter prediction method (e.g., translation model based motion compensation) but not allowed for blocks using some other inter prediction methods (e.g., affine model based motion compensation). In another example, SVT may be allowed for prediction blocks using Merge mode or AMVP (advanced motion vector prediction) mode with 1/4-pel motion vector difference precision, but not allowed for prediction blocks using affine merge mode, affine inter mode or AMVP mode with 1-pel or 4-pel motion vector difference precision. In another example, SVT may be allowed for prediction blocks using Merge mode with a merge index smaller than 2, but not allowed for prediction blocks using Merge mode with a merge index not smaller than 2. The Merge mode and AMVP mode can be referred to in H.265/HEVC standard. Affine merge mode and affine inter mode can be referred to in JEM (Joint Exploration Model) codec from JVET (Joint Video Exploration Team).

[0035] In one example, a block may refer to a coding unit, where the coding unit may contain one prediction block and one residual block. The prediction block may contain all prediction samples of the coding unit, the residual block may contain all residual samples of the coding unit, and the prediction block is of the same size as the residual block. In another example, a block may refer to a coding unit, a coding unit may contain two prediction blocks and one residual block, each prediction block may contain a part of prediction samples of the coding unit, and a residual block may contain all residual samples of the coding unit. In another example, a block may refer to a coding unit, a coding unit may contain two prediction blocks and four residual blocks. The partition pattern of residual blocks in a coding unit may be signaled in the bitstream, such as the Residual Quad-Tree (RQT) in HEVC.

[0036] A block may contain only Y component (luma) of image samples (or pixels), or it may contain Y, U (chrominance) and V (chrominance) components of image samples.

[0037] A residual block Ro of size w×h can be reconstructed by the following steps.

[0038] Step 1. Determine the transform block size of the residual block Ro.

[0039] Step 1.1. Determine the usage of SVT according to a syntax element. For a residual block which is allowed to use SVT, if the residual block has non-zero transform coefficients of Y component (or it has non-zero transform coefficients of any color component), a flag (namely svt flag) is parsed from the bitstream. The flag indicates whether the residual block is coded using a transform block of the same size as the residual block (e.g., svt_flag = 0) or the residual block is coded with a transform block of a size smaller than the size of the residual block (e.g., svt flag = 1). Whether a block has non-zero transform coefficients of a color component may be indicated by a coded block flag (cbf) of the color component, as used in HEVC. Whether a block has non-zero transform coefficients of any color component may be indicated by a root coded block flag (root cbf), as used in HEVC.

[0040] In one example, a block is allowed to use SVT if the following conditions are satisfied:
  1. 1) the block is predicted using inter prediction;
  2. 2) either the block width or block height falls in a pre-determined range [a1, a2], e.g., a1=16 and a2=64, or a1=8 and a2=64, or a1=16 and a2=128. The value of a1 and a2 can be fixed values. The value also can be derived from a sequence parameter set (SPS) or a slice header.


[0041] In another example, a block is allowed to use SVT if the following conditions are satisfied:
  1. 1) the block is predicted using Merge mode with merge index smaller than a threshold (e.g., 1 or 2 or 3) or using AMVP mode with 1/4-pel motion vector difference precision;
  2. 2) one dimension of the block falls in a pre-determined range [a1, a2], and the other dimension of the block is not greater than a threshold a3, e.g., a1=8, a2=32 and a3=32. Parameter a1 may be set as twice of minimum transform size, a2 and a3 may both be set as the maximum transform size. The value of a1, a2 and a3 can be fixed values. The value also can be derived from a sequence parameter set (SPS) or a slice header.


[0042] If the block does not use SVT, the transform block size is set as w×h. Otherwise, Step 1.2 is applied to decide the transform size.

[0043] Step 1.2. Determine the type of SVT according to a syntax element, and derive the transform block size according to the SVT type. Allowed SVT types for the residual block are decided based on the width and height of the residual block. SVT-V is allowed if w is in the range [a1, a2] and h is not greater than a3; SVT-H is allowed if h is in the range [a1, a2] and w is not greater than a3. SVT may be only used for the Y component, or it may be used for all three components, i.e., Y component, U component and V component. When SVT is only used for the Y component, the Y component residual is transformed by SVT and the U and V components are transformed according to the size of the residual block.

[0044] When both SVT-V and SVT-H are allowed, one flag (namely svt_type_flag) is parsed from the bitstream, which indicates whether SVT-V is used (e.g., svt_type_flag = 0) or SVT-H is used (e.g., svt_type_flag = 1) for the residual block, and the transform block size is set according to the signaled SVT type (i.e., w_t=w/2 and h_t=h for SVT-V, and w_t=w and h_t=h/2 for SVT-H). When only SVT-V is allowed or only SVT-H is allowed, the svt_type _flag is not parsed from the bitstream, and the transform block size is set according to the allowed SVT type.

[0045] Step 2. Determine the transform block position according to a syntax element, and determine the transform type for the transform block based on the type of SVT and the transform block position information.

[0046] Step 2.1: Determine the transform block position according to a syntax element.

[0047] A position index P is parsed from the bitstream, and the position offset Z of the top left corner of the transform block to the top left corner of the residual block is determined as Z = s × P, where s is a candidate position step size (CPSS). The value of P is among

if SVT-V is used, or the value of P is among

if SVT-H is used. More specifically, let (0, 0) represent the coordinate of the top left corner of the residual block, the coordinate of the top left corner of the transform block is (Z, 0) for SVT-V or (0, Z) for SVT-H.

[0048] In one example, the CPSS is calculated as s = w/M1 for SVT-V or s = h/M2 for SVT-H, where w and h are the width and height of the residual block, respectively, and M1 and M2 are pre-determined integers in range of 2 to 8. More candidate positions are allowed with a larger M1 or M2 value. In this example, M1 and M2 are both set as 8. Therefore, the value of P is among 0 to 4. The candidate positions are illustrated in Fig. 3.

[0049] In another example, the CPSS is calculated as s = max(w/M1, Th1) for SVT-V or s = max(h/M2, Th2) for SVT-H, where Th1 and Th2 are pre-defined integers specifying a minimum step size. Th1 and Th2 are integers no less than 2. In this example, Th1 and Th2 are set as 4, and M1 and M2 are set as 8. In this example, different block sizes may have different number of candidate positions. For example, when w=8, 2 candidate positions (as illustrated by Fig. 5(a) and Fig. 5(e)) are available to choose; when w=16, 3 candidate positions (as illustrated by Fig. 5(a), Fig. 5(c) and Fig. 5(e)) are available to choose; when w>16, 5 positions are available to choose.

[0050] In another example, the CPSS is calculated as s = w/M1 for SVT-V or s = h/M2 for SVT-H, where M1 and M2 are set as 4. Accordingly, 3 candidate positions are allowed.

[0051] In another example, the CPSS is calculated as s = w/M1 for SVT-V or s = h/M2 for SVT-H, where M1 and M2 are set as 2. Accordingly, 2 candidate positions are allowed.

[0052] In another example, the CPSS is calculated as s = max(w/M1, Th1) for SVT-V or s = max(h/M2, Th2) for SVT-H, where T1 and T2 are set as 2, M1 is set as 8 if w ≥ h or is set as 4 if w < h, and M2 is set as 8 if h ≥ w or is set as 4 if h < w. In this case, the number of candidate positions for SVT-H or SVT-V may further depend on the aspect ratio of the residual block.

[0053] In another example, the CPSS is calculated as s = max(w/M1, Th1) for SVT-V or s = max(h/M2, Th2) for SVT-H, where the values of M1, M2, Th1 and Th2 are derived from a high-level syntax structure in the bitstream (e.g., sequence parameter set). M1 and M2 may share the same value parsed from a syntax element, and Th1 and Th2 may share the same value parsed from another syntax element.

[0054] The position index P may be binarized into one or more bins using truncated unary code. For example, if the P value is in the range of 0 to 4, P value 0, 4, 2, 3 and 1 are binarized as 0, 01, 001, 0001 and 0000, respectively; if the P value is in the range of 0 to 1, P value 0 and 1 are binarized as 0 and 1, respectively.

[0055] The position index P may be binarized into one or more bins using one most probable position and several remaining positions. When the left and top neighbors are available, the most probable position may be set as the position covering the bottom-right corner of the residual block. In one example, if the P value is in the range of 0 to 4 and position 4 is set as the most probable position, P value 4, 0, 1, 2 and 3 are binarized as 1, 000, 001, 010 and 011, respectively; if the P value is in the range of 0 to 2 and position 2 is set as the most probable position, P value 2, 0 and 1 are binarized as 1, 01 and 00, respectively.

[0056] Step 2.2: determine the transform type for the transform block based on the type of SVT and transform block position information. The transform type includes the horizontal transform and vertical transform of a 2-D separable transform.

[0057] Taking the case that 3 candidate positions are allowed for an example, as shown in Fig. 4. Position 0 covers the top-left corner, and position 2 covers the bottom-right corner. Position 1 is at the middle of the residual block. There are three positions for both SVT-V and SVT-H, as shown in Fig. 4.

[0058] In another example, 2 candidate positions are allowed. Position 0 covers the top-left corner, and position 1 covers the bottom-right corner (the same as position 2 in Fig. 4). That is, there are two positions for both SVT-V and SVT-H.

[0059] A two-dimensional transform may be separable into one-dimensional horizontal transform and vertical transform. A forward 2D transform which turns residual into transform coefficients may be realized by first applying horizontal transform on a residual block to generate a block TA and then applying vertical transform on the block TA to generate a transform coefficient block, as implemented in JEM codec. Accordingly, an inverse 2D transform which turns transform coefficients back to residual may be realized by first applying inverse vertical transform on a transform coefficient block to generate a block TB and then applying inverse horizontal transform on the block TB to generate a residual block, as implemented in JEM codec.

[0060] In one embodiment, the horizontal and vertical transforms for SVT-V position 0 are DCT-8 and DST-7; the horizontal and vertical transforms for SVT-V position 1 are DST-1 and DST-7; the horizontal and vertical transforms for SVT-V position 2 are DST-7 and DST-7; the horizontal and vertical transforms for SVT-H position 0 are DST-7 and DCT-8; the horizontal and vertical transforms for SVT-H position 1 are DST-7 and DST-1; the horizontal and vertical transforms for SVT-H position 2 are DST-7 and DST-7, as listed in Table I. In this example, the vertical transform for SVT-V and the horizontal transform for SVT-H are set as DST-7, and the other transform is based on SVT position.
Table I. An embodiment of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DCT-8 DST-7
SVT-V, position 1 DST-1 DST-7
SVT-V, position 2 DST-7 DST-7
SVT-H, position 0 DST-7 DCT-8
SVT-H, position 1 DST-7 DST-1
SVT-H, position 2 DST-7 DST-7


[0061] In another example not comprising all features necessary to implement the present invention, the horizontal transform and vertical transform for different SVT types and positions are listed in Table II. In this example, the vertical transform for SVT-V and the horizontal transform for SVT-H are set as DCT-2, and the other transform is based on SVT position.
Table II. An example of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DCT-8 DCT-2
SVT-V, position 1 DST-1 DCT-2
SVT-V, position 2 DST-7 DCT-2
SVT-H, position 0 DCT-2 DCT-8
SVT-H, position 1 DCT-2 DST-1
SVT-H, position 2 DCT-2 DST-7


[0062] In another example not comprising all features necessary to implement the present invention, the horizontal transform and vertical transform for different SVT types and positions are listed in Table III. In this example, the horizontal transform and vertical transform are decided only by SVT position.
Table III. An example of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DCT-8 DCT-8
SVT-V, position 1 DST-1 DST-1
SVT-V, position 2 DST-7 DST-7
SVT-H, position 0 DCT-8 DCT-8
SVT-H, position 1 DST-1 DST-1
SVT-H, position 2 DST-7 DST-7


[0063] In another example not comprising all features necessary to implement the present invention, the horizontal transform and vertical transform for different SVT types and positions are listed in Table IV.
Table IV. An example of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DST-7 DCT-8
SVT-V, position 1 DST-7 DST-1
SVT-V, position 2 DST-7 DST-7
SVT-H, position 0 DCT-8 DST-7
SVT-H, position 1 DST-1 DST-7
SVT-H, position 2 DST-7 DST-7


[0064] In another embodiment, the horizontal transform and vertical transform for different SVT types and positions are listed in Table V.
Table V. An embodiment of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DCT-8 DST-7
SVT-V, position 1 DCT-2 DST-7
SVT-V, position 2 DST-7 DST-7
SVT-H, position 0 DST-7 DCT-8
SVT-H, position 1 DST-7 DCT-2
SVT-H, position 2 DST-7 DST-7


[0065] In another example not comprising all features necessary to implement the present invention, the horizontal transform and vertical transform for different SVT types and positions are listed in Table VI.
Table VI. An example of 1-D horizontal and vertical transforms for different SVT types and positions.
SVT type, positionhorizontal transformvertical transform
SVT-V, position 0 DCT-8 DCT-2
SVT-V, position 1 DCT-2 DCT-2
SVT-V, position 2 DST-7 DCT-2
SVT-H, position 0 DCT-2 DCT-8
SVT-H, position 1 DCT-2 DCT-2
SVT-H, position 2 DCT-2 DST-7


[0066] The position-dependent multiple transforms may be applied to luma transform block only, and the corresponding chroma transform blocks always use inverse DCT-2 in the inverse transform process.

[0067] Step 3. Parse transform coefficients of the transform block based on the transform block size.

[0068] This is a commonly used process in video decoding, such as the transform coefficients parsing in HEVC or H.264/AVC. The transform coefficients may be coded using run-length coding or coded more sophisticated as a set of transform coefficient groups (CG).

[0069] Step 3 may be conducted before Step 2.

[0070] Step 4. Reconstruct the residual block Ro based on the transform coefficients and the transform block position and the type of inverse transform.

[0071] Inverse quantization and inverse transform of size w_t×h_t are applied to the transform coefficients to recover residual samples. The size of the residual samples is w_t×h_t, which is the same to the transform block size. The inverse transform is a 2-D separable transform. The dequantized transform coefficient block is first transformed by an inverse vertical transform to generate a block TC and then the block TC is transformed by an inverse horizontal transform, in which the inverse horizontal transform and inverse vertical transform are decided in Step 2.2 based on transform block position or based on both transform block position and SVT type of the transform block.

[0072] The residual samples are assigned to a corresponding region inside the residual block Ro, according to the transform block position, and the rest samples inside the residual block are set to be zero. For example, if SVT-V is used and the number of candidate position is 5 and the position index is 4, the reconstructed residual samples are assigned to region A in Fig. 3(e) and the region of size (w/2)×h to the left of region A has zero residual.

[0073] After conducting Step 1 to Step 4, the reconstructed residual block may be composed with a prediction block to generate the reconstructed samples in a coding unit. A filtering process may be applied on the reconstructed samples later, such as deblocking filter and sample adaptive offset (SAO) processing in HEVC.

[0074] Unlike existing solutions, the present disclosure adaptively uses multiple transform types for transform block based on the SVT type and position information.

[0075] FIG. 5 is a flowchart of an example method of video decoding employing spatially varying transform with adaptive transform type. The method may be initiated at a decoder upon receiving a bitstream. The method employs the bitstream to determine prediction blocks and transformed residual blocks. The method may also determine transform blocks, which is employed to determine residual blocks. The residual blocks and the prediction blocks are then employed to reconstruct image blocks. It should be noted that while method is described from the perspective of the decoder, a similar method may be employed (e.g., in reverse) to encode the video by employing SVT. Where the method includes:

[0076] Step 501, determining the usage of SVT for a residual block. The specific process of the determining is similar to step 1.1.

[0077] Step 502, determining a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either a SVT-V type or a SVT-H type, where the S VT-V type indicates that the width of a transform block of the residual block is the half size of the width of the residual block, and the height of the transform block is the same size of the height of the residual block (as shown in Fig. 4); where the SVT-H type indicates that the width of the transform block is the same size of the width of the residual block, and the height of the transform block is the half size of the height of the residual block (as shown in Fig. 4). The specific process of the determining is similar to step 1.2.

[0078] Step 503, deriving a transform block size of the transform block according to the SVT type. The specific process of the deriving is similar to step 1.2.

[0079] Step 504, determining a transform block position of the transform block. The specific process of the determining may similar to step 2.1.

[0080] Alternatively, when the candidate positions for a SVT type is two, a one bit flag may be employed to indicate the transform block position of the transform block of the residual block. For example, when only positions 0 and 2 of Fig. 4 are employed for SVT-V, a one bit flag is enough to indicate whether the transform block position is position 0 or position 2. When only positions 0 and 2 of Fig. 4 are employed for SVT-H, a one bit flag is enough to indicate whether the transform block position is position 0 or position 2.

[0081] Step 505, determining a transform type of the transform block according to the SVT type and the transform block position of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform and the vertical transform is DST-7. The specific process of the determining may similar to step 2.2.

[0082] The specific transform type can be any transform type of any one of the tables I and V as described above.

[0083] When the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the top-left corner of the residual block(that is, position 0 of Fig. 4), the horizontal transform is DCT-8, and the vertical transform is DST-7.

[0084] When the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block (that is, position 2 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DST-7.

[0085] When the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the top-left corner of the residual block(that is, position 0 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DCT-8.

[0086] When the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block(that is, position 2 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DST-7.

[0087] Step 506, parsing transform coefficients of the transform block according to the transform block size. The specific process of the parsing may similar to step 3.

[0088] Step 507, reconstructing the residual block based on the transform type, the transform block position and transform coefficients of the transform block. The specific process of the determining may similar to step 4.

[0089] It can be seen that, the present disclosure adaptively uses multiple transform types for transform block based on the SVT type and position information, thus can improve decoding quality and decoding efficiency; further, the quantity of the transform algorithm are limited in some embodiments, thus can simplify the realization of the decoding apparatus.

[0090] The present disclosure discloses a video decoding apparatus that is configured to implement the techniques of the present application, the video decoding apparatus including:

a unit configured to determine the usage of spatially varying transform (SVT) for a residual block. The specific process of the determine is similar to step 1.1.

a unit configured to determine a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either a SVT-V type or a SVT-H type, wherein the SVT-V type indicates that the width of a transform block of the residual block is the half size of the width of the residual block, and the height of the transform block is the same size of the height of the residual block, wherein the SVT-H type indicates that the width of the transform block is the same size of the width of the residual block, and the height of the transform block is the half size of the height of the residual block. The specific process of the determine is similar to step 1.2.

a unit configured to derive a transform block size of the transform block according to the SVT type. The specific process of the deriving is similar to step 1.2.

a unit configured to determine a transform block position of the transform block. The specific process of the determine may similar to step 2.1. Alternatively, when the candidate positions for a SVT type is two, a one bit flag may be employed to indicate the transform block position of the transform block of the residual block. For example, when only positions 0 and 2 of Fig. 4 are employed for SVT-V, a one bit flag is enough to indicate whether the transform block position is position 0 or position 2. When only positions 0 and 2 of Fig. 4 are employed for SVT-H, a one bit flag is enough to indicate whether the transform block position is position 0 or position 2.

a unit configured to determine a transform type of the transform block according to the SVT type and the transform block position of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein at least one of the horizontal transform and the vertical transform is DST-7. The specific process of the determine may similar to step 2.2.

a unit configured to parse transform coefficients of the transform block according to the transform block size.

The specific process of the parse may similar to step 3.
a unit configured to reconstruct the residual block based on the transform type, the transform block position and transform coefficients of the transform block. The specific process of the determining may similar to step 4.

[0091] The specific transform type can be any transform type of any one of the tables I and V as described above.

[0092] When the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the top-left corner of the residual block(that is, position 0 of Fig. 4), the horizontal transform is DCT-8, and the vertical transform is DST-7.

[0093] When the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block (that is, position 2 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DST-7.

[0094] When the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the top-left corner of the residual block(that is, position 0 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DCT-8.

[0095] When the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block(that is, position 2 of Fig. 4), the horizontal transform is DST-7, and the vertical transform is DST-7.

[0096] The present disclosure discloses another video decoding apparatus that is configured to implement the techniques of the present application, the video decoding apparatus including: one or more processors; and a non- volatile computer-readable storage medium coupled to the processors and storing programming for execution by the processors, wherein the programming, when executed by the processors, configures the video decoding apparatus to process any of the methods as stated above.

[0097] The present disclosure discloses a non- volatile computer-readable storage medium storing computer instructions, that when executed by one or more processors, cause the one or more processors to perform the steps of any of the methods as stated above.

[0098] Figure 9 is a schematic diagram of a coding device 900 according to an embodiment of the disclosure. The coding device 900 is suitable for implementing the disclosed embodiments as described herein. The coding device 900 comprises ingress ports 910 and receiver units (Rx) 920 for receiving data; a processor, logic unit, or central processing unit (CPU) 930 to process the data; transmitter units (Tx) 940 and egress ports 950 for transmitting the data; and a memory 960 for storing the data. The coding device 900 may also comprise optical-to-electrical (OE) components and electrical-to-optical (EO) components coupled to the ingress ports 910, the receiver units 920, the transmitter units 940, and the egress ports 950 for egress or ingress of optical or electrical signals.

[0099] The processor 930 is implemented by hardware and software. The processor 930 may be implemented as one or more CPU chips, cores (e.g., as a multi-core processor), field-programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), and digital signal processors (DSPs). The processor 930 is in communication with the ingress ports 910, receiver units 920, transmitter units 940, egress ports 950, and memory 960. The processor 930 comprises a coding module 970. The coding module 970 implements the disclosed embodiments described above. For instance, the coding module 970 implements, processes, parses, prepares, or provides the various graphics processes and calculations. The inclusion of the coding module 970 therefore provides a substantial improvement to the functionality of the device 900 and effects a transformation of the device 900 to a different state. Alternatively, the coding module 970 is implemented as instructions stored in the memory 960 and executed by the processor 930.

[0100] The memory 960 comprises one or more disks, tape drives, and solid-state drives and may be used as an overflow data storage device, to store programs when such programs are selected for execution, and to store instructions and data that are read during program execution. The memory 960 may be volatile and/or non-volatile and may be read-only memory (ROM), random-access memory (RAM), ternary content-addressable memory (TCAM), and/or static random-access memory (SRAM).

[0101] The following references are incorporated herein by reference as if reproduced in their entirety:

[0102] While several embodiments have been provided in the present disclosure, it should be understood that the disclosed systems and methods might be embodied in many other specific forms without departing from the scope of the present disclosure. The present examples are to be considered as illustrative and not restrictive, and the intention is not to be limited to the details given herein. For example, the various elements or components may be combined or integrated in another system or certain features may be omitted, or not implemented.

[0103] In addition, techniques, systems, subsystems, and methods described and illustrated in the various embodiments as discrete or separate may be combined or integrated with other systems, modules, techniques, or methods without departing from the scope of the present disclosure. Other items shown or discussed as coupled or directly coupled or communicating with each other may be indirectly coupled or communicating through some interface, device, or intermediate component whether electrically, mechanically, or otherwise. Other examples of changes, substitutions, and alterations are ascertainable by one skilled in the art and could be made without departing from the scope disclosed herein.


Claims

1. A video decoding method, comprising:

determining (501) the usage of spatially varying transform (SVT) for a residual block;

determining (502) a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either a SVT-V type or a SVT-H type, wherein the SVT-V type indicates that the width of a transform block of the residual block is the half size of the width of the residual block, and the height of the transform block is the same size of the height of the residual block, wherein the SVT-H type indicates that the width of the transform block is the same size of the width of the residual block, and the height of the transform block is the half size of the height of the residual block;

deriving (503) a transform block size of the transform block according to the SVT type;

determining (504) a transform block position of the transform block;

determining (505) a transform type of the transform block;

parsing (506) transform coefficients of the transform block according to the transform block size; and

reconstructing (507) the residual block by recovering residual samples based on the transform type, the transform block size, the transform block position and transform coefficients of the transform block, wherein residual samples are assigned to a corresponding region inside the residual block according to the transform block position, and the rest samples inside the residual block are set to be zero;

characterized by

determining (505) a transform type of the transform block according to the SVT type and the transform block position of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein the vertical transform for the SVT-V type for all transform block positions and the horizontal transform for the SVT-H type for all transform block positions are set as DST-7, and the other transform is based on the transform block position.


 
2. The method according to claim 1, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DCT-8, and the vertical transform is based on DST-7.
 
3. The method according to claim 1, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 
4. The method according to claim 1, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DCT-8.
 
5. The method according to claim 1, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 
6. A video decoding apparatus, comprising:

a unit configured to determine the usage of spatially varying transform (SVT) for a residual block;

a unit configured to determine a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either a SVT-V type or a SVT-H type, wherein the SVT-V type indicates that the width of a transform block of the residual block is the half size of the width of the residual block, and the height of the transform block is the same size of the height of the residual block, wherein the SVT-H type indicates that the width of the transform block is the same size of the width of the residual block, and the height of the transform block is the half size of the height of the residual block;

a unit configured to derive a transform block size of the transform block according to the SVT type;

a unit configured to determine a transform block position of the transform block;

a unit configured to determine a transform type of the transform block;

a unit configured to parse transform coefficients of the transform block according to the transform block size; and

a unit configured to reconstruct the residual block by recovering residual samples based on the transform type, the transform block position and transform coefficients of the transform block, wherein residual samples are assigned to a corresponding region inside the residual block according to the transform block position, and the rest samples inside the residual block are set to be zero; characterized by a unit configured to determine a transform type of the transform block according to the SVT type and the transform block position of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein the vertical transform for the SVT-V type for all transform block positions and the horizontal transform for the SVT-H type for all transform block positions are set as DST-7, and the other transform is based on the transform block position.


 
7. The apparatus according to claim 6, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DCT-8, and the vertical transform is based on DST-7.
 
8. The apparatus according to claim 6, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 
9. The apparatus according to claim 6, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DCT-8.
 
10. The apparatus according to claim 6, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 
11. A non- volatile computer-readable storage medium storing computer instructions, that when executed by one or more processors, cause the one or more processors to perform the steps of:

determining (501) the usage of spatially varying transform (SVT) for a residual block;

determining (502) a SVT type for the residual block when SVT is used for the residual block, wherein the SVT type for the residual block is either a SVT-V type or a SVT-H type, wherein the SVT-V type indicates that the width of a transform block of the residual block is the half size of the width of the residual block, and the height of the transform block is the same size of the height of the residual block, wherein the SVT-H type indicates that the width of the transform block is the same size of the width of the residual block, and the height of the transform block is the half size of the height of the residual block;

deriving (503) a transform block size of the transform block according to the SVT type;

determining (504) a transform block position of the transform block;

determining (505) a transform type of the transform block;

parsing (506) transform coefficients of the transform block according to the transform block size; and

reconstructing (507) the residual block by recovering residual samples based on the transform type, the transform block size, the transform block position and transform coefficients of the transform block, wherein residual samples are assigned to a corresponding region inside the residual block according to the transform block position, and the rest samples inside the residual block are set to be zero; characterized by determining (505) a transform type of the transform block according to the SVT type and the transform block position of the transform block, wherein the transform type indicates a horizontal transform and a vertical transform for the transform block, wherein the vertical transform for the SVT-V type for all transform block positions and the horizontal transform for the SVT-H type for all transform block positions are set as DST-7, and the other transform is based on the transform block position.


 
12. The medium according to claim 11, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DCT-8, and the vertical transform is based on DST-7.
 
13. The medium according to claim 11, wherein when the SVT type for the residual block is the SVT-V type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 
14. The medium according to claim 11, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the top-left corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DCT-8.
 
15. The medium according to claim 11, wherein when the SVT type for the residual block is the SVT-H type, and the transform block position of the transform block is a position covers the right-bottom corner of the residual block, the horizontal transform is based on DST-7, and the vertical transform is based on DST-7.
 


Ansprüche

1. Videodecodierungsverfahren, das Folgendes umfasst:

Bestimmen (501) der Verwendung einer räumlich variierenden Transformation (SVT) für einen Restblock;

Bestimmen (502) einer SVT-Art für den Restblock, wenn die SVT für den Restblock verwendet wird, wobei die SVT-Art für den Restblock entweder eine SVT-V-Art oder eine SVT-H-Art ist, wobei die SVT-V-Art anzeigt, dass die Breite eines Transformationsblocks des Restblocks die halbe Größe der Breite des Restblocks ist und die Höhe des Transformationsblocks die gleiche Größe der Höhe des Restblocks ist, wobei die SVT-H-Art anzeigt, dass die Breite des Transformationsblocks die gleiche Größe wie die Breite des Restblocks ist und die Höhe des Transformationsblocks die halbe Größe der Höhe des Restblocks ist;

Ableiten (503) einer Transformationsblockgröße des Transformationsblocks gemäß der SVT-Art;

Bestimmen (504) einer Transformationsblockposition des Transformationsblocks;

Bestimmen (505) einer Transformationsart des Transformationsblocks;

Parsen (506) von Transformationskoeffizienten des Transformationsblocks gemäß der Transformationsblockgröße; und

Rekonstruieren (507) des Restblocks durch Wiederherstellen von Restabtastwerten basierend auf der Transformationsart, der Transformationsblockgröße, der Transformationsblockposition und den Transformationskoeffizienten des Transformationsblocks, wobei Restabtastwerte einer entsprechenden Region innerhalb des Restblocks gemäß der Transformationsblockposition zugeordnet sind, und die Restabtastungen innerhalb des Restblocks eingestellt werden, um Null zu sein;

gekennzeichnet durch

Bestimmen (505) einer Transformationsart des Transformationsblocks gemäß der SVT-Art und der Transformationsblockposition des Transformationsblocks, wobei die Transformationsart eine horizontale Transformation und eine vertikale Transformation für den Transformationsblock anzeigt, wobei die vertikale Transformation für die SVT-V-Art für alle Transformationsblockpositionen und die horizontale Transformation für die SVT-H-Art für alle Transformationsblockpositionen als DST-7 eingestellt werden, und die andere Transformation auf der Transformationsblockposition basiert.


 
2. Verfahren nach Anspruch 1, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DCT-8 basiert und die vertikale Transformation auf DST-7 basiert.
 
3. Verfahren nach Anspruch 1, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 
4. Verfahren nach Anspruch 1, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DCT-8 basiert.
 
5. Verfahren nach Anspruch 1, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 
6. Videodecodierungseinrichtung, die Folgendes umfasst:

eine Einheit, die konfiguriert ist, um die Verwendung einer räumlich variierenden Transformation (SVT) für einen Restblock zu bestimmen;

eine Einheit, die konfiguriert ist, um eine SVT-Art für den Restblock zu bestimmen, wenn die SVT für den Restblock verwendet wird, wobei die SVT-Art für den Restblock entweder eine SVT-V-Art oder eine SVT-H-Art ist, wobei die SVT-V-Art anzeigt, dass die Breite eines Transformationsblocks des Restblocks die halbe Größe der Breite des Restblocks ist und die Höhe des Transformationsblocks die gleiche Größe der Höhe des Restblocks ist, wobei die SVT-H-Art anzeigt, dass die Breite des Transformationsblocks die gleiche Größe wie die Breite des Restblocks ist und die Höhe des Transformationsblocks die halbe Größe der Höhe des Restblocks ist;

eine Einheit, die konfiguriert ist, um eine Transformationsblockgröße des Transformationsblocks gemäß der SVT-Art abzuleiten;

eine Einheit, die konfiguriert ist, um eine Transformationsblockposition des Transformationsblocks zu bestimmen;

eine Einheit, die konfiguriert ist, um eine Transformationsart des Transformationsblocks zu bestimmen;

eine Einheit, die konfiguriert ist, um Transformationskoeffizienten des Transformationsblocks gemäß der Transformationsblockgröße zu analysieren; und

eine Einheit, die konfiguriert ist, um den Restblock durch Wiederherstellen von Restabtastwerten basierend auf der Transformationsart, der Transformationsblockposition und den Transformationskoeffizienten des Transformationsblocks zu rekonstruieren, wobei Restabtastwerte einer entsprechenden Region innerhalb des Restblocks gemäß der Transformationsblockposition zugeordnet sind, und die Restabtastungen innerhalb des Restblocks eingestellt werden, um Null zu sein; gekennzeichnet durch eine Einheit, die konfiguriert ist, um eine Transformationsart des Transformationsblocks gemäß der SVT-Art und die Transformationsblockposition des Transformationsblocks zu bestimmen, wobei der Transformationsart eine horizontale Transformation und eine vertikale Transformation für den Transformationsblock anzeigt, wobei die vertikale Transformation für die SVT-V-Art für alle Transformationsblockpositionen und die horizontale Transformation für die SVT-H-Art für alle Transformationsblockpositionen als DST-7 eingestellt werden, und die andere Transformation auf der Transformationsblockposition basiert.


 
7. Einrichtung nach Anspruch 6, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DCT-8 basiert und die vertikale Transformation auf DST-7 basiert.
 
8. Einrichtung nach Anspruch 6, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 
9. Einrichtung nach Anspruch 6, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DCT-8 basiert.
 
10. Einrichtung nach Anspruch 6, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 
11. Nicht flüchtiges computerlesbares Speichermedium, das Computeranweisungen speichert, die, wenn sie durch einen oder mehrere Prozessoren ausgeführt werden, den einen oder die mehreren Prozessoren veranlassen, die folgenden Schritte durchzuführen:

Bestimmen (501) der Verwendung einer räumlich variierenden Transformation (SVT) für einen Restblock;

Bestimmen (502) einer SVT-Art für den Restblock, wenn die SVT für den Restblock verwendet wird, wobei die SVT-Art für den Restblock entweder eine SVT-V-Art oder eine SVT-H-Art ist, wobei die SVT-V-Art anzeigt, dass die Breite eines Transformationsblocks des Restblocks die halbe Größe der Breite des Restblocks ist und die Höhe des Transformationsblocks die gleiche Größe der Höhe des Restblocks ist, wobei die SVT-H-Art anzeigt, dass die Breite des Transformationsblocks die gleiche Größe wie die Breite des Restblocks ist und die Höhe des Transformationsblocks die halbe Größe der Höhe des Restblocks ist;

Ableiten (503) einer Transformationsblockgröße des Transformationsblocks gemäß der SVT-Art;

Bestimmen (504) einer Transformationsblockposition des Transformationsblocks;

Bestimmen (505) einer Transformationsart des Transformationsblocks;

Parsen (506) von Transformationskoeffizienten des Transformationsblocks gemäß der Transformationsblockgröße; und

Rekonstruieren (507) des Restblocks durch Wiederherstellen von Restabtastwerten basierend auf der Transformationsart, der Transformationsblockgröße, der Transformationsblockposition und den Transformationskoeffizienten des Transformationsblocks, wobei Restabtastwerte einer entsprechenden Region innerhalb des Restblocks gemäß der Transformationsblockposition zugeordnet sind, und die Restabtastungen innerhalb des Restblocks eingestellt werden, um Null zu sein; gekennzeichnet durch Bestimmen (505) einer Transformationsart des Transformationsblocks gemäß der SVT-Art und der Transformationsblockposition des Transformationsblocks, wobei der Transformationsart eine horizontale Transformation und eine vertikale Transformation für den Transformationsblock anzeigt, wobei die vertikale Transformation für die SVT-V-Art für alle Transformationsblockpositionen und die horizontale Transformation für die SVT-H-Art für alle Transformationsblockpositionen als DST-7 eingestellt werden, und die andere Transformation auf der Transformationsblockposition basiert.


 
12. Medium nach Anspruch 11, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DCT-8 basiert und die vertikale Transformation auf DST-7 basiert.
 
13. Medium nach Anspruch 11, wobei, wenn die SVT-Art für den Restblock die SVT-V-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 
14. Medium nach Anspruch 11, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die obere linke Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DCT-8 basiert.
 
15. Medium nach Anspruch 11, wobei, wenn die SVT-Art für den Restblock die SVT-H-Art ist, und die Transformationsblockposition des Transformationsblocks eine Position ist, die die rechte untere Ecke des Restblocks abdeckt, die horizontale Transformation auf DST-7 basiert und die vertikale Transformation auf DST-7 basiert.
 


Revendications

1. Procédé de décodage d'image vidéo, comprenant :

la détermination (501) de l'utilisation d'une transformée variant spatialement (SVT) pour un bloc résiduel ;

la détermination (502) d'un type de SVT pour le bloc résiduel lorsque la SVT est utilisée pour le bloc résiduel, le type de SVT pour le bloc résiduel étant soit un type de SVT-V, soit un type de SVT-H, le type de SVT-V indiquant que la largeur d'un bloc de transformée du bloc résiduel est la moitié de la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la même taille que la hauteur du bloc résiduel, le type de SVT-H indiquant que la largeur du bloc de transformée est la même taille que la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la moitié de la hauteur du bloc résiduel ;

la dérivation (503) d'une taille de bloc de transformée du bloc de transformée selon le type SVT ;

la détermination (504) d'une position de bloc de transformée du bloc de transformée ;

la détermination (505) d'un type de transformée du bloc de transformée ;

l'analyse (506) des coefficients de transformée du bloc de transformée selon la taille de bloc de transformée ; et

la reconstruction (507) du bloc résiduel en récupérant des échantillons résiduels sur la base du type de transformée, de la taille du bloc de transformée, de la position de bloc de transformée et des coefficients de transformée du bloc de transformée, les échantillons résiduels étant attribués à une région correspondante à l'intérieur du bloc résiduel selon le la position de bloc de transformée, et les échantillons restants à l'intérieur du bloc résiduel sont mis à zéro ;

caractérisé par

la détermination (505) d'un type de transformée du bloc de transformée selon le type de SVT et la position du bloc de transformée du bloc de transformée, le type de transformée indiquant une transformée horizontale et une transformée verticale pour le bloc de transformation, la transformée verticale pour le type de SVT-V pour toutes les positions de bloc de transformée et la transformée horizontale pour le type de SVT-H pour toutes les positions de bloc de transformée étant définies comme DST-7, et l'autre transformée étant basée sur la position du bloc de transformée.


 
2. Procédé selon la revendication 1, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position du bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DCT-8, et la transformée verticale est basée sur DST-7.
 
3. Procédé selon la revendication 1, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformation verticale est basée sur DST-7.
 
4. Procédé selon la revendication 1, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformée verticale est basée sur DCT-8.
 
5. Procédé selon la revendication 1, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basé sur DST-7, et la transformée verticale est basée sur DST-7.
 
6. Appareil de décodage vidéo, comprenant :

une unité configurée pour déterminer l'utilisation d'une transformée variant spatialement (SVT) pour un bloc résiduel ;

une unité configurée pour déterminer un type de SVT pour le bloc résiduel lorsque la SVT est utilisée pour le bloc résiduel, le type de SVT pour le bloc résiduel étant soit un type de SVT-V, soit un type de SVT-H, le type de SVT-V indiquant que la largeur d'un bloc de transformée du bloc résiduel est la moitié de la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la même taille que la hauteur du bloc résiduel, le type de SVT-H indiquant que la largeur du bloc de transformée est la même taille que la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la moitié de la hauteur du bloc résiduel ;

une unité configurée pour dériver une taille de bloc de transformée du bloc de transformée selon le type de SVT ;

une unité configurée pour déterminer une position de bloc de transformée du bloc de transformée ;

une unité configurée pour déterminer un type de transformée du bloc de transformée ;

une unité configurée pour analyser les coefficients de transformée du bloc de transformée selon la taille de bloc de transformée ; et

une unité configurée pour reconstruire le bloc résiduel en récupérant des échantillons résiduels sur la base du type de transformée, de la position de bloc de transformée et des coefficients de transformée du bloc de transformée, les échantillons résiduels étant attribués à une région correspondante à l'intérieur du bloc résiduel selon la position de bloc de transformée, et les échantillons restants à l'intérieur du bloc résiduel étant mis à zéro ; caractérisé par une unité configurée pour déterminer un type de transformée du bloc de transformée selon le type de SVT et la position de bloc de transformée du bloc de transformée, le type de transformée indiquant une transformée horizontale et une transformée verticale pour le bloc de transformée, la transformée verticale pour le type de SVT-V pour toutes les positions de bloc de transformée et la transformée horizontale pour le type de SVT-H pour toutes les positions de bloc de transformée étant définies comme DST-7, et l'autre transformée étant basée sur la position du bloc de transformée.


 
7. Appareil selon la revendication 6, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DCT-8, et la transformée verticale est basée sur DST-7.
 
8. Appareil selon la revendication 6, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformée verticale est basée sur DST-7.
 
9. Appareil selon la revendication 6, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformée verticale est basée sur DCT-8.
 
10. Appareil selon la revendication 6, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformée verticale est basée sur DST-7.
 
11. Support de mémoire non volatile lisible par ordinateur stockant des instructions informatiques qui, lorsqu'elles sont exécutées par un ou plusieurs processeurs, amènent le ou les processeurs à réaliser les étapes consistant à :

déterminer (501) l'utilisation d'une transformée variant spatialement (SVT) pour un bloc résiduel ;

déterminer (502) un type de SVT pour le bloc résiduel lorsque la SVT est utilisée pour le bloc résiduel, le type de SVT pour le bloc résiduel étant soit un type de SVT-V, soit un type de SVT-H, le type de SVT-V indiquant que la largeur d'un bloc de transformée du bloc résiduel est la moitié de la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la même taille que la hauteur du bloc résiduel, le type de SVT-H indiquant que la largeur du bloc de transformée est la même taille que la largeur du bloc résiduel, et que la hauteur du bloc de transformée est la moitié de la hauteur du bloc résiduel ;

dériver (503) une taille de bloc de transformée du bloc de transformée selon le type de SVT ;

déterminer (504) une position de bloc de transformée du bloc de transformée ;

déterminer (505) un type de transformée du bloc de transformée ;

analyser (506) des coefficients de transformée du bloc de transformée selon la taille du bloc de transformée ; et

reconstruire (507) le bloc résiduel en récupérant des échantillons résiduels sur la base du type de transformée, de la taille du bloc de transformée, de la position de bloc de transformée et des coefficients de transformée du bloc de transformée, les échantillons résiduels étant attribués à une région correspondante à l'intérieur du bloc résiduel selon le la position de bloc de transformée, et les échantillons restants à l'intérieur du bloc résiduel étant mis à zéro ; caractérisé par la détermination (505) d'un type de transformée du bloc de transformée selon le type de SVT et la position de bloc de transformée du bloc de transformée, le type de transformée indiquant une transformée horizontale et une transformée verticale pour le bloc de transformée, la transformée verticale pour le type de SVT-V pour toutes les positions de bloc de transformée et la transformée horizontale pour le type de SVT-H pour toutes les positions de bloc de transformée étant définis comme DST-7, et l'autre transformée est basée sur la position de bloc de transformée.


 
12. Support selon la revendication 11, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DCT-8, et la transformée verticale est basée sur DST-7.
 
13. Support selon la revendication 11, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-V, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformation verticale est basée sur DST-7.
 
14. Support selon la revendication 11, dans lequel lorsque le type de SVT pour le bloc résiduel est le type SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin supérieur gauche du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformation verticale est basée sur DCT-8.
 
15. Support selon la revendication 11, dans lequel lorsque le type de SVT pour le bloc résiduel est le type de SVT-H, et que la position de bloc de transformée du bloc de transformée est une position couvrant le coin inférieur droit du bloc résiduel, la transformée horizontale est basée sur DST-7, et la transformée verticale est basée sur DST-7.
 




Drawing