Intra spatial geometric partition mode and matrix intra partition mode transform set selection in video coding

A device for decoding video data, the device comprising:

• one or more memories configured to store the video data;
• and
• one or more processors implemented in circuitry and operably coupled to the one or more memories, the one or more processors configured to:
• determine to use a spatial geometric partition mode (SGPM) for a current block of the video data;
• perform a Sobel-based intra prediction direction derivation for the current block;
• determine a first intra prediction mode of a plurality of intra prediction modes based on an output of the Sobel-based intra prediction direction derivation;
• determine a second intra prediction mode of the plurality of intra prediction modes based on the output of the Sobel-based intra prediction direction derivation;
• determine a first set of transforms based on the first intra prediction mode;
• determine a second set of transforms based on the second intra prediction mode;
• and
• decode the current block based on the SGPM, and at least one of the first set of transforms or the second set of transforms.

A method for encoding video data, the method comprising:

• determining to use a spatial geometric partition mode (SGPM) for a current block of the video data;
• performing a Sobel-based intra prediction direction derivation for the current block;
• determining a first intra prediction mode of a plurality of intra prediction modes based on an output of the Sobel-based intra prediction direction derivation;
• determining a second intra prediction mode of the plurality of intra prediction modes based on the output of the Sobel-based intra prediction direction derivation;
• determining a first set of transforms based on the first intra prediction mode;
• determining a second set of transforms based on the second intra prediction mode;
• and
• encoding the current block based on the SGPM, and at least one of the first set of transforms or the second set of transforms.