Selection of pictures for disparity vector derivation
AssigneeQUALCOMM Incorporated
InventorsJewon Kang, Ying Chen, Li Zhang, Marta Karczewicz
Life of this patent
Estimating the term…
Abstract
When coding multiview video data, a video encoder and video decoder may select a candidate picture from one of one or more random access point view component (RAPVC) pictures and one or more pictures having a lowest temporal identification value. The video encoder and video decoder may determine whether a block in the selected candidate picture is inter-predicted with a disparity motion vector and determine a disparity vector for a current block of a current picture based on the disparity motion vector. The video encoder and video decoder may inter-prediction encode or decode, respectively, the current block based on the determined disparity vector.
Claims33
A method for decoding a bitstream that includes multiview video data that includes multiple views, the method comprising:
- applying a neighboring block based disparity vector (NBDV) generation process for purposes of deriving a disparity vector for a current block of a current picture of the video data, wherein the NBDV generation process relies on motion vectors of neighboring blocks for deriving the disparity vector for the current block of the current picture relative to another view of the multiview video data,
- wherein applying the NBDV generation process comprises:
- determining whether one or more random access point view component (RAPVC) pictures are available;
- selecting a candidate picture from the one or more RAPVC pictures based on the determination that at least one of the RAPVC pictures is available, or
- selecting the candidate picture from one or more pictures having a lowest temporal identification value based on the determination that no RAPVC picture is available;
- determining whether a video block in the selected candidate picture is inter-predicted with a disparity motion vector, wherein the disparity motion vector refers to a block in a view other than a view that includes the selected candidate picture of the multiview video data;
- and
- determining the disparity vector for the current block of the current picture, as part of the NBDV generation, based on the disparity motion vector based on the video block in the selected candidate picture of the multiview video data being inter-predicted with the disparity motion vector;
- and
- inter-prediction decoding the current block based on the disparity vector.
A method for encoding multiview video data that includes multiple views in bitstream, the method comprising:
- applying a neighboring block based disparity vector (NBDV) generation process for purposes of deriving a disparity vector for a current block of a current picture of the video data, wherein the NBDV generation process relies on motion vectors of neighboring blocks for deriving the disparity vector for the current block of the current picture relative to another view of the multiview video data,
- wherein applying the NBDV generation process comprises:
- determining whether one or more random access point view component (RAPVC) pictures are available;
- selecting a candidate picture from the one or more RAPVC pictures based on the determination that at least one of the RAPVC pictures is available, or
- selecting the candidate picture from one or more pictures having a lowest temporal identification value based on the determination that no RAPVC picture is available;
- determining whether a video block in the selected candidate picture is inter-predicted with a disparity motion vector, wherein the disparity motion vector refers to a block in a view other than a view that includes the selected candidate picture of the multiview video data;
- and
- determining the disparity vector for the current block of the current picture, as part of the NBDV generation, based on the disparity motion vector based on the video block in the selected candidate picture of the multiview video data being inter-predicted with the disparity motion vector;
- and
- inter-prediction encoding the current block based on the disparity vector.
A device for coding video data for multiview video, the device comprising:
- a memory unit configured to store the video data of a current picture;
- a video coder configured to:
- apply a neighboring block based disparity vector (NBDV) generation process for purposes of deriving a disparity vector for a current block of the current picture, wherein the NBDV generation process relies on motion vectors of neighboring blocks for deriving the disparity vector for the current block of the current picture relative to another view of the multiview video data,
- wherein, to apply the NBDV generation process, the video coder is configured to:
- determine whether one or more random access point view component (RAPVC) pictures are available;
- select a candidate picture from the one or more RAPVC pictures based on the determination that at least one of the RAPVC pictures is available, or
- select the candidate picture from one or more pictures having a lowest temporal identification value based on the determination that no RAPVC picture is available;
- determine whether a video block in the selected candidate picture is inter-predicted with a disparity motion vector, wherein the disparity motion vector refers to a block in a view other than a view that includes the selected candidate picture of the multiview video data;
- and
- determine the disparity vector for the current block of the current picture, as part of the NBDV generation, based on the disparity motion vector based on the video block in the selected candidate picture of the multiview video data being inter-predicted with the disparity motion vector, and
- wherein the video coder is configured to inter-prediction code the current block based on the disparity vector.
A non-transitory computer-readable storage medium having instructions stored thereon that when executed by one or more processors of a device for video coding for multiview video cause the one or more processors to:
- apply a neighboring block based disparity vector (NBDV) generation process for purposes of deriving a disparity vector for a current block of a current picture, wherein the NBDV generation process relies on motion vectors of neighboring blocks for deriving the disparity vector for the current block of the current picture relative to another view of the multiview video data,
- wherein the instructions that cause the one or more processors to apply the NBDV generation process comprise instructions that cause the one or more processors to:
- determine whether one or more random access point view component (RAPVC) pictures are available;
- select a candidate picture from the one or more RAPVC pictures based on the determination that at least one of the RAPVC pictures is available, or
- select the candidate picture from one or more pictures having a lowest temporal identification value based on the determination that no RAPVC picture is available;
- determine whether a video block in the selected candidate picture is inter-predicted with a disparity motion vector, wherein the disparity motion vector refers to a block in a view other than a view that includes the selected candidate picture of the multiview video data;
- and
- determine the disparity vector for the current block of the current picture, as part of the NBDV generation, based on the disparity motion vector based on the video block in the selected candidate picture of the multiview video data being inter-predicted with the disparity motion vector, and
- wherein the instructions cause the one or more processors to inter-prediction code the current block based on the disparity vector.
A device for coding video data for multiview video, the device comprising:
- means for applying a neighboring block based disparity vector (NBDV) generation process for purposes of deriving a disparity vector for a current block of a current picture, wherein the NBDV generation process relies on motion vectors of neighboring blocks for deriving the disparity vector for the current block of the current picture relative to another view of the multiview video data,
- wherein the means for applying the NBDV generation process comprises:
- means for determining whether one or more random access point view component (RAPVC) pictures are available;
- means for selecting a candidate picture from the one or more RAPVC pictures based on the determination that at least one of the RAPVC pictures is available, or
- means for selecting the candidate picture from one or more pictures having a lowest temporal identification value based on the determination that no RAPVC picture is available;
- means for determining whether a video block in the selected candidate picture is inter-predicted with a disparity motion vector, wherein the disparity motion vector refers to a block in a view other than a view that includes the selected candidate picture of the multiview video data;
- and
- means for determining the disparity vector for the current block of the current picture, as part of the NBDV generation, based on the disparity motion vector based on the video block in the selected candidate picture of the multiview video data being inter-predicted with the disparity motion vector, and
- the device further comprising means for inter-prediction coding the current block based on the disparity vector.
Dependencies are inferred from the claim text.