# US 10,313,763 B2 · Method and apparatus for requesting and receiving selected segment streams based on projection information > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,763 B2 - Document ID: US10313763B2 - Status: Granted - Kind: B2 - Application number: 15/660,710 - Filed: 2017-07-26 - Published: 2018-02-01 - Granted: 2019-06-04 - Earliest claimed: 2016-07-29 - Assignees: Mediatek Inc. - Applicants: Mediatek Inc. - Inventors: Wang Lin Lai; Shan Liu; Xin Wang - Web page: https://patentgrep.com/patent/US10313763B2 ## CPC - H04N 21/816: {involving special video data, e.g 3D video} - H04N 7/0117: {involving conversion of the spatial resolution of the incoming video signal (for graphics images G09G2340/0407)} - H04N 21/234345: {the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment} - H04N 21/234363: {by altering the spatial resolution, e.g. for clients with a lower screen resolution} - H04N 21/26258: {for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list (retrieval of multimedia data based on playlists G06F16/40)} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4728: for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region - H04N 21/6581: {Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application} - H04N 21/8146: {involving graphical data, e.g. 3D object, 2D graphics} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Aspects of the disclosure provide an apparatus having an interface circuit, a processing circuit, and a display device. The interface circuit is configured to receive media presentation description information of media data. The media data includes video content on a two-dimensional (2D) plane that is projected from video content of a sphere surface. The video content on the 2D plane includes a plurality of segment streams having different coverages on the 2D plane. The media presentation description information uses projection based spatial relationship description (P-SRD) to describe the different coverages of the video content on the 2D plane according to the projection. The processing circuit is configured to determine one or more segment streams based on a region of interests for image generation and the P-SRD, select segments in the one or more segment streams, and cause the interface circuit to request and receive the selected segments. ## Claims ### Claim 1 An apparatus, comprising: an interface circuit configured to receive media presentation description information of media data, the media data including video content on a two-dimensional (2D) plane that is projected from video content of a sphere surface according to a projection, the video content on the plane including a plurality of segment streams having different video coverage on the 2D plane, and the media presentation description information using projection based spatial relationship description (P-SRD) to describe the different video coverage by the video content on the 2D plane according to the projection; a processing circuit configured to determine one or more segment streams based on a region of interests for image generation and the P-SRD, select segments in the one or more segment streams, and cause the interface circuit to request and receive the selected segments; and a display device configured to display images generated based on the selected segments. ### Claim 2 (depends on 1) The apparatus of claim 1, wherein the processing circuit is configured to parse a projection indicator from the P-SRD. ### Claim 3 (depends on 2) The apparatus of claim 2, wherein the processing circuit is configured to parse yaw and pitch coordinates in a sphere coordinate system from the P-SRD when the projection indicator is indicative of an equirectangular projection (ERP). ### Claim 4 (depends on 3) The apparatus of claim 3, wherein the processing circuit is configured to parse a minimum value of yaw coordinate, a maximum value of yaw coordinate, a minimum value of pitch coordinate, and a maximum value of pitch coordinate from the projection based spatial relationship description that define a region in the 2D plane. ### Claim 5 (depends on 3) The apparatus of claim 3, wherein the processing circuit is configured to parse yaw and pitch coordinates that define a corner point of a rectangular region, and parse a width and a height of the rectangular region in yaw and pitch coordinates from the P-SRD. ### Claim 6 (depends on 2) The apparatus of claim 2, wherein the processing circuit is configured to parse one or more face indexes from the P-SRD when the projection indicator is indicative of a platonic solid projection. ### Claim 7 (depends on 2) The apparatus of claim 2, wherein the processing circuit is configured to parse coordinates in an Euclidean coordinate system from the projection based spatial relationship description when the projection indicator is indicative of no projection. ### Claim 8 (depends on 1) The apparatus of claim 1, wherein the media presentation description information uses the P-SRD in at least one of an adaptation set level, a representation level and a sub-representation level to describe the different video coverage in the 2D plane according to the projection. ### Claim 9 (depends on 1) The apparatus of claim 1, wherein the processing circuit is configured to parse the media presentation description information to extract a dependency of a first segment stream to a second segment stream, and select segments in the first segment stream and the second segment stream, and cause the interface circuit to request and receive the selected segments. ### Claim 10 (depends on 9) The apparatus of claim 9, wherein the processing circuit is configured to extract at least one of a region dependency, a bandwidth dependency and an image size dependency of the first segment stream to the second segment stream. ### Claim 11 A method for image rendering, comprising: receiving media presentation description information of media data, the media data including video content in a two-dimensional (2D) plane that is projected from video content of a sphere surface according to a projection, the video content in the 2D plane including a plurality of segment streams having different video coverage in the 2D plane, the media presentation description information using projection based spatial relationship description (P-SRD) to describe the different video coverage in the 2D plane according to the projection; determining one or more segment streams based on a region of interests for image generation and the projection based spatial relationship description; selecting segments in the one or more segment streams; transmitting a request for the selected segments; receiving the selected segments; and displaying images generated based on the selected segments. ### Claim 12 (depends on 11) The method of claim 11, further comprising: parsing the projection based spatial relationship description to extract a projection indicator. ### Claim 13 (depends on 12) The method of claim 12, further comprising: parsing yaw and pitch coordinates in a sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of an equirectangular projection (ERP). ### Claim 14 (depends on 13) The method of claim 13, wherein parsing the yaw and pitch coordinates in the sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of the equirectangular projection (ERP) further comprises: parsing a minimum value of yaw coordinate, a maximum value of yaw coordinate, a minimum value of pitch coordinate, and a maximum value of pitch coordinate from the projection based spatial relationship description that define a region in the 2D plane. ### Claim 15 (depends on 13) The method of claim 13, wherein parsing the yaw and pitch coordinates in the sphere coordinate system from the projection based spatial relationship description when the projection indicator is indicative of the equirectangular projection (ERP) further comprises: parsing yaw and pitch coordinates that define a corner point of a rectangular region from the projection based spatial relationship description; and parsing a width and a height of the rectangular region in yaw and pitch coordinates from the projection based spatial relationship description. ### Claim 16 (depends on 12) The method of claim 12, further comprising: parsing one or more face indexes from the projection based spatial relationship description when the projection indicator is indicative of a platonic solid projection. ### Claim 17 (depends on 12) The method of claim 12, further comprising: parsing coordinates in an Euclidean coordinate system from the projection based spatial relationship description when the projection indicator is indicative of no projection. ### Claim 18 (depends on 11) The method of claim 11, further comprising: parsing the media presentation description information to extract a dependency of a first segment stream to a second segment stream; selecting segments in the first segment stream and the second segment stream; transmitting a request for the selected segments in the first segment stream and the second segment stream; receiving the selected segments; and displaying images generated based on the selected segments in the first segment stream and the second segment stream. ### Claim 19 (depends on 11) The method of claim 11, wherein the media presentation description information uses the P-SRD in at least one of an adaptation set level, a representation level, and a sub-representation level to describe the different video coverage in the 2D plane according to the projection. ### Claim 20 (depends on 18) The method of claim 18, wherein parsing the media presentation description information to extract the dependency of the first segment stream to the second segment stream further comprises: extracting at least one of a region dependency, a bandwidth dependency and an image size dependency of the first segment stream to the second segment stream.