# US 11,115,644 B2 · Video generation method and apparatus using mesh and texture data > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,115,644 B2 - Document ID: US11115644B2 - Status: Granted - Kind: B2 - Application number: 16/624,451 - Filed: 2018-06-14 - Published: 2020-07-09 - Granted: 2021-09-07 - Earliest claimed: 2017-06-29 - Assignees: Sony Interactive Entertainment Inc. - Applicants: Sony Interactive Entertainment Inc. - Inventors: Anthony William Godar - Web page: https://patentgrep.com/patent/US11115644B2 ## CPC - H04N 13/275: from three-dimensional [3D] object models, e.g. computer-generated stereoscopic image signals - G06T 9/001: {Model-based coding, e.g. wire frame} - H04N 13/161: Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) - H04N 13/332: Displays for viewing with the aid of special glasses or head-mounted displays [HMD] - H04N 13/366: using viewer tracking - H04N 19/20: using video object coding - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A display system for displaying video content, the display unit including a display controller operable to control the display of at least a region of the video content and a visual acuity identification unit operable to identify at least regions of high visual acuity and low visual acuity of a viewer at display positions corresponding to particular regions of the video content, where the display controller is operable to control the display of video content such that regions of high visual acuity are displayed differently to regions of low visual acuity. ## Claims ### Claim 1 A content generation apparatus comprising: a data generation unit operable to generate mesh and texture data for a virtual scene; and a frame encoding unit operable to encode one or more frames comprising at least a portion of the generated mesh and texture data, wherein the mesh and texture data that is encoded contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene, and wherein the frame encoding unit is operable to encode, in one or more frames, information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed. ### Claim 2 (depends on 1) A content generation method according to claim 1, wherein one or more of the frames comprises change in position information for meshes also comprises additional mesh and texture information. ### Claim 3 (depends on 1) A content generation apparatus according to claim 1, in which the frames output by the frame encoding unit are arranged in a group of pictures structure. ### Claim 4 (depends on 1) A content generation apparatus according to claim 1, wherein the frame encoding unit is operable to encode, in one or more frames, information indicating a range of possible viewpoints that may be generated using that frame. ### Claim 5 (depends on 1) A content generation apparatus according to claim 1, wherein the data generation unit is operable to generate mesh and texture data for objects in the virtual scene that are occluded in one or more viewpoints within the virtual scene. ### Claim 6 (depends on 1) A content generation apparatus according to claim 1, wherein the frame encoding unit is operable to encode, in one or more frames, information indicating a default viewpoint position within that frame. ### Claim 7 (depends on 1) A content generation apparatus according to claim 1, wherein the frame encoding unit is also operable to encode one or more frames comprising information about a change in position of one or more of the meshes in the virtual scene with respect to another encoded frame. ### Claim 8 (depends on 1) A content reproduction apparatus according to claim 1, further comprising: a head-mountable display device. ### Claim 9 A content reproduction apparatus comprising: a frame decoding unit operable to decode one or more frames comprising mesh and texture data, and comprising information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed; and an image rendering unit operable to generate one or more images for display from the one or more decoded frames in dependence upon a specified viewpoint, wherein the mesh and texture data that is decoded from the one or more frames contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene. ### Claim 10 (depends on 9) A content reproduction apparatus according to claim 9, wherein the specified viewpoint is determined in dependence upon one or more of a user input, instructions present in the received frames, events or objects within the scene and/or a viewer's head position and/or orientation. ### Claim 11 A content generating method comprising: generating mesh and texture data for a virtual scene; and encoding one or more frames comprising at least a portion of the generated mesh and texture data, wherein the mesh and texture data that is encoded contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene, and wherein the encoding includes encoding one or more frames comprising information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed. ### Claim 12 A video reproduction method comprising: decoding one or more frames comprising mesh and texture data, and comprising information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed; and generating one or more images for display from the one or more decoded frames in dependence upon a specified viewpoint, wherein the mesh and texture data that is decoded from the one or more frames contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene. ### Claim 13 A non-transitory, computer readable storage medium containing a computer program which, when executed by a computer, causes the computer to execute a content generating method by carrying out actions, comprising: generating mesh and texture data for a virtual scene; and encoding one or more frames comprising at least a portion of the generated mesh and texture data, wherein the mesh and texture data that is encoded contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene, and wherein the encoding includes encoding one or more frames comprising information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed. ### Claim 14 A non-transitory, computer readable storage medium containing a computer program which, when executed by a computer, causes the computer to execute video reproduction method by carrying out actions, comprising: decoding one or more frames comprising mesh and texture data, and comprising information indicating a gearing ratio between a request for a change of viewpoint and a change in viewpoint to be displayed; and generating one or more images for display from the one or more decoded frames in dependence upon a specified viewpoint, wherein the mesh and texture data that is decoded from the one or more frames contains information that may be used to describe any of a plurality of different viewpoints within the same virtual scene.